cm0002@lemmy.world to Technology@lemmy.worldEnglish · 2 months agoOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comexternal-linkmessage-square25linkfedilinkarrow-up1390arrow-down14
arrow-up1386arrow-down1external-linkOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 2 months agomessage-square25linkfedilink
minus-squarehenfredemars@infosec.publinkfedilinkEnglisharrow-up28·2 months agoEven mainly text-mode sites like LWN are feeling the strain and finding it hard to support all this parasite bots.
minus-squarezonnewin@feddit.nllinkfedilinkEnglisharrow-up12·2 months agoSo don’t support them. Block them!
minus-squarePlutoniumAcid@lemmy.worldlinkfedilinkEnglisharrow-up21·2 months agoSure, but the challenge is how to block them without putting undue load on humans. In the olden days, you’d just host a webserver and be done with it. Today you need elaborate setups to trick bots. It’s a losing proposition.
minus-squarewhyNotSquirrel@sh.itjust.workslinkfedilinkEnglisharrow-up5·2 months agoIs there a tools to not have to manually block them? Like an updated list of AIshit IP?
Even mainly text-mode sites like LWN are feeling the strain and finding it hard to support all this parasite bots.
So don’t support them. Block them!
Sure, but the challenge is how to block them without putting undue load on humans.
In the olden days, you’d just host a webserver and be done with it. Today you need elaborate setups to trick bots. It’s a losing proposition.
Is there a tools to not have to manually block them? Like an updated list of AIshit IP?