Social Media
Automated traffic—all non-human internet traffic—is growing eight times faster than human traffic, AI-driven traffic—traffic generated by or on behalf of AI systems—is the fastest-growing category of internet traffic, and for the first time, AI systems are not just reading the web but transacting on it.


CrowdSec could probably catch a moderate amount of them, but that is really geared towards bad actors and malicious probing bots.
Fial2ban also wouldn’t work at all here since they aren’t trying brute force attacks, they are just using high bandwidth stealing as much public data from everything possible.
I think cloudflare is also making an alternative (or has already), but it is a tough problem.
Thanks! I use OPNsense, I do already have set several block lists actually like FireHOL 1,2,3 and 4.
I found the community plugin called
os-crowdsec. I will try it set it up: https://docs.crowdsec.net/docs/next/getting_started/install_crowdsec_opnsense/I want to avoid Cloudflare :)… And yes I know fail2ban will not catch these kind of AI bots or DDos attacks. Even if its a brute force attack, most bad actors are using a botnet with 100.000’s of unique IPs… Fail2ban would be no help either in that case.
EDIT: I also found another block list: https://threathive.net/. Which updates every 15 min. This one is great I think as well. So the list would be: https://threathive.net/hiveblocklist.txt