<-- back to the mailing list

Bad bots

remyabel at tilde.team remyabel at tilde.team

Wed Jun 9 12:19:09 BST 2021

- - - - - - - - - - - - - - - - - - - 

On Wed, Jun 09, 2021 at 01:35:27PM +0500, Anna “CyberTailor” wrote:

Who owns a crawler running on IP 140.82.24.154?
It doesn't respect robots.txt and makes requests too fast. I had to
ban this IP with a firewall rule.
This thread is open for complaints on other bad behaving bots.

I'm not sure what purpose publishing the IP address is? You gain nothingand potentially violate the privacy of a valid user. With that beingsaid, I don't recommend manually sifting through logs and manuallywriting firewall rules. You might want to look into something likefail2ban which will automatically ban misbehaving visitors for you.There are also other posts talking about putting your gemini servicesbehind a reverse proxy which might help.