Re: Bad bots

On Wed, Jun 09, 2021 at 01:35:27PM +0500, Anna “CyberTailor” wrote:
> Who owns a crawler running on IP 140.82.24.154?
> 
> It doesn't respect robots.txt and makes requests too fast. I had to
> ban this IP with a firewall rule.
> 
> This thread is open for complaints on other bad behaving bots.

I'm not sure what purpose publishing the IP address is? You gain nothing
and potentially violate the privacy of a valid user. With that being
said, I don't recommend manually sifting through logs and manually
writing firewall rules. You might want to look into something like
fail2ban which will automatically ban misbehaving visitors for you.
There are also other posts talking about putting your gemini services
behind a reverse proxy which might help.

---

Previous in thread (2 of 4): 🗣️ Kevin Sangeelee (kevin (a) susa.net)

Next in thread (4 of 4): 🗣️ Thomas Groman (tgrom.automail (a) nuegia.net)

View entire thread.