💾 Archived View for rawtext.club › ~sloum › geminilist › 006661.gmi captured on 2023-11-14 at 09:11:48. Gemini links have been rewritten to link to archived content

View Raw

More Information

⬅️ Previous capture (2021-11-30)

-=-=-=-=-=-=-

<-- back to the mailing list

Bad bots

Anna “CyberTailor” cyber at sysrq.in

Wed Jun 9 09:35:27 BST 2021

- - - - - - - - - - - - - - - - - - - 

Who owns a crawler running on IP 140.82.24.154?

It doesn't respect robots.txt and makes requests too fast. I had toban this IP with a firewall rule.

This thread is open for complaints on other bad behaving bots.