💾 Archived View for rawtext.club › ~sloum › geminilist › 006665.gmi captured on 2023-11-14 at 09:11:37. Gemini links have been rewritten to link to archived content

View Raw

More Information

⬅️ Previous capture (2021-11-30)

-=-=-=-=-=-=-

<-- back to the mailing list

Bad bots

Thomas Groman tgrom.automail at nuegia.net

Wed Jun 9 13:39:59 BST 2021

- - - - - - - - - - - - - - - - - - - 

On Wed, 9 Jun 2021 13:35:27 +0500Anna “CyberTailor” <cyber at sysrq.in> wrote:

Who owns a crawler running on IP 140.82.24.154?
It doesn't respect robots.txt and makes requests too fast. I had to
ban this IP with a firewall rule.
This thread is open for complaints on other bad behaving bots.

how about just putting rate limiting into your server?

-- _______________________________________ / Against his wishes, a math teacher's \| classroom was remodeled. Ever since, || he's been talking about the good old || dais. His students planted a small || orchard in his honor; the trees all |\ have square roots. / --------------------------------------- \ \ /\ /\ //\\_//\\ ____ \_ _/ / / / * * \ /^^^] \_\O/_/ [ ] / \_ [ / \ \_ / / [ [ / \/ _/ _[ [ \ /_/