robots.txt for Gemini formalised

On Sun Nov 22, 2020 at 11:51 PM EST, John Cowan wrote:
> It is the agent of an arbitrarily large number of users.

So is every other user agent. It will never make more requests than
there are users who are asking for content. It is not special.

---

Previous in thread (16 of 70): 🗣️ Sean Conner (sean (a) conman.org)

Next in thread (18 of 70): 🗣️ Emilis (emilis (a) emilis.net)

View entire thread.