💾 Archived View for rawtext.club › ~sloum › geminilist › 002318.gmi captured on 2020-09-24 at 03:12:13. Gemini links have been rewritten to link to archived content

View Raw

More Information

⬅️ Previous capture (2020-09-24)

-=-=-=-=-=-=-

<-- back to the mailing list

Identifying robots (was Re: Open Source Proxy)

Petite Abeille petite.abeille at gmail.com

Thu Jul 23 22:10:03 BST 2020

- - - - - - - - - - - - - - - - - - - 
On Jul 23, 2020, at 22:45, Sean Conner <sean at conman.org> wrote:
How do I instruct a Gemini bot with robots.txt,
when there's no way for a Gemini bot to identify itself?

Through a side channel such as the TLS certificate? Robots could identify themselves there.

Otherwise, only User-agent: * wide rules apply.

Alternatively, some creative use of TLS fingerprinting.