💾 Archived View for rawtext.club › ~sloum › geminilist › 002318.gmi captured on 2020-09-24 at 01:17:14. Gemini links have been rewritten to link to archived content
-=-=-=-=-=-=-
Petite Abeille petite.abeille at gmail.com
Thu Jul 23 22:10:03 BST 2020
- - - - - - - - - - - - - - - - - - -
On Jul 23, 2020, at 22:45, Sean Conner <sean at conman.org> wrote:
How do I instruct a Gemini bot with robots.txt,
when there's no way for a Gemini bot to identify itself?
Through a side channel such as the TLS certificate? Robots could identify themselves there.
Otherwise, only User-agent: * wide rules apply.
Alternatively, some creative use of TLS fingerprinting.