💾 Archived View for rawtext.club › ~sloum › geminilist › 001324.gmi captured on 2020-11-07 at 02:08:35. Gemini links have been rewritten to link to archived content

View Raw

More Information

⬅️ Previous capture (2020-09-24)

-=-=-=-=-=-=-

<-- back to the mailing list

robot capabilities

Petite Abeille petite.abeille at gmail.com

Thu Jun 4 05:25:29 BST 2020

- - - - - - - - - - - - - - - - - - - 

The robots exclusion standard defines a simple syntax to control access:

User-agent: *Allow: /

Such syntax can express well-known locations:

Allow: /.well-known/feed --- syndication urlAllow: /.well-known/host-meta -- RFC6415Allow: /.well-known/icon -- favorite icon url

Data encoded in text/gemini. To advertise capabilities.

data:text/plain;charset=utf-8,User-agent%3A%20%2A%0D%0AAllow%3A%20%2F%0D%0AAllow%3A%20%2F.well-known%2Ffeed%0D%0AAllow%3A%20%2F.well-known%2Fhost-meta%0D%0AAllow%3A%20%2F.well-known%2Ficon

data:text/plain;charset=utf-8;base64,VXNlci1hZ2VudDogKg0KQWxsb3c6IC8NCkFsbG93OiAvLndlbGwta25vd24vZmVlZA0KQWxsb3c6IC8ud2VsbC1rbm93bi9ob3N0LW1ldGENCkFsbG93OiAvLndlbGwta25vd24vaWNvbg==

A MAY, RFC wise.-------------- next part --------------An HTML attachment was scrubbed...URL: <https://lists.orbitalfox.eu/archives/gemini/attachments/20200604/5cabc9a5/attachment.htm>