💾 Archived View for station.martinrue.com › bortzmeyer › e6b35514987f4799a270e959cb7bd696 captured on 2023-03-20 at 20:18:47. Gemini links have been rewritten to link to archived content

View Raw

More Information

⬅️ Previous capture (2023-01-29)

➡️ Next capture (2023-04-20)

🚧 View Differences

-=-=-=-=-=-=-

👽 bortzmeyer

RFC 9039 (robots.txt) has been published. Note that 11 % of capsules known by the Lupa crawler have a robots.txt (each with a slightly different syntax). https://www.rfc-editor.org/info/rfc9039

6 months ago

Links

[1] https://www.rfc-editor.org/info/rfc9039

Actions

👋 Join Station

4 Replies

👽 bencollver

gemini://gemini.bortzmeyer.org/rfc-mirror/rfc9309.txt · 6 months ago

👽 bortzmeyer

Too bad it is apparently not possible to edit but, yes, it is 9309, sorry. · 6 months ago

👽 skyjake

Wrong number?

https://www.rfc-editor.org/rfc/rfc9309.html · 6 months ago

👽 bencollver

That links to a document titled Uniform Resource Names for Device Identifiers. How is that related to robots.txt? · 6 months ago