💾 Archived View for station.martinrue.com › acidus › b08121dd260046fc83c0ac05c651b337 captured on 2023-03-20 at 18:58:27. Gemini links have been rewritten to link to archived content
-=-=-=-=-=-=-
I used all the content from previous crawls by my search engine Kennedy to construct a searchable archive! It's just like the Internet Archive's Wayback machine, but for Gemini. 2 million+ URLs/versions, going back to Jan 2022.
Example: gemini://kennedy.gemi.dev/archive/cached?url=gemini%3a%2f%2fdrewdevault.com%2f&t=637898933801779424&raw=False
You can enter and exact URL, or just search for part of a URL, like searching for a domain name
gemini://kennedy.gemi.dev/
21 hours ago · 👍 cobradile94, skyjake, jo, astroseneca, warpengineer, mozz
[2] gemini://kennedy.gemi.dev/
@danrl sure is. The Gemini subset of Robots.txt talks specifically about this.
gemini://gemini.circumlunar.space/docs/companion/robots.gmi
Basically, set "archiver" exclusion rules in your robots.txt. This allows your capsule to be crawled and available for search engines, without being archived. Or just deny all crawlers. Whatever you feel most comfortable with.
I'll also add some more clear language and a way to contact me to opt out as well · 2 hours ago
@skyjack. fixed. Thanks · 2 hours ago
is there a way to opt out capsules,?like with the internet archive which used to follow robots.txt (but then stopped which i find quite audacious, but that’s a different story) · 4 hours ago
This is the archive _verision_ of
A small typo... 🤓 · 13 hours ago
That’s awesome! Gemini needs to be preserved the same way the Clearnet does! I really appreciate the work you’re doing here! 😁 · 17 hours ago