💾 Archived View for bbs.geminispace.org › u › Aptor-theHobbit › 19358 captured on 2024-12-17 at 15:35:59. Gemini links have been rewritten to link to archived content
-=-=-=-=-=-=-
Re: "Search Engines in Gemini"
The only thing I did was to
1. add the site link to my capsule for searching of the capsule
— kennedy.gemi.dev/site-search/
2. Try the back linklink search
But it was not showing me any results till today. I think it took a while for the crawler to reach to my capsule.
I also added my capsule link to TLGS using following link
Sep 03 · 3 months ago
Didn’t think linking to them was a requirement. My capsule has been up about a year with plenty of indexed links to it. Maybe it’s the back link search that I never did.
🕹️ skyjake [mod...] · Sep 03 at 06:42:
@istvan:
Didn’t think linking to them was a requirement.
It likely isn't required... @Acidus will be able to elaborate if this is just a matter of the crawler getting around to indexing the capsule.
I think it may have been due to my robots.txt, which was there in an attempt to stop the content from being hit by web crawlers if someone linked to a document over a Gemini to Web proxy.
My attempt to block spiders from caching may have blocked Kennedy from indexing.
Search Engines in Gemini — I found out that when I search for my capsule on any of the search engines on Gemini, nothing comes up? I tried adding its url in Kennedy as well, few times, still nothing. Its weird since, the crawlers should be working just fine since I do not even have robot.txt in my main path of the capsule. Did anyone else has experienced this before? Its been more than 10 days since I launched my capsule. I hope it shows up in the search at least, just in case someone is cuious...
💬 Aptor-theHobbit · 7 comments · Sep 02 · 3 months ago · #capsule #search_engines