💾 Archived View for bbs.geminispace.org › u › istvan › 19357 captured on 2024-12-17 at 15:35:58. Gemini links have been rewritten to link to archived content
-=-=-=-=-=-=-
Re: "Search Engines in Gemini"
How do you add a URL to Kennedy? I’m not indexed (but people linking to me are indexed, and searching for my URL comes up with their pages, so it must not be following links to discover capsules)
Sep 03 · 3 months ago
☕️ Aptor-theHobbit [OP] · Sep 03 at 02:55:
The only thing I did was to
1. add the site link to my capsule for searching of the capsule
— kennedy.gemi.dev/site-search/
2. Try the back linklink search
But it was not showing me any results till today. I think it took a while for the crawler to reach to my capsule.
I also added my capsule link to TLGS using following link
Didn’t think linking to them was a requirement. My capsule has been up about a year with plenty of indexed links to it. Maybe it’s the back link search that I never did.
🕹️ skyjake [mod...] · Sep 03 at 06:42:
@istvan:
Didn’t think linking to them was a requirement.
It likely isn't required... @Acidus will be able to elaborate if this is just a matter of the crawler getting around to indexing the capsule.
I think it may have been due to my robots.txt, which was there in an attempt to stop the content from being hit by web crawlers if someone linked to a document over a Gemini to Web proxy.
My attempt to block spiders from caching may have blocked Kennedy from indexing.
Search Engines in Gemini — I found out that when I search for my capsule on any of the search engines on Gemini, nothing comes up? I tried adding its url in Kennedy as well, few times, still nothing. Its weird since, the crawlers should be working just fine since I do not even have robot.txt in my main path of the capsule. Did anyone else has experienced this before? Its been more than 10 days since I launched my capsule. I hope it shows up in the search at least, just in case someone is cuious...
💬 Aptor-theHobbit · 7 comments · Sep 02 · 3 months ago · #capsule #search_engines