💾 Archived View for gemplex.space › crawler captured on 2024-02-05 at 09:23:49. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2023-04-19)
-=-=-=-=-=-=-
Gemplex tries to be slow and careful when crawling the Geminispace. robots.txt limitations are honored, and queries are timed so that a single host is not hit more than once a second. "SLOW DOWN" responses from servers (code 44) are also honored.
The crawler's user-agent string is "elektito/gemplex". You can use this user-agent to set limitations specific to the Gemplex crawler. Any limitations set for "crawler", "indexer", and "researcher" crawlers are always taken into account, as described in the spec:
robots.txt Specification for Gemini
If there are any issues, you are welcome to contact the author at: