💾 Archived View for rawtext.club › ~sloum › geminilist › 004943.gmi captured on 2023-09-08 at 17:32:54. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2021-11-30)
-=-=-=-=-=-=-
René Wagner rwagner at rw-net.de
Wed Jan 27 14:38:48 GMT 2021
- - - - - - - - - - - - - - - - - - -
Thanks for the replys.
I've opted for the first version at the moment.Off course no one knows how exactly crawlers out there are implemented or if they obey robots.txt at all.
Atleast i can serve a valid robots.txt now.
cheersRené