@acidus Another thing that I think would greatly help all of the search engines is to send the lang parameter in the mimetype for gemipedia articles (and welcome page) of languages other than english.
2 years ago
@acidus ... and the lang pages (like gemini://gemi.dev/cgi-bin/wp.cgi/lang/hu) · 2 years ago
gemini://gemi.dev/cgi-bin/wp.cgi/lang/hu
@acidus Right, the articles (containing "/view") are disallowed in robots.txt, but the welcome pages for each language are not (which I think is good). But those welcome pages (like gemini://gemi.dev/cgi-bin/wp.cgi/welcome/sh for example) don't have the lang param. · 2 years ago
gemini://gemi.dev/cgi-bin/wp.cgi/welcome/sh
robots should be preventing Gemipedia from being crawled. good point about the articles though · 2 years ago