@acidus Another thing that I think would greatly help all of the search engines is to send the lang parameter in the mimetype for gemipedia articles (and welcome page) of languages other than english.
11 months ago
@acidus ... and the lang pages (like gemini://gemi.dev/cgi-bin/wp.cgi/lang/hu) · 11 months ago
@acidus Right, the articles (containing "/view") are disallowed in robots.txt, but the welcome pages for each language are not (which I think is good). But those welcome pages (like gemini://gemi.dev/cgi-bin/wp.cgi/welcome/sh for example) don't have the lang param. · 11 months ago
robots should be preventing Gemipedia from being crawled. good point about the articles though · 11 months ago