gemini.git

going-flying.com gemini git repository

summary

tree

log

refs

18e4ee12f93bf781757cc55820a594ae66d867f6 - Matthew Ernisse - 1675950805

I think perhaps several crawlers do not lowercase tokens while parsing...

view tree

view raw

diff --git a/robots.txt b/robots.txt
index 7b40282..b47e184 100644
--- a/robots.txt
+++ b/robots.txt
@@ -1,3 +1,3 @@
-User-Agent: *
+User-agent: *
 Disallow: /cgi-bin
 Disallow: /git