On Sun, Feb 21, 2021 at 6:44 PM Sean Conner <sean at conman.org> wrote: > It was thus said that the Great Mansfield once stated: > > > > I must admit, I'm woefully lacking skill or background with robots.txt. > It > > seems like it could be a great answer. > > > > A few questions to help me educate myself: > > > <snip> > More about it can be read here [2]. > > -spc > > [1] > https://portal.mozz.us/gemini/gemini.circumlunar.space/docs/companion/robots.gmi > > [2] http://www.robotstxt.org/robotstxt.html Thanks for the links. I'll add this to the TODO list. -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://lists.orbitalfox.eu/archives/gemini/attachments/20210222/c593 548a/attachment.htm>
---
Previous in thread (16 of 20): 🗣️ Petite Abeille (petite.abeille (a) gmail.com)
Next in thread (18 of 20): 🗣️ Jason McBrayer (jmcbray (a) carcosa.net)