René Wagner rwagner at rw-net.de
Wed Jan 27 09:40:39 GMT 2021
- - - - - - - - - - - - - - - - - - -
Hi,
simple question: is the following robots.txt format valid in a form that the "disallow" is applied to all User-agents mentioned before?---User-agent: researcherUser-agent: indexerUser-agent: archiverDisallow: about---
or do i need to be more chatty?---User-agent: researcherDisallow: aboutUser-agent: indexerDisallow: aboutUser-agent: archiverDisallow: about---
kind regardsRené