User-agent: * Disallow: User-agent: archiver Disallow: /posts/ User-agent: webproxy Disallow: /