💾 Archived View for gemini.bunburya.eu › newsgroups › gemini › messages › t7us6a$eof$1@dont-email.me… captured on 2023-06-16 at 16:34:49. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2022-06-11)
-=-=-=-=-=-=-
From: noscript <name@example.com>
Subject: Is there a program for downloading gemini sites?
Date: Fri, 10 Jun 2022 07:34:34 -0000 (UTC)
Message-ID: <t7us6a$eof$1@dont-email.me>
Hi,
I'm looking for a program taking a URL and downloading the gemini pages
like `wget --mirror`.
99.99% of the accesses to my gemini site are spider bots from multiple
data centers around the world, what are these spider bots?
Children: