💾 Archived View for station.martinrue.com › elektito › 5a3efd58c4c94ab7bb1159fe90fc7117 captured on 2023-11-04 at 12:31:40. Gemini links have been rewritten to link to archived content
⬅️ Previous capture (2023-09-28)
-=-=-=-=-=-=-
Finally added "slow down" support to the crawler, in case any server finds the default rate of one request per second too much. I'm a model citizen now.
6 months ago · 👍 danrl
some of us host on scrappy home lines, dsl with high snr and the like. thanks for slowing down, there is a good amount of crawler traffic in gemini :) · 6 months ago