@skyjake, how does gemini://skyjake.fi/~Cosmos/ collect data? specific crawling (antenna+station+...) ? generic crawler?
9 months ago · 👍 cebalrai
[1] gemini://skyjake.fi/~Cosmos/
@skyjake good to know, thank you! · 9 months ago
It does also fetch each posted URL to see if there are links to other known entry URLs, to create the discussion threads. · 9 months ago
It doesn't do crawling. It just follows the various aggregators out there, like Antenna, CAPCOM, smol.pub and Flounder front pages, and collects the feed entry URLs. If Station or Geddit links to a known entry URL, their posts get attached as a "comment" entry in the Cosmos database. · 9 months ago