👽 marginalia

Anyone want a fun dataset to play with? I've published a link database from my search engine here: https://downloads.marginalia.nu/

1 year ago · 👍 kevinsan, haze, staticvoid

Links

[1] https://downloads.marginalia.nu/

Actions

👋 Join Station

3 Replies

👽 staticvoid

I've put it on IPFS: QmWfyrQXfkP9KxgQbzTpD1SN1NFBHNnXMRRyj5TxsiL4bZ · 1 year ago

👽 marginalia

@haze: Yeah it's production data from search.marginalia.nu; I do my own crawling and everything. · 1 year ago

👽 haze

Ohhh nice! Something I can play with!!

I'm curious, how was this data collected? You built your down crawler? · 1 year ago