👽 marginalia

Anyone want a fun dataset to play with? I've published a link database from my search engine here: https://downloads.marginalia.nu/

2 years ago · 👍 kevinsan, haze, staticvoid

Links

https://downloads.marginalia.nu/

Actions

👋 Join Station

3 Replies

👽 staticvoid

I've put it on IPFS: QmWfyrQXfkP9KxgQbzTpD1SN1NFBHNnXMRRyj5TxsiL4bZ · 2 years ago

👽 marginalia

@haze: Yeah it's production data from search.marginalia.nu; I do my own crawling and everything. · 2 years ago

👽 haze

Ohhh nice! Something I can play with!!

I'm curious, how was this data collected? You built your down crawler? · 2 years ago