Comment by Watchful1 on 31/05/2023 at 01:11 UTC

8 upvotes, 1 direct replies (showing 1)

View submission: Advancing Community-Led Moderation: An Update on How NCRI/Pushshift and Reddit, Inc. are Working Together

View parent comment

Ingesting reddit content is relatively simple. It would be nice if they opensourced their implementation, but anyone really interested can just build one themselves.

But replicating the database structure and api capable of handling the loads pushshift did is a lot of detailed server setup and configuration that isn't that easy to publish and wouldn't be that useful anyway unless you bought all the same hardware they did.

Replies

Comment by HQuasar at 31/05/2023 at 01:22 UTC

3 upvotes, 0 direct replies

Right. That's why I hoped a smaller scale implementation limited to the top subs would be relatively easy to setup.