Comment by Stuck_In_the_Matrix on 23/02/2023 at 21:13 UTC

4 upvotes, 1 direct replies (showing 1)

View submission: New Management for Pushshift

View parent comment

1. Thanks for the reminder on the list of bugs in that submission. I'm going to take time out tomorrow and this weekend to address as much of the low hanging fruit as possible and involve some of our other engineers on the larger issues (but from looking at some of them, I should be able to make a decent dent in the bugs listed).

Your question about API tokens and pricing tiers deserves a more formal reply involving more of our leadership team but I can say this -- Pushshift will continue to provide the research community with free access to our most popular API endpoints like Reddit while eventually charging for-profit and other organizations that require enhanced access and/or higher rate limits to Pushshift API endpoints.

At some point we will have a key management system / API tokens. Removals are, at present, processed manually but we are training additional people to make that process smoother and faster. Long-term goal will be to automate the process completely.

Let me know if that answers your questions -- I didn't want to get into specifics without conferring with the rest of the team but we should have more details for you and others soon.

Replies

Comment by Watchful1 at 23/02/2023 at 21:19 UTC

4 upvotes, 1 direct replies

Thanks, that's all good to know.

Two more quick questions. What's the best way to contact the team? Direct message that reddit account? Or make a post here and wait till they notice it?

And is there any way to get involved? I'm not exactly looking for a new job, but I'd be happy to help out on a technical level. Either with automating removals or anything else.