Reddit Data API Update: Changes to Pushshift Access [Pushshift is in violation of the Reddit Data API terms and has been unresponsive despite multiple outreach attempts. Reddit is suspending Pushshift's access to the Data API starting today]

/r/modnews/comments/134tjpe/reddit_data_api_update_changes_to_pushshift_access/

created by shiruken on 01/05/2023 at 17:34 UTC

131 upvotes, 12 top-level comments (showing 12)

Comments

Comment by Btan21 at 01/05/2023 at 18:13 UTC

38 upvotes, 2 direct replies

Concerning news. Might affect those like me who depend on Reddit data for academic research.

Comment by IsilZha at 01/05/2023 at 20:30 UTC

17 upvotes, 1 direct replies

Well that didn't take long. Even if they contacted Jason on day 1, could Pushshift even make any changes that would be acceptable under the new API rules and function?

Comment by safrax at 01/05/2023 at 18:53 UTC

37 upvotes, 6 direct replies

I feel pretty confident in saying that the changes Reddit is making for their IPO will eventually kill Reddit. Their API has been a large part of what has made them successful and while I get them wanting to kill pushshift specifically, it's garbage that the blast radius from these changes will significantly impact so many other tools that make reddit usable. The new interface and their app is an absolute dumpster fire that they've learned nothing from.

Oh well. Something will take reddit's place eventually, maybe not too much longer after these API changes. Sucks that all the data will essentially go *poof* though.

Comment by rip-pushshift at 01/05/2023 at 18:19 UTC

20 upvotes, 1 direct replies

After seeing the dumpster fire that is the first-party app, there's basically 0 chance Reddit can reproduce what Pushshift was capable of, especially for moderators.

Comment by FaceDeer at 01/05/2023 at 20:19 UTC

9 upvotes, 0 direct replies

Well, I guess it's time for me to wave goodbye to all the future AIs that are training on my comments in the old Pushshift archives. I hope you got enough context from the things I've said here over the years to make some happy thoughts.

Comment by tasbir49 at 01/05/2023 at 20:41 UTC

8 upvotes, 2 direct replies

Only way Pushshift can possibly survive is through webscraping :(

Comment by grejty at 01/05/2023 at 18:26 UTC

15 upvotes, 5 direct replies

I use pushshift for my Bachelor which is due to 22nd May and I dont know what am I supposed to do right now..

They are saying you didnt reply to them? Why not

Comment by swamprt5000 at 01/05/2023 at 22:49 UTC

5 upvotes, 1 direct replies

Can someone post (or DM me) a full db dump? Or instructions on how to do it? It's only a matter of time till pushshift is shutdown and all the data is lost.

Comment by daronjay at 01/05/2023 at 21:21 UTC

6 upvotes, 2 direct replies

Truth is, we need to **replace** pushshift with an opensource project, an unresponsive owner is death to any project.

There are numerous people in this sub who have the chops to build a replacement, even if it has to charge a nominal subscription to be able to afford Reddits paid api access.