API has been taken down

https://www.reddit.com/r/pushshift/comments/13mhuzq/api_has_been_taken_down/

created by skylabspiral on 20/05/2023 at 04:29 UTC

87 upvotes, 20 top-level comments (showing 20)

API returns "Check back in the next few weeks for updates. - Pushshift team (May 19, 2023)" for all endpoints

Comments

Comment by signalhunter at 20/05/2023 at 05:24 UTC

27 upvotes, 1 direct replies

All good thing must come to an end, huh...

Event timeline in EST, according to my scraper logs:

2023-05-19 20:18:11: Online
2023-05-19 20:18:13: HTTP 521 (Cloudflare timeout)
2023-05-19 20:18:43: HTTP 404 [10min sleep]
2023-05-19 20:28:44: HTTP redirect loop [5m sleep, scraper quits due to excessive retries]
now: Proper redirect to notice

Comment by XxGod_fucker69xX at 20/05/2023 at 05:03 UTC

41 upvotes, 2 direct replies

Where were you when pushshift was kil

Comment by Thubbe42 at 20/05/2023 at 05:14 UTC

13 upvotes, 1 direct replies

I was literally working with it 7 hours ago, then went to use the thing I had built and it was dead. Legit killed during testing

EDIT: I got the timing wrong, I was working on it 4 hours ago

Comment by Btan21 at 20/05/2023 at 07:11 UTC

23 upvotes, 4 direct replies

I hope they're able to reach upon a good agreement with Reddit that's beneficial to both mods and researchers.

Comment by grejty at 20/05/2023 at 12:20 UTC

10 upvotes, 1 direct replies

Is there a way to catch this "error" via PMAW? I would like to catch it and add it to my .log file as a proof for my Bachelor that pushshift is done :D

Comment by skylabspiral at 20/05/2023 at 04:33 UTC

7 upvotes, 0 direct replies

Elasticsearch is down as well, just showing an access denied message via Cloudflare, but unsure how long that's been happening: https://elastic.pushshift.io

Comment by reercalium2 at 20/05/2023 at 18:31 UTC

11 upvotes, 2 direct replies

Better get seeding those torrents if you don't want the data gone forever

Comment by Undescended_tester at 22/05/2023 at 10:34 UTC

6 upvotes, 1 direct replies

This would be a good time for the pushshift team to make a rare apearance...

Comment by shiruken at 20/05/2023 at 14:48 UTC

10 upvotes, 0 direct replies

RIP

Comment by Noxian16 at 21/05/2023 at 00:09 UTC*

10 upvotes, 1 direct replies

What the fuck man, how are we supposed to search for posts now? How are we supposed to find old posts by date? Reddit's search is utter garbage. Fuck Reddit admins. I might have to quit this website now that it's become useless.

Comment by iKR8 at 20/05/2023 at 19:46 UTC

6 upvotes, 1 direct replies

RIP in peace 😭

You served us well

Comment by AndrewCHMcM at 20/05/2023 at 09:29 UTC

8 upvotes, 1 direct replies

TL;DR: Pushshift is in violation of our Data API Terms

Guess that meant "violation because they provide any data to users at all"

Comment by TCA360 at 21/05/2023 at 16:44 UTC

3 upvotes, 0 direct replies

Yea almost all of the Reddit searches aren't working (some haven't been working for some time). Kept trying one after one, and either they had an error, took forever to load when I searched, or they redirected you completely.

Comment by notamoonshot at 24/05/2023 at 18:12 UTC

3 upvotes, 0 direct replies

rip, used it on a couple of projects, it was good while it last

Comment by dniepr at 20/05/2023 at 10:16 UTC

4 upvotes, 0 direct replies

Rip

Comment by sidenotez at 20/05/2023 at 14:31 UTC

5 upvotes, 0 direct replies

Rip Pushshift

Comment by Max8967 at 20/05/2023 at 22:08 UTC

5 upvotes, 0 direct replies

Thank you for all those years of service, you will be remembered