https://www.reddit.com/r/pushshift/comments/14ei799/pushshift_live_again_and_how_moderators_can/
created by Pushshift-Support on 20/06/2023 at 18:01 UTC
93 upvotes, 28 top-level comments (showing 25)
Dear Reddit community
Earlier this month we shared an update[1] about our collaboration with Reddit to grant access to community-enabled moderation tools developed through the Pushshift API, which would be reinstated for approved Reddit moderators. Today we are updating you that Pushshift is live again and sharing how moderators can request Pushshift access.
Note the process outlined below will be contingent on moderators registering for Pushshift accounts if you don’t already have an account. Each moderator will also need explicit approval from Reddit and the use of Pushshift will be limited to moderation use cases only. This will enable moderators to effectively use these tools to enhance community moderation and enforce guidelines, while protecting the privacy and data security of Reddit's user base.
1. Submit modmail to r/pushshiftrequest using this link[2]. Please include the following details in your request:
​
2. You should receive a message in your inbox from r/pushshiftrequest within one week after your request has been submitted. The message will indicate whether your application has been approved or denied. If approved, your moderator username will be shared with Pushshift for verification.
3: https://api.pushshift.io/signup
4: https://api.pushshift.io/signup
Pushshift has added a search page for authorized users to make it easier for mods to use pushshift. To use it:
1. Log into your pushshift account at https://api.pushshift.io/signup[5][6]
2. If verified, you will be redirected to the search page
3. Search away!
5: https://api.pushshift.io/signup
6: https://api.pushshift.io/signup
Data has been fully backfilled and up to date. No data should be missing.
If you are experiencing issues with Pushshift or have any questions, please send a private message to u/pushshift-support[7].
7: https://www.reddit.com/user/pushshift-support
To help direct members of the Pushshift community to gain API access, we have put together a guide[8] for approved moderators.
8: https://api.pushshift.io/guide
We are excited about this partnership to support the Reddit community. Thank you again for your passion and continued support!
Sincerely,
Pushshift and the Network Contagion Research Institute
Comment by Watchful1 at 20/06/2023 at 18:08 UTC
25 upvotes, 2 direct replies
Is there no way to get a longer term api key or an automated way to get one? Any automated tool using the service for moderation tasks would need to be manually updated every day with a new key. That makes any bots that use it nearly worthless unless someone is willing to update them daily.
Comment by Btan21 at 20/06/2023 at 18:12 UTC
26 upvotes, 1 direct replies
Are there any plans for allowing non-moderators access to the Pushshift API?
Comment by bizude at 21/06/2023 at 01:48 UTC
10 upvotes, 0 direct replies
This sounds like a nice step, but many of the tools which we used won't work "out of the box" without some changes. For example, I used browser extensions which incorporated pushshift.
Will Reddit assist porting some of these tools, if the source is available? Some of these devs are no longer maintaining these tools because pushshift is mod-only now.
Comment by WilhelmWrobel at 20/06/2023 at 23:09 UTC
22 upvotes, 0 direct replies
Comment by shiruken at 21/06/2023 at 02:17 UTC
8 upvotes, 0 direct replies
Could you provide clarity on whether data ingest practices have been changed as a result of the Reddit partnership? For example, if a user deletes their comment on Reddit, are you now mirroring that deletion on Pushshift?
Comment by danke-Empire at 20/06/2023 at 18:16 UTC
5 upvotes, 1 direct replies
Will you still be providing the SSE Stream API[1] using this new bearer token authentication? If so, what does this look like in practice — is the websocket connection valid for the lifetime for the API key (24 hours)?
1: https://github.com/pushshift/reddit_sse_stream
Comment by shiruken at 21/06/2023 at 02:06 UTC*
5 upvotes, 2 direct replies
~~For anyone that's interested, I forked one of the search websites[1] and added support for the new authentication token: https://shiruken.github.io/chearch~~[2]
1: https://adhesivecheese.github.io/chearch/
2: https://shiruken.github.io/chearch~~
Edit: [Chearch](https://adhesive[3] cheese.github.io/chearch/) now supports the authentication token
Comment by [deleted] at 21/06/2023 at 02:24 UTC
5 upvotes, 1 direct replies
[deleted]
Comment by HTC864 at 20/06/2023 at 18:12 UTC
9 upvotes, 1 direct replies
What types of moderation activities do you require Pushshift access for?
Glad it's back in some form, but I was expecting a little more automation. They really want thousands of people sending messages for this?
Comment by HerrX2000 at 21/06/2023 at 18:24 UTC*
3 upvotes, 2 direct replies
As someone who used Pushshift for research in the past. I would greatly appreciate if the scientific community world also get access. At best the data dumps would be available on some uni server behind some research network, so only authorized researcher would have access.
Comment by 9-T-9 at 23/06/2023 at 18:25 UTC
3 upvotes, 1 direct replies
Can you share any updates for allowing access for academic uses? It's urgent to my situation and would love to be able to use the Pushshift API for my research.
Comment by rebutv at 30/06/2023 at 18:38 UTC
3 upvotes, 0 direct replies
so complicated, i miss the old day when i could easily search thing through a single website without all these hassle
Comment by Glad-Acanthaceae-467 at 13/09/2023 at 06:21 UTC
2 upvotes, 0 direct replies
I am a university researcher who used to use pushift to get reddit data for my project. After changes, i duly submitted my academic application to reddit and got an autoresponse and…. Eternal oblivion from reddit… how can i still get access to pushift data? My research, my work -everything is in that data! And i am poor as a … academic …
Comment by teanailpolish at 20/06/2023 at 20:47 UTC
2 upvotes, 0 direct replies
Would it be possible to make the results clickable to take you to the comment/post for context?
Comment by exposecreepsandliars at 04/07/2023 at 04:19 UTC*
2 upvotes, 1 direct replies
I was hopeful for a little bit, but after trying the official tool (https://search-tool.pushshift.io/[1]), I'm kinda speechless.
1: https://search-tool.pushshift.io/
And to add insult to injury, the dash bug is *still a thing months later*, making it impossible to effectively search for any user with a dash in their name. How is this not one of the top things to fix?
How am I supposed to effectively moderate with this?
Comment by MarathonMarathon at 20/06/2023 at 21:52 UTC
3 upvotes, 0 direct replies
still no reddit search idfk why we're considering this a win
Comment by InitiatePenguin at 20/06/2023 at 20:40 UTC
1 upvotes, 1 direct replies
Hi, I accessed pushshift data in the past through a web based GUI. camas.unddit was the most recent incarnation of this tool. I used to also use redditsearch.io but they removed the ability to cross search username and subreddit.
For someone not tech savvy with API keys or PSAW does there exist a user-friendly way for me to continue to use the pushshift data? On
Is "Pushshift Search" this feature?
Comment by norrin83 at 20/06/2023 at 22:24 UTC
-4 upvotes, 2 direct replies
I will repeat my questions you always ignore:
Comment by giddy6661 at 06/08/2023 at 00:30 UTC
0 upvotes, 0 direct replies
Hi... sorry if this is not allowed I don't know where to post this. If I were to purge my account using powerdeletesuite would pushshift still be able to recover everything back? What if I edit the comments before deleting?
Also I heard that reddit archives edited posts/comments too, does that mean when I truly want to take something off of reddit should I edit to multiple times in order to really purge it?
If there's a better place to send this let me know. Thank youu.
Comment by tresser at 21/06/2023 at 17:33 UTC
1 upvotes, 1 direct replies
is the correct procedure for using this system
click on link in mail i got > click green bar > allow reddit access for the next hour > use as needed
repeat full loop as needed?
Comment by [deleted] at 23/06/2023 at 17:56 UTC
1 upvotes, 1 direct replies
[removed]
Comment by luisadoamaral at 25/06/2023 at 12:26 UTC
1 upvotes, 1 direct replies
can we consider a similar thing for researchers with institutional emails and official letters from their institutions
or anything else that could convince Reddit that I need access too
Comment by KKingler at 26/06/2023 at 14:13 UTC
1 upvotes, 0 direct replies
Can you please add permalink of comments/posts to the results? Thank you.
Comment by Furrystonetoss at 27/06/2023 at 14:06 UTC
1 upvotes, 1 direct replies
maybe you can help me further. i wanted to create 2 bots.
one is an approval bot, which checks a user post/com history/activity and compares it with white/blacklists. For the other, pushshift is essential (i would've used psaw), as it's purpose is to get users by coms/posts and certain post details of a very specific subreddit, plus this bot has a function, to not only scan for newest post(coms, but for EVERYONE down to the subs creation.
For the second one i have two questions.
one: during the time pushshift was offline, has the data been restored or is there simply a "black hole" during that time ?
second: what happend with coms/posts that got removed whilst the tool was offline. Will there be ever an opportunity to get banned/deleted content, or rather will tools like reveddit and camas.unddit be ever back online again ?
Comment by Icy-Distribution6887 at 03/07/2023 at 11:43 UTC
1 upvotes, 1 direct replies
I am getting this bot message with the r/pushshiftrequest:
r/pushshiftrequest modmail is reserved for community moderators to apply for Pushshift access for moderation activities and it doesn't appear your reachout fits this criteria.
Why my account doesn't meet the criteria? I have OAuth authorised token from the Reddit API.
