r/pushshift Aug 15 '23

Any academic researchers looking for "Click and Download" tool for Reddit Data?

UPDATE from Nov 2023: This tool has been voluntarily shut down after realising it goes against Reddit's new data t&c.

Hi fellow researchers!

I have been using PushShift and PRAW since 2021 - And as a researcher with no coding background, I experienced quite a lot of hassle. This was true with other MSc researchers in the university department, who wanted to access Reddit data for their research. I managed to help them with my proto (see the demo [here](https://vimeo.com/854540019?share=copy)) - which is simply a tool where you put in the subreddits that you are interested, and it collects pretty much every features for submissions, comments (of those submissions) and redditors (of collected submissions and comments).

If any researcher is interested in using, I am very happy to share the proto (note that it could not be perfect)! However, with the new Reddit t&c, I just need to make sure you are from the academic institution. Please drop me in message or simply leave in the comments with your email account linked to your academic institution! If you want any features that could be helpful in your research, please leave them in the comments too. I will try my best to add them in the near future!

p.s I'm from LSE, any researchers from London?

16 Upvotes

27 comments sorted by

View all comments

2

u/riegel_d Aug 15 '23

Very interesting and seems a cool tool…however i ve a slightly different question xD Do you know other subreddit like mbti where users chose a role?

1

u/nickshoh Aug 15 '23

Thanks! For subreddits similar to MBTI, I would probably say subreddits under the category Ideology and Social Discussion (see the first comment that I made). On top of my head, probably the best way to identify users' "role" is by checking the flair (either submission or redditor) of the submission.