Code-Pile icon indicating copy to clipboard operation
Code-Pile copied to clipboard
verified publisher icon CarperAI

Github issue scraper

Open vanga opened this issue 3 years ago • 0 comments

This PR contains Big query queries and Github graphql API scraping code for (pre-2015 issues + comments). This is not easily reusable code with easily pluggable configurations. This works and acts as a reference for the work done to prepare the github issues dataset.

Further work will need to be done into making the code clean and turn it into well abstracted APIs. Feel free to close the PR if something like this shouldn't exist in the main repo.

vanga avatar Nov 19 '22 05:11 vanga