ghcrawler icon indicating copy to clipboard operation
ghcrawler copied to clipboard

Crawl GitHub APIs and store the discovered orgs, repos, commits, ...

Results 28 ghcrawler issues
Sort by recently updated
recently updated
newest added

Bumps [mongodb](https://github.com/mongodb/node-mongodb-native) from 2.2.11 to 3.1.13. Commits c6f417e chore(release): 3.1.13 210c71d fix(db_ops): ensure we async resolve errors in createCollection 5ad9fa9 fix(changeStream): properly handle changeStream event mid-close (#1902) e806be4 fix(bulk): honor...

dependencies

This PR adds functionality to crawl a user's events. There is one test that is not currently passing. I'd appreciate some help figuring out how to get that last test...

The problem lies here: https://github.com/microsoft/ghcrawler/blob/0ac110780f4e8ec915dfb47f55e55cccf80892d7/lib/crawler.js#L30-L37 The path is not only `/orgList` https://github.com/microsoft/ghcrawler/blob/0ac110780f4e8ec915dfb47f55e55cccf80892d7/lib/crawler.js#L32 When reassigning `this.options.orgList`, `this.options.orgList.map(element => element.toLowerCase())` should be used and not `orgList.value.map(element => element.toLowerCase())`. https://github.com/microsoft/ghcrawler/blob/0ac110780f4e8ec915dfb47f55e55cccf80892d7/lib/crawler.js#L35

I want to get all data avilable on repo, which includes traffic data and issues and their comments. I created personal token under my account and provided all access excel...

I've been using GHCrawler for about a year with great success - thanks for the awesome tool :) Today, I got a deprecation notice from Github when the crawler fired...

Elastic search seems like an interesting choice for store technology. Would give live access to the data in a queryable way.

enhancement
help wanted

Currently on startup we look to see if there is a known config from the config provider, if there is, we use it. That's great for production scenarios but in...

The current code traverses statuses but does not really do anything with them. They can be interesting indicators of project and contributor activity.

enhancement
help wanted

Our goal is to track contributions by our employees to any open-source project on GitHub. So we'll need to look at each employee’s commits, pull requests, issues, etc. We can...