raven icon indicating copy to clipboard operation
raven copied to clipboard
verified publisher icon CycodeLabs

crawl: print the real page number

Open elad-pticha opened this issue 2 years ago • 0 comments

Due to GitHub API limitations, we are querying pages 1-10 and changing the query start and end page all the time. Currently, we are printing. The relational page number (1-10) and not the real one:

image

Change the logging to log the real page number to track progress.

elad-pticha avatar Oct 29 '23 14:10 elad-pticha