WebToEpub icon indicating copy to clipboard operation
WebToEpub copied to clipboard

Sites like freewebnovel.com is now asking to slow down webtoepub which greatly add parsing time.

Open zicodm opened this issue 2 years ago • 8 comments

Can you please a fix to this? I've only used freewebnovel.com but I hope it doesn't spread to other sites as well.

zicodm avatar Jun 23 '23 08:06 zicodm

Uploading Screenshot_2023-06-23-15-23-30-082_com.tokopedia.tkpd~2.jpg…

zicodm avatar Jun 23 '23 08:06 zicodm

@zicodm There's no screenshot, you just need to copy/paste it into GitHub.

dteviot avatar Jun 24 '23 21:06 dteviot

@zicodm I don't understand the problem. If site is asking WebToEpub to slow down, then things will take longer. Not slowing down WebToEpub can result in you IP Address being blocked.

dteviot avatar Jun 28 '23 09:06 dteviot

I understand your point, indeed. I also use it occasionally, perhaps once a month. However, I have a feeling that today the site's parsing time will slow down, and tomorrow it might even block the parsing support. I guess it's inevitable. Thanks for your replies; I sincerely appreciate it

zicodm avatar Jun 28 '23 10:06 zicodm

@zicodm you could try to limit your request per second. A lot of websites slow you down if you request too many pages per second. Example: You request 10 pages a second -> website says slow down and wait 5min before next request -> WebToEpub resumes after 5min. If you slow down you requests like 1 Page per 3 seconds -> 20 Pages per minute most websites don't complain and it is much faster (10 pages in 5min vs. 100 pages in 5min). You can read here how to do it: https://github.com/dteviot/WebToEpub/wiki/Advanced-Options#manual-throttledelay-per-chapter

gamebeaker avatar Jul 01 '23 11:07 gamebeaker

There are more and more site that limite the parsing now.

Before, freewebnovel wasn't like that.

Flwk avatar Jul 10 '23 19:07 Flwk

My biggest fear has already arrived. My go to site which is freewebnovel.com (innread.com now) and novelfull.net already block the support. It was fun while it lasted haha

zicodm avatar Aug 13 '23 06:08 zicodm

Does the regular manually adding parsing support works? They already block the automatic parsing, I don't want to kinda wasting time manually adding them

zicodm avatar Aug 13 '23 06:08 zicodm