Sai Shreyas Bhavanasi

Error scraping some pages

1

The following code: ```py import asyncio from crawl4ai import AsyncWebCrawler async def main(): async with AsyncWebCrawler(verbose=True) as crawler: result = await crawler.arun(url="https://jobs.ashbyhq.com/writer/1c5617a6-3295-4333-83a0-346987e7be78") asyncio.run(main()) ``` Returns: ``` Warning: Synchronous WebCrawler is...

× after_goto() got an unexpected keyword argument 'context'

1

I am not able to use hooks. I followed the docs to setup this example ```py import asyncio from crawl4ai import AsyncWebCrawler from crawl4ai.async_crawler_strategy import AsyncPlaywrightCrawlerStrategy from crawl4ai.cache_context import CacheMode...

How to "track" async calls?

1

I have a series of links I am trying to analyze the redirection for. a simple 301 redirect is not working so using playwright I know I can do page.url...

update_proxy not in codebase

1

I was trying to update the proxies, but looks like that function does not exist in the codebase. Only mention is in the docs  ### Problem I would like...