crawl4ai [Bug]: arun_many error when using BFSDeepCrawlingStrategy

crawl4ai version

0.5.0.post8

Expected Behavior

As far as I understand, arun_many() should work with any strategy. I've tested, and when running with default strategy, it works.

Current Behavior

But when I add a deep_crawl_strategy=BFSDeepCrawlStrategy, then it throws the error: Error Message: 'async_generator' object has no attribute 'status_code'

Is this reproducible?

Yes

Inputs Causing the Bug

Steps to Reproduce

To see the expected behaviour, run: python arun_many_bug.py

Then to see the error, run: python arun_many_bug.py bfs

Code snippets

import asyncio

from crawl4ai import (
    AsyncWebCrawler,
    CrawlerRunConfig,
    BFSDeepCrawlStrategy,
    CacheMode,
)

async def basic_deep_crawl(bfs: bool = False):

    if bfs:
        print('-- BFS config --')
        config = CrawlerRunConfig(
            deep_crawl_strategy=BFSDeepCrawlStrategy(
                max_depth=1,
                max_pages=2,
                include_external=False,

            ),
            cache_mode=CacheMode.BYPASS,
            stream=True,
        )
    else:
        print('-- Default config --')
        config = CrawlerRunConfig(
            cache_mode=CacheMode.BYPASS,
            stream=True,
        )

    async with AsyncWebCrawler() as crawler:

        async for result in await crawler.arun_many(urls=['https://crawl4ai.com'], config=config):
            print('len(HTML): ', len(result.html))
            print('Success: ', result.success)
            print('Error Message: ', result.error_message)


if __name__ == "__main__":
    import sys
    if len(sys.argv) > 1 and sys.argv[1] == 'bfs':
        asyncio.run(basic_deep_crawl(True))
    else:
        asyncio.run(basic_deep_crawl(False))