LLMWebCrawler icon indicating copy to clipboard operation
LLMWebCrawler copied to clipboard

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.

Results 0 LLMWebCrawler issues
Sort by recently updated
recently updated
newest added