LLMWebCrawler
LLMWebCrawler copied to clipboard
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.
Results
0
LLMWebCrawler issues
Sort by
recently updated
recently updated
newest added