web-data-extraction topic

List web-data-extraction repositories

iww

97
Stars
13
Forks
Watchers

AI based web-wrapper for web-content-extraction

Scrapegraph-ai

21.9k
Stars
1.9k
Forks
21.9k
Watchers

Python scraper based on AI

crunchbase-scraper

44
Stars
19
Forks
Watchers

Scrape crunchbase companies, people, investors, acquisitions data including website urls, social urls, emails, phone numbers, employee count, funding information etc.

firecrawl

68.4k
Stars
5.3k
Forks
68.4k
Watchers

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

extractor

57
Stars
6
Forks
57
Watchers

Using LLMs and AI browser automation to robustly extract web data

this.url

59
Stars
0
Forks
59
Watchers

The this.url class is designed to fetch and parse URL data, returning an object with structured information that can then be used for machine learning algorithms in a database or other storage.