stormscraper icon indicating copy to clipboard operation
stormscraper copied to clipboard

Published 12 years ago • verified publisher icon tjake
→

Metadata

A Storm based web crawler with Cassandra backend

Results 1 stormscraper issues
Sort by recently updated
recently updated
newest added

FIXME: This doesn't scale, iterator should be lazy

//FIXME: This doesn't scale, iterator should be lazy tableIterator = result.all().iterator(); Seems like key aspect is missing from stormscraper/src/main/java/com/github/tjake/stormscraper/spout/ ScraperSpout.java. Should demo efficient/fast data extraction.

okigan avatar okigan

← Metadata

28
Stars
9
Forks
28
Watchers

Owner

verified publisher icon tjake

Metadata

A Storm based web crawler with Cassandra backend

Back