incubator-stormcrawler
incubator-stormcrawler copied to clipboard
Add support for shards in SOLR
Just like it's done in ES, we could route the documents in the statusupdaterbolt based on the host / name or IP and in the spouts check that the number of instances is equal to the # of shards and filter the queries per shard accordingly.
At the moment, we can have only one instance of a spout.
https://solr.apache.org/guide/solr/latest/deployment-guide/solrcloud-shards-indexing.html#document-routing