Add support for MapDB backed Repositories [DATAKV-113]
Thomas Darimont opened DATAKV-113 and commented
It would be great to have support for MapDB which provides filesystem backed maps that allows you to deal with very large Map like data structures
Reference URL: http://www.mapdb.org/
1 votes, 2 watchers
Eugene Tenkaev commented
What the status of this? I need create temporary large set to remove stale items from the mongodb repository, this thing will be very helpful.
Here is more detailed description of case: Imagine you have eternal service there you request large list of items using pagination REST api. You have save requested items in the MongoDB for further processing.
After some time you request again big list of items using paginated REST api.
And when you save received items you need mark new items. You do this by using MongoDB repository and method exists.
But after you done with requesting, you need to remove stale items that wasn't available during last request. And here you need to store ids that you got during last request in set. But this list of ids large to completely put in memory. So file system backed set will be helpful here.
So here is a case, I say thanks in advance for any propositions for this case. If you need I will add additional clarifications about this case