bloomfilter-rb
bloomfilter-rb copied to clipboard
igrigorik
BloomFilter(s) in Ruby: Native counting filter + Redis counting/non-counting filters
I am trying to load 471,774 items into a native bloomfilter as such: ``` ruby bloom_filter = BloomFilter::Native.new(size: lines.count, raise: true) ``` But after about 34,193 items it gives me...
The RubyGems gemspec property `rubyforge_project` has been removed without a replacement. This PR removes that property. ## Background * [RubyForge was closed down in 2013][1]. * [rubygems/rubygems#2436 deprecated the `rubyforge_project`...
I need to push to store around 300 millions of records I have to use `BloomFilter::Native`, because Redis string has limit 512Mb. My calculations: ``` count_elements = 300_000_000 false_positive =...
Can you add a functionality so the initialization process is as easy as: filter = BloomFilter.new size: 100_000, error_rate: 0.01
In order to fix [crc32 overload issue](https://github.com/igrigorik/bloomfilter-rb/issues/38), I introduced the built-in crc32 `Zlib.crc32`. **This version is no longer compatible with previous versions.** I'm not used to ruby native extension coding,...
I inserted the same input, but I got different `bitmap` on Linux and Mac. I ran the following code. - test.rb ``` require 'cbloomfilter' bf = CBloomFilter.new(16, 1, 7, 1)...
- Fixed various compile time warnings and silenced output during tests - Updated CBloomFilter `bf_load` to check string size and load old style if needed - Added tests to check...
When using `marshal_dump` the bitmap is converted to some format which is 8 times larger than it has to be. Consider the following: ``` [307] pry(main)> filter => #800, :hashes=>6,...
- just use CRC32 - it's fast and works very well for purpose This PR reduces dependencies and complexity while improving performance and silencing some warnings. It also renames "hashes"...
