6api.com

what about 100 million md5

1

how much mem would use for this? and performance?

about hmget & hmset

1

local res, err hmget(mykey, "one", "two", "three") then `res.one` (not worked) when mykey not exists,the below code not worked ``` if (res[2] ~= nil) then ngx.say('exists') -- when mykey not...

看了源代码中去重使用的2种方法，一个是md5直接放redis set，这个数据量到百万千万后性能不行 另一个使用bloomfilter映射redis bitmap，这2者在爬取URL数量在千万级性能差距有多少？

rt索引不能使用中文

1

plain索引正常，rt索引中文不行 rt索引，不管 chinese_dictionary 是否打开，都无法搜索中文，结果为空，英文可以 ``` index rt { # chinese_dictionary = /usr/local/sphinx/etc/xdict min_word_len = 1 ngram_len = 1 ngram_chars = U+3000..U+2FA1F type = rt path = /usr/local/sphinx/var/data/rt rt_mem_limit = 512M...