Peter Kleissner

Results 15 issues of Peter Kleissner

Hi, maybe you want to add support for Intelligence X? We operate a search engine for OSINT: https://intelx.io We have a SDK with code samples here: https://github.com/IntelligenceX/SDK

If somebody has time, it would nice to have an https://intelx.io module for your project. We have a SDK here with some code samples (including Go code): https://github.com/IntelligenceX/SDK

enhancement
help wanted
good first issue
modules

Maybe you want to add Intelligence X as source for finding emails? Example: https://intelx.io/?s=nsa.gov&pb=1 ![image](https://user-images.githubusercontent.com/13511064/62945202-9a434500-bdde-11e9-8cdd-8354d77cdb09.png) There's a free SDK with Python sample code: https://github.com/IntelligenceX/SDK

I just realized that `index.numKeys` is a 32-bit uint, and there's `MaxKeys = math.MaxUint32` 😲 I think it would make sense to change it to 64-bit (any reason why we...

We are recently running into this problem which prevents the database from growing. Every time we call `db.Put` we get this error message: ``` truncate D:\Database\main.pix: The requested operation could...

windows

I read the code and documentation and wanted to ask if there is a specific reason why you are discarding the old index files and always recreating them? It sounds...

The crawler should optionally parse image tags that are in the form `` and use it as input for crawling (just as it would consider `` links to images). I'm...

The current stop functionality via `Crawler.Stop` is insufficient for multiple reasons: * Calling `Stop` twice results in a panic (because it would close `c.stop` twice) * Inside the functions `Extender.Visit`...

Implement the code for #69 Parsing image tags to include them in crawling. By default the new setting `ParseImageTags` is set to false, so the current default behavior does not...