node-crawler icon indicating copy to clipboard operation
node-crawler copied to clipboard

Parsing errors

Open taxmeifyoucan opened this issue 3 years ago • 1 comments

API has some issues reading certain data from crawler database. Not sure if this is issue with the parser on API side or formatting by crawler. Example of error in api logs:

Parser Error: Invalid length of '1' for input: 'geth'
Parser Error: Invalid length of '6' for input: 'Q-Client/v1.0.8-stable/Geth/v1.10.8-stable-825470ee/linux-amd64/go1.16.15'
1 Version string is invalid: 
2 Version string is invalid: linux-amd64
Parser Error: Invalid length of '6' for input: 'Q-Client/v1.0.8-stable/Geth/v1.10.8-stable-714279ce/linux-amd64/go1.16.15'
Parser Error: Invalid length of '1' for input: 'geth'
Parser Error: Invalid length of '15' for input: 'Geth/enode://91a3c3d5e76b0acf05d9abddee959f1bcbc7c91537d2629288a9edd7a3df90acaa46ffba0e0e5d49a20598e0960ac458d76eb8fa92a1d64938c0a3a3d60f8be4@54.158.188.182:21000,enode://571be7fe060b183037db29f8fe08e4fed6e87fbb6e7bc24bc34e562adf09e29e06067be14e8b8f0f2581966f3424325e5093daae2f6afde0b5d334c2cd104c79@142.132.135.228:21000,enode://269ecefca0b4cd09bf959c2029b2c2caf76b34289eb6717d735ce4ca49fbafa91de8182dd701171739a8eaa5d043dcae16aee212fe5fadf9ed8fa6a24a56951c@65.108.72.177:21000,enode://d2afd84a880543a63f76d03a5e7a512e3b4d811c1d2d899dd9dd250ab093d892f05c559b6822498c5e29ad029ada71a93ad17e4a77f1d83474de417b4757ace2@82.146.35.68:30300,enode://52f736e778b1db7ece0ea2d20e1d2979db88456e7e8392abd7fb2c1bea7b73346a40de97e43615d3baac50b9bae2c16f1b156dd3c41dffd547eaaa6670ca992e@188.120.238.54:30300/v1.10.0-stable(quorum-v22.1.0)/linux-amd64/go1.17.2'

I suppose these incorrect strings are result of parse errors:
image

taxmeifyoucan avatar Aug 26 '22 15:08 taxmeifyoucan

The parsing is still causing issues. Same error logs in API and also issue on the frontend as in screenshot above.

Parses needs to be more versatile.

Version string is invalid: linux-amd64
 -> Error Parsing: 'Geth/v0.8.0-stable-6a28bcae/linux-amd64/go1.17.5/pulse', {geth v0.8.0-stable-6a28bcae {0 0 0 amd64   true} {go1.17.5 } { }}
Parser Error: Invalid length of '3' for input: 'Geth/linux-amd64/go1.18.2'
Parser Error: Invalid length of '1' for input: 'Efireal'

taxmeifyoucan avatar Feb 17 '23 13:02 taxmeifyoucan