httpx icon indicating copy to clipboard operation
httpx copied to clipboard

headless chrome wappalyzer detection via js

Open cyberlixio opened this issue 3 years ago • 2 comments

Please describe your feature request:

Currently, httpx does not take advantage of chromium-based wappalyzer detection with the -tech-detect flag, so httpx is missing a lot of technologies when relying solely on fingerprint-based detection.

Describe the use case of this feature:

Introducing browser-based wappalyzer detection will allow us to not only rely on fingerprint-based detection but also Javascript-based detection which will result in detecting more technologies stacks.

What you could do to see if it's something you would like to implement is to compile this rust crate https://github.com/iustin24/wappalyzer which uses browser-based wappaylzer detection and run it against a bunch of hosts then compare the results with httpx and see if it found more technologies.

Hopefully, this is something you might consider, I've been really wanting a tool that can do what I described.

Regards, Blake

cyberlixio avatar Feb 05 '23 01:02 cyberlixio

realy a lot of technologies like CMSs and js library missed using '-tech-detect' , I hope you will enhance that soon

localhost-MouhannadlrX avatar Feb 24 '23 17:02 localhost-MouhannadlrX

I've written a basic version of httpx in rust and you can see the difference in technologies using headless chrome.

image