Add detection for category (browser, bot, scripted, search engine, health monitor)?

[hsluoyz]

Hi all, currently, we only get (browser, OS, device), we also classify some traffic as spider. But this spider" is very weird to appear in the device`` field. I think we should add a new 4th string field called category, its value can be:

1. Browser: normal browsers
2. Bot: like lyticsBot
3. Scripted: like Apache-HttpClient, Python Requests, Wget, Curl, Java, Apache, HeadlessChrome
4. Search engine: like Googlebot, Bingbot, etc.
5. Health monitor: like Rackspace Monitoring, etc.

Does it sound reasonable?

[JaySunSyn]

I would love to have this feature.

How do you currently distinguish between a "real" user request via a browser and a spider/bot/etc. @hsluoyz