User-Agent bots

Bots

Crawlers, monitors, and HTTP clients we've seen in real traffic. Who runs them, what they do, and example User-Agent strings.

AI crawlers

Training and retrieval bots from AI labs, the ones people actually search for.

Search & crawlers

Monitors & scanners

HTTP clients

Other

149 bots with real write-ups from our archive. Useragent API