User-Agent bots
Scrapy
Scrapy Python crawling framework default UA.
- Feb 2015
- first seen in our archive
- 88
- distinct User-Agents
- 6.5K+
- requests seen
- client
- category
Official: scrapy.org
Parse it
Send the User-Agent to the API, device, OS, browser, and bot detection come back in one response. Scrapy is identified by name when the string matches.
curl -s "https://api.parseapi.com/useragent" \
-H "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.0 Safari/605.1.15" \
-H "X-Api-Key: $PARSEAPI_KEY"