Scrapy

Scrapy Python crawling framework default UA.

Feb 2015
first seen in our archive: 88
distinct User-Agents: 6.5K+
requests seen: client
category

Parse it

Send the User-Agent to the API, device, OS, browser, and bot detection come back in one response. Scrapy is identified by name when the string matches.

curl -s "https://api.parseapi.com/useragent" \
  -H "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.0 Safari/605.1.15" \
  -H "X-Api-Key: $PARSEAPI_KEY"

Create a free key Useragent API