GPTBot

OpenAI crawler used to gather training data for GPT models. Respects robots.txt via GPTBot user-agent.

AI crawler, used for model training and/or live retrieval.

Aug 2023
first seen in our archive: 4
distinct User-Agents: 4+
requests seen: AI
crawler

Official: openai.com/gptbot·Vendor: OpenAI

Parse it

Send the User-Agent to the API, device, OS, browser, and bot detection come back in one response. GPTBot is identified by name when the string matches.

curl -s "https://api.parseapi.com/useragent" \
  -H "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.0 Safari/605.1.15" \
  -H "X-Api-Key: $PARSEAPI_KEY"

Create a free key Useragent API