OAI-SearchBot

OpenAI crawler for SearchGPT / ChatGPT search results — separate from training crawls.

AI crawler, used for model training and/or live retrieval.

Aug 2024
first seen in our archive: 6
distinct User-Agents: 6+
requests seen: AI
crawler

Official: openai.com/gptbot·Vendor: OpenAI

Parse it

Send the User-Agent to the API, device, OS, browser, and bot detection come back in one response. OAI-SearchBot is identified by name when the string matches.

curl -s "https://api.parseapi.com/useragent" \
  -H "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.0 Safari/605.1.15" \
  -H "X-Api-Key: $PARSEAPI_KEY"

Create a free key Useragent API