OpenAI names separate user agents in its documentation: OAI-SearchBot indexes sites so they can appear in ChatGPT search features, while GPTBot gathers content that may be used to train its models.
https://developers.openai.com/api/docs/botsThe full answer on making a site ready for AI agents is here:
https://aiwebpageseo.com/blog/is-your-site-ai-agent-readyHave you treated search bots and training bots differently in your own robots.txt, and why?
No replies yet.