Robots.txt and OAI-SearchBot ?
by @jonduv (467), 1 month ago
Hi there,
With the growth of AI search, would it be recommended to "allow" the "OAI-SearchBot" and "ChatGPT-User" in your robots.txt file? If so, what would be the proper syntax? I've read mixed opinions on this. We have a local service-based business. I currently see our brand come up in .ai searches (if that matters). Any suggestions would be great. Thanks so much.
Here is the syntax I found:
User-agent: OAI-SearchBot Allow: /
User-agent: ChatGPT-User Allow: /
by @binayjha (5709), 1 month ago
User agents used are correct and hope the allow part is in the new line of the robots.txt file. Agents name are provided in the below link for a cross-check,
https://platform.openai.com/docs/bots
by @jonduv (467), 1 month ago
@binayjha, thanks so much.
Want to see your Ad here?
Do you have a product or service you'd like to promote on Seoforum? It's easy. Contact us.