Robots.txt and OAI-SearchBot ?
by @jonduv (440), 2 days ago
Hi there,
With the growth of AI search, would it be recommended to "allow" the "OAI-SearchBot" and "ChatGPT-User" in your robots.txt file? If so, what would be the proper syntax? I've read mixed opinions on this. We have a local service-based business. I currently see our brand come up in .ai searches (if that matters). Any suggestions would be great. Thanks so much.
Here is the syntax I found:
User-agent: OAI-SearchBot Allow: /
User-agent: ChatGPT-User Allow: /