jonduv

Robots.txt and OAI-SearchBot ?

by @jonduv (458), 1 week ago

Hi there,

With the growth of AI search, would it be recommended to "allow" the "OAI-SearchBot" and "ChatGPT-User" in your robots.txt file? If so, what would be the proper syntax? I've read mixed opinions on this. We have a local service-based business. I currently see our brand come up in .ai searches (if that matters). Any suggestions would be great. Thanks so much.

Here is the syntax I found:

User-agent: OAI-SearchBot Allow: /

User-agent: ChatGPT-User Allow: /

520 Views
0 Upvotes
2 Replies
2 Users
Sort replies:
binayjha
by @binayjha (5529), 5 days ago

User agents used are correct and hope the allow part is in the new line of the robots.txt file. Agents name are provided in the below link for a cross-check,

https://platform.openai.com/docs/bots
jonduv
by @jonduv (458), 5 days ago

@binayjha, thanks so much.

Join the forum to unlock true power of SEO community

You're welcome to become part of SEO Forum community. Register for free, learn and contribute.

Log In Sign up
SEO Directory for agencies
Want to see your Ad here?

Do you have a product or service you'd like to promote on Seoforum? It's easy. Contact us.