Update: Google Wants to Change Robots.txt and Seeking Suggestions

Google is looking to make changes in the 30 years old robots.txt to accommodate mainly AI/ML. Here are the details:

https://blog.google/technology/ai/ai-web-publisher-controls-sign-up/

To participate in the discussion use the below link to register:

https://services.google.com/fb/forms/ai-web-publisher-controls-external/