Hi @ahxnamc,

It sounds like you're dealing with a few common issues related to robots.txt and site configuration. Here are some key steps to fix the problem:

1. Check for Duplicate Robots.txt Files: Ensure that only one robots.txt file is accessible at the correct URL (e.g., https://example.com/robots.txt). The multiple entries might be due to your site having different versions (www, non-www, subdomain). Use 301 redirects to point all variations to the preferred version.

2. Canonicalization: Set a canonical URL for your main site version (e.g., https://example.com) in your site's WordPress settings and in the header of each page using a ``.

3. Check Crawl Stats: In Google Search Console, check your Crawl Stats and URL Parameters settings. Ensure Googlebot can access your site’s pages without restrictions.

4. Content Quality: Since your content is AI-generated, ensure it’s original, valuable, and well-optimized. Google may struggle with low-quality or duplicate content, which could affect crawling and indexing.

5. Submit a Sitemap: Submit your XML sitemap to Google Search Console to help Google crawl and index your pages.

Once you've addressed these, Google should be able to crawl and index your pages more efficiently. Let me know if you need more help!