crawling

List your site in our Directory

SEO Directory is now out and ready to help you reach our users and visitors from all around the world.

Do you offer SEO services as an Individual or Agency? Do you run a SEO, marketing or analytics related SaaS? Great! These work for our Directory.

New

Affordable Pricing

What is the Query to add in robots.txt for blocking URLs has some special characters?

by @rchalana (122), 9 months ago

I was going through the Google Search Console pages issues and one of the issue reason is "Alternate page with proper canonical tag" and this has some URLs whic...

robots.txt crawling google search console

Share Report

Join the forum to unlock true power of SEO community

You're welcome to become part of SEO Forum community. Register for free, learn and contribute.

That's all we have in crawling. Looking for something else? Go ahead and ask!

List your site in our Directory

What is the Query to add in robots.txt for blocking URLs has some special characters?

Join the forum to unlock true power of SEO community

Leaderboard

Categories