hazelwwwrong

Urgent for help! About crawel request sudden drop

by @hazelwwwrong (145), 2 years ago

Anybody occur sudden drop of crawl request situation? The crawl request of my site drop dramatically from daily 125k to 1k, nearly drop ove3 90%.

1381 Views
0 Upvotes
5 Replies
2 Users
Sort replies:
ms
by @ms (3855), 2 years ago

Response time seems higher, but if it hasn't changed recently, it's not gonna be the issue. Anyway, I see multiple drops to similar levels in the past. Which means, they likely have signals telling them when to crawl more/less intensively.

I checked the same report for seoforum, and it's much more balanced, but still has peaks in both directions. It's definitely normal and I haven't ever seen a straight line in Crawl stats.

Also, if Google's crawler gets blocked by robots.txt, that request still counts for totals, so it won't be robots.txt.

hazelwwwrong
by @hazelwwwrong (145), 2 years ago

And we have checked our server log, robot file and also response time. Didn't find anything wrong. Also, didn't see any google algorithm update on crawling.

This drop trend didn't affect traffic for now. So the site is not penalized.

hazelwwwrong
by @hazelwwwrong (145), 2 years ago

yes, stats are from gsc and also our company's own log report. here is the screenshot in gsc: https://ibb.co/NNzZjvw.

Our daily crawel request drop from 6m to 60k on 9th, Oct, and it didn't recover yet.

ms
by @ms (3855), 2 years ago

Where do you have these stats from? Can you post a screenshot?

hazelwwwrong
by @hazelwwwrong (145), 2 years ago

anyone knows the reason?

Join the forum to unlock true power of SEO community

You're welcome to become part of SEO Forum community. Register for free, learn and contribute.

Log In Sign up