Urgent for help! About crawel request sudden drop
Anybody occur sudden drop of crawl request situation? The crawl request of my site drop dramatically from daily 125k to 1k, nearly drop ove3 90%.
anyone knows the reason?
Where do you have these stats from? Can you post a screenshot?
yes, stats are from gsc and also our company's own log report. here is the screenshot in gsc: https://ibb.co/NNzZjvw.
Our daily crawel request drop from 6m to 60k on 9th, Oct, and it didn't recover yet.
And we have checked our server log, robot file and also response time. Didn't find anything wrong. Also, didn't see any google algorithm update on crawling.
This drop trend didn't affect traffic for now. So the site is not penalized.
Response time seems higher, but if it hasn't changed recently, it's not gonna be the issue. Anyway, I see multiple drops to similar levels in the past. Which means, they likely have signals telling them when to crawl more/less intensively.
I checked the same report for seoforum, and it's much more balanced, but still has peaks in both directions. It's definitely normal and I haven't ever seen a straight line in Crawl stats.
Also, if Google's crawler gets blocked by robots.txt, that request still counts for totals, so it won't be robots.txt.
Do you have a product or service you'd like to promote on Seoforum? It's easy. Contact us.