rich

Crawling placeholder titles/desc until loads, indexing placeholders

by @rich (162), 1 year ago

Note: I'm not the web dev on this project, but I oversee it. So I do my part to help where I can, shine light on what can be improved, and do all the SEO research that I suggest to the team to implement.

So our website (https://tradehub.pro) have titles that change once the content is loaded. For example, if you go to https://tradehub.pro/stock/aapl the first few seconds it will show as Stock | Info, News, & Data but when it's done fetching all the data, the title changes. In this example, to AAPL - $131.86 (price changes during market hours). Other pages are like this too, such as https://tradehub.pro/user/rich title at first is User - Trade Hub then switches to Username - Trades & Performance Stats on Trade Hub as well as a few other pages (blog posts, user generated content/posts/trades). The description will also change once the page has fetched all the data from the APIs.

So the issue is, when the website is being crawled it will get indexed with the placeholder titles and descriptions- presumably because the pages don't load fast enough by the time crawler moves onto the next URL. Which then gets these links marked as issues in some webmaster (yandex) & SEO tools (moz/ahref). (see image)

Yandex webmaster, dupe titles issues

So my question is, what can help solve this? Other than speeding up the pages load time. We're working on a new web app design right now, haven't gotten to these pages yet but the speed of market data we're fetching for our Discord bot has increased tremendously so can only assume same will go for website- so hoping that is the case. But this type of data takes time to fetch, unless it's truly the method/code being used for this current/soon to be old site. Is there anyway to tell crawlers to slow down? Wait X seconds on each page when crawling before indexing?

I know there's a timer you can set, but I think it's only for the time it waits between the next URL- to lighten the load on the server. Or will it wait on that page for the specified time before moving to the next?

Appreciate if you read this far, and your feedback. Thanks

EDIT I just noticed that Yandex has a JavaScript rendering feature and if I'm understanding correctly, it does exactly what I need it to. It waits for the page to load! (I'll check Bing nex)

Yandex JavaScript Rendering

I haven't seen this on Google, is there one? If not, then the question in my original message still stands.

627 Views
1 Upvote
1 Reply
1 User
Sort replies:
binayjha
by @binayjha (4749), 1 year ago

This might help you,

https://developers.google.com/search/docs/crawling-indexing/javascript/dynamic-rendering

Join the forum to unlock true power of SEO community

You're welcome to become part of SEO Forum community. Register for free, learn and contribute.

Log In Sign up