How often google re-index a site - Webmaster Forums UK SEO SEM Webmaster Community Forum

Flex · #1 (**permalink**) 06-14-2009, 07:21 PM

hi,
how often google re-index a site (or it is better to say re-index a page?!) ?
why some sites reindex everyday but some monthly?

I have got confused in themes. Move please to the necessary theme. Excuse please

patria987 · #2 (**permalink**) 06-15-2009, 09:00 PM

Pages with higher page rank and SERP rank is indexed faster.So, its obvious that some sites get indexed faster and on regular basis and some after few days gap.

Robdale · #3 (**permalink**) 06-15-2009, 10:24 PM

I don't think so, search engines index the sites faster who keeps updating their website with fresh and new content. I have witnessed it on my blog. Also, you can mention the gap period in robot.txt for search engines to crawl your site.

surreypcsupport · #4 (**permalink**) 06-16-2009, 09:15 AM

I think you are both right. High PR is gained through large numbers of backlinks and large numbers of backlinks results in more bot visits and faster reindexing.

And Robdale makes a good couple of points that content changes result in more bot visits and you can even tell the bots how often the page updates. Although I thought it was in the sitemap.xml file and not robots.txt e.g. <changefreq>daily</changefreq>

MayaLocke · #5 (**permalink**) 06-25-2009, 12:08 PM

It depends on how popular the site is and how frequently new content is posted to the site.

dhanjit · #6 (**permalink**) 06-26-2009, 06:48 AM

It also depends upon how friendly your site is with search engines and how big brand you are. If you update your site daily, your site will be visited by search engines daily. News sites are indexed twice and thrice in a day. There are many pages of bbc.co.uk, which are posted as a new page and new url and they got cache in the same day.

Kingbeing · #7 (**permalink**) 07-06-2009, 09:43 AM

Quote:

Originally Posted by dhanjit

It also depends upon how friendly your site is with search engines and how big brand you are. If you update your site daily, your site will be visited by search engines daily. News sites are indexed twice and thrice in a day. There are many pages of bbc.co.uk, which are posted as a new page and new url and they got cache in the same day.

En, it's reasonable.

dhanjit · #8 (**permalink**) 07-06-2009, 10:17 AM

Quote:

Originally Posted by Kingbeing

En, it's reasonable.

Google crawler visits BBC pages more than once in one second...

and the reason behind it is "update".

jeffturner · #9 (**permalink**) 07-06-2009, 11:14 AM

It depends on google.. how frequent it find the links on the other webpages. And also on the changing frequency of your website content.

Russel · #10 (**permalink**) 08-25-2009, 12:52 AM

If you wish to have your website pages indexed regularly then it is important to update your website regularly. If your website is updated regularly, some of the search engine spiders stay on your website and once the website is updated, the content is automatically indexed in the search engines.