Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations strongm on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

When will Google do an update on it's index/rerank pages??? 3

Status
Not open for further replies.

JoJoH

Programmer
Jan 29, 2003
356
US
Hi all,

Does anyone have any idea as to approximately when will Google do an update on it's index?

Please advice.

Thanks in advance.

JoJoH

 
According to , "We update our index every four weeks". Elsewhere it talks about the index being refreshed about once a month, and about the crawling process taking several weeks.

So I guess there's an ongoing crawling process going on, after which they publish a new index to the public site. I don't know when the next refresh will happen.

More to the point, I don't care! There's nothing we can do to advance or retard the next publication date, so why worry about when it's going to be? If I told you it was to be next Wednesday (and who knows, it might be), what would you be able to do with the information?

-- Chris Hunt
 
Good answer chris. [2thumbsup]

In reality there is no set date for the index\update. Every site can have it's own crawl\update schedule. The monthly update (Google dance) idea has come about from the fact that once a month the Google datacentres would be synchronized so the webmasters and SEOs who watch their PR and SERPs daily would see a fluctuation during this period (usually 3 to 4 days).

Demonstration how crawls and updates happen any time and all the time.
this thread215-728151 was posted 11 Dec

Google SERP;
crawled and in the results 13 Dec.

If your site has rapidly changing content the crawls will happen daily or more, with updates in 24 to 48 hrs. I maintain one site where content changes weekly and crawls are every 2/3 days and updates are every 2 weeks, another site has an events calendar on-line (new page everyday) which is crawled everyday and always updated 2 days later.



Chris.

Indifference will be the downfall of mankind, but who cares?
 
Hi Chris,

Thanks for your reply! Something I don't understand... I have 3 pages that googlebot came and crawled on 11/30/2003 but till today I still don't see it listed in Google's index. What worries me is basically googlebot comes to my site every day and crawl on different pages, but nothing changes in Google's index(for example the 3 new pages I mentioned above). Please advice.

Thanks in advance!

JoJoH

 
Hi JoJoH.
It looks like your site is in the process of getting updated, as 99 pages but www2 and www3 are showing 107 pages for an allinurl: check. I didn't check the DCs.
There are several pages marked for removal which can sometimes slow down updating for some reason best known to Google.
Something that does seem to delay listing after a crawl is lack of content on the pages, possibly because the algo cannot immediately get the page context and then has to wait for anchor text analysis. (theory based on observation rather than hard facts)



Chris.

Indifference will be the downfall of mankind, but who cares?
 
Thanks Chris for your reply! Where and how did you check those useful information?(such as different data centers, which page marked for removal,etc) Can you please point me to it?
Thanks again Chris! [smile]

JoJoH

 
Hi JoJoH

Late reply (the real world of making a living got in the way) [ponder]

there are a few tools that you can use with Google to check your site, and other sites of course.

site:domainname keyword checks for indexed pages in the domain that contain the keyword/phrase.

allinurl:domainname checks for pages that Google has indexed in the domain. You can also use domainname/folder to check sub-folders.

allintitle:keyword/phrase runs a search for indexed pages that contain the word/phrase in the page title.

allinanchor:keyword/phrase runs a search for indexed pages that contain the word/phrase in the anchor text.

link:domainname checks for pages that link to the domain name (only shows pages above ~PR4) can also be used as domainname/page or domainname/folder

related:domainname or domainname/page runs a search for pages that have indexed content related to the indexed content of the specified page.

When you run an allinurl: or site: check you may see pages that have the page url instead of the title and no snippet, these are pages that Google has 'lost' (404 errors) and are still in the index but will be removed after a waiting period of ?? crawls they are not removed immediately because it may be a server error causing it, so they are checked for so long before being deleted.

For a list of DCs and regional engines take a look at
but don't get too involved in the whole Google Dance thing or you'll end up at WMW [lol]




Chris.

Indifference will be the downfall of mankind, but who cares?
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top