Get Your Website Crawled And Indexed By Googlebot Within A Day

It’s frustrating having to wait up to several weeks for Googlebot (Google’s crawler) to notice new content added to your site. Well, Google have heard the complaints of webmasters and introduced a new tool called ‘Fetch as Googlebot” in Webmaster Tools.

Now you can directly request that Googlebot index your new and updated URL. The best part is, if it is approved for inclusion in their search engine index, this only takes up to 24 hours for your site to be crawled and indexed. But remember, this doesn’t guarantee that every URL can be indexed using this tool. They’ll still be evaluating whether a URL belongs in their search engine.

The benefits are clear. This allows visitors to view the updated cached version of your site with the new changes (Note: A Cached version of your page is just how the page looks when the search engine last indexed your page to its database. People may view this page if you actual site is temporarily down).  You wouldn’t want out-of-date content could appear in search results right, particularly if you need to update event and product details or if you’ve published the wrong information.

It’s also great for newly launched websites. If your website isn’t indexed, users won’t be able to find you from the search engines (which generally accounts for the majority of website traffic).

How to submit a URL

Fortunately, this is a very simple feature to use. You just need to have a Google Webmaster Tool’s account. Google explains:

“First, use Diagnostics > Fetch As Googlebot to fetch the URL you want to submit to Google. If the URL is successfully fetched you’ll see a new “Submit to index” link appear next to the fetched URL.

Once you click “Submit to index” you’ll see a dialog box that allows you to choose whether you want to submit only the one URL, or that URL and all its linked pages.

When submitting individual URLs, we have a maximum limit of 50 submissions per week; when submitting URLs with all linked pages, the limit is 10 submissions per month.”

Submit unverified URLs

You now also have the option of submitting URLS via Google’s Crawl URL form without having to verify ownership of the site in question.

While you don’t need to use this tool for every update you make to your website, the benefits of using this are clear. So I strongly suggest you take advantage of this free tool when you need your website updates indexed immediately.