Recently Jill Whalen had an excellent post on "Getting Into Google". Her post describes a number of points that Google's Director of Crawl Systems, Dan Crow mentioned at a Search Engine Marketing New England show a few weeks back. The information is straight from Google so it must be legit right?
On the serious side Jill mentioned a number of key points about what is required to get indexed and ranked in Google.
- When Google goes to index a site, the first thing Googlebot does is look at the robots.txt file to learn where it shouldn't go. It was interesting to note that Google has stated that the major search engines are working to standardize the the commands for the robots.txt file.
- Google still loves PageRank (just not the PageRank that we see in the toolbar). The key point to remember here is that having high quality links is still one of the greatest factors towards being indexed and ranked in Google. The best way to generate links? Create unique site content.
- Use Google Webmaster Tools to look into potential indexing issues with your site. We have been a big supporter of Google Webmaster Tools since it was released a few years ago. It's a great tool for providing insight into your external linking inventory and inbound linking anchor text.
- Limit your use of Flash and AJAX. Whoa this is not very Web 2.0. but the fact is, is that Google still has difficulty indexing content that is contained within Flash and AJAX. Why make it difficult for Google?
- Modify your pages and try to get links to all important site pages if you want to avoid heading into the Supplemental Index of Google.
Jill's full post can be found here.