How To Ensure The Search Engines Find Your Website

  • by Craig Broadbent
  • Published on 6/6/06
  • Article views: 449

Your Ad Here

One of the most fundamental aspects of search engine optimisation (SEO) is ensuring that the pages within your website are as accessible as possible to the search engines. It's not only the homepage of a website that can be indexed, but also the internal pages within a site's structure. The internal pages of a site often contain important content such as products, services or general information, and therefore can be uniquely optimised for related terms. As a result, easy access to these pages is vital.

There are many do's and don'ts involved in ensuring all of your pages can be found by search engines. However, it is important to first establish how the search engines find and index web pages.

Search engines use 'robots' (also known as 'bots' or 'spiders') to find content on the web for inclusion in their index. A robot is a computer programme that can follow the hyperlinks on a web page, which is known as 'crawling'. When a robot finds a document it includes the contents within the search engine's index, then follows the next links it can find and continues the process of crawling and indexing. With this in mind, it becomes apparent that the navigational structure of a website is important in getting as many pages as possible indexed.

When considering the navigational structure of your site, the hierarchy of content should be considered. Search engines judge what they feel to be the most important pages of a site when considering rankings and a page's position in the site structure can influence this. The homepage is generally considered the most important page of a site - it is the top level document and usually attracts the most inbound links. From here, search engine robots can normally reach pages that are within three clicks of the homepage. Therefore, your most important pages should be one click away, the next important two clicks away and so forth.

The next thing to consider is how to link the pages together. Search engine robots can only follow generic HTML href links, meaning Flash links, JavaScript links, dropdown menus and submit buttons will all be inaccessible to robots. Links with query strings that have two or more parameters are also typically ignored, so be aware of this if you run a dynamically generated website.

The best links to use from an SEO perspective are generic HTML text links, as not only can they be followed by robots but the text contained in the anchor can also be used to describe the destination page - an optimisation plus point. Image links are also acceptable but the ability to describe the destination page is diminished, as the alt attribute is not given as much ranking weight as anchor text.

The most natural way to organise content on a website is to categorise it. Break down your products, services or information into related categories and then structure this so that the most important aspects are linked to from the homepage. If you have a vast amount of information for each category then again you will want to narrow your content down further. This could involve having articles on a similar topic, different types of product for sale, or content that can be broken down geographically. Categorisation is natural optimisation - the further you break down your information the more content you can provide and the more niche key phrases there are that can be targeted.

If you are still concerned that your important pages may not get indexed, then you can consider adding a sitemap to your website. A sitemap can be best described as an index page - it is a list of links to all of the pages within a site contained on one page. If you link to a sitemap from your homepage then it gives a robot easy access to all of the pages within your site. Just remember - robots typically can't follow more than 100 links from one page, so if your site is larger than this you may want to consider spreading your sitemap across several pages.

There are many considerations to make when optimising your site for search engines, and making your pages accessible to search engine robots should be the first step of your optimisation process. Following the advice above will help you make your entire site accessible and aid you in gaining multiple rankings and extra traffic.

Craig Broadbent is Search Engine Optimisation Executive for UK-based internet marketing company, WebEvents Ltd. Clients of WebEvents benefit from a range of services designed to maximise ROI from internet marketing activities. To find out more, visit http://www.webeventseurope.com.

Bookmark it: Digg this! Add to Del.icio.us Furl this! Add to Stumbleupon Add to Facebook

Rate this article:


More Articles

  • Top 10 SEO secrets
    Today everyone wants to have better search engine result pages ranks. However only one can have the rank 1. Therefore you need to optimize constantly your websites and to have an edge over others you need to do something different and unique. Following are 10 rare tips/secrets which can help you get high search engine ranks.
  • SEO For Beginners
    Since the beginning of the understanding of Search Engine Optimization - SEO - there has been tons of different theories developed about how to do it 'right'. The truth is, however, that there is no one single method that is one hundred percent known to be better than the rest.
  • SEO Merits of Interlinking
    Many webmasters spend a lot of time optimizing their home page only. That's fine and is something you should definitely do, but you should also take some time to optimize all of your inner web pages as well.
  • How can Your SEO Keywords make Money?
    As you likely know by now, there is a big difference between effective, quality website content, and search engine optimized (SEO) website content that will obtain the highest ranks in search engines and directories such as Google, Yahoo!, and MSN.
  • The Mysteries of SEO
    SEO, or search engine optimization, is the most important element in building a successful website. Most people online have heard the term SEO and have some idea of what is involved yet it remains a mysterious process to many.
  • Top 10 SEO secrets
    Today everyone wants to have better search engine result pages ranks. However only one can have the rank 1. Therefore you need to optimize constantly your websites and to have an edge over others you need to do something different and unique. Following are 10 rare tips/secrets which can help you get high search engine ranks.
  • Google Sitemaps: The New Features
    The Google Sitemap program has brought a high level of assistance to web developers, web designers and business owners who want to optimize how their websites web pages are seen by the Google search engine.
  • Search Engine Optimization Basics
    SEO stands for Search Engine Optimization. Search Engine Optimization is an ongoing process of getting high placement in search engines at search phrases, relevant to the web content.
  • As Search Engines Grow Smarter, Will You?
    As search gets smarter, tricks get cheaper and we get nearer to coming full circle to an original goal of Internet search: that content is, indeed, king. It cuts across the grain of some notions we've held in the industry for some time, that there are shortcuts aplenty in the hunt for better search rankings.
  • Use of Search Engine Optimization
    For a website owner the only way to get potential customers is to have them visit your site and there are only three ways a customer can reach your site. By typing the web address, a link of another website and through search engines.
  • How to Straighten Out Your Tax Affairs in 2010
    Utter the word 'taxes' in front of people and you are sure hear a loud groan. Frankly, there are valid reasons behind this response: First of all, paying your taxes annually can be a financial burden, especially with the economic hard times which we are going through these days.
  • Benefits of Yoga - Redefining Life, Meditation and Exercise
    Yoga is a complete exercise for the mind, body and soul and it can give a person a change to know himself in a new light. Regular practice of Yoga has been known to reduce stress, increase concentration and also benefit one's overall health.
  • The Best Floral Perfumes
    Floral perfumes are considered the best perfumes all over the world. In fact the history of perfumes says that floral perfumes are the first perfume category of the world and thus popular also. Floral perfumes represent the essence of love and romance.
  • Coffee Gift Baskets
    Even a Coffee Bean or San Francisco Coffee outlet frequenter will not be able to master the art of appreciating true gourmet coffee unless they know the history and information about gourmet coffee.
  • Rent a car in Israel
    If you are already in Israel and wish to rent a car, then you can make a booking and tell the service to pick you up from wherever you are. The best part about car rental in Israel is that they are extremely flexible.
  • How to Straighten Out Your Tax Affairs in 2010
    Utter the word 'taxes' in front of people and you are sure hear a loud groan. Frankly, there are valid reasons behind this response: First of all, paying your taxes annually can be a financial burden, especially with the economic hard times which we are going through these days.
  • Ecommerce Checkout - Make Them Register
    The world of ecommerce is expanding daily as more and more retailers take their business to the web in the hopes of attracting a percentage of those ever finicky web shoppers. As the amount of businesses open up ecommerce shops online, the amount of web development companies is also growing, offering ecommerce solutions for even the smallest of budgets. It is important that web developers understand the dynamics of the checkout process when discussing the options with the client.
  • A History of Vintage Automobiles - From 1916 to 1924
    Before cars were around, people usually traveled distances using horse-drawn carriages. But as early as 1335 several bright minds have been trying to come up with a 'horseless carriage'.
  • 3 Rules to Follow in Your Logo Design
    When designing your own logo or getting it done by logo design professionals, ensure the following three basic rules and you will have a great and memorable corporate identity.
  • Top 10 SEO secrets
    Today everyone wants to have better search engine result pages ranks. However only one can have the rank 1. Therefore you need to optimize constantly your websites and to have an edge over others you need to do something different and unique. Following are 10 rare tips/secrets which can help you get high search engine ranks.


The opinions expressed in the above articles are solely of the authors and the owners of Point Articles may or may not agree with them. Copyright (c) 2008 Point Articles. All rights reserved.