What's In The Mysterious Log File?
- by Zac Hewlett
- Published on 3/7/06
- Article views: 412
First things first, if your web hosting service provider doesn't allow you to download the raw log file, just go away. You need the raw log file to study and improve your web site performance.
What's A Log File?
Every time someone visits a page on your site, a record is made into the log file, which is saved on your server. You can find some interesting and useful information about the visitors in the log file.
Though log file formats vary, here I discuss the common elements.
Here's the contents of a single line of the log file from this site.
165.21.154.9 - - [03/Jul/2003:06:39:23 -0400] 'GET / HTTP/1.1' 200 15549 'http://www.working-at-home-business.com' 'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; http://www.working-at-home-business.com)'
Letīs see what's inside one by one.
User IP Address
165.21.154.9
This is the IP address of the visitor to our site. It tells you where the visitor is from. If you do a reverse DNS look-up on this IP number at DNS Stuff the result is bbcache-9.singnet.com.sg which belongs to 'Singapore Telecommunications Pte Ltd'. You really can't go further than that to identify a particular person. Otherwise, the Internet would be too dangerous. ;)
Yeah, that visitor was myself.
Date/Time
03/Jul/2003:06:39:23
The exact time of the visit. Combined with the IP address, it enables you to follow a particular visitor sequentially from page to page on your site. More on this later.
GMT offset
0400
This is the number of hours from Greenwich Mean Time (GMT). So in our example the offset is 4 hours from GMT.
Action
'GET / HTTP/1.1'
This is either GET or POST. Except for a few CGI programs, this will typically be GET. That is, get a web page or an image that goes on that page.
This line records a command from my own browser to GET a web page from the root directory (Notice the slash '/'after GET) using a protocol named HTTP/1.1. This is the index page of our web site.
Another example.
'GET /web-promotion/index.shtml HTTP/1.1'
It records a request of this URL:
http://www.singaporewebhosting.com/web-promotion/index.shtml
Return Code
200
The next item tells whether the action was successful or not. Our example is a return code of 200, which means 'Successful Loaded'. You've probably got the dreaded 404 'File Not Found' error code when the web page you were trying to find wasn't at that URL, so these return codes aren't entirely new to you.
Other common return codes include:
400 - Bad Request 401- Authorization Required 403 - Forbidden 500 - Internal Server Error
Size
15549
This is the size of the file sent, in this case 15549 bytes.
Referrer
'http://www.working-at-home-business.com'
This tells us the web page where the visitor came from. In our example http://www.working-at-home-business.com ,which is also run by us.
You will find another extremely important piece of information here: the keywords by which your visitors found you. For example:
'http://search.yahoo.com/bin/search?p=web%20hosting%20singapore'
It tells you someone found this page at Yahoo, using the keywords 'web hosting singapore'.
By studying referrer information, you will know exactly which search engine brings your how many visitors, what they were looking for when they found your site, which links partner is more valuable...then you will know how to spend your advertising dollars wisely.
Browser/Platform
'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; http://www.working-at-home-business.com)'
The final field in the log file tells you what web browser and operating system the visitor is using.
Mozilla is a code name that indicates the browser is Netscape-compatible. In this case, the visitor was using IE6.0 on a Windows NT operating system.
Why my URL is at the end again? Just a little fun. I customized my browser a bit. You won't see it anywhere else unless I did visit your web site. ;)
Tracing A Visitor
Here comes the more interesting part. Lets take a closer look at the log file and see how a visitor passes through your site. I will be abbreviating the log file to simplify this for you.
03/Jul/2003:06:39:23 GET / 03/Jul/2003:06:39:52 GET /web-hosting/index.shtml 03/Jul/2003:06:40:36 GET /newsletter/index.shtml 03/Jul/2003:06:41:04 POST /cgi-bin/followup/auto_followup.pl 03/Jul/2003:06:41:05 GET /newsletter/subscribed.shtml 03/Jul/2003:06:41:27 GET /support/index.shtml 03/Jul/2003:06:41:38 GET /support/log.shtml
First, the visitor went to the homepage of Singapore Web Hosting, then web hosting section to find out more about web hosting package. And then looked at newsletter page and filled up the subscription form. Our CGI script processed the form and the visitor was redirected to 'thank you for subscription' page. This visitor continued reading some articles in support section.
I've skipped all the requests for images.
Why should you analyze a visitor's path? Because only when you do that, you begin to discover how a visitor uses your site: which door and from where she comes in, what interests her most, and where she leaves. Lots of small scientific observations will add up to an accurate picture of what a visitor actually does on your site.
That information is priceless if your goal is to optimize the experience, and lead your visitor to the most important parts of your site.
Zac Hewlett at
Singapore Web Hosting - Visit
http://www.SingaporeWebHosting.com for more web site design and promotion
articles, proven online marketing tips and techniques.
More Articles
-
-
-
» Latest articles
-
» Highest rated articles
- Usability - Secret Behind A Successful Website
Web site usability is the latest buzz in the World Wide Web. From increasing traffic to your site to increasing sales of your products or services, usability offers benefits which can help you make an impressive web presence.
- 10 Key Things to Look for in a Good Web Designer
Before listing the ten key things to look for in a good web designer, let's define a few terms. Even though you may encounter variants on the name - like web developer, web artist, webmaster and so forth - we're talking about an individual who, alone or with some assistance, is going to 'get you up and running.' This means more than simple design.
- How Web Development is different from Website Designing
Web development is the buzz word, but not many people understand the true meaning of web development. Most people associate web designing with web development, which is not only misleading but really cramps up the vision of what real web development can do.
- Myspace Design Features - Helpful for those who have no idea of HTML
If you are reluctant to create Myspace website because you do not have any idea about HTML. Several Myspace designer features will help you to create Myspace website even if you have no idea on HTML.
- Stock Images - An Indispensable Tool For Designers
When the already obtainable photographs are accredited for definite usage, then they are called Stock photography. H. Armstrong Roberts founded the 1st prominent stock photography agency way back in 1920. In the stock photography industry, the new micro-stock models of images get filed at the agencies. Stock photography, nowadays, is an extensively used application of digital media.
- Stock Images - An Indispensable Tool For Designers
When the already obtainable photographs are accredited for definite usage, then they are called Stock photography. H. Armstrong Roberts founded the 1st prominent stock photography agency way back in 1920. In the stock photography industry, the new micro-stock models of images get filed at the agencies. Stock photography, nowadays, is an extensively used application of digital media.
- Developing a website
If you are starting a new business there are many things you need to keep in mind, and starting a website to market your products online is one of the most important aspects of your new business. There are many reasons why should start a website that include saving money, convenience, more customers, professional image, and keeping up with the competition.
- What's In The Mysterious Log File?
Every time someone visits a page on your site, a record is made into the log file, which is saved on your server. You can find some interesting and useful information about the visitors in the log file.
- The Importance of Good Web Site Design
It is, perhaps, the most frustrating experience to see people come to your site and leave before seeing what you have to offer. This is a common problem that demoralizes many website owners who spend countless hours designing their websites to realize their dreams. The reason why most ecommerce ventures fail is because of poor web design.
- Writing for the Web
Have you ever tried to read your local newspaper online? How about the New York Times or the Wall Street Journal? It just isn't the same. Do you know why? Because articles meant for print don't translate well to the web, and the rules that apply to writing content for the internet are different than those for print.
- The Mysteries of SEO
SEO, or search engine optimization, is the most important element in building a successful website. Most people online have heard the term SEO and have some idea of what is involved yet it remains a mysterious process to many.
- How can Your SEO Keywords make Money?
As you likely know by now, there is a big difference between effective, quality website content, and search engine optimized (SEO) website content that will obtain the highest ranks in search engines and directories such as Google, Yahoo!, and MSN.
- How to write your first Ebook?
One of the most excellent ways to build your online income is by writing and distributing Ebooks. Ebooks can be a very helpful tool for marketing your business and they can also be big money makers.
- Top 10 Photo Recovery Tips
Perhaps you have a capacious memory card. Maybe you simply trust the technology of your latest digital gizmo to forever shield your data from harm.
- 3 Rules to Follow in Your Logo Design
When designing your own logo or getting it done by logo design professionals, ensure the following three basic rules and you will have a great and memorable corporate identity.
- Reiki and how it can help you Heal
Reiki is a valuable healing tool which involves the practitioner placing his or her hands on the client without actually manipulating the body in any way. This makes Reiki an ideal healing tool for people who suffer from all kinds of conditions, both physical and emotional. This article discusses what is involved in a Reiki session and what training a Reiki practitioner undergoes.
- A History of Vintage Automobiles - From 1916 to 1924
Before cars were around, people usually traveled distances using horse-drawn carriages. But as early as 1335 several bright minds have been trying to come up with a 'horseless carriage'.
- Common mistakes before starting a website
If you want your website to be a big hit then you need to avoid some common mistakes before starting one. Here you have a list of pitfalls that are designed for beginner and for many established ones too. Check out the common mistakes that have to be avoided for sure!
- How to Create a MySpace Layout
Creating a MySpace layout might seem tricky when you think about it but it is actually pretty easy. Here's a few steps that will help you in designing myspace templates.
- Ecommerce Checkout - Make Them Register
The world of ecommerce is expanding daily as more and more retailers take their business to the web in the hopes of attracting a percentage of those ever finicky web shoppers. As the amount of businesses open up ecommerce shops online, the amount of web development companies is also growing, offering ecommerce solutions for even the smallest of budgets. It is important that web developers understand the dynamics of the checkout process when discussing the options with the client.
