The disturbing inaccuracy behind Google Analytics

Google Analytics is probably the most popular web analytics tool in use today. It is certainly the best tool you can get for the price -- it's free and worth every penny. Unfortunately, like every web analytics tool, it is not 100 percent accurate. There are reasons why it is impossible to build perfectly accurate web analytics software, which I have covered previously in "Things that throw your stats," so we should not blame Google for this. However, Google Analytics is different from other products in that it has been intentionally designed by Google to be inaccurate over and above the normal inaccuracies that are inevitable. These inaccuracies are so glaring that most people are getting a very false picture of what is happening in their sites. This article will explain where these inaccuracies lie and provide methods to correct for them.

Visits and bounces
Firstly, we must remember that Google did not create Google Analytics.  The company bought a product called Urchin and rebranded it. After about a year, it then released an upgraded version. Urchin had contained a very big mistake in its calculations, which Google fixed in the upgrade. The problem lay with counting visits. According to all the web analytics standards, a "visit" only happens when someone reads more than one page on a site. If someone comes to your site, looks at the first page, then leaves, this is not a "visit" -- it is a "bounce." The best way to think of this is in terms of a shop. If someone looks at the store window but moves on, they have bounced. It is only when they enter the store (or site) that you have a visit.

This is a very important definition to grasp because it fundamentally affects how you see the performance of the site. The reason we need to distinguish between bounces and visits is that we can't tell how long someone spent looking at a web page. We can only tell what time they accessed it. We calculate the time spent looking at a page by comparing what time they accessed it with what time they accessed the next page.

For example, if someone accesses my homepage at 2 p.m., then accesses the next page at 2:15 p.m., we assume they spent 15 minutes reading the homepage. If someone only accesses one page -- in other words, if they bounce -- we have no way of knowing how long they spent looking at that one page. So you can only calculate visit duration when someone reads two or more pages.

A key metric when analyzing the performance of a site is the average duration -- how long people are spending in the site. You need to know your overall average duration for the site, and you often want to know the average duration for visits from certain ads or for specific products. It's a very good way of assessing engagement. Average duration is calculated by totaling up all the individual visit durations and dividing this by the total number of visits.

Next page >>
 

Comments

The Imtiaz
The Imtiaz November 18, 2009 at 12:13 AM

Google Analytics is one of the best analytics tool with so many report dimensions. I agree that there is a slight discrepancy in reports. No other tool in the market gives these many tracking dimensions of a visitor. That too free of cost.

I disagree with your point below

A "visit" only happens when someone reads more than one page on a site. If someone comes to your site, looks at the first page, then leaves, this is not a "visit" -- it is a "bounce."

Google Analytics perfectly tracks one page visits. I have many one page websites. GA tracks every visit perfectly.

I have used many web analytics tools in past, but Google Analytics stands at its best.

The Imtiaz
Internet Strategist

The Imtiaz
The Imtiaz November 18, 2009 at 12:12 AM

Google Analytics is one of the best analytics tool with so many report dimensions. I agree that there is a slight discrepancy in reports. No other tool in the market gives these many tracking dimensions of a visitor. That too free of cost.

I disagree with your point below


Google Analytics perfectly tracks one page visits. I have many one page websites. GA tracks every visit perfectly.

I have used many web analytics tools in past, but Google Analytics stands at its best.

Regards,

The Imtiaz
Internet Strategist

Joao Correia
Joao Correia November 16, 2009 at 10:12 AM

Nothing in the world is 100% correct !
Web Analytics its not about the numbers its about the trends.
If you stick with the same web analytics you will be fine.

Regards
Joao Correia

Bernadette Homor
Bernadette Homor January 13, 2009 at 11:36 AM

I like your article, makes a lot of sense

Page alizer
Page alizer November 20, 2008 at 12:32 AM

You are absolutely right. This is why we created http://www.pagealizer.com . It is easier to optimize your page design if you know how long a visitor visited your page before bouncing. After all a average bounce after 5 seconds is different than an average bounce after a 1min visit - each bounce pattern should be addressed differently by site design and marketing. This is crucial in landing page design where in a lot of times there are no "second page views" and therefore common web analytics cant calculate visit length. This is where Pagealizer comes in. After adding Pagealizer tracking code to your site the code pings our servers as long as the visitor is viewing the page. This way you are getting real visit length in places a lot of web analytics services fail. check us out :)

Brandt Dainow
Brandt Dainow November 19, 2008 at 4:20 PM

REPLY TO JODI McDERMOT
Comments are not the place for debates, but Jodi has accussed me of lying in public, so I am forced to reply.

I was appointed WAA standards liason to the UK IAB and ABCE in 2006. Note that IAB is not a single international organisation, but a conglomerate of national ones. I met with Richard Foan and Andy Flint of ABCE in June 2006. Here is a copy of my report to the WAA committee:

I met with ABCE last week. They have confirmed their original agreement that WAA and ABCE co-operate on standards. The mechanism we have agreed is necessarily loose because ABCE is controlled by its member organisations. In particular, it is part of their brief to keep things simple for people who are outside the web analytics arena, and to create a limited set of standards which are easy to understand. This means they cannot agree to automatically adopt all WAA standards. Instead, when we publish our standards documents we will forward a copy to them, and they will then determine which ones they will adopt.

They will also forward to us their own standards document. This is currently around 40 pages, but much of the information within is stuff they want to keep confidential and restricted to their members (who have to pay for this document). They will remove this material and forward the rest to us for us to approve as we see fit. WAA is not obliged to approve any of their standards any more than they are obligated to approve ours. What we have agreed is that we will continually supply each other with lists of standards as we create them. We have also agreed we will publisd PR on our sites stating our position with regard to each other's standards so that we do not create the impression of a conflict.

ABCE have also undertaken to discuss this process at the JICWEBS level and drive the process of getting JICWEBS to develop a formal position with regard to WAA standards. ABCE are the secretary for JICWEBS.

JICWEBS is The Joint Industry Committee for Web Standards, and feeds standards to 36 countries for the purposes of online auditing via IFABC (International Federation of Audit Bureaux of Circulations). Standards are restricted to census-only data. JICIMS handles standards for panel research. Other members of JICWEBS are DMG - the IPA Digital Media Group, IAB - Interactive Advertising Bureau, IPA - Institute of Practitioners in Advertising, ISBA - Incorporated Society of British Advertisers, NPA - Newspaper Publishers' Association, NS - Newspaper Society, AOP - Association of Online Publishers.

Countries following JICWEB standards are: USA, Canada, Mexico, South Africa, China, India, Japan, Korea, Malaysia, Singapore, Sri Lanka, Austria, Belgium, Blugaria, Czech Republic, Finland, France, Germany, Hungary, Ireland, Italy, Netherlands, Norway, Poland, Portugal, Romania, Russia, Spain, Sweden, Switzerland, Turkey, UK, Australia, New Zealand, Argentina, and Brazil.

WAA has begun a similar conversation with IAB. Richard Foan, chair of ABCE, recommended WAA discuss standards with ISBA and IPA, and offered to make appropriate introductions. I think we should consider talking to EACA (European Association of Communications Agencies) as well.

Jodi McDermott
Jodi McDermott November 19, 2008 at 3:40 PM

Brandt,

I noticed on your bio that you state that you are the Web Analytics Association (WAA) liaison to the Internet Advertising Bureau. Can you please provide proof that this is true? I am asking as I am the first (and only) liaison to from the WAA to the IAB. In fact I helped to put that relationship together and personally announced that relationship at the E-metrics Summit in Toronto in March of this year.

I would appreciate a public reply as to your relationship with the WAA and the level of your involvement in the Standards committee.

Regards,

Jodi McDermott
WAA Liaison to the IAB
Co-chair of the Social Media Standards Subcommittee

Bob Mitchell
Bob Mitchell November 19, 2008 at 7:48 AM

'All WA standards' ?!
The first standard that comes to mind is from the WAA (of which you're a founder) which says :

TERM: Visits/Sessions
Type: Count
Universe: Aggregate, Segmented
[quote]
Definition/Calculation:
A visit is an interaction, by an individual, with a website consisting of one or more
requests for an analyst-definable unit of content (i.e. "page view”). If an individual
has not taken another action (typically additional page views) on the site within a
specified time period, the visit session will terminate.
[/quote]

So, single-view visits are still visits, right?

Now, unless I'm misreading something here (which is entirely possible), doesn't that contradict what you're claiming?

Note that I don't dispute that it's important to know what your tool is doing - that's always been vital.

Michael Martinez
Michael Martinez November 18, 2008 at 5:23 PM

Brandt Dainow: "According to all the web analytics standards, a "visit" only happens when someone reads more than one page on a site. If someone comes to your site, looks at the first page, then leaves, this is not a 'visit' -- it is a 'bounce.'"

Michae: Every Web site experiences 100% bounce because sooner or later, people leave the site. To argue that anyone who spends 3 minutes reading the front page of a blog and then leaves is a "bounce" is a pretty naive measurement of traffic.

There are certainly plenty of problems with Google Analytics, its under-reporting of traffic being the worst, but complaining about how they calculate bounce rates is grasping at straws.

If the objective of the Web site is to get people to visit one page and one page only (and there are MANY such sites), then there is no point in using any metrics package that doesn't track the traffic accurately.

Accurate traffic is not determined by nameless, uncited standards, but rather by the purpose and goals of the Web site.

Latham Arneson
Latham Arneson November 18, 2008 at 3:09 PM

I think to use the words "wrong" and "incorrect" is not being fair. Wrong or right is not really the case here, it's all a matter of how - as in, how the numbers are calculated.

You bring up an important point that it's important to know how you're analytics system is measuring the data it's presenting to you, but just because systems do it differently doesn't make it wrong or right.

To me, I actually like the fact GA reports a bounce as a visit. I want to know, at a very basic level, how many people were linked (however it happened) to my site. Once they're there, then I can analyze what they're doing and trying to get all of them to "convert". Getting rid of these users by not counting them would be just as "inaccurate" if you didn't understand how the system calculated the number.

We could debate the merits of whether it's worth counting bounced visits as "visitors", but my main point is that I strongly disagree with the notion that there is a wrong or right here and it's more a matter of how you look at it and your perspective - and most importantly, understanding how the numbers are calculated.

Bennet Bayer
Bennet Bayer November 18, 2008 at 8:32 AM

My goodness, you are just becoming aware of this now? Google does one thing well...put money in its own pocket.

I have blogged on the detail of market analytics and other sources such as your log but there are many others more cleaver than I doing this.

Sujit Nair
Sujit Nair November 18, 2008 at 8:16 AM

Nice detailed article !