Many Faces of TimRSS Icon

Clickthrough Experiment Update

A couple of weeks ago I came across an experiment which in brief suggested you could improve your click through rate on SERPs by making them stand out. This would seem to make sense and his figures suggested a staggering increase. So I set out to replicate the feat in a slightly more controlled manner.

You can read how the experiment was set up on the previous click through article. One thing I should add both sites are in the UK and we only monitored the click through from Google.co.uk and not .com or other regional, this makes the data set much smaller but also more reliable.

Remember this is nothing to do with higher rankings, merely attempting to improve click through rate from results pages once your already ranked.

UPPERCASE EXPERIMENT

So to recap we changed the case of the content in the title tag to be entirely upper case. In both experiments we had clients with 2 sites in the same SERP so that we could provide a norm, and experimented on the lower ranking of the two.
Graph of uppercase experiment
So the top blue line is our higher ranking site for the two weeks the uppercase was in effect (remember this is our norm and hasn't been changed in any way but ranks higher so will have a higher ctr), the cream brown line is the rate of the two weeks for the site we have uppercase, while the cyan blue/green is the previous two weeks.

The fluctuations may seem large but keep in mind the number of clicks from the highest peek and trough on the blue is just 8.

Clearly our UPPERCASE title has not done as well in the two weeks compared with the previous two and it's interesting to note its peeks and troughs are in a slightly different pattern to our higher ranking site. All in all for the two weeks it consistently under performed.

UPPERCASE and Click Me

In this experiment we added a Click here for wording before the title with the entire title in uppercase, the idea give some one a direct call to action and they will follow. To make life more interesting the product related to this SERP was featured on a TV program in Canada causing a small spike in CTR even on the .co.uk with a much larger one in google.com.
Click here results
Like before the Blue is our higher ranking norm (notice the spike), the mocha brown line is the same week as the blue with our call to action and uppercase, while the cyan is the previous two weeks

Our call to action does not on first glance to be performing badly but keep in mind the 25% increase in the period for searches related to our product and the click through is looking less impressive.

What did visitors think

To assist with the experiment we asked a few visitors arriving via google.co.uk if the experiments had made a difference to them, we started by showing them a picture of the Google result for the site from the previous two weeks and the current look asking them which they had clicked on.

  • Uppercase results - 90% remembered clicking through the uppercase version
  • Click here results - 100% all remembered they clicked through the click here version

Next we showed a generic result, and asked which element first drew them to our site
generic

  • Uppercase results - 70% Said it was the title that had inspired them
  • Click here results - 60% Said it was the title

Finally we asked if the site was the first site they had clicked on the search page?

  • Uppercase results - 50% Clicked the test site first
  • Click here results - 75% Clicked the test site first

What about sales?

Sales figures are only half available at the moment but the conversion rate has seen a slight performance increase in the click here experiment, but remember this is more likely to be related to the Canadian coverage.

So at the halfway mark what have we learnt?

  • Neither experiment is showing improved results, indeed the click through rate is lower
  • Both experiments were distinctive enough for people to remember the "odd titles"
  • The survey indicates the titles do make the result stand out
  • Far to many Brits watch Canadian TV!

Before I go, no I will not be revealing the keywords, site information or client info. A) the experiment is still on going, B) Both clients have been kind to let me run the experiments and deserve praise but both have asked for privacy. So come back in a couple of weeks for the full results.

Quickly Linking?

If you want to link to this post quickly please use: http://tnash.eu/t144

alternativly use one of these services Tiny URL | bit.ly |is.gd

RSS feed | Trackback URI | Add your comment!

9 Comments »

Comment by Martin Bowling from Martin Bowling
2008-05-17 15:18:29
Martin Bowling avatar

This is really cool, I can’t wait to see the final sales data. I am not really surprised that the click throughs aren’t going up but I am surprised that so many people responded that they remember the titles being distinctive. This is great stuff, thanks Tim!

 
Comment by rishil from Private Health
2008-05-20 11:05:53
rishil avatar

I had run a test few months back with a client site – with branded products, use of “official site” saw significant spike in traffic from brand terms…

 
Comment by Kiowa
2008-05-20 17:31:37
Kiowa avatar

Thanks for this, been very curious about this. Seeing the difference changing a few words can do in a PPC ad makes me curious to what it can do for organic traffic

 
Comment by Amad Ebrahimi from Awaken Strategy
2008-05-20 18:26:56
Amad Ebrahimi avatar

I was surprised about the Connected Internet article in the first place. I used to sell quite a bit of products on ebay, and one of the first mistakes that I made was to create my headlines in all caps. From what I’ve read, and experimented with myself, I’ve noticed that CTR goes down with the all caps headlines. They’re harder to read, a little bit more “in your face” which result in a push marketing type situation. I think the call to action in either the title or description tags is definitely a plus though.

 
Comment by Andy Beard from Lazy Blogger
2008-05-20 18:46:25
Andy Beard avatar

More to experiment with

Camel case versus no caps
Click here with both of those

Click here in the description

Caps in the description, not the title

Comment by Tim Nash
2008-05-20 22:19:27

I think I would run out of willing clients before getting through that list Andy :) actually the hardest part is keeping the clients on board.

@Rishil – Using terms like OFFICIAL is an interesting one, I remember one of my clients added IN STOCK to their titles for every page talking about a certain Nintendo product to great effect.

@Kiowa you might find http://www.mindvalleylabs.com an interesting read if you don’t already they have some fascinating split tests on word patterns.

 
 
Comment by Hobo from Hobo
2008-05-21 02:08:55
Hobo avatar

Nice research Tim

 
Comment by David E-Stainer from SEO Hampshire
2008-05-22 22:09:27
David E-Stainer avatar

It makes me wonder if trying the Uppercase for two weeks, followed by the normal case could be the way to go? Almost like a little shot in the arm!

 
Comment by Chris Estes from SEO by Chris Search Experiment
2008-05-23 06:03:30
Chris Estes avatar

I love experiments. I have the results for mine and need to write the follow up. I am glad to see you testing and experimenting.

 

Responses to this post:

dont be an idiot, use a real name and all comments are moderated
Name Your name not your website(required)
E-mail (required - never shown publicly)
Website address (URL)
Web site name will be used as link text
Your Comment (smaller size | larger size)
You may use <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> in your comment.
Spam protection: Sum of eight + 9 ?
Tim Nash consulting