Surveys

This article, written by Neil Mason, was originally published on Clickz.com on 01/07/10 and is republished here with permission.

Last time I looked at some of the characteristics of data collected from surveys, particularly data collected from surveys run on websites where you have no control on who is answering the survey. Generally this lack of control can cause some bias in the data which can cause some issues if you are looking at the aggregated reports. For example the data on the profile of visitors (i.e. gender, age etc) that you collected from survey data may not actually reflect the true profile of visitors to your site because of the different propensities of different groups to respond to surveys. So, does that mean that survey data is useless? Not really but it does means that it needs to be handled with a bit of caution. Read more…

This article, written by Neil Mason, was originally published on Clickz.com on 18/06/10 and is republished here with permission.

Having looked at some of the fundamentals around web analytics metrics over the past few weeks, this time I turn my attention to survey based data and metrics. Over the past couple of years there has been a growth in the number of organisations that are running on-site survey based voice of the customer programmes. These might range from simple “do it yourself” approaches using free or low cost survey software, to a packaged tool like 4Q or more sophisticated programmes like ForSee Results or iPercpetions. As with all things, you pay your money and you make your choices. Read more…

This article, written by Neil Mason, was originally published on Clickz.com on 23/04/10 and is republished here with permission.

When the graphs are going up and to the right, people are generally happy. Life feels fine when there’s good growth in the right kind of metrics and despite the tough economic trading conditions over the past 18 months, the digital economy has generally been doing OK. Here in the UK spending on online advertising grew by just under 5% in 2009 compared to 2008 with spend on Search up by just under 10%. Whilst that isn’t the kind of stellar growth seen in previous years, the indicators are positive. Business confidence amongst advertisers is higher than it’s been previously and we’re continuing to see growth in the active online audience (up 10% vs. a year ago), some of that being driven by the growth in population of social networking sites such as Facebook. Read more…

There are obvious attractions to conducting international surveys as conduits of quantitative research.

Not only will they extend your reach and influence geographically, but they also expand the size of your potential samples, while reducing costs considerably compared to securing a similar scope of respondents locally. Surveys do have obvious limitations against one-to-one qualitative studies, but with skilled questioning and efficient organisation, excellent results can still be gained for far lower overheads. Read more…

Even during recessionary times, the value of online transactions continues to increase. However, in a recent study carried out by Foviance, 44% of people surveyed said they didn’t buy online because they wanted to physically see the product. A further 18% cited the cost of delivery as a barrier to online shopping.

This white paper provides insight from over 100 respondents, into the buying habits and behaviours in the run up to the busiest time of year for retailers.  We probed respondents to understand their motivations, the barriers they are confronted with, and examples of best and worst websites that exist.

This paper highlights that customers are already using multiple channels as part of their purchase process dependent on what it is they are buying and the information provided at the various touch points. By enhancing the cross-channel customer experience, retailers can diminish the impact of the main barriers to conversion.

By Marty Carroll

This month’s newsletter combines November and December. In this last newsletter of 2009 we reflect on a difficult but eventful business year.

We saw customer experience play a critical role for many organisations strengthening their digital presence and cross-channel offering in order to provide the best possible levels of service for existing and new customers alike.

Looking back at 2009, Paul assesses how predictable the current landscape was at the outset, and then looks positively towards a tricky but exciting 2010. Meanwhile Amanda shares her insights from a conference on mobile, for those more concerned about sweating the small-screen stuff, and Lis takes a look down both sides of the narrowing divide between mobility and accessibility. Also, I look at the non-rational consumer, a lucrative segment.

Finally, Clare has been analysing our research into online retail habits ahead of the festive shopping season. If you would like a copy of the whitepaper as soon as it’s released, please e-mail info@foviance.com

I hope you have enjoyed your regular newsletters throughout the year. I’d also be very happy to hear from you directly with any feedback.

Marty.

In this issue:

• Looking back on 2009 and forward to 2010
• Researching the mobile experience
• The fine line between mobility and accessibility
• Tapping a lucrative segment: the non-rational consumer

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

An interesting report was published recently by E-consultancy that gives a useful insight into the state of play of the web analytics industry here in the UK. They surveyed around 700 people from “practitioners”, agencies consultancies and vendors around a number of themes including the use of analytics within organisations, the amount of investment being made and the use that people are making of the data that has been invested in.

When asked how many web analytics tool they were using within their business over 50% of people said they were using two systems or more. Quite often the scenario was that a company was using a paid-for tool and then were using Google Analytics as well. Relatively few organisations were using Google Analytic exclusively. This is a trend that I have observed as well, an organisation has a system from one of the major vendors and then also deploys Google Analytics “to see what it is like” because it’s free. This result throws up some interesting questions like: “is this a good idea or not?”. One the one hand you can argue that since it’s not costing anything, then what’s the problem? Maybe Google Analytics does some things better than the system that you already have in place. On the other hand software like Google Analytics might be free to buy but it’s not free to implement (that takes time and effort) nor is it free to maintain (that takes time and effort too). Given that many organisations find it challenging to properly implement and configure one web analytics tool, does it make sense to try and manage two?

The other thing that struck me about this is that two systems will inevitably been giving different results. So which one do you believe? There’s a saying that a man with two watches can never tell the time. I can understand organisation wanting to try out different tools but at the end of the day I feel its best to stick with one and make sure that it’s giving you what you need.

There was some good news from this report about the adoption of other tools, particularly Voice of the Customer tools. Over 60% of organisations said that they looked at customer survey data. I think that if this survey had been done a couple of years ago the number would have been a lot lower. It’s good to see that businesses are beginning to realise that you can’t measure the effectiveness of the digital marketing strategy just by looking at data that comes out of a web analytics tools and that you need other data, particularly customer insight data to fully understand what is going on.

There are some worrying signs from the report. Organisations admit that they are still often not tying up their data collection strategy to their business objectives and relatively few said that they were definitely getting actionable insights from their web analytics. Quite a number thought that a lot of the data they had wasn’t particularly useful for decision making purposes and the clue to the reasons why came when you looked at the resourcing of their web analytics programme. 45% of respondents didn’t have a dedicated web analyst and when you look at where the money is being spent, the biggest chunk is usually on the technology rather than the resources to extract the value from the technology. So it’s hardly surprising that organisations are finding they are struggling to get insight from their web analytic programme that leads to better decision making.

The signs from the report suggest that there is progress being made in the UK but more vision is required at the right levels of organisations to tie their business strategy and the measurement strategy together. Reasons often cited as being a major barrier to having an effective online measurement strategy included lack of coordination, lack of senior level buy-in, budget and resources rather than problems with the technologies. And I think that if there is a difference between what is happening over here on this side of the Atlantic to what is happening in the US, it is probably more to do with those factors than anything else. For those of you in the UK and the rest of Europe, it’s worth taking a look at the report and seeing how you benchmark.

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

A few weeks ago I took stock of the web analytics market, particularly looking at some of the key trends in Europe. This week to get a sense check from the position of someone in the US, I turn to a fellow WAA Board Director and friend Avinash Kaushik. Avinash is also an Author and one of the leading thinkers about web analytics and where it’s heading, having actually “been there and done it” previously at Intuit software.

This is what Avinash had to say.

Avinash, you had a busy year in 2007. What were some of the highlights for you?

It has indeed been a hectic year, becoming an Independent Consultant and Analytics Evangelist role at Google and publishing Web Analytics: An Hour A Day in June. Along they way speaking at conferences and running around the country became normal! Oh then there is the blog, Occam’s Razor, my baby (!), that took more time than I could ever have imagined.

I think the biggest professional highlight has to be the book. In five months sales have vastly exceeded my expectations. Since all of my proceeds go to charity (The Smile Train, Doctors Without Borders) it has meant a nice amount raised for them.

The book is a great primer and reference document for all things “web analytics”. But in this fast moving industry, isn’t it a risk writing a book? Are there some parts of the book that you think you might have to rewrite soon?

The core of the book I think will stand the test of time (and by that I mean five years at most! ). But there are many sections I would update. The book has been out only five months but I would add new things to the SEO section. Ditto for blogging metrics, I have slightly changed two of the six in the book and added a brand new one. I touch on Social Media but when I write the next version of the book I think things will be more settled and I can add more interesting things.

New tools will come with time, as will new sources of data and my book, or and those of others, will accommodate for that. But the biggest goal of Web Analytics: An Hour A Day is to teach you a new way of thinking, that I think will be relevant for quite some time to come.

All that said Willem from Wiley was over the other day asking me to start work on the next version!!

What do you consider to be some of the key industry developments to have been in 2007?

I get the distinct feeling that we will look back at 2007 and remember it as a turning point, a good one, for the industry.

Why is that?

Every site in the world seems to have Google Analytics – a leading indicator that even the most common person with tangential interest in data now has access to a great web analytics application. More interest translates into more mind share.

The industry has consolidated quite a bit. Omniture has built on top of its already impressive growth by acquiring Visual Science (/WebSideStory / HBX), in addition to Instadia (Analytics + Surveys), TouchClarity (Behaviour Targeting) and Offermatica (Multivariate Testing). This year all roads seemed to lead to Salt Lake City!

WebTrends is going through some temporary management turmoil, but with its excellent set of solutions I expect them to come back strong.

There were more web analytics consultancies launched, more than on you can count. Ditto for web analytics conferences. Actually a real interesting trend was how many non-analytics conferences had “web analytics day” or “web analytics pre-intensives” – a real sign of growing demands.

It was also a year of Web Analytics 2.0. An expansion of the core definition of what web analytics is, stretching is beyond just clickstream to include qualitative research, testing, competitive intelligence, multiple dimensions of outcomes etc.

So what are some of the key drivers?

Many, if not all, of the trends above were driven by a singular phenomenon: The web is becoming serious business.

It seems odd to say this in 2008 but in many companies web, and web analytics, have been a silo that someone else is taking care of. Websites are becoming the most important customer touch point and the most important revenue generator even for businesses that are not first of mind.

The consolidation in the industry, the increase in interest (tools or conferences) and expansion of the definition is a reaction to the demands now being placed driven by a desire to move beyond printing reports (to perhaps printing money!).

How would you assess where the web analytics industry is at the moment from the point of view of software vendors?

Full of opportunity.

Money and fame awaits all. Well at least those who are willing to work hard.

The vendors have done well thus far, mostly, but they are still scratching the surface of what is possible. Many big websites still don’t use web analytics. There are many growth opportunities in the Software market (aside from the current favourite child: hosted). We are not even scratching the surface of integration with data from other parts of the company and other tools should we decide that web analytics is not a silo but a part of “Business Analytics”? So there is a lot to do and appropriate financial rewards for companies that help accelerate the move beyond clickstream.

What about the people side, i.e. the end users and consultants?

There is a read dearth of skilled practitioners in our industry. And that has stunted the amount of progress that can be made (because the 10/90 rule still applies – spend $10 on software/services and $90 on people who can actually analyze data and produce insights). If you are a skilled person, you can name your own salary (but make sure you are on the web analytics 2.0 continuum and not 1.0), and if you are someone who wants a great Analytics career then now you know where to find it.

Consultants will thrive in any field where the rule is 10/90, because they can bring their expertise to bear on the $90 part of the equation. Additionally because of increase in the demand you are noticing many more consultancies (mom and pop and grandpa included), and an interest from the “big boys” for mature web analytics consultancies (example: our good friends Zaaz acquired by WPP). To make optimal amounts of money Consultancies, like other companies, are finding that they can’t be a one trick “let me parse your log files” pony. They are being forced to evolve into areas such as multivariate testing, competitive intelligence, usability etc.

What are some of the key trends that you see at moment? Where’s the market going?

The problem with Web Analytics 1.0 is that it is an exercise in data torture and reporting with long lags in taking action (if any). Data torture needs to get automated and expanded, decision making needs to get automated; people need to be left for smart hard things (vs. what happens today!). Smart companies will start to exploit more things like Multivariate Testing, Onsite Behaviour Targeting etc because in each case you are leaving humans to understand customers and create content and you are letting intelligent solutions create the right customer experience based on data. Won’t happen overnight, but are on this train for good.

I also believe that 2008 will see a more serious attempt to get Web Analytics to become a part of “Business Analytics”. We are still a silo in most companies (data and people!). We will see more collaboration and innovation in helping web data become a core part of the company data to truly give end to end visibility (and maybe the holy grail of multi channel analytics / impact). Won’t happen all in 2008, but we might get serious.

I am optimistic that we don’t have untouchable islands of data like we do today. Search Engine Optimization, RSS, Social Media, etc. They are all becoming mainstream yet the current generation of tools mostly stink at tracking them. You can track them, but if you are willing to row your leaky boat all by yourself to that island. I think this will change.

Oh and we are not done with consolidation in the industry.

It’s going to be fun!

I reckon so, thanks Avinash