Surveys

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

One of my predictions for this year is that retention marketing will increase it’s importance in the online marketing mix. My thinking is that acquisition marketing activities through channels such as affiliates and search is becoming increasingly sophistacted. The tools are out there, the skills are out there and the improvements in efficiencies are beginning to tail off. That’s not to say that there aren’t improvements to be made. It’s just not the low hanging fruit for most organisations these days.

At the same time, conversion optimisation is gaining momentum. There has been a lot more focus on what actually happens when someone gets to the site over the past couple of years, spawning the growth of web analytics and multi-variate testing services. There is still probably a lot of mileage to be gained for most organisations through site improvements but generally the process is underway.

However, from the work we have done with a number of organisations it seems to me that companies generally heave a sigh of relief when they make the sale as if the job is done. Having been through the effort of creating awareness, acquiring the traffic and converting it on the site, the important asset that has been created, ie the customer, is then neglected and the organisation sets off in pursuit of new ones. The result is most customer databases are littered with customers who have only transacted once. For more, the definition of retention marketing is converting someone twice without having to acquire them twice. You don’t want to have to go through all that heavy lifting again!

So as part of this increased focus on retention marketing there’s going to be an increased emphasis on customer loyalty. Over the next few weeks I’m going to be taking a look at issues around customer loyalty such as “what is customer loyalty?”, how do you measure loyalty and how can you use data and insights to manage the retention marketing process more effectively.

What do we mean by loyalty?

What do we mean by customer loyalty? For example is it a state of mind or it is a set of behaviours? How can we really establish whether a customer is loyal or not? In our multi-channel world is the notion of loyalty even valid or useful?

These are tough questions that have been debated for many years and, of course, there are arguments on all sides. If you look up the definition of loyalty is usually describes loyalty as being a “quality” which suggests it’s more attitudinal than behavioural. However in our marketing world we’re generally interested in outcomes, like someone buying something. But are behaviours actually always the best indicators of loyalty.

As part of my MBA I did a lot of research into store loyalty amongst supermarkets in the UK. I measured how much people spent in each of the grocery stores that they shopped in over a 12 week period and created a metric to measure how loyal they were to various retail brands. What I found was that most people spent most of their weekly shop in one supermarket. So you could argue that most people seemed to be “loyal”. But what is the context to this behaviour? Are they only loyal to that store because it happens to be the closest or the most convenient? Would they in fact rather shop somewhere else if it was more convenient?

Another example can be found in financial services. People can appear to be behaviourally very loyal to their bank. If I look at my own behaviour I have had my main account with my bank since I was a student. So I must be very loyal, right? Well if I was asked whether I considered myself to be a loyal supporter of my bank I would say that I wasn’t. I’m behaviourally loyal but I don’t consider myself to be a loyal customer. The problem is that the pain of switching accounts to another bank is just too high at the moment. There are inertia effects at work and there is a great deal of inertia in financial services.

Of course, the internet is a technology that can break down inertia. There is the famous saying that “your competitor is only one click away”. I can now choose to get my groceries delivered by whichever supermarket will deliver to my area. I am actively encouraged to use shopping comparison sites to get the best deal from a selection of stores.

However the technology can also create barriers to switching which means for example, that our household generally get’s all it’s online groceries from one supermarket chain because all our orders are stored there. Similarly Amazon get’s a significant chunk of my expenditure in certain categories mainly because it’s so easy to buy, not because they are necessarily the cheapest.

So how do we measure customer loyalty? Do we look at behavioural indicators or should we be concerned about what our customers think of us? Or both? This is something I’ll be looking at next time. Till then…

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

I can’t believe I’m writing about this already but Christmas is coming… fast. Probably like a lot you, I’m going to be doing most of my shopping online. Spending a couple of evenings online is far preferable for me than battling down a busy high street. So online retailers in the UK can count on me making a modest contribution to the estimated £7 billion in online sales in the run up to Christmas this year.

I imagine that e-tailers all over the world are now refining their campaigns, optimising their store fronts and adjusting their merchandising strategies to maximise their returns during the peak period. But there was a timely reminder earlier this month from the IMRG (Interactive Media in Retail Group) here in the UK (an equivalent to Shop.org) that e-commerce is still a relatively immature channel for most retailers and that some aspects of their operations still require significant refinement.

The IMRG highlighted in its report that e-tailers need to improve their delivery services or face a backlash from consumers. They asserted that too many basic mistakes are being made, for example putting small items in large packages which then don’t fit through letterboxes. This view form the IMRG highlighted to me the need to consider the whole end-to-end process when we think about optimising the customer experience rather than just what happens on the website.

A huge amount of time and effort goes into optimising the visitors experience on the website and that’s great. Quite often on websites there is still quote a lot to be put right once decent measurement systems have been put in place. However, all that effort comes to little if the value created by a positive website experience is destroyed by a poor post sales experience.

When online, sites often attempt to survey me to find out about who I am and whether I was satisfied with my experience. Whilst I don’t answer every single one I applaud the attempt to understand more about me and to find out how I feel about their website, assuming that they do anything with the data. However, I struggle to remember if anyone has ever contacted me after I have bought something online to find out what I thought about the overall experience and importantly what I would do in the future as a result. Just because someone is satisfied with the website experience, it doesn’t necessarily mean that they end up wanting to do business with you again.

I would therefore suggest that if you don’t have a programme in place that gives you input to your visitors overall opinion of your performance then you’re missing a vital component of your overall measurement strategy. As well as understanding satisfaction with the on-site elements of the transaction, look to understand satisfaction with the off-site components of the transaction. For example:

• Were there any problems with the payment processes?
• What was their opinion on the delivery times and prices?
• Did the order tracking capability work well?
• Did the delivery arrive on time?
• Did they use customer services/My Account etc?
• Was that a good experience?

I saw a good example of such a programme being put in place at Emetrics in Washington. StubHub.com presented on what they were doing to track the overall customer experience. In addition to phone surveys, website pop-up surveys and exit surveys, they also ran “post event surveys” two weeks after the transaction had occurred on the site to find out if everything went smoothly for both the buyer and the seller and if not, why not.

As conversion optimisation processes become increasingly tuned, other aspects of the customer experience are likely to be where retention battles might be won or lost. So, find out what impact the experience had on the likelihood of them doing business with you again. Propensity scores such as “likelihood to return” and “likelihood to recommend” strong indicators of satisfaction and customer lifetime value.

So when it comes to evaluating performance in January let’s not just focus on sales, orders, conversion rates and the like. Consider also whether the experience worked for the customer as well – all of it. Remember, a customer is for life, not just for Christmas!

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

I got a bit of a wake-up call this week. An event which I thought was a long off is getting closer. The Emetrics summit in Washington DC in October is now only a matter of a few weeks away and the event organiser, Jim Sterne, has been marshalling his speakers.

Jim’s developed the approach for this Emetrics summit into a multi-track format. I’ve been given the job of moderating a track on “The Voice of the Customer” and there’s a great line up of speakers including my fellow ClickZ columnist Jason Burby from Zaaz.

I’m really pleased that there’s this track at the conference. If you have looked at any of my other contributions to this column, you will know that I believe that the “web analytics” world for too long has been too “site centric” and not “customer centric” enough. In other words people tend to focus on too much on the analysis of the site, rather than on the people who are trying to use the site.

The inclusion of this track in the Emetrics summit means that we are going to get exposure on some of the issues, challenges and opportunities of working with surveys and other customer data sources alongside the data collected from web analytics systems. I’m looking forward to it.

Jim’s email giving the speakers their instructions for the event made me start thinking about the whole area again and just what some of those challenges and opportunities are. The opportunities are plenty and pretty obvious. Augmenting your understanding of behaviour on the site by adding additional insights into who your visitors or customers are and what they think gives you both sides of the story. I often say to clients that web analytics data tells you what is going on on your website and survey data often tells you why.

However, despite the many benefits many organisations still think of their data in silos. So what are the challenges to getting a more holistic approach to thinking about how the effectiveness of your online marketing programmes?

I think they probably fall into three main areas:

* Technical challenges
* Competency challenges
* Organisational challenges

The technical challenges are around getting the different data sources to sit next to each other in a way that makes it easier to analyse. This is the data integration challenge and I’ve written about macro data integration and micro data integration in previous articles in this column. The web analytics systems vendors are making it easier for us to be able to integrate survey data in with the site data and this is a good trend. Most of the major vendors now say that they can integrate survey data into their systems, but do look closely at exactly what they mean by “integration”. One Scandinavian web analytics company, Instadia, has gone as far as making customer surveys an integral part of their product with the ability to write, launch and analyse surveys from within the system. The survey data that is collected is stored in the same database as the visitor’s behavioural data. That’s what I call integration.

Competency and organisational challenges are probably two sides of the same coin. Analysis and reporting of continuous marketing data and the development and analysis of customer surveys are different skill sets. The web analytics industry is probably not mature enough yet for individuals to have had the opportunity to be exposed to survey work before getting involved in web analytics and vice-versa. Typically these may also be separate functions within an organisation. The web analytics data may be owned by the online marketing function and surveys may be owned by the marketing research or consumer insight function. Each function may not be familiar with the other sort of data and so it’s rare that they are brought together.

So lots of challenges and opportunities but things are definitely moving in the right direction. I’m looking forward to hearing the speakers at the Emetrics summit in Washington talking about how they have met those challenges, I’m sure it will be fascinating. I’d also be interested in hearing from you if you have some good examples of how you have successfully integrated web analytics and customer data.

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

Over the past few weeks I have been taking a look at the variety of data sources available for evaluating e-business performance in addition to the data that comes from your site. These additional sources include audience panels, surveys and focus groups. I’ve also been making the point that purely focussing on web analytics data rarely gives you the full picture.

To talk about this on a practical level let’s take a look at how multiple data sources can be used together to look at a specific business issue such as optimising conversion rates on the site. The simple premise is that if you know who is coming to your site, why they are there and what they are trying to do then you can develop the site to optimise these key customer journeys.

To help digital property owners understand how visitors are interacting with their site we use something called a Customer Journey Framework. This framework is an approach to understanding which visitors are trying to use the site, how they are using it and whether they are being successful in their goals or not. There isn’t a single source of data that will give you the answer to these questions. You need to draw the answers from a suite of different places.

The Customer Journey Framework comprises of three key components:

• Understanding the different types of visitors (Audience segments)
• Understanding why people visit the site (Intentions)
• Understanding usage of the site and the consumption of different content (Content)

Different people come to your site for different reasons and there are bound to be different segments of visitors. The challenge is to work out what the most meaningful segments are for your business that you can use for your marketing and site development activities. This is something we’ll take a look at in the future.

Working out who is coming to your site is where you might use audience panel data, surveys or internal data from customer of registration databases. The reality is that you might need to use all three to build up a true profile of the different types of users that you might have. Audience panels can give you a demographic profile (if your site is large enough) but they may not help you to segment your audience in a meaningful way.

Surveys can help you understand if different types of visitors are coming to your site for different reasons. We call these “intention modes”. What is the visitor’s intention when they arrive on the site? What is their goal? To use an e-commerce example, a visitor may come to a site in one of these modes:

• To browse for something and buy it they find something they like
• To do research for price comparison purposes
• To buy a specific product that they have already researched
• To browse around with no intention of buying anything

Visitors in each of these modes will have different goals and will also exhibit different behaviours on the site.

By linking intentions to visitor segments you may find that some modes are more pronounced in certain groups of visitors. For example, in some work for a high street retailer in the UK we found distinct differences in these modes were evident when we looked at it along age and gender lines. In this particular case, older females were tending to arrive at the site with higher levels of purchase intent than younger females. The younger females were looking to be inspired by the site to make a purchase whereas the older females were more likely to already have in their mind what they wanted to buy.

The final link is then to layer these visitor segments and their modes onto the actual content of the site. This is where web analytics data is important and the linking the behaviours that you see on the site back to what you know about visitors and what they are trying to do. So, in our example above are the younger females looking at different types of products than the older females and so do those products need to be merchandised differently on the site to maximise conversion?

Linking behavioural data and profiling data can be tricky. It’s certainly easier if you can identify at least some of the site’s visitors through say a registration process or a transaction. You can match the profiling data captured in the process with the actual behaviour on the site and use that information to generalise for all traffic. It is also possible to link survey response and site behaviour data as well, though certainly here in Europe you need to be mindful of privacy concerns about identifying individuals.

The framework we’ve looked at here is one example of bringing together data from different sources to get a holistic view of what is happening on the site. It’s also just that – a framework, which can be adapted to suit the circumstances of your own site and information sources.

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

In my previous article we looked at the need to combine detailed data from site analysis systems with additional consumer insight gleaned from surveys. This week, some thoughts on how to ensure your surveys are as effective as possible.

First of all, there are many different forms of surveys that an online business might run and they can vary on a number of dimensions. For example you might be surveying visitors on your site as opposed to customers, you might be collecting some general background information or you might be asking about a specific issue. The survey might be a once off survey or it may be run on a continuous basis. Indeed some of the different dimensions that might be involved and considered in the development of an online survey include:

• The purpose of the survey
• The target audience for the survey
• The type of survey and how the respondents are recruited
• The number of responses needed
• The expected response rate
• The purpose of the survey

Purpose of the survey

Any survey should have clear objectives; there must be a reason why you want to do it. There could be more than one research objective in a survey, but it is important that they are clearly stated, easily understood and are not contradictory. From the objectives everything else flows, ie the type of survey needed, the target audience and so on.

The target audience for the survey

It should be apparent from the objectives who you want to talk to in the survey. You may not want to invest time and effort understanding everything about everybody who visits your site. Your primary interest will be about finding out the right information about the types of visitors who are of most interest to you, like customers, subscribers and so on.

The type of survey

Having determined what the survey’s objectives are and who you want to survey, you are in a better position to decide on the type of survey that is most likely to meet your needs

On the whole, there are two main types of online surveys:

• Pop-up surveys
• Site based surveys

Pop up surveys (as the name implies) pop up in a window on your site. They must generally be short and easy to answer. Site based surveys are potentially more extensive surveys that people are directed to on a separate part of the site or on another site altogether. Some of the key differences between pop-up surveys and site-based surveys are highlighted below.

The number of responses needed

Another key consideration for your survey is the number of completed responses you need. This can vary enormously with the type of work you are carrying out and the target audience for the survey itself. In general terms for consumer analysis, you would ideally be looking for about 400 respondents to allow you to be able to do any meaningful analysis.

Response rates

Having determined how many respondents you think you need, you then need to think about how you are going to get them. For a pop-up survey, visitors are typically randomly selected on the site and presented with the pop-up survey invitation. For a site-based survey, people will either be invited by e-mail or via an invitation on the site.

In either case, only a proportion of those who are invited to participate in the survey will actually do so and complete it. This proportion is known as the response rate. This response rate can vary from survey to survey and it has been found that response rates to surveys are influenced by:

• The style and quality of the survey’s first page
• Relationship with the web site and/or the brand
• The level of interest and relevance of the survey to the potential respondent

If you are inviting people to participate using an e-mail, then the style of the e-mail and the subject line will also be an important factor affecting the response rate. You should try and make the call to action as interesting and as engaging as possible so that it cuts through the noise in their Inbox. You should use language be appropriate to the type of business that you are and also the relationship that you have with the potential respondent. Many e-mail and survey systems allow you to personalise the invite and this can be used to good effect to improve the chances that someone opens the e-mail and then acts on it.

Survey frequency

The final consideration will be on how often you are going to run the survey. A great many surveys are only run once to get some insight into a particular issue, eg the effects of a new site design, but some surveys such as a customer satisfaction monitor might be run more than once or on a continuous basis.

This article, written by Neil Mason, was originally published on Clickz.com and is republished here with permission.

During the heady days of the dot-com boom in the late 1990s and early 2000s there was a common perception that this “new media” meant an end to many traditional marketing practices and I remember being told that as far as market research was concerned, that things were different in the “Internet world”.

Certainly, a more interactive experience for many businesses with their customers means that they had much more access to information on what their customers were doing (or not doing) than ever before. The web was perceived to be totally measurable through analysing behaviour on the site and that the use of traditional practices like market research was no longer appropriate to doing business in the digital age.

As we all know enormous amounts of data can be generated from online businesses about what visitors and customers are doing. It is possible to track their every movement through the website, you can tell how many people put something in their shopping basket and then either take it out again or fail to complete the check out process. It’s also possible to track exactly which creative of which ad was clicked on and which site it was clicked on to attract them to the site in the first place. We also all know of the challenges involved is generating meaningful insight from the vast quantities of web analytics data.

However, whilst site-centric data is very good at telling you what is happening it is generally very poor at telling you why it is happening. In addition, web analytics data can tell you all about what has happened in the past but doesn’t necessarily help you understand what might happen in the future.

Relying totally on analysis of web analytics data can be likened to diving down a motorway at full speed but only looking in your rear-view mirror. Whilst you can tell where you’ve been, you can’t tell what’s about to happen. Getting beyond the “what” and more into the “why” enables you to get beyond taking a purely historical perspective on the business and to form a view on where the business is going. To do this you need to get under the skin of your users and customers and understand why they do what they do and how they feel about it.

Surveys are one of the most common methods of understanding what customers think and how they feel and developments in the usability and affordability of online research tools means that conducting research amongst the customer base is now easier than ever before. However, there is a huge difference between deploying surveys that generate useful insight and pulling together a few questions or doing a poll on a website.

Concerns that have existed in the general market research world about possible biases by conducting research using online methods are not relevant to the online business. If a customer is doing business online then they are generally likely to be able to be researched using online methods.

Conducting research online can have many advantages over the more traditional approaches such as using face to face interviews or telephone research:

First of all, costs can be dramatically reduced as there is a much lower cost associated with actually collecting the data in the first place. Typically the actual costs of just collecting the data can be 50% of the overall costs of a market research study using face-to-face or telephone data collection.

Secondly, project times can be reduced. With some of the tools available for conducting online research it’s possible to write your questionnaire into a system and have it “in the field” within a day or so.

However, just because online research can be cheaper and faster, it doesn’t mean that it doesn’t deserve the same kind of rigour in its design. A badly designed survey is still a badly designed survey and it doesn’t matter whether the data is being collected face to face, over the telephone or on the web.

A badly designed survey can not only have an impact on response rates but can also have an impact on people’s perceptions of you as a brand. So whilst the increased accessibility of online research means that potentially many more businesses can use surveys as part of the marketing intelligence tool kit, they still need to ensure that those surveys have some degree of expertise applied to them as well.

Next time, some thoughts on how to improve the effectiveness of your online surveys.