Recipes for successful online surveys

In my previous article we looked at the need to combine detailed data from site analysis systems with additional consumer insight gleaned from surveys. This week, some thoughts on how to ensure your surveys are as effective as possible.

First of all, there are many different forms of surveys that an online business might run and they can vary on a number of dimensions. For example you might be surveying visitors on your site as opposed to customers, you might be collecting some general background information or you might be asking about a specific issue. The survey might be a once off survey or it may be run on a continuous basis. Indeed some of the different dimensions that might be involved and considered in the development of an online survey include:

  • The purpose of the survey
  • The target audience for the survey
  • The type of survey and how the respondents are recruited
  • The number of responses needed
  • The expected response rate
  • The purpose of the survey

Purpose of the survey
Any survey should have clear objectives; there must be a reason why you want to do it. There could be more than one research objective in a survey, but it is important that they are clearly stated, easily understood and are not contradictory. From the objectives everything else flows, ie the type of survey needed, the target audience and so on.
The target audience for the survey
It should be apparent from the objectives who you want to talk to in the survey. You may not want to invest time and effort understanding everything about everybody who visits your site. Your primary interest will be about finding out the right information about the types of visitors who are of most interest to you, like customers, subscribers and so on.

The type of survey
Having determined what the survey’s objectives are and who you want to survey, you are in a better position to decide on the type of survey that is most likely to meet your needs

On the whole, there are two main types of online surveys:

  • Pop-up surveys
  • Site based surveys

Pop up surveys (as the name implies) pop up in a window on your site. They must generally be short and easy to answer. Site based surveys are potentially more extensive surveys that people are directed to on a separate part of the site or on another site altogether. Some of the key differences between pop-up surveys and site-based surveys are highlighted below.

Pop-up surveys
 Site Based Surveys
Pop up on the site
 Survey hosted elsewhere on the site or on another site
Generally must be kept short (c. 5mins) as they are invasive to the site visit
 Can be longer (up to 15 to 20 minutes)
Susceptible to pop-up blockers
   
Invitation to take part is generally random on the site
 Specific people can be invited to take part by e-mail or can be randomly invited on the site
No control over who answers the survey
 Ability to control the number or type of people who answer the survey.

The number of responses needed
Another key consideration for your survey is the number of completed responses you need. This can vary enormously with the type of work you are carrying out and the target audience for the survey itself. In general terms for consumer analysis, you would ideally be looking for about 400 respondents to allow you to be able to do any meaningful analysis.

Response rates
Having determined how many respondents you think you need, you then need to think about how you are going to get them. For a pop-up survey, visitors are typically randomly selected on the site and presented with the pop-up survey invitation. For a site-based survey, people will either be invited by e-mail or via an invitation on the site.

In either case, only a proportion of those who are invited to participate in the survey will actually do so and complete it. This proportion is known as the response rate. This response rate can vary from survey to survey and it has been found that response rates to surveys are influenced by:

  • The style and quality of the survey’s first page
  • Relationship with the web site and/or the brand
  • The level of interest and relevance of the survey to the potential respondent

If you are inviting people to participate using an e-mail, then the style of the e-mail and the subject line will also be an important factor affecting the response rate. You should try and make the call to action as interesting and as engaging as possible so that it cuts through the noise in their Inbox. You should use language be appropriate to the type of business that you are and also the relationship that you have with the potential respondent. Many e-mail and survey systems allow you to personalise the invite and this can be used to good effect to improve the chances that someone opens the e-mail and then acts on it.

Survey frequency
The final consideration will be on how often you are going to run the survey. A great many surveys are only run once to get some insight into a particular issue, eg the effects of a new site design, but some surveys such as a customer satisfaction monitor might be run more than once or on a continuous basis.

More from Applied Insights

See more: Articles
See more: Surveys
See more: Consumer insight

Learn about our web analytics consulting Discover our innovative marketing applications Get to know Applied Insights