Shout It Loud

Designing surveys is easy; or is it? The truth is that writing surveys is easy but writing surveys that will be effective is a little bit more difficult. The following are twenty tips that if followed will help you with your survey questionnaire design and help you write effective surveys.

1. What is the survey’s purpose?

There are many reasons for conducting surveys and questionnaires. By correctly phrasing the questions and structuring the answers surveys can be used in a multitude of ways and for a variety of reasons. When designing a survey do not lose sight of its purpose.

2. Title the survey

The survey title is key and an opportunity to instantly summarise a survey’s objective and encourage respondents to participate. Respondents are going to invest time in completing the survey so make them feel that their investment is worthwhile.

3. Keep the survey as short as possible

Every question asked should be asked for a reason. Minimize the questions providing you with ‘nice to know’ information and focus instead on the ‘need to know’ questions.

4. Use plain English, maintain consistency, avoid jargon and acronyms and don’t ask questions that may result in ambiguous answers

Be careful when wording the question. If a question is not clear then there is every chance that respondents may interpret the question differently to that intended by the publisher making any analysis of the data meaningless or at the very least misleading.

5. Avoid questions that are long

Where practical use succinct sentences. Long questions can cause a respondent discomfort and lead to them abandoning the survey.

6. Ask one question at a time

Avoid confusing the respondent with a question like ‘Do you like football and golf?’

7. Do not influence the answer

It is important not to load the question. ‘Should irresponsible shop keepers who sell alcohol to minors be prosecuted?’ is unlikely to have any value.

8. Make sure that the chosen answer format allows the respondent to answer the question being asked

Ensure that the respondent can answer how they really feel or they may be inclined to abandon the survey. As a last resort consider the benefit of including a “Can’t say”, “No comment” or similar response option.

9. While you are compiling the survey consider, when the survey is complete, how the compiled data is going be analysed

When asking questions that allow for a free text open ended response, such as when asking the respondent for their comments, appreciate that such information is likely to be difficult to score and/or summarised. Consider grouping the answers into groups that will match your analysis requirements. For example “Indicate your length of service?” - ‘less than 1 year’, ‘between 1 and 6 years’ and ‘more than 6′.

10. Try and ensure that the questionnaire flows

Group the questions into clear categories as this makes the task of completing the survey easier for the participants.

11. Target your respondents carefully

In some cases you will want to target a specific group, in others a cross section. If you can’t control who responds to your survey consider including questions/answers that will allow you to filter out respondents who don’t fit your target profile.

12. Allow respondents to expand on their answers and/or make comments

By allowing respondents to make additional comments you will increase their satisfaction level and the comments will also give valuable feedback on the specific questions and/or the survey as a whole. Remember that for large sample collections that free text open ended responses may be difficult to analyze.

13. If the survey you are conducting is to be confidential ensure that you honour your pledge

If you have assured the respondents that the survey is confidential ensure that the individual data is not to be shared with anyone and the information is not going to be used for any other purpose. Confidentiality must be maintained at all times and any contact information destroyed after the survey is complete.

14. Weigh up the benefits of allowing respondents to be anonymous or identifiable

If your respondents are to be anonymous then you will be unable to follow up or match “pre” or “post” surveys. Allowing respondents to remain anonymous will however allow respondents to respond without possible peer pressure.

15. Give careful consideration to the best response format

It is good practice to maintain a consistency in the format used for responses. When designing your survey keep in mind that when analysing the data radio buttons are easier to analyse than check boxes that offer the respondent multiple responses. Do not use a check box if a radio response would do.

16. Inform the respondent as to the approximate time it will take to complete the survey

Respondent drop out can occur if the survey appears to be a stream of never ending questions. It is a good idea to give an indication as to how long the survey is likely to take so the respondents can choose the best time to complete the survey.

17. Inform respondents of the survey end date

Encourage respondents to complete the survey as soon as possible but advise respondents as to the survey’s end date so that they have the opportunity to schedule the necessary time.

18. Trial the survey

Before publishing a live survey publish the survey as a trial to check for questions that are ambiguous or confusing and to ensure that the survey is aesthetically pleasing.

19. Before publishing the survey check the survey several times

Check more than once that the survey is grammatically correct and makes sense. If practical get a colleague to check the survey before you publish, if you are unable to do this then take a break before checking again.

20. Thank your respondents

To complete surveys respondents need to invest their time and should be thanked either in a covering letter, at the end of completing the survey or in a follow up letter. You may even want to consider incentives such as a prize draw or reward.

To get started there are numerous survey software websites to choose from.