Using Interactive Features to Motivate and Probe Responses to Open-Ended Questions
Single Wave Study
General Information
Title
Using Interactive Features to Motivate and Probe Responses to Open-Ended Questions
Project Number
19
Abstract
The project explores how interactive features in web surveys can influence respondent behavior.
In August 2008, the LISS panel was presented a questionnaire on the effect of including motivational statements and follow-up probes on response length and response quality of the responses to open-ended questions. The questionnaire included four open-ended questions and several closed-ended questions about the current situation in Dutch society. Respondents to the internet survey were randomly assigned to one of the four versions of the open-ended questions. The control version simply displayed the open-ended question; no motivating statement was included with the question and respondents were not branched to a follow-up probe. In the second version the open-ended question included the motivational statement ‘This question is very important to our survey’, but similar to the control version, respondents were not asked a follow-up probe. In the third version respondents were asked the open-ended question and after they submitted their initial response, they were branched to a follow-up probe screen. This screen displayed the respondent’s answer to the initial open-ended question and a follow-up probe (e.g., ‘Is there anything else you would like to add?’). Respondents to the fourth version were also asked the initial open-ended question and then branched to a follow-up probe with a motivational statement. In addition, people who did not answer the initial open-ended question (or who provided an answer like ‘don’t know’ or other answers that were less than four characters) were routed to a nonrespondent version that displayed the text ‘Please provide a response. This question is very important to our survey” and repeated the open-ended question.
In August 2008, the LISS panel was presented a questionnaire on the effect of including motivational statements and follow-up probes on response length and response quality of the responses to open-ended questions. The questionnaire included four open-ended questions and several closed-ended questions about the current situation in Dutch society. Respondents to the internet survey were randomly assigned to one of the four versions of the open-ended questions. The control version simply displayed the open-ended question; no motivating statement was included with the question and respondents were not branched to a follow-up probe. In the second version the open-ended question included the motivational statement ‘This question is very important to our survey’, but similar to the control version, respondents were not asked a follow-up probe. In the third version respondents were asked the open-ended question and after they submitted their initial response, they were branched to a follow-up probe screen. This screen displayed the respondent’s answer to the initial open-ended question and a follow-up probe (e.g., ‘Is there anything else you would like to add?’). Respondents to the fourth version were also asked the initial open-ended question and then branched to a follow-up probe with a motivational statement. In addition, people who did not answer the initial open-ended question (or who provided an answer like ‘don’t know’ or other answers that were less than four characters) were routed to a nonrespondent version that displayed the text ‘Please provide a response. This question is very important to our survey” and repeated the open-ended question.
Longitudinal Type
Single Wave Study
Researcher
Christian, Leah, Oudejans, Marije
Publisher
CentERdata
Copyright
© 2009 CentERdata
Funding Organization
CentERdata/MESS Project
DOI
https://doi.org/10.17026/dans-zsp-agty
Datasets and documentation
View Documentation
Codebook, English version
Codebook, Dutch (original) version
Data Files
English SPSS file
English STATA file
PDF file with extra long open answers (in Dutch)
Variables
| Variable name | Variable Label | Variable Type |
|---|---|---|
| nomem_encr | Number of household member encrypted | preloaded |
| at08a_m | Year and month of field work period | constructed |
| at08a001 | experimental version | constructed |
| at08a002 | Sequence of statements on citizens in Dutch society: displayed first | constructed |
| at08a003 | Sequence of statements on citizens in Dutch society: displayed second | constructed |
| at08a004 | Sequence of statements on citizens in Dutch society: displayed third | constructed |
| at08a005 | Sequence of statements on citizens in Dutch society: displayed fourth | constructed |
| at08a006 | Sequence of statements on citizens in Dutch society: displayed 5th | constructed |
| at08a007 | Sequence of statements on citizens in Dutch society: displayed 6th | constructed |
| at08a008 | Sequence of statements on citizens in Dutch society: displayed 7th | constructed |
| at08a009 | Sequence of statements on citizens in Dutch society: displayed 8th | constructed |
| at08a010 | Sequence of statements on citizens in Dutch society: displayed 9th | constructed |
| at08a011 | Sequence of statements on citizens in Dutch society: displayed 10th | constructed |
| at08a012 | Sequence of statements on citizens in Dutch society: displayed 11th | constructed |
| at08a013 | Sequence of statements on citizens in Dutch society: displayed 12th | constructed |
| at08a014 | Sequence of statements on citizens in Dutch society: displayed 13th | constructed |
| at08a015 | Sequence of statements on citizens in Dutch society: displayed 14th | constructed |
| at08a016 | Sequence of statements on basic principles of society: displayed first | constructed |
| at08a017 | Sequence of statements on basic principles of society: displayed second | constructed |
| at08a018 | Sequence of statements on basic principles of society: displayed third | constructed |
| at08a019 | Sequence of statements on basic principles of society: displayed fourth | constructed |
| at08a020 | How satisfied are you, generally speaking, about the way things are in the Netherlands nowadays? | directly measured |
| at08a021 | Why are you [satisfied/dissatisfied] with how things are in the Netherlands nowadays? | directly measured |
| at08a022 | This question is very important to our research. Why are you [satisfied/dissatisfied] with how things are in the Netherlands nowadays? | directly measured |
| at08a023 | Is there anything you would like to add? | directly measured |
| at08a024 | This question is very important to our research. Is there anything you would like to add? | directly measured |
| at08a025 | Please provide an answer. This question is very important to our research. Why are you [satisfied/dissatisfied] with how things are in the Netherlands nowadays? | directly measured |
| at08a026 | Would you say that Dutch society is heading in the right direction, or in the wrong direction? | directly measured |
| at08a027 | What do you see as the most important problems in Dutch society today? | directly measured |
| at08a028 | This question is very important to our research. What do you see as the most important problems in Dutch society today? | directly measured |
| at08a029 | Can you name any more problems? | directly measured |
| at08a030 | This question is very important to our research. Can you name any more problems? | directly measured |
| at08a031 | Please provide an answer. This question is very important to our research. What do you see as the most important problems in Dutch society today? | directly measured |
| at08a032 | Do you feel that you do enough for society? | directly measured |
| at08a033 | Do you feel that people in your direct environment do enough for society? | directly measured |
| at08a034 | Do you feel that Dutch people in general do enough for society? | directly measured |
| at08a035 | Do you feel that society does enough for you? | directly measured |
| at08a036 | In Dutch society, a citizen ought to help the neighbors | directly measured |
| at08a037 | In Dutch society, a citizen ought to speak the Dutch language | directly measured |
| at08a038 | In Dutch society, a citizen ought to perform voluntary work | directly measured |
| at08a039 | In Dutch society, a citizen ought to be familiar with Dutch culture | directly measured |
| at08a040 | In Dutch society, a citizen ought to stay informed of what is happening in society | directly measured |
| at08a041 | In Dutch society, a citizen ought to provide for his/her own income if he/she is able to work | directly measured |
| at08a042 | In Dutch society, a citizen ought to deal prudently with his/her expenditures and any debts | directly measured |
| at08a043 | In Dutch society, a citizen ought to give his/her own children a good upbringing | directly measured |
| at08a044 | In Dutch society, a citizen ought to take care of his/her own parents. | directly measured |
| at08a045 | In Dutch society, a citizen ought to contribute to keeping the neighborhood safe and tidy | directly measured |
| at08a046 | In Dutch society, a citizen ought to confront people behaving in undesirable ways | directly measured |
| at08a047 | In Dutch society, a citizen ought to adopt an eco-friendly way of life | directly measured |
| at08a048 | In Dutch society, a citizen ought to donate money to charity | directly measured |
| at08a049 | In Dutch society, a citizen ought to be member of a political party | directly measured |
| at08a050 | What would you prefer? | directly measured |
| at08a051 | What would you prefer? | directly measured |
| at08a052 | What would you prefer? | directly measured |
| at08a053 | What would you prefer? | directly measured |
| at08a054 | How do you judge the Netherlands as place to live? | directly measured |
| at08a055 | What do you like about living in the Netherlands? | directly measured |
| at08a056 | This question is very important to our research. What do you like about living in the Netherlands? | directly measured |
| at08a057 | Are there any other reasons why you like living in the Netherlands? | directly measured |
| at08a058 | This question is very important to our research. Are there any other reasons why you like living in the Netherlands? | directly measured |
| at08a059 | Please provide an answer. This question is very important to our research. What do you like about living in the Netherlands? | directly measured |
| at08a060 | How many years have you been living in the Netherlands? | directly measured |
| at08a061 | At the end of 2007, the WRR presented the report 'Identification with the Netherlands', about Dutch identity. To what extent have you read or heard about this report? | directly measured |
| at08a062 | To what degree do you believe that there is such a thing as a Dutch identity? | directly measured |
| at08a063 | What do you think are essential aspects of Dutch identity? Or, what would you consider to be typical for Dutch people? | directly measured |
| at08a064 | This question is very important to our research. What do you think are essential aspects of Dutch identity? Or, what would you consider to be typical for Dutch people? | directly measured |
| at08a065 | Are there any other things that you would consider typical for Dutch people? | directly measured |
| at08a066 | This question is very important to our research. Are there any other things that you would consider typical for Dutch people? | directly measured |
| at08a067 | Please provide an answer. This question is very important to our research. What would you consider to be typical for Dutch people? | directly measured |
| at08a068 | For how many years have you been using Internet? | directly measured |
| at08a069 | Did you find it difficult to answer the questions? | directly measured |
| at08a070 | Were the questions clear to you? | directly measured |
| at08a071 | Did the questionnaire get you thinking? | directly measured |
| at08a072 | Did you find the topic interesting? | directly measured |
| at08a073 | Did you enjoy answering the questions? | directly measured |
| at08a074 | Starting date of the interview | constructed |
| at08a075 | Starting time of the interview | constructed |
| at08a076 | End date of the interview | constructed |
| at08a077 | End time of the interview | constructed |
| at08a078 | duration in seconds | derived |
Questions
Questionnaire: Probes
Browse ProbesResponse Information
Response Overview
Response:Selected number of household members: 4268
Non-response: 1315 (31%)
Actual response: 2953 (69%)
Complete: 2928
Incomplete: 25
Collection Events
Period
04-08-2008 to 27-08-2008
Sample
Random selection of panel members with age greater or equal to 16
Collection Mode
internet survey
Fieldwork Note
a reminder was sent twice to non-respondents
Publications
Using interactive features to motivate and probe responses to open-ended questions In: M. Das, P. Ester & L. Kaczmirek (Eds.), Social and Behavioral Research and the Internet: Advances in Applied Methods and Research Strategies, pp. 215-244; Oudejans, M.
et al.