Abstract
Background. Choice experiments (CE) are applied in health economics to elicit public preferences and willingness to pay (WTP). CEs are frequently administered as Internet-based surveys. Internet surveys have recognized advantages, but concerns exist about the representativeness of Internet samples, data quality, and the impact on elicited values. Aim. We conducted the first study in health comparing an Internet-based CE survey with the more traditional general population mail survey. We also compared the Internet-based and mail CE surveys with computer-assisted personal interviews (CAPIs), which are commonly used to elicit health state valuations. Methods. Two separate samples were drawn from 2 United Kingdom (UK) volunteer Internet panels (IPs), CAPIs were undertaken with respondents sampled from UK Census Output Areas, and mail surveys were sent to UK households drawn from the postcode address file (PAF). Each mode received more than 1000 respondents. We compared modes and frames using objective measures (response rate, sample representativeness of the UK population, elicited values, theoretical validity, and cost per response) and subjective/self-reported measures (time taken to complete the study, perceived study consequentiality, and stated attribute nonattendance). This study intentionally confounded the survey modes and sample frame by choosing sample frames that are typically used by researchers for each mode. Results. Estimated WTP differs across mode-frame pairs. On most measures, CAPIs dominated. They are more expensive, however. On all measures, except response rates, Internet surveys dominated the mail survey. They were also cheaper. Conclusion. Researchers using IPs should pay attention to response rates and be aware that the quality of IPs differs. Given the importance of perceived consequentiality and attribute attendance in CEs, future research should address their impact across modes and frames.
Original language | English |
---|---|
Pages (from-to) | 827-841 |
Number of pages | 15 |
Journal | Medical Decision Making |
Volume | 39 |
Issue number | 7 |
Early online date | 15 Sept 2019 |
DOIs | |
Publication status | Published - Oct 2019 |
Bibliographical note
This work was funded by the Medical Research Council MR/J004812/1. The Health Economics Research Unit is funded by the Chief Scientists Office of the Scottish Government Health and Social Care Directorates.Keywords
- survey mode
- sample frame
- choice experiment
- health care
- RESPONSE RATES
- MEDICINES
- ADHERENCE
- ONLINE
- QUESTIONNAIRES
- PREFERENCES
- FORMATS
- BELIEFS
- ASTHMA
Fingerprint
Dive into the research topics of 'Mode and Frame Matter: assessing the impact of survey mode and sample frame in choice experiments'. Together they form a unique fingerprint.Profiles
-
Mandy Ryan
- School of Medicine, Medical Sciences & Nutrition, Health Economics Research Unit - Emeritus Professor
Person: Honorary