Survey monitoring
In this episode, Barry Schouten discusses survey monitoring and the use of dashboards with Brady West and James Wagner. Paul Burton also presents how such dashboards and indicators are used and interpreted in practice. Survey monitoring is becoming more and more important, especially considering rising costs, new data collection modes, and responsive and adaptive survey designs. The following topics are covered:
- History and experience of using dashboards for survey monitoring
- Evolution of dashboards
- Dashboards content in the responsive design framework
- The process of interventions based on the dashboards
- Dashboards in the context of different modes of data collection and mix-mode
- Transition from micro- to macro-level of survey monitoring
- Data protection with regard to dashboards data
- Tailoring interviewers’ reactions to respondents’ concerns regarding survey participation
- Recent changes in the survey environment
- Future of dashboards
References:
Groves, R. M., & Heeringa, S. G. (2006). Responsive design for household surveys: tools for actively controlling survey errors and costs. Journal of the Royal Statistical Society Series A: Statistics in Society, 169(3), 439-457.
Kreuter, F. (2013), Improving Surveys with Paradata. Analytic Uses of Process Information. Edited Book. Wiley Series in Survey Methodlogy
Wagner, J., West, B.T., Kim, B., Suolang, D., Engstrom, C., Sinibaldi, J. (2024), Using a Stopping Rule to Optimize Cost-Quality Tradeoffs in a Large, Mixed-Mode Survey: A Simulation Study, JOS, https://doi.org/10.1177/0282423X241287452
Schouten, B., Calinescu, M., Luiten, A. (2013), Optimizing quality of response through adaptive survey designs, Survey Methodology, 39 (1), 29 – 58.
Affiliations:
Prof. Dr. Brady T. West – Research Professor, Survey Research Center, Institute for Social Research, University of Michigan-Ann Arbor
Prof. Dr. James Wagner – Research Professor, Survey Research Center, Institute for Social Research, University of Michigan-Ann Arbor; Adjunct Lecturer in Quant Methods and Social Science Program, College of Literature, Science, and the Arts, University of Michigan-Ann Arbor
Paul Burton – Lead Statistician, Survey Research Center, Institute for Social Research, University of Michigan-Ann Arbor
Prof. Dr. Barry Schouten – Senior Methodologist at Centraal Bureau voor de Statistiek (CBS)