Interviewers’ Deviations in Surveys 3
|Convenor||Dr Natalja Menold (GESIS )|
|Coordinator 1||Professor Peter Winker (University of Giessen)|
Using Wave 1 data from the 2014 panel of the Survey of Income and Program Participation (SIPP), this study examines indicators of Field Representative (FR) performance. We focus on the correlations across indicators, the predictive value of early indicators like interviewer training certification test scores, and employ multilevel modeling to understand how much of the variance in key measures (like interview length, consent to record interviews, don’t know and item refusal rates, incomplete data, and contact strategies) are attributable to respondents, FRs, and regional offices.
Researchers make great efforts to refine question wording in the design of survey questionnaires, but interviewers may not read questions word by word in field interview. How could we find out interviewersâ€™ such deviant behavior? And what would be its consequences? This paper describes the strategies of detection and reports the discoveries from practices based on the experience and paradata of Chinese Family Panel Studies (CFPS). With a focus of three prominent problems identified above, it further investigates the factors that foster the deviant behavior and assesses the deviationsâ€™ influences on survey data quality.
In recent years, researchers have given greater attention to standardized and conversational interviewing techniques used in survey data collection. In this study, we explore respondents’ reactions to both interviewing techniques in a national face-to-face survey conducted in Germany. The recorded interviews were coded and tabulated into respected groups of variables. We find that respondents show more evidence of confusion when they recognize the interviewer’s ability to respond. We explore the situation when a difficult question is met with ease in the standardized group, but with confusion in the conversational group. We address the concern that conversational interviewers
Although interviewers are often expected to act in a neutral and standardized manner during survey interviews, to some extent they intentionally or unintentionally deviate from their instructions. We hypothesize that interviewers’ behaviour in responding to a questionnaire is related to the respondents’ behaviour in the same questionnaire through the way interviewers deviate from standardization in interacting with respondents. On the basis of data from the sixth round of the European Social Survey in Belgium and interviewer data from the same questionnaire, we investigate the relation between how interviewers and respondents answer survey questions.