ESRA logo

ESRA 2023 Glance Program


All time references are in CEST

Using Internet Surveys in Cross-National Research

Session Organiser Dr Tom W Smith (NORC at the University of Chicago)
TimeFriday 21 July, 09:00 - 10:30
Room U6-01f

Pushed by the rising costs of traditional modes (face-to-face, telephone) and the COVID pandemic, there is ever increasing use of internet-based surveys in both national and cross-national research. The use internationally is especially challenging given the varying levels of internet availability, the different levels of familiarity with doing surveys on-line, and the various sample frames that can be employed for drawing internet samples across countries. This session will examine the use of internet surveys cross-nationally and consider such issues as 1) how can cross-national comparability be maximized, 2) the use of one-time internet surveys vs. employing internet panels, 3) the comparability of internet surveys to surveys using other modes and in particular the reliable measurement of trends over time when traditional modes are replaced by internet modes, and 4) the variation that occurs due to the devices used to access the internet and complete surveys (e.g. smartphone vs. lap/desktops). Research will draw on the European Social Survey, the International Social Survey Program, and other cross-national studies.

Keywords: Cross-national survey research, Mode, Internet

Papers

Where are my completes? Leveraging different response modes in a German online probability panel.

Ms Elena Babamova (Lifepanel)
Mr Carsten Broich (Lifepanel) - Presenting Author

In online probability panels or mixed mode probability panels it is so far standard to receive the majority of the completions via Email invites. To cover part of the offline population, elements like mail invitations, tablets or calls to landline phones are used additionally. Nevertheless, not much research has been conducted on the effectiveness of email as a major means for online probability panels. Within Lifepanel, members are recruited through phone for which an RDD Dual-Frame is the base for the probability selection. With the majority of the sample recruits coming from mobile phone numbers, it became questionable whether the email address is really required or whether the invites can be pushed to the mobile phone number via SMS or WhatsApp and yield higher response rates. As part of an adaptive design, it was tested to which extent it is possible to predict the most likely choice for response modes based on the demographics and use this knowledge to increase the panel response rates.


State of surveys: a comparison of NPS scores in 10 countries over 10 years

Ms Laura Wronski (SurveyMonkey)
Mr Sam Gutierrez (SurveyMonkey) - Presenting Author
Ms Zoe Padgett (SurveyMonkey)

Analyzing metadata from millions of survey responses from the SurveyMonkey platform the past 10 years, we explore trends in the survey-taking experience globally, and across countries and regions. Cross-cultural differences in response distributions have been well-established in the academic literature. In this research, we examine responses to all NPS questions asked in 10 countries around the world to compare how those scores have changed over time and how consistently their country-by-country variation is. This research highlights the changing respondent experience, and the various considerations that survey creators will have to keep in mind when designing questionnaires.