ESRA 2019 Draft Programme at a Glance

The Power and Pitfalls of Combining Survey and Sensor Data 1

Session Organisers Miss Anne Elevelt (Utrecht University)
Dr Peter Lugtig (Utrecht University)
Dr Vera Toepoel (Utrecht University)
TimeWednesday 17th July, 14:00 - 15:00
Room D19

Sensor data offer great potential for social scientists interested in studying attitudes and behaviors. These kind of data are particularly interesting when they can be linked to and compared with other data sources. With more and more possibilities to collect additional data through smartphones (for example through smartphone apps or activity trackers) large-scale population surveys could rather easily be enriched. Participants carry their smartphone everywhere, enabling scientists to ask respondents to make pictures, or to collect GPS and accelerometer data and track for example how much participants move around and where they go. Opportunities abound.

However, there are still many unsolved and unique methodological questions and issues to collecting and using sensor data. This session invites presentations that investigate the potentials and challenges when combining survey and sensor data. We especially welcome papers that used and collected these kind of data, and address;

The power of sensor data
o Higher data quality?
o Lower respondent burden.

The pitfalls of sensor data
o Implementation issues; nonresponse, willingness, device use.
o Technical problems.
o Issues in collecting and accessing these data across the general population.
o Data storage.

Keywords: Big data; sensor data

Augmenting survey data with smartphone data: Is there a threat to panel retention?

Professor Mark Trappmann (Institute for Employment Research (IAB), University of Bamberg) - Presenting Author
Dr Sebastian Bähr (Institute for Employment Research (IAB))
Mr Georg Haas (Institute for Employment Research (IAB))
Professor Florian Keusch (University of Mannheim)
Professor Frauke Kreuter (Institute for Employment Research (IAB), University of Maryland, University of Mannheim)

The integration of individual survey data with sensor data of the respondents offers a high potential for social science research. It enables researchers to combine the advantages of surveys originating from the controlled research design and representative sample with new and detailed forms of measurements that smartphone sensors offer.

Combining individual survey data with mobile app and sensor data, however, usually requires some form of informed consent. In longitudinal surveys with repeated measurement, panel members who disapprove of the extra burden or feel that a line has been crossed by requesting access to potentially highly sensitive data, might decide to withdraw their cooperation for future panel waves.

The German panel study PASS is designed to collect data for research into (un)employment, poverty and social security. PASS is an annual mixed-mode CATI and CAPI panel survey of the general population that completed its 12th wave of data collection in 2018.

In January 2018, we invited randomly selected panelists (n=4,293), who had reported in the previous wave that they owned a smartphone, to participate in the IAB-SMART-Study. The panelists were asked to install an app on their smartphones. They were asked to give access to sensor data, GPS position or app usage data for half a year and were regularly asked to answer short questionnaires during that time.

The random selection of invitees allows us to evaluate the unintended effect that the request for participation to a smartphone study collecting information that might be considered sensitive has on panel retention in the subsequent wave. We will report results on response rates as well as on composition of respondents with respect to target variables of the survey.

Squats in surveys: the use of accelerometers for fitness tasks in surveys.

Miss Anne Elevelt (Utrecht University) - Presenting Author
Dr Jan Karem Höhne (University of Mannheim; RECSM-Universitat Pompeu Fabra)
Professor Annelies Blom (University of Mannheim)

Smartphones are becoming increasingly important and widely-used in survey completion. Smartphones also offer many new possibilities for survey research, such as extending data collection by using sensor data (e.g., acceleration). Sensor data, for instance, can be used as a more objective supplement to health and physical fitness measures in mobile web surveys. In this study, we therefore investigate respondents’ willingness to participate in fitness tasks during mobile web survey completion. In addition, we investigate the appropriateness of acceleration data to draw conclusions about respondents’ health and fitness level. For this purpose, we use “SurveyMotion (SM),” a JavaScript-based tool for smartphones to gather the acceleration of smartphones during survey completion and additionally employ traditional health and physical fitness measures. We ask respondents if they would generally be willing to take part in a fitness task during mobile web survey completion and employ a subsequent fitness task in which we ask respondents to do squats (knee bends) for one minute. Thus, we investigate respondents’ hypothetical as well as actual willingness and the general comparability of acceleration data with established health and physical fitness measures. We conduct an observational study by using a German nonprobability-based web panel with n = 1,500 respondents; the data collection takes place in September 2018. This study contributes to the development of more objective measures of respondents’ health and fitness in mobile web surveys and could be extended by further physical activity tasks in future research.

SurveyMaps: A sensor-based supplement to GPS in mobile web surveys

Mr Stephan Schlosser (University of Göttingen) - Presenting Author
Dr Jan Karem Höhne (University of Mannheim)
Mr Daniel Qureshi (University of Frankfurt)

The use of mobile devices, such as smartphones, to participate in web surveys has increased tremendously in recent years. The reasons for this development are a skyrocketing proportion of smartphone owners accompanied by an increase in high-speed mobile Internet access. This development also enables respondents to participate in web surveys without any time and place restrictions. For instance, they can take part on their morning way to work or at home in the afternoon. There are almost no limitations regarding mobile web survey participation. One strategy to investigate respondents’ position and completion conditions is the collection of GPS (Global Positioning System) data. However, a drawback of GPS is that its reception in buildings or beneath the ground is reduced or even impossible. We therefore propose “SurveyMaps (SMaps),” a JavaScript-based tool that combines passive data, such as IP address, acceleration, and compass, to provide a supplement to GPS data. In this usability study, we initially investigate the proper functioning of SMaps in public spaces, such as parks and cities, by using GPS data. To illustrate the functionality of SMaps, we present the results of a study in which we ask respondents to complete a mobile web survey on their smartphone while being outdoor and randomly walk around (informed consent will be obtained). The results of the pretests look very promising and indicate that SMaps reliably gathers respondents outdoor position. A next step is to test the application of SMaps in buildings and beneath the ground.