In higher education and science studies, our surveys are typically addressed to young and well educated individuals, e.g. students, graduates, doctoral students and researchers. Most of them are intensive computer and internet users and thus easy to reach by an survey administered online. This method of data collection is gaining importance. The DZHW’s long-term survey series are also successively being converted to online surveys. This leads to a number of methodological issues (e.g. potential mode effects through the interview channel, the design of complex question types, the use of paradata and the formulation of corresponding informed consents) that are investigated in this project.
Experimental Study on the Methodology of Online Surveys (ESMO)
A Randomized Controlled Trial Among Students in Germany
Start of the project: 2017-Aug-01 - End of the project: 2018-Dec-31
Presentations
What Predicts the Validity of Self-Reported Paradata? Results from the German HISBUS Online Access Panel.
Kastirke, N., Sudheimer, S., Fehring, G., & Schwabe, U. (2019, Juli).What Predicts the Validity of Self-Reported Paradata? Results from the German HISBUS Online Access Panel. Poster präsentiert auf der 8th Conference of the European Survey Research Association (ESRA 2019), Universität Zagreb, Kroatien.
What Predicts the Validity of Self-Reported Paradata? Results from the German HISBUS Online Access Panel.
Kastirke, N., Sudheimer, S., Fehring, G., & Schwabe, U. (2019, März).What Predicts the Validity of Self-Reported Paradata? Results from the German HISBUS Online Access Panel. Poster präsentiert auf der General Online Research (GOR19), Köln.
Abstract
Paradata, such as user agent strings (UAS), provide us with important client-side information about the technical conditions of web surveys. If due to different reasons for example data protection issues UAS are not available, one may directly ask survey participants for the required data. Until now it is unclear whether the validity of these self-reported paradata is determined by participants' general attitudes towards surveys, their willingness to participate and - in connection with technically demanding questions - distraction while answering.
To shed light into the question what predicts the consistency between UAS and self-reported paradata, we use the HISBUS Online Access Panel. The sample comprised 3.137 members with UAS...
Validity of Subjective Paradata - Results from the National Educational Panel Study and HISBUS Online Access Panel.
Fehring, G., Kastirke,N., Sudheimer, S., & Willige, J. (2018, März).Validity of Subjective Paradata - Results from the National Educational Panel Study and HISBUS Online Access Panel. Poster präsentiert auf der General Online Research (GOR18), Köln.
Experimental Study on the Methodology of Online Surveys (ESMO): Design of a Randomized Controlled Trial Among Students in Germany.
Kastirke, N. (2017, Juli).Experimental Study on the Methodology of Online Surveys (ESMO): Design of a Randomized Controlled Trial Among Students in Germany. Poster präsentiert auf der 7th Conference of the European Survey Research Association (ESRA) in Lissabon, Portugal.
Abstract
Switching from paper questionnaires to online surveys presents massive methodological challenges. To date, little is known about how these surveys have to be designed in order to achieve the highest possible data quality and to continue existing time series. Therefore, an Experimental Study on the Methodology of Online Surveys (ESMO 1) will be carried out in 2017. About 25,000 participants of a randomly recruited online access panel of German students are invited. They are randomly assigned to various conditions of eight scenarios assumed to influence response behavior. At the conference we will present the complete RCT design and initial results