Improving our understanding of user trial samples using survey data
View / Open Files
Conference Name
DRS 2022
Type
Conference Object
This Version
AM
Metadata
Show full item recordCitation
Petyaeva, A., Deane, J., Bradley, M., Waller, S., & Clarkson, P. J. Improving our understanding of user trial samples using survey data. DRS 2022. https://doi.org/10.17863/CAM.84160
Abstract
User research such as user trials provides valuable information on users and how they respond to interfaces in practice. However, it can be hard to ensure a repre-sentative sample. We propose a methodology to improve the understanding of a sample’s skew and to identify the characteristics of those who are missing by com-paring the sample with survey data. This can improve the interpretation of results and inform further recruitment to improve the sample. We provide a case study of this methodology in practice. 30 participants were recruited using quota sampling with significant effort to obtain people with low technology experience. Neverthe-less, comparison with UK survey data on technology experience, competence and attitudes identified four key groups of people not included in the sample, covering 29% of the population. We discuss how these missing people would likely respond on the tasks, based on the characteristics of similar people in the survey
Sponsorship
Funded by DFT and delivered through RSSB’s TOC'16 project: Towards the Inclusive Railway. Some of the work was also funded by the Dignity project which received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement number 875542
Funder references
European Commission Horizon 2020 (H2020) Research Infrastructures (RI) (875542)
Embargo Lift Date
2023-05-04
Identifiers
External DOI: https://doi.org/10.17863/CAM.84160
This record's URL: https://www.repository.cam.ac.uk/handle/1810/336739
Rights
Attribution-NonCommercial 4.0 International
Licence URL: https://creativecommons.org/licenses/by-nc/4.0/
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.
Recommended or similar items
The current recommendation prototype on the Apollo Repository will be turned off on 03 February 2023. Although the pilot has been fruitful for both parties, the service provider IKVA is focusing on horizon scanning products and so the recommender service can no longer be supported. We recognise the importance of recommender services in supporting research discovery and are evaluating offerings from other service providers. If you would like to offer feedback on this decision please contact us on: support@repository.cam.ac.uk