Complex Interaction as Emergent Behaviour: Simulating Mid-Air Virtual Keyboard Typing using Reinforcement Learning.
dc.contributor.author | Hetzel, Lorenz | |
dc.contributor.author | Dudley, John | |
dc.contributor.author | Feit, Anna Maria | |
dc.contributor.author | Kristensson, Per Ola | |
dc.date.accessioned | 2021-08-24T23:30:16Z | |
dc.date.available | 2021-08-24T23:30:16Z | |
dc.date.issued | 2021-11 | |
dc.identifier.issn | 1077-2626 | |
dc.identifier.uri | https://www.repository.cam.ac.uk/handle/1810/327095 | |
dc.description.abstract | Accurately modelling user behaviour has the potential to significantly improve the quality of human-computer interaction. Traditionally, these models are carefully hand-crafted to approximate specific aspects of well-documented user behaviour. This limits their availability in virtual and augmented reality where user behaviour is often not yet well understood. Recent efforts have demonstrated that reinforcement learning can approximate human behaviour during simple goal-oriented reaching tasks. We build on these efforts and demonstrate that reinforcement learning can also approximate user behaviour in a complex mid-air interaction task: typing on a virtual keyboard. We present the first reinforcement learning-based user model for mid-air and surface-aligned typing on a virtual keyboard. Our model is shown to replicate high-level human typing behaviour. We demonstrate that this approach may be used to augment or replace human testing during the validation and development of virtual keyboards. | |
dc.format.medium | Print-Electronic | |
dc.language | eng | |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | |
dc.rights | All rights reserved | |
dc.title | Complex Interaction as Emergent Behaviour: Simulating Mid-Air Virtual Keyboard Typing using Reinforcement Learning. | |
dc.type | Article | |
prism.publicationDate | 2021 | |
prism.publicationName | IEEE Trans Vis Comput Graph | |
prism.volume | PP | |
dc.identifier.doi | 10.17863/CAM.74549 | |
dcterms.dateAccepted | 2021-07-03 | |
rioxxterms.versionofrecord | 10.1109/TVCG.2021.3106494 | |
rioxxterms.version | AM | |
rioxxterms.licenseref.uri | http://www.rioxx.net/licenses/all-rights-reserved | |
rioxxterms.licenseref.startdate | 2021-08-27 | |
dc.contributor.orcid | Kristensson, Per Ola [0000-0002-7139-871X] | |
dc.identifier.eissn | 1941-0506 | |
rioxxterms.type | Journal Article/Review | |
pubs.funder-project-id | Engineering and Physical Sciences Research Council (EP/S027432/1) | |
cam.orpheus.success | Mon Sep 13 07:30:24 BST 2021 - Embargo updated | |
cam.orpheus.counter | 2 | |
rioxxterms.freetoread.startdate | 2021-08-27 |
Files in this item
This item appears in the following Collection(s)
-
Cambridge University Research Outputs
Research outputs of the University of Cambridge