Repository logo
 

Fast and precise touch-based text entry for head-mounted augmented reality with variable occlusion

Simple item page
cam.issuedOnline2018-12-13
dc.contributor.authorDudley, JJ
dc.contributor.authorVertanen, K
dc.contributor.authorOla Kristensson, P
dc.contributor.orcidDudley, John [0000-0001-6692-4853]
dc.date.accessioned2018-10-16T10:36:11Z
dc.date.available2018-10-16T10:36:11Z
dc.date.issued2018
dc.description.abstract<jats:p>We present the VISAR keyboard: An augmented reality (AR) head-mounted display (HMD) system that supports text entry via a virtualised input surface. Users select keys on the virtual keyboard by imitating the process of single-hand typing on a physical touchscreen display. Our system uses a statistical decoder to infer users’ intended text and to provide error-tolerant predictions. There is also a high-precision fall-back mechanism to support users in indicating which keys should be unmodified by the auto-correction process. A unique advantage of leveraging the well-established touch input paradigm is that our system enables text entry with minimal visual clutter on the see-through display, thus preserving the user’s field-of-view. We iteratively designed and evaluated our system and show that the final iteration of the system supports a mean entry rate of 17.75wpm with a mean character error rate less than 1%. This performance represents a 19.6% improvement relative to the state-of-the-art baseline investigated: A gaze-then-gesture text entry technique derived from the system keyboard on the Microsoft HoloLens. Finally, we validate that the system is effective in supporting text entry in a fully mobile usage scenario likely to be encountered in industrial applications of AR HMDs.</jats:p>
dc.description.sponsorshipPer Ola Kristensson was supported in part by a Google Faculty research award and EPSRC grants EP/N010558/1 and EP/N014278/1. Keith Vertanen was supported in part by a Google Faculty research award. John Dudley was supported by the Trimble Fund.
dc.identifier.doi10.17863/CAM.31013
dc.identifier.eissn1557-7325
dc.identifier.issn1073-0516
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/283643
dc.language.isoeng
dc.publisherAssociation for Computing Machinery (ACM)
dc.publisher.urlhttp://dx.doi.org/10.1145/3232163
dc.subjectAugmented reality
dc.subjecttext entry
dc.titleFast and precise touch-based text entry for head-mounted augmented reality with variable occlusion
dc.typeArticle
dcterms.dateAccepted2018-06-09
prism.issueIdentifier6
prism.publicationDate2018
prism.publicationNameACM Transactions on Computer-Human Interaction
prism.volume25
pubs.funder-project-idEPSRC (1198)
pubs.funder-project-idEngineering and Physical Sciences Research Council (EP/R004471/1)
pubs.funder-project-idEngineering and Physical Sciences Research Council (EP/N014278/1)
pubs.funder-project-idEngineering and Physical Sciences Research Council (EP/N010558/1)
rioxxterms.licenseref.startdate2018-12-01
rioxxterms.licenseref.urihttp://www.rioxx.net/licenses/all-rights-reserved
rioxxterms.typeJournal Article/Review
rioxxterms.versionAM
rioxxterms.versionofrecord10.1145/3232163

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
TOCHI_VISAR_Keyboard_Author_Version.pdf
Size:
1.74 MB
Format:
Adobe Portable Document Format
Description:
Accepted version
Licence
http://www.rioxx.net/licenses/all-rights-reserved
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
DepositLicenceAgreement.pdf
Size:
417.78 KB
Format:
Adobe Portable Document Format
Download

Collections

Cambridge University Research Outputs