Exploring gestural input for engineering surveys of real-life structures in virtual reality using photogrammetric 3D models
Authors
Lu, Yupu
Rydlewicz, Maciej
Rydlewicz, Wojciech
Bubas, Tomasz
Kristensson, Per Ola
Publication Date
2021-01-30Journal Title
Multimedia Tools and Applications
ISSN
1380-7501
Publisher
Springer US
Volume
80
Issue
20
Pages
31039-31058
Language
en
Type
Article
This Version
VoR
Metadata
Show full item recordCitation
Tadeja, S. K., Lu, Y., Rydlewicz, M., Rydlewicz, W., Bubas, T., & Kristensson, P. O. (2021). Exploring gestural input for engineering surveys of real-life structures in virtual reality using photogrammetric 3D models. Multimedia Tools and Applications, 80 (20), 31039-31058. https://doi.org/10.1007/s11042-021-10520-z
Description
Funder: Cambridge Commonwealth, European and International Trust; doi: https://doi.org/10.13039/501100003343
Funder: Tsinghua Academic Fund for Undergraduate Overseas Studies
Funder: Tsien Excellence in Engineering Program
Abstract
Abstract: Photogrammetry is a promising set of methods for generating photorealistic 3D models of physical objects and structures. Such methods may rely solely on camera-captured photographs or include additional sensor data. Digital twins are digital replicas of physical objects and structures. Photogrammetry is an opportune approach for generating 3D models for the purpose of preparing digital twins. At a sufficiently high level of quality, digital twins provide effective archival representations of physical objects and structures and become effective substitutes for engineering inspections and surveying. While photogrammetric techniques are well-established, insights about effective methods for interacting with such models in virtual reality remain underexplored. We report the results of a qualitative engineering case study in which we asked six domain experts to carry out engineering measurement tasks in an immersive environment using bimanual gestural input coupled with gaze-tracking. The qualitative case study revealed that gaze-supported bimanual interaction of photogrammetric 3D models is a promising modality for domain experts. It allows the experts to efficiently manipulate and measure elements of the 3D model. To better allow designers to support this modality, we report design implications distilled from the feedback from the domain experts.
Keywords
1173: Interaction in Immersive Experiences, Virtual reality, Photogrammetry, Industrial visual analytics, Immersive analytics, Digital twinning, Virtual reality content
Sponsorship
Engineering and Physical Sciences Research Council (1788814)
Identifiers
s11042-021-10520-z, 10520
External DOI: https://doi.org/10.1007/s11042-021-10520-z
This record's URL: https://www.repository.cam.ac.uk/handle/1810/328082
Rights
Licence:
http://creativecommons.org/licenses/by/4.0/
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.