Repository logo
 

Research data supporting "Gesture Knitter: A Hand Gesture Design Tool for Head-Mounted Mixed Reality Applications"


Change log

Description

Data corresponding to experiments described in "Gesture Knitter: A Hand Gesture Design Tool for Head-Mounted Mixed Reality Applications".

The zipped folder participant_data.zip contains the raw hand tracking files for each of the eight participants. This includes the fine primitive gesture (for both hands), the gross gestures (right and left hands), the one-handed and two-handed complex gestures, the continuous online recognition data for one-handed and two-handed gestures, as well as the designed primitive and complex gesture if that individual participated in Study 2, the design study.

The raw data includes the x, y, z coordinates and the quaternions qx, qy, qz, and qw for each of the time series steps of the hand trajectory. The tracked elements are as follows:

cam -> camera palm -> plm wrist -> wrs thumb -> th index -> in middle -> mi ring -> ri pinky -> pi

The character "r" or "l" joined to the end of any of the above abbreviations denotes the right and left hands respectively.

CHI2021_Gesture_Knitter_supporting_data.xlsx contains the processed data derived from the raw data. It represents the recognition rates for each of the cases examined in our recognition experiments - training with all the primitive data, cross-validation results, as well as the recognition results from the synthetic data generation. The user study questionnaire sheet shows the user responses to the post-study questionnaire conducted in the design study.

The decoding text files (decoding_one_hand.txt, decoding_two_hand.txt, and online_recognition.txt) contain the output of the decoder when fed the various complex gesture traces. The number at the end of each decoding output is the edit distance to the correct declaration. The online results show the output of the online recognition experiment with gestures that are misclassified, false activations, or failure to recognize a gesture within that time frame.

Version

Software / Usage instructions

Excel

Publisher

Rights and licensing

Except where otherwised noted, this item's license is described as Attribution 4.0 International (CC BY 4.0)