Repository logo
 

Bodily Expression of Social Initiation Behaviors in ASC and non-ASC children: Mixed Reality vs. LEGO Game Play

cam.issuedOnline2020-12-27
cam.orpheus.counter15
cam.orpheus.successMon Feb 01 07:32:17 GMT 2021 - Embargo updated
dc.contributor.authorSayis, B
dc.contributor.authorPares, N
dc.contributor.authorGunes, H
dc.contributor.orcidGunes, Hatice [0000-0003-2407-3012]
dc.date.accessioned2020-09-30T23:30:30Z
dc.date.available2020-09-30T23:30:30Z
dc.date.issued2020
dc.description.abstractThis study is part of a larger project that showed the potential of our mixed reality (MR) system in fostering social initiation behaviors in children with Autism Spectrum Condition (ASC). We compared it to a typical social intervention strategy based on construction tools, where both mediated a face-to-face dyadic play session between an ASC child and a non-ASC child. In this study, our first goal is to show that an MR platform can be utilized to alter the nonverbal body behavior between ASC and non-ASC during social interaction as much as a traditional therapy setting (LEGO). A second goal is to show how these body cues differ between ASC and non-ASC children during social initiation in these two platforms. We present our first analysis of the body cues generated under two conditions in a repeated-measures design. Body cue measurements were obtained through skeleton information and characterized in the form of spatio-temporal features from both subjects individually (e.g. distances between joints and velocities of joints), and interpersonally (e.g. proximity and visual focus of attention). We used machine learning techniques to analyze the visual data of eighteen trials of ASC and non-ASC dyads. Our experiments showed that: (i) there were differences between ASC and non-ASC bodily expressions, both at individual and interpersonal level, in LEGO and in the MR system during social initiation; (ii) the number of features indicating differences between ASC and non-ASC in terms of nonverbal behavior during initiation were higher in the MR system as compared to LEGO; and (iii) computational models evaluated with combination of these different features enabled the recognition of social initiation type (ASC or non-ASC) from body features in LEGO and in MR settings. We did not observe significant differences between the evaluated models in terms of performance for LEGO and MR environments. This might be interpreted as the MR system encouraging similar nonverbal behaviors in children, perhaps more similar than the LEGO environment, as the performance scores in the MR setting are lower as compared to the LEGO setting. These results demonstrate the potential benefits of full body interaction and MR settings for children with ASC.
dc.description.sponsorshipEPSRC
dc.identifier.doi10.17863/CAM.58023
dc.identifier.isbn9781450380027
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/310931
dc.language.isoeng
dc.publisherACM
dc.publisher.urlhttp://dx.doi.org/10.1145/3395035.3425188
dc.rightsAll rights reserved
dc.subjectBodily Expression
dc.subjectBody Cues
dc.subjectAutism Spectrum Condition
dc.subjectMixed Reality
dc.subjectEmbodied Interaction
dc.subjectSocial Initiation
dc.subjectVirtual Reality
dc.subjectMachine Learning
dc.titleBodily Expression of Social Initiation Behaviors in ASC and non-ASC children: Mixed Reality vs. LEGO Game Play
dc.typeConference Object
dcterms.dateAccepted2020-09-01
prism.endingPage149
prism.publicationDate2020
prism.publicationNameICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction
prism.startingPage140
pubs.conference-finish-date2020-10-29
pubs.conference-nameICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
pubs.conference-start-date2020-10-25
pubs.funder-project-idEngineering and Physical Sciences Research Council (EP/R030782/1)
rioxxterms.licenseref.startdate2020-10-25
rioxxterms.licenseref.urihttp://www.rioxx.net/licenses/all-rights-reserved
rioxxterms.typeConference Paper/Proceeding/Abstract
rioxxterms.versionAM
rioxxterms.versionofrecord10.1145/3395035.3425188

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
ICMI2020-FGAHI.pdf
Size:
1.9 MB
Format:
Adobe Portable Document Format
Description:
Accepted version
Licence
http://www.rioxx.net/licenses/all-rights-reserved
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
DepositLicenceAgreementv2.1.pdf
Size:
150.9 KB
Format:
Adobe Portable Document Format