Repository logo
 

Use of graphemic lexicons for spoken language assessment

Accepted version
Peer-reviewed

Type

Conference Object

Change log

Authors

Knill, KM 
Gales, MJF 
Kyriakopoulos, Konstantinos  ORCID logo  https://orcid.org/0000-0002-7659-4541
Ragni, A 
Wang, Y 

Abstract

Copyright © 2017 ISCA. Automatic systems for practice and exams are essential to support the growing worldwide demand for learning English as an additional language. Assessment of spontaneous spoken English is, however, currently limited in scope due to the difficulty of achieving sufficient automatic speech recognition (ASR) accuracy. "Off-the-shelf" English ASR systems cannot model the exceptionally wide variety of accents, pronunications and recording conditions found in non-native learner data. Limited training data for different first languages (L1s), across all proficiency levels, often with (at most) crowd-sourced transcriptions, limits the performance of ASR systems trained on non-native English learner speech. This paper investigates whether the effect of one source of error in the system, lexical modelling, can be mitigated by using graphemic lexicons in place of phonetic lexicons based on native speaker pronunications. Graphemicbased English ASR is typically worse than phonetic-based due to the irregularity of English spelling-to-pronunciation but here lower word error rates are consistently observed with the graphemic ASR. The effect of using graphemes on automatic assessment is assessed on different grader feature sets: audio and fluency derived features, including some phonetic level features; and phone/grapheme distance features which capture a measure of pronunciation ability.

Description

Keywords

graphemic speech recognition, spoken language assessment, automatic grading, non-native speakers

Journal Title

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Conference Name

Interspeech 2017

Journal ISSN

2308-457X
1990-9772

Volume Title

2017-August

Publisher

ISCA
Sponsorship
IARPA (4912046943)
Cambridge Assessment (unknown)