Repository logo

Intelligent Interactive Displays in Vehicles with Intent Prediction: A Bayesian framework

Accepted version



Change log


Murphy, JK 
Godsill, S 
Langdon, PM 
Hardy, R 


Using an in-vehicle interactive display, such as a touchscreen, typically entails undertaking a free hand pointing gesture and dedicating a considerable amount of attention, that can be otherwise available for driving, with potential safety implications. Due to road and driving conditions, the user input can also be subject to high levels of perturbations resulting in erroneous selections. In this article, we give an overview of the novel concept of an intelligent predictive display in vehicles. It can infer, notably early in the pointing task and with high confidence, the item the user intends to select on the display from the tracked free hand pointing gesture and possibly other available sensory data. Accordingly, it simplifies and expedites the target acquisition (pointing and selection), thereby substantially reducing the time and effort required to interact with an in-vehicle display. As well as briefly addressing the various signal processing and human factor challenges posed by predictive displays in the automotive environment, the fundamental problem of intent inference is discussed and a Bayesian formulation is introduced. Empirical evidence from data collected in instrumented cars is shown to demonstrate the usefulness and effectiveness of this solution.



46 Information and Computing Sciences, 4608 Human-Centred Computing

Journal Title

IEEE Signal Processing Magazine

Conference Name

Journal ISSN


Volume Title



Institute of Electrical and Electronics Engineers (IEEE)
Engineering and Physical Sciences Research Council (EP/K020153/1)
The authors would like to thank Jaguar Land Rover for funding this work under the the CAPE agreement and supporting the data collection on their test-track at the JLR Gaydon Centre, U.K.