A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Change log
Denes, G 
Mikhailiuk, Aliaksei  ORCID logo  https://orcid.org/0000-0001-9757-6644
Mantiuk, RK 

jats:pLimited GPU performance budgets and transmission bandwidths mean that real-time rendering often has to compromise on the spatial resolution or temporal resolution (refresh rate). A common practice is to keep either the resolution or the refresh rate constant and dynamically control the other variable. But this strategy is non-optimal when the velocity of displayed content varies. To find the best trade-off between the spatial resolution and refresh rate, we propose a perceptual visual model that predicts the quality of motion given an object velocity and predictability of motion. The model considers two motion artifacts to establish an overall quality score: non-smooth (juddery) motion, and blur. Blur is modeled as a combined effect of eye motion, finite refresh rate and display resolution. To fit the free parameters of the proposed visual model, we measured eye movement for predictable and unpredictable motion, and conducted psychophysical experiments to measure the quality of motion from 50 Hz to 165 Hz. We demonstrate the utility of the model with our on-the-fly motion-adaptive rendering algorithm that adjusts the refresh rate of a G-Sync-capable monitor based on a given rendering budget and observed object motion. Our psychophysical validation experiments demonstrate that the proposed algorithm performs better than constant-refresh-rate solutions, showing that motion-adaptive rendering is an attractive technique for driving variable-refresh-rate displays.</jats:p>

motion quality, adaptive refresh rate
Journal Title
ACM Transactions on Graphics
Conference Name
Journal ISSN
Volume Title
Association for Computing Machinery (ACM)
All rights reserved
European Research Council (725253)
European Commission Horizon 2020 (H2020) Marie Sklodowska-Curie actions (765911)
Engineering and Physical Sciences Research Council (EP/N509620/1)
Engineering and Physical Sciences Research Council (1778303)