FIERY: Future Instance Prediction in Bird’s-Eye View from Surround Monocular Cameras
View / Open Files
Authors
Hu, Anthony
Murez, Zak
Mohan, Nikhil
Dudas, Sofia
Hawke, Jeffrey
Badrinarayanan, Vijay
Kendall, Alex
Conference Name
International Conference on Computer Vision (ICCV)
Type
Conference Object
This Version
AM
Metadata
Show full item recordCitation
Hu, A., Murez, Z., Mohan, N., Dudas, S., Hawke, J., Badrinarayanan, V., Cipolla, R., & et al. FIERY: Future Instance Prediction in Bird’s-Eye View from Surround Monocular Cameras. International Conference on Computer Vision (ICCV). https://doi.org/10.17863/CAM.77128
Abstract
Driving requires interacting with road agents and predicting their future behaviour in order to navigate safely. We present FIERY: a probabilistic future prediction model in bird’s-eye view from monocular cameras. Our model predicts future instance segmentation and motion of dynamic agents that can be transformed into non-parametric future trajectories. Our approach combines the perception, sensor fusion and prediction components of a traditional autonomous driving stack by estimating bird’s-eye-view prediction directly from surround RGB monocular camera inputs. FIERY learns to model the inherent stochastic nature of the future solely from camera driving data in an end-to-end manner, without relying on HD maps, and predicts multimodal future trajectories. We show that our model outperforms previous prediction baselines on the NuScenes and Lyft datasets. The code and trained models are available at
https://github.com/wayveai/fiery.
Sponsorship
Toshiba Europe, grant G100453.
Identifiers
External DOI: https://doi.org/10.17863/CAM.77128
This record's URL: https://www.repository.cam.ac.uk/handle/1810/329682
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.