Repository logo
 

PoseNet: A convolutional network for real-time 6-dof camera relocalization

Published version
Peer-reviewed

Type

Conference Object

Change log

Authors

Grimes, M 

Abstract

© 2015 IEEE. We present a robust and real-time monocular six degree of freedom relocalization system. Our system trains a convolutional neural network to regress the 6-DOF camera pose from a single RGB image in an end-to-end manner with no need of additional engineering or graph optimisation. The algorithm can operate indoors and outdoors in real time, taking 5ms per frame to compute. It obtains approximately 2m and 3 degrees accuracy for large scale outdoor scenes and 0.5m and 5 degrees accuracy indoors. This is achieved using an efficient 23 layer deep convnet, demonstrating that convnets can be used to solve complicated out of image plane regression problems. This was made possible by leveraging transfer learning from large scale classification data. We show that the PoseNet localizes from high level features and is robust to difficult lighting, motion blur and different camera intrinsics where point based SIFT registration fails. Furthermore we show how the pose feature that is produced generalizes to other scenes allowing us to regress pose with only a few dozen training examples.

Description

Keywords

cs.CV, cs.CV, cs.NE, cs.RO

Journal Title

Proceedings of the IEEE International Conference on Computer Vision

Conference Name

International Conference on Computer Vision

Journal ISSN

1550-5499

Volume Title

2015

Publisher

IEEE

Rights

Publisher's own licence