Learning less is more: 6D camera localization via 3D surface regression

Popular research areas like autonomous driving and augmented reality have renewed the interest in image-based camera localization. In this work, we address the task of predicting the 6D camera pose from a single RGB image in a given 3D environment. With the advent of neural networks, previous works...

Full description

Saved in:
Bibliographic Details
Main Authors: Brachmann, Eric (Author) , Rother, Carsten (Author)
Format: Article (Journal) Chapter/Article
Language:English
Published: 27 Mar 2018
In: Arxiv

Online Access:Verlag, lizenzpflichtig, Volltext: http://arxiv.org/abs/1711.10228
Get full text
Author Notes:Eric Brachmann and Carsten Rother

MARC

LEADER 00000caa a2200000 c 4500
001 1731819463
003 DE-627
005 20220818195612.0
007 cr uuu---uuuuu
008 200914s2018 xx |||||o 00| ||eng c
035 |a (DE-627)1731819463 
035 |a (DE-599)KXP1731819463 
035 |a (OCoLC)1341359696 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 28  |2 sdnb 
100 1 |a Brachmann, Eric  |d 1987-  |e VerfasserIn  |0 (DE-588)1179206088  |0 (DE-627)1066600457  |0 (DE-576)518117634  |4 aut 
245 1 0 |a Learning less is more  |b 6D camera localization via 3D surface regression  |c Eric Brachmann and Carsten Rother 
264 1 |c 27 Mar 2018 
300 |a 11 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 14.09.2020 
520 |a Popular research areas like autonomous driving and augmented reality have renewed the interest in image-based camera localization. In this work, we address the task of predicting the 6D camera pose from a single RGB image in a given 3D environment. With the advent of neural networks, previous works have either learned the entire camera localization process, or multiple components of a camera localization pipeline. Our key contribution is to demonstrate and explain that learning a single component of this pipeline is sufficient. This component is a fully convolutional neural network for densely regressing so-called scene coordinates, defining the correspondence between the input image and the 3D scene space. The neural network is prepended to a new end-to-end trainable pipeline. Our system is efficient, highly accurate, robust in training, and exhibits outstanding generalization capabilities. It exceeds state-of-the-art consistently on indoor and outdoor datasets. Interestingly, our approach surpasses existing techniques even without utilizing a 3D model of the scene during training, since the network is able to discover 3D scene geometry automatically, solely from single-view constraints. 
650 4 |a Computer Science - Computer Vision and Pattern Recognition 
700 1 |a Rother, Carsten  |e VerfasserIn  |0 (DE-588)1181464692  |0 (DE-627)1662676883  |4 aut 
773 0 8 |i Enthalten in  |t Arxiv  |d Ithaca, NY : Cornell University, 1991  |g (2018) Artikel-Nummer 1711.10228, 11 Seiten  |h Online-Ressource  |w (DE-627)509006531  |w (DE-600)2225896-6  |w (DE-576)28130436X  |7 nnas  |a Learning less is more 6D camera localization via 3D surface regression 
773 1 8 |g year:2018  |g extent:11  |a Learning less is more 6D camera localization via 3D surface regression 
787 0 8 |i Forschungsdaten  |a Brachmann, Eric, 1987 -   |t DSAC++ visual camera re-localization [data]  |d Heidelberg : Universität, 2020  |h 1 Online-Ressource (2 Files)  |w (DE-627)1731819269 
856 4 0 |u http://arxiv.org/abs/1711.10228  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20200914 
993 |a Article 
994 |a 2020 
998 |g 1181464692  |a Rother, Carsten  |m 1181464692:Rother, Carsten  |d 700000  |d 708070  |e 700000PR1181464692  |e 708070PR1181464692  |k 0/700000/  |k 1/700000/708070/  |p 2  |y j 
998 |g 1179206088  |a Brachmann, Eric  |m 1179206088:Brachmann, Eric  |d 700000  |d 708070  |e 700000PB1179206088  |e 708070PB1179206088  |k 0/700000/  |k 1/700000/708070/  |p 1  |x j 
999 |a KXP-PPN1731819463  |e 3753071412 
BIB |a Y 
JSO |a {"language":["eng"],"recId":"1731819463","type":{"bibl":"chapter","media":"Online-Ressource"},"note":["Gesehen am 14.09.2020"],"person":[{"roleDisplay":"VerfasserIn","display":"Brachmann, Eric","role":"aut","family":"Brachmann","given":"Eric"},{"role":"aut","roleDisplay":"VerfasserIn","display":"Rother, Carsten","given":"Carsten","family":"Rother"}],"title":[{"title_sort":"Learning less is more","title":"Learning less is more","subtitle":"6D camera localization via 3D surface regression"}],"relHost":[{"title":[{"title_sort":"Arxiv","title":"Arxiv"}],"titleAlt":[{"title":"Arxiv.org"},{"title":"Arxiv.org e-print archive"},{"title":"Arxiv e-print archive"},{"title":"De.arxiv.org"}],"part":{"year":"2018","text":"(2018) Artikel-Nummer 1711.10228, 11 Seiten","extent":"11"},"pubHistory":["1991 -"],"language":["eng"],"recId":"509006531","disp":"Learning less is more 6D camera localization via 3D surface regressionArxiv","type":{"bibl":"edited-book","media":"Online-Ressource"},"note":["Gesehen am 28.05.2024"],"id":{"zdb":["2225896-6"],"eki":["509006531"]},"origin":[{"dateIssuedDisp":"1991-","publisher":"Cornell University ; Arxiv.org","dateIssuedKey":"1991","publisherPlace":"Ithaca, NY ; [Erscheinungsort nicht ermittelbar]"}],"physDesc":[{"extent":"Online-Ressource"}]}],"physDesc":[{"extent":"11 S."}],"name":{"displayForm":["Eric Brachmann and Carsten Rother"]},"id":{"eki":["1731819463"]},"origin":[{"dateIssuedDisp":"27 Mar 2018","dateIssuedKey":"2018"}]} 
SRT |a BRACHMANNELEARNINGLE2720