DSAC - differentiable RANSAC for camera localization

RANSAC is an important algorithm in robust optimization and a central building block for many computer vision applications. In recent years, traditionally hand-crafted pipelines have been replaced by deep learning pipelines, which can be trained in an end-to-end fashion. However, RANSAC has so far n...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Brachmann, Eric (VerfasserIn) , Krull, Alexander (VerfasserIn) , Nowozin, Sebastian (VerfasserIn) , Shotton, Jamie (VerfasserIn) , Michel, Frank (VerfasserIn) , Gumhold, Stefan (VerfasserIn) , Rother, Carsten (VerfasserIn)
Dokumenttyp: Article (Journal) Kapitel/Artikel
Sprache:Englisch
Veröffentlicht: 21 Mar 2018
In: Arxiv

Online-Zugang:Verlag, lizenzpflichtig, Volltext: http://arxiv.org/abs/1611.05705
Volltext
Verfasserangaben:Eric Brachmann, Alexander Krull, Sebastian Nowozin, Jamie Shotton, Frank Michel, Stefan Gumhold, Carsten Rother

MARC

LEADER 00000caa a2200000 c 4500
001 1731805144
003 DE-627
005 20220818195440.0
007 cr uuu---uuuuu
008 200914s2018 xx |||||o 00| ||eng c
035 |a (DE-627)1731805144 
035 |a (DE-599)KXP1731805144 
035 |a (OCoLC)1341359580 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 28  |2 sdnb 
100 1 |a Brachmann, Eric  |d 1987-  |e VerfasserIn  |0 (DE-588)1179206088  |0 (DE-627)1066600457  |0 (DE-576)518117634  |4 aut 
245 1 0 |a DSAC - differentiable RANSAC for camera localization  |c Eric Brachmann, Alexander Krull, Sebastian Nowozin, Jamie Shotton, Frank Michel, Stefan Gumhold, Carsten Rother 
264 1 |c 21 Mar 2018 
300 |a 11 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 14.09.2020 
520 |a RANSAC is an important algorithm in robust optimization and a central building block for many computer vision applications. In recent years, traditionally hand-crafted pipelines have been replaced by deep learning pipelines, which can be trained in an end-to-end fashion. However, RANSAC has so far not been used as part of such deep learning pipelines, because its hypothesis selection procedure is non-differentiable. In this work, we present two different ways to overcome this limitation. The most promising approach is inspired by reinforcement learning, namely to replace the deterministic hypothesis selection by a probabilistic selection for which we can derive the expected loss w.r.t. to all learnable parameters. We call this approach DSAC, the differentiable counterpart of RANSAC. We apply DSAC to the problem of camera localization, where deep learning has so far failed to improve on traditional approaches. We demonstrate that by directly minimizing the expected loss of the output camera poses, robustly estimated by RANSAC, we achieve an increase in accuracy. In the future, any deep learning pipeline can use DSAC as a robust optimization component. 
650 4 |a Computer Science - Computer Vision and Pattern Recognition 
700 1 |a Krull, Alexander  |d 1982-  |e VerfasserIn  |0 (DE-588)1166992098  |0 (DE-627)1030841160  |0 (DE-576)510987850  |4 aut 
700 1 |a Nowozin, Sebastian  |d 1980-  |e VerfasserIn  |0 (DE-588)1075229596  |0 (DE-627)833048562  |0 (DE-576)443341532  |4 aut 
700 1 |a Shotton, Jamie  |e VerfasserIn  |4 aut 
700 1 |a Michel, Frank  |d 1976-  |e VerfasserIn  |0 (DE-588)136972470  |0 (DE-627)588730025  |0 (DE-576)30136978X  |4 aut 
700 1 |a Gumhold, Stefan  |d 1971-  |e VerfasserIn  |0 (DE-588)122461797  |0 (DE-627)081958366  |0 (DE-576)178366919  |4 aut 
700 1 |a Rother, Carsten  |e VerfasserIn  |0 (DE-588)1181464692  |0 (DE-627)1662676883  |4 aut 
773 0 8 |i Enthalten in  |t Arxiv  |d Ithaca, NY : Cornell University, 1991  |g (2018) Artikel-Nummer 1611.05705, 11 Seiten  |h Online-Ressource  |w (DE-627)509006531  |w (DE-600)2225896-6  |w (DE-576)28130436X  |7 nnas  |a DSAC - differentiable RANSAC for camera localization 
773 1 8 |g year:2018  |g extent:11  |a DSAC - differentiable RANSAC for camera localization 
787 0 8 |i Forschungsdaten  |a Brachmann, Eric, 1987 -   |t Differentiable RANSAC (DSAC) for visual re-localization [data]  |d Heidelberg : Universität, 2020  |h 1 Online-Ressource (1 File)  |w (DE-627)1731804253 
856 4 0 |u http://arxiv.org/abs/1611.05705  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20200914 
993 |a Article 
994 |a 2020 
998 |g 1181464692  |a Rother, Carsten  |m 1181464692:Rother, Carsten  |d 700000  |d 708070  |e 700000PR1181464692  |e 708070PR1181464692  |k 0/700000/  |k 1/700000/708070/  |p 7  |y j 
998 |g 1166992098  |a Krull, Alexander  |m 1166992098:Krull, Alexander  |d 700000  |d 708070  |e 700000PK1166992098  |e 708070PK1166992098  |k 0/700000/  |k 1/700000/708070/  |p 2 
998 |g 1179206088  |a Brachmann, Eric  |m 1179206088:Brachmann, Eric  |d 700000  |d 708070  |e 700000PB1179206088  |e 708070PB1179206088  |k 0/700000/  |k 1/700000/708070/  |p 1  |x j 
999 |a KXP-PPN1731805144  |e 3752923458 
BIB |a Y 
JSO |a {"recId":"1731805144","language":["eng"],"note":["Gesehen am 14.09.2020"],"type":{"bibl":"chapter","media":"Online-Ressource"},"person":[{"given":"Eric","family":"Brachmann","role":"aut","display":"Brachmann, Eric","roleDisplay":"VerfasserIn"},{"given":"Alexander","family":"Krull","role":"aut","roleDisplay":"VerfasserIn","display":"Krull, Alexander"},{"family":"Nowozin","given":"Sebastian","roleDisplay":"VerfasserIn","display":"Nowozin, Sebastian","role":"aut"},{"family":"Shotton","given":"Jamie","display":"Shotton, Jamie","roleDisplay":"VerfasserIn","role":"aut"},{"given":"Frank","family":"Michel","role":"aut","display":"Michel, Frank","roleDisplay":"VerfasserIn"},{"roleDisplay":"VerfasserIn","display":"Gumhold, Stefan","role":"aut","family":"Gumhold","given":"Stefan"},{"role":"aut","roleDisplay":"VerfasserIn","display":"Rother, Carsten","given":"Carsten","family":"Rother"}],"title":[{"title_sort":"DSAC - differentiable RANSAC for camera localization","title":"DSAC - differentiable RANSAC for camera localization"}],"relHost":[{"id":{"eki":["509006531"],"zdb":["2225896-6"]},"origin":[{"dateIssuedDisp":"1991-","publisher":"Cornell University ; Arxiv.org","dateIssuedKey":"1991","publisherPlace":"Ithaca, NY ; [Erscheinungsort nicht ermittelbar]"}],"physDesc":[{"extent":"Online-Ressource"}],"title":[{"title":"Arxiv","title_sort":"Arxiv"}],"language":["eng"],"recId":"509006531","disp":"DSAC - differentiable RANSAC for camera localizationArxiv","note":["Gesehen am 28.05.2024"],"type":{"bibl":"edited-book","media":"Online-Ressource"},"part":{"text":"(2018) Artikel-Nummer 1611.05705, 11 Seiten","extent":"11","year":"2018"},"titleAlt":[{"title":"Arxiv.org"},{"title":"Arxiv.org e-print archive"},{"title":"Arxiv e-print archive"},{"title":"De.arxiv.org"}],"pubHistory":["1991 -"]}],"physDesc":[{"extent":"11 S."}],"name":{"displayForm":["Eric Brachmann, Alexander Krull, Sebastian Nowozin, Jamie Shotton, Frank Michel, Stefan Gumhold, Carsten Rother"]},"id":{"eki":["1731805144"]},"origin":[{"dateIssuedDisp":"21 Mar 2018","dateIssuedKey":"2018"}]} 
SRT |a BRACHMANNEDSACDIFFER2120