Learning linearized assignment flows for image labeling

We introduce a novel algorithm for estimating optimal parameters of linearized assignment flows for image labeling. An exact formula is derived for the parameter gradient of any loss function that is constrained by the linear system of ODEs determining the linearized assignment flow. We show how to...

Full description

Saved in:
Bibliographic Details
Main Authors: Zeilmann, Alexander (Author) , Petra, Stefania (Author) , Schnörr, Christoph (Author)
Format: Article (Journal) Chapter/Article
Language:English
Published: 2 Aug 2021
In: Arxiv
Year: 2021, Pages: 1-26
DOI:10.48550/arXiv.2108.02571
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.48550/arXiv.2108.02571
Verlag, lizenzpflichtig, Volltext: http://arxiv.org/abs/2108.02571
Get full text
Author Notes:Alexander Zeilmann, Stefania Petra, Christoph Schnörr

MARC

LEADER 00000caa a2200000 c 4500
001 1817235125
003 DE-627
005 20230118161906.0
007 cr uuu---uuuuu
008 220921s2021 xx |||||o 00| ||eng c
024 7 |a 10.48550/arXiv.2108.02571  |2 doi 
035 |a (DE-627)1817235125 
035 |a (DE-599)KXP1817235125 
035 |a (OCoLC)1361714150 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 27  |2 sdnb 
100 1 |a Zeilmann, Alexander  |e VerfasserIn  |0 (DE-588)1225318092  |0 (DE-627)1744906696  |4 aut 
245 1 0 |a Learning linearized assignment flows for image labeling  |c Alexander Zeilmann, Stefania Petra, Christoph Schnörr 
264 1 |c 2 Aug 2021 
300 |a 26 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Identifizierung der Ressource nach: 4 Apr 2022 
500 |a Gesehen am 22.09.2022 
520 |a We introduce a novel algorithm for estimating optimal parameters of linearized assignment flows for image labeling. An exact formula is derived for the parameter gradient of any loss function that is constrained by the linear system of ODEs determining the linearized assignment flow. We show how to efficiently evaluate this formula using a Krylov subspace and a low-rank approximation. This enables us to perform parameter learning by Riemannian gradient descent in the parameter space, without the need to backpropagate errors or to solve an adjoint equation. Experiments demonstrate that our method performs as good as highly-tuned machine learning software using automatic differentiation. Unlike methods employing automatic differentiation, our approach yields a low-dimensional representation of internal parameters and their dynamics which helps to understand how assignment flows and more generally neural networks work and perform. 
650 4 |a 34C40, 62H35, 68U10, 68T05, 91A22 
650 4 |a Computer Science - Machine Learning 
650 4 |a Mathematics - Optimization and Control 
700 1 |a Petra, Stefania  |e VerfasserIn  |0 (DE-588)1065905580  |0 (DE-627)816924961  |0 (DE-576)425560155  |4 aut 
700 1 |a Schnörr, Christoph  |e VerfasserIn  |0 (DE-588)1023033348  |0 (DE-627)717351017  |0 (DE-576)168404540  |4 aut 
773 0 8 |i Enthalten in  |t Arxiv  |d Ithaca, NY : Cornell University, 1991  |g (2021), Artikel-ID 2108.02571, Seite 1-26  |h Online-Ressource  |w (DE-627)509006531  |w (DE-600)2225896-6  |w (DE-576)28130436X  |7 nnas  |a Learning linearized assignment flows for image labeling 
773 1 8 |g year:2021  |g elocationid:2108.02571  |g pages:1-26  |g extent:26  |a Learning linearized assignment flows for image labeling 
856 4 0 |u https://doi.org/10.48550/arXiv.2108.02571  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u http://arxiv.org/abs/2108.02571  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20220921 
993 |a Article 
994 |a 2021 
998 |g 1023033348  |a Schnörr, Christoph  |m 1023033348:Schnörr, Christoph  |d 110000  |d 110200  |d 110000  |d 110400  |d 700000  |d 728500  |e 110000PS1023033348  |e 110200PS1023033348  |e 110000PS1023033348  |e 110400PS1023033348  |e 700000PS1023033348  |e 728500PS1023033348  |k 0/110000/  |k 1/110000/110200/  |k 0/110000/  |k 1/110000/110400/  |k 0/700000/  |k 1/700000/728500/  |p 3  |y j 
998 |g 1065905580  |a Petra, Stefania  |m 1065905580:Petra, Stefania  |d 110000  |d 110200  |d 110000  |d 110400  |e 110000PP1065905580  |e 110200PP1065905580  |e 110000PP1065905580  |e 110400PP1065905580  |k 0/110000/  |k 1/110000/110200/  |k 0/110000/  |k 1/110000/110400/  |p 2 
998 |g 1225318092  |a Zeilmann, Alexander  |m 1225318092:Zeilmann, Alexander  |d 110000  |d 110200  |d 110000  |d 110400  |d 700000  |d 728500  |e 110000PZ1225318092  |e 110200PZ1225318092  |e 110000PZ1225318092  |e 110400PZ1225318092  |e 700000PZ1225318092  |e 728500PZ1225318092  |k 0/110000/  |k 1/110000/110200/  |k 0/110000/  |k 1/110000/110400/  |k 0/700000/  |k 1/700000/728500/  |p 1  |x j 
999 |a KXP-PPN1817235125  |e 4190568759 
BIB |a Y 
JSO |a {"person":[{"role":"aut","given":"Alexander","family":"Zeilmann","display":"Zeilmann, Alexander"},{"family":"Petra","display":"Petra, Stefania","given":"Stefania","role":"aut"},{"role":"aut","given":"Christoph","family":"Schnörr","display":"Schnörr, Christoph"}],"language":["eng"],"title":[{"title":"Learning linearized assignment flows for image labeling","title_sort":"Learning linearized assignment flows for image labeling"}],"note":["Identifizierung der Ressource nach: 4 Apr 2022","Gesehen am 22.09.2022"],"origin":[{"dateIssuedDisp":"2 Aug 2021","dateIssuedKey":"2021"}],"type":{"media":"Online-Ressource","bibl":"chapter"},"recId":"1817235125","name":{"displayForm":["Alexander Zeilmann, Stefania Petra, Christoph Schnörr"]},"physDesc":[{"extent":"26 S."}],"relHost":[{"disp":"Learning linearized assignment flows for image labelingArxiv","language":["eng"],"part":{"extent":"26","pages":"1-26","text":"(2021), Artikel-ID 2108.02571, Seite 1-26","year":"2021"},"note":["Gesehen am 28.05.2024"],"origin":[{"dateIssuedDisp":"1991-","publisherPlace":"Ithaca, NY ; [Erscheinungsort nicht ermittelbar]","dateIssuedKey":"1991","publisher":"Cornell University ; Arxiv.org"}],"type":{"bibl":"edited-book","media":"Online-Ressource"},"titleAlt":[{"title":"Arxiv.org"},{"title":"Arxiv.org e-print archive"},{"title":"Arxiv e-print archive"},{"title":"De.arxiv.org"}],"title":[{"title":"Arxiv","title_sort":"Arxiv"}],"recId":"509006531","pubHistory":["1991 -"],"physDesc":[{"extent":"Online-Ressource"}],"id":{"zdb":["2225896-6"],"eki":["509006531"]}}],"id":{"eki":["1817235125"],"doi":["10.48550/arXiv.2108.02571"]}} 
SRT |a ZEILMANNALLEARNINGLI2202