Instance separation emerges from inpainting

Deep neural networks trained to inpaint partially occluded images show a deep understanding of image composition and have even been shown to remove objects from images convincingly. In this work, we investigate how this implicit knowledge of image composition can be leveraged for fully self-supervis...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wolf, Steffen (VerfasserIn) , Hamprecht, Fred (VerfasserIn) , Funke, Jan (VerfasserIn)
Dokumenttyp: Article (Journal) Kapitel/Artikel
Sprache:Englisch
Veröffentlicht: 28 Feb 2020
In: Arxiv
Year: 2020, Pages: 1-11
DOI:10.48550/arXiv.2003.00891
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.48550/arXiv.2003.00891
Verlag, lizenzpflichtig, Volltext: http://arxiv.org/abs/2003.00891
Volltext
Verfasserangaben:Steffen Wolf, Fred A. Hamprecht, Jan Funke
Beschreibung
Zusammenfassung:Deep neural networks trained to inpaint partially occluded images show a deep understanding of image composition and have even been shown to remove objects from images convincingly. In this work, we investigate how this implicit knowledge of image composition can be leveraged for fully self-supervised instance separation. We propose a measure for the independence of two image regions given a fully self-supervised inpainting network and separate objects by maximizing this independence. We evaluate our method on two microscopy image datasets and show that it reaches similar segmentation performance to fully supervised methods.
Beschreibung:Gesehen am 13.07.2022
Beschreibung:Online Resource
DOI:10.48550/arXiv.2003.00891