A recurrent neural network for particle tracking in microscopy images using future information, track hypotheses, and multiple detections

Automatic tracking of particles in time-lapse fluorescence microscopy images is essential for quantifying the dynamic behavior of subcellular structures and virus structures. We introduce a novel particle tracking approach based on a deep recurrent neural network architecture that exploits past and...

Full description

Saved in:
Bibliographic Details
Main Authors: Spilger, Roman (Author) , Imle, Andrea (Author) , Lee, Ji Young (Author) , Müller, Barbara (Author) , Fackler, Oliver Till (Author) , Bartenschlager, Ralf (Author) , Rohr, Karl (Author)
Format: Article (Journal)
Language:English
Published: 13 January 2020
In: IEEE transactions on image processing
Year: 2020, Volume: 29, Pages: 3681-3694
ISSN:1941-0042
DOI:10.1109/TIP.2020.2964515
Online Access:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1109/TIP.2020.2964515
Get full text
Author Notes:Roman Spilger, Andrea Imle, Ji-Young Lee, Barbara Müller, Oliver T. Fackler, Ralf Bartenschlager, Karl Rohr
Description
Summary:Automatic tracking of particles in time-lapse fluorescence microscopy images is essential for quantifying the dynamic behavior of subcellular structures and virus structures. We introduce a novel particle tracking approach based on a deep recurrent neural network architecture that exploits past and future information in both forward and backward direction. Assignment probabilities are determined jointly across multiple detections, and the probability of missing detections is computed. In addition, existence probabilities are determined by the network to handle track initiation and termination. For correspondence finding, track hypotheses are propagated to future time points so that information at later time points can be used to resolve ambiguities. A handcrafted similarity measure and handcrafted motion features are not necessary. Manually labeled data is not required for network training. We evaluated the performance of our approach using image data of the Particle Tracking Challenge as well as real fluorescence microscopy image sequences of virus structures. It turned out that the proposed approach outperforms previous methods.
Item Description:Gesehen am 30.03.2020
Physical Description:Online Resource
ISSN:1941-0042
DOI:10.1109/TIP.2020.2964515