Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgery
In this paper, we propose a multi-sensor super-resolution framework for hybrid imaging to super-resolve data from one modality by taking advantage of additional guidance images of a complementary modality. This concept is applied to hybrid 3-D range imaging in image-guided surgery, where high-qualit...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
3 July 2015
|
| In: |
Medical image analysis
Year: 2015, Jahrgang: 24, Heft: 1, Pages: 220-234 |
| ISSN: | 1361-8423 |
| DOI: | 10.1016/j.media.2015.06.011 |
| Online-Zugang: | Resolving-System, lizenzpflichtig, Volltext: https://doi.org/10.1016/j.media.2015.06.011 Verlag, lizenzpflichtig, Volltext: http://www.sciencedirect.com/science/article/pii/S1361841515000985 
|
| Verfasserangaben: | Thomas Köhler, Sven Haase, Sebastian Bauer, Jakob Wasza, Thomas Kilgus, Lena Maier-Hein, Christian Stock, Joachim Hornegger, Hubertus Feußner |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1724796151 | ||
| 003 | DE-627 | ||
| 005 | 20230426103239.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 200715s2015 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.media.2015.06.011 |2 doi | |
| 035 | |a (DE-627)1724796151 | ||
| 035 | |a (DE-599)KXP1724796151 | ||
| 035 | |a (OCoLC)1341345236 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 33 |2 sdnb | ||
| 100 | 1 | |a Köhler, Thomas |e VerfasserIn |0 (DE-588)1151351334 |0 (DE-627)1011588811 |0 (DE-576)49769087X |4 aut | |
| 245 | 1 | 0 | |a Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgery |c Thomas Köhler, Sven Haase, Sebastian Bauer, Jakob Wasza, Thomas Kilgus, Lena Maier-Hein, Christian Stock, Joachim Hornegger, Hubertus Feußner |
| 264 | 1 | |c 3 July 2015 | |
| 300 | |a 15 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 15.07.2020 | ||
| 520 | |a In this paper, we propose a multi-sensor super-resolution framework for hybrid imaging to super-resolve data from one modality by taking advantage of additional guidance images of a complementary modality. This concept is applied to hybrid 3-D range imaging in image-guided surgery, where high-quality photometric data is exploited to enhance range images of low spatial resolution. We formulate super-resolution based on the maximum a-posteriori (MAP) principle and reconstruct high-resolution range data from multiple low-resolution frames and complementary photometric information. Robust motion estimation as required for super-resolution is performed on photometric data to derive displacement fields of subpixel accuracy for the associated range images. For improved reconstruction of depth discontinuities, a novel adaptive regularizer exploiting correlations between both modalities is embedded to MAP estimation. We evaluated our method on synthetic data as well as ex-vivo images in open surgery and endoscopy. The proposed multi-sensor framework improves the peak signal-to-noise ratio by 2 dB and structural similarity by 0.03 on average compared to conventional single-sensor approaches. In ex-vivo experiments on porcine organs, our method achieves substantial improvements in terms of depth discontinuity reconstruction. | ||
| 650 | 4 | |a 3-D endoscopy | |
| 650 | 4 | |a Hybrid range imaging | |
| 650 | 4 | |a Open surgery | |
| 650 | 4 | |a Sensor fusion | |
| 650 | 4 | |a Super-resolution | |
| 700 | 1 | |a Haase, Sven |e VerfasserIn |4 aut | |
| 700 | 1 | |a Bauer, Sebastian |e VerfasserIn |4 aut | |
| 700 | 1 | |a Wasza, Jakob |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kilgus, Thomas |e VerfasserIn |4 aut | |
| 700 | 1 | |a Maier-Hein, Lena |d 1980- |e VerfasserIn |0 (DE-588)1075029252 |0 (DE-627)832869899 |0 (DE-576)190090804 |4 aut | |
| 700 | 1 | |a Stock, Christian |d 1978- |e VerfasserIn |0 (DE-588)123325218 |0 (DE-627)706256530 |0 (DE-576)29365624X |4 aut | |
| 700 | 1 | |a Hornegger, Joachim |e VerfasserIn |4 aut | |
| 700 | 1 | |a Feußner, Hubertus |e VerfasserIn |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Medical image analysis |d Amsterdam [u.a.] : Elsevier Science, 1996 |g 24(2015), 1, Seite 220-234 |h Online-Ressource |w (DE-627)306365081 |w (DE-600)1497450-2 |w (DE-576)091204941 |x 1361-8423 |7 nnas |a Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgery |
| 773 | 1 | 8 | |g volume:24 |g year:2015 |g number:1 |g pages:220-234 |g extent:15 |a Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgery |
| 856 | 4 | 0 | |u https://doi.org/10.1016/j.media.2015.06.011 |x Resolving-System |x Verlag |z lizenzpflichtig |3 Volltext |
| 856 | 4 | 0 | |u http://www.sciencedirect.com/science/article/pii/S1361841515000985 |x Verlag |z lizenzpflichtig |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20200715 | ||
| 993 | |a Article | ||
| 994 | |a 2015 | ||
| 998 | |g 123325218 |a Stock, Christian |m 123325218:Stock, Christian |d 910000 |d 999701 |e 910000PS123325218 |e 999701PS123325218 |k 0/910000/ |k 1/910000/999701/ |p 7 | ||
| 998 | |g 1075029252 |a Maier-Hein, Lena |m 1075029252:Maier-Hein, Lena |d 50000 |e 50000PM1075029252 |k 0/50000/ |p 6 | ||
| 999 | |a KXP-PPN1724796151 |e 3724390505 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"language":["eng"],"physDesc":[{"extent":"15 S."}],"title":[{"title":"Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgery","title_sort":"Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgery"}],"name":{"displayForm":["Thomas Köhler, Sven Haase, Sebastian Bauer, Jakob Wasza, Thomas Kilgus, Lena Maier-Hein, Christian Stock, Joachim Hornegger, Hubertus Feußner"]},"note":["Gesehen am 15.07.2020"],"recId":"1724796151","id":{"eki":["1724796151"],"doi":["10.1016/j.media.2015.06.011"]},"origin":[{"dateIssuedDisp":"3 July 2015","dateIssuedKey":"2015"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"person":[{"given":"Thomas","display":"Köhler, Thomas","family":"Köhler","role":"aut"},{"role":"aut","display":"Haase, Sven","family":"Haase","given":"Sven"},{"display":"Bauer, Sebastian","family":"Bauer","role":"aut","given":"Sebastian"},{"given":"Jakob","family":"Wasza","display":"Wasza, Jakob","role":"aut"},{"given":"Thomas","display":"Kilgus, Thomas","family":"Kilgus","role":"aut"},{"given":"Lena","role":"aut","display":"Maier-Hein, Lena","family":"Maier-Hein"},{"given":"Christian","family":"Stock","display":"Stock, Christian","role":"aut"},{"role":"aut","display":"Hornegger, Joachim","family":"Hornegger","given":"Joachim"},{"role":"aut","display":"Feußner, Hubertus","family":"Feußner","given":"Hubertus"}],"relHost":[{"recId":"306365081","type":{"bibl":"periodical","media":"Online-Ressource"},"titleAlt":[{"title":"Medical image analysis online"}],"pubHistory":["1.1996/97 -"],"disp":"Multi-sensor super-resolution for hybrid range imaging with application to 3-D endoscopy and open surgeryMedical image analysis","part":{"issue":"1","extent":"15","year":"2015","text":"24(2015), 1, Seite 220-234","pages":"220-234","volume":"24"},"id":{"zdb":["1497450-2"],"eki":["306365081"],"issn":["1361-8423"]},"origin":[{"dateIssuedKey":"1996","publisherPlace":"Amsterdam [u.a.]","dateIssuedDisp":"1996-","publisher":"Elsevier Science"}],"language":["eng"],"physDesc":[{"extent":"Online-Ressource"}],"title":[{"title":"Medical image analysis","title_sort":"Medical image analysis"}],"note":["Gesehen am 16.05.23"]}]} | ||
| SRT | |a KOEHLERTHOMULTISENSO3201 | ||