Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration

Purpose: In laparoscopic surgery, soft tissue deformations substantially change the surgical site, thus impeding the use of preoperative planning during intraoperative navigation. Extracting depth information from endoscopic images and building a surface model of the surgical field-of-view is one wa...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Röhl, Sebastian (VerfasserIn) , Kenngott, Hannes Götz (VerfasserIn) , Müller, Beat P. (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 1 March 2012
In: Medical physics
Year: 2012, Jahrgang: 39, Heft: 3, Pages: 1632-1645
ISSN:2473-4209
DOI:10.1118/1.3681017
Online-Zugang:Verlag, Volltext: http://dx.doi.org/10.1118/1.3681017
Verlag, Volltext: https://aapm.onlinelibrary.wiley.com/doi/abs/10.1118/1.3681017
Volltext
Verfasserangaben:Sebastian Röhl, Sebastian Bodenstedt, Stefan Suwelack, Hannes Kenngott, Beat P. Müller‐Stich, Rüdiger Dillmann, Stefanie Speidel

MARC

LEADER 00000caa a2200000 c 4500
001 1580055222
003 DE-627
005 20230427065640.0
007 cr uuu---uuuuu
008 180815s2012 xx |||||o 00| ||eng c
024 7 |a 10.1118/1.3681017  |2 doi 
035 |a (DE-627)1580055222 
035 |a (DE-576)510055222 
035 |a (DE-599)BSZ510055222 
035 |a (OCoLC)1341016847 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Röhl, Sebastian  |e VerfasserIn  |0 (DE-588)1037861965  |0 (DE-627)756366712  |0 (DE-576)391902814  |4 aut 
245 1 0 |a Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration  |c Sebastian Röhl, Sebastian Bodenstedt, Stefan Suwelack, Hannes Kenngott, Beat P. Müller‐Stich, Rüdiger Dillmann, Stefanie Speidel 
264 1 |c 1 March 2012 
300 |a 14 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 15.08.2018 
520 |a Purpose: In laparoscopic surgery, soft tissue deformations substantially change the surgical site, thus impeding the use of preoperative planning during intraoperative navigation. Extracting depth information from endoscopic images and building a surface model of the surgical field-of-view is one way to represent this constantly deforming environment. The information can then be used for intraoperative registration. Stereo reconstruction is a typical problem within computer vision. However, most of the available methods do not fulfill the specific requirements in a minimally invasive setting such as the need of real-time performance, the problem of view-dependent specular reflections and large curved areas with partly homogeneous or periodic textures and occlusions. Methods: In this paper, the authors present an approach toward intraoperative surface reconstruction based on stereo endoscopic images. The authors describe our answer to this problem through correspondence analysis, disparity correction and refinement, 3D reconstruction, point cloud smoothing and meshing. Real-time performance is achieved by implementing the algorithms on thegpu. The authors also present a new hybrid cpu-gpu algorithm that unifies the advantages of the cpu and the gpu version. Results: In a comprehensive evaluation usingin vivo data, in silico data from the literature and virtual data from a newly developed simulation environment, the cpu, the gpu, and the hybrid cpu-gpu versions of the surface reconstruction are compared to a cpu and a gpu algorithm from the literature. The recommended approach toward intraoperative surface reconstruction can be conducted in real-time depending on the image resolution (20 fps for the gpu and 14fps for the hybrid cpu-gpu version on resolution of 640 × 480). It is robust to homogeneous regions without texture, large image changes, noise or errors from camera calibration, and it reconstructs the surface down to sub millimeter accuracy. In all the experiments within the simulation environment, the mean distance to ground truth data is between 0.05 and 0.6 mm for the hybrid cpu-gpu version. The hybrid cpu-gpu algorithm shows a much more superior performance than its cpu and gpu counterpart (mean distance reduction 26% and 45%, respectively, for the experiments in the simulation environment). Conclusions: The recommended approach for surface reconstruction is fast, robust, and accurate. It can represent changes in the intraoperative environment and can be used to adapt a preoperative model within the surgical site by registration of these two models. 
650 4 |a Architectures of general purpose stored programme computers 
650 4 |a biological tissues 
650 4 |a Biomedical engineering 
650 4 |a Calibration 
650 4 |a Cameras 
650 4 |a devices or methods 
650 4 |a Digital computing or data processing equipment or methods 
650 4 |a e.g. endoscopes 
650 4 |a e.g. tourniquets 
650 4 |a endoscopes 
650 4 |a Endoscopic imaging 
650 4 |a endoscopic procedures 
650 4 |a Illuminating arrangements therefor 
650 4 |a Image analysis 
650 4 |a Image data processing or generation 
650 4 |a image reconstruction 
650 4 |a Image reconstruction 
650 4 |a image registration 
650 4 |a image-guided therapy 
650 4 |a in general 
650 4 |a Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection 
650 4 |a intraoperative registration 
650 4 |a Liver 
650 4 |a medical computing 
650 4 |a medical image processing 
650 4 |a Medical image reconstruction 
650 4 |a Medical image smoothing 
650 4 |a Medical imaging 
650 4 |a mesh generation 
650 4 |a Reconstruction 
650 4 |a Registration 
650 4 |a Smoothing 
650 4 |a smoothing methods 
650 4 |a specially adapted for specific applications 
650 4 |a surface reconstruction 
650 4 |a Surface reconstruction 
650 4 |a surgery 
650 4 |a Surgical instruments 
650 4 |a Visual imaging 
700 1 |a Kenngott, Hannes Götz  |d 1979-  |e VerfasserIn  |0 (DE-588)141469994  |0 (DE-627)62780117X  |0 (DE-576)324023065  |4 aut 
700 1 |a Müller, Beat P.  |d 1971-  |e VerfasserIn  |0 (DE-588)14066209X  |0 (DE-627)70374819X  |0 (DE-576)317992287  |4 aut 
773 0 8 |i Enthalten in  |t Medical physics  |d Hoboken, NJ : Wiley, 1974  |g 39(2012), 3, Seite 1632-1645  |h Online-Ressource  |w (DE-627)265784867  |w (DE-600)1466421-5  |w (DE-576)074891243  |x 2473-4209  |7 nnas  |a Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration 
773 1 8 |g volume:39  |g year:2012  |g number:3  |g pages:1632-1645  |g extent:14  |a Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration 
856 4 0 |u http://dx.doi.org/10.1118/1.3681017  |x Verlag  |x Resolving-System  |3 Volltext 
856 4 0 |u https://aapm.onlinelibrary.wiley.com/doi/abs/10.1118/1.3681017  |x Verlag  |3 Volltext 
951 |a AR 
992 |a 20180815 
993 |a Article 
994 |a 2012 
998 |g 14066209X  |a Müller, Beat P.  |m 14066209X:Müller, Beat P.  |d 910000  |d 910200  |e 910000PM14066209X  |e 910200PM14066209X  |k 0/910000/  |k 1/910000/910200/  |p 5 
998 |g 141469994  |a Kenngott, Hannes Götz  |m 141469994:Kenngott, Hannes Götz  |d 910000  |d 910200  |e 910000PK141469994  |e 910200PK141469994  |k 0/910000/  |k 1/910000/910200/  |p 4 
999 |a KXP-PPN1580055222  |e 3022378041 
BIB |a Y 
SER |a journal 
JSO |a {"title":[{"title_sort":"Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration","title":"Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registration"}],"language":["eng"],"person":[{"display":"Röhl, Sebastian","given":"Sebastian","role":"aut","family":"Röhl"},{"display":"Kenngott, Hannes Götz","given":"Hannes Götz","role":"aut","family":"Kenngott"},{"family":"Müller","given":"Beat P.","role":"aut","display":"Müller, Beat P."}],"name":{"displayForm":["Sebastian Röhl, Sebastian Bodenstedt, Stefan Suwelack, Hannes Kenngott, Beat P. Müller‐Stich, Rüdiger Dillmann, Stefanie Speidel"]},"id":{"eki":["1580055222"],"doi":["10.1118/1.3681017"]},"physDesc":[{"extent":"14 S."}],"relHost":[{"note":["Gesehen am 01.08.2025"],"id":{"eki":["265784867"],"issn":["2473-4209","1522-8541"],"zdb":["1466421-5"]},"disp":"Dense GPU-enhanced surface reconstruction from stereo endoscopic images for intraoperative registrationMedical physics","physDesc":[{"extent":"Online-Ressource"}],"origin":[{"publisherPlace":"Hoboken, NJ ; College Park, Md. ; New York, NY","publisher":"Wiley ; AAPM ; [Verlag nicht ermittelbar]","dateIssuedDisp":"1974-","dateIssuedKey":"1974"}],"recId":"265784867","type":{"media":"Online-Ressource","bibl":"periodical"},"titleAlt":[{"title":"Medical physics online"}],"name":{"displayForm":["American Association of Physicists in Medicine ; American Institute of Physics"]},"pubHistory":["1.1974 -"],"language":["eng"],"part":{"issue":"3","pages":"1632-1645","extent":"14","volume":"39","text":"39(2012), 3, Seite 1632-1645","year":"2012"},"title":[{"title_sort":"Medical physics","title":"Medical physics"}]}],"note":["Gesehen am 15.08.2018"],"recId":"1580055222","origin":[{"dateIssuedDisp":"1 March 2012","dateIssuedKey":"2012"}],"type":{"media":"Online-Ressource","bibl":"article-journal"}} 
SRT |a ROEHLSEBASDENSEGPUEN1201