Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction

Purpose: In image-guided surgery (IGS) intraoperative image acquisition of tissue shape, motion, and morphology is one of the main challenges. Recently, time-of-flight (ToF) cameras have emerged as a new means for fast range image acquisition that can be used for multimodal registration of the patie...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mersmann, Sven (VerfasserIn) , Seitel, Alexander (VerfasserIn) , Erz, Michael (VerfasserIn) , Jähne, Bernd (VerfasserIn) , Nickel, Felix (VerfasserIn) , Mieth, Markus (VerfasserIn) , Mehrabi, Arianeb (VerfasserIn) , Maier-Hein, Lena (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 17 July 2013
In: Medical physics
Year: 2013, Jahrgang: 40, Heft: 8, Pages: 1-19
ISSN:2473-4209
DOI:https://doi.org/10.1118/1.4812889
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/https://doi.org/10.1118/1.4812889
Verlag, lizenzpflichtig, Volltext: https://aapm.onlinelibrary.wiley.com/doi/abs/10.1118/1.4812889
Volltext
Verfasserangaben:Sven Mersmann and Alexander Seitel, Division of Medical and Biological Informatics, Junior Group Computer-assisted Interventions, German Cancer Research Center (DKFZ), Heidelberg; Michael Erz and Bernd Jähne, Heidelberg Collaboratory for Image Processing (HCI), University of Heidelberg; Felix Nickel, Markus Mieth, and Arianeb Mehrabi, Department of General, Visceral and Transplant Surgery, University of Heidelberg; Lena Maier-Hein, Division of Medical and Biological Informatics, Junior Group Computer-assisted Interventions, German Cancer Research Center (DKFZ), Heidelberg

MARC

LEADER 00000caa a2200000 c 4500
001 1758234644
003 DE-627
005 20230427100739.0
007 cr uuu---uuuuu
008 210520s2013 xx |||||o 00| ||eng c
024 7 |a 10.1118/1.4812889  |2 doi 
035 |a (DE-627)1758234644 
035 |a (DE-599)KXP1758234644 
035 |a (OCoLC)1341413720 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Mersmann, Sven  |d 1980-  |e VerfasserIn  |0 (DE-588)1046014196  |0 (DE-627)775223204  |0 (DE-576)399331751  |4 aut 
245 1 0 |a Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction  |c Sven Mersmann and Alexander Seitel, Division of Medical and Biological Informatics, Junior Group Computer-assisted Interventions, German Cancer Research Center (DKFZ), Heidelberg; Michael Erz and Bernd Jähne, Heidelberg Collaboratory for Image Processing (HCI), University of Heidelberg; Felix Nickel, Markus Mieth, and Arianeb Mehrabi, Department of General, Visceral and Transplant Surgery, University of Heidelberg; Lena Maier-Hein, Division of Medical and Biological Informatics, Junior Group Computer-assisted Interventions, German Cancer Research Center (DKFZ), Heidelberg 
264 1 |c 17 July 2013 
300 |a 19 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Gesehen am 20.05.2021 
520 |a Purpose: In image-guided surgery (IGS) intraoperative image acquisition of tissue shape, motion, and morphology is one of the main challenges. Recently, time-of-flight (ToF) cameras have emerged as a new means for fast range image acquisition that can be used for multimodal registration of the patient anatomy during surgery. The major drawbacks of ToF cameras are systematic errors in the image acquisition technique that compromise the quality of the measured range images. In this paper, we propose a calibration concept that, for the first time, accounts for all known systematic errors affecting the quality of ToF range images. Laboratory andin vitro experiments assess its performance in the context of IGS. Methods: For calibration the camera-related error sources depending on the sensor, the sensor temperature and the set integration time are corrected first, followed by the scene-specific errors, which are modeled as function of the measured distance, the amplitude and the radial distance to the principal point of the camera. Accounting for the high accuracy demands in IGS, we use a custom-made calibration device to provide reference distance data, the cameras are calibrated too. To evaluate the mitigation of the error, the remaining residual error after ToF depth calibration was compared with that arising from using the manufacturer routines for several state-of-the-art ToF cameras. The accuracy of reconstructed ToF surfaces was investigated after multimodal registration with computed tomography (CT) data of liver models by assessment of the target registration error (TRE) of markers introduced in the livers. Results: For the inspected distance range of up to 2 m, our calibration approach yielded a mean residual error to reference data ranging from 1.5 ± 4.3 mm for the best camera to 7.2 ± 11.0 mm. When compared to the data obtained from the manufacturer routines, the residual error was reduced by at least 78% from worst calibration result to most accurate manufacturer data. After registration of the CT data with the ToF data, the mean TRE ranged from 3.7 ± 2.1 mm for point-based and 5.7 ± 1.9 mm for surface-based registration for the best camera to 6.2 ± 3.4 and 11.1 ± 2.8 mm, respectively. Compared to data provided by the manufacturer, the mean TRE decreased by 8%-60% for point-based and by 18%-74% for surface-based registration. Conclusions: Using the proposed calibration approach improved the measurement accuracy of all investigated ToF cameras. Although evaluated in the context of intraoperative image acquisition, the proposed calibration procedure can easily be applied to other medical applications using ToF cameras, such as patient positioning or respiratory motion tracking in radiotherapy. 
650 4 |a Accessories therefor 
650 4 |a Analysis of motion 
650 4 |a biomedical equipment 
650 4 |a Calibrating of instruments or apparatus 
650 4 |a calibration 
650 4 |a Calibration 
650 4 |a cameras 
650 4 |a Cameras 
650 4 |a Computed tomography 
650 4 |a Computerised tomographs 
650 4 |a computerised tomography 
650 4 |a data acquisition 
650 4 |a Data acquisition 
650 4 |a Data acquisition and logging 
650 4 |a Details of cameras or camera bodies 
650 4 |a devices or methods 
650 4 |a Digital computing or data processing equipment or methods 
650 4 |a e.g. tourniquets 
650 4 |a Error correction 
650 4 |a Illumination 
650 4 |a Image data processing or generation 
650 4 |a image motion analysis 
650 4 |a image reconstruction 
650 4 |a image registration 
650 4 |a image sensors 
650 4 |a Image sensors 
650 4 |a Imager structures 
650 4 |a in general 
650 4 |a intraoperative surface reconstruction 
650 4 |a liver 
650 4 |a Liver 
650 4 |a medical image processing 
650 4 |a Medical imaging 
650 4 |a Reconstruction 
650 4 |a Registration 
650 4 |a specially adapted for specific applications 
650 4 |a Standards and calibration 
650 4 |a Surface reconstruction 
650 4 |a surgery 
650 4 |a Surgical instruments 
650 4 |a Testing or calibrating of apparatus or arrangements provided for in groups G01D1/00 to G01D15/00 
650 4 |a time-of-flight cameras 
650 4 |a Transforming light or analogous information into electric information 
700 1 |a Seitel, Alexander  |d 1980-  |e VerfasserIn  |0 (DE-588)1025312058  |0 (DE-627)722029861  |0 (DE-576)370197003  |4 aut 
700 1 |a Erz, Michael  |e VerfasserIn  |0 (DE-588)143675222  |0 (DE-627)653845448  |0 (DE-576)338315683  |4 aut 
700 1 |a Jähne, Bernd  |d 1953-  |e VerfasserIn  |0 (DE-588)172169321  |0 (DE-627)697084426  |0 (DE-576)161561616  |4 aut 
700 1 |a Nickel, Felix  |d 1982-  |e VerfasserIn  |0 (DE-588)1067980059  |0 (DE-627)819414875  |0 (DE-576)427122619  |4 aut 
700 1 |a Mieth, Markus  |e VerfasserIn  |0 (DE-588)1071362240  |0 (DE-627)825726573  |0 (DE-576)433041072  |4 aut 
700 1 |a Mehrabi, Arianeb  |d 1967-  |e VerfasserIn  |0 (DE-588)137664583  |0 (DE-627)594829763  |0 (DE-576)304831263  |4 aut 
700 1 |a Maier-Hein, Lena  |d 1980-  |e VerfasserIn  |0 (DE-588)1075029252  |0 (DE-627)832869899  |0 (DE-576)190090804  |4 aut 
773 0 8 |i Enthalten in  |t Medical physics  |d Hoboken, NJ : Wiley, 1974  |g 40(2013), 8, Artikel-ID 082701, Seite 1-19  |h Online-Ressource  |w (DE-627)265784867  |w (DE-600)1466421-5  |w (DE-576)074891243  |x 2473-4209  |7 nnas  |a Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction 
773 1 8 |g volume:40  |g year:2013  |g number:8  |g elocationid:082701  |g pages:1-19  |g extent:19  |a Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction 
856 4 0 |u https://doi.org/https://doi.org/10.1118/1.4812889  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext 
856 4 0 |u https://aapm.onlinelibrary.wiley.com/doi/abs/10.1118/1.4812889  |x Verlag  |z lizenzpflichtig  |3 Volltext 
951 |a AR 
992 |a 20210520 
993 |a Article 
994 |a 2013 
998 |g 1075029252  |a Maier-Hein, Lena  |m 1075029252:Maier-Hein, Lena  |d 50000  |e 50000PM1075029252  |k 0/50000/  |p 8  |y j 
998 |g 137664583  |a Mehrabi, Arianeb  |m 137664583:Mehrabi, Arianeb  |d 910000  |d 910200  |e 910000PM137664583  |e 910200PM137664583  |k 0/910000/  |k 1/910000/910200/  |p 7 
998 |g 1071362240  |a Mieth, Markus  |m 1071362240:Mieth, Markus  |d 910000  |d 910200  |e 910000PM1071362240  |e 910200PM1071362240  |k 0/910000/  |k 1/910000/910200/  |p 6 
998 |g 1067980059  |a Nickel, Felix  |m 1067980059:Nickel, Felix  |d 910000  |d 910200  |e 910000PN1067980059  |e 910200PN1067980059  |k 0/910000/  |k 1/910000/910200/  |p 5 
998 |g 172169321  |a Jähne, Bernd  |m 172169321:Jähne, Bernd  |d 700000  |d 708070  |e 700000PJ172169321  |e 708070PJ172169321  |k 0/700000/  |k 1/700000/708070/  |p 4 
998 |g 143675222  |a Erz, Michael  |m 143675222:Erz, Michael  |p 3 
998 |g 1025312058  |a Seitel, Alexander  |m 1025312058:Seitel, Alexander  |p 2 
998 |g 1046014196  |a Mersmann, Sven  |m 1046014196:Mersmann, Sven  |d 50000  |e 50000PM1046014196  |k 0/50000/  |p 1  |x j 
999 |a KXP-PPN1758234644  |e 3929837323 
BIB |a Y 
SER |a journal 
JSO |a {"recId":"1758234644","name":{"displayForm":["Sven Mersmann and Alexander Seitel, Division of Medical and Biological Informatics, Junior Group Computer-assisted Interventions, German Cancer Research Center (DKFZ), Heidelberg; Michael Erz and Bernd Jähne, Heidelberg Collaboratory for Image Processing (HCI), University of Heidelberg; Felix Nickel, Markus Mieth, and Arianeb Mehrabi, Department of General, Visceral and Transplant Surgery, University of Heidelberg; Lena Maier-Hein, Division of Medical and Biological Informatics, Junior Group Computer-assisted Interventions, German Cancer Research Center (DKFZ), Heidelberg"]},"origin":[{"dateIssuedDisp":"17 July 2013","dateIssuedKey":"2013"}],"person":[{"display":"Mersmann, Sven","given":"Sven","family":"Mersmann","role":"aut"},{"given":"Alexander","display":"Seitel, Alexander","family":"Seitel","role":"aut"},{"role":"aut","given":"Michael","display":"Erz, Michael","family":"Erz"},{"role":"aut","display":"Jähne, Bernd","given":"Bernd","family":"Jähne"},{"role":"aut","display":"Nickel, Felix","given":"Felix","family":"Nickel"},{"role":"aut","family":"Mieth","given":"Markus","display":"Mieth, Markus"},{"family":"Mehrabi","given":"Arianeb","display":"Mehrabi, Arianeb","role":"aut"},{"display":"Maier-Hein, Lena","given":"Lena","family":"Maier-Hein","role":"aut"}],"language":["eng"],"title":[{"title":"Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction","title_sort":"Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"id":{"doi":["10.1118/1.4812889"],"eki":["1758234644"]},"physDesc":[{"extent":"19 S."}],"relHost":[{"pubHistory":["1.1974 -"],"type":{"bibl":"periodical","media":"Online-Ressource"},"disp":"Calibration of time-of-flight cameras for accurate intraoperative surface reconstructionMedical physics","recId":"265784867","titleAlt":[{"title":"Medical physics online"}],"language":["eng"],"id":{"zdb":["1466421-5"],"issn":["2473-4209","1522-8541"],"eki":["265784867"]},"part":{"extent":"19","issue":"8","volume":"40","text":"40(2013), 8, Artikel-ID 082701, Seite 1-19","year":"2013","pages":"1-19"},"physDesc":[{"extent":"Online-Ressource"}],"note":["Gesehen am 01.08.2025"],"origin":[{"dateIssuedDisp":"1974-","publisher":"Wiley ; AAPM ; [Verlag nicht ermittelbar]","publisherPlace":"Hoboken, NJ ; College Park, Md. ; New York, NY","dateIssuedKey":"1974"}],"name":{"displayForm":["American Association of Physicists in Medicine ; American Institute of Physics"]},"title":[{"title_sort":"Medical physics","title":"Medical physics"}]}],"note":["Gesehen am 20.05.2021"]} 
SRT |a MERSMANNSVCALIBRATIO1720