seg2med: a bridge from artificial anatomy to multimodal medical images

Objective. We present seg2med (segmentation-to-medical images), a modular framework for anatomy-driven multimodal medical image synthesis. The system integrates three components to enable high-fidelity, cross-modality generation of computed tomography (CT) and magnetic resonance (MR) images based on...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yang, Zeyu (VerfasserIn) , Chen, Zhilin (VerfasserIn) , Sun, Yipeng (VerfasserIn) , Strittmatter, Anika (VerfasserIn) , Raj, Anish (VerfasserIn) , Allababidi, Ahmad (VerfasserIn) , Rink, Johann (VerfasserIn) , Zöllner, Frank G. (VerfasserIn)
Dokumenttyp: Article (Journal)
Sprache:Englisch
Veröffentlicht: 15 December 2025
In: Physics in medicine and biology
Year: 2025, Jahrgang: 70, Heft: 24, Pages: 1-23
ISSN:1361-6560
DOI:10.1088/1361-6560/ae2738
Online-Zugang:Verlag, lizenzpflichtig, Volltext: https://doi.org/10.1088/1361-6560/ae2738
Volltext
Verfasserangaben:Zeyu Yang, Zhilin Chen, Yipeng Sun, Anika Strittmatter, Anish Raj, Ahmad Allababidi, Johann S Rink and Frank G Zöllner

MARC

LEADER 00000naa a2200000 c 4500
001 1960356798
003 DE-627
005 20260209113031.0
007 cr uuu---uuuuu
008 260209s2025 xx |||||o 00| ||eng c
024 7 |a 10.1088/1361-6560/ae2738  |2 doi 
035 |a (DE-627)1960356798 
035 |a (DE-599)KXP1960356798 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 33  |2 sdnb 
100 1 |a Yang, Zeyu  |d 1996-  |e VerfasserIn  |0 (DE-588)132634384X  |0 (DE-627)1885965419  |4 aut 
245 1 0 |a seg2med  |b a bridge from artificial anatomy to multimodal medical images  |c Zeyu Yang, Zhilin Chen, Yipeng Sun, Anika Strittmatter, Anish Raj, Ahmad Allababidi, Johann S Rink and Frank G Zöllner 
246 3 3 |a seg two med 
264 1 |c 15 December 2025 
300 |b Illustrationen 
300 |a 23 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
500 |a Veröffentlicht: 15. Dezember 2025 
500 |a Gesehen am 09.02.2026 
520 |a Objective. We present seg2med (segmentation-to-medical images), a modular framework for anatomy-driven multimodal medical image synthesis. The system integrates three components to enable high-fidelity, cross-modality generation of computed tomography (CT) and magnetic resonance (MR) images based on structured anatomical priors. Approach. First, anatomical maps are independently derived from three sources: real patient data, extended cardiac-torso (XCAT) digital phantoms, and anatomies-synthetic subjects created by combining organs from multiple patients. Second, we introduce PhysioSynth, a modality-specific simulator that converts anatomical masks into imaging-like prior volumes using tissue-dependent parameters (e.g. HU, T1, T2, ρ) and modality-specific signal models. It supports simulation of CT and multiple MR sequences, including gradient-echo, SPACE, and volumetric interpolated breath-hold examination. Third, the synthesized anatomical priors are used to train 2-channel conditional denoising diffusion probabilistic models, which take the anatomical prior as a structural condition alongside the noisy image, enabling it to generate high-quality, structurally aligned images within its modality. Main results. The framework achieves a structural similarity index measure (SSIM) of for CT and for MR images compared to real patient data, and FSIM for simulated CT from XCAT. The generative quality is further supported by a Fréchet inception distance of 20.20 for CT synthesis. In modality conversion tasks, seg2med attains SSIM scores of (MR CT) and (CT MR). Significance. In anatomical fidelity evaluation, synthetic CT images achieve a mean Dice coefficient exceeding 0.90 for 11 key abdominal organs, and over 0.80 for 34 of 59 total organs. These results underscore seg2med’s utility in cross-modality image synthesis, dataset augmentation, and anatomy-aware AI development in medical imaging. 
700 1 |a Chen, Zhilin  |e VerfasserIn  |4 aut 
700 1 |a Sun, Yipeng  |e VerfasserIn  |4 aut 
700 1 |a Strittmatter, Anika  |d 1997-  |e VerfasserIn  |0 (DE-588)1344822703  |0 (DE-627)1905543174  |4 aut 
700 1 |a Raj, Anish  |d 1994-  |e VerfasserIn  |0 (DE-588)1259932710  |0 (DE-627)1807079856  |4 aut 
700 1 |a Allababidi, Ahmad  |e VerfasserIn  |0 (DE-588)1348908866  |0 (DE-627)1909307920  |4 aut 
700 1 |a Rink, Johann  |d 1988-  |e VerfasserIn  |0 (DE-588)1160454043  |0 (DE-627)1023629909  |0 (DE-576)505901277  |4 aut 
700 1 |a Zöllner, Frank G.  |d 1976-  |e VerfasserIn  |0 (DE-588)129580015  |0 (DE-627)473357054  |0 (DE-576)297732587  |4 aut 
773 0 8 |i Enthalten in  |t Physics in medicine and biology  |d Bristol : IOP Publ., 1956  |g 70(2025), 24, Artikel-ID 245015, Seite 1-23  |h Online-Ressource  |w (DE-627)269016163  |w (DE-600)1473501-5  |w (DE-576)088704130  |x 1361-6560  |7 nnas  |a seg2med a bridge from artificial anatomy to multimodal medical images 
773 1 8 |g volume:70  |g year:2025  |g number:24  |g elocationid:245015  |g pages:1-23  |g extent:23  |a seg2med a bridge from artificial anatomy to multimodal medical images 
856 4 0 |u https://doi.org/10.1088/1361-6560/ae2738  |x Verlag  |x Resolving-System  |z lizenzpflichtig  |3 Volltext  |7 1 
951 |a AR 
992 |a 20260209 
993 |a Article 
994 |a 2025 
998 |g 129580015  |a Zöllner, Frank G.  |m 129580015:Zöllner, Frank G.  |d 60000  |d 65200  |d 60000  |e 60000PZ129580015  |e 65200PZ129580015  |e 60000PZ129580015  |k 0/60000/  |k 1/60000/65200/  |k 0/60000/  |p 8  |y j 
998 |g 1160454043  |a Rink, Johann  |m 1160454043:Rink, Johann  |d 60000  |d 62900  |e 60000PR1160454043  |e 62900PR1160454043  |k 0/60000/  |k 1/60000/62900/  |p 7 
998 |g 1348908866  |a Allababidi, Ahmad  |m 1348908866:Allababidi, Ahmad  |d 60000  |d 62900  |e 60000PA1348908866  |e 62900PA1348908866  |k 0/60000/  |k 1/60000/62900/  |p 6 
998 |g 1259932710  |a Raj, Anish  |m 1259932710:Raj, Anish  |d 60000  |d 65200  |e 60000PR1259932710  |e 65200PR1259932710  |k 0/60000/  |k 1/60000/65200/  |p 5 
998 |g 1344822703  |a Strittmatter, Anika  |m 1344822703:Strittmatter, Anika  |d 60000  |e 60000PS1344822703  |k 0/60000/  |p 4 
998 |g 132634384X  |a Yang, Zeyu  |m 132634384X:Yang, Zeyu  |d 60000  |e 60000PY132634384X  |k 0/60000/  |p 1  |x j 
999 |a KXP-PPN1960356798  |e 4911454687 
BIB |a Y 
SER |a journal 
JSO |a {"person":[{"given":"Zeyu","role":"aut","family":"Yang","display":"Yang, Zeyu"},{"given":"Zhilin","role":"aut","family":"Chen","display":"Chen, Zhilin"},{"role":"aut","given":"Yipeng","display":"Sun, Yipeng","family":"Sun"},{"given":"Anika","role":"aut","family":"Strittmatter","display":"Strittmatter, Anika"},{"family":"Raj","display":"Raj, Anish","role":"aut","given":"Anish"},{"display":"Allababidi, Ahmad","family":"Allababidi","role":"aut","given":"Ahmad"},{"family":"Rink","display":"Rink, Johann","role":"aut","given":"Johann"},{"display":"Zöllner, Frank G.","family":"Zöllner","given":"Frank G.","role":"aut"}],"titleAlt":[{"title":"seg two med"}],"language":["eng"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"note":["Veröffentlicht: 15. Dezember 2025","Gesehen am 09.02.2026"],"origin":[{"dateIssuedKey":"2025","dateIssuedDisp":"15 December 2025"}],"title":[{"title":"seg2med","title_sort":"seg2med","subtitle":"a bridge from artificial anatomy to multimodal medical images"}],"id":{"doi":["10.1088/1361-6560/ae2738"],"eki":["1960356798"]},"recId":"1960356798","relHost":[{"note":["Gesehen am 28.01.2019","Fortsetzung der Druck-Ausgabe"],"origin":[{"publisherPlace":"Bristol","dateIssuedDisp":"1956-","dateIssuedKey":"1956","publisher":"IOP Publ."}],"pubHistory":["1.1956 -"],"title":[{"subtitle":"an official journal of the Institute of Physics and Engineering in Medicine","title_sort":"Physics in medicine and biology","title":"Physics in medicine and biology"}],"disp":"seg2med a bridge from artificial anatomy to multimodal medical imagesPhysics in medicine and biology","type":{"media":"Online-Ressource","bibl":"periodical"},"recId":"269016163","physDesc":[{"extent":"Online-Ressource"}],"id":{"zdb":["1473501-5"],"issn":["1361-6560"],"eki":["269016163"]},"language":["eng"],"part":{"volume":"70","extent":"23","year":"2025","pages":"1-23","issue":"24","text":"70(2025), 24, Artikel-ID 245015, Seite 1-23"}}],"name":{"displayForm":["Zeyu Yang, Zhilin Chen, Yipeng Sun, Anika Strittmatter, Anish Raj, Ahmad Allababidi, Johann S Rink and Frank G Zöllner"]},"physDesc":[{"noteIll":"Illustrationen","extent":"23 S."}]} 
SRT |a YANGZEYUCHSEG2MED1520