IEEE 2026 NSS MIC RTSD

Please note! All times in the online program are given in Madrid - Europe (CET) times!

Madrid - Europe ()
Oct 23, 2026, 9:59:39 PM
Your time ()
n/a
Madrid - Europe ()
Oct 23, 2026, 9:59:39 PM
Our Sponsors:

To search for a specific ID please enter the hash sign followed by the ID number (e.g. #123).

Novel applications of AI in radiation-based medical imaging (1)

Session chair: Li, Quanzheng, Professor (Massachusetts General Hospital & Harvard Medical School, Gordon Center for Medical Imaging, Boston, USA); Yousefirizi, Fereshteh, Dr. (BC Cancer Research Institute, Vancouver, Canada)
 
Shortcut: MIC-08
Date: Thursday, 12 November, 2026, 15:00 - 17:00
Location: FEDERICO GARCÍA LORCA
Session type: MIC Session

Contents

Click on an contribution to preview the abstract content.

The underlined authors are the presenters. The authors in bold are the main authors.

15:00 MIC-08-01

Sensitivity-Informed Network for Image Restoration in Sparse-Detector PET (#1881)

Y. Hou1, Y. Chen1, F. Zhan2, 3, J. Jiang1

1 Beijing Normal University, School of Physics and Astronomy, beijing, China
2 The First Affiliated Hospital of USTC, Department of Nuclear Medicine, Hefei, China
3 Jiangnan University, Wuxi School of Medicine, Wuxi, China

Abstract

Positron emission tomography (PET) requires dense detector crystals and associated electronics, resulting in high manufacturing costs. Sparse detector configurations can reduce hardware complexity but may degrade image quality due to reduced coincidence events, incomplete line-of-response coverage, and geometry-dependent artifacts. In this study, different sparse detector configurations were investigated for clinical PET imaging, and a sensitivity-informed network, termed SIU-Net, was proposed to recover image quality from sparse ring reconstructions. The residual sensitivity image was used as structural guidance to improve the restoration of degradation caused by detector sparsity. Experiments on 303 clinical brain datasets showed that the 1/2-TS-AR configuration achieved the best image quality among the evaluated sparse designs. SIU-Net consistently outperformed the baseline models across seven degraded image settings. These results demonstrate the potential of combining optimized sparse detector geometry with sensitivity-guided deep learning restoration for cost-effective PET imaging.

AcknowledgmentThis work was supported in part by the National Natural Science Foundation of China (No. 12475336), and the Fundamental Research Funds for the Central Universities (No. 310400209521).
References
[1] Berg, E & Cherry, SR 2018, ‘Innovations in Instrumentation for Positron Emission Tomography’, Seminars in Nuclear Medicine, vol. 48, no. 4, pp. 311–331, Elsevier.
[2] Gao, M, Daube-Witherspoon, ME, Karp, JS & Surti, S 2025, ‘Total-body PET system designs with axial and transverse gaps: a study of lesion quantification and detectability’, Journal of Nuclear Medicine, vol. 66, no. 2, pp. 323–329, Society of Nuclear Medicine and Molecular Imaging.
[3] Yuan, Z, Zhan, F, Lu, H, Hou, Y, Liao, R, Li, C, et al. 2026, ‘GPU-based list-mode TOF PET image reconstruction with complete correction techniques’, Medical Physics, vol. 53, no. 1, e70216, Wiley.
[4] Hou, Y, Zhan, F, Liu, J, Cheng, X, Li, C, Yuan, Z, et al. 2026, ‘Cycle-constrained adversarial denoising convolutional network for PET image denoising: Multi-dimensional validation on large datasets with reader study and real low-dose data’, Medical Image Analysis, vol. 107, 103826, Elsevier.
Keywords: Positron emission tomography, PET image restoration, Sparse PET ring, Sensitivity-informed network
15:15 MIC-08-02

Anatomy-Guided Null-Space Learning for Self-Supervised Blind PET Deblurring (#2189)

Z. Zhou1, Z. Liu1, T.-A. Song1, F. Yang1, J. Dutta1

1 University of Massachusetts Amherst, Biomedical Engineering, Amherst, Massachusetts, United States of America

Abstract

The intrinsically limited spatial resolution of positron emission tomography (PET) confounds image quantitation. Post-reconstruction deblurring is an ill-posed inverse problem in which the blur kernel is often unknown, and noise renders direct inversion infeasible. We present a principled framework for self-supervised blind PET image deblurring that incorporates high-resolution MRI anatomical guidance in a data-consistent way. The central contribution is an observation-dependent spectral decomposition of the PET image into a practical range space, i.e., the set of spatial frequencies recoverable from the blurry PET observation at a specified signal-to-noise ratio (SNR) threshold, and a complementary practical null space whose content cannot be estimated from the PET data alone, regardless of the estimator. A self-supervised deep learning framework, Anatomy-Guided Null-Space Learning (AGNS), instantiates this decomposition with three jointly optimized components: a blind 3D kernel estimation network, a range-space Wiener deconvolution, and an MRI-guided null-space imputation network. Joint optimization proceeds via the alternating direction method of multipliers (ADMM). Methodological evaluation is performed through clinical paired-resolution validation using images from the HRRT and NeuroEXPLORER (NX) scanners, where the NX images are only used as the validation ground-truth. AGNS produces strong qualitative and quantitative benchmarks relative to competing unsupervised and non-AI approaches.

References
[1] Tohka, J, Reilhac, A 2008, ‘Deconvolution-based partial volume correction in Raclopride-PET and Monte Carlo comparison to MR-based method’, NeuroImage, vol. 39, no. 4, pp. 1570–1584.
[2] Sample, C, Rahmim, A, Uribe, C, Bénard, F, Wu, J, Fedrigo, R, Clark, H 2024, ‘Neural blind deconvolution for deblurring and supersampling PSMA PET’, Physics in Medicine & Biology, vol. 69, no. 8.
[3] Ren, D, Zhang, K, Wang, Q, Hu, Q, Zuo, W 2020, ‘Neural Blind Deconvolution Using Deep Priors’, arXiv, arXiv:1908.02197.
[4] Volpi, T, Toyonaga, T, Khattar, N, Gallezot, JD, Naganawa, M, Vanderlinden, G, Honhar, P, Zeng, T, Fontaine, K, Mulnix, T, Hu, L, Sun, X, Henry, S, Matuskey, D, Radhakrishnan, R, Guo, L, Hu, Y, Zhang, J, Zheng, X, Nabulsi, N, Huang, Y, Badawi, RD, Cherry, SR, Hillmer, AT, Jones, T, Liu, C, Morris, E, Qi, J, Li, H, Carson, RE 2026, ‘Exceptional brain PET images from the NeuroEXPLORER: scans with targeted radiopharmaceuticals and comparison to HRRT’, European Journal of Nuclear Medicine and Molecular Imaging, vol. 53, no. 3, pp. 2110–2121.
[5] Zhou, Z, Song, T-A, Lei, B, Yang, F, Gomez, CL, Johnson, K, Dutta, J 2024, ‘Unsupervised Tau PET Image Super-Resolution Using Cross-Domain Diffusion Posterior Sampling’, 2024 IEEE Nuclear Science Symposium (NSS), Medical Imaging Conference (MIC) and Room Temperature Semiconductor Detector Conference (RTSD), pp. 1–1: IEEE.
[6] Liu, Z, Song, T, Yang, F, Banerjee, A, Zhou, Z, Lei, B, Saranathan, M, Dutta, J 2025, ‘Segmentation Guided Neural Blind Deconvolution for Unsupervised 3D Brain PET Image Partial Volume Correction’, 2025 IEEE Nuclear Science Symposium (NSS), Medical Imaging Conference (MIC) and Room Temperature Semiconductor Detector Conference (RTSD), [edition missing], pp. 1–1: IEEE.
[7] Song, T-A, Yang, F, Chowdhury, SR, Kim, K, Johnson, KA, El Fakhri, G, Li, Q, Dutta, J 2019, ‘PET Image Deblurring and Super-Resolution With an MR-Based Joint Entropy Prior’, IEEE Transactions on Computational Imaging, vol. 5, no. 4, pp. 530–539: IEEE.
Keywords: Self-supervised Learning, Blind PET deblurring, MRI-Guided, Null space
15:30 MIC-08-03

Brownian Bridge Diffusion Model for Ultra-Low-Dose Total-Body PET Denoising (#1889)

N. Aghakhanolia1, A. Rafiei Sardouei2, J. Fowler3, A. L´opez Montes4, K. Shi4, P. L. Esquinas5, A. Rahmim6

1 University of British Columbia, School of Biomedical Engineering, Vancouver, British Columbia, Canada
2 University of British Columbia, Department of Electrical and Computer Engineering, Vancouver, British Columbia, Canada
3 University of British Columbia, Department of Physics & Astronomy, Vancouver, British Columbia, Canada
4 Bern University Hospital, Department of Nuclear Medicine, Bern, Bern, Switzerland
5 University of British Columbia, Department of Radiology, Vancouver, British Columbia, Canada
6 BC Cancer Research Institute, Department of Basic and Translational Research, Vancouver, British Columbia, Canada

Abstract

PET imaging enables quantitative assessment of disease burden and treatment response, but performance is constrained by a trade-off between radiation dose and image quality. Reducing injected adiotracer activity decreases patient exposure, yet increases image noise, degrading lesion detectability and quantitative accuracy. Total-body PET systems, with substantially increased sensitivity, enable significant dose reduction. However, ultra-low-dose acquisitions remain highly noisy, limiting their clinical utility. In this work, we investigate Brownian Bridge Diffusion Models (BBDM) as a novel framework for ultra-low-dose PET denoising. BBDM formulates dose-level image translation as a stochastic bridge between paired standard- and low-dose PET images, with the diffusion process constrained at both endpoints. This formulation is well-suited for dose translation. The proposed method was evaluated on a multi-center, multi-scanner total-body 18F-FDG PET/CT dataset of 80 patients. Paired full-dose and simulated 1/10-dose datasets were generated through statistical count reduction in the list-mode data. The model was trained with T = 1000 diffusion steps, and inference was accelerated using S = 200 sampling steps. On the held-out test cohort, BBDM achieved substantial gains across both global image-quality and lesion-level quantitative metrics. Compared with low-dose inputs, BBDM increased PSNR by approximately 26.6% and SSIM by 8.9%, while reducing RMSE by 60.0%. Across evaluated lesions, SUVmean and SUVmax biases decreased by 54.5% and 70.9%, respectively. Lesion noise was also reduced by 45.8%. The approach effectively preserves both image quality and lesion quantification at substantially reduced dose levels, highlighting its potential for ultra-low-dose total-body PET imaging.

AcknowledgmentNA
References
[1] S. J. McQuaid et al., “Cumulative radiation doses from recurrent PET-CT examinations,” British Journal of Radiology, vol. 94, no. 1124, 2021.
[2] S. R. Cherry, T. Jones, J. S. Karp, M. Sibomana, and R. D. Badawi, “Total-body PET: maximizing sensitivity to create new opportunities for clinical research and patient care,” Journal of Nuclear Medicine, vol. 59, no. 1, pp. 3–12, 2018.
[3] K. Gong, J. Guan, C.-C. Liu, and J. Qi, “PET image denoising using a deep neural network through fine structure preservation,” IEEE Transactions on Radiation and Plasma Medical Sciences, vol. 3, no. 1, pp. 26–34, 2018.
[4] B. Yu and K. Gong, “Robust whole-body PET image denoising using 3D diffusion models: evaluation across various scanners, tracers, and dose levels,” Physics in Medicine & Biology, vol. 70, no. 4, p. 045005, 2025.
[5] B. Li, K. Xue, B. Liu, and Y.-K. Lai, “BBDM: Image-to-image translation with Brownian Bridge Diffusion Models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1952–1961, 2023.
Keywords: Brownian bridge diffusion model, denoising, diffusion model, low-dose PET, PET imaging
15:45 MIC-08-04

Self-Supervised Low-Dose SPECT Denoising from a Single Standard-Dose Scan via Poisson Thinning (#2519)

H. Zheng1, L. Cheng2, L. Gao2, S. Wang1, Z. Wu1, H. Liu1, Y. Liu1

1 Tsinghua University, Beijing, China
2 Chengdu NOVEL MEDICAL Equipment Co., Ltd., Chengdu, China

Abstract

Low-dose or fast-scan single-photon emission computed tomography/computed tomography (SPECT/CT) suffers from Poisson noise, but clinical archives usually provide only one noisy standard-dose projection per patient and no noise-free target. A common single-scan workaround synthesizes a low-dose input from the standard-dose scan and uses the original projection as the supervised target. This creates a nested pair because the target contains the input photons, so the objective can learn a noisy full-dose image with input-noise leakage. We propose a self-supervised projection-domain framework based on mutually exclusive Poisson thinning. Each standard-dose projection is partitioned online into K∈{2,3,4,5} disjoint equal-dose subsets by multinomial assignment, and two subsets are randomly paired for Noise2Noise training. These paired subsets contain disjoint photons and are conditionally independent given the underlying count rate while preserving the same dose; mean-square or Poisson-likelihood training therefore targets the clean same-dose conditional mean rather than a noisy full-dose target. A three-dimensional residual U-Net is trained only from thinned noisy pairs and applied before OSEM reconstruction. Training used 225 clinical bone SPECT/CT cases. On 31 held-out cases evaluated by patient-specific controlled Poisson resampling over 1×--5× fast-scan factors, the method achieved 45.72 dB PSNR and 0.9862 SSIM in the projection domain, outperforming an architecture-matched low-to-standard-dose supervised baseline by 2.68 dB; the paired gain increased from 1.82 dB at 1× to 3.34 dB at 5×. The framework enables low-dose bone SPECT/CT denoising from routinely stored projections without clean ground truth or repeated acquisitions.

AcknowledgmentThis work was supported in part by the National Key Research and Development Program of China (No. 2022YFC2402002, No. 2022YFC2403802), and National Natural Science Foundation of China (No. 12205166)
References
[1] Lehtinen, J, Munkberg, J, Hasselgren, J, Laine, S, Karras, T, Aittala, M and Aila, T 2018, ‘Noise2Noise: Learning Image Restoration without Clean Data’, Proceedings of the 35th International Conference on Machine Learning, Proceedings of Machine Learning Research, vol. 80, pp. 2965–2974, PMLR.
[2] Pan, B et al. 2022, ‘Ultra high speed SPECT bone imaging enabled by a deep learning enhancement method: a proof of concept’, EJNMMI Physics, vol. 9, article 43.
[3] Aghakhan Olia, N et al. 2022, ‘Deep learning–based denoising of low-dose SPECT myocardial perfusion images: quantitative assessment and clinical performance’, European Journal of Nuclear Medicine and Molecular Imaging, vol. 49, pp. 1508–1522.
[4] Sun, J et al. 2023, ‘Deep learning-based denoising in projection-domain and reconstruction-domain for low-dose myocardial perfusion SPECT’, Journal of Nuclear Cardiology, vol. 30, no. 3, pp. 970–985.
[5] Liu, J, Yang, Y, Wernick, MN, Pretorius, PH and King, MA 2021, ‘Deep learning with noise-to-noise training for denoising in SPECT myocardial perfusion imaging’, Medical Physics, vol. 48, no. 1, pp. 156–168.
[6] Yie, SY et al. 2024, ‘Enhancing bone scan image quality: an improved self-supervised denoising approach’, Physics in Medicine & Biology, vol. 69, no. 21, article 215020.
Keywords: Low-dose SPECT/CT, Noise2Noise, Poisson thinning, projection-domain denoising, self-supervised learning
16:00 MIC-08-05

VLM-Guided Conditional Flow Matching for CT-Free total-body PET Correction (#2298)

J. Rong1, S. Li2, C. Yang1, L. Li2, J. Liu2, R. Chen2, Z. Huang1

1 Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Research Center for Medical AI, Shenzhen, China
2 Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Nuclear Medicine, Shanghai, China

Abstract

Accurate attenuation and scatter correction is important for positron emission tomography (PET) to improve diagnosis. Conventional PET correction pipelines rely heavily on CT-derived attenuation information, which inevitably increases radiation exposure during clinical examinations, especially in total-body PET/CT imaging. In this study, we introduce a vision-language-model-guided conditional flow framework for CT-free PET attenuation and scatter correction. Specifically, non-corrected PET slices are analyzed to generate organ-aware textual prompts, which are subsequently encoded as semantic representations and integrated into a latent-space flow generation process. Then, a cross-modal attention mechanism is further designed to establish interactions between semantic prompts and PET image features under multiple scales during conditional flow matching. Experiments were performed on 264 clinical subjects under total-body PET/CT scans. Comparison methods consist of several representative deep learning approaches, including UNet, Uformer, CycleGAN, latent diffusion models, and VM-UNet. Quantitative evaluation demonstrated that the proposed framework achieved the highest metric index, reaching 38.66 dB PSNR and 0.9754 SSIM on the testing dataset. Visual assessment and Correlation Analysis additionally confirmed improved anatomical continuity and more accurate tracer uptake recovery. The study suggests that semantic-aware flow modeling offers an effective strategy for CT-free PET correction.

AcknowledgmentThis work was supported by National Natural Science Foundation of China (62471461), Guangdong Basic and Applied Basic Research Foundation (2025A1515010783), Shenzhen Science and Technology Program (JCYJ20250604182905007, JCYJ20240813155913017).
References
[1] S. Surti, A. R. Pantel, and J. S. Karp, “Total body pet: why, how, what for?” IEEE transactions on radiation and plasma medical sciences, vol. 4, no. 3, pp. 283–292, 2020.
[2] R. Guo, S. Xue, J. Hu, H. Sari, C. Mingels, K. Zeimpekis, G. Prenosil, Y. Wang, Y. Zhang, M. Viscione et al., “Using domain knowledge for robust and generalizable deep learning-based ct-free pet attenuation and scatter correction,” Nature Communications, vol. 13, no. 1, p. 5882, 2022.
[3] C. Li, C. Wong, S. Zhang, N. Usuyama, H. Liu, J. Yang, T. Naumann, H. Poon, and J. Gao, “Llava-med: Training a large language-and-vision assistant for biomedicine in one day,” Advances in Neural Information Processing Systems, vol. 36, pp. 28 541–28 564, 2023.
[4] M. Yazdani, Y. Medghalchi, P. Ashrafian, I. Hacihaliloglu, and D. Shahriari, “Flow matching for medical image synthesis: Bridging the gap between speed and quality,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2025, pp. 216–226.
Keywords: PET correction, vision-language-model, conditional flow matching, total-body PET
16:15 MIC-08-06

Implicit Neural Representations for Joint Motion-Resolved PET Reconstruction and Respiratory Gating (#3089)

N. De Bie1, M. Colarieti Tosti1

1 KTH Royal Institute of Technology, Department of Biomedical Engineering and Health Systems, Stockholm, Sweden

Abstract

Respiratory motion during acquisition degrades image quality in positron emission tomography (PET). Data-driven gating (DDG) extracts a respiratory signal directly from the measurement data, but classical methods such as axial center-of-mass and principal component analysis (PCA) degrade under irregular breathing and at low count rates. We propose a self-supervised framework based on implicit neural representations (INRs) that jointly estimates a respiratory gating signal and a motion-corrected reconstruction. Two coordinate-based networks parametrize a motion-free canonical activity image and a deformation field conditioned on learnable per-frame latent codes that encode the respiratory state. We evaluate the framework on XCAT thoracic phantom simulations of an 18F-FDG acquisition at clinically realistic count levels under regular and irregular breathing. The recovered gating signal achieves Spearman correlations of 0.87 (regular) and 0.85 (irregular) with the ground-truth respiratory signal, exceeding center-of-mass (0.62; 0.30) and PCA-based (0.74; 0.34) DDG baselines, and the framework simultaneously produces a motion-resolved reconstruction with PSNR comparable to maximum likelihood expectation maximization (MLEM) reconstruction.

References
[1] Y. Moussaoui, et al., “Implicit Neural Representations for End-to-End PET Reconstruction,” in 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI), Apr. 2025
[2] R. J. Santo, et al., “From Ultra-Short Timeframes to Ultra-Fast Motion: Maximum-Likelihood Motion and Activity (MLMA) Reconstruction for Cardiac Gateless TOF-PET,” in 2025 IEEE NSS
MIC RTSD conference, Nov. 2025
[3] V. Sitzmann et al., “Implicit Neural Representations with Periodic Activation Functions,” Jun. 2020.
[4] K. Thielemans et al, “Device-less gating for PET/CT using PCA,” in 2011 IEEE Nuclear Science Symposium Conference Record, Oct. 2011
Keywords: Data-driven gating
16:30 MIC-08-07

Towards CT-Free Multi-Time-Point [18F]PSMA-1007 LAFOV PET Protocols: Evaluation of Synthetic Attenuation Maps Versus Elastic Co-Registration for Longitudinal Imaging (#1865)

E. Olyaei1, 2, J. Schaefferkoetter3, E. Calderón Ochoa1, C. P. Reinert1, 5, L. S. Kiefer1, C. la Fougère1, 4, F. P. Schmidt1, 2

1 University Hospital Tuebingen, Department of Nuclear Medicine and Clinical Molecular Imaging, Tuebingen, Baden-Württemberg, Germany
2 Eberhard-Karls University Tuebingen, Werner Siemens Imaging Center, Department of Preclinical Imaging and Radiopharmacy, Tuebingen, Baden-Württemberg, Germany
3 Siemens Medical Solutions USA, Inc, Knoxville, Tennessee, United States of America
4 University Hospital Tuebingen, Cluster of Excellence iFIT (EXC 2180) "Image Guided and Functionally Instructed Tumor Therapies",, Tuebingen, Baden-Württemberg, Germany
5 University Hospital Tuebingen, Diagnostic and Interventional Radiology, Tuebingen, Baden-Württemberg, Germany

Abstract

Long axial field-of-view (LAFOV) PET enables imaging at very late timepoints but requires repeated CT acquisitions for attenuation correction (AC) in multi-time-point protocols, increasing radiation exposure. This study evaluates two CT-free AC strategies for [¹⁸F]PSMA-1007 LAFOV PET at delayed imaging timepoints: synthetic μ-maps derived from non-attenuation-corrected PET imaging using a ResNet-based model (Synth-AC) and elastic co-registration of CT-based μ-maps from the initial scan (CoReg-AC). Ten patients were scanned on a Siemens Biograph Vision Quadra LAFOV system at 90 min, 3 h, and 5 h p.i. Quantitative evaluation was performed based on relative differences in SUVmean across seven major organs. Lesion quantification was assessed for SUVmean (28 lesions at 3 h p.i., 20 lesions at 5 h p.i.) using Bland–Altman analysis and linear regression. Visually, synthetic μ-maps appeared smoother, while co-registration preserved more anatomical detail but showed localized inconsistencies. In PET images, Synth-AC exhibited smaller and more homogeneous deviations (±5%), whereas CoReg-AC showed more pronounced peripheral differences. At organ level, reduced variability was observed at 5 h for both methods. CoReg-AC showed a positive bias in high-uptake organs (liver +1.7% to +4.3%, spleen +2.7% to +4.3%), while Synth-AC shifted from near agreement at 3 h to moderate negative bias at 5 h (liver −2.1%, heart −13.5%). Both methods demonstrated a pronounced positive bias in lung regions. Linear regression demonstrated strong agreement with CT-based AC (R² = 0.993–0.998), and Bland–Altman analysis at 3 h p.i. showed a mean bias of −0.97% with limits of agreement [−12.11%; +10.17%] for Synth-AC and +1.40% [−8.71%; +11.52%] for CoReg-AC. Both CT-free approaches enable robust quantitative imaging in delayed LAFOV PET. Observed differences are primarily driven by organ-level bias patterns, while lesion quantification remains stable.

References
[1] Schaefferkoetter, J,  2021, ‘Deep learning for whole-body medical image generation’, European Journal of Nuclear Medicine and Molecular Imaging, vol. 48, no. 12, pp. 3817–3826, vol. 48, no. 12, pp. 3817–3826, Springer Nature.
[2] Schaefferkoetter, J , 2023, ‘Deep learning for improving PET/CT attenuation correction by elastic registration of anatomical data’, European Journal of Nuclear Medicine and Molecular Imaging, vol. 50, no. 8, pp. 2292–2304, Springer Nature
Keywords: Longitudinal-Imaging, AI-Based-Atteunation-Correction, Elastic-Co-Registration, LAFOV-PET, CT-Free-PETImaging
16:45 MIC-08-08

3D Latent Implicit Diffusion for Scalable Volume Generation (#2875)

Y. Mellak1, A. Bousse1, A. De Paepe1, D. Visvikis1

1 Université de Bretagne Occidentale, LaTIM, INSERM, UMR 1101, Brest, France

Abstract

Full-volume 3-D medical image generation at clinical resolutions remains a significant challenge due to GPU memory constraints. Direct voxel-space generative modeling becomes increasingly difficult once spatial resolution exceeds 256³, especially on single-GPU hardware. Latent diffusion approaches reduce this burden by performing generation in a compact representation [1], but decoding onto a dense fixed grid remains costly at high resolution. Implicit neural representations offer an attractive alternative, as they reconstruct images by querying continuous spatial coordinates rather than materializing a full voxel grid [2], making them naturally suited to memory-efficient volumetric generation.
We propose a memory-efficient 3-D latent implicit diffusion framework that combines a lightweight 3-D encoder with a coordinate-conditioned local implicit decoder, inspired by [3]. The encoder compresses the input volume into a compact latent grid, while the implicit decoder reconstructs the volume by querying continuous spatial coordinates from learned latent features, avoiding the need to materialize the full voxel grid during training. A full-volume 3-D diffusion model is then trained directly in this compact latent space. At inference, new volumes are generated by sampling from the diffusion model and rendering the full grid through the implicit decoder.
We validate our framework on CT and MRI volumes at resolutions up to 512³ on a single consumer-grade GPU, demonstrating coherent full-volume generation across axial, coronal, and sagittal planes without materializing the full voxel grid at any stage of training.

References
[1] Rombach, R., Blattmann, A., Lorenz, D., Esser, P. and Ommer, B., 2022. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 10684-10695).
[2] Chen, Y., Liu, S. and Wang, X., 2021. Learning continuous image representation with local implicit image function. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 8628-8638).
[3] Kim, J. and Kim, T.K., 2024. Arbitrary-scale image generation and upsampling using latent diffusion model and implicit neural decoder. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 9202-9211).
Keywords: 3D medical image generation, latent diffusion models, implicit decoding, memory-efficient generation.


Our Exhibitors: