Name: Foundation and multimodal Models in Computational Imaging
Start: 2025-01-28
End: 2025-01-28

“R4” Reconstruction, Resolution, Regularization and Representation - Overcoming Medical Imaging Challenges

Organiser & chair: Julia Schnabel

Abstract:

This session explores the critical “R4” challenges—Reconstruction, Resolution, Regularization, and Representation—that are central to advancing medical imaging technologies. With a strong focus on how novel computational methods, including machine learning and physics-informed techniques, can address longstanding limitations in image quality, acquisition time, and motion artifacts, this session highlights innovative approaches across a range of medical imaging modalities, including MRI, PET, and photoacoustic tomography (PAT), demonstrating synergistic opportunities for overcoming common imaging challenges.

Foundation and Multimodal Models in Computational Imaging

Organiser & chair: Jong Chul Ye

Abstract: Recently, foundation models, which are large scale models pretrained on massive amounts of diverse data in a self-supervised manner, have been quickly replacing the existing CNN based end-to-end and/or supervised-learning approaches due to their superior performance. As a result of large-scale self-supervised pre-training, foundation models have excellent generalization capabilities with intriguing emergent properties. This session targets recent advances in foundation models for computational imaging, such as text+image models, as well as diffusion models for inverse problems, to understand their advantages and opportunities.

Medical Imaging in a Low-resource Setting

Organiser & chair: Andrew Webb (Chair) & Florian Knoll

Abstract:

This session will explore different challenges associated with medical imaging in low resource settings. MRI, X-ray/CT and ultrasound image requirements will be compared with one another, as well as issues of data transmission and interpretation.

Scalable Interferometric Imaging in the Big Data Era

Organiser & chair: Stefan Wijnholds (Chair) & Kazunori Akiyama

Abstract:

With the development and deployment of LOFAR2.0, SKA and ngVLA, radio interferometry is entering the Big Data Era. To keep up with the data deluge that will be generated by these instruments with an acceptable costing envelope for computing hardware and energy consumption, at least an order of magnitude improvement in computational performance needs to be realized. Also, data processing pipelines will need to scale well and use processing components optimized for energy efficiency. These challenges require us to rethink the way we process radio interferometric data, opening opportunities for exploration of new avenues. This session aims to present an overview of the challenges and provide a forum for discussion of new ways to process radio interferometric data.

Computational Imaging for Precision Astrophysics

Organiser & chair: Aviad Levis / Marie Ygouf

Abstract:

This session is centered on novel computational imaging for precision astrophysics. In the talks and posters we will cover a variety of exciting new approaches for imaging ultra high resolution targets focusing on black holes and exoplanets.

Uncertainty Quantification in Computational Imaging

Organiser & chair: Mujdat Cetin

Abstract:

This session aims to cover recent advances in the theory and methods of uncertainty quantification for computational imaging, including but not limited to approaches that involve learning-based methodologies.

High-dimensional Bayesian Astronomical Imaging and Inverse Problems with Machine Learning

Organiser & chair: Laurence Perreault Levasseur

Abstract:

Recent progress in machine learning and generative modeling has opened new avenues to tackle previously insoluble high-dimensional inverse problems in astronomy and astrophysics, particularly in Bayesian image reconstruction. While these methodologies show great promise in a range of applications from field-level cosmology to differentiable optics systems, multiple open problems stand in the way of groundbreaking discoveries. This session will explore recent applications and proposals addressing the development of computationally tractable methodologies to reconstruct posterior samples in imaging problems. We will also discuss assessing their accuracy in real-world settings and addressing the problem of robustness to distributional shifts, which remains a key focus of current research.

On the Interface of Optimization and Deep Learning for Computational Imaging

Organiser & chair: Audrey Repetti

Abstract:

This session focuses on computational imaging methods at the interface of optimization and deep learning. Recent advances aiming at pairing these two areas has led to significant advancements in image reconstruction and enhancement. Optimization techniques traditionally provided mathematically rigorous solutions for imaging problems, but they often struggled with high-dimensional data and non-linearities. Deep learning, particularly neural networks, has transformed this landscape by learning complex mappings from data, enabling faster and higher expressivity in image solutions. When combined, these approaches harness optimization algorithms to refine and guide the training of deep networks, resulting in robust models that are highly efficient for performing computational imaging tasks.

Medical Imaging in a High-resource Setting

Organiser & chair: Daniel K. Sodickson

Abstract:

If we had all the hardware power, compute resources and data analysis techniques we could dream of, what could we achieve in medical imaging? What fundamental scientific or clinical questions could we answer? This session will explore advanced imaging capabilities which are currently being enabled or may soon be enabled by emerging hardware platforms, software tools, and datasets. Speakers will share a focus on new information that can be gleaned from MRI, PET, CT, ultrasound, and other imaging or sensing modalities. They will also comment on which developments may eventually translate to, or otherwise influence, the low-resource settings to be explored in more detail in a companion session.

Lightning Keynotes on Modern Perspectives on Imaging and Panel Discussion

14:50 – 15:15:

Speaker: Greg Zaharchuk

Topic: Perspectives on the past, present, and future of medical imaging

Abstract: TBC

15:15 – 15:40:

Speaker: Jean-Luc Starck

Topic: Perspectives on the past, present, and future of astronomical imaging

Abstract: TBC

15:40 – 16:05:

Speaker: Carola Schoenlieb

Topic: Perspectives on the past, present, and future of computational imaging

Abstract: TBC

16:05 – 16:30:

Panel Discussion

Topic: Challenges and opportunities at the interface

Astronomical Imaging with Optical Telescopes: From thirty-meter Observatories to future space missions

Organisers: He Sun & Katie Bouman (Committee member)

Abstract:

Large optical telescopes have a rich history of pushing the boundaries of imaging technology and astronomical science. With a series of revolutionary optical telescopes launched recently or planned to be launched soon, in the next decade we expect to discover astronomical phenomena that will redefine our view of the universe. These telescopes will open windows to studying galaxies in the early universe, Earth-like planets around distant stars, and unknown discoveries beyond our imagination. This session will review recent development of computational imaging techniques in large space- or ground-based optical observatories. Topics include adaptive optics for future space telescopes (e.g. RST) and 30m level ground telescopes (e.g. E-ELT), data processing and early results from JWST, and machine learning methods for gravitational lensing and exoplanet study.

Medical Image Reconstruction and Analysis

Organisers: Kerstin Hammernik (Chair) & Julia Schnabel (Committee member)

Abstract:

The aim of this session is to guide the audience through the medical imaging pipeline – from acquisition and reconstruction to analysis – with a little help from AI. The talks will cover different image modalities, and focus on inverse problems in medical image reconstruction, motion estimation and motion correction. As image quality and accurate diagnostic assessment are key for the applicability of AI-based solutions in the medical context, the talks cover these aspects and provide insights into the uncertainty of AI-based algorithms in image reconstruction and analysis.

Frontier of Interferometric Imaging from SKA to ngEHT

Organisers: Kazunori Akiyama (Chair) & Yves Wiaux (Committee member)

Abstract:

Computational imaging is a key process in radio and optical/near-infrared interferometry to reveal the fine views of the universe from observational data taken in Fourier space. Over the last decade, significant progress has been made in the development of new computational imaging techniques to address and overcome various challenges brought by the advent of the new instruments including the Event Horizon Telescope (EHT), Low Frequency Array (LOFAR), MeerKAT and Very Large Telescope Interferometer (VLTI), as well as upgrades of existing facilities such as Very Large Array (VLA). Many algorithmic and data processing challenges arise in our quest to endow these instruments, set to observe the sky at new regimes of sensitivity and resolution, with their expected acute vision. In this new era, imaging encompasses not only forming 2D spatial maps of observed fields of view, but also the reconstruction of the spectrum, polarisation, and dynamics of the sources of interest, not to mention the mapping of underlying physical quantities. This focused session will gather interferometric imaging experts to review the exciting frontiers in the field.

Medical Imaging in Low-Resource Settings

Organisers: Nicholas Durr (Chair) & Audrey Bowden (Committee member)

Abstract:

Despite significant progress in modern healthcare, state-of-the-art healthcare in first-world environments differs significantly from that in low-resource settings. Constraints on cost, size, usability and environmental stability pose interesting challenges to engineer suitable solutions in these spaces. This session will bring together impactful research that showcases innovative strategies for imaging that are suitable for implementing in low-resources settings such as rural areas, primary care centers and low- and middle-income countries.

Large-scale Optimisation for Computational Imaging

Organisers: Gitta Kutyniok (Chair) & Ulugbek Kamilov (Committee member)

Abstract:

Large-scale optimization problems arise in a variety of imaging tasks. Examples include dictionary learning, low-rank matrix recovery, blind deconvolution, and phase retrieval. Conventional approaches for solving many of these optimization problems involve designing algorithms that can effectively leverage a wide-variety of structural constraints.

This session will provide an excellent opportunity for the wider signal processing and imaging community to come together and share recent developments, open challenges, and future directions in large-scale optimization methods suitable for analyzing imaging data.

Physics Informed Machine Learning in Astronomy

Organisers: Francois Lanusse (Chair) & Jean-Luc Starck (Committee member)

Abstract:

Machine Learning had a significant success in Astronomy in recent years, and it becomes obvious that useful applications of ML require a tight connection to physical modelling. In this session, we will explore several aspects of imbuing physics as part of a ML model, from building hybrid models that merge both deep learning and physical models, to using known physical symmetries and equivariances to design dedicated neural architectures.

Inference and Calibration

Organisers: Ivan Dokmanic (Chair) & Philip Schniter (Committee member)

Abstract:

Generative models are experiencing a second youth in imaging and scientific inference. New ideas include injective models for sampling high-dimensional posteriors, theoretical advances on statistical, approximation-theoretic, and topological questions, generating continuous functions which dovetail with the downstream PDE solvers, and creative uses of generative models to probe performance limits of inference systems. The session “Generative Inference and Calibration” brings together prominent researchers spearheading these exciting new directions.

Potential Pitfalls of Deep Learning in Medical Image Reconstruction

Organisers: Efrat Shimron (Chair) & Florian Knoll (Committee member)

Abstract:

This session will focus on scenarios in which deep learning algorithms developed for medical imaging might produce unreliable results, e.g. due to distribution shifts, bias, hallucinations, or other factors. The session is planned following the increasing interest in studying sensitivities and instabilities of such algorithms. The talks will discuss strategies for exposing algorithmic sensitivities and addressing them, preventing inverse crimes, and increasing algorithmic interpretability. The aim of the session is to raise awareness to the growing problem of unreliable AI performance in the context of medical imaging, suggest guidelines and solutions, and invoke community discussions.

Modern Regularisation

Organisers: Thomas Pock (Chair) & Philip Schniter (Committee member)

Abstract:

The availability of expressive regularizers is a very important component in solving ill-posed inverse problems in imaging. In recent years, hand-designed regularizers have been gradually replaced by data-driven ones. Provided sufficient training data is available, it is nowadays possible to learn tailored regularizers for a certain problem class. This usually leads to a huge increase in reconstruction quality, but the learned regularizers are usually much harder to analyse and it is much harder to give guarantees on convergence behaviour, generalisation ability, or reconstruction error. In this session, we will present and discuss the latest methods, techniques and applications in this cutting-edge field of research.

Date

Foundation and multimodal Models in Computational Imaging

Session Schedule