WO2025027643A1 - Method and apparatus for enhancing the scan quality of magnetic resonance (mr) images - Google Patents

Method and apparatus for enhancing the scan quality of magnetic resonance (mr) images Download PDF

Info

Publication number
WO2025027643A1
WO2025027643A1 PCT/IN2024/051408 IN2024051408W WO2025027643A1 WO 2025027643 A1 WO2025027643 A1 WO 2025027643A1 IN 2024051408 W IN2024051408 W IN 2024051408W WO 2025027643 A1 WO2025027643 A1 WO 2025027643A1
Authority
WO
WIPO (PCT)
Prior art keywords
artifacts
artifact
image
model
output image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/IN2024/051408
Other languages
French (fr)
Inventor
Mohanasankar SIVAPRAKASAM
Arun Palla
Sriprabha Ramanarayanan
Keerthi Ram
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Indian Institute of Technology Madras
Original Assignee
Indian Institute of Technology Madras
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Indian Institute of Technology Madras filed Critical Indian Institute of Technology Madras
Publication of WO2025027643A1 publication Critical patent/WO2025027643A1/en
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/565Correction of image distortions, e.g. due to magnetic field inhomogeneities
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room
    • A61B5/004Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
    • A61B5/0044Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part for the heart
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • A61B5/7207Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/5608Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/60Image enhancement or restoration using machine learning, e.g. neural networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00Medical imaging apparatus involving image processing or analysis
    • A61B2576/02Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
    • A61B2576/023Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the heart
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/565Correction of image distortions, e.g. due to magnetic field inhomogeneities
    • G01R33/56509Correction of image distortions, e.g. due to magnetic field inhomogeneities due to motion, displacement or flow, e.g. gradient moment nulling
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/565Correction of image distortions, e.g. due to magnetic field inhomogeneities
    • G01R33/56545Correction of image distortions, e.g. due to magnetic field inhomogeneities caused by finite or discrete sampling, e.g. Gibbs ringing, truncation artefacts, phase aliasing artefacts

Definitions

  • the present invention relates to improving the scan quality of the Magnetic Resonance (MR) images, leading to a better decision process by post-processing the acquired image.
  • MR Magnetic Resonance
  • CMR Cine Cardiac MRI
  • SNR signal-to- noise ratio
  • case-b involves additional hardware like MR navigators, field probes and pilot tone which is not economical, introduces additional parameters, making the acquisition complicated and demands a skilled operator to conduct the acquisition.
  • additional hardware like MR navigators, field probes and pilot tone which is not economical, introduces additional parameters, making the acquisition complicated and demands a skilled operator to conduct the acquisition.
  • not all artifacts that are clinically relevant like chemical shift can be prospectively addressed.
  • Patient dependent (due to breath holds) and operator dependent (for handling the constraints of additional hardware) nature of the prospective solutions are not feasible and cannot be scaled to every other degradation in CMR.
  • data driven learning-based approaches offer a solution as a retrospective/post-processing step.
  • Existing deep-learning (DL) techniques address the removal of a single type of artifact.
  • CINENet [3] is known to perform artifact restoration of only under- sampled Cardaic MR (CMR).
  • CMR Cardaic MR
  • the present invention proposes a single model that learns a common knowledge across various MRI artifacts and helps to generalize to unseen artifacts with deviated amounts of degradation levels at test time (e.g., under-sampling with unseen acceleration factors different from training data).
  • OBJECTS OF THE INVENTION This section is intended to introduce certain objects of the disclosed methods and systems in a simplified form and is not intended to identify the key advantages or features of the present disclosure.
  • the present invention proposes a Model-agnostic meta-learning (MAML) that is based on curriculum structure CMAML, a learning process that integrates MAML with curriculum learning to impart the knowledge of variable artifact complexity to adaptively learn restoration of multiple artifacts during training.
  • MAML Model-agnostic meta-learning
  • the present invention proposes an artifact-invariant information that is characterized by the common knowledge shared across images of different artifacts and incorporates discriminative artifact-specific fine-tuning at train time in order to achieve restoration of various degradations in a single model.
  • An objective of the present invention is to provide a new technique that overcome the disadvantages associated with the prior art, improves the scan quality, enhancing the scan decision-making process for a better understanding of scanned images, and can potentially be integrated into the MRI workflow.
  • Another object of the present invention is in restoring artifact affected MRI images for various types of artifacts in a single deep learning model with a training process driven by learning a set of latent representation which is common across artifacts.
  • Yet another objective of the present invention is to take into account various nuances occurring in the form of artifact-type and artifact-amount that are significant. Moreover, common knowledge present across various different artifacts is to be modeled so that the invention performs reasonably even in the presence of hitherto unseen artifacts. Other general and specific objectives of the invention will in part be obvious and will in part appear hereinafter.
  • TECHNICAL ADVANTAGES OF THE PRESENT INVENTION The present invention can be extensively used in clinical settings, especially in the MRI workflow to correct for the frequent occurrence of artifacts arising from patient movements and acquisition settings.
  • the present invention further achieves that long duration MRI acquisition process can be shortened without any loss in the image quality, further resulting in better MRI scanner utilization by increasing the throughput of the number of patients scanned.
  • the present invention further provides that other degradations arising from the electronic noise of MRI hardware in the form of RF and spiking artifacts does not affect the downstream tasks of analysing the patient.
  • Figure 1 illustrates various types of artifacts in MRI acquisition, in accordance with an embodiment of the present invention.
  • Figure 1 (a) illustrates a qualitative results on motion affected cardiac scan.
  • Figure 2 illustrates a high-level flowchart of the process during testing, in accordance with an embodiment of the present invention.
  • Figure 2 (a) illustrates an exemplary method of Joint training in line with embodiments of the present invention.
  • Figure 2 (b) illustrates a curriculum-MAML for an exemplary neural network in line with present invention.
  • Figure 3 illustrates a flowchart of the method during training using a representation learning technique, in accordance with an embodiment of the present invention.
  • Figure 4 illustrates a pacing function in line with the present invention.
  • Figure 5 illustrates a comparative analysis with respect to SSIM metric on unseen artifact data.
  • Figure 6 illustrates qualitative results on unseen artifact data.
  • Figure 7 illustrates qualitative results on composite artifact data.
  • Figure 8 illustrates an inference pipeline for an exemplary machine learning model having a scheduler component for reducing artifacts during inference stage.
  • DETAILED DESCRIPTION In the following description, for the purpose of explanation, numerous specific details have been set forth in order to provide a description of the invention. It will be apparent, however, that the invention may be practiced without these specific details and features.
  • the present disclosure relates to system and method to improve the scan quality of degraded MRI scan caused by artifacts during acquisition of the MRI scan.
  • the present invention is directed to a method and apparatus for reducing artifacts in MRI scan images during inference by receiving an input MRI scan image, processing the input MRI scan image through a trained deep learning model to generate an output image, applying a scheduler component to iteratively reduce the magnitude of artifacts in the output image by applying a predefined transformation.
  • the present invention utilizes a model-agnostic meta-learning (MAML) model as a nested bi-level optimization framework to learn common knowledge across artifacts in an outer level of optimization, and artifact-specific restoration in the inner level.
  • MAML model-agnostic meta-learning
  • the present invention proposes that the curriculum-MAML (CMAML) is utilized as a learning process that integrates MAML with curriculum learning to impart the knowledge of variable artifact complexity to adaptively learn restoration of multiple artifacts during training.
  • CMAML curriculum-MAML
  • the artifact-specific model of the present invention implements a forward-pass of training process as illustrated in Fig.2b and effectively promotes a specialized model ( ⁇ ), based on artifact type, even in the unseen test degradations.
  • specialized model
  • each type of artifact is treated as a task.
  • the MAML framework as implemented further incorporates a curriculum learning (CL), in order to provide additional knowledge of artifact-complexity during training.
  • CL curriculum learning
  • the present invention implements a level of complexity in curriculum learning [CL] based on the ill-posedness of various artifacts. For instance, in under-sampling artifact, the level of complexity is directly related to the ill-posedness characterized by the amount of acceleration during MRI acquisition. Thus, for two scans where one scan is 3x accelerated and the other is 5x, the former task is less complex than the latter.
  • the proposed learning model of present invention embeds representations based on the nuances in artifacts for a given neural network architecture.
  • present invention is able to propose a curriculum-based model-agnostic meta- learning (CMAML) as a training method that performs image restoration of multiple types of artifact- affected MRI scans in a single model.
  • CMAML curriculum-based model-agnostic meta- learning
  • the proposed method establishes an artifact-type as a task and associates the amount of MRI artifact with the task-complexity.
  • the present invention encompasses analysing multiple MRI artifacts by using multiple artifact representation learning method that provides a single model for improving the scan quality of MRI scans affected by various degradations.
  • the system and method of present invention output a clean counterpart of the artifact affected MRI scan.
  • the present invention encompasses incorporating the nuances of artifact-type and artifact complexity into the training method in determining the artifact free image for a given poor quality MRI scan.
  • the present invention encompasses using multiple artifact data for intelligently updating the model during the course of training to enhance the overall accuracy on various degradations.
  • Figure 1 illustrates a qualitative results on motion affected cardiac scan.
  • Figure 2 illustrates a flowchart of the process during testing, in accordance with an embodiment of the present disclosure.
  • a MRI scan image is processed with the deep-learning module of the present invention which processes the input MRI scan image and results in a scan with improved quality.
  • the MRI Scan Image Improvement Using Deep Learning Model broadly comprises three steps: - The original image obtained from an MRI scan.
  • FIG. 3 shows a flowchart of the process during training, in accordance with an embodiment of the present invention.
  • the process comprises: - collecting datasets for different types of artifacts (e.g., Artifact 1, Artifact 2, ..., Artifact n) - pre-processing the collected data to standardize and preparing it for analysis - assessing the complexity of each artifact using a scoring function. This helps in understanding the severity and nature of the artifacts - applying a pacing function to gradually introduce data with increasing complexity to the DL model during training. This helps the model learn effectively.
  • artifacts e.g., Artifact 1, Artifact 2, ..., Artifact n
  • dataset(s) of various artifact types are collected.
  • Some exemplary artifact types considered for the process are: i) Under-sampling artifact: This type of degradation is induced by the acquisition settings. Usually, the long acquisition duration is shortened at the cost of image quality.
  • Motion artifact Inherent respiratory and cardiac movements degrade the image quality by introducing ghosting artifacts.
  • iii) Poor spatial resolution Artifacts arising due to large in-plane pixel spacing.
  • data pre-processing includes standardizing the various artifact dataset using following steps: i) Cropping: Region of interest (ROI) defined by the cardiac anatomy is extracted within an 128x128 image.
  • ROI Region of interest
  • ii) Normalization The intensity profile of the heterogeneous dataset is modified such that each image has contrast information fitted within a defined range.
  • An artifact complexity scoring function is then used to determine a complexity score of an artifact of any type.
  • the complexity score is a value indicating the difficulty in extracting a clean image from the artifact image.
  • a pacing function is used wherein while initially, the process only uses the easy graded artifacts to perform artifact restoration. At subsequent stages, highly difficult artifacts are cumulatively added to the process so that the knowledge gained from the easy artifacts is used effectively.
  • a deep learning (DL) model provides a parameterized neural network architecture that facilitates a functional mapping from input degraded image to the corresponding clean image at its output.
  • Said model consists of modules including, but not limited to, convolutional layer, batchnorm and nonlinear activation function. The parameters of said modules are appropriately adjusted to effectively improve the quality of input image.
  • an artifact-specific model is implemented, where from a single DL model, based on the artifact type, a separate expert model for every available artifact is obtained, using correction mechanism explained herein below. Correction mechanism also called as backpropagation updates the parameters of a DL model by optimizing an error function.
  • the flowchart provides an evaluation mechanism that also uses backpropagation, but instead operates on a hierarchy where, instead of updating, the updated hypothesis is tested for better optimization strategy.
  • the present invention encompasses inclusion of a biologically motivated method that operates on a spectrum of neural networks and associates a loss function to a training process constituted by the preparation of datasets, applying known artifacts and achieving a highly nonlinear function to map degraded scan to its clean version.
  • This end-to-end learning method based on representation learning is akin to the spirit of biologically evolving systems in the sense of automatically searching (facilitated by feedback as shown in figure 3 in the form of evaluation mechanism) and identifying an optimal mechanism (facilitated by coupling evaluation mechanism with correction mechanism in figure 3).
  • an image quality assessment measure is used as a metric to quantify the image quality of the output provided by the model.
  • the present invention based on representation-learning is different in two aspects: 1) a single model is designed to effectively improve the quality of scan affected by multiple artifacts and, 2) evaluation mechanism is included that boosts the performance of the overall process even in the scenario of unseen artifacts. Whereas the existing system for solving the problem of artifact restoration consists of only training, without evaluation mechanism, a model for every degradation.
  • the present invention efficiently utilizes nuances such as artifact type and artifact complexity that provide additional information for improving the scan quality.
  • the present invention method is designed to work with even a single type of artifact with accuracy all types of artifacts are provided.
  • the method when included in the MRI workflow improves the scan quality, and thus enhances the decision-making process for a better healthcare system.
  • Artifact restoration is ill-posed as the problem is under-determined (M ⁇ N) and the operator A is ill-conditioned.
  • the restoration of MRI artifact scans is achieved by introducing an a-priori knowledge of x into the unconstrained optimization [11]: min x
  • Deep learning-based MRI image restoration involves training a DL model using a single-level optimization on the average loss of all observed artifact data.
  • This supervised joint training can be formulated as: where, Di represents the dataset of artifact i, consisting of ground truth image x and its corresponding degraded image xin.
  • f is a DL model parameterized by ⁇ .
  • E statistical expectation (E) analysis in Eq.3 infers an optimal parameter set ⁇ .
  • ASR(x) U (D(x)), where D and U denote down-sampling and upsampling operations respectively.
  • AUS(x) F ⁇ 1(M ⁇ F(x)) where ⁇ indicate Hadamard product and M is an under-sampling mask.
  • MAML involves partitioning each task’s data into support (xt, xspt) and query (xt, xqry) samples.
  • the parameters of DL model, ⁇ , in Fig.2b are called meta-initializations.
  • the present invention supports samples to perform a few gradient-descent steps (adaptation) from meta-initializations to obtain task-specific parameters ( ⁇ t).
  • Loss of task-specific parameters on query data is aggregated over all train tasks (T ), to provide supervision for meta- initializations.
  • the training method of MAML [12] is: In line with the present disclosure of MAML-based artifact image restoration, the present invention considers an artifact-type as a task.
  • the present invention performs adaptation to result in an artifact-specific model that is characterized by weights ⁇ t and it constitutes one-level of optimization (inner level, steps 6 to 12 in Algorithm 1) in the bi-level MAML framework.
  • the adaptation on an artifact is shown in the Fig.2b.
  • the present invention proposes aggregating the loss incurred by every artifact- specific model using query samples.
  • the second-level of optimization (outer level, steps 13 to 16 of Algorithm 1), the present invention proposes backpropagating the total loss to update the meta-initializations and thus completing one end-to-end iteration in the course of training.
  • the present invention proposes 1) a scoring- function that estimates the complexity of a data-sample based on the difficulty of predicting the target associated with the input and 2) a pacing-function that schedules the inclusion of data-samples to DL model across epochs as the training progresses.
  • pacing-function provides only low- complexity data-samples based on scoring function to the DL model and as the training progresses, medium to high complexity data- samples are cumulatively included.
  • the present invention also incorporates CL into MAML framework. Unlike CL, the present invention also defines complexity over a task (Fig.2b, pink block) and not on data-samples.
  • the scoring-function of a task is parameterized by the ill- posedness of the corresponding forward operator A.
  • the pacing-function used herein is a simple step-function of epoch as in CL, as shown in Fig.3.
  • the training process of CMAML is described in Algorithm 1 and various notations are explained in detail.
  • the experimental dataset details are provided herewith.
  • T Training Data
  • the train tasks (T) include artifacts caused by motion, under-sampling and poor spatial resolution.
  • M&M Multi-Centre, Multi-Vendor & Multi- Disease
  • Unseen Artifact Data the following unseen artifact data are considered for evaluation: (i) different cardiac dataset i.e., Automated Cardiac Diagnosis Challenge (ACDC) [14] dataset (ii) unseen amount of degradation (iii) unseen artifact type. A combination of three cases is also present in unseen artifact data.
  • the present invention selectively chooses 3x and 5x acceleration in unseen artifact data.
  • composite Artifact Data is characterized by simulating one artifact followed by a different artifact in the same cardiac scan. For example, in an embodiment five different artifacts on M&M data are considered: 1) Noise and Spiking, 2) Spatial-resolution and Noise, 3) Under-sampling and Spiking, 4) ghosting and Spiking, and 5) Under-sampling and Noise.
  • Undersampling artifact consists of 3x acceleration and a 2x factor for spatial resolution.
  • D. Preprocessing M&M and ACDC dataset images are used that consist of three spatial dimensions and one time dimension, along with segementation maps and end-systolic (ES) [16] time instances of the cardiac cycle. In the time dimension, except the first and last time points, the rest of the slices are considered for training.
  • the segmentation map of the ES slice consists of the clinically relevant portion of the cardiac scan.
  • a 128x128 region is cropped around the region of interest defined by the segmentation map. Images are normalized for the intensity homogeneity across CMR scans.
  • the (deep learning) DL model is a five layer CNN.
  • the MRI modality is diverse due to its varied acquisition settings and patient conditions.
  • the present invention evaluates the proposed method under deviated scenario of different train and test artifacts and degradations. Details on the unseen artifact data that is used to qualitatively and quantitatively demonstrate the CMAML generalization is given herewith.
  • the Table I provides quantitative results in terms of SSIM and PSNR (dB) metrics. From Table I, for M&M dataset, CMAML is consistently better than other methods in terms of SSIM metric that is considered to be close to radiologist scores. Similarly, in terms of PSNR, CMAML performs better artifact suppression for 83% of unseen degradations on M&M dataset.
  • CMAML shows better identity mapping over other methods as shown in Table I below.
  • the present invention now describes evaluation on composite artifacts.
  • the scenario of composition of artifacts is described, where the scan containing multiple degradations is prominent in MRI acquisition.
  • the ghosting artifact from the respiratory cardiac movement is compounded by the under- sampling artifact arising from acquisition settings.
  • the present invention evaluates on the test scenario that contains two different artifacts in the same scan as shown in Table II below. Details on the composite artifact data is also described herewin. From Table II, the CMAML method of the present invention is quantitatively performing better than joint training and MAML in terms of SSIM scores for 80% of composite artifacts.
  • meta learning methods outperform SGD for 80% of composite artifacts.
  • a maximum improvement margin of around 0.006 is noticed for CMAML over SGD.
  • Qualitative performance of various methods is shown in Fig. 7, including the residue, for a combination of undersampling followed by additive Gaussian noise.
  • the clinically prominent portion of the left ventricle of cardiac is highlighted in the bounding box in the residue images of Fig. 7 and CMAML predicts the artifact suppressed image closer to the normal cardiac scan.
  • the metrics are statistically significant with p ⁇ 0.05.
  • present invention proposes CMAML, a training process based on meta learning, to efficiently consolidate the information of multiple types of artifacts for MRI artifact image restoration.
  • the training process is enabled to embed better representations by associating the artifact’s ill-posedness to the complexity and thus effectively promoting the curriculum fashion of training into meta-learning framework.
  • the present invention demonstrates increased scalability of CMAML on various nuances of unseen artifacts and composite artifacts in cardiac MRI images qualitatively and quantitatively.
  • present invention is trained with deployment perspectives to improve scan quality under various unseen artifacts, and is capable of eliminating models trained separately for each artifact.
  • Fig.8 describes an inference pipeline for a machine learning model with a scheduler component that reduces the artifacts progressively during the inference stage.
  • the exemplary scheduler is designed to iteratively reduce the magnitude of artifacts that might be present in the output of the trained model.
  • the scheduler modifies the output image by a defined iterative process to achieve the desired reduction in artifacts.
  • the transformation applied by the scheduler can be represented as:

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Condensed Matter Physics & Semiconductors (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Theoretical Computer Science (AREA)
  • Physiology (AREA)
  • Primary Health Care (AREA)
  • Cardiology (AREA)
  • Epidemiology (AREA)
  • Psychiatry (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

The present invention focuses on enhancing the scan quality of Magnetic Resonance (MR) images by reducing artifacts through a novel deep learning approach. It introduces a Model-Agnostic Meta-Learning (MAML) framework combined with curriculum learning, enabling the system to adaptively learn and restore multiple types of artifacts, such as noise, motion, and undersampling. The method involves receiving an input MR image, processing it through a trained deep learning model, and applying an iterative scheduler component to progressively reduce the magnitude of artifacts. This technique leverages shared knowledge across various artifact types and fine-tunes restoration processes specific to each artifact during training. By improving the clarity and quality of MR images, the invention aids in better image processing, minimizes the need for patient rescans, and enhances MRI workflow efficiency, ultimately leading to a more effective healthcare system.

Description

METHOD AND APPARATUS FOR ENHANCING THE SCAN QUALITY OF MAGNETIC RESONANCE (MR) IMAGES TECHNICAL FIELD The present invention relates to improving the scan quality of the Magnetic Resonance (MR) images, leading to a better decision process by post-processing the acquired image. BACKGROUND OF THE INVENTION This section is intended to provide information relating to the field of the invention and thus any approach/functionality described below should not be assumed to be qualified as prior art merely by its inclusion in this section. Cine Cardiac MRI (CMR) is known as the gold standard when processing images for heart related diseases due to its ability to assess left and right ventricular functions by estimating stroke volume, ejection fraction, end-systolic and end- diastolic volumes. Non-invasive assessment of such quantities aid decision making in various scenarios ranging from the image processing required in detecting heart failure to determining the need for primary prevention implantable cardioverter defibrillators and the timing of surgical intervention in patients with valvular heart disease. However, CMR is highly operator and patient dependent because of the inherent trade-off between spatial and temporal resolution, scan time and signal-to- noise ratio (SNR). For instance, imaging at higher spatial resolution will result in lower SNR or longer scan times. Longer scan time leads to additional artifacts from patient movements. Moreover, this trade-off is further compounded by imaging a moving anatomy. For example, reduced motion artifact, via gated/triggered acquisition, comes at the expense of spatial resolution and adds additional constraints to CMR. In fact, respiratory and cardiac motion during CMR acquisition constitutes a major source of degradation. The challenge is prospectively addressed by a) avoiding motion by performing breath-holds, b) suppressing motion by monitoring the motion-cycle. However, case-a is not a feasible solution because multiple breath-holds throughout the acquisition leads to patient discomfort and fatigue. It is also patient dependent and is impossible for paediatric, critically ill, and uncooperative patients. Similarly, case-b involves additional hardware like MR navigators, field probes and pilot tone which is not economical, introduces additional parameters, making the acquisition complicated and demands a skilled operator to conduct the acquisition. Furthermore, not all artifacts that are clinically relevant like chemical shift can be prospectively addressed. Patient dependent (due to breath holds) and operator dependent (for handling the constraints of additional hardware) nature of the prospective solutions are not feasible and cannot be scaled to every other degradation in CMR. In this wake, data driven learning-based approaches offer a solution as a retrospective/post-processing step. Existing deep-learning (DL) techniques address the removal of a single type of artifact. However, as MRI is affected by diverse sources of artifacts, training a model separately for each artifact type is not practically possible for deployment because of large computational requirements and cannot be scaled to multiple acquisition settings. Combining all artifact data and training a single DL model is not efficient as it undermines the implicitly available common knowledge shared across various artifacts. So, the existing methods are limited because of the lack of two significant attributes: 1) artifact invariant information that is characterized by the common knowledge shared across images of different artifacts and 2) discriminative artifact-specific restoration that is aided by the artifact invariant information. Traditional training methods such as Joint training (or) Stochastic Gradient Descent (SGD), combine all artifact data in a single level of optimization as shown in Fig. 2a. Such known methods do not include additional nuances of artifacts (like artifact- type and artifact-amount) that are essential to drive the discriminative artifact- specific restoration during training. Thus, conventional deep learning methods are known to deal with removing a specific type of artifact, leading to separately trained models for each artifact type that lack the shared knowledge generalizable across artifacts. Again, training a model for each type and amount of artifact is a tedious process that consumes excessive training time and resources storage for models. For example, CINENet [3] is known to perform artifact restoration of only under- sampled Cardaic MR (CMR). Several deep neural network architectures are developed specifically for motion correction or super- resolution. However, as MRI is affected by diverse and multiple sources of artifacts, training a model separately for each type of artifact incurs large computational requirements. Conventional methods for artifact suppression like compressed sensing treat artifacts as aliasing or blur and use non-linear optimization solvers to iteratively recover the image. There is a long felt need for a technique that imbibes the above attributes to realize a specialized model capable of suppressing multiple artifacts encountered in MRI, including the unseen artifact types. The present invention proposes a single model that learns a common knowledge across various MRI artifacts and helps to generalize to unseen artifacts with deviated amounts of degradation levels at test time (e.g., under-sampling with unseen acceleration factors different from training data). OBJECTS OF THE INVENTION This section is intended to introduce certain objects of the disclosed methods and systems in a simplified form and is not intended to identify the key advantages or features of the present disclosure. The present invention proposes a Model-agnostic meta-learning (MAML) that is based on curriculum structure CMAML, a learning process that integrates MAML with curriculum learning to impart the knowledge of variable artifact complexity to adaptively learn restoration of multiple artifacts during training. The present invention proposes an artifact-invariant information that is characterized by the common knowledge shared across images of different artifacts and incorporates discriminative artifact-specific fine-tuning at train time in order to achieve restoration of various degradations in a single model. An objective of the present invention is to provide a new technique that overcome the disadvantages associated with the prior art, improves the scan quality, enhancing the scan decision-making process for a better understanding of scanned images, and can potentially be integrated into the MRI workflow. Another object of the present invention is in restoring artifact affected MRI images for various types of artifacts in a single deep learning model with a training process driven by learning a set of latent representation which is common across artifacts. Yet another objective of the present invention is to take into account various nuances occurring in the form of artifact-type and artifact-amount that are significant. Moreover, common knowledge present across various different artifacts is to be modeled so that the invention performs reasonably even in the presence of hitherto unseen artifacts. Other general and specific objectives of the invention will in part be obvious and will in part appear hereinafter. TECHNICAL ADVANTAGES OF THE PRESENT INVENTION The present invention can be extensively used in clinical settings, especially in the MRI workflow to correct for the frequent occurrence of artifacts arising from patient movements and acquisition settings. Improving the scan quality of an artifact image potentially results in better inference on the understanding of images and in reducing the time spent in analyzing the artifact scan, thus, efficiently promoting, for example, a better healthcare system. The present invention further achieves that long duration MRI acquisition process can be shortened without any loss in the image quality, further resulting in better MRI scanner utilization by increasing the throughput of the number of patients scanned. The present invention further provides that other degradations arising from the electronic noise of MRI hardware in the form of RF and spiking artifacts does not affect the downstream tasks of analysing the patient. Other general and specific technical advantages of the invention will in part be obvious and will in part appear hereinafter. BRIEF DESCRIPTION OF DRAWINGS Figure 1 illustrates various types of artifacts in MRI acquisition, in accordance with an embodiment of the present invention. Figure 1 (a) illustrates a qualitative results on motion affected cardiac scan. Figure 2 illustrates a high-level flowchart of the process during testing, in accordance with an embodiment of the present invention. Figure 2 (a) illustrates an exemplary method of Joint training in line with embodiments of the present invention. Figure 2 (b) illustrates a curriculum-MAML for an exemplary neural network in line with present invention. Figure 3 illustrates a flowchart of the method during training using a representation learning technique, in accordance with an embodiment of the present invention. Figure 4 illustrates a pacing function in line with the present invention. Figure 5 illustrates a comparative analysis with respect to SSIM metric on unseen artifact data. Figure 6 illustrates qualitative results on unseen artifact data. Figure 7 illustrates qualitative results on composite artifact data. Figure 8 illustrates an inference pipeline for an exemplary machine learning model having a scheduler component for reducing artifacts during inference stage. DETAILED DESCRIPTION In the following description, for the purpose of explanation, numerous specific details have been set forth in order to provide a description of the invention. It will be apparent, however, that the invention may be practiced without these specific details and features. The present disclosure relates to system and method to improve the scan quality of degraded MRI scan caused by artifacts during acquisition of the MRI scan. Particularly, the present invention is directed to a method and apparatus for reducing artifacts in MRI scan images during inference by receiving an input MRI scan image, processing the input MRI scan image through a trained deep learning model to generate an output image, applying a scheduler component to iteratively reduce the magnitude of artifacts in the output image by applying a predefined transformation. The present invention utilizes a model-agnostic meta-learning (MAML) model as a nested bi-level optimization framework to learn common knowledge across artifacts in an outer level of optimization, and artifact-specific restoration in the inner level. The present invention proposes that the curriculum-MAML (CMAML) is utilized as a learning process that integrates MAML with curriculum learning to impart the knowledge of variable artifact complexity to adaptively learn restoration of multiple artifacts during training. In particular, the artifact-specific model of the present invention implements a forward-pass of training process as illustrated in Fig.2b and effectively promotes a specialized model (θ), based on artifact type, even in the unseen test degradations. In the MAML framework of the present invention, each type of artifact is treated as a task. The MAML framework as implemented further incorporates a curriculum learning (CL), in order to provide additional knowledge of artifact-complexity during training. Thus, the present invention implements a level of complexity in curriculum learning [CL] based on the ill-posedness of various artifacts. For instance, in under-sampling artifact, the level of complexity is directly related to the ill-posedness characterized by the amount of acceleration during MRI acquisition. Thus, for two scans where one scan is 3x accelerated and the other is 5x, the former task is less complex than the latter. The proposed learning model of present invention embeds representations based on the nuances in artifacts for a given neural network architecture. Thus, present invention is able to propose a curriculum-based model-agnostic meta- learning (CMAML) as a training method that performs image restoration of multiple types of artifact- affected MRI scans in a single model. Again, the proposed method establishes an artifact-type as a task and associates the amount of MRI artifact with the task-complexity. The present invention encompasses analysing multiple MRI artifacts by using multiple artifact representation learning method that provides a single model for improving the scan quality of MRI scans affected by various degradations. The system and method of present invention output a clean counterpart of the artifact affected MRI scan. Further, the present invention encompasses incorporating the nuances of artifact-type and artifact complexity into the training method in determining the artifact free image for a given poor quality MRI scan. Furthermore, the present invention encompasses using multiple artifact data for intelligently updating the model during the course of training to enhance the overall accuracy on various degradations. Referring to Figure 1, shown are the various types of artifacts that can occur during an MRI acquisition, including, but not limited to, noise artifact, spike artifacts, poor spatial resolution, undersampling artifacts, motion artifacts and ghost artifacts. Figure 1 (a) illustrates a qualitative results on motion affected cardiac scan. Figure 2 illustrates a flowchart of the process during testing, in accordance with an embodiment of the present disclosure. As depicted therein, a MRI scan image is processed with the deep-learning module of the present invention which processes the input MRI scan image and results in a scan with improved quality. Thus, the MRI Scan Image Improvement Using Deep Learning Model broadly comprises three steps: - The original image obtained from an MRI scan. - A Deep Learning model that processes the MRI scan image. - The output is an MRI image with enhanced scan quality. Figure 3 shows a flowchart of the process during training, in accordance with an embodiment of the present invention. The process comprises: - collecting datasets for different types of artifacts (e.g., Artifact 1, Artifact 2, ..., Artifact n) - pre-processing the collected data to standardize and preparing it for analysis - assessing the complexity of each artifact using a scoring function. This helps in understanding the severity and nature of the artifacts - applying a pacing function to gradually introduce data with increasing complexity to the DL model during training. This helps the model learn effectively. - training the deep learning (DL) model using the pre-processed data and pacing function - Implementing a correction mechanism within the deep learning DL model to adjust and improve its performance based on artifact-specific challenges - Developing an artifact-specific model that targets and improves specific types of artifacts identified during training - Evaluating the improved MRI images using an image quality assessment measure to ensure the enhancements meet the required criteria - Continuously evaluating the model's performance using an evaluation mechanism - Checking if the improved image quality meets the set criteria. - - If “Yes”, finalizing the (deep learning) DL model for deployment. - - If “No”, iterating through the (deep learning) DL model training and correction mechanism until the desired quality is achieved. Thus, as shown in figure 3, dataset(s) of various artifact types are collected. Some exemplary artifact types considered for the process are: i) Under-sampling artifact: This type of degradation is induced by the acquisition settings. Usually, the long acquisition duration is shortened at the cost of image quality. ii) Motion artifact: Inherent respiratory and cardiac movements degrade the image quality by introducing ghosting artifacts. iii) Poor spatial resolution: Artifacts arising due to large in-plane pixel spacing. Further, data pre-processing includes standardizing the various artifact dataset using following steps: i) Cropping: Region of interest (ROI) defined by the cardiac anatomy is extracted within an 128x128 image. ii) Normalization: The intensity profile of the heterogeneous dataset is modified such that each image has contrast information fitted within a defined range. An artifact complexity scoring function is then used to determine a complexity score of an artifact of any type. The complexity score is a value indicating the difficulty in extracting a clean image from the artifact image. Next, a pacing function is used wherein while initially, the process only uses the easy graded artifacts to perform artifact restoration. At subsequent stages, highly difficult artifacts are cumulatively added to the process so that the knowledge gained from the easy artifacts is used effectively. In the next step, a deep learning (DL) model provides a parameterized neural network architecture that facilitates a functional mapping from input degraded image to the corresponding clean image at its output. Said model consists of modules including, but not limited to, convolutional layer, batchnorm and nonlinear activation function. The parameters of said modules are appropriately adjusted to effectively improve the quality of input image. Further, an artifact-specific model is implemented, where from a single DL model, based on the artifact type, a separate expert model for every available artifact is obtained, using correction mechanism explained herein below. Correction mechanism also called as backpropagation updates the parameters of a DL model by optimizing an error function. Updating occurs in a way such that the new parameters are better than the old parameters at performing the task of artifact reduction. Further, the flowchart provides an evaluation mechanism that also uses backpropagation, but instead operates on a hierarchy where, instead of updating, the updated hypothesis is tested for better optimization strategy. The present invention encompasses inclusion of a biologically motivated method that operates on a spectrum of neural networks and associates a loss function to a training process constituted by the preparation of datasets, applying known artifacts and achieving a highly nonlinear function to map degraded scan to its clean version. This end-to-end learning method based on representation learning is akin to the spirit of biologically evolving systems in the sense of automatically searching (facilitated by feedback as shown in figure 3 in the form of evaluation mechanism) and identifying an optimal mechanism (facilitated by coupling evaluation mechanism with correction mechanism in figure 3). Finally, an image quality assessment measure is used as a metric to quantify the image quality of the output provided by the model. The present invention based on representation-learning is different in two aspects: 1) a single model is designed to effectively improve the quality of scan affected by multiple artifacts and, 2) evaluation mechanism is included that boosts the performance of the overall process even in the scenario of unseen artifacts. Whereas the existing system for solving the problem of artifact restoration consists of only training, without evaluation mechanism, a model for every degradation. The present invention efficiently utilizes nuances such as artifact type and artifact complexity that provide additional information for improving the scan quality. The present invention method is designed to work with even a single type of artifact with accuracy all types of artifacts are provided. The method when included in the MRI workflow improves the scan quality, and thus enhances the decision-making process for a better healthcare system. The data acquisition forward model of the artifact restoration problem [11] is formulated as: Ax + E = y (1) where, x ∈ CN denotes the desired image, y ∈ CM is the measurement from the MRI scanner, E ∈ CM is the noise and A: CN → CM represents the forward operator of MRI acquisition that causes artifacts. Artifact restoration is ill-posed as the problem is under-determined (M << N) and the operator A is ill-conditioned. The restoration of MRI artifact scans is achieved by introducing an a-priori knowledge of x into the unconstrained optimization [11]: min x ||Ax − y||2 + R(x) (2) where, ||Ax − y||2 is the data fidelity term and R is a regularization term. Deep learning-based MRI image restoration involves training a DL model using a single-level optimization on the average loss of all observed artifact data. This supervised joint training can be formulated as: where, Di represents the dataset of artifact i, consisting of ground truth image x and its corresponding degraded image xin. Here, f is a DL model parameterized by θ. Unlike iterative methods in Eq.2, statistical expectation (E) analysis in Eq.3 infers an optimal parameter set θ∗. Artifacts considered for training are motion, super- resolution (SR) and under-sampling (US), each defined with a corresponding operator as: (i) AM (x) = F−1[ l+s ψj(F(xj))], where F and F−1 denote 2D Fourie j=rl−s and inverse transforms respectively, ψ selects k-space data lines of 2s + 1 frames of CMR . (ii) ASR(x) = U (D(x)), where D and U denote down-sampling and upsampling operations respectively. (iii) AUS(x) = F−1(M ◦ F(x)) where ◦ indicate Hadamard product and M is an under-sampling mask. MAML involves partitioning each task’s data into support (xt, xspt) and query (xt, xqry) samples. The parameters of DL model, θ, in Fig.2b are called meta-initializations. For every task “t”, the present invention supports samples to perform a few gradient-descent steps (adaptation) from meta-initializations to obtain task-specific parameters (φt). Loss of task-specific parameters on query data is aggregated over all train tasks (T ), to provide supervision for meta- initializations. The training method of MAML [12] is:
Figure imgf000016_0001
In line with the present disclosure of MAML-based artifact image restoration, the present invention considers an artifact-type as a task. On every artifact’s support samples, the present invention performs adaptation to result in an artifact-specific model that is characterized by weights φt and it constitutes one-level of optimization (inner level, steps 6 to 12 in Algorithm 1) in the bi-level MAML framework. The adaptation on an artifact is shown in the Fig.2b. After adapting on support samples of all train artifact data, the present invention proposes aggregating the loss incurred by every artifact- specific model using query samples. In the second-level of optimization (outer level, steps 13 to 16 of Algorithm 1), the present invention proposes backpropagating the total loss to update the meta-initializations and thus completing one end-to-end iteration in the course of training. During the outer level update, the parameters of the artifact- specific model are frozen to perform optimization on only the meta-initializations as shown in Fig. 2b. However, additional nuances in the complexity of various configurations within a type of artifact can embed representations that generalize better for unseen artifacts in test data. In Curriculum-learning (CL) [10], the present invention proposes 1) a scoring- function that estimates the complexity of a data-sample based on the difficulty of predicting the target associated with the input and 2) a pacing-function that schedules the inclusion of data-samples to DL model across epochs as the training progresses. During the initial epochs of training in CL, pacing-function provides only low- complexity data-samples based on scoring function to the DL model and as the training progresses, medium to high complexity data- samples are cumulatively included. Here, the present invention also incorporates CL into MAML framework. Unlike CL, the present invention also defines complexity over a task (Fig.2b, pink block) and not on data-samples. The scoring-function of a task is parameterized by the ill- posedness of the corresponding forward operator A. The pacing-function used herein is a simple step-function of epoch as in CL, as shown in Fig.3. The training process of CMAML is described in Algorithm 1 and various notations are explained in detail.
Figure imgf000017_0001
Figure imgf000017_0002
The experimental dataset details are provided herewith. A. Training Data For training, the present invention use Multi-Centre, Multi-Vendor & Multi- Disease (M&M) cardiac dataset. The train tasks (T) include artifacts caused by motion, under-sampling and poor spatial resolution. The present invention in an exemplary embodiment considers three motion artifact tasks with s = 1, 2 and 3 in AM operator, three under-sampling artifact tasks of 2x, 4x and 6x acceleration with Cartesian masks, and three scale factors of 2x, 3x and 5x as super- resolution tasks. In each task, the present invention considers 2100 and 500 cardiac images for training and validation respectively. B. Unseen Artifact Data In an embodiment, the following unseen artifact data are considered for evaluation: (i) different cardiac dataset i.e., Automated Cardiac Diagnosis Challenge (ACDC) [14] dataset (ii) unseen amount of degradation (iii) unseen artifact type. A combination of three cases is also present in unseen artifact data. Regarding the different degradations, the present invention selectively chooses s = 4 and 6 in AM operator. Similarly, for undersampling artifact, the present invention selectively chooses 3x and 5x acceleration in unseen artifact data. Moreover, artifacts not present in training data such as Spiking, Respiratory/Ghosting, Noise and Gamma artifacts are also present in unseen artifact data, simulated using TorchIO [15] library. C. Composite Artifact Data In an exemplary embodiment, the composite artifact data is characterized by simulating one artifact followed by a different artifact in the same cardiac scan. For example, in an embodiment five different artifacts on M&M data are considered: 1) Noise and Spiking, 2) Spatial-resolution and Noise, 3) Under-sampling and Spiking, 4) Ghosting and Spiking, and 5) Under-sampling and Noise. Undersampling artifact consists of 3x acceleration and a 2x factor for spatial resolution. D. Preprocessing In an embodiment, M&M and ACDC dataset images are used that consist of three spatial dimensions and one time dimension, along with segementation maps and end-systolic (ES) [16] time instances of the cardiac cycle. In the time dimension, except the first and last time points, the rest of the slices are considered for training. The segmentation map of the ES slice consists of the clinically relevant portion of the cardiac scan. A 128x128 region is cropped around the region of interest defined by the segmentation map. Images are normalized for the intensity homogeneity across CMR scans. In an embodiment, the (deep learning) DL model is a five layer CNN. Learning rates (α, β) of 0.001 with 200 max epochs are chosen in an embodiment. Outer level and inner level use Adam and SGD optimizers respectively. Batch size for support and query data (Nspt, Nqry) is 5. Task mini-batch (|d|) is chosen to be 3. Pacing functions’s cumulative inclusion of artifact data across epochs is shown in Fig. 3 along with easy, medium and hard artifacts. Pacing-function also modulates the number of adaptation steps (U ) from 1, 2 & 3 at the cue of adding graded artifacts during training. The loss function is L1 norm between the model’s prediction and ground truth. All models are trained on 24GB memory Nvidia RTX-3090. The MRI modality is diverse due to its varied acquisition settings and patient conditions. The present invention evaluates the proposed method under deviated scenario of different train and test artifacts and degradations. Details on the unseen artifact data that is used to qualitatively and quantitatively demonstrate the CMAML generalization is given herewith. The Table I provides quantitative results in terms of SSIM and PSNR (dB) metrics. From Table I, for M&M dataset, CMAML is consistently better than other methods in terms of SSIM metric that is considered to be close to radiologist scores. Similarly, in terms of PSNR, CMAML performs better artifact suppression for 83% of unseen degradations on M&M dataset. Likewise, on ACDC dataset, meta-learning methods outperform SGD for 83% and 67% of artifacts in terms of SSIM and PSNR respectively. Maximum improvement is present in spiking and gamma artifacts in M&M and ACDC dataset respectively. Qualitative results with residue images in Fig.6 indicate that the proposed CMAML is robust with respect to cardiac image perturbations than other methods. Again, the artifact restoration of motion affected image shown in Fig. 1 indicates better recovery of details in the left ventricle enclosed by a yellow bounding box in residue. From the boxplot of various artifacts in Fig. 5, the regularization offered by curriculum in MAML framework better aids the restoration of CMR images, especially in spiking and additive noise corruption. Also for an input image with no artifact, CMAML shows better identity mapping over other methods as shown in Table I below. The present invention now describes evaluation on composite artifacts.The scenario of composition of artifacts is described, where the scan containing multiple degradations is prominent in MRI acquisition. For instance, the ghosting artifact from the respiratory cardiac movement is compounded by the under- sampling artifact arising from acquisition settings. The present invention evaluates on the test scenario that contains two different artifacts in the same scan as shown in Table II below. Details on the composite artifact data is also described herewin. From Table II, the CMAML method of the present invention is quantitatively performing better than joint training and MAML in terms of SSIM scores for 80% of composite artifacts. Similarly, in terms of PSNR metric, meta learning methods outperform SGD for 80% of composite artifacts. For the composite artifact of ghosting+spiking, a maximum improvement margin of around 0.006 is noticed for CMAML over SGD. Qualitative performance of various methods is shown in Fig. 7, including the residue, for a combination of undersampling followed by additive Gaussian noise. The clinically prominent portion of the left ventricle of cardiac is highlighted in the bounding box in the residue images of Fig. 7 and CMAML predicts the artifact suppressed image closer to the normal cardiac scan. For the proposed method, the metrics are statistically significant with p < 0.05. Thus, present invention proposes CMAML, a training process based on meta learning, to efficiently consolidate the information of multiple types of artifacts for MRI artifact image restoration. The training process is enabled to embed better representations by associating the artifact’s ill-posedness to the complexity and thus effectively promoting the curriculum fashion of training into meta-learning framework. For a fixed neural network, the present invention demonstrates increased scalability of CMAML on various nuances of unseen artifacts and composite artifacts in cardiac MRI images qualitatively and quantitatively. Thus, present invention is trained with deployment perspectives to improve scan quality under various unseen artifacts, and is capable of eliminating models trained separately for each artifact. Moreover, restoring the artifact affected scan within the MRI workflow reduces the burden on the healthcare system by avoiding patient recall and rescan. Further, Fig.8 describes an inference pipeline for a machine learning model with a scheduler component that reduces the artifacts progressively during the inference stage. The exemplary scheduler is designed to iteratively reduce the magnitude of artifacts that might be present in the output of the trained model. The scheduler modifies the output image by a defined iterative process to achieve the desired reduction in artifacts. The transformation applied by the scheduler can be represented as: Although the present invention has been described in considerable detail with reference to certain preferred embodiments and examples thereof, other embodiments and equivalents are possible. Even though numerous characteristics and advantages of the present invention have been set forth in the foregoing description, together with functional and procedural details, the disclosure is illustrative only, and changes may be made in detail, especially in terms of the structuring and implementation within the principles of the invention to the full extent indicated by the broad general meaning of the terms. Thus, various modifications are possible of the presently disclosed system and method without deviating from the intended scope and spirit of the present invention.

Claims

We Claim: 1. A method for reducing artifacts in MRI scan images during inference, comprising: - receiving an input MRI scan image; - processing the input MRI scan image through a trained deep learning model to generate an output image; - applying a scheduler component to iteratively reduce the magnitude of artifacts in the output image by applying a predefined transformation. 2. The method of claim 1, wherein the predefined transformation applied by the scheduler component is represented by the equation: \[ I_{sch} = I_{out} - 0.1 \times (I_{out} - I_{in}) \] where \(I_{in}\) is the input image to the trained model, and \(I_{out}\) is the output image from the trained model. 3. The method of claim 1, wherein the scheduler component operates iteratively until the magnitude of artifacts is reduced to a predetermined threshold. 4. The method of claim 1, further comprising: - adjusting the transformation parameters based on feedback regarding the reduction of artifacts in the output image. 5. The method of claim 1, further comprising: - determining the number of iterations required for artifact reduction based on the initial quality of the output image. 6. The method of claim 1, wherein the trained deep learning model is a model- agnostic meta-learning (MAML) model. 7. The method of claim 1, wherein trained deep learning model is configured to handle multiple types of artifacts including but not limited to noise, spiking artifacts, poor spatial resolution, undersampling artifacts, motion artifacts, and ghost artifacts. 8. An apparatus for reducing artifacts in MRI scan images during inference, comprising: - a trained deep learning model configured to receive an input image and generate an output image; and - a scheduler component operatively coupled to the trained deep learning model, wherein the scheduler component iteratively reduces the magnitude of artifacts in the output image by applying a predefined transformation. 9. The apparatus of claim 8, further comprising a feedback mechanism that adjusts the transformation parameters based on the reduction of artifacts in the output image. 10. The apparatus of claim 8, wherein the scheduler component includes a control unit that determines the number of iterations required for artifact reduction based on the initial quality of the output image. 11. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method for reducing artifacts in MRI scan images during inference, the method comprising: - receiving an input MRI scan image; - processing the input MRI scan image through a trained deep learning model to generate an output image; - applying a scheduler component to iteratively reduce the magnitude of artifacts in the output image by applying a predefined transformation.
PCT/IN2024/051408 2023-07-31 2024-07-30 Method and apparatus for enhancing the scan quality of magnetic resonance (mr) images Pending WO2025027643A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202341051465 2023-07-31
IN202341051465 2023-07-31

Publications (1)

Publication Number Publication Date
WO2025027643A1 true WO2025027643A1 (en) 2025-02-06

Family

ID=94394764

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IN2024/051408 Pending WO2025027643A1 (en) 2023-07-31 2024-07-30 Method and apparatus for enhancing the scan quality of magnetic resonance (mr) images

Country Status (1)

Country Link
WO (1) WO2025027643A1 (en)

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ARUN PALLA; SRIPRABHA RAMANARAYANAN; KEERTHI RAM; MOHANASANKAR SIVAPRAKASAM: "Generalizable Deep Learning Method for Suppressing Unseen and Multiple MRI Artifacts Using Meta-learning", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 13 April 2023 (2023-04-13), 201 Olin Library Cornell University Ithaca, NY 14853, XP091483443 *
CHEN ZHAOLIN, PAWAR KAMLESH, EKANAYAKE MEVAN, PAIN CAMERON, ZHONG SHENJUN, EGAN GARY F.: "Deep Learning for Image Enhancement and Correction in Magnetic Resonance Imaging—State-of-the-Art and Challenges", JOURNAL OF DIGITAL IMAGING ; THE JOURNAL OF THE SOCIETY FOR COMPUTER APPLICATIONS IN RADIOLOGY, SPRINGER-VERLAG, NE, vol. 36, no. 1, Ne , pages 204 - 230, XP093278269, ISSN: 1618-727X, DOI: 10.1007/s10278-022-00721-9 *

Similar Documents

Publication Publication Date Title
US12511742B2 (en) Connected machine-learning models with joint training for lesion detection
US11170545B2 (en) Systems and methods for diagnostic oriented image quality assessment
CN110858391B (en) Patient-specific deep learning image noise reduction methods and systems
US12272034B2 (en) Systems and methods for background aware reconstruction using deep learning
EP4107662A1 (en) Out-of-distribution detection of input instances to a model
CN114494127A (en) Medical image classification system based on channel attention deep learning
Radhika et al. An adaptive optimum weighted mean filter and bilateral filter for noise removal in cardiac MRI images
Kavitha et al. Optimized deep knowledge-based no-reference image quality index for denoised MRI images
CN121544591A (en) A Semi-Supervised Medical Image Segmentation Method Based on Causal Uncertainty Decomposition
US12039728B2 (en) Uncertainty-aware deep reinforcement learning for anatomical landmark detection in medical images
CN113223104B (en) Cardiac MR image interpolation method and system based on causal relationship
WO2025027643A1 (en) Method and apparatus for enhancing the scan quality of magnetic resonance (mr) images
EP4343680A1 (en) De-noising data
US12482149B2 (en) Under-sampled magnetic resonance image reconstruction of an anatomical structure based on a machine-learned image reconstruction model
US11721022B2 (en) Apparatus and method for automated analyses of ultrasound images
Palla et al. Generalizable deep learning method for suppressing unseen and multiple MRI artifacts using meta-learning
EP4302261B1 (en) Pet image analysis and reconstruction by machine learning
US12579716B2 (en) MRI reconstruction based on contrastive learning
EP4591269A1 (en) De-noising data
Iele et al. Sample-Aware Test-Time Adaptation for Medical Image-to-Image Translation
Panaganti et al. An Intelligent Medical Image Denoising Approach Based on Region-Vision Transformer-Based Adaptive Mobile-Unet++ with Kalman Filter for Improved Clinical Diagnosis
Correia The use of diffusion models in the reconstruction of accelerated MRI acquisitions
Karthik et al. Improving Clinical Diagnosis Performance with Automated X-ray Scan Quality Enhancement Algorithms.
WO2025174853A1 (en) Motion correction of ultrasound images using machine learning and a reference image selected as a ground truth image
WO2025027638A1 (en) Improving the quality of magnetic resonance scans affective by under-sampling for multiple mri contrasts

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24848522

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE