US20210161422A1 - Automatic imaging plane planning and following for mri using artificial intelligence - Google Patents
Automatic imaging plane planning and following for mri using artificial intelligence Download PDFInfo
- Publication number
- US20210161422A1 US20210161422A1 US17/060,860 US202017060860A US2021161422A1 US 20210161422 A1 US20210161422 A1 US 20210161422A1 US 202017060860 A US202017060860 A US 202017060860A US 2021161422 A1 US2021161422 A1 US 2021161422A1
- Authority
- US
- United States
- Prior art keywords
- heart
- patient
- neural network
- model
- pose
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 50
- 238000013473 artificial intelligence Methods 0.000 title description 7
- 210000002216 heart Anatomy 0.000 claims abstract description 94
- 238000013528 artificial neural network Methods 0.000 claims abstract description 36
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000012545 processing Methods 0.000 claims description 21
- 238000003062 neural network model Methods 0.000 claims description 16
- 238000013527 convolutional neural network Methods 0.000 claims description 7
- 230000006870 function Effects 0.000 claims description 7
- 230000015654 memory Effects 0.000 claims description 6
- 230000004217 heart function Effects 0.000 claims description 4
- 230000002107 myocardial effect Effects 0.000 claims description 4
- 230000035899 viability Effects 0.000 claims description 4
- 238000002595 magnetic resonance imaging Methods 0.000 description 46
- 230000033001 locomotion Effects 0.000 description 14
- 230000000747 cardiac effect Effects 0.000 description 13
- 238000013184 cardiac magnetic resonance imaging Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 230000000241 respiratory effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000029058 respiratory gaseous exchange Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 210000001519 tissue Anatomy 0.000 description 2
- 206010006322 Breath holding Diseases 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 208000031481 Pathologic Constriction Diseases 0.000 description 1
- 210000004100 adrenal gland Anatomy 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 210000000481 breast Anatomy 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 210000003679 cervix uteri Anatomy 0.000 description 1
- 210000001072 colon Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000000205 computational method Methods 0.000 description 1
- 210000004351 coronary vessel Anatomy 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 210000003414 extremity Anatomy 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000010977 jade Substances 0.000 description 1
- 210000004185 liver Anatomy 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 210000002751 lymph Anatomy 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 210000001672 ovary Anatomy 0.000 description 1
- 210000000496 pancreas Anatomy 0.000 description 1
- 210000003899 penis Anatomy 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 210000002307 prostate Anatomy 0.000 description 1
- 210000000664 rectum Anatomy 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000003079 salivary gland Anatomy 0.000 description 1
- 210000001732 sebaceous gland Anatomy 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 210000002027 skeletal muscle Anatomy 0.000 description 1
- 210000003491 skin Anatomy 0.000 description 1
- 210000002460 smooth muscle Anatomy 0.000 description 1
- 210000000278 spinal cord Anatomy 0.000 description 1
- 210000000952 spleen Anatomy 0.000 description 1
- 208000037804 stenosis Diseases 0.000 description 1
- 230000036262 stenosis Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000001550 testis Anatomy 0.000 description 1
- 210000001541 thymus gland Anatomy 0.000 description 1
- 210000001685 thyroid gland Anatomy 0.000 description 1
- 210000003437 trachea Anatomy 0.000 description 1
- 210000003932 urinary bladder Anatomy 0.000 description 1
- 210000004291 uterus Anatomy 0.000 description 1
- 230000002861 ventricular Effects 0.000 description 1
- 210000001835 viscera Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/004—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/004—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
- A61B5/0044—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part for the heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/28—Details of apparatus provided for in groups G01R33/44 - G01R33/64
- G01R33/32—Excitation or detection systems, e.g. using radio frequency signals
- G01R33/36—Electrical details, e.g. matching or coupling of the coil to the receiver
- G01R33/3642—Mutual coupling or decoupling of multiple coils, e.g. decoupling of a receive coil from a transmission coil, or intentional coupling of RF coils, e.g. for RF magnetic field amplification
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/5608—Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/561—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution by reduction of the scanning time, i.e. fast acquiring systems, e.g. using echo-planar pulse sequences
- G01R33/5611—Parallel magnetic resonance imaging, e.g. sensitivity encoding [SENSE], simultaneous acquisition of spatial harmonics [SMASH], unaliasing by Fourier encoding of the overlaps using the temporal dimension [UNFOLD], k-t-broad-use linear acquisition speed-up technique [k-t-BLAST], k-t-SENSE
- G01R33/5612—Parallel RF transmission, i.e. RF pulse transmission using a plurality of independent transmission channels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/561—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution by reduction of the scanning time, i.e. fast acquiring systems, e.g. using echo-planar pulse sequences
- G01R33/5615—Echo train techniques involving acquiring plural, differently encoded, echo signals after one RF excitation, e.g. using gradient refocusing in echo planar imaging [EPI], RF refocusing in rapid acquisition with relaxation enhancement [RARE] or using both RF and gradient refocusing in gradient and spin echo imaging [GRASE]
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/563—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution of moving material, e.g. flow contrast angiography
- G01R33/56308—Characterization of motion or flow; Dynamic imaging
- G01R33/56325—Cine imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R33/00—Arrangements or instruments for measuring magnetic variables
- G01R33/20—Arrangements or instruments for measuring magnetic variables involving magnetic resonance
- G01R33/44—Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
- G01R33/48—NMR imaging systems
- G01R33/54—Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
- G01R33/56—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
- G01R33/561—Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution by reduction of the scanning time, i.e. fast acquiring systems, e.g. using echo-planar pulse sequences
- G01R33/5611—Parallel magnetic resonance imaging, e.g. sensitivity encoding [SENSE], simultaneous acquisition of spatial harmonics [SMASH], unaliasing by Fourier encoding of the overlaps using the temporal dimension [UNFOLD], k-t-broad-use linear acquisition speed-up technique [k-t-BLAST], k-t-SENSE
Definitions
- MRI Magnetic Resonance Imaging
- volume coils for example, body coils
- local coils for example, surface coils
- Cardiac MR imaging is widely regarded as one of the most complex examinations utilizing magnetic resonance due to the patient's respiratory and cardiac motions.
- obtaining target heart views is typically performed through a multi-step approach 100 as illustrated in FIG. 1 .
- scout images and multi-slice localizer images may be initially acquired to determine an approximate location of the heart in the patient's body, including the standard heart views: the short axis view corresponding to the echocardiographic parasternal short axis plane; the horizontal long axis view corresponding to the echocardiographic apical 4-chamber plane; and the vertical long axis view corresponding to the echocardiographic apical 2-chamber plane.
- the localizer images may be used to manually plan slices through the standard heart views, as shown in block 104 .
- the image plane planning of the subsequently performed cardiac MR acquisition scans relies on the views determined above, and the planning is generally accomplished by performing an acquisition scan, as shown in block 106 , and referring or copying the slice locations from the pre-determined standard heart views to the acquisition scan, as shown in block 108 .
- patient motion and inconsistency of breath-holding positions in between scans may introduce mis-registrations of the slices from scan to scan, and may introduce difficulties in interpreting the images.
- an additional acquisition scan may be performed, as shown in block 110 , and a technician may reposition the slices manually, as shown in block 112 , and an acquisition scan for the selected imaging protocol may be performed as shown in block 114 . Severe mis-registration may even require patient repositioning, additional repeated scans, or additional post-processing to register the images, any one of which may add additional cost in the form of additional labor, time, computation, etc. to the MR scanning processes.
- Navigation techniques have been used to monitor respiratory motion of objects being imaged, however, most navigation techniques aim at compensating for the respiratory motion by using a brief MR scan limited to the patient's diaphragm between k-space lines. Thus, the technique may compensate for motion within one data acquisition but cannot address patient motion between multiple data acquisitions. Furthermore, the navigation signal is usually a beam perpendicular to the diaphragm which has a one dimensional limited view and description of the motion of the diaphragm, which may lead to an erroneous respiratory motion estimation.
- the method and system may exploit artificial intelligence, for example, a neural network, to: automatically estimate a pose of the heart; automatically provide imaging slice planning; reconstruct highly accelerated inter-acquisition scout imaging; and monitor and follow patient motion to maintain consistency of planned slice locations for each acquisition.
- artificial intelligence for example, a neural network
- This may advantageously allow for a more automatic and efficient scanning workflow for cardiac MRI and facilitate implementation in most clinical settings for cardiac diagnosis.
- the disclosed embodiments are directed to a method including acquiring initial scout images of a patient's heart, using a neural network to establish a patient specific heart model, and automatically plan imaging planes of the patient specific heart model, performing an accelerated scan of the patient's heart, using the neural network to determine a current location and pose of the patient's heart from the accelerated scan, and to reposition the imaging planes to correspond to the current location and pose of the patient's heart, and using the repositioned imaging planes to perform an acquisition scan and generate an image of the patient's heart from the acquisition scan according to a selected imaging protocol.
- the method may include acquiring the initial scout images from standard MRI body views.
- the initial scout images may include 2D or 3D multi-slice images from one or more of axial sagittal and coronal views.
- Using the neural network to determine a current location and pose of the patient's heart from the accelerated scan may include reconstructing an image from the accelerated scan and comparing the reconstructed image from the accelerated scan to the patient specific heart model.
- the method may include comparing the current location and pose of the patient's heart to the location and pose of the patient specific heart model, and repositioning the imaging planes obtained from the patient specific heart model to correspond to the current location and pose of the patient's heart.
- the neural network may include one or more of a combination of CNN and RNN models, a GRU model, an LSTM model, a fully convolutional neural network model, a generative adversarial network, a back propagation neural network model, a radial basis function neural network model, a deep belief nets neural network model, an Elman neural network model.
- the accelerated scan may include one or more of compressed sensing; parallel imaging; or fast spin echo techniques to allow for acquisition in less time of a reduced amount of data than required to support a higher resolution or larger field of view.
- the selected imaging protocol may include one or more of obtaining anatomic images of the heart, determining cardiac function, or determining myocardial viability.
- the disclosed embodiments are further directed to a system including an MRI scanner, and a processing engine coupled to the MRI scanner, the processing engine comprising a processor and a memory comprising computer readable program code, wherein the processor under control of the computer readable program code is operable to acquire initial scout images of a patient's heart, use a neural network to establish a patient specific heart model, and automatically plan imaging planes of the patient specific heart model, perform an accelerated scan of the patient's heart, use the neural network to determine a current location and pose of the patient's heart from the accelerated scan, and to reposition the imaging planes to correspond to the current location and pose of the patient's heart, and cause the MRI scanner to use the repositioned imaging planes to perform an acquisition scan and generate an image of the patient's heart from the acquisition scan according to a selected imaging protocol.
- FIG. 1 illustrates a conventional scanning workflow, where obtaining target heart views is performed through a multi-step approach including multiple scans and manual repositioning of planned slices.
- FIG. 2 illustrates an exemplary MRI apparatus according to aspects of the disclosed embodiments
- FIG. 3 illustrates an exemplary architecture of a processing engine according to the disclosed embodiments
- FIG. 4 illustrates an exemplary process flow according to aspects of the disclosed embodiments
- FIGS. 5A-5C schematically illustrate usage of a patient specific heart model according to aspects of the disclosed embodiments.
- FIG. 6 depicts an exemplary simple neural network that may be utilized to implement the disclosed embodiments.
- system means, “unit,” “module,” and/or “block” used herein are one method to distinguish different components, elements, parts, section or assembly of different level in ascending order. However, the terms may be displaced by other expressions if they may achieve the same purpose.
- module refers to logic embodied in hardware or firmware, or to a collection of software instructions.
- a module, a unit, or a block described herein may be implemented as software and/or hardware and may be stored in any type of non-transitory computer-readable medium or another storage device.
- a software module/unit/block may be compiled and linked into an executable program. It will be appreciated that software modules can be callable from other modules/units/blocks or from themselves, and/or may be invoked in response to detected events or interrupts.
- Software modules/units/blocks configured for execution on computing devices may be provided on a computer-readable medium, such as a compact disc, a digital video disc, a flash drive, a magnetic disc, or any other tangible medium, or as a digital download (and can be originally stored in a compressed or installable format that needs installation, decompression, or decryption prior to execution).
- a computer-readable medium such as a compact disc, a digital video disc, a flash drive, a magnetic disc, or any other tangible medium, or as a digital download (and can be originally stored in a compressed or installable format that needs installation, decompression, or decryption prior to execution).
- Such software code may be stored, partially or fully, on a storage device of the executing computing device, for execution by the computing device.
- Software instructions may be embedded in firmware, such as an Erasable Programmable Read Only Memory (EPROM).
- EPROM Erasable Programmable Read Only Memory
- modules/units/blocks may be included in connected logic components, such as gates and flip-flops, and/or can be included of programmable units, such as programmable gate arrays or processors.
- the modules/units/blocks or computing device functionality described herein may be implemented as software modules/units/blocks, but may be represented in hardware or firmware.
- the modules/units/blocks described herein refer to logical modules/units/blocks that may be combined with other modules/units/blocks or divided into sub-modules/sub-units/sub-blocks despite their physical organization or storage. The description may be applicable to a system, an engine, or a portion thereof.
- FIG. 2 shows a schematic block diagram of an exemplary MRI apparatus 202 for providing MRI data according to the disclosed embodiments.
- the MRI apparatus 202 may include an MRI scanner 204 , receive and control circuitry 206 and a display 208 .
- the MRI scanner 204 may include, as shown in cross section in FIG. 2 , a magnetic field generator 210 , a gradient magnetic field generator 212 , and a Radio Frequency (RF) generator 214 , all surrounding a table 216 on which subjects under study may be positioned.
- RF Radio Frequency
- the MRI scanner 204 may also include an ECG signal sensor 218 for capturing MRI data in the form of ECG signals from the subject under study during MRI scanning, a camera 220 for capturing MRI data in the form of video images of the subject under study during MRI scanning, and a pulse detector 222 , for capturing MRI data in the form of a subject's pulse during MRI scanning.
- the MRI scanner 204 may perform a scan on a subject or a region of the subject.
- the subject may be, for example, a human body or other animal body.
- the subject may be a patient.
- the region of the subject may include part of the subject.
- the region of the subject may include a tissue of the patient.
- the tissue may include, for example, lung, prostate, breast, colon, rectum, bladder, ovary, skin, liver, spine, bone, pancreas, cervix, lymph, thyroid, spleen, adrenal gland, salivary gland, sebaceous gland, testis, thymus gland, penis, uterus, trachea, skeletal muscle, smooth muscle, heart, etc.
- the scan may be a pre-scan for calibrating an imaging scan.
- the scan may be an imaging scan for generating an image.
- the main magnetic field generator 210 may create a static magnetic field B 0 and may include, for example, a permanent magnet, a superconducting electromagnet, a resistive electromagnet, or any magnetic field generation device suitable for generating a static magnetic field.
- the gradient magnet field generator 212 may use coils to generate a magnetic field in the same direction as B 0 but with a gradient in one or more directions, for example, along X, Y, or Z axes in a coordinate system of the MRI scanner 204 .
- the RF generator 214 may use RF coils to transmit RF energy through the subject, or region of interest of the subject, to induce electrical signals in the region of interest.
- the resulting RF field is typically referred to as the B 1 field and combines with the B 0 field to generate MR signals that are spatially localized and encoded by the gradient magnetic field.
- the MRI scanner 204 may further include an RF detector 224 implemented using, for example, an RF coil, where the RF detector operates to sense the RF field and convey a corresponding output to the receive and control circuitry 206 .
- the RF detector may also include one or more coil arrays for parallel imaging.
- the function, size, type, geometry, position, amount, or magnitude of the MRI scanner 204 may be determined or changed according to one or more specific conditions.
- the MRI scanner 204 may be designed to surround a subject (or a region of the subject) to form a tunnel type MRI scanner, referred to as a closed bore MRI scanner, or an open MRI scanner, referred to as an open-bore MRI scanner.
- the MRI scanner may be portable and transportable down hallways and through doorways to a patient, providing MR scanning services to the patient as opposed to transporting the patient to the MRI scanner.
- a portable MRI scanner may be configured to scan a region of interest of a subject, for example, the subject's brain, spinal cord, limbs, heart, blood vessels, and internal organs.
- the ECG signal sensor 218 may operate to capture ECG signals from the subject under study during MRI scanning for use in subsequently identifying cardiac cycles and cardiac phases of the subject.
- the camera 220 may operate to capture video images of the subject under study during MRI scanning for use in subsequently identifying cardiac cycles and cardiac phases of the subject.
- MRI scanning the subject may be requested to hold their breath and to stay still in order to provide accurate MRI cardiac data while scanning.
- video images of the subject may be used to compensate for subject movement or breathing patterns during scanning that may adversely affect the acquired MRI data.
- the pulse detector 222 may provide pulse data from the subject during MRI scanning which may also be used to enhance cardiac cycle and phase predictions.
- the receive and control circuitry 206 may control overall operations of the MRI scanner 204 , in particular, the magnetic field generator 210 , the gradient magnetic field generator 212 , the RF generator 214 , and the RF detector 224 .
- the receive and control circuitry 206 may control the magnet field gradient generator to produce gradient fields along one or more of the X, Y, and Z axes, and the RF generator to generate the RF field.
- the receive and control circuitry 206 may receive commands from, for example, a user or another system, and control the magnetic field generator 210 , the gradient magnetic field generator 212 , the RF generator 214 , and the RF detector 224 accordingly.
- the receive and control circuitry 206 may be connected to the MRI scanner 204 through a network 226 .
- the network 226 may include any suitable network that can facilitate the exchange of information and/or data for the MRI scanner 204 .
- the network 226 may include one or more of a public network (e.g., the Internet), a private network (e.g., a local area network (LAN), a wide area network (WAN)), etc.), a wired network (e.g., an Ethernet network), a wireless network (e.g., an 802.11 network, a Wi-Fi network, etc.), a cellular network (e.g., a Long Term Evolution (LTE) network), a frame relay network, a virtual private network (“VPN”), a satellite network, a telephone network, routers, hubs, switches, server computers, and/or any combination thereof.
- a public network e.g., the Internet
- a private network e.g., a local area network (LAN),
- the network 418 may include a cable network, a wireline network, a fiber-optic network, a telecommunications network, an intranet, a wireless local area network (WLAN), a metropolitan area network (MAN), a public telephone switched network (PSTN), a Bluetooth® network, a ZigBee® network, a near field communication (NFC) network, or the like, or any combination thereof.
- the network 226 may include one or more network access points.
- the network 226 may include wired and/or wireless network access points such as base stations and/or internet exchange points through which one or more components of the MRI scanner 204 may be connected with the network 226 to exchange data and/or information.
- the receive and control circuitry 206 may operate the MRI scanner 204 to perform operations according to the disclosed embodiments, including automatically estimating a pose of the heart; automatically providing imaging slice planning; performing a highly accelerated scout scan between acquisition scans, and automatically adjusting the image slices to maintain consistency of planned slice locations for each acquisition in spite of movement which may arise as a result of heart movement, breathing, patient movement, or other factors that cause changes in heart position between acquisition scans.
- the receive and control circuitry 206 may include a processing engine 300 for operating the MRI scanner 204 to perform the operations and workflows according to the disclosed embodiments.
- FIG. 3 illustrates an example implementation of the processing engine 300 according to the disclosed embodiments.
- the processing engine 300 may include computer readable program code stored on at least one computer readable medium 302 for carrying out and executing the process steps described herein.
- the computer readable program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB. NET, Python or the like, conventional procedural programming languages, such as the “C” programming language, Visual Basic, Fortran 2103 , Perl, COBOL 2102 , PHP, ABAP, dynamic programming languages such as Python, Ruby, and Groovy, or other programming languages.
- object-oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB. NET
- Python or the like
- conventional procedural programming languages such as the “C” programming language, Visual Basic, Fortran 2
- the computer readable program code may execute entirely on the processing engine 300 , partly on the processing engine 300 , as a stand-alone software package, partly on the processing engine 300 and partly on a remote computer or server or entirely on the remote computer or server.
- the remote computer may be connected to the processing engine 300 through any type of network, including those mentioned above with respect to network 226 .
- the computer readable medium 302 may be a memory of the processing engine 300 .
- the computer readable program code may be stored in a memory external to, or remote from, the processing engine 300 .
- the memory may include magnetic media, semiconductor media, optical media, or any media which is readable and executable by a computer.
- the processing engine 300 may also include a computer processor 304 for executing the computer readable program code stored on the at least one computer readable medium 302 .
- the processing engine 300 may include one or more input or output devices, generally referred to as a user interface 306 which may operate to allow input to the processing engine 306 or to provide output from the processing engine 300 , respectively.
- the processing engine 300 may be implemented in hardware, software or a combination of hardware and software. According to one or more embodiments, the processing engine 300 may be part of the receive and control circuitry 206 , while in other embodiments the processing engine 300 may be located remotely from the receive and control circuitry 206 .
- FIG. 4 shows an exemplary work flow that may be implemented using the exemplary MRI apparatus 202 .
- initial scout images may be acquired before performing subsequent scans.
- the scout images may be 2D multi-slice images from all three standard body views (axial, sagittal and coronal) at a low spatial resolution.
- the scout images may also be low resolution true 3D image volumes.
- the location, pose, shape, and other aspects of a patient's heart may be estimated using a neural network, an example of which is illustrated as item 600 in FIG. 6 .
- the neural network 600 may utilize the aspects the heart to establish a patient specific heart model, as schematically illustrated in FIG. 5A .
- the neural network 600 may be used to estimate standard heart views according to clinical standards from the patient specific heart model, including the short axis view, horizontal long axis view, and vertical long axis view.
- the estimated standard heart views may optionally be updated and refined by one or more MR technicians and the updates and refinements may be used to update the patient specific heart model.
- the standard heart views may be used to automatically plan imaging planes, as schematically illustrated in FIG. 5B .
- Blocks 414 and 416 represent operations that may be referred to as an Artificial Intelligence (AI) scout scan.
- AI Artificial Intelligence
- an accelerated scan for example, one or more of a multi-slice, multi-view, 2D or 3D, scan may be performed to acquire cardiac positioning data to determine the location of the heart before the next acquisition scan.
- the accelerated scan techniques may include using compressed sensing where data is undersampled in the K-space, parallel imaging where data is individually obtained from multiple receiver coils, and fast spin echo where multiple echoes are acquired during each sequence pulse to allow for acquisition in less time of a reduced amount of data than required to support a higher resolution or larger field of view.
- the neural network 600 may be used to reconstruct the highly accelerated data as shown in block 416 , and may be used to compare the heart location and pose to those of the patient specific heart model from the initial scouting, as shown in block 418 .
- the prescribed imaging planes may then be automatically adjusted to correspond to the heart location and pose, as illustrated in FIG. 5C , and used for an acquisition scan for a selected imaging protocol, as shown in block 422 .
- the AI scout scan 414 , 416 may be used to determine the location and pose of the heart immediately before the acquisition scan 422 and may be used to represent the location and pose of the heart for that particular acquisition scan.
- Cardiac MRI imaging protocols may be generally tailored to specific clinical indications, for example, anatomic images of the heart and great vessels, including axial, coronal, sagittal, long axis, and short axis views, and views of coronary arteries, and valves.
- Other cardiac MRI imaging protocols may be directed to cardiac function, for example, motion of the ventricular walls during systole and diastole, turbulence created by valvular stenosis, and cine studies obtained by repeatedly imaging the heart at a single slice location throughout the cardiac cycle.
- Still other cardiac MRI imaging protocols may be directed to myocardial viability, utilizing for example, segmented, T1-weighted, inversion-prepared fast gradient echo sequences.
- AI scout scan 414 reconstruction of AI scout scan data 416 , comparison of the heart location and pose 418 , automatic repositioning 420 , and acquisition scan 422 , are described in the context of being performed by a single neural network 600 , it should be understood that the scan 414 , reconstruction 416 , comparison 418 , automatic repositioning 420 , and acquisition scan 422 , may be performed individually by different neural networks or performed in groups by different neural networks.
- utilizing the neural network 600 advantageously ensures reconstruction quality and reduces the time required for establishing the patient specific heart model, planning and repositioning the image planes, computing the reconstructions, and repositioning the image planes.
- the neural network may utilize this information to automatically plan the imaging planes, instead of having a technician manually plan the imaging planes.
- a technician is no longer required to perform additional scans to relocate the heart position, pose, and short and long axes, because the position, pose, and short and long axes are defined by the patient specific heart model.
- the desired slice location relative to the structure of the heart as defined during the initial scouting may be maintained regardless of changes in the heart location and pose throughout the imaging protocol scans.
- use of the neural network 600 enables completion of the AI scout scan and in particular, reconstruction of the accelerated data, in significantly less time than technician controlled rescans, reducing the time required for the patient to stop breathing or remain immobile, or both. It should also be noted that while the disclosed embodiments are described in the context of utilizing a neural network, other computational methods that meet the speed and accuracy requirements may also be utilized.
- FIG. 6 depicts an example of the neural network 600 that may be utilized to implement the disclosed embodiments. While a simple neural network is shown, it should be understood that the disclosed embodiments may be implemented utilizing a deep learning method or deep learning model including one or more gated recurrent units (GRUs), long short term memory (LSTM) networks, fully convolutional neural network (FCN) models, generative adversarial networks (GANs), back propagation (BP) neural network models, radial basis function (RBF) neural network models, deep belief nets (DBN) neural network models, Elman neural network models, or any deep learning or machine learning model capable of performing the operations described herein.
- GRUs gated recurrent units
- LSTM fully convolutional neural network
- FCN fully convolutional neural network
- GANs generative adversarial networks
- BP back propagation
- RBF radial basis function
- DNN deep belief nets
- Techniques that train to learn or to select a particular neural network structure can be used to learn the hyperparameter of the neural network 600 for optimal performance.
- a reinforcement learning framework can be a searching neural network that can act on the tested neural network by changing the hyperparameters and observing the resulting performance.
- the searching network can continuously perform trials of acting and observing, and accumulate experiences through the trials.
- the target of the searching network is to maximize some reward, which can be defined as achieving better performance.
- the searching network will eventually reach an optimal performance point, at which the operations of the searching network may be terminated.
Landscapes
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Radiology & Medical Imaging (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Evolutionary Computation (AREA)
- Mathematical Physics (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- High Energy & Nuclear Physics (AREA)
- Pathology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Vascular Medicine (AREA)
- Fuzzy Systems (AREA)
- Physiology (AREA)
- Psychiatry (AREA)
- Cardiology (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
Abstract
Description
- This application claims the benefit of U.S. Provisional Application No. 62/941,904, filed 29 Nov. 2019, which is incorporated by reference herein in its entirety.
- The aspects of the present disclosure relate generally to Magnetic Resonance Imaging (MRI), and in particular to predicting cardiac signals from MRI data. MRI is a widely used medical technique which produces images of a region of interest using magnetic and radio frequency energy. During an MRI scan, volume coils (for example, body coils) and local coils (for example, surface coils) may acquire MR signals produced by nuclear relaxation inside the object being examined. Cardiac MR imaging is widely regarded as one of the most complex examinations utilizing magnetic resonance due to the patient's respiratory and cardiac motions. In a conventional scanning workflow, obtaining target heart views is typically performed through a
multi-step approach 100 as illustrated inFIG. 1 . As shown inblock 102, scout images and multi-slice localizer images, typically in the form of a set of three plane, low resolution, large field of view images, may be initially acquired to determine an approximate location of the heart in the patient's body, including the standard heart views: the short axis view corresponding to the echocardiographic parasternal short axis plane; the horizontal long axis view corresponding to the echocardiographic apical 4-chamber plane; and the vertical long axis view corresponding to the echocardiographic apical 2-chamber plane. The localizer images may be used to manually plan slices through the standard heart views, as shown inblock 104. - The image plane planning of the subsequently performed cardiac MR acquisition scans, for example, cine or functional scans, relies on the views determined above, and the planning is generally accomplished by performing an acquisition scan, as shown in
block 106, and referring or copying the slice locations from the pre-determined standard heart views to the acquisition scan, as shown inblock 108. However, patient motion and inconsistency of breath-holding positions in between scans may introduce mis-registrations of the slices from scan to scan, and may introduce difficulties in interpreting the images. In order to overcome the mis-registration, an additional acquisition scan may be performed, as shown inblock 110, and a technician may reposition the slices manually, as shown inblock 112, and an acquisition scan for the selected imaging protocol may be performed as shown inblock 114. Severe mis-registration may even require patient repositioning, additional repeated scans, or additional post-processing to register the images, any one of which may add additional cost in the form of additional labor, time, computation, etc. to the MR scanning processes. - Navigation techniques have been used to monitor respiratory motion of objects being imaged, however, most navigation techniques aim at compensating for the respiratory motion by using a brief MR scan limited to the patient's diaphragm between k-space lines. Thus, the technique may compensate for motion within one data acquisition but cannot address patient motion between multiple data acquisitions. Furthermore, the navigation signal is usually a beam perpendicular to the diaphragm which has a one dimensional limited view and description of the motion of the diaphragm, which may lead to an erroneous respiratory motion estimation.
- As a result, image quality and usability for diagnosis depends on additional scans between acquisition scans for the selected imaging protocol and on an operators' skills and experience in relocating the slices between scans. This represents one of the major barriers to cardiac MRI being widely applied in clinical procedures.
- It would be advantageous to provide a method and system that may automatically acquire and adjust planned image planes to compensate for changes in a pose of a heart throughout an entire scanning process without manual intervention.
- According to the present disclosure, the method and system may exploit artificial intelligence, for example, a neural network, to: automatically estimate a pose of the heart; automatically provide imaging slice planning; reconstruct highly accelerated inter-acquisition scout imaging; and monitor and follow patient motion to maintain consistency of planned slice locations for each acquisition. This may advantageously allow for a more automatic and efficient scanning workflow for cardiac MRI and facilitate implementation in most clinical settings for cardiac diagnosis.
- The disclosed embodiments are directed to a method including acquiring initial scout images of a patient's heart, using a neural network to establish a patient specific heart model, and automatically plan imaging planes of the patient specific heart model, performing an accelerated scan of the patient's heart, using the neural network to determine a current location and pose of the patient's heart from the accelerated scan, and to reposition the imaging planes to correspond to the current location and pose of the patient's heart, and using the repositioned imaging planes to perform an acquisition scan and generate an image of the patient's heart from the acquisition scan according to a selected imaging protocol.
- The method may include acquiring the initial scout images from standard MRI body views.
- The initial scout images may include 2D or 3D multi-slice images from one or more of axial sagittal and coronal views.
- Using the neural network to determine a current location and pose of the patient's heart from the accelerated scan may include reconstructing an image from the accelerated scan and comparing the reconstructed image from the accelerated scan to the patient specific heart model.
- The method may include comparing the current location and pose of the patient's heart to the location and pose of the patient specific heart model, and repositioning the imaging planes obtained from the patient specific heart model to correspond to the current location and pose of the patient's heart.
- The neural network may include one or more of a combination of CNN and RNN models, a GRU model, an LSTM model, a fully convolutional neural network model, a generative adversarial network, a back propagation neural network model, a radial basis function neural network model, a deep belief nets neural network model, an Elman neural network model.
- The accelerated scan may include one or more of compressed sensing; parallel imaging; or fast spin echo techniques to allow for acquisition in less time of a reduced amount of data than required to support a higher resolution or larger field of view.
- The selected imaging protocol may include one or more of obtaining anatomic images of the heart, determining cardiac function, or determining myocardial viability.
- The disclosed embodiments are further directed to a system including an MRI scanner, and a processing engine coupled to the MRI scanner, the processing engine comprising a processor and a memory comprising computer readable program code, wherein the processor under control of the computer readable program code is operable to acquire initial scout images of a patient's heart, use a neural network to establish a patient specific heart model, and automatically plan imaging planes of the patient specific heart model, perform an accelerated scan of the patient's heart, use the neural network to determine a current location and pose of the patient's heart from the accelerated scan, and to reposition the imaging planes to correspond to the current location and pose of the patient's heart, and cause the MRI scanner to use the repositioned imaging planes to perform an acquisition scan and generate an image of the patient's heart from the acquisition scan according to a selected imaging protocol.
- These and other aspects, implementation forms, and advantages of the exemplary embodiments will become apparent from the embodiments described herein considered in conjunction with the accompanying drawings. It is to be understood, however, that the description and drawings are designed solely for purposes of illustration and not as a definition of the limits of the disclosed invention, for which reference should be made to the appended claims. Additional aspects and advantages of the invention will be set forth in the description that follows, and in part will be obvious from the description, or may be learned by practice of the invention. Moreover, the aspects and advantages of the invention may be realized and obtained by means of the instrumentalities and combinations particularly pointed out in the appended claims.
- In the following detailed portion of the present disclosure, the invention will be explained in more detail with reference to the example embodiments shown in the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures throughout the several views of the drawings, wherein:
-
FIG. 1 illustrates a conventional scanning workflow, where obtaining target heart views is performed through a multi-step approach including multiple scans and manual repositioning of planned slices. -
FIG. 2 illustrates an exemplary MRI apparatus according to aspects of the disclosed embodiments; -
FIG. 3 illustrates an exemplary architecture of a processing engine according to the disclosed embodiments; -
FIG. 4 illustrates an exemplary process flow according to aspects of the disclosed embodiments; -
FIGS. 5A-5C schematically illustrate usage of a patient specific heart model according to aspects of the disclosed embodiments; and -
FIG. 6 depicts an exemplary simple neural network that may be utilized to implement the disclosed embodiments. - In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant disclosure. However, it should be apparent to those skilled in the art that the present disclosure may be practiced without such details. In other instances, well known methods, procedures, systems, components, and/or circuitry have been described at a relatively high-level, without detail, in order to avoid unnecessarily obscuring aspects of the present disclosure. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirits and scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments shown, but to be accorded the widest scope consistent with the claims.
- It will be understood that the term “system,” “unit,” “module,” and/or “block” used herein are one method to distinguish different components, elements, parts, section or assembly of different level in ascending order. However, the terms may be displaced by other expressions if they may achieve the same purpose.
- It will be understood that when a unit, module or block is referred to as being “on,” “connected to” or “coupled to” another unit, module, or block, it may be directly on, connected or coupled to the other unit, module, or block, or intervening unit, module, or block may be present, unless the context clearly indicates otherwise. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
- Generally, the word “module,” “unit,” or “block,” as used herein, refers to logic embodied in hardware or firmware, or to a collection of software instructions. A module, a unit, or a block described herein may be implemented as software and/or hardware and may be stored in any type of non-transitory computer-readable medium or another storage device. In some embodiments, a software module/unit/block may be compiled and linked into an executable program. It will be appreciated that software modules can be callable from other modules/units/blocks or from themselves, and/or may be invoked in response to detected events or interrupts. Software modules/units/blocks configured for execution on computing devices may be provided on a computer-readable medium, such as a compact disc, a digital video disc, a flash drive, a magnetic disc, or any other tangible medium, or as a digital download (and can be originally stored in a compressed or installable format that needs installation, decompression, or decryption prior to execution). Such software code may be stored, partially or fully, on a storage device of the executing computing device, for execution by the computing device. Software instructions may be embedded in firmware, such as an Erasable Programmable Read Only Memory (EPROM). It will be further appreciated that hardware modules/units/blocks may be included in connected logic components, such as gates and flip-flops, and/or can be included of programmable units, such as programmable gate arrays or processors. The modules/units/blocks or computing device functionality described herein may be implemented as software modules/units/blocks, but may be represented in hardware or firmware. In general, the modules/units/blocks described herein refer to logical modules/units/blocks that may be combined with other modules/units/blocks or divided into sub-modules/sub-units/sub-blocks despite their physical organization or storage. The description may be applicable to a system, an engine, or a portion thereof.
- The terminology used herein is for the purposes of describing particular examples and embodiments only, and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “include,” and/or “comprise,” when used in this disclosure, specify the presence of integers, devices, behaviors, stated features, steps, elements, operations, and/or components, but do not exclude the presence or addition of one or more other integers, devices, behaviors, features, steps, elements, operations, components, and/or groups thereof.
- These and other features, and characteristics of the present disclosure, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, may become more apparent upon consideration of the following description with reference to the accompanying drawings, all of which form a part of this disclosure. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended to limit the scope of the present disclosure. It is understood that the drawings are not to scale.
-
FIG. 2 shows a schematic block diagram of anexemplary MRI apparatus 202 for providing MRI data according to the disclosed embodiments. TheMRI apparatus 202 may include anMRI scanner 204, receive andcontrol circuitry 206 and adisplay 208. TheMRI scanner 204 may include, as shown in cross section inFIG. 2 , amagnetic field generator 210, a gradientmagnetic field generator 212, and a Radio Frequency (RF)generator 214, all surrounding a table 216 on which subjects under study may be positioned. TheMRI scanner 204 may also include anECG signal sensor 218 for capturing MRI data in the form of ECG signals from the subject under study during MRI scanning, acamera 220 for capturing MRI data in the form of video images of the subject under study during MRI scanning, and apulse detector 222, for capturing MRI data in the form of a subject's pulse during MRI scanning. In some embodiments, theMRI scanner 204 may perform a scan on a subject or a region of the subject. The subject may be, for example, a human body or other animal body. For example, the subject may be a patient. The region of the subject may include part of the subject. For example, the region of the subject may include a tissue of the patient. The tissue may include, for example, lung, prostate, breast, colon, rectum, bladder, ovary, skin, liver, spine, bone, pancreas, cervix, lymph, thyroid, spleen, adrenal gland, salivary gland, sebaceous gland, testis, thymus gland, penis, uterus, trachea, skeletal muscle, smooth muscle, heart, etc. In some embodiments, the scan may be a pre-scan for calibrating an imaging scan. In some embodiments, the scan may be an imaging scan for generating an image. - The main
magnetic field generator 210 may create a static magnetic field B0 and may include, for example, a permanent magnet, a superconducting electromagnet, a resistive electromagnet, or any magnetic field generation device suitable for generating a static magnetic field. The gradientmagnet field generator 212 may use coils to generate a magnetic field in the same direction as B0 but with a gradient in one or more directions, for example, along X, Y, or Z axes in a coordinate system of theMRI scanner 204. - In some embodiments, the
RF generator 214 may use RF coils to transmit RF energy through the subject, or region of interest of the subject, to induce electrical signals in the region of interest. The resulting RF field is typically referred to as the B1 field and combines with the B0 field to generate MR signals that are spatially localized and encoded by the gradient magnetic field. TheMRI scanner 204 may further include anRF detector 224 implemented using, for example, an RF coil, where the RF detector operates to sense the RF field and convey a corresponding output to the receive andcontrol circuitry 206. The RF detector may also include one or more coil arrays for parallel imaging. The function, size, type, geometry, position, amount, or magnitude of theMRI scanner 204 may be determined or changed according to one or more specific conditions. For example, theMRI scanner 204 may be designed to surround a subject (or a region of the subject) to form a tunnel type MRI scanner, referred to as a closed bore MRI scanner, or an open MRI scanner, referred to as an open-bore MRI scanner. As another example, the MRI scanner may be portable and transportable down hallways and through doorways to a patient, providing MR scanning services to the patient as opposed to transporting the patient to the MRI scanner. In some examples, a portable MRI scanner may be configured to scan a region of interest of a subject, for example, the subject's brain, spinal cord, limbs, heart, blood vessels, and internal organs. - The
ECG signal sensor 218 may operate to capture ECG signals from the subject under study during MRI scanning for use in subsequently identifying cardiac cycles and cardiac phases of the subject. Thecamera 220 may operate to capture video images of the subject under study during MRI scanning for use in subsequently identifying cardiac cycles and cardiac phases of the subject. During MRI scanning the subject may be requested to hold their breath and to stay still in order to provide accurate MRI cardiac data while scanning. However, this may be difficult for any number of reasons, and video images of the subject may be used to compensate for subject movement or breathing patterns during scanning that may adversely affect the acquired MRI data. Thepulse detector 222 may provide pulse data from the subject during MRI scanning which may also be used to enhance cardiac cycle and phase predictions. - The receive and
control circuitry 206 may control overall operations of theMRI scanner 204, in particular, themagnetic field generator 210, the gradientmagnetic field generator 212, theRF generator 214, and theRF detector 224. For example, the receive andcontrol circuitry 206 may control the magnet field gradient generator to produce gradient fields along one or more of the X, Y, and Z axes, and the RF generator to generate the RF field. In some embodiments, the receive andcontrol circuitry 206 may receive commands from, for example, a user or another system, and control themagnetic field generator 210, the gradientmagnetic field generator 212, theRF generator 214, and theRF detector 224 accordingly. The receive andcontrol circuitry 206 may be connected to theMRI scanner 204 through anetwork 226. Thenetwork 226 may include any suitable network that can facilitate the exchange of information and/or data for theMRI scanner 204. Thenetwork 226 may include one or more of a public network (e.g., the Internet), a private network (e.g., a local area network (LAN), a wide area network (WAN)), etc.), a wired network (e.g., an Ethernet network), a wireless network (e.g., an 802.11 network, a Wi-Fi network, etc.), a cellular network (e.g., a Long Term Evolution (LTE) network), a frame relay network, a virtual private network (“VPN”), a satellite network, a telephone network, routers, hubs, switches, server computers, and/or any combination thereof. Merely by way of example, thenetwork 418 may include a cable network, a wireline network, a fiber-optic network, a telecommunications network, an intranet, a wireless local area network (WLAN), a metropolitan area network (MAN), a public telephone switched network (PSTN), a Bluetooth® network, a ZigBee® network, a near field communication (NFC) network, or the like, or any combination thereof. In some embodiments, thenetwork 226 may include one or more network access points. For example, thenetwork 226 may include wired and/or wireless network access points such as base stations and/or internet exchange points through which one or more components of theMRI scanner 204 may be connected with thenetwork 226 to exchange data and/or information. - According to some embodiments, the receive and
control circuitry 206 may operate theMRI scanner 204 to perform operations according to the disclosed embodiments, including automatically estimating a pose of the heart; automatically providing imaging slice planning; performing a highly accelerated scout scan between acquisition scans, and automatically adjusting the image slices to maintain consistency of planned slice locations for each acquisition in spite of movement which may arise as a result of heart movement, breathing, patient movement, or other factors that cause changes in heart position between acquisition scans. The receive andcontrol circuitry 206 may include aprocessing engine 300 for operating theMRI scanner 204 to perform the operations and workflows according to the disclosed embodiments. -
FIG. 3 illustrates an example implementation of theprocessing engine 300 according to the disclosed embodiments. Theprocessing engine 300 may include computer readable program code stored on at least one computerreadable medium 302 for carrying out and executing the process steps described herein. The computer readable program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB. NET, Python or the like, conventional procedural programming languages, such as the “C” programming language, Visual Basic, Fortran 2103, Perl, COBOL 2102, PHP, ABAP, dynamic programming languages such as Python, Ruby, and Groovy, or other programming languages. The computer readable program code may execute entirely on theprocessing engine 300, partly on theprocessing engine 300, as a stand-alone software package, partly on theprocessing engine 300 and partly on a remote computer or server or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to theprocessing engine 300 through any type of network, including those mentioned above with respect tonetwork 226. - The computer
readable medium 302 may be a memory of theprocessing engine 300. In alternate aspects, the computer readable program code may be stored in a memory external to, or remote from, theprocessing engine 300. The memory may include magnetic media, semiconductor media, optical media, or any media which is readable and executable by a computer. Theprocessing engine 300 may also include acomputer processor 304 for executing the computer readable program code stored on the at least one computerreadable medium 302. In at least one aspect, theprocessing engine 300 may include one or more input or output devices, generally referred to as auser interface 306 which may operate to allow input to theprocessing engine 306 or to provide output from theprocessing engine 300, respectively. Theprocessing engine 300 may be implemented in hardware, software or a combination of hardware and software. According to one or more embodiments, theprocessing engine 300 may be part of the receive andcontrol circuitry 206, while in other embodiments theprocessing engine 300 may be located remotely from the receive andcontrol circuitry 206. -
FIG. 4 shows an exemplary work flow that may be implemented using theexemplary MRI apparatus 202. As shown inblock 402, initial scout images may be acquired before performing subsequent scans. The scout images may be 2D multi-slice images from all three standard body views (axial, sagittal and coronal) at a low spatial resolution. The scout images may also be low resolution true 3D image volumes. As shown inblock 404, from the scout images, the location, pose, shape, and other aspects of a patient's heart may be estimated using a neural network, an example of which is illustrated asitem 600 inFIG. 6 . Referring to block 406, theneural network 600 may utilize the aspects the heart to establish a patient specific heart model, as schematically illustrated inFIG. 5A . Referring to block 408, theneural network 600 may be used to estimate standard heart views according to clinical standards from the patient specific heart model, including the short axis view, horizontal long axis view, and vertical long axis view. Referring to block 410, the estimated standard heart views may optionally be updated and refined by one or more MR technicians and the updates and refinements may be used to update the patient specific heart model. Referring to block 412, the standard heart views may be used to automatically plan imaging planes, as schematically illustrated inFIG. 5B .Blocks block 414, an accelerated scan, for example, one or more of a multi-slice, multi-view, 2D or 3D, scan may be performed to acquire cardiac positioning data to determine the location of the heart before the next acquisition scan. The accelerated scan techniques may include using compressed sensing where data is undersampled in the K-space, parallel imaging where data is individually obtained from multiple receiver coils, and fast spin echo where multiple echoes are acquired during each sequence pulse to allow for acquisition in less time of a reduced amount of data than required to support a higher resolution or larger field of view. - The
neural network 600 may be used to reconstruct the highly accelerated data as shown inblock 416, and may be used to compare the heart location and pose to those of the patient specific heart model from the initial scouting, as shown inblock 418. Referring to block 420, the prescribed imaging planes may then be automatically adjusted to correspond to the heart location and pose, as illustrated inFIG. 5C , and used for an acquisition scan for a selected imaging protocol, as shown inblock 422. Thus, theAI scout scan acquisition scan 422 and may be used to represent the location and pose of the heart for that particular acquisition scan. - Cardiac MRI imaging protocols may be generally tailored to specific clinical indications, for example, anatomic images of the heart and great vessels, including axial, coronal, sagittal, long axis, and short axis views, and views of coronary arteries, and valves. Other cardiac MRI imaging protocols may be directed to cardiac function, for example, motion of the ventricular walls during systole and diastole, turbulence created by valvular stenosis, and cine studies obtained by repeatedly imaging the heart at a single slice location throughout the cardiac cycle. Still other cardiac MRI imaging protocols may be directed to myocardial viability, utilizing for example, segmented, T1-weighted, inversion-prepared fast gradient echo sequences.
- While the
AI scout scan 414, reconstruction of AIscout scan data 416, comparison of the heart location and pose 418,automatic repositioning 420, and acquisition scan 422, are described in the context of being performed by a singleneural network 600, it should be understood that thescan 414,reconstruction 416,comparison 418,automatic repositioning 420, and acquisition scan 422, may be performed individually by different neural networks or performed in groups by different neural networks. - It should be noted that utilizing the
neural network 600 advantageously ensures reconstruction quality and reduces the time required for establishing the patient specific heart model, planning and repositioning the image planes, computing the reconstructions, and repositioning the image planes. For example, because the position, pose, and short and long axes are defined by the patient specific heart model, the neural network may utilize this information to automatically plan the imaging planes, instead of having a technician manually plan the imaging planes. Furthermore, because the disclosed embodiments establish a patient specific heart model, a technician is no longer required to perform additional scans to relocate the heart position, pose, and short and long axes, because the position, pose, and short and long axes are defined by the patient specific heart model. Thus, the desired slice location relative to the structure of the heart as defined during the initial scouting may be maintained regardless of changes in the heart location and pose throughout the imaging protocol scans. Still further, use of theneural network 600 enables completion of the AI scout scan and in particular, reconstruction of the accelerated data, in significantly less time than technician controlled rescans, reducing the time required for the patient to stop breathing or remain immobile, or both. It should also be noted that while the disclosed embodiments are described in the context of utilizing a neural network, other computational methods that meet the speed and accuracy requirements may also be utilized. -
FIG. 6 depicts an example of theneural network 600 that may be utilized to implement the disclosed embodiments. While a simple neural network is shown, it should be understood that the disclosed embodiments may be implemented utilizing a deep learning method or deep learning model including one or more gated recurrent units (GRUs), long short term memory (LSTM) networks, fully convolutional neural network (FCN) models, generative adversarial networks (GANs), back propagation (BP) neural network models, radial basis function (RBF) neural network models, deep belief nets (DBN) neural network models, Elman neural network models, or any deep learning or machine learning model capable of performing the operations described herein. - Techniques that train to learn or to select a particular neural network structure can be used to learn the hyperparameter of the
neural network 600 for optimal performance. One example following a reinforcement learning framework can be a searching neural network that can act on the tested neural network by changing the hyperparameters and observing the resulting performance. The searching network can continuously perform trials of acting and observing, and accumulate experiences through the trials. The target of the searching network is to maximize some reward, which can be defined as achieving better performance. The searching network will eventually reach an optimal performance point, at which the operations of the searching network may be terminated. - Thus, while there have been shown, described and pointed out, fundamental novel features of the invention as applied to the exemplary embodiments thereof, it will be understood that various omissions, substitutions and changes in the form and details of devices and methods illustrated, and in their operation, may be made by those skilled in the art without departing from the spirit and scope of the presently disclosed invention. Further, it is expressly intended that all combinations of those elements, which perform substantially the same function in substantially the same way to achieve the same results, are within the scope of the invention. Moreover, it should be recognized that structures and/or elements shown and/or described in connection with any disclosed form or embodiment of the invention may be incorporated in any other disclosed or described or suggested form or embodiment as a general matter of design choice. It is the intention, therefore, to be limited only as indicated by the scope of the claims appended hereto.
Claims (16)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/060,860 US20210161422A1 (en) | 2019-11-29 | 2020-10-01 | Automatic imaging plane planning and following for mri using artificial intelligence |
CN202011347028.4A CN112494030B (en) | 2019-11-29 | 2020-11-26 | Cardiac imaging system and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962941904P | 2019-11-29 | 2019-11-29 | |
US17/060,860 US20210161422A1 (en) | 2019-11-29 | 2020-10-01 | Automatic imaging plane planning and following for mri using artificial intelligence |
Publications (1)
Publication Number | Publication Date |
---|---|
US20210161422A1 true US20210161422A1 (en) | 2021-06-03 |
Family
ID=76091984
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/060,860 Abandoned US20210161422A1 (en) | 2019-11-29 | 2020-10-01 | Automatic imaging plane planning and following for mri using artificial intelligence |
US17/060,988 Active 2041-10-25 US11992289B2 (en) | 2019-11-29 | 2020-10-01 | Fast real-time cardiac cine MRI reconstruction with residual convolutional recurrent neural network |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/060,988 Active 2041-10-25 US11992289B2 (en) | 2019-11-29 | 2020-10-01 | Fast real-time cardiac cine MRI reconstruction with residual convolutional recurrent neural network |
Country Status (1)
Country | Link |
---|---|
US (2) | US20210161422A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11982725B2 (en) * | 2021-04-30 | 2024-05-14 | Regents Of The University Of Minnesota | Parallel transmission magnetic resonance imaging with a single transmission channel RF coil using deep learning |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7375521B1 (en) * | 2002-04-19 | 2008-05-20 | Fonar Corporation | Positional magnetic resonance imaging |
US8036730B1 (en) * | 2002-04-19 | 2011-10-11 | Fonar Corporation | Temporal magnetic resonance imaging |
US8948484B2 (en) * | 2010-11-11 | 2015-02-03 | Siemens Corporation | Method and system for automatic view planning for cardiac magnetic resonance imaging acquisition |
US20180035892A1 (en) * | 2016-08-05 | 2018-02-08 | Siemens Healthcare Gmbh | Deep learning based isocenter positioning and fully automated cardiac mr exam planning |
US20200037962A1 (en) * | 2018-08-01 | 2020-02-06 | General Electric Company | Plane selection using localizer images |
US20200041596A1 (en) * | 2018-08-01 | 2020-02-06 | General Electric Company | Systems and methods for automated graphical prescription with deep neural networks |
US20210080531A1 (en) * | 2019-09-17 | 2021-03-18 | GE Precision Healthcare LLC | Systems and methods for generating localizer scan settings from calibration images |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7309984B2 (en) | 2005-10-27 | 2007-12-18 | Wisconsin Alumni Research Foundation | Parallel magnetic resonance imaging method using a radial acquisition trajectory |
US9643019B2 (en) * | 2010-02-12 | 2017-05-09 | Cyberonics, Inc. | Neurological monitoring and alerts |
US20150374237A1 (en) * | 2013-01-31 | 2015-12-31 | The Regents Of The University Of California | Method for accurate and robust cardiac motion self-gating in magnetic resonance imaging |
US10521902B2 (en) * | 2015-10-14 | 2019-12-31 | The Regents Of The University Of California | Automated segmentation of organ chambers using deep learning methods from medical imaging |
US10497119B2 (en) * | 2016-05-20 | 2019-12-03 | Precision Image Analysis, Inc. | System and methods for post-cardiac MRI images |
WO2017223560A1 (en) * | 2016-06-24 | 2017-12-28 | Rensselaer Polytechnic Institute | Tomographic image reconstruction via machine learning |
WO2018173009A1 (en) * | 2017-03-24 | 2018-09-27 | Oxford University Innovation Limited | Methods for extracting subject motion from multi-transmit electrical coupling in imaging of the subject |
US11026636B2 (en) * | 2017-06-08 | 2021-06-08 | Siemens Healthcare Gmbh | Method for generating a medical data set of a moving body part |
EP3477324A1 (en) * | 2017-10-31 | 2019-05-01 | Pie Medical Imaging BV | Improving left ventricle segmentation in contrast-enhanced cine mri datasets |
US10629305B2 (en) * | 2017-11-09 | 2020-04-21 | General Electric Company | Methods and apparatus for self-learning clinical decision support |
US10573031B2 (en) | 2017-12-06 | 2020-02-25 | Siemens Healthcare Gmbh | Magnetic resonance image reconstruction with deep reinforcement learning |
US10489943B2 (en) * | 2018-02-28 | 2019-11-26 | General Electric Company | System and method for sparse image reconstruction |
US11681001B2 (en) * | 2018-03-09 | 2023-06-20 | The Board Of Trustees Of The Leland Stanford Junior University | Deep learning method for nonstationary image artifact correction |
US10782378B2 (en) | 2018-05-16 | 2020-09-22 | Siemens Healthcare Gmbh | Deep learning reconstruction of free breathing perfusion |
EP3861560A1 (en) * | 2018-10-05 | 2021-08-11 | Imperial College Of Science, Technology And Medicine | Method for detecting adverse cardiac events |
US11083913B2 (en) * | 2018-10-25 | 2021-08-10 | Elekta, Inc. | Machine learning approach to real-time patient motion monitoring |
US20220151500A1 (en) * | 2018-11-12 | 2022-05-19 | Northwestern University | Noninvasive quantitative flow mapping using a virtual catheter volume |
CN109993809B (en) | 2019-03-18 | 2023-04-07 | 杭州电子科技大学 | Rapid magnetic resonance imaging method based on residual U-net convolutional neural network |
US20220370033A1 (en) * | 2021-05-05 | 2022-11-24 | Board Of Trustees Of Southern Illinois University | Three-dimensional modeling and assessment of cardiac tissue |
-
2020
- 2020-10-01 US US17/060,860 patent/US20210161422A1/en not_active Abandoned
- 2020-10-01 US US17/060,988 patent/US11992289B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7375521B1 (en) * | 2002-04-19 | 2008-05-20 | Fonar Corporation | Positional magnetic resonance imaging |
US8036730B1 (en) * | 2002-04-19 | 2011-10-11 | Fonar Corporation | Temporal magnetic resonance imaging |
US8948484B2 (en) * | 2010-11-11 | 2015-02-03 | Siemens Corporation | Method and system for automatic view planning for cardiac magnetic resonance imaging acquisition |
US20180035892A1 (en) * | 2016-08-05 | 2018-02-08 | Siemens Healthcare Gmbh | Deep learning based isocenter positioning and fully automated cardiac mr exam planning |
US20200037962A1 (en) * | 2018-08-01 | 2020-02-06 | General Electric Company | Plane selection using localizer images |
US20200041596A1 (en) * | 2018-08-01 | 2020-02-06 | General Electric Company | Systems and methods for automated graphical prescription with deep neural networks |
US20210080531A1 (en) * | 2019-09-17 | 2021-03-18 | GE Precision Healthcare LLC | Systems and methods for generating localizer scan settings from calibration images |
Non-Patent Citations (1)
Title |
---|
Blansit et al., "Deep Learning–based Prescription of Cardiac MRI Planes," (27 November, 2019) Radiol Artif Intell. 2019 Nov; 1(6): e180069. (Year: 2019) * |
Also Published As
Publication number | Publication date |
---|---|
US11992289B2 (en) | 2024-05-28 |
US20210165064A1 (en) | 2021-06-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10198799B2 (en) | Method and apparatus for processing magnetic resonance image | |
JP7246864B2 (en) | Image processing device, magnetic resonance imaging device and image processing program | |
KR102028126B1 (en) | Magnetic resonance image apparatus and method of generating magnetic resonance image | |
US11506735B2 (en) | Systems and methods for magnetic resonance imaging | |
US11348230B2 (en) | Systems and methods for generating and tracking shapes of a target | |
US8781552B2 (en) | Localization of aorta and left atrium from magnetic resonance imaging | |
JP2010125329A (en) | System and method for automated scan planning using symmetry detection and image registration | |
KR101811720B1 (en) | Magnetic resonance imaging apparatus and scanning method for magnetic resonance image thereof | |
CN107865659A (en) | MR imaging apparatus and the method for obtaining MRI | |
EP3098619A2 (en) | Apparatus and method for three-dimensional parallel magnetic resonance imaging using non-uniform k-space sampling | |
CN111685766B (en) | Imaging system and method | |
CN113126013B (en) | Image processing system and method | |
CN113506271A (en) | Medical scanning data processing method and system | |
CN111012349B (en) | System and method for signal characterization determination in magnetic resonance imaging | |
US20210161422A1 (en) | Automatic imaging plane planning and following for mri using artificial intelligence | |
CN112494030B (en) | Cardiac imaging system and method | |
US20100130849A1 (en) | System and method for patient motion compensation during magnetic resonance scans | |
US20220328195A1 (en) | System and method for heart strain determination | |
KR20190117234A (en) | Apparatus and method for selecting imaging protocol of magnetic resonance imaging by using artificial neural network, and computer-readable recording medium storing related program | |
CN116548948A (en) | Systems and methods for magnetic resonance imaging | |
JP2024512439A (en) | Stepwise reconstruction of planning images for cardiac magnetic resonance imaging | |
US20220022817A1 (en) | Cardiac phase prediction in cardiac mri using deep learning | |
US20210330271A1 (en) | Medical imaging apparatus and medical imaging processing method | |
CN112285622A (en) | Nuclear magnetic resonance imaging control method and device and computer readable storage medium | |
CN112204616A (en) | Automated object monitoring for medical imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: UII AMERICA, INC., MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHEN, XIAO;SUN, SHANHUI;CHEN, ZHANG;AND OTHERS;SIGNING DATES FROM 20200929 TO 20200930;REEL/FRAME:053950/0699 Owner name: SHANGHAI UNITED IMAGING INTELLIGENCE CO., LTD., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:UII AMERICA, INC.;REEL/FRAME:053950/0973 Effective date: 20200930 |
|
AS | Assignment |
Owner name: UII AMERICA, INC., MASSACHUSETTS Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNMENT DOCUMENT PREVIOUSLY ATTACHED TO THE RECOR PREVIOUSLY RECORDED AT REEL: 053950 FRAME: 0699. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:CHEN, XIAO;SUN, SHANHUI;CHEN, ZHANG;AND OTHERS;SIGNING DATES FROM 20200929 TO 20200930;REEL/FRAME:054025/0783 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |