EP1913421B1 - Motion compensation in functional imaging - Google Patents
Motion compensation in functional imaging Download PDFInfo
- Publication number
- EP1913421B1 EP1913421B1 EP06780233A EP06780233A EP1913421B1 EP 1913421 B1 EP1913421 B1 EP 1913421B1 EP 06780233 A EP06780233 A EP 06780233A EP 06780233 A EP06780233 A EP 06780233A EP 1913421 B1 EP1913421 B1 EP 1913421B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- cardiac
- images
- respiratory
- phases
- heart
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/503—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of the heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/037—Emission tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5235—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/54—Control of apparatus or devices for radiation diagnosis
- A61B6/541—Control of apparatus or devices for radiation diagnosis involving acquisition triggered by a physiological signal
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T12/00—Tomographic reconstruction from projections
- G06T12/10—Image preprocessing, e.g. calibration, positioning of sources or scatter correction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
- A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb occurring during breathing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7271—Specific aspects of physiological measurement analysis
- A61B5/7285—Specific aspects of physiological measurement analysis for synchronizing or triggering a physiological measurement or image acquisition with a physiological event or waveform, e.g. an ECG signal
- A61B5/7289—Retrospective gating, i.e. associating measured signals or images with a physiological event after the actual measurement or image acquisition, e.g. by simultaneously recording an additional physiological signal during the measurement or image acquisition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/08—Clinical applications
- A61B8/0883—Clinical applications for diagnosis of the heart
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2211/00—Image generation
- G06T2211/40—Computed tomography
- G06T2211/412—Dynamic
Definitions
- the present invention relates to the digital imaging arts. It finds particular application in conjunction with Single Photon Emission Computed Tomography (SPECT) or Positron Emission Tomography (PET) imaging systems, and more specifically with combined SPECT/CT or PET/CT systems and will be described with particular reference thereto. It is, however, to be appreciated that the invention may also find application in the combination of SPECT, PET, or other nuclear imaging scans, and other modalities, such as CT, MRI, Ultrasound, and others.
- SPECT Single Photon Emission Computed Tomography
- PET Positron Emission Tomography
- EP 1 087 337 Aldiscloses a process for reconstructing a three-dimensional image of an object moving with a substantially cyclic motion, in which, for an acquisition duration extending over several cycles of the movement of the object, an acquisition of a plurality of initial digital radiographic images is performed using a snapshot apparatus rotating around the object.
- Initial images having the same temporal occurrence in the course of each cycle are selected respectively in successive cycles so as to form a group of images which is associated with this same temporal occurrence.
- Several different groups of initial images corresponding respectively to several different temporal occurrences are formed.
- An intermediate three-dimensional representation of the object is reconstructed on the basis of each group of initial images and of an iterative image reconstruction algorithm.
- a law of spatial deformation between two intermediate three-dimensional representations is formulated on the basis of the two intermediate three-dimensional representations corresponding to two successive temporal occurrences.
- a final three-dimensional representation of the object is reconstructed on the basis of the initial images successively acquired, the spatial deformation law and an iterative image reconstruction algorithm.
- GB 2 250 164 A discloses an x-ray computed tomography scanner for acquiring projection data from a series of views during a scan of a patient's chest. A movement of the patient's chest due to respiration is sensed by using, for instance, an ultrasonic range finder during the scan. This acquired motion data is employed along with a geometric model of chest motion to calculate factors which correct the acquired projection data. Finally, the corrected acquired projection data are back projected for generating an image having reduced motion artifacts.
- a subject In nuclear medicine, a subject is injected with a radiopharmaceutical that carries a radioisotope which decays, emitting gamma radiation.
- Nuclear cameras such as SPECT or PET scanners, detect the gamma radiation and reconstruct a diagnostic image illustrating a density of radioactive events in the subject.
- SPECT imaging a radioactive source emits high energy particles that pass through at least a portion of a subject in an imaging region and are collected at a detector array that is positioned adjacent the subject.
- the subject In order to receive enough radiation events to reconstruct a meaningful diagnostic image, the subject remains in the imaging region for an extended period of time, on the order of 10s of minutes or more.
- a CT scan can perform a complete scan of a limited region in less than a minute.
- the subject can move. Voluntary movements cause the internal anatomy of the subject to move also, and thus, shift positions in a diagnostic image.
- the scan time is far too long for a subject to hold their breath. Even shallow, controlled breathing will introduce periodic motion of the chest cavity. Continuous respiration during the SPECT acquisition leads to a periodic translation of the heart by several centimeters in the cranial-caudal direction. This leads to spatial blur of the reconstructed images and degrades the left ventricle volume estimation in both the individual heart phases and the perfusion image.
- Imaging many body regions may be difficult or may result in blurring due to body, respiratory, cardiac and other physiological rhythms.
- cardiac SPECT images of the heart are being gathered, and naturally, the heart is constantly moving.
- the beating heart periodically contracts, translates, rotates, and twists which displaces individual segments of the myocardium by several centimeters in a complicated and non-homogeneous fashion. This degrades the spatial resolution of the summed perfusion image.
- These three sources of motion all produce spatial variance in the position of the internal organs of the subject, and ultimately cause spatial blurring of a resultant SPECT image.
- these sources of motion will become increasingly problematic because they will negate the advantages gained from higher resolution by blurring the images.
- the present invention provides a new and improved method and apparatus which overcomes the above-referenced problems and others.
- a method of respiratory and cardiac movement compensated diagnostic imaging is provided.
- a plurality of heart images are generated in each of a plurality of respiratory and cardiac phases with a first imaging modality being a nuclear imaging modality.
- the images which have a common cardiac phase but different respiratory phases are transformed into images of the plurality of cardiac phases, but all at a selected common respiratory phase.
- the images with a common cardiac phase and the selected respiratory phase are combined into a series of respiratory compensated images at the plurality of cardiac phases.
- the series of respiratory compensated images are transformed in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images all in a selected common cardiac phase and the selected common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape motion model is generated. These images are combined into an image in the selected common cardiac and respiratory phases.
- a method of compensating for respiratory and cardiac movement in diagnostic image reconstruction is provided.
- the respiratory activity of a subject is monitored during a nuclear imaging scan and a respiratory movement vector is created.
- Cardiac activity of the subject is also monitored during the scan.
- Raw image data acquired during the scan is binned in accordance with both its respiratory and cardiac phases and the binned raw data is reconstructed into a plurality of images.
- the images are translated in accordance with the respiratory movement vector and are further adjusted in accordance with a heart shape and motion model, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape motion model is generated.
- the translated and adjusted images are then combined.
- a diagnostic imaging apparatus In accordance with another aspect of the present invention, a diagnostic imaging apparatus is provided.
- a first modality scanner generates a plurality of heart images in each of a plurality of respiratory and cardiac phases, wherein the first modality scanner is a nuclear imaging modality.
- a respiratory adjustment processor transforms the images which have a common cardiac phase but different respiratory phases into a series of images at the plurality of cardiac phases but at a selected common respiratory phase.
- a cardiac transforming routine transforms the series of respiratory compensated images in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images at a selected cardiac phase and at the selected common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape motion model is generated.
- a cardiac summing routine combines the images and the selected common cardiac and respiratory phases.
- an image reconstruction processor for use in conjunction with cardiac SPECT imaging procedures.
- a respiratory adjustment processor receives a plurality of images of differing respiratory phases and differing cardiac phases and adjusts the images of differing respiratory and cardiac phases into a series of images with a common respiratory phase but the differing cardiac phases.
- a cardiac transforming routine transforms the series of respiratory compensated images in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images in a common cardiac phase and the common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape and motion model is generated.
- a cardiac summing routine combines the images in the common cardiac and respiratory phases.
- a transform calculating routing can create a transform for warping, translating, rotating and zooming the series images at the differing cardiac phases into the common cardiac phase.
- the nuclear images are preferentially respiratory motion corrected to a selected respiratory phase selected from only those respiratory phases which are sufficiently stable to avoid blurring artifacts.
- the respiratory motion correction can be performed by generating a database of gated transform matrices based on image data from a patient pool, wherein the gated transform matrices compensate for respiratory motion.
- Gated image data can be acquired for a current image to be motion corrected.
- the image data can be reconstructed to form gated images, and the transformation matrices collected in the database can be used to estimate a current set of transformation matrices accounting for respiratory motion.
- a current motion-compensated image can be generated based on the current set of transform matrices.
- a database of transform matrices compensating for other physiological motion is generated, wherein the current set of transform matrices is based on the respiratory motion transform matrices and the physiological motion transform matrices from the respective databases.
- the physiological motion compensation transform matrices may account for cardiac, peristaltic or other physiological motion.
- the diagnostic imaging apparatus can comprise a user interface, which includes a display for displaying images and a motion compensation selector, wherein the motion compensation selection mechanism allows the user to select a motion compensation method.
- the selectable motion compensation method can include at least one of a specific patient model based motion compensation method and a general database based motion compensation method.
- the selectable motion compensation method may also include both a specific patient model based motion compensation method and a general database based motion compensation method.
- the user interface may further comprise a motion compensation method selector, wherein a motion type includes respiratory and other physiological motion.
- One advantage of the present invention is a more robust estimation of and correction for respiratory motion.
- Another advantage of this invention is a more robust estimation of and correction for cardiac motion.
- Yet another advantage of this invention resides in the elimination of spatial blur due to respiratory and cardiac motion.
- the invention may take form in various components and arrangements of components, and in various steps and arrangements of steps.
- the drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention.
- the human heart beats in a predictable fashion. During normal activity, the speed at which the heart beats can vary, from less than once per second when the subject is at rest, up to about three times per second under extreme physical exertion and/or stress. Also, its range of motion is not always exactly the same from person to person. Often, when a subject is scheduled for a cardiac SPECT imaging procedure, the physician is attempting to diagnose cardiac anomalies, and these can often affect how the heart behaves in its cycle.
- a preliminary, cardiac modeling scan of the heart to create an individualized cardiac shape and motion model, i.e., a model that is subject-specific.
- the subject is positioned in a diagnostic scanner 10.
- a modeling scan is performed that captures images at several phases, e.g. 5-10 phases, of the cardiac cycle and are collected during a breath hold period to be free of respiratory motion degradation.
- gated acquisitions or reconstructions can be used to generate cardiac images in a common respiratory phase. Optimally, these images capture and display translation, rotation, stretching, contracting, and warping of the heart muscle during its cycle.
- the diagnostic scanner 10 is a combined SPECT/CT scanner and the cardiac modeling scan is performed on a CT portion.
- separate scanners are contemplated, but in such a case, the subject is relocated, and repositioned to duplicate the position of the cardiac modeling scan.
- the modeling scan performed is preferably an ECG gated CT scan. ECG gating ensures that the desired images of each stage of heart motion are captured.
- the cardiac modeling scan is performed immediately before the SPECT imaging scan. This is to ensure maximum consistency between the subject's cardiac behavior from the cardiac modeling scan to the SPECT scan.
- the cardiac modeling scan can be performed on a different day, for example, but in this case it is more likely that cardiac behavior will have changed. This is more of a concern with subjects with known heart defects, because it is more likely that the subject's heart will vary its activity pattern over time.
- the cardiac modeling scanner does not have to be a CT scanner, but can also be MRI, ultrasound, Doppler ultrasound, or any other modality that can reliably capture the complete range of motion of the heart from an anatomical standpoint.
- a model creation processor 12 fits a generic heart shape and motion model 11 to the patient-specific data that was just acquired, e.g. by adapting or fitting the shape model to the individual images reconstructed for the different cardiac phases.
- the motion part of the heart shape and motion model can be used to guide or regularize this adaptation procedure.
- a patient-specific motion map for the myocardium is then derived from point correspondences of the fitted models, which yields a robust estimate.
- Clinicians have identified at least eight different points within a cardiac cycle where the heart is in a different position.
- the generic model represents expected positions for the average heart. By fitting the expected motion of the generic model to the actual motion of the subject's heart gathered from the cardiac modeling scan, a patient-specific heart model is obtained. It is preferred that the model illustrate the position of the subject's heart in at least eight phases, but more or fewer phases are contemplated. With fewer phases, the model may not capture the full range of motion of the heart.
- the patient specific shape and motion model is then stored in a patient model database 13 .
- the patient specific cardiac models can be stored for an indeterminate length of time, so that any subsequent SPECT imaging procedure for that patient may call upon them.
- new patient specific models can be generated to replace old ones if the patient is slated to have several SPECT scans or the condition of the heart changes.
- models stored within the database 13 can be marked as out of date, or deleted entirely. It may, however, be beneficial to archive old patient specific models to compare to newer ones, as an additional diagnostic tool showing how heart function changes over time.
- the subject is ready for the SPECT imaging procedure. If a SPECT/CT scanner was used to create the cardiac model, then the patient support translates the region of interest from the CT gantry portion to the SPECT gantry portion.
- the subject is outfitted with a respiratory motion sensor 14 , such as an optical marker mounted near the diaphragm and a marker position monitor such as a video system. RF systems, acoustic systems, other optical systems, pneumatic systems, and the like are also contemplated.
- the sensor 14 is positioned adjacent the subject's diaphragm, to detect the periodic motion of the subject's respiratory cycle.
- the senor 14 is positioned such that at least a position of maximum inhale and a position of maximum exhale are detected.
- an intermediate respiratory position is sensed midway between maximum inhale and maximum exhale.
- a total of three respiratory positions is preferred including the two extreme positions. Additional intermediate respiratory positions can be generated, event counts permitting.
- cardiac ECG electrodes 15 are applied to the subject. If the cardiac modeling scan was just performed, then the subject will already have the ECG electrodes 15 attached. Once both the cardiac and respiratory sensors are in place, the subject is ready for nuclear scanning.
- a respiratory monitor 16 tracks the respiratory cycle
- an ECG monitor 18 tracks the cardiac cycle during nuclear imaging.
- radioactive substance 20 The subject is injected with a radioactive substance 20 .
- radionuclides used in nuclear medicine include technetium-99m, thallium-201, fluorine-18, indium-111, gallium-67, iodine-123, iodine-131, and xenon-133.
- each radionuclide is coupled with a carrier molecule targeted to a specific cellular process.
- the carriers that concentrate in the bloodstream are selected.
- the carrier molecules tend to accumulate at the area of interest, and the radionuclide decay provides information about the location and concentration of carriers, hence the location of blood, in the area of interest.
- tracers are used that accumulate in the well-perfused muscle tissue.
- the nuclear events are detected by a detector array 22 .
- an event binning processor 24 Upon reception of a radiation event at the detector array 22 , an event binning processor 24 sorts each event into an appropriate bin 26 . In a preferred embodiment, there are twenty-four event bins 26 . These represent three different respiratory cycle positions at each of the eight cardiac cycle positions. When an event is received, the event binning processor 24 notes the point in the respiratory cycle from the respiratory monitor 16 and the point in the cardiac cycle from the ECG monitor 18 . From this information, the event binning processor 24 is able to sort out each radiation event into its appropriate bin 26 .
- the binning can be achieved by marking each event with an indicator of the corresponding points in the respiratory and cardiac cycles. The marking may be also achieved indirectly through coordinated time stamps of the events and outputs of the respiratory and cardiac monitors.
- a reconstruction processor 30 reconstructs each bin of events into a separate image.
- Each of the twenty-four reconstructed images is reconstructed with relatively higher spatial resolution but may be high in noise if the count density is low.
- Each of the bins is essentially a snapshot of the heart, in the point of the cardiac and respiratory cycles that its counts were collected. If all of the events were constructed in a single image without cycle dependant binning, the single image would be blurred and degraded by the cardiac and respiratory movement.
- a respiratory adjustment processor 32 registers and combines the disparate respiratory component images of each cardiac phase.
- the motion caused by the respiratory cycle is virtually all translation in the cranial-caudal direction.
- Within each of the eight imaged cardiac phases the three images are virtually identical except for offsets in the cranial-caudal direction.
- the respiratory adjustment processor 32 compares the three images and determines a registration transform among the images, e.g., a translation, a rigid transformation, or an affine transform. In all cardiac phases, the respiratory shift should be the same. In one embodiment all cardiac phase images are used to determine a common rigid transform. Alternately, one or a few phases can be used to determine the transform for all phases. As yet another option, a transform is independently determined for each phase. For example, the respiratory adjustment processor 32 may use the sum of squared gray value differences as a similarity measure due to the mono-modal nature of the problem. In this manner, the respiratory adjustment processor 32 develops a respiratory transformation, which in the simplest case could be a translation vector 34 , as depicted in FIGURE 2 , directly from the SPECT image data.
- a respiratory transformation which in the simplest case could be a translation vector 34 , as depicted in FIGURE 2 , directly from the SPECT image data.
- the respiratory adjustment processor includes a transformation routine 36 that transforms the maximum inhale and the maximum exhale images to overlay the intermediate image.
- the images can be brought into alignment in other points in the respiratory cycle, e.g. at one of the extremes.
- a summation routine (38) preferably in a linear summation of counts.
- either the maximum inhale or maximum exhale (or both) may be weighted more if the intermediate stage images are more blurred due to being collected over a wider range of movement.
- Adjusting and combining the images in each imaged cardiac phase according to the respiratory transformation creates a single image for each cardiac phase in which the spatial blur induced by respiration is removed. Because the combined image in each phase has more counts, e.g. three times as many, it has less noise than the originally collected cardiac and respiratory gated images. In the illustrated embodiment, the twenty four images are reduced to eight images, each in a different cardiac phase but in the same respiratory phase.
- the thresholds can be chosen such that approximately the same number of the SPECT events falls into each of the respiratory bins.
- longer data collection time intervals can be defined at maximum inhale and exhale, where the motion is minimal, and shorter collection time intervals at intermediate state(s) where the motion is greater. This will result in an uneven distribution of the SPECT events over the respiratory bins, but the original signal-to-noise ratio is retrieved once the images are combined. This is advantageous if the separate, respiratory phase-specific images are not useful for diagnostic purposes.
- the intermediate respiratory stage can be eliminated or greatly restricted since it has the highest residual variance.
- the maximum inhale and exhale and possibly one or more unblurred intermediate respiratory stages
- a cardiac adjustment processor 42 retrieves the latest patient specific cardiac model from the cardiac model database 13 .
- the cardiac adjustment processor 42 identifies which of the eight images (if any) corresponds with the user input cardiac phase.
- the cardiac adjustment processor includes a routine 44 that analyzes the patient specific cardiac model to generate transforms that transform each of the cardiac phase images into the user selected phase.
- the transforms typically include translation, rotation, enlarging, (or shrinking), summing, and warping of the cardiac phase images to bring them into alignment with the selected phase.
- the transform generating routine 44 of the cardiac adjustment processor 42 first generates a point-to-point correspondence of the SPECT image data into the patient specific cardiac shape and motion model.
- the patient-specific cardiac shape model corresponding to the selected cardiac phase is registered or aligned with the respiratory-motion compensated SPECT image for the same cardiac phase to establish point correspondence.
- a rigid transformation is sufficient for this task, if the geometry of the two scans is correct (no scaling, shearing, or warping).
- the patient-specific motion map as derived from the cardiac modeling scan is then applied to the corresponding points in the respiratory-motion compensated SPECT images of the different cardiac phases.
- the motion vector fields from the patient-specific motion model are interpolated to determine the inverse of the motion vector fields for each pixel of the reconstructed (and respiratory averaged) SPECT images from its actual phase to the selected cardiac phase.
- a transform routine 46 operates on each of the cardiac phase images to transform it to the selected cardiac phase and a combining routine 48 combines, e.g. sums, the transformed cardiac phase images in the selected phase.
- the transformed images can be weightedly combined. For example, images which are transformed the least can be weighted more that those that are transformed the most.
- the cardiac adjustment processor can perform the above process to a plurality of selected cardiac phases. This way, the user could have any number of cardiac phases in the combined format, or a ciné presentation of the combined images.
- the respiratory adjustment processor 32 and the cardiac adjustment processor 42 may be defined within a single computer or distributed among a variety of processing modules.
- the combined SPECT image(s) is acquired, it is presented to the user on the user interface 40 , or alternatively, on a separate output device 50 such as a dedicated monitor, palm device, hard copy printout, e-mail account, intranet web server, or the like.
- a separate output device 50 such as a dedicated monitor, palm device, hard copy printout, e-mail account, intranet web server, or the like.
- the completed images are also stored in an image archive 52 for convenient recall and study at a later time.
- the illustrated embodiment has been described utilizing twenty four bins at eight cardiac phases in each of three respiratory phases, but the number of bins and the number of cardiac and respiratory phases can be more or less. It is neither intended that the cardiac cycle be limited to eight segments, nor that the respiratory cycle be limited to three segments.
- the respiratory adjustment processor 32 and the cardiac adjustment processor 42 may be replaced by an iterative reconstruction processor 56 as depicted in FIGURE 3 and FIGURE 4 .
- the current image estimate 60 is transformed according to the three respiratory transformations 36 and the eight cardiac transformations 46 to generate all twenty four image estimates 64 . These image estimates are then projected to generate twenty four projection estimates 68 that are then compared to the measured projections in the twenty-four event bins 26 to generate the twenty four ratios 72 . These ratios 72 are reconstructed to generate twenty four update factors 76 , the inverse respiratory and cardiac transforms 80 are applied, and the result summed to generate an overall update factor 84 .
- the current image 60 is the final image. If the stop condition 88 is not met, a new image estimate is generated 92 and the process continues.
- the preliminary scan is not performed to create the patient specific cardiac motion model. Instead, a generic cardiac motion model is used. This embodiment carries the advantage of eliminating the preliminary scan at the cost of the individualized data. This method would produce faster results with less accuracy.
- the current scan of a specific patient can be used as an additional patient in the patient pool, thereby allowing for update of the data based on a larger population.
- the database is derived using gated acquisition with a fixed number of gates. Ideally, the number of gates used would match the specific current study, although pooling of gates and other such methods can also be used.
- the database may be derived at a different time and location and may use different imaging equipment. For example, it may be advantageous to image the background patient for the database on a high-resolution system, which may not be available at the site of the current study.
- the image data is reconstructed for each gate and transformation matrices are estimated by mapping each gate to a reference gate.
- transformation matrices can be formed using principal component analysis (PCA), clustering algorithms, or any other acceptable method.
- a current study can use the database to correct for motion.
- gated image data is acquired and reconstructed into individual gated images.
- the transform matrices between the gates images are then estimated using the database of estimated transformation matrices.
- PCA this can be formulated as follows:
- the task is to find the cluster of transformation matrices which is most "similar" to the transformation matrix to be estimated, and use a representative of the cluster as estimate for the unknown transformation matrix.
- the image data can be corrected to compensate for motion.
- the number of parameters to be estimated from the new patient data is reduced.
- such methods can be used with relatively low count statistics since information is used from the background patient database. Consequently the number of gates can be increased, thereby allowing for finer time resolution for modeling the motion cycle.
- a patient specific cardiac motion model can be constructed from the high resolution scan without melding with a generic heart model.
- a mapping of corresponding points is performed in each phase.
- a manual mapping procedure is labor intensive, but can be very accurate.
- a Doppler ultrasound is used to generate a direct motion vector field of the motion of the heart due to respiration.
- the cardiac modeling scan is conducted after the nuclear scan.
- the motion compensation described in this application is not limited to cardiac, but rather cardiac motion is merely an illustrative example.
- respiratory motion can be accounted for using the methods described above to provide transformation matrices for any organ or region of interest.
- the database can be populated based on respiratory motion alone or in combination with local motion of the region of interest, such as, for example, the heart. Consequently, a database can be derived for each individual region of interest.
- the user interface can allow for "traditional" gated motion compensation, specific patient model based motion compensation, or general database based motion compensation. Any of those methods can account solely for respiratory motion or can be combined with cardiac contractile motion compensation. It should be appreciated that the methods described herein may be further applied to other physiological motion, including, but not limited to, peristaltic motion.
- the user interface would provide for a selection of the desired motion compensation method, such as, for example, by indication with icons or a pull-down list.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- High Energy & Nuclear Physics (AREA)
- Animal Behavior & Ethology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Surgery (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Dentistry (AREA)
- Cardiology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- Physiology (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Nuclear Medicine (AREA)
Description
- The present invention relates to the digital imaging arts. It finds particular application in conjunction with Single Photon Emission Computed Tomography (SPECT) or Positron Emission Tomography (PET) imaging systems, and more specifically with combined SPECT/CT or PET/CT systems and will be described with particular reference thereto. It is, however, to be appreciated that the invention may also find application in the combination of SPECT, PET, or other nuclear imaging scans, and other modalities, such as CT, MRI, Ultrasound, and others.
-
Aldiscloses a process for reconstructing a three-dimensional image of an object moving with a substantially cyclic motion, in which, for an acquisition duration extending over several cycles of the movement of the object, an acquisition of a plurality of initial digital radiographic images is performed using a snapshot apparatus rotating around the object. Initial images having the same temporal occurrence in the course of each cycle are selected respectively in successive cycles so as to form a group of images which is associated with this same temporal occurrence. Several different groups of initial images corresponding respectively to several different temporal occurrences are formed. An intermediate three-dimensional representation of the object is reconstructed on the basis of each group of initial images and of an iterative image reconstruction algorithm. A law of spatial deformation between two intermediate three-dimensional representations is formulated on the basis of the two intermediate three-dimensional representations corresponding to two successive temporal occurrences. A final three-dimensional representation of the object is reconstructed on the basis of the initial images successively acquired, the spatial deformation law and an iterative image reconstruction algorithm.EP 1 087 337 -
discloses an x-ray computed tomography scanner for acquiring projection data from a series of views during a scan of a patient's chest. A movement of the patient's chest due to respiration is sensed by using, for instance, an ultrasonic range finder during the scan. This acquired motion data is employed along with a geometric model of chest motion to calculate factors which correct the acquired projection data. Finally, the corrected acquired projection data are back projected for generating an image having reduced motion artifacts.GB 2 250 164 A - In nuclear medicine, a subject is injected with a radiopharmaceutical that carries a radioisotope which decays, emitting gamma radiation. Nuclear cameras, such as SPECT or PET scanners, detect the gamma radiation and reconstruct a diagnostic image illustrating a density of radioactive events in the subject.
- In SPECT imaging, a radioactive source emits high energy particles that pass through at least a portion of a subject in an imaging region and are collected at a detector array that is positioned adjacent the subject. In order to receive enough radiation events to reconstruct a meaningful diagnostic image, the subject remains in the imaging region for an extended period of time, on the order of 10s of minutes or more. Comparatively, a CT scan can perform a complete scan of a limited region in less than a minute.
- As the subject has to remain in the imaging region for an extended period of time, several sources of motion occur that will lower the spatial resolution of a resulting image. First, the subject can move. Voluntary movements cause the internal anatomy of the subject to move also, and thus, shift positions in a diagnostic image. Second, the scan time is far too long for a subject to hold their breath. Even shallow, controlled breathing will introduce periodic motion of the chest cavity. Continuous respiration during the SPECT acquisition leads to a periodic translation of the heart by several centimeters in the cranial-caudal direction. This leads to spatial blur of the reconstructed images and degrades the left ventricle volume estimation in both the individual heart phases and the perfusion image.
- Imaging many body regions may be difficult or may result in blurring due to body, respiratory, cardiac and other physiological rhythms. For example in cardiac SPECT, images of the heart are being gathered, and naturally, the heart is constantly moving. The beating heart periodically contracts, translates, rotates, and twists which displaces individual segments of the myocardium by several centimeters in a complicated and non-homogeneous fashion. This degrades the spatial resolution of the summed perfusion image. These three sources of motion all produce spatial variance in the position of the internal organs of the subject, and ultimately cause spatial blurring of a resultant SPECT image. As the SPECT modality of imaging improves, these sources of motion will become increasingly problematic because they will negate the advantages gained from higher resolution by blurring the images.
- Efforts are currently underway to register voluntary physical patient motion, and compensate for that motion. These efforts, however, currently do not compensate for motion caused by the natural respiratory and cardiac cycles, and only focus on SPECT image space.
- The present invention provides a new and improved method and apparatus which overcomes the above-referenced problems and others.
- In accordance with one aspect of the present invention, a method of respiratory and cardiac movement compensated diagnostic imaging is provided. A plurality of heart images are generated in each of a plurality of respiratory and cardiac phases with a first imaging modality being a nuclear imaging modality. The images which have a common cardiac phase but different respiratory phases are transformed into images of the plurality of cardiac phases, but all at a selected common respiratory phase. The images with a common cardiac phase and the selected respiratory phase are combined into a series of respiratory compensated images at the plurality of cardiac phases. The series of respiratory compensated images are transformed in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images all in a selected common cardiac phase and the selected common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape motion model is generated. These images are combined into an image in the selected common cardiac and respiratory phases.
- In accordance with another aspect of the present invention, a method of compensating for respiratory and cardiac movement in diagnostic image reconstruction is provided. The respiratory activity of a subject is monitored during a nuclear imaging scan and a respiratory movement vector is created. Cardiac activity of the subject is also monitored during the scan. Raw image data acquired during the scan is binned in accordance with both its respiratory and cardiac phases and the binned raw data is reconstructed into a plurality of images. The images are translated in accordance with the respiratory movement vector and are further adjusted in accordance with a heart shape and motion model, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape motion model is generated. The translated and adjusted images are then combined.
- In accordance with another aspect of the present invention, a diagnostic imaging apparatus is provided. A first modality scanner generates a plurality of heart images in each of a plurality of respiratory and cardiac phases, wherein the first modality scanner is a nuclear imaging modality. A respiratory adjustment processor transforms the images which have a common cardiac phase but different respiratory phases into a series of images at the plurality of cardiac phases but at a selected common respiratory phase. A cardiac transforming routine transforms the series of respiratory compensated images in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images at a selected cardiac phase and at the selected common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape motion model is generated. A cardiac summing routine combines the images and the selected common cardiac and respiratory phases.
- In accordance with another aspect of the present invention, an image reconstruction processor is provided for use in conjunction with cardiac SPECT imaging procedures. A respiratory adjustment processor receives a plurality of images of differing respiratory phases and differing cardiac phases and adjusts the images of differing respiratory and cardiac phases into a series of images with a common respiratory phase but the differing cardiac phases. A cardiac transforming routine transforms the series of respiratory compensated images in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images in a common cardiac phase and the common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape and motion model is generated. A cardiac summing routine combines the images in the common cardiac and respiratory phases.
- A transform calculating routing can create a transform for warping, translating, rotating and zooming the series images at the differing cardiac phases into the common cardiac phase.
- The nuclear images are preferentially respiratory motion corrected to a selected respiratory phase selected from only those respiratory phases which are sufficiently stable to avoid blurring artifacts. The respiratory motion correction can be performed by generating a database of gated transform matrices based on image data from a patient pool, wherein the gated transform matrices compensate for respiratory motion. Gated image data can be acquired for a current image to be motion corrected. The image data can be reconstructed to form gated images, and the transformation matrices collected in the database can be used to estimate a current set of transformation matrices accounting for respiratory motion. A current motion-compensated image can be generated based on the current set of transform matrices. In an embodiment a database of transform matrices compensating for other physiological motion is generated, wherein the current set of transform matrices is based on the respiratory motion transform matrices and the physiological motion transform matrices from the respective databases. The physiological motion compensation transform matrices may account for cardiac, peristaltic or other physiological motion.
- The diagnostic imaging apparatus can comprise a user interface, which includes a display for displaying images and a motion compensation selector, wherein the motion compensation selection mechanism allows the user to select a motion compensation method. The selectable motion compensation method can include at least one of a specific patient model based motion compensation method and a general database based motion compensation method. The selectable motion compensation method may also include both a specific patient model based motion compensation method and a general database based motion compensation method. The user interface may further comprise a motion compensation method selector, wherein a motion type includes respiratory and other physiological motion.
- One advantage of the present invention is a more robust estimation of and correction for respiratory motion.
- Another advantage of this invention is a more robust estimation of and correction for cardiac motion.
- Yet another advantage of this invention resides in the elimination of spatial blur due to respiratory and cardiac motion.
- Still further advantages of the present invention will be appreciated to those of ordinary skill in the art upon reading and understanding the following detailed description.
- The invention may take form in various components and arrangements of components, and in various steps and arrangements of steps. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention.
-
FIGURE 1 is a diagrammatic illustration of a SPECT/CT system in accordance with the present invention; -
FIGURE 2 is a vector field describing typical respiratory displacement; -
FIGURE 3 is a diagrammatic illustration of a SPECT/CT system utilizing an iterative reconstruction; and, -
FIGURE 4 is a detailed flow chart of the data processing performed during iterative reconstruction. - The human heart beats in a predictable fashion. During normal activity, the speed at which the heart beats can vary, from less than once per second when the subject is at rest, up to about three times per second under extreme physical exertion and/or stress. Also, its range of motion is not always exactly the same from person to person. Often, when a subject is scheduled for a cardiac SPECT imaging procedure, the physician is attempting to diagnose cardiac anomalies, and these can often affect how the heart behaves in its cycle.
- Resultantly, it is beneficial to perform a preliminary, cardiac modeling scan of the heart to create an individualized cardiac shape and motion model, i.e., a model that is subject-specific. In order to generate the subject-specific heart shape and motion model, with reference to
FIGURE 1 , the subject is positioned in adiagnostic scanner 10. A modeling scan is performed that captures images at several phases, e.g. 5-10 phases, of the cardiac cycle and are collected during a breath hold period to be free of respiratory motion degradation. Alternately, gated acquisitions or reconstructions can be used to generate cardiac images in a common respiratory phase. Optimally, these images capture and display translation, rotation, stretching, contracting, and warping of the heart muscle during its cycle. Preferably, thediagnostic scanner 10 is a combined SPECT/CT scanner and the cardiac modeling scan is performed on a CT portion. This allows two types of diagnostic scans to be performed sequentially without the subject moving. Of course, separate scanners are contemplated, but in such a case, the subject is relocated, and repositioned to duplicate the position of the cardiac modeling scan. The modeling scan performed is preferably an ECG gated CT scan. ECG gating ensures that the desired images of each stage of heart motion are captured. - Preferably, the cardiac modeling scan is performed immediately before the SPECT imaging scan. This is to ensure maximum consistency between the subject's cardiac behavior from the cardiac modeling scan to the SPECT scan. Alternatively, the cardiac modeling scan can be performed on a different day, for example, but in this case it is more likely that cardiac behavior will have changed. This is more of a concern with subjects with known heart defects, because it is more likely that the subject's heart will vary its activity pattern over time. Also, the cardiac modeling scanner does not have to be a CT scanner, but can also be MRI, ultrasound, Doppler ultrasound, or any other modality that can reliably capture the complete range of motion of the heart from an anatomical standpoint.
- After the cardiac modeling scan is performed, a
model creation processor 12 fits a generic heart shape andmotion model 11 to the patient-specific data that was just acquired, e.g. by adapting or fitting the shape model to the individual images reconstructed for the different cardiac phases. The motion part of the heart shape and motion model can be used to guide or regularize this adaptation procedure. A patient-specific motion map for the myocardium is then derived from point correspondences of the fitted models, which yields a robust estimate. Clinicians have identified at least eight different points within a cardiac cycle where the heart is in a different position. The generic model represents expected positions for the average heart. By fitting the expected motion of the generic model to the actual motion of the subject's heart gathered from the cardiac modeling scan, a patient-specific heart model is obtained. It is preferred that the model illustrate the position of the subject's heart in at least eight phases, but more or fewer phases are contemplated. With fewer phases, the model may not capture the full range of motion of the heart. - The patient specific shape and motion model is then stored in a
patient model database 13. The patient specific cardiac models can be stored for an indeterminate length of time, so that any subsequent SPECT imaging procedure for that patient may call upon them. Periodically, new patient specific models can be generated to replace old ones if the patient is slated to have several SPECT scans or the condition of the heart changes. Similarly, models stored within thedatabase 13 can be marked as out of date, or deleted entirely. It may, however, be beneficial to archive old patient specific models to compare to newer ones, as an additional diagnostic tool showing how heart function changes over time. - Once the patient-specific heart model is generated and stored, the subject is ready for the SPECT imaging procedure. If a SPECT/CT scanner was used to create the cardiac model, then the patient support translates the region of interest from the CT gantry portion to the SPECT gantry portion. In preparation for the scan, the subject is outfitted with a
respiratory motion sensor 14, such as an optical marker mounted near the diaphragm and a marker position monitor such as a video system. RF systems, acoustic systems, other optical systems, pneumatic systems, and the like are also contemplated. Thesensor 14 is positioned adjacent the subject's diaphragm, to detect the periodic motion of the subject's respiratory cycle. In particular, thesensor 14 is positioned such that at least a position of maximum inhale and a position of maximum exhale are detected. Preferably, an intermediate respiratory position is sensed midway between maximum inhale and maximum exhale. A total of three respiratory positions is preferred including the two extreme positions. Additional intermediate respiratory positions can be generated, event counts permitting. - In addition to connecting the subject with the
respiratory sensor 14,cardiac ECG electrodes 15 are applied to the subject. If the cardiac modeling scan was just performed, then the subject will already have theECG electrodes 15 attached. Once both the cardiac and respiratory sensors are in place, the subject is ready for nuclear scanning. Arespiratory monitor 16 tracks the respiratory cycle, and an ECG monitor 18 tracks the cardiac cycle during nuclear imaging. - The subject is injected with a
radioactive substance 20. Common radionuclides used in nuclear medicine (SPECT and PET) include technetium-99m, thallium-201, fluorine-18, indium-111, gallium-67, iodine-123, iodine-131, and xenon-133. Typically, each radionuclide is coupled with a carrier molecule targeted to a specific cellular process. For myocardial perfusion studies, the carriers that concentrate in the bloodstream are selected. The carrier molecules tend to accumulate at the area of interest, and the radionuclide decay provides information about the location and concentration of carriers, hence the location of blood, in the area of interest. In typical cardiac imaging, tracers are used that accumulate in the well-perfused muscle tissue. The nuclear events are detected by adetector array 22. - Upon reception of a radiation event at the
detector array 22, anevent binning processor 24 sorts each event into anappropriate bin 26. In a preferred embodiment, there are twenty-fourevent bins 26. These represent three different respiratory cycle positions at each of the eight cardiac cycle positions. When an event is received, theevent binning processor 24 notes the point in the respiratory cycle from therespiratory monitor 16 and the point in the cardiac cycle from theECG monitor 18. From this information, theevent binning processor 24 is able to sort out each radiation event into itsappropriate bin 26. Optionally, the binning can be achieved by marking each event with an indicator of the corresponding points in the respiratory and cardiac cycles. The marking may be also achieved indirectly through coordinated time stamps of the events and outputs of the respiratory and cardiac monitors. - Once all of the desired events are collected, a
reconstruction processor 30 reconstructs each bin of events into a separate image. Each of the twenty-four reconstructed images is reconstructed with relatively higher spatial resolution but may be high in noise if the count density is low. Each of the bins is essentially a snapshot of the heart, in the point of the cardiac and respiratory cycles that its counts were collected. If all of the events were constructed in a single image without cycle dependant binning, the single image would be blurred and degraded by the cardiac and respiratory movement. - Once all of the events in each of the
event bins 26 are reconstructed into an image, the images are adjusted and combined. First, arespiratory adjustment processor 32 registers and combines the disparate respiratory component images of each cardiac phase. In the preferred embodiment, there are three images for each imaged point or phase in the respiratory cycle: one representing maximum inhale, one representing maximum exhale, and one representing an intermediate respiratory stage, tracked by the motion of the diaphragm as reported by therespiratory monitor 16. The motion caused by the respiratory cycle is virtually all translation in the cranial-caudal direction. Within each of the eight imaged cardiac phases the three images are virtually identical except for offsets in the cranial-caudal direction. Therespiratory adjustment processor 32 compares the three images and determines a registration transform among the images, e.g., a translation, a rigid transformation, or an affine transform. In all cardiac phases, the respiratory shift should be the same. In one embodiment all cardiac phase images are used to determine a common rigid transform. Alternately, one or a few phases can be used to determine the transform for all phases. As yet another option, a transform is independently determined for each phase. For example, therespiratory adjustment processor 32 may use the sum of squared gray value differences as a similarity measure due to the mono-modal nature of the problem. In this manner, therespiratory adjustment processor 32 develops a respiratory transformation, which in the simplest case could be atranslation vector 34, as depicted inFIGURE 2 , directly from the SPECT image data. - In the preferred embodiment, the respiratory adjustment processor includes a
transformation routine 36 that transforms the maximum inhale and the maximum exhale images to overlay the intermediate image. Alternately the images can be brought into alignment in other points in the respiratory cycle, e.g. at one of the extremes. Once aligned, the three images within each one of the eight imaged cardiac phases are combined by a summation routine, (38) preferably in a linear summation of counts. Alternatively, either the maximum inhale or maximum exhale (or both) may be weighted more if the intermediate stage images are more blurred due to being collected over a wider range of movement. Adjusting and combining the images in each imaged cardiac phase according to the respiratory transformation creates a single image for each cardiac phase in which the spatial blur induced by respiration is removed. Because the combined image in each phase has more counts, e.g. three times as many, it has less noise than the originally collected cardiac and respiratory gated images. In the illustrated embodiment, the twenty four images are reduced to eight images, each in a different cardiac phase but in the same respiratory phase. - For comparable signal-to-noise properties of the reconstructed SPECT images for each heart phase, the thresholds can be chosen such that approximately the same number of the SPECT events falls into each of the respiratory bins. To minimize residual motion blur during the respective respiratory time interval at the resolution scale of the reconstructed SPECT images, longer data collection time intervals can be defined at maximum inhale and exhale, where the motion is minimal, and shorter collection time intervals at intermediate state(s) where the motion is greater. This will result in an uneven distribution of the SPECT events over the respiratory bins, but the original signal-to-noise ratio is retrieved once the images are combined. This is advantageous if the separate, respiratory phase-specific images are not useful for diagnostic purposes.
- Alternately, at the cost of some SPECT event counts in the regions of fastest movement, the intermediate respiratory stage can be eliminated or greatly restricted since it has the highest residual variance. Thus, only the maximum inhale and exhale (and possibly one or more unblurred intermediate respiratory stages) can be acquired, transformed, and summed.
- After the twenty-four images are combined into eight cardiac phase images in the illustrated embodiment, the remaining eight images can be combined into a single SPECT image. With continuing reference to
FIGURE 1 , an operator designates which point of the cardiac cycle he/she would like to see in the final image at auser interface 40. Alternatively, a reference phase may be used as a default. When the eight (respiratory combined) cardiac phase images have been established, acardiac adjustment processor 42 retrieves the latest patient specific cardiac model from thecardiac model database 13. Thecardiac adjustment processor 42 identifies which of the eight images (if any) corresponds with the user input cardiac phase. The cardiac adjustment processor includes a routine 44 that analyzes the patient specific cardiac model to generate transforms that transform each of the cardiac phase images into the user selected phase. The transforms typically include translation, rotation, enlarging, (or shrinking), summing, and warping of the cardiac phase images to bring them into alignment with the selected phase. - More specifically, the
transform generating routine 44 of thecardiac adjustment processor 42 first generates a point-to-point correspondence of the SPECT image data into the patient specific cardiac shape and motion model. Here, the patient-specific cardiac shape model corresponding to the selected cardiac phase is registered or aligned with the respiratory-motion compensated SPECT image for the same cardiac phase to establish point correspondence. A rigid transformation is sufficient for this task, if the geometry of the two scans is correct (no scaling, shearing, or warping). The patient-specific motion map as derived from the cardiac modeling scan is then applied to the corresponding points in the respiratory-motion compensated SPECT images of the different cardiac phases. The motion vector fields from the patient-specific motion model are interpolated to determine the inverse of the motion vector fields for each pixel of the reconstructed (and respiratory averaged) SPECT images from its actual phase to the selected cardiac phase. Atransform routine 46 operates on each of the cardiac phase images to transform it to the selected cardiac phase and a combining routine 48 combines, e.g. sums, the transformed cardiac phase images in the selected phase. Of course, the transformed images can be weightedly combined. For example, images which are transformed the least can be weighted more that those that are transformed the most. - Since CT (or other modality) data is being used, there are other anatomical structures present that are unavailable in the SPECT image. This provides more reference points to gauge the motion of the heart.
- This process effectively removes all components of motion due to both the cardiac and respiratory cycles. Once the images are aligned, they are combined into a single diagnostic image. Alternatively, the cardiac adjustment processor can perform the above process to a plurality of selected cardiac phases. This way, the user could have any number of cardiac phases in the combined format, or a ciné presentation of the combined images.
- The
respiratory adjustment processor 32 and thecardiac adjustment processor 42 may be defined within a single computer or distributed among a variety of processing modules. - Once the combined SPECT image(s) is acquired, it is presented to the user on the
user interface 40, or alternatively, on aseparate output device 50 such as a dedicated monitor, palm device, hard copy printout, e-mail account, intranet web server, or the like. The completed images are also stored in animage archive 52 for convenient recall and study at a later time. - As stated before, the illustrated embodiment has been described utilizing twenty four bins at eight cardiac phases in each of three respiratory phases, but the number of bins and the number of cardiac and respiratory phases can be more or less. It is neither intended that the cardiac cycle be limited to eight segments, nor that the respiratory cycle be limited to three segments.
- In an alternate embodiment, the
respiratory adjustment processor 32 and thecardiac adjustment processor 42 may be replaced by aniterative reconstruction processor 56 as depicted inFIGURE 3 andFIGURE 4 . Thecurrent image estimate 60 is transformed according to the threerespiratory transformations 36 and the eightcardiac transformations 46 to generate all twenty four image estimates 64. These image estimates are then projected to generate twenty four projection estimates 68 that are then compared to the measured projections in the twenty-fourevent bins 26 to generate the twenty fourratios 72. Theseratios 72 are reconstructed to generate twenty fourupdate factors 76, the inverse respiratory andcardiac transforms 80 are applied, and the result summed to generate anoverall update factor 84. If thestop condition 88 is met, (e.g., maximum number of iterations done, or change in update factor less than some tolerance), thecurrent image 60 is the final image. If thestop condition 88 is not met, a new image estimate is generated 92 and the process continues. - In an alternate embodiment, the preliminary scan is not performed to create the patient specific cardiac motion model. Instead, a generic cardiac motion model is used. This embodiment carries the advantage of eliminating the preliminary scan at the cost of the individualized data. This method would produce faster results with less accuracy.
- In such embodiments, it is advantageous to create a database from a sufficiently large number of patients. In some embodiments, the current scan of a specific patient can be used as an additional patient in the patient pool, thereby allowing for update of the data based on a larger population. The database is derived using gated acquisition with a fixed number of gates. Ideally, the number of gates used would match the specific current study, although pooling of gates and other such methods can also be used. The database may be derived at a different time and location and may use different imaging equipment. For example, it may be advantageous to image the background patient for the database on a high-resolution system, which may not be available at the site of the current study.
- After acquisition, the image data is reconstructed for each gate and transformation matrices are estimated by mapping each gate to a reference gate. As with any of the methods described above, the transformation matrices can be formed using principal component analysis (PCA), clustering algorithms, or any other acceptable method.
- Once the database has been derived, a current study can use the database to correct for motion. For the current study, gated image data is acquired and reconstructed into individual gated images. The transform matrices between the gates images are then estimated using the database of estimated transformation matrices. For PCA, this can be formulated as follows:
- Denote the transformation matrix to be estimated with Tpatient , and the PCA basis of transformation matrices estimated in database by Ti, then Tpatient can be written:
Therefore, only the expansion coefficients λ i , have to be estimated from the patient data (instead of the transformation matrix itself). It is assumed that a small number of expansion coefficients (e.g. 3-5 or even less) is sufficient to represent the transformation matrix to be estimated. Moreover, the number of expansion terms may be adjusted to the count statistics of the acquisition. For example, only one expansion term may be appropriate in case of extremely low count statistics. If more data becomes available, the number of coefficients may be increased. - For clustering algorithms, the task is to find the cluster of transformation matrices which is most "similar" to the transformation matrix to be estimated, and use a representative of the cluster as estimate for the unknown transformation matrix.
- Once the estimated transform matrices have been estimated, the image data can be corrected to compensate for motion. In this illustrative approach, the number of parameters to be estimated from the new patient data is reduced. Furthermore, such methods can be used with relatively low count statistics since information is used from the background patient database. Consequently the number of gates can be increased, thereby allowing for finer time resolution for modeling the motion cycle.
- In some embodiments, a patient specific cardiac motion model can be constructed from the high resolution scan without melding with a generic heart model. In this embodiment, a mapping of corresponding points is performed in each phase. A manual mapping procedure is labor intensive, but can be very accurate.
- In other embodiments, a Doppler ultrasound is used to generate a direct motion vector field of the motion of the heart due to respiration. In another embodiment, the cardiac modeling scan is conducted after the nuclear scan.
- It should be appreciated that the motion compensation described in this application is not limited to cardiac, but rather cardiac motion is merely an illustrative example. For instance, respiratory motion can be accounted for using the methods described above to provide transformation matrices for any organ or region of interest. In embodiments that use a motion model database, the database can be populated based on respiratory motion alone or in combination with local motion of the region of interest, such as, for example, the heart. Consequently, a database can be derived for each individual region of interest.
- Another optional feature for systems that use the methods described above, would be a user interface that allows the physician to choose between different motion compensation options. For example, the user interface can allow for "traditional" gated motion compensation, specific patient model based motion compensation, or general database based motion compensation. Any of those methods can account solely for respiratory motion or can be combined with cardiac contractile motion compensation. It should be appreciated that the methods described herein may be further applied to other physiological motion, including, but not limited to, peristaltic motion. In embodiments that allow for user selection of the motion compensation method, the user interface would provide for a selection of the desired motion compensation method, such as, for example, by indication with icons or a pull-down list.
- The invention has been described with reference to the preferred embodiments. Modifications and alterations may occur to others upon reading and understanding the preceding detailed description. It is intended that the invention be constructed as including all such modifications and alterations insofar as they come within the scope of the appended claims.
Claims (15)
- A method of respiratory and cardiac movement compensated diagnostic imaging comprising:generating a plurality of heart images in each of a plurality of respiratory and cardiac phases with a first imaging modality being a nuclear imaging modality;transforming images of the plurality of images which have a common cardiac phase and different respiratory phases into a series of respiratory compensated images at the plurality of cardiac phases and at a selected common respiratory phase;transforming the series of respiratory compensated images in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images in a selected common cardiac phase and the selected common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape and motion model is generated; and,combining the images in the selected common cardiac and respiratory phases.
- The method according to claim 1 further including:generating images of a heart of a subject in each of a plurality of cardiac phases with a second imaging modality;fitting a generic heart shape and motion model (11) to the generated heart images to generate a subject specific heart shape and motion model that is used for the transforming of the series of respiratory compensated images to generate a series of cardiac and respiratory compensated images in the selected common cardiac phase and the selected common respiratory phase.
- The method according to claim 2, wherein the second imaging modality is a cardiac gated anatomical imaging modality.
- The method according to claim 3, wherein the second imaging modality is cardiac gated CT.
- The method according to claim 4, wherein the images of the heart of the subject in each of the plurality of cardiac phases are generated from CT data collected during a single breath hold.
- The method according to claim 2, wherein the plurality of second imaging modality images are in a common respiratory phase.
- The method according to claim 1, wherein the heart shape and motion model is a generic model generated from a database of transformation matrices between anatomical respiratory compensated images of a patient pool at a plurality of cardiac phases.
- The method according to claim 1, wherein the plurality of first imaging modality images includes images in each ofN cardiac phases and M respiratory phases, where N and M are plural integers, such that the plurality of first imaging modality images includes NxM images.
- The method according to claim 8, wherein the N respiratory phases include a maximum inhale phase and a maximum exhale phase.
- The method according to claim 1, wherein generating the plurality of first imaging modality images includes:acquiring data with cardiac and respiratory gating; and,reconstructing acquired data with common respiratory and cardiac phases into the plurality of first imaging modality images.
- The method according to claim 1 wherein the plurality of generated heart images are current estimate heart images (60) and iteratively repeating the following steps until a stop condition is met:performing the first and second transforming steps with the estimate heart images to generate a series of cardiac and respiratory compensated estimate images;projecting the series of cardiac and respiratory compensated estimate images to generate a series of projection estimates;comparing the projection estimates with measured projections to generate a series of ratios (72);reconstructing the ratios to generate a series of update factors (76);applying inverses of the first and second transforming steps to generate an overall update factor (84).
- An image reconstruction processor for use in conjunction with cardiac nuclear imaging procedures comprising:a respiratory adjustment processor (32) that receives a plurality of nuclear images of differing respiratory phases and differing cardiac phases and adjusts the images of differing respiratory phases and cardiac phases into a series of images with a common respiratory phase and the differing cardiac phases;a cardiac transforming routine (46) that transforms the series of respiratory compensated images in accordance with a heart shape and motion model to generate a series of cardiac and respiratory compensated images in a common cardiac phase and the common respiratory phase, wherein a point-to-point correspondence between each respiratory compensated image and the heart shape and motion model is generated; and,a cardiac summing routine (48) that combines the images in the common cardiac and respiratory phases.
- The image reconstruction processor according to claim 12, wherein the respiratory adjustment processor (32) includes:a transformation routine, such as a translation (36) that transforms images of different respiratory phases and the same cardiac phase to spatially overlay each other.
- A diagnostic imaging apparatus comprising:a first modality scanner (10) that generates a plurality of heart images in each of a plurality of respiratory and cardiac phases, wherein the first modality scanner (10) is a nuclear imaging modality; characterized bythe image reconstruction processor according to claim 12.
- The diagnostic imaging apparatus according to claim 14, further including:a cardiac model generating scanner (10) that generates images of a heart of a subject in each of a plurality of cardiac phases with a first imaging modality;a model creation processor (12) that fits a heart shape and motion model to the generated heart images to generate a subject specific heart movement model.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US59576805P | 2005-08-04 | 2005-08-04 | |
| PCT/IB2006/052585 WO2007015199A2 (en) | 2005-08-04 | 2006-07-27 | Motion compensation in functional imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1913421A2 EP1913421A2 (en) | 2008-04-23 |
| EP1913421B1 true EP1913421B1 (en) | 2013-01-30 |
Family
ID=37575094
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP06780233A Not-in-force EP1913421B1 (en) | 2005-08-04 | 2006-07-27 | Motion compensation in functional imaging |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US8411915B2 (en) |
| EP (1) | EP1913421B1 (en) |
| CN (1) | CN101238391B (en) |
| RU (1) | RU2431443C2 (en) |
| WO (1) | WO2007015199A2 (en) |
Families Citing this family (105)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10195464B2 (en) | 2004-06-24 | 2019-02-05 | Varian Medical Systems, Inc. | Systems and methods for treating a lung of a patient using guided radiation therapy or surgery |
| US9586059B2 (en) | 2004-07-23 | 2017-03-07 | Varian Medical Systems, Inc. | User interface for guided radiation therapy |
| US8437449B2 (en) | 2004-07-23 | 2013-05-07 | Varian Medical Systems, Inc. | Dynamic/adaptive treatment planning for radiation therapy |
| EP1926520B1 (en) | 2005-09-19 | 2015-11-11 | Varian Medical Systems, Inc. | Apparatus and methods for implanting objects, such as bronchoscopically implanting markers in the lung of patients |
| EP2041721B1 (en) * | 2006-07-05 | 2016-09-07 | Philips Intellectual Property & Standards GmbH | Prediction of cardiac shape by a motion model |
| JP2010501856A (en) * | 2006-08-22 | 2010-01-21 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Artifact correction for motion artifact images |
| US7602418B2 (en) * | 2006-10-11 | 2009-10-13 | Eastman Kodak Company | Digital image with reduced object motion blur |
| US20080146908A1 (en) * | 2006-10-24 | 2008-06-19 | Jung-Chu Wu | Lithotripter with stone tracking and locking localization system |
| DE102007009182B4 (en) * | 2007-02-26 | 2016-09-22 | Siemens Healthcare Gmbh | Method and device for image display of cyclically moving objects |
| US9968256B2 (en) | 2007-03-08 | 2018-05-15 | Sync-Rx Ltd. | Automatic identification of a tool |
| JP5639764B2 (en) * | 2007-03-08 | 2014-12-10 | シンク−アールエックス,リミティド | Imaging and tools for use with moving organs |
| US9375164B2 (en) | 2007-03-08 | 2016-06-28 | Sync-Rx, Ltd. | Co-use of endoluminal data and extraluminal imaging |
| US11064964B2 (en) | 2007-03-08 | 2021-07-20 | Sync-Rx, Ltd | Determining a characteristic of a lumen by measuring velocity of a contrast agent |
| US10716528B2 (en) | 2007-03-08 | 2020-07-21 | Sync-Rx, Ltd. | Automatic display of previously-acquired endoluminal images |
| US9629571B2 (en) | 2007-03-08 | 2017-04-25 | Sync-Rx, Ltd. | Co-use of endoluminal data and extraluminal imaging |
| WO2010058398A2 (en) | 2007-03-08 | 2010-05-27 | Sync-Rx, Ltd. | Image processing and tool actuation for medical procedures |
| US11197651B2 (en) | 2007-03-08 | 2021-12-14 | Sync-Rx, Ltd. | Identification and presentation of device-to-vessel relative motion |
| FR2914176B1 (en) * | 2007-03-27 | 2009-05-22 | Gen Electric | METHOD FOR DETECTING AND COMPENSATING RESPIRATORY MOVEMENT IN FLUOROSCOPIC CARDIAC IMAGES SYNCHRONIZED TO AN ELECTROCARDIOGRAM SIGNAL. |
| US9814431B2 (en) * | 2007-05-04 | 2017-11-14 | Memorial Sloan Kettering Cancer Center | Methods and systems for retrospective internal gating |
| WO2008139344A1 (en) * | 2007-05-10 | 2008-11-20 | Koninklijke Philips Electronics N.V. | Model-based spect heart orientation estimation |
| WO2009013661A2 (en) | 2007-07-26 | 2009-01-29 | Koninklijke Philips Electronics N.V. | Motion correction in nuclear imaging |
| RU2491020C2 (en) | 2007-12-19 | 2013-08-27 | Конинклейке Филипс Электроникс Н.В. | Correction of involuntary respiratory motion in computed tomography of heart |
| US20090187106A1 (en) * | 2008-01-23 | 2009-07-23 | Siemens Medical Solutions Usa, Inc. | Synchronized combining for contrast agent enhanced medical diagnostic ultrasound imaging |
| GB0803064D0 (en) * | 2008-02-20 | 2008-03-26 | Siemens Medical Solutions | System for defining volumes of interest with reference to anatomical features |
| DE102008016892A1 (en) * | 2008-04-02 | 2009-10-15 | Siemens Aktiengesellschaft | Operating method for an imaging system for time-resolved imaging of an iteratively moving examination subject |
| EP2293720B1 (en) * | 2008-06-05 | 2021-02-24 | Varian Medical Systems, Inc. | Motion compensation for medical imaging and associated systems and methods |
| WO2010048434A2 (en) * | 2008-10-22 | 2010-04-29 | University Of Massachusetts | Motion compensation in nuclear imaging |
| US9095313B2 (en) | 2008-11-18 | 2015-08-04 | Sync-Rx, Ltd. | Accounting for non-uniform longitudinal motion during movement of an endoluminal imaging probe |
| US8855744B2 (en) | 2008-11-18 | 2014-10-07 | Sync-Rx, Ltd. | Displaying a device within an endoluminal image stack |
| US9144394B2 (en) | 2008-11-18 | 2015-09-29 | Sync-Rx, Ltd. | Apparatus and methods for determining a plurality of local calibration factors for an image |
| US9101286B2 (en) | 2008-11-18 | 2015-08-11 | Sync-Rx, Ltd. | Apparatus and methods for determining a dimension of a portion of a stack of endoluminal data points |
| US9974509B2 (en) | 2008-11-18 | 2018-05-22 | Sync-Rx Ltd. | Image super enhancement |
| US10362962B2 (en) | 2008-11-18 | 2019-07-30 | Synx-Rx, Ltd. | Accounting for skipped imaging locations during movement of an endoluminal imaging probe |
| US11064903B2 (en) | 2008-11-18 | 2021-07-20 | Sync-Rx, Ltd | Apparatus and methods for mapping a sequence of images to a roadmap image |
| US8731257B2 (en) | 2008-12-08 | 2014-05-20 | Elekta Ab (Publ) | Analysis of radiographic images |
| EP2389661B1 (en) | 2009-01-22 | 2019-09-18 | Koninklijke Philips N.V. | Nuclear image reconstruction |
| US8532357B2 (en) * | 2009-01-23 | 2013-09-10 | General Electric Company | Method and apparatus for reducing image artifacts |
| US8355551B2 (en) * | 2009-02-27 | 2013-01-15 | General Electric Company | Method and apparatus for reducing image artifacts |
| CN102361587B (en) * | 2009-03-24 | 2014-08-06 | 皇家飞利浦电子股份有限公司 | Heart segmentation in cardiac rest and stress imaging |
| KR101085220B1 (en) * | 2009-05-14 | 2011-11-21 | 삼성메디슨 주식회사 | Elastic image realization device and method |
| US9412044B2 (en) * | 2009-06-09 | 2016-08-09 | Siemens Aktiengesellschaft | Method of compensation of respiratory motion in cardiac imaging |
| US8718338B2 (en) * | 2009-07-23 | 2014-05-06 | General Electric Company | System and method to compensate for respiratory motion in acquired radiography images |
| CN101702232B (en) * | 2009-10-16 | 2012-01-11 | 昆明理工大学 | Respiration correction technique in positron emission tomography |
| EP2502204A1 (en) | 2009-11-18 | 2012-09-26 | Koninklijke Philips Electronics N.V. | Motion correction in radiation therapy |
| JP5591545B2 (en) * | 2010-01-20 | 2014-09-17 | 株式会社東芝 | Magnetic resonance imaging system |
| EP2539869B1 (en) * | 2010-02-22 | 2014-08-27 | Koninklijke Philips N.V. | Sparse data reconstruction for gated x-ray ct imaging |
| DE102010014211A1 (en) * | 2010-04-08 | 2011-10-13 | Siemens Aktiengesellschaft | Evaluation method for a sequence of image data sets with twice the elastic distortion of the image data records |
| JP5878920B2 (en) * | 2010-06-04 | 2016-03-08 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Relative amplitude / tilt mapping |
| US9545506B2 (en) | 2010-10-01 | 2017-01-17 | Varian Medical Systems, Inc. | Delivery catheter for and method of delivering an implant, for example, bronchoscopically implanting a marker in a lung |
| WO2012069990A1 (en) * | 2010-11-26 | 2012-05-31 | Koninklijke Philips Electronics N.V. | Image processing apparatus |
| WO2012075577A1 (en) | 2010-12-08 | 2012-06-14 | Gregory Couch | Generating a suitable model for estimating patient radiation dose resulting from medical imaging scans |
| RU2013136488A (en) * | 2011-01-05 | 2015-02-10 | Конинклейке Филипс Электроникс Н.В. | METHOD AND DEVICE FOR MOTION DETECTION AND CORRECTION IN POSITRON-EMISSION TOMOGRAPHY DATA IN THE LIST MODE USING A SYNCHRONIZED SIGNAL |
| EP2706917B1 (en) * | 2011-05-12 | 2019-06-12 | Koninklijke Philips N.V. | Motion compensated imaging |
| US8421021B2 (en) * | 2011-06-21 | 2013-04-16 | General Electric Company | Motion correction of SPECT images |
| EP2724319B1 (en) * | 2011-06-21 | 2020-03-18 | Koninklijke Philips N.V. | Respiratory motion determination apparatus |
| JP6099640B2 (en) | 2011-06-23 | 2017-03-22 | シンク−アールエックス,リミティド | Lumen background sharpening |
| DE102011083646A1 (en) * | 2011-09-28 | 2013-03-28 | Siemens Aktiengesellschaft | Method for determination of motion field of heart of patient, involves determining motion field using extreme value of image based on motion-compensating reconstructed tomographic image data sets |
| DE102011085399A1 (en) * | 2011-10-28 | 2013-05-02 | Siemens Aktiengesellschaft | Method for recording magnetic resonance image data using a respiratory device |
| FR2985899B1 (en) * | 2012-01-24 | 2015-04-17 | Gen Electric | TREATMENT OF INTERVENTIONAL RADIOLOGY IMAGES BY ECG ANALYSIS |
| JP6071260B2 (en) * | 2012-06-13 | 2017-02-01 | キヤノン株式会社 | Subject information acquisition apparatus and information processing method |
| CA2875346A1 (en) | 2012-06-26 | 2014-01-03 | Sync-Rx, Ltd. | Flow-related image processing in luminal organs |
| US20140016847A1 (en) * | 2012-07-13 | 2014-01-16 | General Electric Company | Multi-phase computed tomography image reconstruction |
| US8837799B2 (en) * | 2012-08-31 | 2014-09-16 | General Electric Company | Method and apparatus for selecting a reference gate |
| US9767536B2 (en) | 2013-03-14 | 2017-09-19 | Memorial Sloan Kettering Cancer Center | Medical imaging |
| BR112015025602A2 (en) | 2013-04-12 | 2017-07-18 | Koninklijke Philips Nv | medical system, medical lumen movement tracking system for fractional flow reserve (rff) simulation and method for tracking lumen movement |
| US9398855B2 (en) * | 2013-05-30 | 2016-07-26 | Siemens Aktiengesellschaft | System and method for magnetic resonance imaging based respiratory motion correction for PET/MRI |
| US9919165B2 (en) | 2014-05-07 | 2018-03-20 | Varian Medical Systems, Inc. | Systems and methods for fiducial to plan association |
| US10043284B2 (en) | 2014-05-07 | 2018-08-07 | Varian Medical Systems, Inc. | Systems and methods for real-time tumor tracking |
| CN106687044B (en) * | 2014-06-13 | 2020-09-08 | 美国西门子医疗解决公司 | Methods and systems for processing data for medical imaging |
| US9770223B2 (en) * | 2014-09-09 | 2017-09-26 | Wisconsin Alumni Research Foundation | System and method for accelerated, time-resolved imaging |
| CN104287769B (en) * | 2014-10-13 | 2016-10-05 | 沈阳东软医疗系统有限公司 | A kind of outside gate signal supervisory instrument based on PET/CT equipment and method |
| US9466132B2 (en) | 2014-12-08 | 2016-10-11 | General Electric Company | Systems and methods for motion mitigation determinations |
| US9684973B2 (en) | 2014-12-08 | 2017-06-20 | General Electric Company | Systems and methods for selecting imaging data for principle components analysis |
| CN104899867A (en) * | 2015-01-14 | 2015-09-09 | 昆明理工大学 | Automatic determining method for gating threshold in respiratory movement gating correction method |
| US9471976B2 (en) * | 2015-02-20 | 2016-10-18 | General Electric Company | System and method for data driven gating of multiple bed positions |
| KR20160107799A (en) | 2015-03-05 | 2016-09-19 | 삼성전자주식회사 | Tomography imaging apparatus and method for reconstructing a tomography image thereof |
| EP3078980B1 (en) * | 2015-04-07 | 2020-06-17 | Siemens Healthcare GmbH | Dynamic effects correction in medical imaging |
| US10123761B2 (en) | 2015-07-01 | 2018-11-13 | William E. Butler | Device and method for spatiotemporal reconstruction of a moving vascular pulse wave in the brain and other organs |
| EP3349658B1 (en) | 2015-09-16 | 2022-08-03 | Koninklijke Philips N.V. | Respiratory motion compensation for four-dimensional computed tomography imaging using ultrasound |
| US11707204B2 (en) * | 2015-10-06 | 2023-07-25 | Synaptive Medical Inc. | Method, system and apparatus for image-guided insertion of implant devices |
| US11120564B2 (en) | 2015-12-22 | 2021-09-14 | Koninklijke Philips N.V. | Medical imaging apparatus and medical imaging method for inspecting a volume of a subject |
| WO2017192775A1 (en) * | 2016-05-03 | 2017-11-09 | Acutus Medical, Inc. | Cardiac mapping system with efficiency algorithm |
| US10360724B2 (en) * | 2016-12-21 | 2019-07-23 | Uih America, Inc. | Methods and systems for emission computed tomography image reconstruction |
| US10255694B2 (en) * | 2016-12-21 | 2019-04-09 | Uih America, Inc. | Methods and systems for emission computed tomography image reconstruction |
| US11064965B2 (en) * | 2017-03-24 | 2021-07-20 | Koninklijke Philips N.V. | Noise-robust real-time extraction of the respiratory motion signal from PET list-data |
| EP3382413B1 (en) * | 2017-03-27 | 2022-08-10 | Siemens Healthcare GmbH | 2d navigator technique in mri |
| US10690782B2 (en) * | 2017-09-30 | 2020-06-23 | Uih America, Inc. | Systems and methods for positron emission tomography image reconstruction |
| US11568581B2 (en) | 2018-01-27 | 2023-01-31 | Shanghai United Imaging Healthcare Co., Ltd. | Systems and methods for correcting mismatch induced by respiratory motion in positron emission tomography image reconstruction |
| US10504250B2 (en) * | 2018-01-27 | 2019-12-10 | Uih America, Inc. | Systems and methods for correcting mismatch induced by respiratory motion in positron emission tomography image reconstruction |
| EP3413317B1 (en) * | 2018-01-29 | 2020-06-17 | Siemens Healthcare GmbH | Provision of a medical image |
| CN111742346A (en) | 2018-02-21 | 2020-10-02 | 纳维斯国际有限公司 | Mapping binned medical data |
| US20210137491A1 (en) * | 2018-03-29 | 2021-05-13 | Terumo Kabushiki Kaisha | Information selection device |
| CA3126986A1 (en) | 2019-02-06 | 2020-08-13 | William E. Butler | Spatiotemporal reconstruction of a moving vascular pulse wave from a plurality of lower dimensional angiographic projections |
| US12076174B2 (en) | 2019-02-06 | 2024-09-03 | William E. Butler | Methods for angiography |
| KR102722504B1 (en) | 2019-03-27 | 2024-10-29 | 윌리암 이. 버틀러 | Reconstructing cardiac frequency phenomena from angiographic data |
| ES3033066T3 (en) | 2019-04-04 | 2025-07-30 | William E Butler | Intrinsic contrast optical cross-correlated wavelet angiography |
| CN112494030B (en) * | 2019-11-29 | 2024-09-06 | 上海联影智能医疗科技有限公司 | Cardiac imaging systems and methods |
| CN111067622B (en) * | 2019-12-09 | 2023-04-28 | 天津大学 | Respiratory motion compensation method for pulmonary percutaneous puncture |
| US11494955B2 (en) | 2020-06-10 | 2022-11-08 | Siemens Medical Solutions Usa, Inc. | Data driven reconstruction in emission tomography |
| US12220272B2 (en) | 2021-05-12 | 2025-02-11 | Angiowave Imaging, Inc. | Motion-compensated wavelet angiography |
| CN114418907B (en) * | 2021-12-16 | 2025-06-03 | 沈阳智核医疗科技有限公司 | Image reconstruction method and device for positron emission tomography data |
| US12406409B2 (en) * | 2022-08-01 | 2025-09-02 | GE Precision Healthcare LLC | System and method for motion compensation for cardiac PET imaging |
| CN116616817B (en) * | 2023-07-21 | 2023-10-03 | 深圳华声医疗技术股份有限公司 | Ultrasonic heart rate detection method and device, ultrasonic equipment and storage medium |
| CN119762555B (en) * | 2025-03-05 | 2025-05-30 | 零磁装备(德清)有限公司 | Cardiac multimodal image registration method, registration system and readable storage medium |
| CN121242589B (en) * | 2025-12-08 | 2026-03-17 | 四川大学华西医院 | A method, system, and storage medium for cardiopulmonary motion imaging reconstruction. |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5251128A (en) | 1990-11-19 | 1993-10-05 | General Electric Company | Motion artifact reduction in projection imaging |
| EP0602730B1 (en) | 1992-12-18 | 2002-06-19 | Koninklijke Philips Electronics N.V. | Registration of Volumetric images which are relatively elastically deformed by matching surfaces |
| US5758645A (en) | 1996-03-21 | 1998-06-02 | Siemens Medical Systems, Inc. | Automatic detection and correction of body organ motion and particularly cardiac motion in nuclear medicine studies |
| US5939716A (en) * | 1997-04-02 | 1999-08-17 | Sandia Corporation | Three-dimensional light trap for reflective particles |
| US6056691A (en) * | 1998-06-24 | 2000-05-02 | Ecton, Inc. | System for collecting ultrasound imaging data at an adjustable collection image frame rate |
| US6067859A (en) * | 1999-03-04 | 2000-05-30 | The Board Of Regents, The University Of Texas System | Optical stretcher |
| FR2799029B1 (en) | 1999-09-24 | 2002-05-24 | Ge Medical Syst Sa | METHOD FOR RECONSTRUCTING A THREE-DIMENSIONAL IMAGE OF A MOVING OBJECT, IN PARTICULAR A THREE-DIMENSIONAL IMAGE OF VESSELS OF THE HUMAN HEART |
| US6473636B1 (en) * | 2000-02-03 | 2002-10-29 | Siemens Corporate Research, Inc. | Variable-length correlation method for motion correction in SPECT myocardial perfusion imaging |
| DE10051244A1 (en) * | 2000-10-17 | 2002-05-16 | Philips Corp Intellectual Pty | X-ray free intravascular localization and imaging procedure |
| CA2431945C (en) * | 2000-12-21 | 2010-07-06 | Kishan Dholakia | Optical rotation of microscopic particles |
| DE10162272A1 (en) * | 2001-12-19 | 2003-07-10 | Philips Intellectual Property | Procedure to support orientation in the vascular system |
| US7324282B2 (en) * | 2002-05-14 | 2008-01-29 | Arryx, Inc. | Apparatus, system and method for applying optical gradient forces |
| US7180976B2 (en) * | 2002-06-04 | 2007-02-20 | Koninklijke Philips Electronics N.V. | Rotational angiography based hybrid 3-D reconstruction of coronary arterial structure |
| DE10231061A1 (en) * | 2002-07-10 | 2004-01-22 | Philips Intellectual Property & Standards Gmbh | Process and system for improving the information content in an image |
| EP2270816B1 (en) * | 2002-07-31 | 2014-06-18 | Premium Genetics (UK) Limited | System and method of sorting materials using holographic laser steering |
| DE10245943B4 (en) * | 2002-09-30 | 2008-06-26 | Siemens Ag | Method for generating CT images of a periodically moved organ and CT apparatus for carrying out such a method |
| WO2004068406A2 (en) * | 2003-01-30 | 2004-08-12 | Chase Medical, L.P. | A method and system for image processing and contour assessment |
| US20050043609A1 (en) * | 2003-01-30 | 2005-02-24 | Gregory Murphy | System and method for facilitating cardiac intervention |
| US7558402B2 (en) * | 2003-03-07 | 2009-07-07 | Siemens Medical Solutions Usa, Inc. | System and method for tracking a global shape of an object in motion |
| US7507968B2 (en) | 2003-06-17 | 2009-03-24 | Ge Medical Systems Global Technology Company, Llc | Systems and methods for correcting a positron emission tomography emission image |
| CN1809841B (en) | 2003-06-18 | 2010-05-12 | 皇家飞利浦电子股份有限公司 | Reconstruction method, device and system for motion compensation |
| EP1665125A4 (en) * | 2003-09-02 | 2007-10-03 | Ludwig Inst Cancer Res | DATA-TRIGGER MOTION CORRECTION FOR NUCLEAR IMAGING |
| DE102004011156A1 (en) * | 2004-03-08 | 2005-10-06 | Siemens Ag | Method for endoluminal imaging with movement correction |
| US7454048B2 (en) * | 2004-08-27 | 2008-11-18 | General Electric Company | Methods and systems for motion correction in an ultrasound volumetric data set |
| US7170050B2 (en) * | 2004-09-17 | 2007-01-30 | Pacific Biosciences Of California, Inc. | Apparatus and methods for optical analysis of molecules |
| US7173248B2 (en) * | 2004-10-20 | 2007-02-06 | General Electric Company | Methods and systems for positron emission tomography data correction |
| WO2007042989A1 (en) * | 2005-10-11 | 2007-04-19 | Ecole Polytechnique Federale De Lausanne (Epfl) | Miniaturized optical tweezer array with an array of reflective elements for reflecting the light back to a focal area |
| US7491928B2 (en) * | 2005-12-05 | 2009-02-17 | New York University | Extended optical traps by shape-phase holography |
| US8005284B2 (en) * | 2006-12-07 | 2011-08-23 | Kabushiki Kaisha Toshiba | Three dimensional image processing apparatus and x-ray diagnosis apparatus |
-
2006
- 2006-07-27 CN CN200680029060XA patent/CN101238391B/en not_active Expired - Fee Related
- 2006-07-27 WO PCT/IB2006/052585 patent/WO2007015199A2/en not_active Ceased
- 2006-07-27 US US11/997,410 patent/US8411915B2/en not_active Expired - Fee Related
- 2006-07-27 EP EP06780233A patent/EP1913421B1/en not_active Not-in-force
- 2006-07-27 RU RU2008108077/14A patent/RU2431443C2/en not_active IP Right Cessation
Also Published As
| Publication number | Publication date |
|---|---|
| WO2007015199A3 (en) | 2007-04-19 |
| CN101238391B (en) | 2012-08-29 |
| US8411915B2 (en) | 2013-04-02 |
| EP1913421A2 (en) | 2008-04-23 |
| RU2008108077A (en) | 2009-09-10 |
| RU2431443C2 (en) | 2011-10-20 |
| CN101238391A (en) | 2008-08-06 |
| WO2007015199A2 (en) | 2007-02-08 |
| US20080226149A1 (en) | 2008-09-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8411915B2 (en) | Motion compensation in functional imaging | |
| CN1846618B (en) | Method for calculating and compensating organ periodical motion and image capturing system | |
| US7221728B2 (en) | Method and apparatus for correcting motion in image reconstruction | |
| US9535145B2 (en) | MR-PET cyclic motion gating and correction | |
| CN101765865B (en) | Motion correction in nuclear imaging | |
| Dawood et al. | Lung motion correction on respiratory gated 3-D PET/CT images | |
| JP4576228B2 (en) | Non-rigid image registration based on physiological model | |
| CN109961419B (en) | Correction information acquisition method for attenuation correction of PET activity distribution image | |
| EP2724319B1 (en) | Respiratory motion determination apparatus | |
| EP2389661B1 (en) | Nuclear image reconstruction | |
| US20110082368A1 (en) | Reconstruction of dynamical cardiac spect for measuring tracer uptake and redistribution | |
| US8855391B2 (en) | Operating method for an imaging system for the time-resolved mapping of an iteratively moving examination object | |
| CN110458779B (en) | Method for acquiring correction information for attenuation correction of PET images of respiration or heart | |
| Lang et al. | Organ movement reduction in PET/CT using dual-gated listmode acquisition | |
| CN110428384B (en) | Method for acquiring correction information for attenuation correction of PET images of respiration or heart | |
| CN118974773A (en) | Device-free motion state estimation | |
| JP2003190147A (en) | X-ray CT apparatus and image processing apparatus | |
| Asraf Ali | Maxillofacial CBCT Reconstruction in the Face of Challenging Patient Motions | |
| Lamare et al. | Correction of respiratory motion in dual gated cardiac imaging in PET/CT | |
| Chung et al. | Cardiac PET motion correction using materially constrained transform models | |
| Fitzpatrick et al. | Mis-registration between emission and transmission data in cardiac PET/CT |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20080304 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| 17Q | First examination report despatched |
Effective date: 20111206 |
|
| DAX | Request for extension of the european patent (deleted) | ||
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: DA SILVA, ANGELA Inventor name: MEYER, CARSTEN Inventor name: CARLSEN, INGWER-CURT Inventor name: WISCHMANN, HANS-ALOYS Inventor name: SHAO, LINGXIONG |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 595804 Country of ref document: AT Kind code of ref document: T Effective date: 20130215 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602006034451 Country of ref document: DE Effective date: 20130328 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 595804 Country of ref document: AT Kind code of ref document: T Effective date: 20130130 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20130130 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130511 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130530 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130430 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130501 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130530 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PFA Owner name: KONINKLIJKE PHILIPS N.V., NL Free format text: FORMER OWNER: KONINKLIJKE PHILIPS ELECTRONICS N.V., NL |
|
| RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 |
|
| 26N | No opposition filed |
Effective date: 20131031 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602006034451 Country of ref document: DE Effective date: 20131031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20130727 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602006034451 Country of ref document: DE Representative=s name: MEISSNER, BOLTE & PARTNER GBR, DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130731 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130727 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130731 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602006034451 Country of ref document: DE Representative=s name: MEISSNER BOLTE PATENTANWAELTE RECHTSANWAELTE P, DE Effective date: 20140331 Ref country code: DE Ref legal event code: R081 Ref document number: 602006034451 Country of ref document: DE Owner name: KONINKLIJKE PHILIPS N.V., NL Free format text: FORMER OWNER: KONINKLIJKE PHILIPS ELECTRONICS N.V., EINDHOVEN, NL Effective date: 20140331 Ref country code: DE Ref legal event code: R082 Ref document number: 602006034451 Country of ref document: DE Representative=s name: MEISSNER, BOLTE & PARTNER GBR, DE Effective date: 20140331 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130727 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130130 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130727 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20060727 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20170727 Year of fee payment: 12 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20190930 Year of fee payment: 14 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602006034451 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210202 |
