EP2120702A2 - Automated diagnosis and alignment supplemented with pet/mr flow estimation - Google Patents
Automated diagnosis and alignment supplemented with pet/mr flow estimationInfo
- Publication number
- EP2120702A2 EP2120702A2 EP08710043A EP08710043A EP2120702A2 EP 2120702 A2 EP2120702 A2 EP 2120702A2 EP 08710043 A EP08710043 A EP 08710043A EP 08710043 A EP08710043 A EP 08710043A EP 2120702 A2 EP2120702 A2 EP 2120702A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- images
- set forth
- region
- diagnostic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5247—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/40—Detecting, measuring or recording for evaluating the nervous system
- A61B5/4076—Diagnosing or monitoring particular conditions of the nervous system
- A61B5/4088—Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/037—Emission tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room
- A61B5/0035—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/507—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for determination of haemodynamic parameters, e.g. perfusion CT
Definitions
- the present application relates to the diagnostic imaging arts. It finds particular application in early diagnosis of dementia and will be described with particular attention thereto. Aspects will have numerous other applications. Dementia affects more than 30 million people worldwide, and incidence rates are rising as the average age of the population in more affluent nations increases. Alzheimer's disease is the most common cause of dementia, and although no effective long term treatment is yet available, treatments are available that can slow the onset of dementia if the underlying cause is diagnosed early. Providing an accurate and timely diagnosis for patients exhibiting clinical symptoms of dementia is of the utmost importance in order to initiate appropriate pharmacotherapy, which is most likely to be effective when initiated soon after onset.
- a reliable diagnostic approach could potentially pave the way for screening programs to detect dementia before the onset of clinical symptoms, especially in subjects with mild cognitive impairment.
- Neuro-imaging offers a diagnostic alternative to waiting for the manifestation of clinical symptoms.
- PET imaging using a glucose based tracer provides a promising biomarker for neurodegenerative disease. Tracer uptake patterns reveal regions exhibiting reduced brain glucose metabolism. This enables clinicians to distinguish between alternative underlying causes of dementia, with different illness types yielding distinct and characteristic patterns of reduced glucose metabolism.
- An alternative approach is to use MRI based measurements of volume changes over time in the medial temporal lobe of the brain. These arise due to neuronal atrophy in the hippocampus, and have been demonstrated to provide a sensitive biomarker for progression of Alzheimer's disease.
- a solely MR based approach requires a longitudinal study to establish morphological changes, and is furthermore specific to a single cause of dementia (Alzheimer's disease). Hippocampal volume changes are very localized, with more widespread cortical atrophy effects visible only in later stages of the disease.
- PET in neuro-imaging involves measuring regional cerebral metabolic rate of glucose to identify individuals suffering from neurodegenerative diseases, such as Alzheimer's disease and other dementias, by observing characteristic patterns of hypo-metabolism in specific regions of the neo-cortex. Regions of hypo-metabolism can be identified by comparing the individual PET image to a reference population of healthy subjects in order to devise a parametric map indicating regions in which the observed intensity deviates significantly from the normal population. This requires that the images first be spatially aligned and then normalized in intensity levels. Intensity normalization requires the definition of a global scaling factor, which is applied to all image voxels to adjust image intensities to match the normal population.
- Spatial alignment is a critical step in the automated evaluation of functional images of the brain, such as fluorodeoxyglucose (FDG) PET data for evaluation of dementia patients.
- FDG fluorodeoxyglucose
- the aim is to identify brain regions exhibiting hypo- intensity, indicating (in the case of an FDG tracer) a reduced rate of glucose metabolism and thus pathologically affected brain tissue.
- the spatial distribution of the affected regions is characteristic of the underlying cause of dementias, and is an important biomarker for the differential diagnosis of diseases such as Alzheimer's disease and fronto-temporal dementia.
- a patient image should first be elastically registered with a template PET image, which defines a common reference frame. These images are aligned to an atlas image such as a Talairach atlas image.
- an atlas image such as a Talairach atlas image.
- the global intensity level is normalized, since the variations in imaging protocol and metabolism rate between patients can cause significant variations in the absolute tracer uptake in the brain.
- a voxel-wise statistical comparison is performed between intensities in patient and asymptomatic collective images, and hypo- intensity is detected at some pre-defined significance level.
- the normal collective images provide a model of the variability present within the healthy population. The model is specific to a range of factors including the patient protocol and the imaging system. The statistical comparison yields a statistical parameter map, which is interpreted visually for diagnostic purposes.
- Alignment is important in the evaluation of the images, and is also used for alignment of patient data to the template image, registration of images to each other within the healthy population sample, and for spatial normalization of the template with the healthy population sample. Resultantly, the accuracy of this alignment is of paramount importance, since it is directly linked to the validity of the evaluation. Inaccurate alignment of images in the healthy patient sample can, for example, induce higher standard deviation in the model, and leads directly to reduced sensitivity of the statistical test. Spatial alignment of two PET images is realized using elastic registration methods that optimize the parameters of fitting, and due to computational efficiency constraints, the dimensionality of the adopted non-linear transformation is generally constrained.
- An alternative approach for spatial alignment which has been proposed is to perform an intra-patient, inter-modality rigid registration between a PET and an MR image of the patient, followed by an elastic registration of the MR image with an MR template image (which is already previously aligned with the PET template). The two resulting transformations can then be concatenated and applied to the patient's PET image to derive a stereotactically normalized patient PET image.
- a "skull-stripping' pre-processing step can be utilized, since the skull structure is not present in a PET image and can thus destabilize a rigid registration between a PET image and an MR image.
- PET imaging the image is created by detecting decay of radioactive isotopes that are attached to biochemical tracers.
- PET imaging of the brain yields localized, time resolved measurements of the uptake of the applied tracer.
- a model is required to describe the transport of the tracer from the blood plasma into the imaged tissue.
- the fitting of such models to PET data typically requires estimates of the arterial blood flow rate and tracer concentration, referred to as the 'input function.'
- the most accurate method of obtaining such a measurement is direct sampling of the arterial blood. This is an invasive approach that entails significant inconvenience for the patient, so it is desirable to conceive more comfortable alternatives.
- a clinician can determine the concentration of tracer entering the brain at known time points, and then compare those values to resultant images.
- post processing methods have been typically adopted, for example using a scale factor defined using the mean intensities within a pre-imaged sampling of the healthy population. This method, however, is generally sub-optimal and can lead to artifacts in derived parametric maps.
- a method of automated diagnosis using a positron emission tomography scanner is provided.
- a diagnostic image of a region of interest is produced.
- a knowledge maintenance engine is consulted for data from past imaging scans and diagnoses.
- the diagnostic image is analyzed, identifying areas of the image that appear different from images taken of an asymptomatic control collective.
- a positron emission scanning apparatus In accordance with another aspect, a positron emission scanning apparatus is presented.
- An imaging portion generates a positron emission tomography image of a portion of a subject.
- An image memory stores a reconstructed positron emission tomography image.
- An analysis processor analyzes the positron emission tomography image and assigns a score indicative of a diagnosis.
- a knowledge maintenance engine provides previously gathered data to the analysis processor to aid the analysis processor in its analysis.
- a filter (74) limits information from the knowledge maintenance engine to information that is most pertinent to a present study.
- a method of diagnostic image registration is provided. A first diagnostic image of a region of interest is produced. A second diagnostic image of the region of interest is also produced. The first and second diagnostic images are aligned with respect to the structures present in the images.
- a method of diagnostic imaging is provided.
- a first diagnostic image of a region of interest is produced with a first image modality.
- a second diagnostic image of the region of interest is produced with a second image modality, the second modality being different than the first modality.
- the first and second diagnostic images are aligned.
- a medical abnormality appearing in at least one of the first and second diagnostic images is then diagnosed.
- a dual modality scanning apparatus is provided.
- a magnetic resonance imaging portion of the apparatus is capable of generating a magnetic resonance image of at least a portion of a subject in an imaging region.
- a magnetic resonance image memory stores a reconstructed magnetic resonance image.
- a positron emission tomography portion of the apparatus is capable of generating a positron emission tomography image of the portion of the subject.
- a positron emission tomography image memory stores a reconstructed positron emission tomography image.
- An image registration processor registers and combines the magnetic resonance image and the positron emission tomography image, forming a pair of co-registered images.
- An image memory stores the co-registered images.
- An analysis processor analyzes the co-registered images and assigns a feature vector indicative of a diagnosis.
- a knowledge maintenance engine provides previously gathered data to the analysis processor to aid the analysis processor in its analysis.
- a filter limits information from the knowledge maintenance engine to information that is most pertinent to a present study.
- a diagnostic imaging apparatus In accordance with another aspect, a diagnostic imaging apparatus is provided.
- An image construction portion generates a diagnostic image of a portion of a subject.
- An image memory stores a plurality of reconstructed images.
- An image registration processor registers and combines at least two images from the image memory, forming a pair of co-registered images.
- a co-registration image memory stores the co- registered images.
- a method of determining an amount of tracer uptake in a region of interest of a subject is provided.
- a radioisotope tagged with a tracer is injected into a subject.
- a first diagnostic image of a region of interest is produced with a first image modality.
- a second diagnostic image of the region of interest is produced with a second image modality, the second modality being different than the first modality.
- From the first diagnostic image an amount of blood inflow into the region of interest is determined with a magnetic resonance scanner.
- An amount of tracer uptake in the region of interest is calculated.
- a dual modality scanning apparatus In accordance with another aspect, a dual modality scanning apparatus is provided.
- a magnetic resonance imaging portion generates a magnetic resonance image of at least a portion of a subject in an imaging region.
- a magnetic resonance image memory stores a reconstructed magnetic resonance image.
- a positron emission tomography portion generates a positron emission tomography image of the portion of the subject.
- a positron emission tomography image memory stories a reconstructed positron emission tomography image.
- An uptake processor calculates an amount of tracer uptake in the portion of the subject by applying the relationship
- C t (t) is a tissue concentration
- C a (t) is an arterial concentration
- Ic 1 is an influx constant
- B represents a free tracer component
- One advantage lies in automated differential diagnosis and classification of patterns of hypo-intensity.
- Another advantage lies in enhanced accuracy of sterotactical normalization.
- Another advantage lies in increased consistency in outcomes, even if aspects of the imaging processes or hardware components are changed.
- Another advantage lies in improved alignment of neuro images across subjects.
- FIGURE 1 is a flow diagram of steps that a scanner proceeds through to create an automated diagnosis
- FUGURE 2 is a flow diagram of an image registration process, in accordance with the present application.
- FIGURE 3 is a flow diagram of a tracer uptake measurement, in accordance with the present application.
- FIGURE 4 is diagrammatic illustration of a combined PET/MR scanner, in accordance with the present application.
- the application now turns to description of several exemplary embodiments. While the application includes description of a combined PET/MR scanner, it is to be understood that automated diagnosis techniques and landmark based spatial alignment are not dependent on a multimodality system, but merely enhanced thereby.
- the application first discusses automated diagnosis using PET imaging, and then landmark based spatial alignment of PET images. Both of these concepts can be enhanced with concurrent MR imaging data, but the MR data is not necessary.
- the application then turns to scaling of intensity values from PET image to PET image, using the benefits of MR flow measurement.
- the application then lays the groundwork for a multimodality environment.
- a PET or other diagnostic image alone can be used to automatically diagnose medical ailments. Again, the present embodiment is described with reference to diagnosing degenerative neurological diseases, but it is to be understood that the nature of the PET imaging modality can be used in conjunction with myriad other diagnoses.
- FIGURE 1 a system for automated evaluation of dementia is illustrated. An analysis 60 of the PET image data is performed with a data analysis processor 62. Another possibility is that single photon emission computed tomography (SPECT) image data can be used in place of the PET image data. Significant deviations between the calibrated physiological input data and an asymptomatic collective are detected. The system 10 notes the deviations in step 64 and classifies the ailment in step 66. Standard statistical tests, e.g. the test currently used serve as straightforward implementation.
- SPECT single photon emission computed tomography
- the result of such a comparison is a data set giving for each location in the field of view a difference measure indicative of the deviation between the tracer uptake at that particular location in the patient data and the corresponding location in the control collective.
- the spatial distribution of these deviations is (in the case of an FDG tracer) characteristic of the type of dementia.
- the spatial distribution of areas of significant hypo-intensity is compared to a set of models representing disease specific patterns.
- the set of models may be derived from group based testing of patients with confirmed diagnoses, with respect to the healthy reference collective.
- the comparison of these models to the patterns derived from the current patient provides a quantitative basis on which to perform a fully automated differential diagnosis. This step enables a completely computer assisted diagnosis of the input patient image data.
- the system uses several knowledge sources that are all a part of a collective knowledge maintenance engine 70.
- the knowledge maintenance engine 70 can be, for example, a hospital wide database or a larger scale, as in a multi-hospital network database, or further, a publicly accessible information database.
- a hospital wide database or a larger scale as in a multi-hospital network database, or further, a publicly accessible information database.
- scanner specific data it is also advantageous to have as much clinical data as possible on hand to assist a diagnosis. If the instant scanner has not performed enough scans to adequately support a diagnosis, the knowledge maintenance engine 70 ensures that adequate substitute data is available.
- the knowledge maintenance engine 70 contains an acquisition protocol database 72.
- This database provides the modality and tracer specific information characteristic of the currently used acquisition protocol, as needed for the calibration of the physiological input data in conjunction with morphological input data. Often the analysis of the data will depend on the tracer that is used, so that information is provided so a filter 74 can select past scans that used the appropriate tracer or comparable tracers.
- control collective database 76 Another source of information available to the system is a control collective database 76.
- This database provides acquisition specific information needed to tell where and to what extent an individual patient data set significantly differs from the control collective.
- the control collective database 76 contains a sample of healthy subjects for comparison. This information is important for deciding whether a patient suffers from a disease indicated by variance of the patient's image to the control collective. If the patient' s scan shows areas of hypo-intensity not in the control collective, then it is likely that further investigation is in order.
- the control collective is comprised of images taken on the present scanner system; intensities, calibrations, artifacts, and the like are the same across the collective and present image data. Alternately, compensation algorithms can be constructed to normalize the control collective to the present images.
- the intensity of each voxel is compared with the corresponding voxel of one or more normal brain scans. Based on these comparisons, potentially weighted for regions of the brain that are more or less characteristic of dementia, the analysis 60 determines whether the patient is healthy, may be showing signs of dementia, etc. Further, the voxels which differ significantly from normal are used to generated the deviation pattern 64.
- the system also includes a geometric reference database 78.
- This database defines a common geometric reference system of the control collective and the calibrated patient data. It contains all information for identifying and matching corresponding structures in the patient data and the control collective so that both data sets can be geometrically aligned as needed for the determination of the spatial distribution of deviation patterns between them. This component is specific to the geometrical arrangements of the data acquisition as well as the target application.
- the knowledge maintenance engine 70 also contains a disease template database 80. This database contains disease and acquisition specific information needed to detect and classify the spatial distribution of the deviations from the control collective into characteristic patterns that allow for the scoring of different forms of dementia in the respective brain areas.
- the disease template 80 includes a symptomatic collective or array of images that are characteristic of various dementia or dementia components.
- the filter 74 can limit comparison studies from the control collective database 76, the geometric reference database 78 and the disease template database 80 to studies that are most relevant to the present subject. For example, only data using the same tracer, geometry, disease pattern, and the like could be used in analysis of the present scan.
- the knowledge sources are properly selected and configured in light of the target, present application. This entails, for example, selecting the proper knowledge source from a pre-defined set of knowledge sources. This can be done automatically according to data retrieved from an electronic patient record or interactively by a technician performing the data acquisition.
- the system can adjust for minor inconsistencies, requesting different subsets of information from the knowledge maintenance engine 70 based on, e.g., changes in the acquisition protocol, changes in the imaging equipment, etc. Changes and deviations among the knowledge sources that exceed certain safety margins can be signaled lest they jeopardize the quality of the final pattern classification and scoring. If appropriate, the system can update the knowledge maintenance engine 70 with the results of the present scan. This and other maintenance tasks can be performed by a quality control processor 82 ensuring internal consistency of the knowledge maintenance engine 70.
- the knowledge maintenance engine 70 safeguards the result against malfunctions in the acquisition of the input images or changes in the patient clientele violating the validated application domain of the normal collectives.
- the system can also be used to control and supervise the accumulation of new knowledge sources as needed by specific forms of neurodegenerative diseases or new and more specific tracer substances.
- new knowledge sources as needed by specific forms of neurodegenerative diseases or new and more specific tracer substances.
- the comparison 66 of the deviation pattern 64 with the array of dementia characteristic patterns 80 results in a series of similarity/dissimilarity values or vectors.
- the orientation/direction of these vectors is indicative of a dementia type and their magnitude is indicative of the degree of advancement of the dementia.
- the system assigns a diagnosis score 84 (such as a feature vector) to the analyzed image.
- a diagnosis score 84 (such as a feature vector) to the analyzed image. This provides the clinician with an estimate of the type of ailment.
- the system identifies the type of dementia that it is evident from the scans.
- the score can also reflect the probability, that is, the confidence that the indicated diagnosis is the correct diagnosis.
- the score can also reflect all of the various factors that play into the diagnosis, such as the areas affected, the degree of hypo-intensity, the extent of the hypo-intensity, and the like. It is preferable that the score, once provided to a clinician, can indicate an immediate estimate of the type and severity of the ailment.
- images of the region of interest are produced using both modalities.
- co-registered images can be produced by combining PET images of both PET and with images in which alignment points are clearly identifiable, such as MR, CT, or the like.
- PET and MRI represent substantially different techniques of image acquisition, which in no small part contributes to the complimentary nature of the two modalities, certain landmarks appear in both imaging modalities.
- the images can be co-registered into a representation with the advantages of both modalities by combining an inter-modality rigid registration with an automated MR landmark extraction.
- the PET and MR images are collected concurrently or sequentially with scanning equipment with a known spatial relationship such that the PET and MR images are inherently aligned.
- the comparison of the patient image with the healthy brain images of the control collective 76 and the diseased images of the disease templates 80 is more accurate if the images are all scaled to the same size and if their brightness, intensity and other image properties are also normalized.
- a nominal skull size and orientation is developed and alignment points are selected.
- corresponding points in the patient image are identified and the patient image is elastically transformed such that the alignment points of the patient image overlay the alignment points of the template.
- the alignment points are only in the MR image and the intrinsically aligned PET image is transformed analogously.
- some alignment points in the PET or SPECT image are used. The number of points can be only a few or can be very large.
- the bone is extracted forming an image of the skull and the transform is determined by aligning the two images.
- the transform is determined by aligning the two images.
- only selected points in the skull and or soft tissue are used to determine the transform.
- an alignment template can be developed 92 by a known geometry, of a phantom 94, a normal sized patient skull, an average of prior images, or the like.
- the template has with markers or structures that are readily identifiable.
- the mathematical transformation model and commonly matching target structures are provided by the template and the previously aligned atlas.
- Different forms of spatial alignment can be used, for example, a geometric brain model might be used to determine brain anatomy as derived from the MRI data, registration to the "average" tracer uptake pattern of a control collective, extraction of common anatomical landmarks clearly visible and unambiguously identifiable in the MRI and PET data, and the like.
- the accurate definition of the landmarks in a high resolution MR image enables improved alignment of neuro (and other) images across subjects. In the particular case of a brain image, the local variation in the region of the selected structures is minimized.
- Automatic landmark extraction 96 from an MR image is used to align a corresponding PET image of the same region of interest of the subject with the template.
- the extraction of landmark positions in the MR image is preferably automated. Alternately, it can be performed manually by an imaging technician, but this is more time intensive.
- positions of a sparse set of landmarks are estimated in a set of characteristic two- dimensional planes. This can be done, for example, by implementing a SmartExamTM package available on MR consoles.
- initial positioning of three-dimensional models of anatomical structures is performed. By using the landmarks previously obtained, the size and orientation of these structures (e.g. ventricle, cerebellum, and brain stem) can be placed.
- the initial models are refined and adapted to match the position, orientation, and shape of the current subject's anatomy.
- a set of anatomical landmarks is defined according to the final three-dimensional model positioning. These landmarks can also be points of the three-dimensional models themselves.
- the landmarks are identified in the MR image, they are identified in the PET image so the PET or both images can be aligned with the template.
- the landmarks are transformed from MR space into PET space by using the estimated rigid registration parameters. Given the positions of these landmarks in at least two PET images (e.g. the current subject's image and a template image derived from the control collective) these images can be aligned into a common space as follows.
- the positions of corresponding landmarks can be used to define a transformation for an arbitrary spatial location. For example, thin plate spline interpolation can be used. The interpolation enables image re-sampling such that one of the images can be re-sampled in alignment with the other image. Images so co-registered provide the benefits of both the MR and PET modalities to the clinician.
- tracer uptake characteristics can be calculated.
- common methods of measuring blood flow to the brain include invasive, time consuming arterial sampling that provides significant discomfort to the patient.
- State of the art MR scanners can be configured to measure the inflow of blood to the brain via the carotid artery with a high degree of accuracy, and thus, an uptake processor 102 can calculate tracer uptake.
- an uptake processor 102 can calculate tracer uptake.
- FIGURE 3 during a PET scan, a known volume of radioisotope tagged with a biological tracer is introduced into the patient 104.
- glucose is a common tracer.
- the imaged concentration can be divided into a free tracer component and an accumulating tracer component that represents the bound tracer 106.
- the Patlak model is an exemplary model for this calculation. Further, it is assumed that the free tracer component follows the general blood flow activity, with kinetics that are more rapid than the metabolic rate, such that the free tracer component approaches a constant B. Thus, a model of the two components can be expressed by the equation
- the tissue concentration C t (t) is measured 108 in relative terms in the PET image, and the arterial concentration C a (t) is measured 110 using MR flow estimation techniques, enabling estimation of the influx constant k ⁇ Resultantly, the absolute level of activity in the tissue is determined, and assuming that corresponding measurements are available for sets of reference or control images, the appropriate scaling factor can be determined 112.
- the uptake calculation has been described for measuring the uptake of tracer into the brain, but it is to be understood that uptakes in other regions of interest and/or using other tracer tags for the radioisotope have been contemplated.
- the application also finds use in SPECT. As available tracers and data acquisition geometries improve, SPECT imaging could potentially become as fast as PET, and would also allow for pharmacokinetic modeling.
- an embodiment of a combined or hybrid magnetic resonance (MR) and PET data acquisition system 110 which generates intrinsically aligned PET and MR images.
- MR magnetic resonance
- PET data acquisition system 110 which generates intrinsically aligned PET and MR images.
- the illustrated scanner 110 is a coplanar system, but other scanner orientations are equally plausible, such as side-by-side systems, insert systems, and the like.
- a magnetic resonance scanner includes a magnet 112 including a plurality of conductor coil windings (diagrammatically depicted in FIGURE 4 by boxes with crossing lines) that generate a static magnetic field B 0 within an imaging region 114.
- the magnet 112 may be superconducting or resistive in nature; in the former case the magnet 112 is typically disposed in a cryogenic container or other cooling system (not shown).
- the illustrated magnet 112 is a solenoidal magnet having a relatively horizontal Bo field through the imaging region 114. Though the polarity of the B 0 field is shown left to right, the opposite polarity is also suitable. In other embodiments, the magnet 112 may be otherwise oriented to produce a vertical or otherwise-oriented static magnetic field.
- the magnetic resonance scanner also includes a magnetic field gradient assembly, which in the illustrative embodiment of FIGURE 4 includes gradient coil windings 116 that cooperatively superimpose magnetic field gradients on the static B 0 magnetic field responsive to selective energizing of selected gradient coil windings 116.
- the magnetic field gradient coil, magnet, or both may include other features not shown for forming, stabilizing, and dynamically adjusting the magnetic field, such as passive ferromagnetic shims, active shimming coils, and the like.
- the magnetic resonance scanner further includes a radio frequency excitation and reception system 118.
- the radio frequency system includes at least one component, such as the illustrated radio frequency coil 118, that can be energized at a suitable radio frequency to excite magnetic resonance in a subject disposed in the imaging region 114.
- the coil 118 can also operate as a radio frequency receiver to receive or detect magnetic resonance emanating from the imaging region 114 after RF excitation. In some embodiments, different coils are used for the excitation and reception operations.
- the built-in coil 118 may be used to excite magnetic resonance, and a different, local coil (not shown) may be positioned over or close to the subject in the imaging region 114 to detect magnetic resonance. It is contemplated for the same magnetic resonance scanner to be configurable in different ways using different combinations of built-in coils, local coils, or both.
- Received magnetic resonance samples are stored in a magnetic resonance sampling storage 120.
- a magnetic resonance reconstruction processor 122 applies a suitable reconstruction algorithm to reconstruct the magnetic resonance samples to form a reconstructed image that is stored in a magnetic resonance image memory 124.
- the reconstruction processor 122 applies a reconstruction algorithm that comports with the selected spatial encoding used in generating the magnetic resonance data. For example, a Fourier transform reconstruction algorithm may be suitable for reconstructing Cartesian-encoded magnetic resonance data.
- the illustrated combined or hybrid MR and PET data acquisition system 110 further includes radiation detectors for performing PET data acquisition.
- the radiation detectors include first and second arrays 130, 132 of radiation detectors.
- each of the illustrated generally planar detector arrays 130, 132 includes a scintillator layer and a layer of electron multiplier-based photon detectors, however, other detector configurations such as a cylindrical detector array disposed about the imaging region 114 are contemplated.
- Solid state radiation detectors and solid state optical detectors are also contemplated.
- Each of the radiation detector arrays 130, 132 is configured to detect 511 keV gamma rays that are emitted by positron-electron annihilation events.
- two substantially simultaneous 511 keV gamma ray detection events are presumed to have originated from the same positron-electron annihilation event, which is therefore located somewhere along a "line of response" (LOR) connecting the two substantially simultaneous 511 keV gamma ray detection events.
- This line of response is also sometimes called a projection or a ray, and the collected PET data is referred to as projection data.
- substantially simultaneous 511 keV gamma ray detection events are defined as two 511 keV gamma ray detection events occurring within a selected short time window, such as within one nanosecond of each other. Due to the variable annihilation position with respect to the detector elements a small (e.g., sub-nanosecond) time difference between the substantially simultaneous gamma photon detection events occurs.
- a related technique called time-of-flight PET or TOF-PET, takes advantage of this small time difference to further localize the positron-electron annihilation event along the LOR.
- the radiation detector arrays 130, 132 of the hybrid system 110 are used to acquire PET or TOF-PET data.
- the gamma ray detection events are processed by a PET digitization unit 134 that performs time-to-digital conversion (TDC) and analog-to-digital conversion (ADC) of detection events, and a singles processing unit 136 that performs clustering, energy estimation, timestamping, and positioning.
- the singles processing unit 136 optionally filters out detections that are outside of a selection energy window centered about on the expected 511 keV gamma ray energy.
- the radiation detectors are pixelated, so that the spatial localization of the gamma ray detection events defining the projection correspond to a pixel size (i.e., physical size) of the radiation detectors of the radiation detector arrays 130, 132.
- clustering is applied by a block readout algorithm such as Anger logic or the like to provide further spatial localization refinement of the gamma ray detection events defining the projection.
- a coincidence detection processor 138 employs temporal windowing to identify gamma ray detection events that occurred substantially simultaneously, and hence likely correspond to a common positron-electron annihilation event and hence define a projection or line of response.
- the singles processing 136 and coincidence detection processing 138 can be swapped or interleaved so that the time difference between the identified substantially simultaneous or coincident detection events can be used to spatially localize the positron-electron annihilation event along the projection or line of response.
- the resulting PET or TOF-PET data are stored in a PET data storage 140.
- a PET reconstruction processor 142 processes the projection or localized projection data using a suitable reconstruction algorithm to generate a reconstructed image that is stored in a PET images storage 144.
- a filtered backprojection algorithm or iterative reconstruction algorithm can be employed.
- the system of FIGURE 4 includes a discontinuous radiation detector array 130, 132 for PET that does not completely encircle the subject. The incomplete encirclement can lead to imaging artifacts due to "missing" projections or lines of response. For example, in the system of FIGURE 4 no perfectly horizontal projections are collected, and so information ordinarily provided by such horizontal projections about vertical position is unavailable.
- time-of-flight PET data are acquired and reconstructed then the time-of-flight localization provides additional information that compensates for the information that is lost by incomplete encirclement.
- the aforementioned missing information about vertical position can be compensated by a TOF-localized vertical projection, since the temporal localization of the electron-positron annihilation event along the vertical projection provides information about its vertical position.
- MR and PET acquisitions are optionally performed concurrently. Alternatively or additionally, MR and PET acquisition can be done sequentially (e.g., MR first followed by PET, or vice versa) or can be interleaved.
- An image registration processor 150 spatially registers and optionally temporally registers the reconstructed MR and PET images. If created, the co-registered images are stored in a co-registration image memory 152. The images so registered are suitably displayed on a display device 154, rendered using suitable two- or three-dimensional rendering software, or otherwise processed.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Veterinary Medicine (AREA)
- Surgery (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- High Energy & Nuclear Physics (AREA)
- Neurology (AREA)
- Radiology & Medical Imaging (AREA)
- Optics & Photonics (AREA)
- Child & Adolescent Psychology (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Neurosurgery (AREA)
- Physiology (AREA)
- Developmental Disabilities (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Nuclear Medicine (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US89324107P | 2007-03-06 | 2007-03-06 | |
| PCT/IB2008/050545 WO2008107809A2 (en) | 2007-03-06 | 2008-02-14 | Automated diagnosis and alignment supplemented with pet/mr flow estimation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP2120702A2 true EP2120702A2 (en) | 2009-11-25 |
| EP2120702B1 EP2120702B1 (en) | 2014-04-09 |
Family
ID=39580009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP08710043.4A Not-in-force EP2120702B1 (en) | 2007-03-06 | 2008-02-14 | Automated diagnosis and alignment supplemented with pet/mr flow estimation |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US8488857B2 (en) |
| EP (1) | EP2120702B1 (en) |
| JP (1) | JP5424902B2 (en) |
| CN (1) | CN101626727B (en) |
| WO (1) | WO2008107809A2 (en) |
Families Citing this family (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102007023657B4 (en) * | 2007-05-22 | 2014-03-20 | Siemens Aktiengesellschaft | Method for data acquisition in a functional brain examination with a combined magnetic resonance PET device |
| US8218905B2 (en) * | 2007-10-12 | 2012-07-10 | Claron Technology Inc. | Method, system and software product for providing efficient registration of 3D image data |
| CN102355859A (en) * | 2009-03-19 | 2012-02-15 | 皇家飞利浦电子股份有限公司 | Functional imaging |
| US9020216B2 (en) | 2010-07-28 | 2015-04-28 | Varian Medical Systems, Inc. | Knowledge-based automatic image segmentation |
| US9454823B2 (en) * | 2010-07-28 | 2016-09-27 | arian Medical Systems, Inc. | Knowledge-based automatic image segmentation |
| US8934685B2 (en) * | 2010-09-21 | 2015-01-13 | General Electric Company | System and method for analyzing and visualizing local clinical features |
| CN103260522A (en) * | 2010-12-16 | 2013-08-21 | 皇家飞利浦电子股份有限公司 | Equipment for hybrid CT-MRI and nuclear imaging, cross-calibration, and performance evaluation |
| CN103501701B (en) * | 2011-04-26 | 2017-02-15 | 皇家飞利浦有限公司 | diagnostic brain imaging |
| EP2760337A2 (en) * | 2011-09-26 | 2014-08-06 | Acuitas Medical Limited | Method for detection of characteristics of organ fibrosis |
| CN104093354B (en) * | 2011-12-15 | 2017-06-09 | 联邦科学与工业研究组织 | Method and apparatus for assessing medical image |
| US9053213B2 (en) | 2012-02-07 | 2015-06-09 | Koninklijke Philps N.V. | Interactive optimization of scan databases for statistical testing |
| RU2014140480A (en) * | 2012-03-08 | 2016-04-27 | Конинклейке Филипс Н.В. | INTELLECTUAL CHOICE OF GUIDELINES FOR INCREASING THE ACCURACY OF THE COMBINATION WHEN MERGING IMAGES RECEIVED BY VARIOUS DEVICES |
| US9554707B2 (en) | 2012-06-29 | 2017-01-31 | General Electric Company | Concurrent acquisition of PET fields during acquisition of a MRI field of view |
| EP3879487B1 (en) * | 2012-10-26 | 2023-11-29 | Brainlab AG | Matching patient images and images of an anatomical atlas |
| CN103919554A (en) * | 2013-01-16 | 2014-07-16 | 李茗 | Novel magnetic resonance technology for inner ear lymph |
| US10939822B2 (en) * | 2013-01-24 | 2021-03-09 | Tylerton International Holdings Inc. | Body structure imaging |
| JP2016508769A (en) * | 2013-01-28 | 2016-03-24 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Medical image processing |
| US9332954B2 (en) * | 2013-03-15 | 2016-05-10 | Jacqueline K. Vestevich | Systems and methods for evaluating a brain scan |
| US9741131B2 (en) * | 2013-07-17 | 2017-08-22 | Siemens Medical Solutions Usa, Inc. | Anatomy aware articulated registration for image segmentation |
| CN103800076B (en) * | 2014-01-14 | 2016-02-03 | 中国科学院自动化研究所 | A kind of structure-optics-nucleic multi-mode imaging system and method |
| CN106663321B (en) * | 2014-07-15 | 2021-04-06 | 皇家飞利浦有限公司 | Statistical testing of imaging data including stereotaxic normalization using personalized template images |
| KR101696061B1 (en) * | 2015-03-05 | 2017-01-13 | 재단법인 아산사회복지재단 | Methods and apparatus for acquiring image based biomarkers suitable for diagnosis of neurodegenerative diseases and methods for diagnosing neurodegenerative diseases |
| US9606245B1 (en) | 2015-03-24 | 2017-03-28 | The Research Foundation For The State University Of New York | Autonomous gamma, X-ray, and particle detector |
| US10357217B2 (en) * | 2016-10-18 | 2019-07-23 | The Regents Of The University Of California | Method for positron emission tomography (PET) imaging analysis for classifying and diagnosing of neurological diseases |
| US11000255B2 (en) * | 2017-02-24 | 2021-05-11 | Bayer Healthcare Llc | Systems and methods for generating simulated computed tomography (CT) images |
| EP3382647A1 (en) * | 2017-03-31 | 2018-10-03 | Koninklijke Philips N.V. | Device and method for sketch template generation or adaption |
| US10403010B2 (en) * | 2017-09-19 | 2019-09-03 | General Electric Company | Methods and systems for reconstructing images |
| CL2018001428A1 (en) * | 2018-05-28 | 2018-08-24 | Univ Del Desarrollo | A method to process brain images. |
| CN109166108B (en) * | 2018-08-14 | 2022-04-08 | 上海融达信息科技有限公司 | Automatic identification method for abnormal lung tissue of CT (computed tomography) image |
| DK180231B1 (en) * | 2018-10-31 | 2020-08-28 | Synaptic Aps | Method of establishing a brain status indication parameter and system therefor |
| CN110477941B (en) * | 2019-08-19 | 2023-06-27 | 上海联影医疗科技股份有限公司 | Uptake value correction method, device, computer equipment and readable storage medium |
| CN110544252A (en) * | 2019-09-05 | 2019-12-06 | 重庆邮电大学 | Auxiliary diagnosis system for Parkinson's disease based on multimodal magnetic resonance brain imaging |
| US11462315B2 (en) | 2019-11-26 | 2022-10-04 | Enlitic, Inc. | Medical scan co-registration and methods for use therewith |
| JPWO2021220597A1 (en) * | 2020-04-28 | 2021-11-04 | ||
| EP4208812A4 (en) * | 2020-09-02 | 2024-12-25 | The General Hospital Corporation | Methods for identifying cross-modal features from spatially resolved data sets |
| JPWO2022054711A1 (en) * | 2020-09-10 | 2022-03-17 | ||
| US12136484B2 (en) | 2021-11-05 | 2024-11-05 | Altis Labs, Inc. | Method and apparatus utilizing image-based modeling in healthcare |
| CN119048694A (en) * | 2024-10-31 | 2024-11-29 | 福建智康云医疗科技有限公司 | Multi-mode-based three-dimensional image post-processing method and system |
Family Cites Families (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3890959A (en) * | 1971-03-22 | 1975-06-24 | Univ New York | Method for determining discrete localized blood flow in a large volume of tissue |
| US5300886A (en) | 1992-02-28 | 1994-04-05 | The United States Of America As Represented By The Department Of Health & Human Services | Method to enhance the sensitivity of MRI for magnetic susceptibility effects |
| JPH07204170A (en) * | 1994-01-25 | 1995-08-08 | Hitachi Ltd | Activation area extraction method |
| IL139655A0 (en) * | 2000-11-14 | 2002-02-10 | Hillman Yitzchak | A method and a system for combining automated medical and psychiatric profiling from combined input images of brain scans with observed expert and automated interpreter using a neural network |
| US20040092809A1 (en) * | 2002-07-26 | 2004-05-13 | Neurion Inc. | Methods for measurement and analysis of brain activity |
| US7433540B1 (en) * | 2002-10-25 | 2008-10-07 | Adobe Systems Incorporated | Decomposing natural image sequences |
| US7458936B2 (en) * | 2003-03-12 | 2008-12-02 | Siemens Medical Solutions Usa, Inc. | System and method for performing probabilistic classification and decision support using multidimensional medical image databases |
| US7912528B2 (en) * | 2003-06-25 | 2011-03-22 | Siemens Medical Solutions Usa, Inc. | Systems and methods for automated diagnosis and decision support for heart related diseases and conditions |
| US7873405B2 (en) * | 2004-06-02 | 2011-01-18 | Siemens Medical Solutions Usa, Inc. | Automated detection of Alzheimer's disease by statistical analysis with positron emission tomography images |
| US20060030769A1 (en) * | 2004-06-18 | 2006-02-09 | Ramamurthy Venkat R | System and method for loading timepoints for analysis of disease progression or response to therapy |
| JP2006167289A (en) * | 2004-12-17 | 2006-06-29 | Toshiba Corp | Composite image diagnosis support system, composite image diagnosis support device, and medical image database creation method |
| JP4824321B2 (en) * | 2005-01-28 | 2011-11-30 | 富士フイルムRiファーマ株式会社 | Image data analysis system, method and computer program |
| DE102005015070B4 (en) * | 2005-04-01 | 2017-02-02 | Siemens Healthcare Gmbh | Combined positron emission tomography and magnetic resonance tomography device |
| WO2006119085A2 (en) | 2005-04-29 | 2006-11-09 | The Regents Of The University Of California | Integrated pet-mri scanner |
| JP4581088B2 (en) * | 2005-05-17 | 2010-11-17 | 国立大学法人 筑波大学 | Computer-aided diagnosis apparatus and method |
| EP1909574A2 (en) * | 2005-08-03 | 2008-04-16 | Socratech L.L.C. | Role of gax in alzheimer neurovascular dysfunction |
| WO2008005513A2 (en) * | 2006-07-06 | 2008-01-10 | Regents Of The University Of Minnesota | Analysis of brain patterns using temporal measures |
| WO2010052731A1 (en) * | 2008-11-07 | 2010-05-14 | Department Of Biotechnology | A ready automated screening, diagnosis & classification technique for alzheimer's disease using magnetic resonance imaging signal from ventricular zone contour of brain |
| AU2010202926B2 (en) * | 2009-09-11 | 2016-07-14 | Electrophoretics Limited | Markers and methods relating to the assessment of Alzheimer's disease |
-
2008
- 2008-02-14 US US12/529,195 patent/US8488857B2/en not_active Expired - Fee Related
- 2008-02-14 JP JP2009552302A patent/JP5424902B2/en not_active Expired - Fee Related
- 2008-02-14 WO PCT/IB2008/050545 patent/WO2008107809A2/en not_active Ceased
- 2008-02-14 CN CN2008800070420A patent/CN101626727B/en not_active Expired - Fee Related
- 2008-02-14 EP EP08710043.4A patent/EP2120702B1/en not_active Not-in-force
Non-Patent Citations (1)
| Title |
|---|
| See references of WO2008107809A3 * |
Also Published As
| Publication number | Publication date |
|---|---|
| US8488857B2 (en) | 2013-07-16 |
| WO2008107809A2 (en) | 2008-09-12 |
| JP2010520478A (en) | 2010-06-10 |
| JP5424902B2 (en) | 2014-02-26 |
| CN101626727B (en) | 2012-02-15 |
| EP2120702B1 (en) | 2014-04-09 |
| CN101626727A (en) | 2010-01-13 |
| WO2008107809A3 (en) | 2008-12-04 |
| US20100152577A1 (en) | 2010-06-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2120702B1 (en) | Automated diagnosis and alignment supplemented with pet/mr flow estimation | |
| US12171542B2 (en) | Systems and methods for estimating histological features from medical images using a trained model | |
| JP5468905B2 (en) | Tools to help diagnose neurodegenerative diseases | |
| EP2747658B1 (en) | Method to compute and present brain amyloid in gray matter | |
| US11835612B2 (en) | System and method for motion correction of magnetic resonance image | |
| EP2787882B1 (en) | Positioning of a volume of interest for magnetic resonance spectroscopic imaging | |
| JP2017124039A (en) | Image processing device and image processing program | |
| Cabello et al. | Comparison between MRI-based attenuation correction methods for brain PET in dementia patients | |
| Zwanenburg et al. | Generalized multiple-layer appearance of the cerebral cortex with 3D FLAIR 7.0-T MR imaging | |
| CN114098696B (en) | Magnetic resonance imaging device | |
| KR102144721B1 (en) | How to increase the chances of clinical trial success probability by selecting gruops of patients with parkinson's disease | |
| Roy et al. | Enhancing patient care with modality-based image registration in modern healthcare | |
| US10269115B2 (en) | Imaging data statistical testing including a stereotactical normalization with a personalized template image | |
| Pietrzyk et al. | Does PET/MR in human brain imaging provide optimal co-registration? A critical reflection | |
| EP3718468B1 (en) | Age-specific image atlas | |
| Boivin et al. | MRI-guided partial volume correction in brain PET imaging: comparison of five algorithms | |
| Efthimiou et al. | Tangible advantages of multi-stage brain motion compensation for PET imaging demonstrated in multiple studies | |
| Parsayan et al. | Odense-Oxford PET Image Analysis (OPETIA): An FSL-based toolbox for multimodal neuroimaging | |
| Roy et al. | 5 Enhancing with Modality-Based Patient Care Image Registration in Modern Healthcare | |
| Simon et al. | A Software Tool to automatically evaluate and quantify Diffusion Weighted Images | |
| Lu et al. | Partial volume correction of magnetic resonance spectroscopic imaging | |
| BR112018002613B1 (en) | MULTI-MODALITY IMAGING SYSTEM AND METHOD |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20091006 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
| 17Q | First examination report despatched |
Effective date: 20100115 |
|
| DAX | Request for extension of the european patent (deleted) | ||
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: PHILIPS INTELLECTUAL PROPERTY & STANDARDS GMBH Owner name: KONINKLIJKE PHILIPS N.V. |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| INTG | Intention to grant announced |
Effective date: 20131011 |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. Owner name: PHILIPS INTELLECTUAL PROPERTY & STANDARDS GMBH |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 660865 Country of ref document: AT Kind code of ref document: T Effective date: 20140415 Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602008031381 Country of ref document: DE Effective date: 20140522 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 660865 Country of ref document: AT Kind code of ref document: T Effective date: 20140409 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20140409 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140709 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140710 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140709 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140809 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140811 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602008031381 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20150112 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602008031381 Country of ref document: DE Effective date: 20150112 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602008031381 Country of ref document: DE Representative=s name: MEISSNER BOLTE PATENTANWAELTE RECHTSANWAELTE P, DE Ref country code: DE Ref legal event code: R082 Ref document number: 602008031381 Country of ref document: DE Representative=s name: MEISSNER, BOLTE & PARTNER GBR, DE Ref country code: DE Ref legal event code: R081 Ref document number: 602008031381 Country of ref document: DE Owner name: PHILIPS GMBH, DE Free format text: FORMER OWNER: PHILIPS INTELLECTUAL PROPERTY & STANDARDS GMBH, 20099 HAMBURG, DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150214 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150228 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150228 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20151030 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150214 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150302 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20080214 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602008031381 Country of ref document: DE Representative=s name: MEISSNER BOLTE PATENTANWAELTE RECHTSANWAELTE P, DE Ref country code: DE Ref legal event code: R081 Ref document number: 602008031381 Country of ref document: DE Owner name: PHILIPS GMBH, DE Free format text: FORMER OWNER: PHILIPS GMBH, 20099 HAMBURG, DE |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 602008031381 Country of ref document: DE |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240228 Year of fee payment: 17 Ref country code: GB Payment date: 20240220 Year of fee payment: 17 |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: 746 Effective date: 20240620 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602008031381 Country of ref document: DE |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20250214 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20250902 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20250214 |