EP1965703A2 - Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet - Google Patents

Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet

Info

Publication number
EP1965703A2
EP1965703A2 EP06832175A EP06832175A EP1965703A2 EP 1965703 A2 EP1965703 A2 EP 1965703A2 EP 06832175 A EP06832175 A EP 06832175A EP 06832175 A EP06832175 A EP 06832175A EP 1965703 A2 EP1965703 A2 EP 1965703A2
Authority
EP
European Patent Office
Prior art keywords
sequence
data sets
reconstruction unit
reconstructing
data set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP06832175A
Other languages
German (de)
English (en)
Other versions
EP1965703B1 (fr
Inventor
Michael Grass
Jens Von Berg
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Philips Intellectual Property and Standards GmbH
Koninklijke Philips NV
Original Assignee
Philips Intellectual Property and Standards GmbH
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Philips Intellectual Property and Standards GmbH, Koninklijke Philips Electronics NV filed Critical Philips Intellectual Property and Standards GmbH
Priority to EP06832175.1A priority Critical patent/EP1965703B1/fr
Publication of EP1965703A2 publication Critical patent/EP1965703A2/fr
Application granted granted Critical
Publication of EP1965703B1 publication Critical patent/EP1965703B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03—Computed tomography [CT]
    • A61B6/032—Transmission computed tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/003—Reconstruction from projections, e.g. tomography
    • G06T11/005—Specific pre-processing for tomographic reconstruction, e.g. calibration, source positioning, rebinning, scatter correction, retrospective gating
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271—Specific aspects of physiological measurement analysis
    • A61B5/7285—Specific aspects of physiological measurement analysis for synchronising or triggering a physiological measurement or image acquisition with a physiological event or waveform, e.g. an ECG signal
    • A61B5/7289—Retrospective gating, i.e. associating measured signals or images with a physiological event after the actual measurement or image acquisition, e.g. by simultaneously recording an additional physiological signal during the measurement or image acquisition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/40—Arrangements for generating radiation specially adapted for radiation diagnosis
    • A61B6/4064—Arrangements for generating radiation specially adapted for radiation diagnosis specially adapted for producing a particular type of beam
    • A61B6/4085—Cone-beams
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
    • A61B6/503—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of the heart
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2211/00—Image generation
    • G06T2211/40—Computed tomography
    • G06T2211/412—Dynamic

Definitions

  • Reconstruction unit for reconstructing a fine reproduction of at least a part of an object
  • the invention relates to a reconstruction unit for reconstructing a fine reproduction of at least a part of an object, a corresponding method, an examination apparatus, a computer-readable medium and a program element.
  • the invention relates to a reconstruction unit for reconstructing a fine reproduction of at least a part of an object, wherein the reproduction is executed on data detected by a tomography device.
  • Deploying computer tomography (CT) for object reconstruction aims to scan an object and to reconstruct a reproduction of the object, which object is enclosed by a body.
  • the non-invasive method of scanning the object is a common procedure to obtain information about the object for diagnostic purposes.
  • An image of the object is generated.
  • the image can be analysed and an abnormality of an inner structure of the object may be detected.
  • CT scanning is quite often deployed to obtain information of a heart in the body of an human being e.g. calcification in the coronary arteries can be detected.
  • the reconstructed pictures may be blurry depending on the phase point of the cardiac cycle when the scan was performed or the projection data were selected and the image of the heart was reconstructed.
  • the phase point determines the centre of the interval of the cardiac cycle, or also named RR-interval, were the projection data have been selected or measured.
  • the automatic determination of an applicable phase point for retrospectively gated cardiac reconstruction remains as one of the key problems for CT based non-invasive coronary angiography.
  • the determination of an applicable phase point can improve the quality of a reconstructed image of an object.
  • model based approaches have been used, followed by image processing based methods.
  • a reconstruction unit for reconstructing a fine reproduction of at least a part of an object is provided, wherein the reconstruction unit is adapted for receiving a sequence of data sets, the data sets representing structural information of the object. In parallel scheduling information related to the data sets of the sequence of data sets is received. Then a sequence of coarse reconstructions of the object is reconstructed by combining the sequence of data sets and the scheduling information.
  • a sequence of adapted models of the object is generated by adapting a respective model, in particular a basic model, to each of the coarse reconstructions.
  • a motion of a predetermined portion of each of the adapted models is determined.
  • a specific data set of the sequence of data sets is selected, wherein the specific data set corresponds to the adapted model with the minimum motion of the predetermined portion.
  • a fine reproduction of at least the part of interest of the object is reconstructed using the specific data set.
  • a method for reconstructing a fine reproduction of at least a part of an object comprises receiving a sequence of data sets, the data sets representing structural information of the object.
  • the method also comprises receiving scheduling information related to the data sets of the sequence of data sets.
  • reconstructing of a sequence of coarse reconstructions of the object is performed by using the sequence of data sets and the scheduling information.
  • a sequence of adapted models of the object is generated by adapting a respective model to each of the coarse reconstructions.
  • a motion of a predetermined portion of each of the adapted models is determined and a specific data set of the sequence of data sets is selected, wherein the specific data set corresponds to the adapted model with the minimum motion of the predetermined portion.
  • the method comprises reconstructing a fine reconstruction of at least the part of the object using the specific data set.
  • an examination apparatus for reconstructing a fine reproduction of at least a part of an object
  • the examination apparatus comprising the reconstruction unit as described above.
  • the examination apparatus further comprises a detector unit and a time scheduling unit, wherein the detector unit is connected to the reconstruction unit.
  • the time scheduling unit is connected to the reconstruction unit and the detector unit is adapted for providing the data set containing structural information about the object.
  • the time scheduling unit is adapted for providing the scheduling information related to the data set.
  • a computer-readable medium in which a computer program for reconstructing a fine reproduction of at least a part of an object is stored, which, when being executed by a processor, is adapted to carry out the above-mentioned method.
  • a program element for reconstructing a fine reproduction of at least a part of the object is provided, which, when being executed by a processor, is adapted to carry out the above- mentioned method.
  • retrospective gating is used to express the process of scanning an object continuously and afterwards analysing of the gathered information. While the scanning of the object is performed a sequence of data sets is generated. These data sets may represent a digitized information of a projection of the object. Structural information of the object, in particular structural information of an interior area of the object may be contained in the projection data set. After having collected the plurality of data sets, particular data sets can be selected to reconstruct a reproduction of the object.
  • the reconstruction unit may be adapted for receiving a sequence of data sets, wherein the data sets represent structural information of the object. Further the reconstruction unit may receive scheduling information related to the data sets of the sequence of data sets. The scheduling information may be gathered in parallel to the process of gathering the data sets. Each data set may have a corresponding scheduling information and thus, an order of the data sets belonging to the sequence of data sets is provided. The scheduling information may be seen as a time scale to relate the data sets to the scheduling information. Thus, each data set may have a timing information or a time point information to determine the point in time when the data set was recorded.
  • a sequence of coarse reconstructions of the object By using the sequence of data sets and the scheduling information it may be possible to reconstruct a sequence of coarse reconstructions of the object. This combination may allow to reconstruct a movement or motion of the scanned object. Information about the motion may be available by comparing subsequent coarse reconstructions of the model. Using a coarse reconstruction may quickly provide results of calculations and automated operations like mathematical comparisons of the models and in particular of specific elements of the models may be possible. A coarse reconstruction or a coarse reproduction may use less information than a fine reconstruction or a fine reproduction. Thus, a fine reproduction may show a more detailed information of the object.
  • the fine reproduction which may be used instead of the coarse reproduction, may be an image of high resolution.
  • An example of a coarse reconstruction may be a two dimensional sectional view with a low resolution or a three dimensional picture with a low resolution. In a two dimensional view or picture pixels may be used to mark different sub-structures of the object. Therefore pixels may provide grey scale values or colour values to mark different substructures.
  • a three dimensional picture may use voxels to distinguish between different substructures.
  • the time resolution may be 20 to 50 three dimensional pictures in a defined time period wherein the time period may be substantially 1 second.
  • the time period may also be expressed by a sampling rate, which is the inverse value of the duration of a period.
  • the coarse reconstructions may be computer generated pictures, it may be possible to detect different sub- structures in the coarse reconstructions by methods of automatic image processing. Therefore processing of the coarse reconstructions with the reconstruction unit may be possible.
  • the reconstruction unit may deploy e.g. filter operations to select the boarders of different structures.
  • the reconstruction unit is able to automatically distinguish and recognize different sub-structures in the coarse reconstruction of the object.
  • parts of a representation of a real physical object, in particular interior structures of the physical object may be converted into a machine-readable format.
  • the reconstruction unit may be able to automatically generate a sequence of adapted models of the object by adapting a respective basic model to each of the coarse reconstructions.
  • the reconstruction unit may be able to adapt the basic model to the detected sub- structures of the coarse reconstructions.
  • a model may be a mesh model.
  • a mesh model may comprise a plurality of lines and edges to rebuild a structure of an object.
  • the mesh model may use an a priori knowledge about the structure of the object of interest.
  • the basic structure of the object or the inner structure of the object may be known in advance and a basic mesh model using this knowledge may be provided.
  • the basic model may have to be adapted to the recognised structures of the coarse reconstructions, which may be an image of the object of interest.
  • the edges and lines of the model may make such a model virtually deformable.
  • the model may be adapted to the detected structures or sub- structures of the coarse reconstructions of the physical object.
  • landmarks are deployed, which may be specific points for finding related points of the coarse reconstructions.
  • Such landmarks may be a known artery or a known ventricle in case of a heart.
  • a motion of a portion of the mesh model may be determined.
  • the motion may be determined by tracking the position of a known specific point of the model in the sequence of adapted models.
  • An example for a specific point may be an edge of the mesh model.
  • a motion vector field of the portion of interest may be generated in order to determine the strength of the motion of that portion.
  • a motion vector field is a plurality of motion vectors. Each motion vector may correspond to the relevant portion of the object and may indicate the strength of the motion of the relevant portion.
  • the portion may be selected in advance since the portion of the model may correspond to a relevant portion or area in the physical object.
  • Using the determined information about the motion may allow selecting a specific data set of the sequence of data sets, wherein the specific data set may correspond to the adapted model with the minimum motion of the predetermined portion.
  • the relevant data set may be determined by backward tracking from the adapted model to the relevant data set. The backward tracking may be possible, since the sequence of data sets is linked to the scheduling information.
  • the relevant data set of minimum motion may be found it may be possible to reconstruct a fine reconstruction of at least the part of the object using the relevant data set.
  • There may be additional information available in the data set for reconstructing a fine reproduction since not all the information available in the data set may be used for the coarse reconstruction.
  • Using the additional information from the relevant data set may achieve a high granularity of the reproduction, i.e. with this additional information it may be possible to reconstruct a picture with a high resolution.
  • using the method of retrospectively gated object reconstruction may produce a plurality of projections or scanner data sets. Scanning an oscillating object may produce artefacts or un-sharp reconstructed structures. If the object may oscillate irregularly the plurality of data sets may contain data sets corresponding to phases or phase points or points in time of high motion activity and data sets corresponding to phases or phase points or points in time of minimum motion activity.
  • Finding the data sets corresponding to phase points of minimum activity of a part of interest of the object may allow a sharp reproduction of the part of interest of the object.
  • the sharpness may be increased by using data sets corresponding to phase points of minimum or nearly no motion of the part of interest of the object.
  • the sharpness in addition may be increased by using all information available in a data set for reconstructing the object. This may lead to a sharp image of high resolution or a fine reproduction of high resolution.
  • Providing a high resolution may mean that an area is represented by a higher number of voxel or pixel.
  • more details of the part of interest of the object may be visualized. Therefore structures, which usually cannot be seen in un-sharp pictures may now be visible.
  • fine structures of the object may also be seen. The fine structures may be seen even if the models have been adapted to other coarse shapes, which may be located nearby or underneath the fine structures.
  • the reconstruction unit is adapted for reconstructing a cardiac structure.
  • a reconstruction unit which is adapted for reconstructing a cardiac structure may allow to reconstruct a fine reproduction of the heart or parts of the heart. Since such a reproduction is not limited to the selected portion it may be possible that other structures are reconstructed. Therefore small coronaries may be visible on such reproductions.
  • the models of a heart may be permanently stored in a reconstruction unit, which is adapted for reconstructing a cardiac structure since the reconstruction unit may only be used for analyses concerning the heart and the reconstructing unit may be optimised for reconstructing cardiac structures.
  • the respective model is at least one selected from the group consisting of a mesh and a cardiac model.
  • Using a specific mesh or cardiac model may allow recognition of the different sub structures or different compartments of the cardiac anatomy. Therefore the detection and reconstruction process may be accelerated.
  • the above-mentioned respective model comprises adaptable shapes.
  • the fine reproduction is at least one selected from the group of a fine mesh, fine sub mesh, a high resolution computer picture, a vector graphic, a high resolution 2D picture, a high resolution 3D picture, a coronal sectional view, and a sagittal sectional view of the part of the object.
  • the different reproductions may provide exemplary reproductions, which may be used in a computer system for representing a physical object.
  • the different reproductions may be different representations of the same set of data.
  • the different representations may be selectively switched on to provide different views of the part of interest of the object or cardiac structure to an user.
  • the reconstruction unit is adapted to process scheduling information, which is a sequence of points in time.
  • the points in time may correspond to specific events.
  • the sequence of points in time may be an ordered list, listing sampling points. Having an ordered list of points in time, which may correspond to a relevant data set recorded in that special point in time may allow to relate a specific data set to a point in time, the data set corresponds to. This information of the relationship of the data set and the relevant point in time may be used when backtracking for finding the relevant data set for the fine reproduction.
  • the reconstruction unit is adapted to process scheduling information, which is a sequence of phase points.
  • a phase may be a regularly repeating interval, which is a part of the cardiac cycle.
  • the cardiac cycle is a sequence of phase points and a sequence of phases.
  • the phase points may allow to relate a data set to a defined point in time of the cardiac phase.
  • the phase points are phase points of a cardiac phase.
  • the reconstruction unit is adapted to receive scheduling information from an ECG (electro cardiogram) recording.
  • An ECG recording is a plot which represents the activity of an heart over the time. High activity may be represented by a high amplitude. Low activity may be represented by a low amplitude in the plot. Therefore defined phases of the cardiac cycle may be seen on the plot.
  • the ECG may be recorded in parallel to the sampling of the data sets. Since the time is recorded when the relevant data set is sampled, the data set can be related to a phase of the cardiac cycle. The link may be made by a common point in time of the sequence of data sets and the scheduling information.
  • the reconstruction unit is adapted to process a sequence of data, which is a sequence of CT projection data sets.
  • Computer tomography is a process of using digital processing to generate a three- dimensional image of the internal structure of an object under investigation (object of interest) from a series of two-dimensional X-ray images taken around a single axis of rotation.
  • the reconstruction of CT images can be done by applying appropriate algorithms.
  • For each point in time when a X-ray image is recorded, a set of data is generated.
  • the generated set of data may include information about a direction or angle in relation to the object and the corresponding attenuation of a X-ray through the body or object.
  • the reconstruction unit is adapted for selecting the specific data set by generating a set of motion vectors belonging to the predetermined portion of the model, wherein the set of motion vectors is generated at each position of the adapted models. Once a set of motion vectors is generated the absolute length of the set of motion vectors of the predetermined portion of the adapted models is determined. It may be possible to select from the sequence of adapted models at least one adapted model, which offers the minimum motion of the portion of interest. Since the adapted model is adapted to a coarse reconstruction of a data set, the relevant data set can be determined. This determination may be possible since the coarse reproduction may be related to a phase point of a cardiac cycle, and thus the relevant phase point of the cardiac cycle may be determined. This phase point may be the phase point used in retrospectively gated cardiac reconstruction to achieve a good diagnostic image quality.
  • This embodiment applies also for the reconstruction unit for reconstructing a fine reproduction of at least a part of an object, for the examination apparatus, for the computer- readable medium, and for the program element.
  • the method comprises selecting the part of the object as a structure nearby a coronary.
  • a coronary may be not directly detectable and visual in a coarse reproduction of the part of the object.
  • the coronary therefore may also be no part of the model.
  • a part of the object that is known to be in the neighbourhood or lying underneath the coronary or the fine structure may be selected to be sharply reproduced. Indirectly and automatically the coronary may be visible on the sharp reproduction of the object.
  • the examination apparatus may comprise a memory unit wherein the memory unit is adapted for storing the sequence of data sets and the scheduling information.
  • Storing the information may allow to collect the information about the object and to analyze the information after collecting the information. Thus, backtracking may be possible.
  • the examination apparatus comprises a graphical user-interface.
  • the graphical user-interface may be adapted to display information calculated by the examination apparatus.
  • the fine reproduction may be a graphical representation of a list of graphical information.
  • the graphical user interface may convert this graphical information into an image, viewable by an user.
  • the graphical user interface may also provide the option to select between different views of the fine reproduction of the object.
  • the graphical user interface may also provide the possibility to send commands to the examination apparatus, in particular to control the reconstruction unit.
  • the whole process of reconstructing a fine reproduction may be controllable through the graphical user interface.
  • the examination apparatus is at least one selected of the group consisting of a material testing apparatus, a baggage inspection apparatus, a medical application apparatus, a computer tomography apparatus, a coherent scatter computed tomography apparatus, a positron emission computed tomography apparatus, a single photon emission computed tomography apparatus, ultra sound apparatus, electron beam tomography apparatus, magnetic resonance apparatus, and an interventional 3D rotational X-ray device.
  • a material testing apparatus e.g., a baggage inspection apparatus, a medical application apparatus, a computer tomography apparatus, a coherent scatter computed tomography apparatus, a positron emission computed tomography apparatus, a single photon emission computed tomography apparatus, ultra sound apparatus, electron beam tomography apparatus, magnetic resonance apparatus, and an interventional 3D rotational X-ray device.
  • phase point allows to reconstruct a high resolution reproduction to achieve a good diagnostic image quality.
  • a model is adapted to coarse reconstructions so that a series of adapted models can be reconstructed. From this consecutive adapted models areas of minimum motion can be determined.
  • To improve the quality of the high resolution reproduction preferably just a portion of the model is selected, leading to better results then just using global information of motion of the whole object.
  • the reconstruction process uses a structure different from the structure of interest, the knowledge about the position of the structure of interest can be used to focus on a structure nearby the structure of interest. Since these different structures may have similar motion properties a point in time, which is good for reconstructing the nearby structure may also be good for reconstructing the structure of interest.
  • the structure of interest may be visible, even if this structure may not be part of a model used for reconstruction.
  • Fig. 1 shows a simplified schematic representation of an examination apparatus according to an exemplary embodiment of the present invention.
  • Fig. 2 shows a 3D model representation after adaptation to a low resolution 4D data set in an end systolic phase point.
  • Fig. 3 shows a 3D model representation after adaptation to a low resolution 4D data set in an end diastolic phase point.
  • Fig. 4 shows an exemplary embodiment of an image processing device according to the present invention, for executing an exemplary embodiment of a method in accordance with the present invention.
  • Fig. 5 shows a 3D mesh model with coronaries.
  • Fig. 6 shows a flow-chart of an exemplary method according to the present invention.
  • Fig. 1 shows an exemplary embodiment of a computed tomography scanner system according to the present invention.
  • the computer tomography apparatus 100 depicted in Fig. 1 is a cone-beam CT scanner. However, the invention may also be carried out with a fan-beam geometry.
  • the CT scanner depicted in Fig. 1 comprises a gantry 101, which is rotatable around a rotational axis 102.
  • the gantry 101 is driven by means of a motor 103.
  • Reference numeral 104 designates a source of radiation such as an X-ray source, which, according to an aspect of the present invention, emits polychromatic or monochromatic radiation.
  • Reference numeral 105 designates an aperture system which forms the radiation beam emitted from the radiation source to a cone-shaped radiation beam 106.
  • the cone-beam 106 is directed such that it penetrates an object of interest 107 arranged in the center of the gantry 101, i.e. in an examination region of the CT scanner, and impinges onto the detector 108.
  • the detector 108 is arranged on the gantry 101 opposite to the source of radiation 104, such that the surface of the detector 108 is covered by the cone beam 106.
  • the detector 108 depicted in Fig. 1 comprises a plurality of detector elements 123 each capable of detecting X-rays which have been scattered by or passed through the object of interest 107.
  • the detector 108 may be a multi slice detector to increase the resolution in the z axis.
  • the source of radiation 104, the aperture system 105 and the detector 108 are rotated along the gantry 101 in the direction indicated by an arrow 116.
  • the motor 103 is connected to a motor control unit 117, which is connected to a control unit 118 (which might also be denoted as a calculation, determination unit or reconstruction unit).
  • the object of interest 107 is a human being which is disposed on an operation table 119.
  • the operation table 119 displaces the human being 107 along a direction parallel to the rotational axis 102 of the gantry 101.
  • the heart 130 is scanned along a helical scan path.
  • the operation table 119 may also be stopped during the scans to thereby measure signal slices. It should be noted that in all of the described cases it is also possible to perform a circular scan, where there is no displacement in a direction parallel to the rotational axis 102, but only the rotation of the gantry 101 around the rotational axis 102.
  • an electrocardiogram (ECG) device 135 which measures an electrocardiogram of the heart 130 of the human being 107 while X-rays attenuated by passing the heart 130 are detected by detector 108.
  • the data sets detected by detector 108 are transmitted to the control unit 118 via interface or input terminal 142.
  • the data related to the measured electrocardiogram are transmitted to the control unit 118 via interface or input terminal 140.
  • the invention can be realized by a fan-beam configuration.
  • the aperture system 105 can be configured as a slit collimator.
  • the detector 108 is connected to the control unit 118.
  • the control unit 118 receives the detection result in the form of a sequence of data sets, i.e. the read-outs from the detector elements 123 of the detector 108 and determines a scanning result on the basis of these read-outs. Furthermore, the control unit 118 communicates with the motor control unit 117 in order to coordinate the movement of the gantry 101 with motors 103 and 120 with the operation table 11.
  • the control unit 118 may be adapted for reconstructing an image from readouts or data sets of the detector 108.
  • a reconstructed image or fine reproduction generated by the control unit 118 may be output to a display or graphical user-interface 121.
  • the graphical user- interface 121 is connected to the interface or output terminal 144.
  • the output 144 provides a bidirectional communication with the reconstruction unit 118. Therefore information can be displayed and control signals can be sent to the reconstruction unit.
  • the reconstructed image which may also be a digital image, is provided to a storage device (not shown in Fig. 1) or a data communication network.
  • the data communication network may be an ATM (asynchronous transfer mode) or Ethernet based network and providing telemedicine applications.
  • the control unit 118 may be realized by a data processor to process read-outs from the detector elements 123 of the detector 108.
  • the computer tomography apparatus shown in Fig. 1 captures multi-cycle cardiac computer tomography data of the heart 130.
  • a helical scan is performed by the X-ray source 104 and the detector 108 with respect to the heart 130.
  • the heart 130 may beat a plurality of times.
  • a plurality of cardiac computer tomography data are acquired.
  • an electrocardiogram is measured by the electrocardiogram unit 135. After having acquired these data, the data are transferred to the control unit 118, and the measured data may be analyzed retrospectively.
  • the measured data namely the cardiac computer tomography data and the electrocardiogram data are processed by the reconstruction unit 118 which may be further controlled via a graphical user-interface (GUI) 121.
  • GUI graphical user-interface
  • the reconstruction unit 118 is adapted to analyze the multi-cycle cardiac computer tomography data detected by attenuating X-rays passing the heart 130 in the following manner, to automatically calculate phase points for spatially different cardiac structures using a model.
  • a sequence of data sets is received from detector 108.
  • the data sets represent structural information of the heart 130.
  • scheduling information related to the data sets of the sequence of data sets is received by the reconstruction unit 118 from ECG 135.
  • a sequence of coarse reconstructions of the heart 130 is reconsructed by using the sequence of data sets and the scheduling information.
  • a sequence of adapted models of the heart 130 is generated by adapting a respective model to each of the coarse reconstructions.
  • a motion of a predetermined portion of each of the adapted models is determined and a specific data set of the sequence of data sets is selected.
  • This specific data set corresponds to the adapted model with the minimum motion of the predetermined portion.
  • a fine reproduction of at least the part of the object is reconstructed using the specific data set and the fine reproduction is displayed on the graphical user-interface 121 or sent to a remote graphical user- interface via a network.
  • a 4D reconstruction is a reconstruction that combines a 3D image with the scheduling information as a fourth dimension.
  • a cardiac model consisting of adaptive shapes of the main compartments of the heart is fitted into one of the phases and propagated through the complete 4D data set.
  • the shape is adapted to the low resolution image data. Since the points used for the description of the model are assigned to the different compartments of the cardiac anatomy, their position can be tracked through the complete 4D data set.
  • the absolute length of all motion vectors of all points belonging to this part of the model may be suitable. The minimum of this function than delivers the optimal phase point. Other measures are imaginable.
  • this phase point is used in a high resolution reconstruction to achieve high diagnostic image quality.
  • the phase point may be good for structures like the coronaries, which may not directly be part of the model, to be determined by the phase point of their underlying structure or a structure nearby the coronaries.
  • phase points for different cardiac compartments for cardiac CT reconstruction can be determined.
  • the detection can be performed for patient selective phase point for different coronary artery segments.
  • patient individual characteristics of the cardiac phase can be regarded and a phase point can be derived in an anatomy selective manner. It is known from the statistical analysis of a large amount of cardiac image data sets that e.g. the right and the left coronary artery have their resting phase at different positions within the RR interval.
  • the RR interval is the duration from the appearance of a R impulse in an ECG recording to the next R impulse.
  • the R impulse shows in an ECG plot the start of a cardiac cycle.
  • the maximum motion of the heart may be expected, i.e. the phase of the compression of the left ventricle.
  • the close neighbourhood of the R impulse less motion may be expected since the contraction of the atrium is finished.
  • Fig. 2 shows a 3D model representation after adaptation to a low resolution 4D data set in an end systolic phase point.
  • different compartments 201', 202, 203 and 204 are shown in an end systolic phase point.
  • the mesh model 206 comprises a plurality of edges 207 and lines 208 building triangular structures.
  • the triangular structures represent the structure of the relevant compartment taken from a coarse reconstruction.
  • compartment 201' represents the left ventricle at the end systolic phase point.
  • a reference point 205' is shown in Fig. 2. Tracking the motion of the reference point 205' allows to determine the motion of a portion of the mesh model 206 the reference point 205' is belonging to.
  • Fig. 3 shows a 3D model representation after adaptation to a low resolution 4D data set in an end diastolic phase point.
  • the left ventricle 205" has a larger volume than the left ventricle 205' of Fig. 2.
  • reference point 205" has moved.
  • end systolic or end diastolic phase points may not applicable for a fine reproduction for the portion of the object 130 the reference point 205' is part of.
  • Fig. 4 depicts an exemplary embodiment of a data processing device 118 or reconstruction unit according to the present invention for executing an exemplary embodiment of a method in accordance with the present invention.
  • the data processing device 118 depicted in Fig. 4 comprises a central processing unit (CPU) or image processor 401 connected to a memory 402 for storing an image depicting an object of interest, such as a patient or an item of baggage.
  • the data processor 401 may be connected to a plurality of input/output networks or diagnosis devices, such as a CT device.
  • the data processor 401 may furthermore be connected to a display device 403, for example, a computer monitor or a graphical user-interface, for displaying information or an image computed or adapted in the data processor 401.
  • An operator or user may interact with the data processor 401 via a keyboard 404 and/or other output devices, which are not depicted in Fig. 4.
  • Fig. 5 shows a 3D mesh model with coronaries.
  • the mesh model 503 is a model of the object of interest 130, e.g. the heart of a patient 107.
  • the model of Fig. 5 is a basic model that is not adapted to patient individual anatomy.
  • the mesh model 503 has edges 207 and lines 208. By providing edges 207 and lines 208 the model has a computer readable and computer processable format, which may allow to adapt the model to an image of the heart by means of the computer.
  • the compartments 201, 202, 203 and 204 are modelled and can be adapted to the relevant structures on a corresponding image. Additional the coronaries 501 and 502 are shown which lay in the neighbourhood of the compartments 201 and 202.
  • the left ventricle 201 is the underlying structure of coronary 501 which provides a plurality of branches.
  • the compartment 202 is the underlying structure of coronary 502.
  • the left ventricle 201 in Fig. 2 and Fig. 3 is labelled with 201' and 201" to show the different phases in which the left ventricle is depicted and to show the different sizes of the left ventricle in the different phases of the cardiac cycle.
  • the coronaries 501 and 502 may be not visible on a coarse reproduction. But determining a fine reproduction of the relevant compartments 201 and 202 can make the coronaries 501, 502 visible on the fine reproduction.
  • Fig. 6 shows a flow-chart of an exemplary method according to the present invention.
  • the method starts with recording of a sequence of data sets in step Sl and with parallel recording of scheduling information in the form of ECG recording S2.
  • step S3 a 4D coarse reconstructions of a sequence of cardiac volume is performed at low spatial resolution.
  • the data sets and the scheduling information of the ECG is combined.
  • step S4 a model is adapted to the coarse reconstructions and a sequence of adapted models is determined. Using these models allows to determine motion vectors.
  • step S5 the minimum length of all motion vectors belonging to a part of the model is determined. With this information about the minimum motion an adequate phase point can be determined.
  • phase point calculated in step S5 can be used in step S6 to find out the relevant data set belonging to the phase point.
  • This data set is used to reconstruct a fine reconstruction.
  • Exemplary embodiments of the invention may be distributed as a software option to CT scanner console, imaging workstations or PACS workstations.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Surgery (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Pulmonology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • General Physics & Mathematics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

L'invention concerne une unité de reconstruction adaptée pour : recevoir une séquence d'ensembles de données représentant des informations structurelles relatives à l'objet ; recevoir des informations d'ordonnancement relatives aux ensembles de données de la séquence d'ensembles de données ; reconstruire une séquence de reconstructions grossières de l'objet à partir de la séquence d'ensembles de données et des informations d'ordonnancement ; produire une séquence de modèles adaptés de l'objet par adaptation d'un modèle particulier à chaque reconstruction grossière ; déterminer le mouvement d'une partie prédéterminée de chacun des modèles adaptés ; sélectionner un ensemble de données spécifiques de la séquence d'ensembles de données, l'ensemble de données spécifiques correspondant au modèle adapté avec un mouvement minimum de la partie déterminée ; et enfin, reconstruire une reproduction précise d'au moins une partie de l'objet en faisant intervenir l'ensemble de données spécifiques.
EP06832175.1A 2005-12-20 2006-12-08 Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet Active EP1965703B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP06832175.1A EP1965703B1 (fr) 2005-12-20 2006-12-08 Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP05112496 2005-12-20
EP06832175.1A EP1965703B1 (fr) 2005-12-20 2006-12-08 Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet
PCT/IB2006/054702 WO2007072281A2 (fr) 2005-12-20 2006-12-08 Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet

Publications (2)

Publication Number Publication Date
EP1965703A2 true EP1965703A2 (fr) 2008-09-10
EP1965703B1 EP1965703B1 (fr) 2017-06-07

Family

ID=38189046

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06832175.1A Active EP1965703B1 (fr) 2005-12-20 2006-12-08 Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet

Country Status (5)

Country Link
US (1) US8094772B2 (fr)
EP (1) EP1965703B1 (fr)
JP (1) JP5481069B2 (fr)
CN (1) CN101355904B (fr)
WO (1) WO2007072281A2 (fr)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8574157B2 (en) * 2007-02-14 2013-11-05 General Electric Company Method and apparatus for generating an ultrasound image of moving objects using deformable models
US20100266182A1 (en) * 2007-11-12 2010-10-21 Koninklijke Philips Electronics N.V. Apparatus for determining a parameter of a moving object
EP2349007B1 (fr) * 2008-10-23 2015-07-22 Koninklijke Philips N.V. Procédé pour caractériser le mouvement d'un objet à partir de données d'imagerie tdm
US8478012B2 (en) 2009-09-14 2013-07-02 General Electric Company Methods, apparatus and articles of manufacture to process cardiac images to detect heart motion abnormalities
DE102011006501B4 (de) * 2011-03-31 2021-12-23 Siemens Healthcare Gmbh Verfahren, Bildverarbeitungseinrichtung und Computertomographie-System zur Gewinnung eines 4D-Bilddatensatzes eines Untersuchungsobjekts, sowie Computerprogrammprodukt mit Programmcodeabschnitten zur Ausführung eines solchen Verfahrens
US10162932B2 (en) 2011-11-10 2018-12-25 Siemens Healthcare Gmbh Method and system for multi-scale anatomical and functional modeling of coronary circulation
DE102012111304A1 (de) * 2012-11-22 2014-05-22 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung, Verfahren und Computerprogramm zur Rekonstruktion einer Bewegung eines Objekts
CN104240270B (zh) * 2013-06-14 2017-12-05 同方威视技术股份有限公司 Ct成像方法和系统
RU2677055C2 (ru) 2013-11-05 2019-01-15 Конинклейке Филипс Н.В. Автоматическая сегментация трехплоскостных изображений для ультразвуковой визуализации в реальном времени
KR101725891B1 (ko) 2015-08-05 2017-04-11 삼성전자주식회사 단층 영상 장치 및 그에 따른 단층 영상 복원 방법
KR102531117B1 (ko) * 2015-10-07 2023-05-10 삼성메디슨 주식회사 대상체를 나타내는 영상을 디스플레이하는 방법 및 장치.
US9990711B2 (en) * 2016-01-25 2018-06-05 Accuray Incorporated Manipulation of a respiratory model via adjustment of parameters associated with model images
USD858532S1 (en) * 2016-09-21 2019-09-03 Analytics For Life Inc. Display screen with transitional graphical user interface
US10950016B2 (en) 2018-06-11 2021-03-16 Shanghai United Imaging Healthcare Co., Ltd. Systems and methods for reconstructing cardiac images
CN109345526A (zh) * 2018-09-27 2019-02-15 上海联影医疗科技有限公司 图像重建方法、装置、计算机设备和存储介质
CN113030134B (zh) * 2021-02-26 2022-03-01 中国工程物理研究院激光聚变研究中心 用于icf靶三维重建的三轴ct成像装置及方法
CN115067980A (zh) 2021-03-15 2022-09-20 上海联影医疗科技股份有限公司 扫描时相的确定方法、装置、计算机设备和存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002103639A2 (fr) * 2001-06-20 2002-12-27 Koninklijke Philips Electronics N.V. Procede de reconstruction d'une image 3d a haute resolution

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004518473A (ja) * 2001-01-30 2004-06-24 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ 変形する３ｄ物体の画像シーケンスを該物体の壁の動きの指示を伴って表示する画像処理方法
WO2002103629A1 (fr) * 2001-06-19 2002-12-27 Nippon Carbide Kogyo Kabushiki Kaisha Produit retroreflechissant dans lequel un circuit integre est scelle
US7142703B2 (en) * 2001-07-17 2006-11-28 Cedara Software (Usa) Limited Methods and software for self-gating a set of images
US7006862B2 (en) * 2001-07-17 2006-02-28 Accuimage Diagnostics Corp. Graphical user interfaces and methods for retrospectively gating a set of images
US6526117B1 (en) * 2001-11-09 2003-02-25 Ge Medical Systems Global Technology Company, Llc Method and apparatus to minimize phase misregistration artifacts in gated CT images
DE60328983D1 (de) * 2002-06-04 2009-10-08 Koninkl Philips Electronics Nv Hybride dreidimensionale rekonstruktion der koronararterien mittels rotationsangiographie
US6628743B1 (en) 2002-11-26 2003-09-30 Ge Medical Systems Global Technology Company, Llc Method and apparatus for acquiring and analyzing cardiac data from a patient
CN1726517B (zh) * 2002-12-20 2010-05-26 皇家飞利浦电子股份有限公司 基于协议的体积可视化
JP2006527619A (ja) * 2003-06-16 2006-12-07 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ 時系列イメージにおけるイメージセグメンテーション
US7545903B2 (en) * 2003-07-16 2009-06-09 Koninklijke Philips Electronics N.V. Reconstruction of an image of a moving object from volumetric data
US7154498B2 (en) * 2003-09-10 2006-12-26 Siemens Medical Solutions Usa, Inc. System and method for spatio-temporal guidepoint modeling
ATE369593T1 (de) * 2003-11-13 2007-08-15 Koninkl Philips Electronics Nv Dreidimensionale segmentierung durch verwendung deformierbarer oberflächen

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002103639A2 (fr) * 2001-06-20 2002-12-27 Koninklijke Philips Electronics N.V. Procede de reconstruction d'une image 3d a haute resolution

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
JOHAN MONTAGNAT ET AL: "Space and Time Shape Constrained Deformable Surfaces for 4D Medical Image Segmentation", 11 February 2004 (2004-02-11), MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION.MICCAI. INTERNATIONAL CONFERENCE. PROCEEDINGS,, PAGE(S) 196 - 205, XP019001259, ISBN: 978-3-540-41189-5 *
Johan Montagnat ET AL: "Spatial and temporal shape constrained deformable surfaces for 3D and 4D medical image segmentation" In: "Spatial and temporal shape constrained deformable surfaces for 3D and 4D medical image segmentation", 1 November 2000 (2000-11-01), INRIA, Sophia Antipolis, XP055056767, pages 1-70, *
MONTAGNAT J ET AL: "4D deformable models with temporal constraints: application to 4D cardiac image segmentation", MEDICAL IMAGE ANALYSIS, OXFORD UNIVERSITY PRESS, OXOFRD, GB, vol. 9, no. 1, 1 February 2005 (2005-02-01), pages 87-100, XP027847007, ISSN: 1361-8415 [retrieved on 2005-02-01] *
MONTAGNAT J ET AL: "Space and time shape constrained deformable surfaces for 4D medical image segmentation", LECTURE NOTES IN COMPUTER SCIENCE/COMPUTATIONAL SCIENCE, SPRINGER, DE, vol. 1935, 1 January 2000 (2000-01-01), pages 196-205, XP002329562, ISBN: 978-3-540-24128-7 *
See also references of WO2007072281A2 *

Also Published As

Publication number Publication date
WO2007072281A2 (fr) 2007-06-28
JP2009519801A (ja) 2009-05-21
US8094772B2 (en) 2012-01-10
JP5481069B2 (ja) 2014-04-23
WO2007072281A3 (fr) 2008-05-08
WO2007072281A8 (fr) 2008-08-28
CN101355904B (zh) 2012-01-11
CN101355904A (zh) 2009-01-28
US20090003513A1 (en) 2009-01-01
EP1965703B1 (fr) 2017-06-07

Similar Documents

Publication Publication Date Title
EP1965703B1 (fr) Unite de reconstruction servant a la reproduction fine d'au moins une partie d'un objet
US8184883B2 (en) Motion compensated CT reconstruction of high contrast objects
US7221728B2 (en) Method and apparatus for correcting motion in image reconstruction
JP4347807B2 (ja) 投影データから運動情報を導く方法及び装置
CN102844793B (zh) 用于门控x射线ct成像的稀疏数据重建
JP5204120B2 (ja) Ｅｃｇゲーテッド・コンピュータ・トモグラフィにおける再構成ウィンドウ適合
US20070053482A1 (en) Reconstruction of an image of a moving object from volumetric data
US20080267455A1 (en) Method for Movement Compensation of Image Data
CN102293660B (zh) 在心脏ct中改善时间分辨率
JP4157302B2 (ja) Ｘ線ｃｔ装置
WO2005104038A1 (fr) Appareil de tomodensitometrie a faisceau conique utilisant des projections tronquees et une image de tomodensitometrie tridimensionnelle precedemment acquise
EP1769462A1 (fr) Angiogramme ct exempt d'artéfacts
CN101991428A (zh) 用于在心脏ct中改进时间分辨率的ct图像重建
US20080219527A1 (en) Cardiac Region Detection From Motion Analysis of Small Scale Reconstruction
EP1933708B1 (fr) Reconstruction cardiaque quadridimensionnelle iterative par tomographie par ordinateur a faisceau conique
JP2008519636A (ja) 周期運動物体の検査のためのコンピュータ断層撮影方法
US20090238412A1 (en) Local motion compensated reconstruction of stenosis
JP4431136B2 (ja) ボリュメトリック画像再構成のための方法及び装置
CN111202539A (zh) 层析图像处理设备和方法以及非暂时性记录介质

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

17P Request for examination filed

Effective date: 20081110

RBV Designated contracting states (corrected)

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20130327

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KONINKLIJKE PHILIPS N.V.

Owner name: PHILIPS INTELLECTUAL PROPERTY & STANDARDS GMBH

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/00 20060101ALI20161201BHEP

Ipc: G06T 11/00 20060101ALI20161201BHEP

Ipc: A61B 6/03 20060101AFI20161201BHEP

Ipc: A61B 6/00 20060101ALI20161201BHEP

INTG Intention to grant announced

Effective date: 20161221

RIN1 Information on inventor provided before grant (corrected)

Inventor name: VON BERG, JENS

Inventor name: GRASS, MICHAEL

Inventor name: LORENZ, CRISTIAN

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 898600

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602006052757

Country of ref document: DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 602006052757

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20170607

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170908

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 898600

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170907

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171007

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602006052757

Country of ref document: DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602006052757

Country of ref document: DE

Owner name: PHILIPS GMBH, DE

Free format text: FORMER OWNER: PHILIPS INTELLECTUAL PROPERTY & STANDARDS GMBH, 20099 HAMBURG, DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

26N No opposition filed

Effective date: 20180308

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20171208

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171208

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20180831

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180102

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171208

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171208

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20061208

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170607

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231227

Year of fee payment: 18