EP2114252B1 - Cartographie cardiaque indépendante des phases - Google Patents
Cartographie cardiaque indépendante des phases Download PDFInfo
- Publication number
- EP2114252B1 EP2114252B1 EP08719459.3A EP08719459A EP2114252B1 EP 2114252 B1 EP2114252 B1 EP 2114252B1 EP 08719459 A EP08719459 A EP 08719459A EP 2114252 B1 EP2114252 B1 EP 2114252B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- map
- vessel
- image
- angiogram
- life
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000747 cardiac effect Effects 0.000 title claims description 39
- 238000000034 method Methods 0.000 claims description 68
- 238000002347 injection Methods 0.000 claims description 19
- 239000007924 injection Substances 0.000 claims description 19
- 238000001514 detection method Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 7
- 239000003550 marker Substances 0.000 claims description 6
- 230000033001 locomotion Effects 0.000 description 17
- 238000012545 processing Methods 0.000 description 13
- 230000001364 causal effect Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 230000000241 respiratory effect Effects 0.000 description 9
- 238000013459 approach Methods 0.000 description 8
- 230000002123 temporal effect Effects 0.000 description 8
- 239000002872 contrast media Substances 0.000 description 7
- 238000002594 fluoroscopy Methods 0.000 description 7
- 230000009466 transformation Effects 0.000 description 6
- 238000013519 translation Methods 0.000 description 4
- 230000014616 translation Effects 0.000 description 4
- 230000002792 vascular Effects 0.000 description 4
- ULEBESPCVWBNIF-BYPYZUCNSA-N L-arginine amide Chemical compound NC(=O)[C@@H](N)CCCNC(N)=N ULEBESPCVWBNIF-BYPYZUCNSA-N 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 238000002955 isolation Methods 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 230000029058 respiratory gaseous exchange Effects 0.000 description 3
- 230000033764 rhythmic process Effects 0.000 description 3
- 208000031481 Pathologic Constriction Diseases 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 238000002059 diagnostic imaging Methods 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 208000035475 disorder Diseases 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 210000004072 lung Anatomy 0.000 description 2
- 230000015654 memory Effects 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 239000000243 solution Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 206010002329 Aneurysm Diseases 0.000 description 1
- 208000022211 Arteriovenous Malformations Diseases 0.000 description 1
- 206010053567 Coagulopathies Diseases 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 230000005744 arteriovenous malformation Effects 0.000 description 1
- 210000001367 artery Anatomy 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 230000035602 clotting Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000010485 coping Effects 0.000 description 1
- 238000007887 coronary angioplasty Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 230000010339 dilation Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000013152 interventional procedure Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003387 muscular Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003071 parasitic effect Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000010008 shearing Methods 0.000 description 1
- 210000004872 soft tissue Anatomy 0.000 description 1
- 238000004154 testing of material Methods 0.000 description 1
- 230000001225 therapeutic effect Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/504—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of blood vessels, e.g. by angiography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/12—Arrangements for detecting or locating foreign bodies
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/481—Diagnostic techniques involving the use of contrast agents
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5235—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/44—Constructional features of apparatus for radiation diagnosis
- A61B6/4429—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units
- A61B6/4464—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit or the detector unit being mounted to ceiling
Definitions
- the invention relates to the field of interventional imaging.
- the invention relates to an examination apparatus for cardiac roadmapping for examination of an object of interest, to a method for cardiac roadmapping, a computer-readable medium, a program element and an image processing device.
- an imaging system for PTCA Percutanerous Transluminal Coronary Angioplasty
- PTCA Percutanerous Transluminal Coronary Angioplasty
- a navigation system may therefore help the cardiologists by providing a cardiac roadmap displayed next or overlaid on the live fluoroscopy pictures.
- this cardiac roadmap represents the vessel network acquired during angiography, with the same cardiac phase than the current live image.
- Documents [1] and [2] describe a basic method for realising cardiac roadmapping. They rely on the extraction of the cardiac and respiratory cycles, and on the matching of those cycles between the angiogram images (in filled state) and the live images.
- [3] a refinement of [1], [2] is proposed that consists in registering the guidewire tip with the roadmapping data.
- a vessel map is computed from the angiogram image that corresponds to the considered live image (this correspondence being established for instance following the cycle-centric approach of [1], [2]), and the guidewire tip is extracted from the live image. The extracted tip is then brought into registration with the vessel map. This may help to improve the correct matching between the roadmap and the intervention device.
- WO 2006/103644 A1 describes automatic detecting and tracking of a device, such as a guide wire tip, catheter tip or intravascular therapeutic device, within a tubular organ, such as an artery or a blood vessel.
- the detecting and tracking uses fluoroscopic images taken prior to or during a catheterization operation.
- the devices are fused with images or projections of models depicting the tubular organs using a constrained correlation, applying a requirement for markers detected in the fluoroscopic image tob e translated to a vessel in a reference image or a last injection image.
- the invention provides a computer-implemented method for cardiac roadmapping, an examination apparatus, a computer-readable medium, and a computer program product, according to the independent claims.
- a computer-implemented method for cardiac roadmapping for examination of a vessel tree is provided in accordance with claim 1.
- a registration of whole image sequences may be performed globally without having to perform an image selection or pairing in a first step followed by an image registration in a second step.
- a cardiac roadmapping technique that does not rely on the prerequisite of a phase-centric pairing of the angiogram and life images. Instead, both the pairing and accurate registration of the angiogram and life images are combined within a single operation.
- This operation may comprise a global registering of a device-map sequence, incrementally built at life-time, with a vessel-map sequence built during angiogram creation.
- This global motion-compensated association process may rely on map similarities, but may also enforce temporal coherency.
- the cardiac roadmapping is based on object enhancement, in which case two or more objects are identified in the life-image and in the angiogram image in order to provide for an image registration, i.e. correlation determination. No phase measuring is necessary.
- At least one of the objects is identified using an object-specific technique.
- a catheter injection tip at a pivotal point of the vessel tree is identified, for which the object-specific technique involves looking at the injection tip at a location near a border of the live image.
- a registration of the vessel-map and the device-map derived on the basis of this identification may be provided without involving an extra pairing or phase measuring step.
- the second image is binary or multi-valued, reflecting a likelihood of the presence of the first object and the second object.
- the second object is a guidewire or a balloon marker or a stand marker inserted into a coronary of the vessel-tree.
- the examination apparatus is adapted for issuing an alarm if no detection of the first object or the second object is performed.
- an alarm signal is generated to warn the user.
- the first image sequence is a vessel-map sequence and the second image sequence is a device-map sequence.
- the device-map sequence is a life-time sequence acquired during an intervention of the object of interest.
- the global correlation determination comprises a definition of a class of geometrical transforms.
- Such a class of geometrical transforms may, for example, be the class of all the translations belonging to a certain range. Furthermore, the class may comprise other rigid transforms, such as rotation or shearing, or even non-rigid transforms.
- the global correlation determination comprises a comparison of device-maps of the device-map sequence to vessel-maps of the vessel-map sequence, resulting in a similarity S[D i ,V j ,T k ] between each device-map of the device-map sequence and each vessel-map of the vessel-map sequence.
- all the geometrically transformed causal device-maps may be compared via a given similarity criterion to all the vessel-maps of the useful angiogram part.
- the global correlation determination comprises an optimization of a measure function K[A], which relates to the similarity.
- the optimization of the measure function enforces a temporal coherency H[A].
- the device-map sequence may be a causal device-map sequence.
- the vessel-map sequence is generated from one of an angiogram data set and an isolated sub-set of the angiogram data set, wherein the vessel-map sequence comprises a plurality of vessel-map images.
- the vessel-map image of the vessel-map sequence is generated on the basis of a vessel-enhanced image.
- each vessel-map image of the vessel-map sequence is computed on the basis of a full isolated sub-set of the angiogram data set.
- an isolation of a sub-set of the angiogram data set is performed on the basis of at least one of a histogram-based procedure and a threshold-based procedure.
- the device-map sequence is generated from a life-image data set.
- the device-map sequence may be generated on the basis of at least one of a position of a guidewire or a marker.
- the examination apparatus is configured as one of the group consisting of a material testing apparatus, a medical application apparatus and a micro CT system.
- a field of application of the invention may be medical imaging or baggage inspection.
- the examination apparatus is adapted as one of a three-dimensional computed tomography apparatus and a three-dimensional rotational x-ray apparatus.
- a method for cardiac roadmapping for examination of an object of interest with an examination apparatus in which a cardiac roadmapping is performed on the basis of at least one of a global correlation determination of a first image sequence of the object of interest and a second image sequence of the object of interest and a correlation determination of a first image of the object of interest and the second image of the object of interest on the basis of an identification of a first object and a second object in the first image and the second image.
- an image processing device for cardiac roadmapping for examination of an object of interest comprising a memory for storing a data set of the object of interest and which is adapted for carrying out the above-mentioned method steps.
- a computer-readable medium in which a computer program for cardiac roadmapping is stored which, when being executed by a processor, causes the processor to carry out the above-mentioned method steps.
- a program element for cardiac roadmapping for examination of an object of interest when being executed by a processor, causes the processor to carry out the above-mentioned method steps.
- the method of examination of the object of interest may be embodied as the computer program, i.e. by software, or may be embodied using one or more special electronic optimization circuits, i.e. in hardware, or the method may be embodied in hybrid form, i.e. by means of software components and hardware components.
- the program element may preferably be loaded into working memories of a data processor.
- the data processor may thus be equipped to carry out exemplary embodiments of the methods of the present invention.
- the computer program may be written in any suitable programming language, such as, for example, C++ and may be stored on a computer-readable medium, such as a CD-ROM.
- the computer program may be available from a network, such as the WorldWideWeb, from which it may be downloaded into image processing units or processors, or any suitable computers.
- a registration of images relating to an angiogram data set and images relating to a life-time data set is performed without an additional pairing or image selection step. No identification of a cardiac or respiration phase has to be performed. Therefore, an electrocardiogram or lung monitoring equipment is not necessary.
- Fig. 1 shows a schematic representation of an exemplary rotational X-ray scanner in which a method according to the invention may be implemented.
- An X-ray source 100 and a flat detector 101 with a large sensitive area are mounted to the ends of a C-arm 102.
- the C-arm 102 is held by curved rail, the "sleeve" 103.
- the C-arm can slide in the sleeve 103, thereby performing a "roll movement" about the axis of the C-arm.
- the sleeve 103 is attached to an L-arm 104 via a rotational joint and can perform a "propeller movement" about the axis of this joint.
- the L-arm 104 is attached to the ceiling via another rotational joint and can perform a rotation about the axis of this joint.
- the various rotational movements are effected by servo motors.
- the axes of the three rotational movements and the cone-beam axis always meet in a single fixed point, the "isocenter" 105 of the rotational X-ray scanner.
- the shape and size of this "volume of projection" (VOP) depend on the shape and size of the detector and on the source trajectory.
- the ball 110 indicates the biggest isocentric ball that fits into the VOP.
- the object e.g.
- a patient or an item of baggage) to be imaged is placed on the table 111 such that the object's VOI fills the VOP. If the object is small enough, it will fit completely into the VOP; otherwise, not. The VOP therefore limits the size of the VOI.
- Each triple of C-arm angle, sleeve angle, and L-arm angle defines a position of the X-ray source. By varying these angles with time, the source can be made to move along a prescribed source trajectory.
- the detector at the other end of the C-arm makes a corresponding movement.
- Fig. 2 shows a schematic representation of an image 201 of an angiography-sequence and an image 202 of a life-sequence for registration according to an exemplary embodiment of the present invention.
- the image 201 shows the vessel-tree 203 and the image 202, which is acquired during an intervention, shows a guidewire 204 inserted into the vessel-tree 203.
- the targeted device has a very limited breadth as compared to the breadth of vessels in the filled angiogram. As a matter of fact, this also applies to other possible intervention devices such as the balloon markers (mentioned once in [3]), or the catheter injection tip from where the contrast agent flows into the coronaries (the catheter is not mentioned in [3] as a possible targeted device).
- the discrepancy between the breadth of the vessels in the angiogram image and the breadth of the segmented object in the corresponding live image may be bound to lead to high registration inaccuracies. For instance, if the tip is rather straight (which is very often the case), it can reasonably fit into any straight vessel section that shows the same orientation (assuming a simple translation-based registration process). This of course may end up to a highly undiscriminating situation, prone to considerable registration mistakes.
- the present invention may improve this situation and may suppress the high degree of inaccuracy of the method described in [3].
- intervention objects are simultaneously present and detected (or enhanced). This may improve the registration of the roadmap and of the live image during cardiac roadmapping.
- the invention proposes to enforce the presence of catheter injection tip in both the angiogram and the live image and to combine the injection tip detection with the detection of another intervention device such as the guidewire tip and/or balloon/stent markers.
- the privileged location of the injection tip at a pivotal point of the vessel network anatomy, combined with a more distal device location such as the guidewire tip's location is an essential element for the robustness of the angiogram vessel map and of a multi-device map.
- the injection tip is not necessarily present in both the angiogram and the live image.
- the intervention protocol is slightly modified to enforce this presence in both the angiogram and the live image, together with the presence of a second intervention device in the live image. This may improve the vessel-to-device registration operation.
- the detection and registration methods proposed by this invention differ from [3] in that the well-identified nature of the involved objects may allow for higher specificity at the detection phase, and lower complexity at the registration phase (see below).
- the invention both proposes an interventional protocol constraint and a detection / registration method for cardiac roadmapping.
- An aspect of the invention stipulates that two distinct devices should be present in the live image, and their corresponding anatomical locations should be visible in the angiogram image.
- the invention stipulates that:
- Fig. 3 shows a flow-chart of an exemplary embodiment of a detection/registration method according to the present invention.
- Step 1 Vessel map creation
- the method relies on the construction of a vessel map, which may simply be a vessel segmentation image or a map that provides, for each pixel, the likelihood of vessel presence.
- a vessel map which may simply be a vessel segmentation image or a map that provides, for each pixel, the likelihood of vessel presence.
- the catheter injection tip should be part of this vessel map.
- Step 2 Multi-device map creation
- the second step is applied to the live image. It consists in building a device map that accounts for the presence of a least two distinct intervention devices. Those devices are very specific and the map creation method can take advantage of this specificity. For each device nature, a specialised technique might be involved. For instance, one might take into account the device scale, expected breadth and location. In particular, the injection tip is to be looked for near the image borders or shutter borders. When object-specific techniques are used, several device maps might be separately created and then eventually merged into a single multi-device map accounting for all the targeted devices.
- the composite device map might be binary, or as in the vessel case, multi-valued, reflecting the likelihood of the presence of each targeted device.
- Step 3 Vessel map to device map registration
- the registration process may then be applied. It comprises the step of finding the geometrical transformation (among a pre-defined class of possible transformations) that maximizes the similarity between the vessels and the multi-device roadmaps. Several similarity measurements may be considered.
- the first step consists of pairing the current live image with a given angiogram image thanks to the matching of their cardiac phases (plus possibly the matching of their respiratory phases).
- this pairing may rely on the ECG signal or on image-based cardiac phase determination (this is often referred to as the kymogram method).
- any method that strongly relies on the cardiac / respiratory phase correlation between the angiogram and the live parts of the intervention may naturally be exposed to all sort of robustness problems.
- a cardiac roadmapping technique that does not rely on the prerequisite of a phase-centric pairing of the angiogram and live images. Instead, both the pairing and accurate registration of the angiogram and live images are combined within a single operation.
- This operation comprises a global registering of a (causal) device-map sequence, incrementally built at live time, with a vessel-map sequence built during angiogram creation.
- This global motion-compensated association process relies on map similarities, but may also enforce temporal coherency.
- the invention may produce a cardiac roadmap without the help of any ECG signal or its image-based surrogate (kymogram).
- the invention may lead to a more robust cardiac roadmapping, capable of coping with arrythmic disorders, cardiac rhythm instabilities, and respiratory cycle or depth changes.
- Fig. 4 shows a flow-chart of another exemplary embodiment of a method according to the present invention.
- Step 1 Determination of the useful part of the angiogram
- the first step consists of isolating from the total angiogram sequence a subset of consecutive images that contains a sufficient amount of contrast agent, thus featuring a good contrast of the vessels set against the background.
- Simple histogram-based or thresholding techniques applied to the vessel-enhanced angiogram images may be used to compute this subset isolation.
- Step 2 Creation of a vessel-map sequence from the useful angiogram part
- a vessel-map image refers to an image where the pixel values are representative of the likelihood of vessel presence at that pixel.
- the values can either be binary (designating presence or absence certainty), or they can vary within a certain range, thus measuring a degree of presence likelihood.
- a vessel-map image can be built from a vessel-enhanced image, using for instance the approach described in [4]. But many other techniques are also possible.
- a vessel-map sequence may simply be constituted of vessel-map images, as described above.
- the full input sequence (the useful angiogram part) is used to compute each elementary vessel-map image of the sequence. This is typically the case when motion information is used to discriminate between vessel and non-vessel structures.
- the vessel-presence likelihood may be replaced or augmented with a vessel-proximity likelihood, for instance using a distance transform.
- Step 3 Creation of a causal live device-map sequence up until the current time
- a causal device-map sequence is built.
- the considered devices may for instance be, but not exclusively, the guidewire tip or balloon/stent markers.
- the term “causal” simply refers to the fact that the device-map sequence is built up to the current time and no further.
- the device-map sequence up to time t can be built from the device-map computed up to t-1, augmented with a device-map at time t. However, this is not necessarily the case.
- Step 4 Global correlation of the causal device-map and vessel-map sequences
- This final part may be the most important step according to this exemplary embodiment of the present invention.
- all the geometrically transformed causal device-maps can be compared via a given similarity criterion to all the vessel-maps of the useful angiogram part (now simply referred to as the angiogram).
- Index t designates the current time.
- Term H[A] enforces the temporal coherency of the association A over the full interval [0, t]. This terms aims at capturing the continuous nature of the image acquisition process and of the involved respiratory and cardiac motions.
- ⁇ and ⁇ are simple normalisation constants, and the negative sign in front of ⁇ simply accounts for the fact that one looks for high map similarity values, but low inter-transform distance values.
- Fig. 5 shows an exemplary embodiment of a data processing device 500 according to the present invention for executing an exemplary embodiment of a method in accordance with the present invention.
- the data processing device 500 depicted in Fig. 5 comprises a central processing unit (CPU) or image processor 501 connected to a memory 502 for storing an image depicting an object of interest, such as the heart of a patient or an item of baggage.
- the central processing unit 502 may comprise a determination unit (not depicted in Fig. 5 ) according to an aspect of the present invention.
- the data processor 501 may be connected to a plurality of input/output network or diagnosis devices, such as a computer tomography scanner.
- the data processor 501 may furthermore be connected to a display device 503, for example, a computer monitor, for displaying information or an image computed or adapted in the data processor 501.
- An operator or user may interact with the data processor 501 via a keyboard 504 and/or other input or output devices, which are not depicted in Fig. 5 .
- the bus system 505 it may also be possible to connect the image processing and control processor 501 to, for example, a motion monitor, which monitors a motion of the object of interest.
- a motion monitor which monitors a motion of the object of interest.
- the motion sensor may be an exhalation sensor.
- the motion sensor may be an electrocardiogram.
- ECG or exhalation data are, according to an aspect of the invention, not necessary.
- Cardiac roadmapping according to the invention is perceived as a possible breakthrough since it may offer to the cardiologist an unprecedented way of achieving PTCA interventions with less contrast agent, less dose, less time, and more security.
- the global correlation determination comprises an optimisation of a measure function K[A], which relates to the similarity.
- the optimisation of the measure function enforces a temporal coherency H[A].
- the device-map sequence is a causal device-map sequence.
- the vessel-map sequence is generated from one of an angiogram data set and an isolated sub-set of the angiogram data set, wherein the vessel-map sequence comprises a plurality of vessel-map images.
- a vessel-map image of the vessel-map sequence is generated on the basis of a vessel-enhanced image.
- each vessel-map image of the vessel-map sequence is computed on the basis of a full isolated sub-set of the angiogram data set.
- an isolation of a sub-set of the angiogram data set is performed on the basis of at least one of a histogram-based and a threshold-based procedure.
- the device-map sequence is generated from a life-image data set.
- the device-map sequence is generated on the basis of at least one of a position of a guidewire or a marker.
- the object of interest is a vessel-tree.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Biomedical Technology (AREA)
- Physics & Mathematics (AREA)
- High Energy & Nuclear Physics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Vascular Medicine (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Claims (10)
- Procédé mis en oeuvre par ordinateur pour une cartographie cardiaque destinée à un examen d'une arborescence vasculaire, comprenant :- la dérivation d'une carte vasculaire à partir d'une angiographie de l'arborescence vasculaire ;- l'identification d'au moins deux objets d'intervention distincts dans une image en direct de l'arborescence vasculaire en utilisant des techniques spécifiques à l'objet pour au moins l'un des objets, dans lequel un premier objet d'intervention est un embout d'injection de cathéter à un point charnière de l'arborescence vasculaire, pour lequel la technique spécifique à l'objet implique la recherche de l'embout d'injection à un emplacement proche d'une frontière de l'image en direct ;- la dérivation d'une carte de dispositif vital sur la base de l'identification ; et- la corrélation de la carte vasculaire et de la carte de dispositif vital.
- Procédé selon la revendication 1,
dans lequel la carte de dispositif vital est binaire ou à valeurs multiples, en reflétant une probabilité de la présence du premier objet et du deuxième objet. - Procédé selon la revendication 1,
dans lequel le deuxième objet d'intervention est un fil de guidage ou un marqueur de ballonnet ou un marqueur d'endoprothèse inséré dans une artère coronaire de l'arborescence vasculaire. - Procédé selon la revendication 1,
comprenant en outre le déclenchement d'une alarme si aucune détection du premier objet ou du deuxième objet n'est effectuée. - Procédé selon la revendication 1, dans lequel l'identification des au moins deux objets comprend l'utilisation de techniques spécifiques à l'objet pour chaque objet.
- Procédé selon la revendication 5, dans lequel la dérivation de la carte de dispositif vital comprend la création de cartes de dispositif distinctes pour chaque objet sur la base des techniques d'identification spécifiques à l'objet, et la fusion des cartes de dispositif distinctes en une seule carte de dispositifs multiples en tant que la carte de dispositif vital.
- Appareil d'examen pour un examen d'une arborescence vasculaire, comprenant une unité de détermination configurée pour effectuer les étapes d'un procédé selon l'une quelconque des revendications 1 à 6.
- Appareil selon la revendication 7, configuré en tant qu'un scanner rotatif à rayons X.
- Produit de programme informatique pour une cartographie cardiaque, comprenant un ensemble d'instructions qui, lorsqu'elles sont exécutées par un processeur (401), amènent le processeur à effectuer les étapes d'un procédé selon l'une quelconque des revendications 1 à 6.
- Support lisible par ordinateur sur lequel est mémorisé le produit de programme informatique selon la revendication 9.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP08719459.3A EP2114252B1 (fr) | 2007-02-28 | 2008-02-25 | Cartographie cardiaque indépendante des phases |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP07103243 | 2007-02-28 | ||
EP08719459.3A EP2114252B1 (fr) | 2007-02-28 | 2008-02-25 | Cartographie cardiaque indépendante des phases |
PCT/IB2008/050668 WO2008104921A2 (fr) | 2007-02-28 | 2008-02-25 | Cartographie cardiaque indépendante des phases |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2114252A2 EP2114252A2 (fr) | 2009-11-11 |
EP2114252B1 true EP2114252B1 (fr) | 2018-04-11 |
Family
ID=39645643
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP08719459.3A Active EP2114252B1 (fr) | 2007-02-28 | 2008-02-25 | Cartographie cardiaque indépendante des phases |
Country Status (4)
Country | Link |
---|---|
US (1) | US8554308B2 (fr) |
EP (1) | EP2114252B1 (fr) |
CN (1) | CN101621965B (fr) |
WO (1) | WO2008104921A2 (fr) |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010067300A1 (fr) | 2008-12-12 | 2010-06-17 | Koninklijke Philips Electronics N. V. | Cartographie automatique pour remplacement valvulaire |
WO2010108146A2 (fr) | 2009-03-20 | 2010-09-23 | Orthoscan Incorporated | Appareil mobile d'imagerie |
JP5965840B2 (ja) | 2009-09-29 | 2016-08-10 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | 血管ロードマッピング |
US8693755B2 (en) * | 2010-06-17 | 2014-04-08 | Siemens Medical Solutions Usa, Inc. | System for adjustment of image data acquired using a contrast agent to enhance vessel visualization for angiography |
JP6002667B2 (ja) | 2010-07-19 | 2016-10-05 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | 3d起源の心臓ロードマップ生成 |
WO2012011035A1 (fr) | 2010-07-19 | 2012-01-26 | Koninklijke Philips Electronics N.V. | Création adaptative d'une feuille de route |
WO2012082799A1 (fr) | 2010-12-13 | 2012-06-21 | Orthoscan, Inc. | Système d'imagerie fluoroscopique mobile |
EP2681711B1 (fr) * | 2011-03-02 | 2016-06-29 | Koninklijke Philips N.V. | Visualisation pour un guidage de navigation |
US9014454B2 (en) * | 2011-05-20 | 2015-04-21 | Varian Medical Systems, Inc. | Method and apparatus pertaining to images used for radiation-treatment planning |
EP2754126B1 (fr) | 2011-11-18 | 2020-07-01 | Koninklijke Philips N.V. | Appariement d'une représentation de l'anatomie à des images en temps réel |
US8675944B2 (en) * | 2012-01-12 | 2014-03-18 | Kabushiki Kaisha Toshiba | Method of registering image data |
US9583075B2 (en) | 2012-08-03 | 2017-02-28 | Koninklijke Philips N.V. | Device position dependant overlay for roadmapping |
CN107787203B (zh) * | 2015-06-25 | 2021-04-27 | 皇家飞利浦有限公司 | 图像配准 |
CN106923792B (zh) * | 2017-03-21 | 2019-11-22 | 重庆理工大学 | 反射式超便携人体浅表部静脉血管显像仪 |
EP3628235A1 (fr) | 2018-09-26 | 2020-04-01 | Koninklijke Philips N.V. | Imagerie intravasculaire par ultrasons |
US20220215625A1 (en) * | 2019-04-02 | 2022-07-07 | The Methodist Hospital System | Image-based methods for estimating a patient-specific reference bone model for a patient with a craniomaxillofacial defect and related systems |
DE102023202451A1 (de) | 2023-03-20 | 2024-09-26 | Siemens Healthineers Ag | Bereitstellen eines Ergebnisdatensatzes |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5274551A (en) | 1991-11-29 | 1993-12-28 | General Electric Company | Method and apparatus for real-time navigation assist in interventional radiological procedures |
US5724551A (en) * | 1996-05-23 | 1998-03-03 | International Business Machines Corporation | Method for managing I/O buffers in shared storage by structuring buffer table having entries include storage keys for controlling accesses to the buffers |
US6351513B1 (en) * | 2000-06-30 | 2002-02-26 | Siemens Corporate Research, Inc. | Fluoroscopy based 3-D neural navigation based on co-registration of other modalities with 3-D angiography reconstruction data |
US7499743B2 (en) * | 2002-03-15 | 2009-03-03 | General Electric Company | Method and system for registration of 3D images within an interventional system |
DE10247299A1 (de) | 2002-10-10 | 2004-04-22 | Philips Intellectual Property & Standards Gmbh | Bildverarbeitungseinheit und Verfahren für die Zuordnung von gespeicherten zu aktuellen Aufnahmen |
JP4804005B2 (ja) * | 2002-11-13 | 2011-10-26 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 境界構造を検出するための医用ビューイングシステム及び方法 |
DE10322738A1 (de) * | 2003-05-20 | 2004-12-16 | Siemens Ag | Verfahren zur markerlosen automatischen Fusion von 2D-Fluoro-C-Bogen-Bildern mit präoperativen 3D-Bildern unter Verwendung eines intraoperativ gewonnenen 3D-Datensatzes |
US20060257006A1 (en) * | 2003-08-21 | 2006-11-16 | Koninklijke Philips Electronics N.V. | Device and method for combined display of angiograms and current x-ray images |
WO2005039253A1 (fr) | 2003-10-16 | 2005-04-28 | Philips Intellectual Property & Standards Gmbh | Methode et dispositif de generation d'une image angiographique |
US20060036167A1 (en) * | 2004-07-03 | 2006-02-16 | Shina Systems Ltd. | Vascular image processing |
JP2008534109A (ja) | 2005-03-31 | 2008-08-28 | パイエオン インコーポレイテッド | 管状器官内の機器を位置決めする装置および方法 |
DE102005030609A1 (de) * | 2005-06-30 | 2007-01-04 | Siemens Ag | Verfahren bzw. Röntgeneinrichtung zum Erstellen einer Serienaufnahme von medizinischen Röntgenbildern eines sich während der Serienaufnahme ggf. bewegenden Patienten |
-
2008
- 2008-02-25 WO PCT/IB2008/050668 patent/WO2008104921A2/fr active Application Filing
- 2008-02-25 EP EP08719459.3A patent/EP2114252B1/fr active Active
- 2008-02-25 US US12/528,097 patent/US8554308B2/en active Active
- 2008-02-25 CN CN200880006414.8A patent/CN101621965B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
EP2114252A2 (fr) | 2009-11-11 |
CN101621965A (zh) | 2010-01-06 |
CN101621965B (zh) | 2015-08-26 |
US8554308B2 (en) | 2013-10-08 |
US20100145193A1 (en) | 2010-06-10 |
WO2008104921A2 (fr) | 2008-09-04 |
WO2008104921A3 (fr) | 2008-11-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2114252B1 (fr) | Cartographie cardiaque indépendante des phases | |
US8255037B2 (en) | Cardiac roadmapping | |
EP2026697B1 (fr) | Débit coronarien à compensation de mouvement à partir d'un traitement de l'image par projection | |
US9042628B2 (en) | 3D-originated cardiac roadmapping | |
US7010080B2 (en) | Method for marker-free automatic fusion of 2-D fluoroscopic C-arm images with preoperative 3D images using an intraoperatively obtained 3D data record | |
JP4374234B2 (ja) | 医療的侵襲処置計画の方法及び装置 | |
JP5965840B2 (ja) | 血管ロードマッピング | |
US20050027193A1 (en) | Method for automatically merging a 2D fluoroscopic C-arm image with a preoperative 3D image with one-time use of navigation markers | |
Ambrosini et al. | A hidden Markov model for 3D catheter tip tracking with 2D X-ray catheterization sequence and 3D rotational angiography | |
JP5739811B2 (ja) | 関心対象をデバイスとともに可視化する装置と方法 | |
JP2019162451A (ja) | 自動的な動き検出 | |
KR101703564B1 (ko) | 혈관 정보를 포함하는 의료 영상을 디스플레이하는 장치 및 방법 | |
Wagner et al. | Real‐time respiratory motion compensated roadmaps for hepatic arterial interventions | |
Kim et al. | Registration of angiographic image on real-time fluoroscopic image for image-guided percutaneous coronary intervention | |
DE102010022526A1 (de) | Verfahren und Vorrichtung zur Verbesserung einer CT-Bild-Darstellung von zumindest einem medizinischen Instrument in einem nahezu nicht kontrastierbaren Ziel-Bereich | |
Adamus et al. | Enhancing transjugular intrahepatic portosystemic shunt puncture by using three-dimensional path planning based on the back projection of two two-dimensional portographs | |
Wang et al. | Target visibility enhancement for C-arm cone beam CT-fluoroscopy-guided hepatic needle placement: implementation and accuracy evaluation | |
CN116894865A (zh) | 结果数据集的提供 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20090928 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20100120 |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20171020 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 987115 Country of ref document: AT Kind code of ref document: T Effective date: 20180415 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602008054773 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180411 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180711 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180712 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 987115 Country of ref document: AT Kind code of ref document: T Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180813 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602008054773 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
26N | No opposition filed |
Effective date: 20190114 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190225 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190225 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190225 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180411 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20080225 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240228 Year of fee payment: 17 Ref country code: GB Payment date: 20240220 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240226 Year of fee payment: 17 |