EP3340912A1 - Methods and systems for displaying electrophysiological lesions - Google Patents
Methods and systems for displaying electrophysiological lesionsInfo
- Publication number
- EP3340912A1 EP3340912A1 EP16779295.1A EP16779295A EP3340912A1 EP 3340912 A1 EP3340912 A1 EP 3340912A1 EP 16779295 A EP16779295 A EP 16779295A EP 3340912 A1 EP3340912 A1 EP 3340912A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- lesion
- surface model
- geometric surface
- tissue necrosis
- processing apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003902 lesion Effects 0.000 title claims abstract description 78
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000017074 necrotic cell death Effects 0.000 claims abstract description 55
- 238000010276 construction Methods 0.000 claims abstract description 36
- 238000009877 rendering Methods 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims description 36
- 238000002679 ablation Methods 0.000 claims description 25
- 210000001519 tissue Anatomy 0.000 description 40
- 230000006870 function Effects 0.000 description 14
- 230000005684 electric field Effects 0.000 description 10
- 230000000747 cardiac effect Effects 0.000 description 7
- 238000005259 measurement Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 239000012530 fluid Substances 0.000 description 5
- 210000001015 abdomen Anatomy 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 239000004020 conductor Substances 0.000 description 3
- 230000005284 excitation Effects 0.000 description 3
- 238000002595 magnetic resonance imaging Methods 0.000 description 3
- 244000025254 Cannabis sativa Species 0.000 description 2
- 206010016654 Fibrosis Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 230000004761 fibrosis Effects 0.000 description 2
- 210000005003 heart tissue Anatomy 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000002262 irrigation Effects 0.000 description 2
- 238000003973 irrigation Methods 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 231100000241 scar Toxicity 0.000 description 2
- 238000007592 spray painting technique Methods 0.000 description 2
- 230000001225 therapeutic effect Effects 0.000 description 2
- 238000002604 ultrasonography Methods 0.000 description 2
- 230000002861 ventricular Effects 0.000 description 2
- 229910052688 Gadolinium Inorganic materials 0.000 description 1
- 238000010317 ablation therapy Methods 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- -1 and bodily fluids) Substances 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 210000001124 body fluid Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 230000034994 death Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000013213 extrapolation Methods 0.000 description 1
- 238000005194 fractionation Methods 0.000 description 1
- UIWYJDYFSGRHKR-UHFFFAOYSA-N gadolinium atom Chemical compound [Gd] UIWYJDYFSGRHKR-UHFFFAOYSA-N 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 229920002635 polyurethane Polymers 0.000 description 1
- 239000004814 polyurethane Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
- A61B5/015—By temperature mapping of body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
- A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
- A61B5/6852—Catheters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00315—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body for treatment of particular body parts
- A61B2018/00345—Vascular system
- A61B2018/00351—Heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00315—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body for treatment of particular body parts
- A61B2018/00345—Vascular system
- A61B2018/00351—Heart
- A61B2018/00357—Endocardium
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
- A61B2018/00773—Sensed parameters
- A61B2018/00779—Power or energy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
- A61B2018/00773—Sensed parameters
- A61B2018/00791—Temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B2018/00636—Sensing and controlling the application of energy
- A61B2018/00773—Sensed parameters
- A61B2018/00886—Duration
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
- A61B2034/104—Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/064—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
- A61B2090/065—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension for measuring contact or contact pressure
Definitions
- This disclosure relates to systems and methods for generating an electrophysiological map of a geometric structure. More particularly, this disclosure relates to computer-implemented systems and methods for rendering lesions on a model of a geometric structure, such as, for example, an intra-cardiac structure.
- At least some known systems facilitate displaying lesions (e.g., generated from ablation therapy) on generated surface models.
- lesions are rendered as either brown spheres or brown surface patches, with a user-selectable radius.
- the locations of the rendered lesions are determined solely based on user placement. That is, the lesions are not rendered based on potentially relevant parameter values such as power level, delivery duration, tissue contact force, lesion-size index (LSI), or force-time integral (FTI). Accordingly, it would be desirable to display lesions more accurately using multidimensional modeling systems.
- the present disclosure is directed to a system for rendering lesions on a geometric surface model of a geometric structure.
- the system includes a computer-based model construction system configured to create a three-dimensional (3D) texture map including a plurality of voxels each having a tissue necrosis value, increment the tissue necrosis values as a function of at least one parameter to generate a total tissue necrosis value for each voxel, render at least one lesion on the geometric surface model based on the total tissue necrosis values, and display the geometric surface model and the at least one rendered lesion.
- 3D three-dimensional
- the present disclosure is directed to a computer- implemented method of rendering lesions on a geometric surface model of a geometric structure.
- the method includes creating a three-dimensional (3D) texture map including a plurality of voxels each having a tissue necrosis value, incrementing the tissue necrosis values as a function of at least one parameter to generate a total tissue necrosis value for each voxel, rendering at least one lesion on the geometric surface model based on the total tissue necrosis values, and displaying the geometric surface model and the at least one rendered lesion.
- 3D three-dimensional
- the present disclosure is directed to a processing apparatus for rendering lesions on a geometric surface model of a geometric structure.
- the processing apparatus is configured to create a three-dimensional (3D) texture map including a plurality of voxels each having a tissue necrosis value, increment the tissue necrosis values as a function of at least one parameter to generate a total tissue necrosis value for each voxel, render at least one lesion on the geometric surface model based on the total tissue necrosis values, and display the geometric surface model and the at least one rendered lesion.
- 3D three-dimensional
- Figure 1 is a diagrammatic view of a system for generating a multi-dimensional surface model of a geometric structure according to one embodiment.
- Figure 2 is a diagrammatic and schematic view of a model construction system of the system illustrated in Figure 1.
- Figure 3 is a schematic view of a point cloud containing a collection of location data points.
- Figures 4A-4D are schematic diagrams of exemplary dipole pairs of driven patch electrodes suitable for use in the model construction system illustrated in Figure 2.
- Figure 5 is a flowchart of a method for rendering lesions on a geometric surface model according to one embodiment.
- Figure 6 is an example of a map including lesions that is generated using the method illustrated in Figure 5.
- Figure 7 is an example of a map including lesions that is generated using the method illustrated in Figure 5.
- Figure 8 is an example of a map including lesions that is generated using the method illustrated in Figure 5.
- the disclosure provides systems and methods for rendering lesions on a geometric surface model of a geometric structure (e.g., of a cardiac structure).
- a computer-based model construction system is configured to create a three-dimensional (3D) texture map including a plurality of voxels each having a tissue necrosis value. The tissue necrosis values are incremented according to at least one parameter to generate a total tissue necrosis value for each voxel. At least one lesion is rendered on the geometric surface model based on the total tissue necrosis values, and the geometric surface model and the at least one rendered lesion are display for a user.
- Figure 1 illustrates one exemplary embodiment of a system 10 for generating a multi-dimensional surface model of one or more geometric structures.
- the model generated by system 10 is a three-dimensional model. It will be appreciated, however, that while the generation of a three-dimensional model is described below, the present disclosure is not meant to be so limited. Rather, in other embodiments, system 10 may be configured to generate multidimensional models other than in three dimensions, and such embodiments remain within the spirit and scope of the present disclosure.
- system 10 in the generation of models of anatomic structures, and cardiac structures in particular, the present disclosure is not meant to be so limited. Rather, system 10, and the methods and techniques used thereby, may be applied to the generation of three- dimensional models of any number of geometric structures, including anatomic structures other than cardiac structures. However, for purposes of illustration and ease of description, the description below will be focused on the use of system 10 in the generation of three- dimensional models of cardiac structures.
- the system 10 includes, among other components, a medical device and a model construction system 14.
- medical device is a catheter 12
- model construction system 14 includes, in part, a processing apparatus 16.
- Processing apparatus 16 may take the form of an electronic control unit, for example, that is configured to construct a three-dimensional model of structures within the heart using data collected by catheter 12.
- catheter 12 is configured to be inserted into a patient's body 18, and more particularly, into the patient's heart 20.
- Catheter 12 may include a cable connector or interface 22, a handle 24, a shaft 26 having a proximal end 28 and a distal end 30 (as used herein, “proximal” refers to a direction toward the portion of the catheter 12 near the clinician, and “distal” refers to a direction away from the clinician and (generally) inside the body of a patient), and one or more sensors 32 (e.g., 32i, 32 2 , 32s) mounted in or on shaft 26 of catheter 12. In this embodiment, sensors 32 are disposed at or near distal end 30 of shaft 26.
- Catheter 12 may further include other conventional components such as, for example and without limitation, a temperature sensor, additional sensors or electrodes, ablation elements (e.g., ablation tip electrodes for delivering RF ablative energy, high intensity focused ultrasound ablation elements, etc.), and corresponding conductors or leads.
- Connector 22 provides mechanical, fluid, and electrical connection(s) for cables, such as, for example, cables 34, 36 extending to model construction system 14 and/or other components of system 10 (e.g., a visualization, navigation, and/or mapping system (if separate and distinct from model construction system 14), an ablation generator, irrigation source, etc.).
- Connector 22 is conventional in the art and is disposed at proximal end 28 of catheter 12, and handle 24 thereof, in particular.
- Handle 24 which is disposed at proximal end 28 of shaft 26, provides a location for the clinician to hold catheter 12 and may further provide means for steering or guiding shaft 26 within body 18 of the patient.
- handle 24 may include means to change the length of a steering wire extending through catheter 12 to distal end 30 of shaft 26 to steer shaft 26.
- Handle 24 is also conventional in the art and it will be understood that the construction of handle 24 may vary.
- catheter 12 may be robotically driven or controlled. Accordingly, rather than a clinician manipulating a handle to steer or guide catheter 12 and shaft 26 thereof, in such an embodiments, a robot is used to manipulate catheter 12.
- Shaft 26 is an elongate, tubular, flexible member configured for movement within body 18.
- Shaft 26 supports, for example and without limitation, sensors and/or electrodes mounted thereon, such as, for example, sensors 32, associated conductors, and possibly additional electronics used for signal processing and conditioning.
- Shaft 26 may also permit transport, delivery, and/or removal of fluids (including irrigation fluids, cryogenic ablation fluids, and bodily fluids), medicines, and/or surgical tools or instruments.
- Shaft 26 may be made from conventional materials such as polyurethane, and defines one or more lumens configured to house and/or transport electrical conductors, fluids, or surgical tools.
- Shaft 26 may be introduced into a blood vessel or other structure within the body 18 through a conventional introducer. Shaft 26 may then be steered or guided through body 18 to a desired location, such as heart 20, using means well known in the art.
- Sensors 32 mounted in or on shaft 26 of catheter 12 may be provided for a variety of diagnostic and therapeutic purposes including, for example and without limitation, electrophysiological studies, pacing, cardiac mapping, and ablation.
- one or more of sensors 32 are provided to perform a location or position sensing function. More particularly, and as will be described in greater detail below, one or more of sensors 32 are configured to be a positioning sensor(s) that provides information relating to the location (position and orientation) of catheter 12, and distal end 30 of shaft 26 thereof, in particular, at certain points in time.
- sensor(s) 32 can be used to collect location data points that correspond to the surface of, and/or other locations within, the structure of interest. These location data points can then be used by, for example, model construction system 14, in the construction of a three-dimensional model of the structure of interest, which will be described in greater detail below.
- model construction system 14 For purposes of clarity and illustration, the description below will discuss an embodiment wherein multiple sensors 32 of catheter 12 comprise positioning sensors. It will be appreciated, however, that in other embodiments, which remain within the spirit and scope of the present disclosure, catheter 12 may comprise both one or more positioning sensors as well as other sensors configured to perform other diagnostic and/or therapeutic functions.
- model construction system 14 is configured to construct a three-dimensional model of structures within the heart using, in part, location data collected by catheter 12. More particularly, processing apparatus 16 of model construction system 14 is configured to acquire location data points collected by sensor(s) 32 and to then use those location data points in the construction or generation of a model of the structure(s) to which the location data points correspond. In this embodiment, model construction system 14 acquires the location data points by functioning with sensors 32 to collect location data points.
- model construction system 14 may simply acquire the location data points from sensors 32 or another component in system 10, such as, for example, a memory or other storage device that is part of model construction system 14 or accessible thereby, without affirmatively taking part in the collection of the location data points.
- Model construction system 14 is configured to construct a three-dimensional model based on some or all of the collected location data points. For purposes of illustration and clarity, the description below will be limited to an embodiment wherein model construction system 14 is configured to both construct the model and also acquire location data points by functioning with sensor(s) 32 in the collection of the location data points. It will be appreciated, however, that other embodiments wherein model construction system 14 only acquires location data points from sensor(s) 32 or another component of system 10 and then constructs a three-dimensional model based thereon remain within the spirit and scope of the present disclosure.
- model construction system 14 in addition to constructing a model of a structure, is configured to function with sensor(s) 32 to collect location data points that are used in the construction of a three-dimensional model.
- Model construction system 14 may comprise an electric field-based system, such as, for example, the EnSiteTM NavXTM system commercially available from St. Jude Medical, Inc., and generally shown with reference to U.S. Pat. No. 7,263,397 entitled “Method and Apparatus for Catheter Navigation and Location and Mapping in the Heart", the entire disclosure of which is incorporated herein by reference.
- model construction system 14 may comprise other types of systems, such as, for example and without limitation: a magnetic-field based system such as the CartoTM system available from Biosense Webster, and as generally shown with reference to one or more of U.S. Pat. Nos. 6,498,944 entitled “Intrabody Measurement,” 6,788,967 entitled “Medical Diagnosis, Treatment and Imaging Systems,” and 6,690,963 entitled “System and Method for Determining the Location and Orientation of an Invasive Medical Instrument," the entire disclosures of which are incorporated herein by reference, or the gMPS system from MediGuide Ltd., and as generally shown with reference to one or more of U.S. Pat. Nos.
- a magnetic-field based system such as the CartoTM system available from Biosense Webster
- 6,498,944 entitled “Intrabody Measurement”
- 6,788,967 entitled “Medical Diagnosis, Treatment and Imaging Systems”
- 6,690,963 entitled “System and Method for Determining the Location and
- sensor(s) 32 of catheter 12 include positioning sensors. Sensor(s) 32 produce signals indicative of catheter location (position and/or orientation) information.
- sensor(s) 32 may comprise one or more electrodes.
- sensor(s) 32 may include one or more magnetic sensors configured to detect one or more characteristics of a low-strength magnetic field.
- sensor(s) 32 may include magnetic coils disposed on or in shaft 26 of catheter 12.
- model construction system 14 will hereinafter be described as including an electric field-based system, such as, for example, the EnSiteTM NavXTM system identified above. It will be appreciated that while the description below is primarily limited to an embodiment wherein sensor(s) 32 include one or more electrodes, in other embodiments, sensor(s) 32 may include one or more magnetic field sensors (e.g., coils). Accordingly, model construction systems that include positioning sensor(s) other than the sensors or electrodes described below remain within the spirit and scope of the present disclosure.
- model construction system 14 may include, among other possible components, a plurality of patch electrodes 38, a multiplex switch 40, a signal generator 42, and a display device 44. In other embodiments, some or all of these components are separate and distinct from model construction system 14 but are electrically connected to, and configured for communication with, model construction system 14.
- Processing apparatus 16 may include a programmable microprocessor or microcontroller, or may include an application specific integrated circuit (ASIC). Processing apparatus 16 may include a central processing unit (CPU) and an input/output (I/O) interface through which the processing apparatus 16 may receive a plurality of input signals including, for example, signals generated by patch electrodes 38 and sensor(s) 32, and generate a plurality of output signals including, for example, those used to control and/or provide data to, for example, display device 44 and switch 40. Processing apparatus 16 may be configured to perform various functions, such as those described in greater detail above and below, with appropriate programming instructions or code (i.e., software). Accordingly, processing apparatus 16 is programmed with one or more computer programs encoded on a computer storage medium for performing the functionality described herein.
- CPU central processing unit
- I/O input/output
- Processing apparatus 16 may be configured to perform various functions, such as those described in greater detail above and below, with appropriate programming instructions or code (i.e., software). Accordingly, processing apparatus 16 is programmed
- patch electrodes 38 are provided to generate electrical signals used, for example, in determining the position and orientation of catheter 12.
- patch electrodes 38 are placed orthogonally on the surface of body 18 and are used to create axes-specific electric fields within body 18.
- patch electrodes 38 xl , 38x2 may be placed along a first (x) axis.
- patch electrodes 38 ⁇ , 38 ⁇ 2 may be placed along a second (y) axis, and patch electrodes 38zi, 38za may be placed along a third (z) axis.
- Each of patch electrodes 38 may be coupled to multiplex switch 40.
- processing apparatus 16 is configured, through appropriate software, to provide control signals to switch 40 to thereby sequentially couple pairs of electrodes 38 to signal generator 42. Excitation of each pair of electrodes 38 generates an electric field within body 18 and within an area of interest such as heart 20. Voltage levels at non-excited electrodes 38, which are referenced to belly patch 38B, are filtered and converted and provided to processing apparatus 16 for use as reference values.
- sensor(s) 32 of catheter 12 are electrically coupled to processing apparatus 16 and are configured to serve a position sensing function. More particularly, sensor(s) 32 are placed within electric fields created in body 18 (e.g., within the heart) by exciting patch electrodes 38. For purposes of clarity and illustration only, the description below will be limited to an embodiment wherein a single sensor 32 is placed within electric fields. It will be appreciated, however, that in other embodiments that remain within the spirit and scope of the present disclosure, a plurality of sensors 32 can be placed within the electric fields and then positions and orientations of each sensor can be determined using the techniques described below.
- sensor 32 When disposed within the electric fields, sensor 32 experiences voltages that are dependent on the location between patch electrodes 38 and the position of sensor 32 relative to tissue. Voltage measurement comparisons made between sensor 32 and patch electrodes 38 can be used to determine the location of sensor 32 relative to the tissue. Accordingly, as catheter 12 is swept about or along a particular area or surface of interest, processing apparatus 16 receives signals (location information) from sensor 32 reflecting changes in voltage levels on sensor 32 and from the non-energized patch electrodes 38.
- the processing apparatus 16 may then determine the location (position and orientation) of sensor 32 and record it as a location data point 46 (also referred to herein as "data point 46" and illustrated in Figure 3) corresponding to a location of sensor 32, and therefore, a point on the surface or in the interior of the structure of interest being modeled, in a memory or storage device, such as memory 47, associated with or accessible by processing apparatus 16.
- a location data point 46 also referred to herein as "data point 46" and illustrated in Figure 3
- the raw location data represented by the signals received by processing apparatus 16 may be corrected by processing apparatus 16 to account for respiration, cardiac activity, and other artifacts using known or hereafter developed techniques.
- locations of other portions of catheter 12 may be inferred from measurements at sensors 32, such as by interpolation or extrapolation, to generate further location data points 46.
- location data points 46 (461, 46 2 , . . . , 46 adjective) taken over time results in the formation of a point cloud 48 (best shown in Figure 3) stored in the memory or storage device.
- Figures 4A-4D depict a plurality of exemplary non-orthogonal dipoles D 0 , D 1 , D 2 , and D3, set in a coordinate system 50.
- the X-axis patch electrodes are designated X A and X B
- the Y-axis patch electrodes are designated Y A and Y B
- the Z-axis patch electrodes are designated Z A and ZB.
- the potentials measured across an intra-cardiac sensor, such as sensor 32, resulting from a predetermined set of drive (source/sink) configurations may be combined algebraically to yield the same effective potential as would be obtained simply by driving a uniform current along the orthogonal axes.
- Any two of the patch electrodes 38 X1 , 38 x2 , 38 y1 , 38 Y2 , 38 Z1 , and 38 ⁇ may be selected as a dipole source and drain with respect to a ground reference, e.g., belly patch 38 B , while the unexcited patch electrodes measure voltage with respect to the ground reference.
- Sensor 32 placed in heart 20 is also exposed to the field for a current pulse and is measured with respect to ground (e.g., belly patch 38 B ).
- multiple patch electrodes 38 may be arranged linearly along a common axis.
- excitation of an electrode pair comprising one of patch electrodes 38 and an electrode mounted on catheter 12 generates an electric field.
- the non-excited patch electrodes 38 may then measure potentials that can be used to determine the position of sensor 32.
- the excitation of multiple electrode pairs comprising different patch electrodes 38 and the catheter-mounted electrode may be used to determine the position of sensor 32.
- Figure 3 is illustrative of the point cloud 48 including location data points 46 l5 46 2 , .46 n corresponding to a particular structure of interest being modeled. It will be appreciated that in practice, the point cloud 48 would generally include hundreds to hundreds of thousands of data points 46. For purposes of illustration and ease of description, however, the description below will be limited to a point cloud having a limited number of location data points, such as, for example, point cloud 48 including location data points 46.
- a geometric surface model of the structure of interest may be generated.
- lesions may be rendered on a geometric surface model.
- the lesions are not rendered based on parameter values such as power level, delivery duration, tissue contact force, lesion-size index (LSI), and force-time integral (FTI).
- LSI lesion-size index
- FTI force-time integral
- a three-dimensional (3D) texture map is used to include any or all of these parameters.
- lesions may be rendered fully automatically by storing a tissue necrosis value for each voxel in the 3D texture map and indexing it into a ID (or 2D) texture map for display.
- FIG. 5 is a flowchart of one embodiment of a method 500 for rendering lesions on a geometric surface model.
- a scalar 3D texture map is created.
- a texture map is an image (typically 2D, but possibly ID or 3D) that is "painted" onto a polygon while the polygon is being drawn by graphics hardware.
- Each vertex of the polygon has coordinates in (x, y, z) space, in addition to one or more coordinates in the texture map, which describe the portion of the texture map that gets painted onto that polygon.
- the effect of clouds or grass may be represented by drawing just a few polygons for the sky or ground, without having to draw each wisp of cloud or blade of grass as its own colored polygon (which would require significantly more computational resources).
- the 3D texture map created in step 502 is large enough to include an entire bounding volume of the geometry model. Further, the 3D texture map is a lattice of voxels that each have an associated tissue necrosis value. In one embodiment, the 3D texture map has a 0.5 millimeter (mm) resolution over its entire volume. Alternatively, the 3D texture map may have any suitable resolution.
- the tissue necrosis value of each voxel in the 3D map that is within a given distance of an ablation location is incremented as a function of one or more parameters to generate a total tissue necrosis value.
- the parameters may include, distance from the ablation location, ablation power level, contact force, tissue temperature, etc.
- the tissue necrosis values may be incremented as a function of at least one of a power level, a delivery duration, a tissue contact force, a lesion-size index, and a force-time integral associated with an ablation procedure.
- the values for the parameters may be acquired, for example, using an instrument that applies ablation to generate the lesions. Accordingly, the lesions may be rendered in realtime as the ablation is occurring.
- the incrementing function may be based on physiological theory, simulation, and/or experimental results. Further, the function may vary over time as well as distance.
- the one or more lesions are rendered on the geometric surface model based on the total tissue necrosis values.
- the total tissue necrosis values are indexed into a relatively small ID (or 2D) texture map.
- the ID (or 2D) texture map may range from transparent (optionally with a reddish tinge) to a tannish or light burnt color. Storing the total necrosis value for each voxel allows neighboring lesions to merge into one another when rendered, with a single border zone, which is clinically accurate. Further, the border zone may transition from opaque to transparent, appearing "fuzzy" to emphasize that map data underneath may be of questionable validity.
- any underlying electrophysiological data that is displayed e.g., peak voltage, local activation time, fractionation value, and/or any other clinically useful measurement or computation
- peak voltage e.g., peak voltage
- local activation time e.g., fractionation value
- fractionation value e.g., fractionation value
- any other clinically useful measurement or computation e.g., peak voltage, local activation time, fractionation value, and/or any other clinically useful measurement or computation
- the border zone becomes opaque, and the color of the electrophysiological data will be obscured by the color of the lesion.
- the 3D texture map has a sufficiently small resolution (e.g., 0.5 mm)
- the lesions may be displayed accurately, and multiple lesions or parts thereof may be rendered on the same facet of the geometric surface model, independent of the geometry resolution or facet size.
- the lesions may be rendered directly on the geometric surface model itself, or may be rendered on a separate overlay layer (e.g., an offset surface that is slightly displaced in a normal direction relative to the geometric surface model, and that is transparent in regions where there are no lesions).
- the overlay layer could be selectively displayed independent from the underlying geometric surface model in some embodiments.
- the ablation location used to render a lesion may vary over time, resulting in a "spray-painting" effect for the rendered lesion. Further, in the systems and methods described herein, there is no need to use a "lesion-breaking" algorithm to determine where one lesion ends and another begins. Instead, adjacent lesions are continuous in space, which is more biophysically realistic than the spheres or surface patches rendered using at least some known methods.
- each voxel in the 3D texture map also contains a stored tissue temperature value associated with that voxel location.
- This tissue temperature value is incremented by a clinically relevant function and may take into account the temperature of neighboring points to mimic heat conduction.
- the relevant voxels could "cool down" to full health (e.g., a tissue necrosis value of zero), some predetermined level of necrosis, or complete death, depending on the maximum temperature achieved. Further, if ablative RF energy is restarted, the temperature would begin rising again from its current level.
- tissue type e.g., total energy delivered, power level, delivery duration, tissue contact force, LSI, and FTI
- tissue type could be used in conjunction with temperature to determine the degree of tissue necrosis. That is, differences in heat absorption/dissipation due to specific characteristics of the tissue (e.g., thicker ventricular cardiac tissue as compared to thinner ventricular cardiac tissue) could be taken into account.
- step 506 triangles of the geometric surface model are drawn using each geometric vertex of the triangles as an index into the 3D texture map of tissue necrosis values.
- the resulting value may be used as an index into the ID (or 2D) lesion texture map. That is, the geometry vertices are used as the texture coordinates to get the correct color index into the lesion spectrum.
- the tissue necrosis and/or temperature value may be incremented in a relatively thin two-dimensional region surrounding the geometry model, instead of in full 3D.
- the geometry could first be rendered into an empty 3D texture map to create a bitfield of texture voxels that intersect the surface model, since those are the only texture points that need to be colored.
- the actual 3D necrosis texture map may be used as the bitfield.
- the bitfield may be initialized to—1.0, and the graphics hardware or geometry renderer could draw the surface model into this texture map to set voxels intersecting the surface to an initial weight of 0.0. From then on during the procedure, the tissue necrosis values would only need to be computed for voxels mat have a nonnegative weight.
- scar/fibrosis information may be incorporated from an external imaging modality (e.g., late gadolinium enhancement magnetic resonance imaging (LGE MRI)) into this framework. If such an image is voxelized according to the fraction of scar/fibrosis information and properly registered to the geometry model, that information could be loaded directly into a texture map and rendered on the surface, along with the original mapping data and lesions.
- an external imaging modality e.g., late gadolinium enhancement magnetic resonance imaging (LGE MRI)
- the lesions may be rendered using any suitable size, color function, border zone, translucency, and/or sharpness.
- Figures 6 and 7 are example maps 600 and 700 generated using the systems and methods described herein.
- map 600 lesions 602 are rendered as substantially white, with a reddish tinged border zone.
- map 700 lesions 702 are rendered as substantially brown.
- maps 600 and 700 lesions 602 and 702 as rendered overlap in a natural and visually intuitive way.
- the triangles are being rendered one vertex at a time, while all colormap interpolation is being handled in texture memory on a graphics card.
- FIG. 8 is an example map 800 that includes lesions 802 generated with a varying ablation location. Maps 600, 700, and 800 all facilitate providing users with realtime feedback on energy delivery/lesion coverage during an ablation procedure.
- model construction system 14, and particularly processing apparatus 16, as described above may include conventional processing apparatus known in the art, capable of executing pre-programmed instructions stored in an associated memory, all performing in accordance with the functionality described herein. It is contemplated that the methods described herein, including without limitation the method steps of embodiments of the invention, will be programmed in some embodiments, with the resulting software being stored in an associated memory and where so described, may also constitute the means for performing such methods. Implementation of the invention, in software, in view of the foregoing enabling description, would require no more than routine application of programming skills by one of ordinary skill in the art. Such a system may further be of the type having both ROM, RAM, a combination of non-volatile and volatile (modifiable) memory so that the software can be stored and yet allow storage and processing of dynamically produced data and/or signals.
- joinder references do not necessarily infer that two elements are directly connected and in fixed relation to each other. It is intended that all matter contained in the above description or shown in the accompanying drawings shall be interpreted as illustrative only and not limiting. Changes in detail or structure may be made without departing from the spirit of the disclosure as defined in the appended claims.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Pathology (AREA)
- Animal Behavior & Ethology (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Architecture (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Robotics (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Surgical Instruments (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562237850P | 2015-10-06 | 2015-10-06 | |
PCT/US2016/054283 WO2017062250A1 (en) | 2015-10-06 | 2016-09-29 | Methods and systems for displaying electrophysiological lesions |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3340912A1 true EP3340912A1 (en) | 2018-07-04 |
EP3340912B1 EP3340912B1 (en) | 2022-02-09 |
Family
ID=57124176
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16779295.1A Active EP3340912B1 (en) | 2015-10-06 | 2016-09-29 | Methods and systems for displaying electrophysiological lesions |
Country Status (5)
Country | Link |
---|---|
US (2) | US10276267B2 (en) |
EP (1) | EP3340912B1 (en) |
JP (1) | JP6691963B2 (en) |
CN (1) | CN108135647B (en) |
WO (1) | WO2017062250A1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2017140235A (en) | 2015-05-12 | 2019-06-13 | Навикс Интернэшнл Лимитед | Assessment of lesions by analyzing dielectric properties |
WO2018092063A1 (en) | 2016-11-16 | 2018-05-24 | Navix International Limited | Real-time display of treatment-related tissue changes using virtual material |
US11010983B2 (en) * | 2016-11-16 | 2021-05-18 | Navix International Limited | Tissue model dynamic visual rendering |
CN109658365B (en) * | 2017-10-11 | 2022-12-06 | 阿里巴巴(深圳)技术有限公司 | Image processing method, device, system and storage medium |
US11164371B2 (en) * | 2017-12-20 | 2021-11-02 | Biosense Webster (Israel) Ltd. | Marking a computerized model of a cardiac surface |
US11272988B2 (en) | 2019-05-10 | 2022-03-15 | Fvrvs Limited | Virtual reality surgical training systems |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6690963B2 (en) | 1995-01-24 | 2004-02-10 | Biosense, Inc. | System for determining the location and orientation of an invasive medical instrument |
JP4177903B2 (en) | 1998-01-22 | 2008-11-05 | バイオセンス・ウエブスター・インコーポレーテツド | Measurement in the body |
US7263397B2 (en) | 1998-06-30 | 2007-08-28 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Method and apparatus for catheter navigation and location and mapping in the heart |
US7386339B2 (en) | 1999-05-18 | 2008-06-10 | Mediguide Ltd. | Medical imaging and navigation system |
US6233476B1 (en) | 1999-05-18 | 2001-05-15 | Mediguide Ltd. | Medical positioning system |
US7095418B2 (en) * | 2003-10-30 | 2006-08-22 | Sensable Technologies, Inc. | Apparatus and methods for texture mapping |
US7197354B2 (en) | 2004-06-21 | 2007-03-27 | Mediguide Ltd. | System for determining the position and orientation of a catheter |
DE102006013476B4 (en) * | 2006-03-23 | 2012-11-15 | Siemens Ag | Method for positionally accurate representation of tissue regions of interest |
MX2009007229A (en) | 2007-01-05 | 2010-02-18 | Landmark Graphics Corp | Systems and methods for visualizing multiple volumetric data sets in real time. |
US9204927B2 (en) * | 2009-05-13 | 2015-12-08 | St. Jude Medical, Atrial Fibrillation Division, Inc. | System and method for presenting information representative of lesion formation in tissue during an ablation procedure |
US20090221999A1 (en) * | 2008-02-29 | 2009-09-03 | Ramin Shahidi | Thermal Ablation Design and Planning Methods |
CA2703347C (en) * | 2009-05-08 | 2016-10-04 | Endosense Sa | Method and apparatus for controlling lesion size in catheter-based ablation treatment |
ES2370727B2 (en) * | 2010-03-18 | 2013-03-13 | Universidad Politécnica de Madrid | METHOD FOR DISPLAYING THE INFORMATION CONTAINED IN THREE-DIMENSIONAL IMAGES OF THE HEART. |
WO2011143199A1 (en) * | 2010-05-10 | 2011-11-17 | Medtronic Inc. | System for selecting an ablation procedure based on comparing a biological response with a mathematical model |
EP2642913B1 (en) * | 2010-11-27 | 2024-02-21 | Boston Scientific Scimed, Inc. | Ablation and temperature measurement devices |
JP6310448B2 (en) * | 2012-05-18 | 2018-04-11 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Voxel tagging using optical fiber shape sensing |
US10433902B2 (en) * | 2013-10-23 | 2019-10-08 | Medtronic Ardian Luxembourg S.A.R.L. | Current control methods and systems |
JP6345881B2 (en) * | 2014-10-30 | 2018-06-20 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Texture analysis map for image data |
-
2016
- 2016-09-29 CN CN201680059141.8A patent/CN108135647B/en active Active
- 2016-09-29 JP JP2018517787A patent/JP6691963B2/en active Active
- 2016-09-29 EP EP16779295.1A patent/EP3340912B1/en active Active
- 2016-09-29 US US15/279,572 patent/US10276267B2/en active Active
- 2016-09-29 WO PCT/US2016/054283 patent/WO2017062250A1/en active Application Filing
-
2019
- 2019-03-15 US US16/355,240 patent/US10714218B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US10276267B2 (en) | 2019-04-30 |
US20170098055A1 (en) | 2017-04-06 |
US10714218B2 (en) | 2020-07-14 |
CN108135647B (en) | 2020-11-03 |
EP3340912B1 (en) | 2022-02-09 |
US20190214148A1 (en) | 2019-07-11 |
CN108135647A (en) | 2018-06-08 |
JP2018535723A (en) | 2018-12-06 |
WO2017062250A1 (en) | 2017-04-13 |
JP6691963B2 (en) | 2020-05-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10861246B2 (en) | Methods and systems for generating a patch surface model of a geometric structure | |
US10714218B2 (en) | Methods and systems for displaying electrophysiological lesions | |
EP2797502B1 (en) | Method and system for constructing an electrophysiology map | |
EP3463136B1 (en) | Methods and systems for generating smoothed images of an elongate medical device | |
US9282915B2 (en) | Method and system for generating and/or repairing a surface model of a geometric structure | |
EP3074956B1 (en) | Methods and systems for generating a multi-dimensional surface model of a geometric structure | |
US10687727B2 (en) | Methods and systems for generating electrophysiological maps | |
US20220020228A1 (en) | Systems and methods for modifying geometry surface models using electrophysiology measurements |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20180327 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200612 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20211015 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1467035 Country of ref document: AT Kind code of ref document: T Effective date: 20220215 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602016068982 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20220209 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1467035 Country of ref document: AT Kind code of ref document: T Effective date: 20220209 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220609 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220509 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220509 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220510 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220609 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602016068982 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20221110 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20220930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220929 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230616 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220929 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602016068982 Country of ref document: DE Representative=s name: ALPSPITZ IP ALLGAYER UND PARTNER PATENTANWAELT, DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20160929 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20220209 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240808 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240808 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240808 Year of fee payment: 9 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20240911 Year of fee payment: 9 |