EP1363548B1 - Diagnostic imaging interventional apparatus - Google Patents
Diagnostic imaging interventional apparatus Download PDFInfo
- Publication number
- EP1363548B1 EP1363548B1 EP01985974.3A EP01985974A EP1363548B1 EP 1363548 B1 EP1363548 B1 EP 1363548B1 EP 01985974 A EP01985974 A EP 01985974A EP 1363548 B1 EP1363548 B1 EP 1363548B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- surgical instrument
- medical imaging
- imaging system
- gripping
- instrument
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
- A61B6/08—Auxiliary means for directing the radiation beam to a particular spot, e.g. using light beams
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
- A61B18/18—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body by applying electromagnetic radiation, e.g. microwaves
- A61B18/20—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body by applying electromagnetic radiation, e.g. microwaves using laser
- A61B2018/2015—Miscellaneous features
- A61B2018/2025—Miscellaneous features with a pilot laser
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/50—Supports for surgical instruments, e.g. articulated arms
Definitions
- the present invention relates to the medical diagnostic imaging and minimally invasive stereotactic surgery arts. It finds particular application in conjunction with an integrated CT scanner and mechanically guided surgical instruments and will be described with particular reference thereto. It is to be appreciated, however, that the invention is also applicable to guiding surgical instruments in conjunction with magnetic resonance, ultrasonic, and other imaging systems.
- interventional medical procedures be as minimally invasive as possible.
- the latter goal may be achieved by a direct inspection of the anatomy.
- direct inspection may be more invasive than desired since relatively large incisions may have to be made to expose or access the interior anatomy for direct inspection.
- tissue from human or animal subjects it is often desirable to sample or test a portion of tissue from human or animal subjects, particularly in the diagnosis and treatment of potentially cancerous tumors, pre-malignant conditions, and other diseases or disorders.
- a biopsy is performed to determine if in fact cells from the tumor are cancerous or otherwise diseased.
- biopsies such as percutaneous biopsies, are performed with a needle-like instrument used to collect the cells for analysis.
- interventional medical procedures such as needle biopsies
- CT scans continuous CT
- MRI magnetic resonance imaging
- SPECT single photon emission CT
- PET positron emission tomography
- the imaging equipment allows an interventionalist, such as a radiologist, surgeon, physician, or other medical personnel, to track the insertion of interventional devices, such as biopsy needles, in a subject during diagnostic and therapeutic procedures. While such imaging modalities allow procedures to be performed with minimal invasiveness and are helpful to the interventionalist and the patient, they have certain drawbacks.
- the tracking of the needle position is not done in real-time. That is to say, a static image is obtained and the needle position noted therein. Subsequently, the needle is advanced or retracted by a small amount and another static image obtained to verify the new needle position. This sequence is repeated as many times as necessary to track the needle's progression.
- a procedure tends to be time consuming insomuch as the needle progresses by only a short distance or increment between imaging, and needle progression is halted during imaging.
- accuracy suffers to the extent that in the interim, i.e., between images, the needle's position cannot be visualized.
- CCT imaging and fluoroscopy With the development of CCT imaging and fluoroscopy, real-time imaging has been made possible.
- CCT scanning a rotating x-ray source irradiates the subject continuously, generating images at a rate of approximately six frames per second.
- CCT or fluoroscopy by the interventionalist for real-time guidance and/or tracking of the needle during biopsies is gaining popularity. As a result, biopsies have become not only more accurate, but also shorter in duration.
- U.S. Pat. No. 4,733,661 describes a hand held guidance device including a planar base with a bubble level to maintain the base in a horizontal position. Needle guides are provided on a support arm pivotally secured to the base, the guides slidingly supporting a catheter at a desired angle as the catheter into the patient's body.
- the guidance device includes a reference line formed upon the base adapted to be aligned with a transverse light beam projected by the CT scanner apparatus.
- the device Although it may be possible for the device to be used to accurately insert a biopsy needle within a patient's body without damage to any unintended targets, one major disadvantage of the device is its reliance upon an accurate human alignment between the reference line defined on the base of the device and the transverse light beam projected by the CT scanner. It would, therefore, be desirable to provide a surgical instrument guidance device which is not dependent upon a manual alignment step.
- U.S. Pat. No. 4,583,538 proposes a free standing biopsy guide that is adapted to hold needles or probes at various selectable calculated angles.
- a reference point on the patient's body is found that exactly correlates to a point on the CT scan. This is accomplished by means of a localization device placed on the patient's skin which can be identified in cross section on the CT scan. Measurements of the localization device on the CT scan are then correlated to the device on the patient. The free standing biopsy guide is then adjusted according to those calculations.
- One disadvantage of the device taught by this patent is the time required to correlate the patient body reference point with selected points on the CT scan.
- WO-A-002882 discloses a manipulator for use in medical procedures and capable of inserting a needle or other object into a patient's body for diagnostic or therapeutic purposes and adjusting the position of the needle within the body while imaging of the body and the needle is being carried out.
- the manipulator is capable of manipulating a medical tool with respect to the patient with multiple degrees of freedom which is provided by several pivotably connected frames.
- the manipulator also comprises an upper and a lower clamp capable of releasably grasping and guiding a needle for inserting the needle into the patient's body.
- the upper clamp includes two stationary blocks and one moveable block each having a recess for receiving the needle.
- the stationary blocks are mounted on a frame and the moveable block is supported for movement towards and away from the stationary blocks in a direction transverse to the needle axis.
- the lower clamp has a structure similar to that of the upper clamp.
- the present invention provides a new and improved interchangeable surgical instrument guidance device and method for using same which overcomes the above-referenced problems and others.
- a medical imaging system for conducting an image-guided medical procedure on a subject is provided according to claim 1.
- the medical imaging system further includes incremental movement means for incrementally inserting the surgical instrument along a trajectory into the subject.
- the trajectory is linear.
- the gripping force has a magnitude that allows the surgical instrument to be manually inserted into the subject.
- the first surgical instrument guide applies a first force to the surgical instrument in a direction perpendicular to the first gripping surface and the second surgical instrument guide applies a second force to the surgical instrument in a direction perpendicular to the second gripping surface.
- the first force and the second force are substantially zero.
- the medical imaging system further includes a mechanical arm controller for controlling the mechanical arm such that the surgical instrument moves along a path in accordance with the planned interventional procedure.
- the path includes a linear trajectory into the subject.
- the movement of the surgical instrument along the path includes relative movement between the surgical instrument and the end-effector along the linear trajectory.
- the medical imaging system further includes position tracking means for tracking a position of the surgical instrument.
- the first surgical instrument guide includes a first and second prong, the first and second prongs extending past the first gripping surface and the second surgical instrument guide includes a third and fourth prong, the third and fourth prongs extending past the second gripping surface.
- One advantage of the present invention is that it provides for a linear trajectory of a surgical instrument into a subject.
- Another advantage of the present invention is that it allows for the surgical instrument to be gripped, inserted into a subject, regripped, and inserted further into the subject while maintaining the same trajectory into the subject.
- Another advantage of the present invention is that it does not require a human alignment step for inserting the surgical instrument into the subject.
- Another advantage of the present invention is that it provides only minimal torque on the surgical instrument in the end-effector.
- Another advantage of the present invention is that is can accommodate various surgical instruments.
- Another advantage of the present invention is that it can track the depth of a surgical instrument in the patient.
- Another advantage of the present invention is that the gripping means can be easily closed (for gripping purposes) and opened for release.
- the invention may take form in various components and arrangements of components, and in various steps and arrangements of steps.
- the drawings are only for purposes of illustrating a preferred embodiment and are not to be construed as limiting the invention.
- a object support10 such as a patient table includes an obj ect support surface 12 that is mounted for longitudinal movement relative to a base portion 14.
- the base portion 14 includes a motor for raising and lowering the object support surface 12 and for moving the support surface longitudinally.
- Position encoders are also provided for generating electrical signals indicative of the height and longitudinal position of the object support.
- a volumetric imaging apparatus 18 is disposed in axial alignment with the table such that an object or patient support surface 12 can be moved into and through a bore 20 of the volumetric imager.
- the volumetric imager is a CT scanner which includes an X-ray source (not shown) mounted for repeated circular travel within a preselected plane.
- the X-ray source projects a fan-shaped beam of radiation through a region of interest of the subject and subsequently to a ring or arc of radiation detectors (not shown) positioned opposite the X-ray source.
- a series of data lines are generated, which data lines are reconstructed into at least a slice image by a reconstruction processor included in a control console 24.
- the patient support 12 moves longitudinally as the X-ray source is rotating around the subject such that a selected volume of the patient is scanned along a spiral path or a series of slices.
- the position of the X-ray source is monitored by a rotational position encoder, and the longitudinal position of the patient support is monitored by a longitudinal position encoder within the table 10.
- the reconstruction processor reconstructs a volumetric image representation from the generated data lines.
- the control console 24 typically includes one or more monitors 26 and various standard operator input devices, such as a keyboard, trackball, mouse, or the like.
- An interventionist control console 28 may be supported from overhead on a track atop the CT scanner as shown.
- a mechanical arm assembly 30 is located at a known spatial position with respect to the CT scanner.
- the mechanical arm assembly 30 can be mounted, for example, to the floor, as shown, or to the CT scanner 18 itself.
- the mechanical arm assembly 30 is controlled by controller 72 and includes a plurality of arm segments which are interconnected by pivot members forming joints between the arm segments.
- Each pivot member, or joint includes a drive such as an electric motor which provides a source of motive power for moving each joint to a desired position.
- Each joint also includes a position encoder such as a quadrature encoder, potentiometer, or the like which provides feedback as to the actual position of the joint.
- the joints of the mechanical arm define six (6) degrees of freedom.
- a base member 42 is located in a known position relative to the CT scanner 18.
- a base joint 44 permits rotation of a primary support carriage 46 in a direction marked A.
- a first joint 48 permits rotation of a first arm member 50 in a direction marked B
- a second joint 52 permits rotation of a second arm member 54 in a direction marked C
- a third joint 56 permits rotation of a third arm member 58 in a direction marked D.
- a fourth joint 60 permits rotation of a fourth arm member 62 in a direction marked E and a fifth joint 64 permits rotation, in a direction F, of an end-effector 66, such as a gripping device, disposed at the distal end of the mechanical arm assembly 30.
- the end-effector 66 is shown generally in FIGS. 3A, 3B, and 3C and includes a base 68 which is attached to the end-effector joint 64.
- a pneumatic gripper 70 is attached to base 68.
- the gripper includes a rail 74 upon which grip carriers 76, 78 can be translated toward and away from one another using compressed air, the application of which is controlled by the controller 72.
- the grip carriers 76, 78 are movable the direction marked X.
- the gripper 66 can be, for example, a parallel opening and closing type gripper provided by ZAYTRAN, Inc. Elyria, Ohio, model no. magnum-pet-130-13. While the gripper has been described as a pneumatic controller, other drive types such as electric motors may be implemented. Moreover, the pneumatic driver may use hydraulic fluid or the like. Alternately, the gripper may be operated manually by the interventionist.
- L-shaped flanges 80, 82 are attached to the grip carriers 76, 78 respectively.
- the L-shaped flanges are removeably mounted to the grip carriers such that the base of each flanges is parallel with the grip carriers and the portions of the flanges perpendicular to the grip carriers are directed distally from the end-effector joint 64.
- the flanges 80, 82 translate along with the grip carriers to which they are attached.
- Fingers 90, 92 are removeably attached to the distally extending portions of the flanges 80, 82, respectively.
- the fingers can be attached to the flanges with set screws or bolts, for example, such that an angle Y is defined between the longitudinal axes of the fingers and an axis extending distally along the mechanical arm assembly 30 for providing clearance between the mechanical arm 30 and the patient.
- the fingers translate along with the flanges to which they are attached. In the illustrated closed position, the end effector can be used to grasp an instrument 130 such as a biopsy needle, probe, or the like.
- the fingers 90, 92 each include a first surface 100 which, in operation, faces towards the patient and a second surface 102 which faces away from the patient. Gripping surfaces 104, 106 are located at the distal end of the fingers 90, 92 respectively so as to face each other.
- substantially v-shaped instrument guides 110, 112 are disposed at the distal end of the fingers 90, 92, respectively. As shown in FIG. 4 , the instrument guides are arranged on the fingers such that one of the guides 110 is located on the first surface 100 of the finger 90 and the other guide 112 is located on the second surface 102 of the other finger 92.
- each instrument guide 110, 112 includes a body portion 114 which is attached to a given finger 90, 92, and two prongs 120, 122 which extend past the gripping surface 104, 106 of each finger a distance L.
- the prongs are arranged such that an angle Z is formed between the prongs.
- the distance L and angle Z are selected such that various sized instruments can be gripped and stabilized by the end effector 66. It is therefore advantageous that the instrument guides 110, 112 are removeably fastened to the fingers 90, 92 so that variously dimensioned instrument guides can be attached to the fingers.
- the end-effector 66 can advantageously be fabricated from materials that facilitate use within imaging systems such as CT, MRI and ultrasound systems.
- the end-effector can be fabricated from transparent materials such as acrylic so that the instrument 130 can be seen while the end effector is in use.
- volumetric images of a region of interest of a patient are obtained with the CT scanner.
- the interventionist uses the control console 24 to define a desired position and/or trajectory of the instrument 130 with respect to one or more images displayed thereon.
- a desired position of the end effector 66 may be calculated by controller 72 so that an instrument placed in the end effector 66 is diposed at the desired position and/or trajectory.
- the controller 72 drives the motors at each joint of the mechanical arm assembly 30 along a desired trajectory so that the instrument 130 is positioned at the desired location and/or trajectory.
- the surgical instrument 130 is selectively movable in multiple orientations as necessary to position the instrument in various desired positions in relation to the patient.
- the instrument can be positioned in predetermined orientations in preparation for and in carrying out a surgical procedure.
- the instrument 130 is located between the gripping surfaces 104, 106 of the fingers.
- the grip pressure exerted on the instrument 130 by the gripping surfaces 104, 106 is controlled by the controller 72 to prevent or allow relative motion between the needle and fingers as desired.
- the instrument 130 passes through the prongs 120, 122 of the instrument guides 110, 112.
- the prongs provide stability to the instrument and prevent the instrument from rotating away from the desired trajectory line.
- the extension L of the prongs and the angle Z defined therebetween are selected to allow the grip surfaces to contact and grip the instrument while the prongs stabilize the instrument.
- the instrument 130 can be inserted into the patient.
- the mechanical arm provides the motive force for inserting the instrument 130 into the patient.
- the range of linear motion of the end effector 66 during the insertion process may be limited by the range of motion of the joints of the mechanical arm 30 as well as the distance from the mechanical arm 30 to the patient.
- the instrument can be inserted incrementally by repeating the steps shown in FIG. 7 of inserting the needle into the patient, releasing the grip pressure, moving the mechanical arm away from the patient, regripping the instrument and inserting the instrument further into the patient. During the regripping process, the instrument guides ensure that the instrument is maintained along the desired trajectory.
- the needle can be removed in a similar manner. Control of the mechanical arm assembly 30 provides that the motion of the needle into the patient is along the desired linear trajectory and that the desired depth of the needle is attained. The linear distance traveled during each increment of insertion or removal is, for example, two centimeters.
- the process of releasing grip pressure and regripping the instrument may also be performed without incrementally inserting or removing the instrument.
- the interventionist may desire to manually manipulate the instrument or the patient may need to breathe without the instrument being held securely. Under such circumstances, the instrument may be released and regripped so that the desired trajectory is maintained.
- an interventionist can manually insert the instrument 130 into the patient.
- the mechanical arm is stable and is positioned near the patient such that the instrument is oriented along a desired line of insertion into the patient.
- the grip pressure is set so that the instrument is stable and can still be moved relative to the gripping surfaces by the interventionalist applying a force to the instrument in the direction of insertion.
- an instrument guide can be securely gripped between the grip fingers. The instrument guide defines a bore by which the instrument can be held stable along the insertion line and inserted into the patient.
- a pointing device such as an infrared laser can be gripped by the end effector 66 and held at a distance of, for example, twenty centimeters away from a patient.
- the pointing device is oriented by the mechanical arm so that it is directed at a region of interest of a patient such as an instrument insertion point and so that its beam is along an insertion trajectory.
- An interventionist can then position an instrument such as a needle so that its tip is at the insertion point and thereafter rotate the instrument until it is in line with the beam of the pointing device.
- the interventionist can then insert the instrument as desired while maintaining the trajectory indicated by the pointing device.
- the mechanical arm is manually controlled as described in US Patent No. 6035228 .
Description
- The present invention relates to the medical diagnostic imaging and minimally invasive stereotactic surgery arts. It finds particular application in conjunction with an integrated CT scanner and mechanically guided surgical instruments and will be described with particular reference thereto. It is to be appreciated, however, that the invention is also applicable to guiding surgical instruments in conjunction with magnetic resonance, ultrasonic, and other imaging systems.
- It is often desired that interventional medical procedures be as minimally invasive as possible. However, it is also desirable to be able to visualize or otherwise know the relative positions and/or orientations of surgical tools or devices with respect to surrounding anatomy. The latter goal may be achieved by a direct inspection of the anatomy. However, in the case of interior anatomy, direct inspection may be more invasive than desired since relatively large incisions may have to be made to expose or access the interior anatomy for direct inspection.
- For example, it is often desirable to sample or test a portion of tissue from human or animal subjects, particularly in the diagnosis and treatment of potentially cancerous tumors, pre-malignant conditions, and other diseases or disorders. Typically, in the case of tumors, when the physician suspects that cancer or an otherwise diseased condition exists, a biopsy is performed to determine if in fact cells from the tumor are cancerous or otherwise diseased. Many biopsies, such as percutaneous biopsies, are performed with a needle-like instrument used to collect the cells for analysis.
- In recent years, the performance of interventional medical procedures such as needle biopsies has been enhanced by the use of x-ray imaging, CT scans, continuous CT (CCT), magnetic resonance imaging (MRI), fluoroscopy, single photon emission CT (SPECT), positron emission tomography (PET), and the like. The imaging equipment allows an interventionalist, such as a radiologist, surgeon, physician, or other medical personnel, to track the insertion of interventional devices, such as biopsy needles, in a subject during diagnostic and therapeutic procedures. While such imaging modalities allow procedures to be performed with minimal invasiveness and are helpful to the interventionalist and the patient, they have certain drawbacks.
- For example, with some image-guided procedures, e.g., those using CT imaging, the tracking of the needle position is not done in real-time. That is to say, a static image is obtained and the needle position noted therein. Subsequently, the needle is advanced or retracted by a small amount and another static image obtained to verify the new needle position. This sequence is repeated as many times as necessary to track the needle's progression. Such a procedure tends to be time consuming insomuch as the needle progresses by only a short distance or increment between imaging, and needle progression is halted during imaging. Moreover, accuracy suffers to the extent that in the interim, i.e., between images, the needle's position cannot be visualized.
- With the development of CCT imaging and fluoroscopy, real-time imaging has been made possible. In CCT scanning, a rotating x-ray source irradiates the subject continuously, generating images at a rate of approximately six frames per second. The use of CCT or fluoroscopy by the interventionalist for real-time guidance and/or tracking of the needle during biopsies is gaining popularity. As a result, biopsies have become not only more accurate, but also shorter in duration.
- Heretofore, several surgical instrument guidance devices have been proposed for use in conjunction with a CT scanner to allow a user to accurately place a catheter, drainage tube, or biopsy probe within a patient's body.
U.S. Pat. No. 4,733,661 describes a hand held guidance device including a planar base with a bubble level to maintain the base in a horizontal position. Needle guides are provided on a support arm pivotally secured to the base, the guides slidingly supporting a catheter at a desired angle as the catheter into the patient's body. The guidance device includes a reference line formed upon the base adapted to be aligned with a transverse light beam projected by the CT scanner apparatus. Although it may be possible for the device to be used to accurately insert a biopsy needle within a patient's body without damage to any unintended targets, one major disadvantage of the device is its reliance upon an accurate human alignment between the reference line defined on the base of the device and the transverse light beam projected by the CT scanner. It would, therefore, be desirable to provide a surgical instrument guidance device which is not dependent upon a manual alignment step. -
U.S. Pat. No. 4,583,538 proposes a free standing biopsy guide that is adapted to hold needles or probes at various selectable calculated angles. In using the device proposed in that patent, a reference point on the patient's body is found that exactly correlates to a point on the CT scan. This is accomplished by means of a localization device placed on the patient's skin which can be identified in cross section on the CT scan. Measurements of the localization device on the CT scan are then correlated to the device on the patient. The free standing biopsy guide is then adjusted according to those calculations. One disadvantage of the device taught by this patent is the time required to correlate the patient body reference point with selected points on the CT scan. In addition, certain inaccuracies may be introduced during the point correlation step and while adjusting the free standing guidance device. Accordingly, it would be desirable to provide a biopsy or other surgical instrument guide that is affixed in a known position relative to the CT scanner apparatus whereby precise and automatic correlation between the coordinate systems of the guidance device, patient table, and patient image volume are automatically established. - Another drawback to prior mechanical linkage-type systems relates to the fact that they typically move the needle, or other surgical instrument, along a straight line. Maintaining a straight line can be problematic if the distance to be traveled, i.e. the depth of insertion, by the biopsy needle is large. It is therefore desirable that the mechanical system is able to grip, insert, release, and distally re-grip the biopsy needle for further insertion during an interventional procedure. In this manner, the range of motion of the mechanical system is relatively small, and linear, while the depth of the needle insertion is relatively large.
-
WO-A-002882 - The present invention provides a new and improved interchangeable surgical instrument guidance device and method for using same which overcomes the above-referenced problems and others.
- In accordance with the present invention, a medical imaging system for conducting an image-guided medical procedure on a subject is provided according to claim 1.
- In accordance with a more limited aspect of the present invention, the medical imaging system further includes incremental movement means for incrementally inserting the surgical instrument along a trajectory into the subject.
- In accordance with a more limited aspect of the present invention, the trajectory is linear.
- In accordance with a more limited aspect of the present invention, the gripping force has a magnitude that allows the surgical instrument to be manually inserted into the subject.
- In accordance with a more limited aspect of the present invention, the first surgical instrument guide applies a first force to the surgical instrument in a direction perpendicular to the first gripping surface and the second surgical instrument guide applies a second force to the surgical instrument in a direction perpendicular to the second gripping surface.
- In accordance with a more limited aspect of the present invention, the first force and the second force are substantially zero.
- In accordance with a more limited aspect of the present invention, the medical imaging system further includes a mechanical arm controller for controlling the mechanical arm such that the surgical instrument moves along a path in accordance with the planned interventional procedure.
- In accordance with a more limited aspect of the present invention, the path includes a linear trajectory into the subject.
- In accordance with a more limited aspect of the present invention, the movement of the surgical instrument along the path includes relative movement between the surgical instrument and the end-effector along the linear trajectory.
- In accordance with a more limited aspect of the present invention, the medical imaging system further includes position tracking means for tracking a position of the surgical instrument.
- In accordance with a more limited aspect of the present invention, the first surgical instrument guide includes a first and second prong, the first and second prongs extending past the first gripping surface and the second surgical instrument guide includes a third and fourth prong, the third and fourth prongs extending past the second gripping surface.
- One advantage of the present invention is that it provides for a linear trajectory of a surgical instrument into a subject.
- Another advantage of the present invention is that it allows for the surgical instrument to be gripped, inserted into a subject, regripped, and inserted further into the subject while maintaining the same trajectory into the subject.
- Another advantage of the present invention is that it does not require a human alignment step for inserting the surgical instrument into the subject.
- Another advantage of the present invention is that it provides only minimal torque on the surgical instrument in the end-effector.
- Another advantage of the present invention is that is can accommodate various surgical instruments.
- Another advantage of the present invention is that it can track the depth of a surgical instrument in the patient.
- Another advantage of the present invention is that the gripping means can be easily closed (for gripping purposes) and opened for release.
- Still further advantages of the present invention will become apparent to those of ordinary skill in the art upon reading and understanding the following detailed description of the preferred embodiments.
- The invention may take form in various components and arrangements of components, and in various steps and arrangements of steps. The drawings are only for purposes of illustrating a preferred embodiment and are not to be construed as limiting the invention.
-
Figure 1 is a diagrammatic illustration of a CT scanner and surgical instrument guidance device. -
Figure 2 is a diagrammatic illustration of a mechanical arm assembly carrying an end effector. -
Figure 3A is a top view of an end effector. -
Figure 3B is a side view of an end effector. -
Figure 3C is a front view of an end effector. -
Figure 4 is a diagrammatic illustration of a pair of gripping fingers. -
Figure 5 is a diagrammatic illustration of an instrument guide. -
Figure 6 is a diagrammatic illustration of an end effector carrying an instrument. -
Figure 7 is a flow chart indicating steps of inserting an instrument into a patient. - With reference first to
FIG. 1 , a object support10 such as a patient table includes an object support surface 12 that is mounted for longitudinal movement relative to abase portion 14. Thebase portion 14 includes a motor for raising and lowering theobject support surface 12 and for moving the support surface longitudinally. Position encoders are also provided for generating electrical signals indicative of the height and longitudinal position of the object support. - A
volumetric imaging apparatus 18 is disposed in axial alignment with the table such that an object orpatient support surface 12 can be moved into and through abore 20 of the volumetric imager. In the illustrated embodiment, the volumetric imager is a CT scanner which includes an X-ray source (not shown) mounted for repeated circular travel within a preselected plane. The X-ray source projects a fan-shaped beam of radiation through a region of interest of the subject and subsequently to a ring or arc of radiation detectors (not shown) positioned opposite the X-ray source. As the X-ray source rotates about the patient, a series of data lines are generated, which data lines are reconstructed into at least a slice image by a reconstruction processor included in acontrol console 24. More specifically, thepatient support 12 moves longitudinally as the X-ray source is rotating around the subject such that a selected volume of the patient is scanned along a spiral path or a series of slices. The position of the X-ray source is monitored by a rotational position encoder, and the longitudinal position of the patient support is monitored by a longitudinal position encoder within the table 10. The reconstruction processor reconstructs a volumetric image representation from the generated data lines. Thecontrol console 24 typically includes one ormore monitors 26 and various standard operator input devices, such as a keyboard, trackball, mouse, or the like. Aninterventionist control console 28 may be supported from overhead on a track atop the CT scanner as shown. - Continuing with
FIG. 1 and with further reference toFIG. 2 , amechanical arm assembly 30 is located at a known spatial position with respect to the CT scanner. Themechanical arm assembly 30 can be mounted, for example, to the floor, as shown, or to theCT scanner 18 itself. Themechanical arm assembly 30 is controlled bycontroller 72 and includes a plurality of arm segments which are interconnected by pivot members forming joints between the arm segments. Each pivot member, or joint, includes a drive such as an electric motor which provides a source of motive power for moving each joint to a desired position. Each joint also includes a position encoder such as a quadrature encoder, potentiometer, or the like which provides feedback as to the actual position of the joint. In one embodiment, the joints of the mechanical arm define six (6) degrees of freedom. - With more particular reference to
FIG. 2 , abase member 42 is located in a known position relative to theCT scanner 18. A base joint 44 permits rotation of aprimary support carriage 46 in a direction marked A. Similarly, a first joint 48 permits rotation of afirst arm member 50 in a direction marked B, a second joint 52 permits rotation of asecond arm member 54 in a direction marked C, and a third joint 56 permits rotation of athird arm member 58 in a direction marked D. A fourth joint 60 permits rotation of afourth arm member 62 in a direction marked E and a fifth joint 64 permits rotation, in a direction F, of an end-effector 66, such as a gripping device, disposed at the distal end of themechanical arm assembly 30. - The end-
effector 66 is shown generally inFIGS. 3A, 3B, and 3C and includes a base 68 which is attached to the end-effector joint 64. Apneumatic gripper 70 is attached tobase 68. The gripper includes arail 74 upon whichgrip carriers controller 72. Thus, in the embodiment shown, thegrip carriers gripper 66 can be, for example, a parallel opening and closing type gripper provided by ZAYTRAN, Inc. Elyria, Ohio, model no. magnum-pet-130-13. While the gripper has been described as a pneumatic controller, other drive types such as electric motors may be implemented. Moreover, the pneumatic driver may use hydraulic fluid or the like. Alternately, the gripper may be operated manually by the interventionist. - L-shaped
flanges grip carriers effector joint 64. Theflanges Fingers flanges mechanical arm assembly 30 for providing clearance between themechanical arm 30 and the patient. The fingers translate along with the flanges to which they are attached. In the illustrated closed position, the end effector can be used to grasp aninstrument 130 such as a biopsy needle, probe, or the like. - Turning now to
FIG. 4 , the fingers of theend effector 66 are shown in an open position. Thefingers first surface 100 which, in operation, faces towards the patient and asecond surface 102 which faces away from the patient. Grippingsurfaces fingers - In addition to the
gripping surfaces fingers FIG. 4 , the instrument guides are arranged on the fingers such that one of theguides 110 is located on thefirst surface 100 of thefinger 90 and theother guide 112 is located on thesecond surface 102 of theother finger 92. - With reference to
FIG. 5 , eachinstrument guide body portion 114 which is attached to a givenfinger prongs gripping surface end effector 66. It is therefore advantageous that the instrument guides 110, 112 are removeably fastened to thefingers - The end-
effector 66 can advantageously be fabricated from materials that facilitate use within imaging systems such as CT, MRI and ultrasound systems. In addition, the end-effector can be fabricated from transparent materials such as acrylic so that theinstrument 130 can be seen while the end effector is in use. - In operation, volumetric images of a region of interest of a patient are obtained with the CT scanner. The interventionist uses the
control console 24 to define a desired position and/or trajectory of theinstrument 130 with respect to one or more images displayed thereon. In that the position of the object support 10 (and hence the patient) and thebase 42 of the mechanical arm are known in relation to the imaging region of the CT scanner, a desired position of theend effector 66 may be calculated bycontroller 72 so that an instrument placed in theend effector 66 is diposed at the desired position and/or trajectory. - Once the patient is positioned, the
controller 72 drives the motors at each joint of themechanical arm assembly 30 along a desired trajectory so that theinstrument 130 is positioned at the desired location and/or trajectory. In this manner, thesurgical instrument 130 is selectively movable in multiple orientations as necessary to position the instrument in various desired positions in relation to the patient. Thus, the instrument can be positioned in predetermined orientations in preparation for and in carrying out a surgical procedure. - As shown in
FIG. 6 , in the case where the surgical instrument is a biopsy needle, theinstrument 130 is located between thegripping surfaces instrument 130 by the grippingsurfaces controller 72 to prevent or allow relative motion between the needle and fingers as desired. In addition, theinstrument 130 passes through theprongs - Once the
mechanical arm 30 has been positioned in the desired location with respect to the patient and theinstrument 130 has been secured between thegripping fingers - In one example, the mechanical arm provides the motive force for inserting the
instrument 130 into the patient. In this example, the range of linear motion of theend effector 66 during the insertion process may be limited by the range of motion of the joints of themechanical arm 30 as well as the distance from themechanical arm 30 to the patient. In order to overcome this limitation, the instrument can be inserted incrementally by repeating the steps shown inFIG. 7 of inserting the needle into the patient, releasing the grip pressure, moving the mechanical arm away from the patient, regripping the instrument and inserting the instrument further into the patient. During the regripping process, the instrument guides ensure that the instrument is maintained along the desired trajectory. The needle can be removed in a similar manner. Control of themechanical arm assembly 30 provides that the motion of the needle into the patient is along the desired linear trajectory and that the desired depth of the needle is attained. The linear distance traveled during each increment of insertion or removal is, for example, two centimeters. - The process of releasing grip pressure and regripping the instrument may also be performed without incrementally inserting or removing the instrument. For example, once the instrument is inserted into the patient, the interventionist may desire to manually manipulate the instrument or the patient may need to breathe without the instrument being held securely. Under such circumstances, the instrument may be released and regripped so that the desired trajectory is maintained.
- In another example, an interventionist can manually insert the
instrument 130 into the patient. In this case, the mechanical arm is stable and is positioned near the patient such that the instrument is oriented along a desired line of insertion into the patient. The grip pressure is set so that the instrument is stable and can still be moved relative to the gripping surfaces by the interventionalist applying a force to the instrument in the direction of insertion. Alternately, an instrument guide can be securely gripped between the grip fingers. The instrument guide defines a bore by which the instrument can be held stable along the insertion line and inserted into the patient. - In another embodiment, a pointing device such as an infrared laser can be gripped by the
end effector 66 and held at a distance of, for example, twenty centimeters away from a patient. The pointing device is oriented by the mechanical arm so that it is directed at a region of interest of a patient such as an instrument insertion point and so that its beam is along an insertion trajectory. An interventionist can then position an instrument such as a needle so that its tip is at the insertion point and thereafter rotate the instrument until it is in line with the beam of the pointing device. The interventionist can then insert the instrument as desired while maintaining the trajectory indicated by the pointing device. - In another embodiment, the mechanical arm is manually controlled as described in
US Patent No. 6035228 . - The invention has been described with reference to the preferred embodiment. Obviously, modifications and alterations will occur to others upon reading and understanding the preceding description. It is intended that the invention be construed as including all such modifications and alterations insofar as they come within the scope of the appended claims.
Claims (9)
- A medical imaging system for conducting an image-guided medical procedure on a subject, the system comprising:a medical imaging apparatus (18) for obtaining volumetric images of the subject;means for planning an interventional procedure on a subject using the volumetric images;a mechanical arm assembly (30) disposed in proximity to the medical imaging apparatus (18), the mechanical arm assembly (30) comprising a base support (42), a distal end, a plurality of arm segments (50, 54, 58, 62), and a plurality of joints (48, 52, 58, 60, 64) between the arm segments (50, 54, 58, 62) for carrying out the interventional procedure; andan end-effector (66) disposed at the distal end of the mechanical arm assembly (30), the end-effector (66) comprising gripping means (70) for selectively gripping and releasing a surgical instrument (130) during the interventional procedure,wherein the end-effector (66) further comprises:a first finger portion (90) having a first gripping surface (104);a second finger portion (92) having a second gripping surface (106), the first and second gripping surfaces (104, 106) being opposed to one another for applying a gripping force to the surgical instrument (130);
characterized in that the end-effector (66) further comprises:a first surgical instrument guide (110) removeably fastened to the first finger portion (90) and extending perpendicularly to the first gripping surface (104); anda second surgical instrument guide (112) removeably fastened to the second finger portion (92)and extending perpendicularly to the second gripping surface (106), wherein the first and the second surgical instrument guides (110, 112) provide stability to the surgical instrument (130). - A medical imaging system according to claim 1 further comprising incremental movement means for incrementally inserting the surgical instrument (130) along a trajectory into the subject.
- A medical imaging system according to claim 1 wherein the gripping force has a magnitude that allows the surgical instrument (130) to be manually inserted into the subject.
- A medical imaging system according to claim 1 wherein the first surgical instrument guide (110) applies a first force to the surgical instrument (130) in a direction perpendicular to the first gripping surface (104) and the second surgical instrument guide (112) applies a second force to the surgical instrument (130) in a direction perpendicular to the second gripping surface (106).
- A medical imaging system according to claim 1 further comprising a mechanical arm controller (72) for controlling the mechanical arm (30) such that the surgical instrument (130) moves along a path in accordance with the planned interventional procedure.
- A medical imaging system according to claim 5 wherein the path comprises a linear trajectory into the subject.
- A medical imaging system according to claim 6 wherein the movement of the surgical instrument (130) along the path includes relative movement between the surgical instrument (130) and the end-effector (66) along the linear trajectory.
- A medical imaging system according to claim 7 further comprising position tracking means for tracking a position of the surgical instrument (130).
- A medical imaging system according to claim 1 wherein the first surgical instrument guide (110) comprises a first and second prong (120), the first and second prongs (120) extending past the first gripping surface (104) and the second surgical instrument guide (112) comprises a third and fourth prong (122), the third and fourth prongs (122) extending past the second gripping surface (106).
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US25293800P | 2000-11-24 | 2000-11-24 | |
US252938P | 2000-11-24 | ||
PCT/US2001/043394 WO2002041782A2 (en) | 2000-11-24 | 2001-11-21 | Diagnostic imaging interventional apparatus |
US09/990,127 US6853856B2 (en) | 2000-11-24 | 2001-11-21 | Diagnostic imaging interventional apparatus |
US990127 | 2001-11-21 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1363548A2 EP1363548A2 (en) | 2003-11-26 |
EP1363548B1 true EP1363548B1 (en) | 2015-08-12 |
Family
ID=26942810
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP01985974.3A Expired - Lifetime EP1363548B1 (en) | 2000-11-24 | 2001-11-21 | Diagnostic imaging interventional apparatus |
Country Status (4)
Country | Link |
---|---|
US (1) | US6853856B2 (en) |
EP (1) | EP1363548B1 (en) |
JP (1) | JP4303962B2 (en) |
WO (1) | WO2002041782A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016204271A1 (en) * | 2016-03-15 | 2017-09-21 | Kuka Roboter Gmbh | Medical workplace with a magnetic resonance device and a medical robot |
Families Citing this family (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8123697B2 (en) * | 2002-02-14 | 2012-02-28 | Koninklijke Philips Electronics N.V. | Method and apparatus for MR-guided biopsy |
US20040092810A1 (en) * | 2002-02-14 | 2004-05-13 | Wolfgang Daum | Method and apparatus for MR-guided biopsy |
EP2070487B1 (en) * | 2002-08-13 | 2014-03-05 | NeuroArm Surgical, Ltd. | Microsurgical robot system |
ATE544409T1 (en) * | 2003-06-18 | 2012-02-15 | Koninkl Philips Electronics Nv | REMOTE NEEDLE GUIDE FOR CT FLUOROSCOPY |
US20050267359A1 (en) * | 2004-05-27 | 2005-12-01 | General Electric Company | System, method, and article of manufacture for guiding an end effector to a target position within a person |
US20060063998A1 (en) * | 2004-09-21 | 2006-03-23 | Von Jako Ron | Navigation and visualization of an access needle system |
ITSV20050040A1 (en) * | 2005-12-09 | 2007-06-10 | Stefano Durante | DEVICE FOR DRIVING NEEDLES, IN PARTICULAR BIOPSY NEEDLES OR SIMILAR |
US7603161B2 (en) * | 2005-12-30 | 2009-10-13 | Medtronic, Inc. | Position detection in a magnetic field |
US20080021317A1 (en) * | 2006-07-24 | 2008-01-24 | Siemens Medical Solutions Usa, Inc. | Ultrasound medical imaging with robotic assistance for volume imaging |
US8401620B2 (en) | 2006-10-16 | 2013-03-19 | Perfint Healthcare Private Limited | Needle positioning apparatus and method |
US8133242B1 (en) | 2007-04-27 | 2012-03-13 | Q-Tech Medical Incorporated | Image-guided extraluminal occlusion |
WO2009157007A1 (en) * | 2008-06-26 | 2009-12-30 | Perfint Engineering Services Private Limited | Needle positioning apparatus and method |
US20100198052A1 (en) * | 2009-01-28 | 2010-08-05 | Kimble Jenkins | Mri-compatible articulating arms and related systems and methods |
EP2440129A4 (en) * | 2009-06-08 | 2015-06-03 | Mri Interventions Inc | Mri-guided surgical systems with preset scan planes |
WO2010148083A2 (en) | 2009-06-16 | 2010-12-23 | Surgivision, Inc. | Mri-guided devices and mri-guided interventional systems that can track and generate dynamic visualizations of the devices in near real time |
US8211121B1 (en) | 2010-03-06 | 2012-07-03 | Q-Tech Medical Incorporated | Methods and apparatus for image-guided extraluminal occlusion using clamping jaws |
US20120190970A1 (en) | 2010-11-10 | 2012-07-26 | Gnanasekar Velusamy | Apparatus and method for stabilizing a needle |
US8684937B2 (en) * | 2011-03-17 | 2014-04-01 | B-K Medical Aps | Imaging probe |
EP2561821A1 (en) * | 2011-08-25 | 2013-02-27 | Perfint Healthcare Private Limited | Tool positioning system |
GB201215877D0 (en) * | 2012-09-05 | 2012-10-24 | Renishaw Plc | Medical imaging accessory |
JP6053933B2 (en) * | 2012-11-29 | 2016-12-27 | オリンパス株式会社 | TREATMENT TOOL, MANIPULATOR SYSTEM, AND TREATMENT TOOL OPERATION METHOD |
CN103919571B (en) * | 2013-01-11 | 2016-12-28 | 通用电气公司 | Ultrasound Image Segmentation |
US20140343406A1 (en) * | 2013-05-15 | 2014-11-20 | LAD technology LLC | Needle positioning device for ultrasound-guided treatments and examinations |
WO2015052718A1 (en) * | 2013-10-07 | 2015-04-16 | Technion Research & Development Foundation Ltd. | Gripper for robotic image guided needle insertion |
BR112018015720A2 (en) * | 2016-02-01 | 2019-09-03 | Imaginalis S R L | radiological imaging device |
CN108095810A (en) * | 2018-02-07 | 2018-06-01 | 上海爱立峰医疗科技有限公司 | For the needle holder in image-guided intervention operation |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4583538A (en) | 1984-05-04 | 1986-04-22 | Onik Gary M | Method and apparatus for stereotaxic placement of probes in the body utilizing CT scanner localization |
FR2605834B1 (en) * | 1986-11-05 | 1989-01-06 | Pellenc & Motte | ROBOTIZED MACHINE, PARTICULARLY FOR HARVESTING FRUITS |
US4733661A (en) * | 1987-04-27 | 1988-03-29 | Palestrant Aubrey M | Guidance device for C.T. guided drainage and biopsy procedures |
DE9016810U1 (en) * | 1990-12-12 | 1991-02-28 | Siemens Ag, 8000 Muenchen, De | |
US5441042A (en) | 1991-08-05 | 1995-08-15 | Putman; John M. | Endoscope instrument holder |
US5957933A (en) * | 1997-11-28 | 1999-09-28 | Picker International, Inc. | Interchangeable guidance devices for C.T. assisted surgery and method of using same |
WO2000002882A1 (en) | 1998-07-10 | 2000-01-20 | Meiji Seika Kaisha Ltd. | Novel x-ray intercepting metal complexes of chlorin derivatives |
US6665554B1 (en) * | 1998-11-18 | 2003-12-16 | Steve T. Charles | Medical manipulator for use with an imaging device |
CA2261488A1 (en) * | 1999-01-21 | 2000-07-21 | Anthony Paolitto | Transabdominal device for performing closed-chest cardiac surgery |
CA2306303A1 (en) | 1999-04-23 | 2000-10-23 | Lutz T. Kynast | Microdrive for probes |
US6785572B2 (en) * | 2001-11-21 | 2004-08-31 | Koninklijke Philips Electronics, N.V. | Tactile feedback and display in a CT image guided robotic system for interventional procedures |
-
2001
- 2001-11-21 EP EP01985974.3A patent/EP1363548B1/en not_active Expired - Lifetime
- 2001-11-21 WO PCT/US2001/043394 patent/WO2002041782A2/en active Application Filing
- 2001-11-21 JP JP2002543966A patent/JP4303962B2/en not_active Expired - Fee Related
- 2001-11-21 US US09/990,127 patent/US6853856B2/en not_active Expired - Lifetime
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016204271A1 (en) * | 2016-03-15 | 2017-09-21 | Kuka Roboter Gmbh | Medical workplace with a magnetic resonance device and a medical robot |
Also Published As
Publication number | Publication date |
---|---|
JP2004517659A (en) | 2004-06-17 |
JP4303962B2 (en) | 2009-07-29 |
WO2002041782A2 (en) | 2002-05-30 |
EP1363548A2 (en) | 2003-11-26 |
US6853856B2 (en) | 2005-02-08 |
WO2002041782A9 (en) | 2003-11-20 |
US20020087065A1 (en) | 2002-07-04 |
WO2002041782A3 (en) | 2003-09-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1363548B1 (en) | Diagnostic imaging interventional apparatus | |
EP1638466B1 (en) | Remotely held needle guide for ct fluoroscopy | |
JP3705816B2 (en) | Image-guided biopsy device and method with improved imaging | |
US20200077993A1 (en) | Apparatus and method for biopsy and therapy | |
JP4624561B2 (en) | Method and apparatus for positioning a device in a body | |
US6785572B2 (en) | Tactile feedback and display in a CT image guided robotic system for interventional procedures | |
US6701173B2 (en) | Curved surgical instruments and method of mapping a curved path for stereotactic surgery | |
Heilbrun | Computed tomography-guided stereotactic systems | |
US5957933A (en) | Interchangeable guidance devices for C.T. assisted surgery and method of using same | |
EP2561821A1 (en) | Tool positioning system | |
DE69916235T2 (en) | DEVICE FOR TISSUE TREATMENT OF AN INTERESTING FIELD USING STEREOTAKTIC RADIOGRAPHIC GUIDANCE | |
US20090030339A1 (en) | Apparatus and method for motorised placement of needle | |
EP0922438A1 (en) | Image guided interventional procedures | |
WO2017050201A1 (en) | Minimally invasive medical robot system | |
Podder et al. | Evaluation of robotic needle insertion in conjunction with in vivo manual insertion in the operating room | |
CN110522491B (en) | Medical device | |
JP3728437B2 (en) | Manipulator for use in closed magnetic resonance tomography equipment | |
WO2011146018A9 (en) | An apparatus for guiding a surgical instrument | |
CN115317090A (en) | Mammary gland puncture robot system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
17P | Request for examination filed |
Effective date: 20040312 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): DE FR GB |
|
17Q | First examination report despatched |
Effective date: 20091123 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: KONINKLIJKE PHILIPS N.V. |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150302 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 60149515 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20160129 Year of fee payment: 15 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 60149515 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20160513 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20151121 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151121 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 16 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20161129 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 60149515 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170601 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20180731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171130 |