WO2016207163A1 - System and method for registering a structure using fiber-optical realshape data - Google Patents
System and method for registering a structure using fiber-optical realshape data Download PDFInfo
- Publication number
- WO2016207163A1 WO2016207163A1 PCT/EP2016/064316 EP2016064316W WO2016207163A1 WO 2016207163 A1 WO2016207163 A1 WO 2016207163A1 EP 2016064316 W EP2016064316 W EP 2016064316W WO 2016207163 A1 WO2016207163 A1 WO 2016207163A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- points
- positional
- positional points
- registration
- deformable
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2061—Tracking techniques using shape-sensors, e.g. fiber shape sensors with Bragg gratings
Definitions
- This disclosure relates to medical devices and more particularly to a system and method for registration of a structure using Fiber-Optical RealShapeTM data.
- Computer assisted surgery is frequently used to provide live navigational guidance during surgical procedures which allows for the optimal positioning of implants as well as improved intraoperative verification of the biomechanics of a structure.
- the registration of a structure of the subject, such as a bone or anatomy of interest, to the coordinate system of an imaging modality (e.g., CT, MRI, X-ray, etc.) or a real-world coordinate system is of vital importance for a computer assisted surgery.
- an imaging modality e.g., CT, MRI, X-ray, etc.
- a real-world coordinate system is of vital importance for a computer assisted surgery.
- the practitioner In order to register the structure to a coordinate system, the practitioner must hold the tip of a tracked pointer to certain landmarks on the anatomy, such as bony landmarks, and indicate to a computerized registration device when the pointer is at the designated landmark. After a series of landmark points are acquired in this fashion, a coarse registration is computed; the practitioner may also refine the registration by running the pointer over the surface,
- fiducial markers need to be acquired in a certain order by the practitioner.
- markerless registration or for refinement of the maker-based registration a series of points are sampled by sliding the tracked pointer on the surface of the bone.
- a deformable registration device utilizing Fiber-Optical RealShapeTM (also known as “Optical Shape Sensing”, “Fiber Shape Sensing”, “Fiber Optical 3D Shape Sensing”, “Fiber Optic Shape Sensing and Localization” or the like) may be used.
- a deformable registration device includes a deformable body that is configured to conform to the shape of the structure of the subject to be registered.
- the deformable registration device may further include an optical fiber for a Fiber-Optical RealShapeTM ("FORS”) system which is configured to acquire a collection of samples along the surface of the deformable body in a single acquisition snapshot in order to obtain positional points for the structure.
- FORS Fiber-Optical RealShapeTM
- a registration of the positional points obtained by FORS is performed to transform the positional points of the structure so that, for example, they correctly overlay the images of the structure obtained by the imaging modality.
- the deformable registration device In order to ensure that the registration is accurate, the deformable registration device must be flush against the structure of the subject. If the deformable registration device is not flush, point cloud/surface registration algorithms known in art, such as iterative closest point ("ICP") in its most widely used form, may provide errors in the registration. This is because ICP and other point cloud/surface registration algorithms use the cumulative Euclidean distance error between the input data sets as the optimization criterion and point samples that reside off of the surface of an object have large associated errors that lead to errors in the registration.
- ICP iterative closest point
- a system for registering a structure of a subject to a coordinate system using FORS data includes a deformable registration device having a deformable body.
- the deformable body includes an optical fiber for a FORS system.
- the system further includes a FORS system that is configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points for the structure.
- a pre-processing module is configured to analyze the positional points acquired by the FORS system and determine which positional points are on- surface and off-surface points with respect to the structure.
- a registration module is configured to delete the off-surface positional points and perform a registration using the on- surface positional points.
- a system for registering a structure of a subject to a coordinate system using FORS data includes a deformable registration device having a deformable body.
- the deformable body includes an optical fiber for a FORS system.
- a FORS system is configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points for the structure.
- the system further includes a workstation having one or more processors, memory and an interface.
- a pre-processing module is configured to analyze the positional points acquired by the FORS system and determine which positional points are on-surface and off-surface points with respect to the structure.
- a registration module is configured to delete the off-surface positional points and perform a registration using the on-surface positional points.
- a method for registering a structure of a subject to a coordinate system using FORS data includes the steps of placing a deformable registration device having a deformable body on a structure of the subject. Positional points for the structure are obtained by measuring a shape of the optical fiber using a FORS system. The positional points acquired by the FORS system are analyzed and a determination concerning which positional points are on-surface and off-surface points with respect to the structure is made. The off-surface positional points are deleted and the on-surface positional points are used to perform a registration.
- FIG. 1 is a block/flow diagram showing a system for registering a structure using FORS data in accordance with one illustrative embodiment
- FIG. 2 shows images of a deformable registration device held taut against the structure
- FIG. 3 shows images of the system determining on-surface and off-surface points using curvature detection
- FIG. 4 shows images of the contact sensing device on the structure
- FIG. 5 is a block/flow diagram showing a contact sensing device
- FIG. 6 shows images of a convex hull generated on a model of the structure and the deformable registration device positioned on the structure;
- FIG. 7 shows images of a model of a structure and a convex hull generated from the model
- FIG. 8 shows images of an envelope generated on a model of the structure and the deformable registration device positioned on the structure
- FIG. 9 shows images of a correct alignment of the registration shape and the bone model and a misalignment of the shapes due to inclusion of off-surface points in registration
- FIG. 10 is a flow diagram showing a method for registering a structure using FORS data in accordance with one illustrative embodiment.
- FIG. 1 1 is a flow diagram showing a method for registering a structure using FORS data in accordance with another illustrative embodiment.
- a system for registering a structure using FORS data includes a deformable registration device having a deformable body that includes an optical fiber.
- the system further includes a FORS system configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points for the structure.
- a pre-processing module is configured to analyze the positional points acquired by the FORS system and determine which positional points are on-surface and off-surface points with respect to the structure.
- a registration module is configured to delete the off-surface positional points and register using the on-surface positional points.
- Positional points may be obtained from a shape generated on a model which approximates points as would be measured by the deformable registration device when it is not flush against the structure.
- the positional points obtained from the shape generated on a model may be combined with the positional points acquired from the deformable body to provide an improved registration. This provides a simpler, more efficient registration procedure for the practitioner which requires less care and skill and improves the accuracy of the registration.
- the present invention will be described in terms of medical systems. However, the teachings of the present invention are much broader and in some embodiments, the present principles are employed in complex biological or mechanical systems. Furthermore, the present principles are applicable to internal procedures of biological systems in all areas of the body such as the lungs, liver, brain, uterus, gastrointestinal tract, excretory organs, blood vessels, and any other solid organ tissue, tumor tissue and homogenously or heterogeneously enhancing structures of the body.
- the elements depicted in the FIGS may be implemented in various combinations of hardware and software and provide functions which may be combined in a single element or multiple elements.
- processors can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
- the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared.
- explicit use of the term "processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor ("DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory
- DSP digital signal processor
- ROM read-only memory
- RAM random access memory
- non-volatile storage etc.
- embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system.
- a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
- the medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium.
- Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk.
- Current examples of optical disks include compact disk - read only memory (CD-ROM), compact disk - read/write (CD-R/W), Blu-RayTM and DVD.
- a system 100 includes a deformable registration device 102 which includes a deformable body 105 that is configured to conform to the shape of the structure 104 of the subject 103 to be registered.
- the system 100 may include a workstation 101 from which the procedure is supervised and/or managed.
- the workstation 101 preferably includes one or more processors 107, memory 109 for storing programs and applications and a display 1 15 which permits a user to view images and interact with the workstation 101.
- the system 100 may further include an interface 123 which may feature a keyboard, mouse, a joystick, a haptic device, or any other peripheral or control to permit user feedback from and interaction with the workstation 101.
- the deformable registration device 102 includes an optical fiber 108 for a FORS system.
- a Fiber-Optical RealShapeTM system is a commercial name for systems developed by Koninklijke Philips, N.V.
- FORS and FORS systems are not, however, limited to products and systems of Koninklijke Philips, N.V., but refer generally to fiber optic(al) shape sensing and fiber optic(al) shape sensing systems, fiber optic(al) 3D shape sensing, fiber optic(al) 3D shape sensing systems, fiber optic(al) shape sensing and localization and similar technologies.
- FORS systems are also commonly known as "optical shape sensing systems".
- FORS systems include one or more optical fibers 108 that are integrated within the registration device 102 in a set pattern or patterns.
- the FORS system is connected to a FORS interrogator device (not shown).
- the optical fiber may connect to a workstation 101 through cabling 1 17.
- the system may include a sensing and interpretation module 1 13 that is configured to receive the FORS data 1 1 1 and interpret this information.
- the FORS data 1 1 1 may be stored in the memory 109 of the system 100.
- a FORS system uses light from the interrogator device along a multicore optical fiber for providing FORS data concerning the shape of the optical fiber during a procedure such as a surgical interventional procedure.
- the shape along the optical fiber begins at a specific point along the sensor, known as the launch or zero position, and the subsequent shape position and orientation are relative to that point.
- the FORS system 1 10 with fiber optics may be based on fiber optic Bragg grating sensors.
- a fiber optic Bragg grating (FBG) is a short segment of optical fiber that reflects particular wavelengths of light and transmits all others. This is achieved by adding a periodic variation of the refractive index in the fiber core, which generates a wavelength-specific dielectric mirror.
- a fiber Bragg grating can therefore be used as an inline optical filter to block certain wavelengths, or as a wavelength-specific reflector.
- a fundamental principle behind the operation of a fiber Bragg grating is Fresnel reflection at each of the interfaces where the refractive index is changing. For some wavelengths, the reflected light of the various periods is in phase so that constructive interference exists for reflection and, consequently, destructive interference for transmission.
- the Bragg wavelength is sensitive to strain as well as to temperature. This means that Bragg gratings can be used as sensing elements in fiber optical sensors. In an FBG sensor, the measurand (e.g., strain) causes a shift in the Bragg wavelength.
- One advantage of this technique is that various sensor elements can be distributed over the length of a fiber. Incorporating three or more cores with various sensors (gauges) along the length of a fiber that is embedded in a structure permits a three-dimensional form of such a structure to be precisely determined, typically with better than 1 mm accuracy.
- a multitude of FBG sensors can be located (e.g., 3 or more fiber sensing cores). From the strain measurement of each FBG, the curvature of the structure can be inferred at that position. From the multitude of measured positions, the total three-dimensional form is determined.
- Rayleigh scattering occurs as a result of random fluctuations of the index of refraction in the fiber core. These random fluctuations can be modeled as a Bragg grating with a random variation of amplitude and phase along the grating length.
- the FORS system 1 10 allows for determination of the shape of the optical fiber 108 when the deformable body 105 of the deformable registration device contacts the structure 104 of the subject.
- the FORS system 1 10 using the shape of the optical fiber 108 is configured to acquire positional points representing the position of the structure 104 of the subject. While the system 100 is illustratively described as utilizing a FORS system 1 10, other known shape sensor systems and sensors may be utilized for the system in accordance with the present principles.
- the deformable registration device 102 is normally required to be flush against the structure of the subject to avoid acquiring erroneous positional points that are not on the surface of the structure 104 and which do not represent a position of the structure. These off- surface points lead to errors in registration of the structure to a coordinate system, such as the coordinate system of the imaging device, a real-world coordinate system or another global coordinate system.
- FIG. 2 displays a deformable registration device 102 held taut against a structure 104.
- the regions of the device 102 in solid lines are in contact or close proximity to the structure 104 and represent on-surface points 1 14.
- the regions of the device 102 in dotted lines are not in contact or close proximity to the structure 104 and represent off-surface points 1 16.
- a registration of these off-surface points 1 16 by known registration algorithms such as ICP would result in errors in the registered structure. More specifically, with specific reference to ICP, the ICP algorithm uses as an optimization parameter that depends on the distance between each sampled point and its corresponding closest point of the structure. Accordingly, the ICP algorithm would analyze the acquired off-surface points and compute a local minimum that is not necessarily the global minimum for the structure 104.
- the system 100 obviates the requirement for the deformable registration device 102 to be held flush against the structure 104 of the subject in order to accurately register the structure 104.
- the system 100 includes a pre-processing module 1 12 which is configured to analyze the positional points 106 acquired by the FORS system 1 10 and determine which points are on-surface 1 14 and off-surface points 1 16.
- a registration module 1 18 is then configured to register the acquired points of the structure 104 factoring in whether a point is an on-surface 1 14 or off-surface point 1 16. As shown in FIG. 3, the registration module 1 18 is configured to delete the off-surface points in order to avoid the distortion that would normally occur in the registration of the off-surface points 1 16.
- "Deletion" of positional points by the registration module 1 18 means that the positional points are either removed or are disregarded in the registration algorithm, such as ICP.
- the pre-processing module includes an interpolation module 120.
- the interpolation module is configured to interpolate the positional points 106 from the FORS data and generate a smooth surface fit 121 along the points.
- FIG. 3 shows positional points 106 acquired from the FORS system which are then interpolated to provide a smooth surface fit 121 over the points.
- the pre-processing module includes a computation module 122 that is configured to compute surface metrics, such as curvature, slope, shape, axial strain, etc., along the surface of the smooth surface fit 121.
- the deformable body 105 of the deformable registration device typically contacts regions of the structure 104 that are more curved than regions of the deformable body that are off of the surface of the structure.
- flat regions of the structure 104 that are isolated from curved regions are more likely to provide off-surface positional points of the structure 104.
- the flat taut portions of the device are off-surface of the concave surfaces of the structure 104 below the deformable body 105 of the device.
- the computation module 122 is configured to compute the curvature along the surface of the smooth surface fit developed by the interpolation module 120.
- a threshold curvature level is determined in which regions with a larger curvature are likely to be on-surface points 1 14 and regions below the threshold curvature level are likely to be off-surface points 1 16.
- the threshold curvature level may be developed by the use of models or the analysis of sample data.
- the determination module 124 is configured to analyze the curvature level or other surface metric(s) determined by the computation module 122 in comparison to the threshold curvature level and determine if the curvature is above, equal to, or below the threshold. As shown in FIG. 3, if the curvature level for a point is below the threshold curvature level, the determination module identifies the point as an off-surface point 1 16. If the point is equal to or above the threshold, the point is determined to be an on-surface point 1 14.
- the system 100 may utilize contact sensing information in combination with the information provided by the determination module 124 to determine if a positional point 106 acquired by the FORS system 1 10 is an on-surface point 1 14 or off- surface point 1 16.
- the contact sensing is performed by a contact sensing device 126.
- the contact sensing device 126 may include an optical fiber 127 of a FORS system that is in an overlapped configuration to form two parallel segments. While the optical fiber is described as forming two parallel segments, in some embodiments the optical fiber may form more than two segments and/or the fiber segments may be positioned in a non- intersecting configuration which is not strictly parallel.
- the contact sensing device 126 is configured to apply a pressure on the optical fiber 127 and the optical fiber is placed on the structure 104. As shown in FIG. 4, when the optical fiber 127 contacts an on-surface region 1 14 of the structure, the distance between the parallel fibers decreases due to the pressure applied on the optical fiber. Conversely, when the optical fiber is in contact with an off-surface region 1 16, the distance between the fibers remains approximately the same.
- the contact sensing device 126 includes a detection device 130 that is configured to compute the distance between the segments of the optical fiber 127 when it is pressed against the structure 104.
- the contact sensing device 126 further includes an identification device 132 that is configured to receive the computation of the distance between segments from the detection device 130 and provide contact sensing information 128 which identifies on-surface and off-surface points.
- the identification device 132 is configured to identify points where the distance between the segments remains approximately the same from the initial distance between the points as being off-surface points 1 16.
- the identification device 132 is configured to identify the points where the distance between the segments decrease as being on-surface points 1 14.
- the optical fiber may be configured within the deformable body 105 to enable the deformable body 105 to simultaneously perform the contact sensing function of the contact sensing device 126 and the registration function of the deformable registration device 102 within a single device.
- the system 100 is configured to review the determination of on-surface points 1 14 and off-surface points 1 16 by both the determination module 124 and from the contact sensing information 128.
- the system 100 may combine both the contact sensing information 128 and the determination from the determination module 124 using a weighted analysis or by other means known in the art.
- system 100 includes a model 134 (FIG. 6) of the structure
- the system 100 includes a generation module 136 that is configured to generate a shape 137 (FIG. 8) on the model 134 which approximates points that would be acquired by the deformable registration device 102 on the structure 104 when the deformable registration device 102 is not flush against the surface of the structure 104.
- the model may generate a convex hull shape 138 which approximates the position of the deformable registration device 102 if the deformable body 105 is held taut over a concave surface.
- an envelope 140 with a maximum concave curvature which encloses the structure may be generated by the generation module 136.
- the pre-processing module 1 12 is configured to receive the positional points 142 (FIG. 1) obtained by the generation module 136 from the shape generated on the model 134 and determine which points are on-surface and off-surface points with respect to the structure 104.
- the registration module 1 18 is configured to receive the positional points 106 acquired by the deformable registration device from FORS data and the positional points 142 acquired from the generation of a shape on the model 134 by the generation module and perform a registration to a coordinate system.
- the registration module 1 18 is configured to solely utilize positional points from the deformable registration device or derived from the model 134 in order to perform the registration.
- both types of acquired positional points 106, 142 are utilized as this technique will generally increase the robustness of the registration.
- the positional points 142 acquired from the model may be a convex hull 138 approximating the position of the deformable registration device 102 when it is held completely taut
- the positional points obtained from the model may be used to register the model with positional points 106 obtained from the deformable registration device. This obviates the need for the deformable registration device 102 to be held completely taut when acquiring the positional points.
- the deformable registration device 102 has a maximum convex curvature that it can deform to, positional points acquired from the envelope 140 generated on the model may be used to register the model with positional points 106 obtained from the deformable registration device.
- the system 100 is also configured to replace positional points acquired by the model 134 with positional points 142 from the generation module 136. This allows the positional points 106 from the deformable registration device 102 to morph a modified statistical model of the structure 104 to match the modified shape of the structure and to obtain registration therefor.
- the registration module 1 18 is configured to perform registration of the positional points 106, 142 using standard registration algorithms known in the art, such as ICP.
- the registration module is configured to apply different weights or delete the positional points in order to avoid error in the registration. For example, as shown in FIG. 9, if a standard ICP algorithm is applied to the positional points 106, 142 from both the deformable registration device and the model without modifying the positional points, the registration shape resulting from the model and the deformable registration device may have an error, such having the positional points 106, 142 intersect with respect to each other.
- the registration module 1 18 is configured to perform registration using positional points 106 acquired by the deformable registration device 102 and the positional points 142 from the model.
- the registration module 1 18 is configured to delete or apply different weights to positional points 106 acquired from the deformable registration device 102 and the positional points 142 acquired from the model.
- a weighted approach is applied wherein the positional points 106 from the deformable registration device 102 are weighted based on on-surfaceness and off-surfaceness confidence of the positional points 106 based on a curvature threshold.
- a weighted approach may be based upon the convexity/concavity of the model 134 or other criteria.
- the registration module 1 18 may apply more weight to positional points acquired from convex regions and less weight to positional points acquired from concave regions of the model.
- the device may further include a registration evaluation module 1 19 which is configured to review the registration for accuracy. If the registration is not accurate, the registration evaluation module 1 19 is configured to generate a signal for the user to reposition the deformable registration device 102 and a new registration is performed by the system 100.
- a registration evaluation module 1 19 which is configured to review the registration for accuracy. If the registration is not accurate, the registration evaluation module 1 19 is configured to generate a signal for the user to reposition the deformable registration device 102 and a new registration is performed by the system 100.
- the system 100 may be configured in an integrated computerized and/or electronic unit wherein a registration performed by the workstation 101 is automatically triggered when the deformable body 105 is pressed against the structure 104, in response to a gesture performed by the user of the deformable registration device 102, the user pressing a button on the deformable registration device, etc.
- a deformable registration device 102 having a deformable body is placed on a structure 104 of the subject.
- positional points for the structure are obtained by measuring a shape of the optical fiber 108 using a FORS system 1 10.
- the positional points 106 acquired by the FORS system are analyzed and a determination concerning which positional points are on-surface 1 14 and off-surface points 1 16 with respect to the structure is made.
- the off-surface 1 16 positional points are deleted and the on-surface 1 14 positional points are used in registration with the model 134.
- the method further comprises the step in block 190 of generating a shape on a model of the structure that is configured to approximate points that would be measured by a deformable registration device of the structure if the deformable registration device was not flush against the surface of the structure.
- the approximated model from generation module 136 can then be used with all positional points 106 from the deformable registration device 102 to perform registration.
- the positional points 106, 142 are modified by applying different weights or deleting at least one positional point to form a modified positional point set. For example, in one embodiment, more weight is applied to positional points from the model that are detected as on-surface points and less weight is applied to positional points that are detected as off-surface points.
- the modified positional point set are registered.
- the method may further comprise the steps of interpolating the positional points from the FORS data to generate a smooth surface fit along the positional points.
- a surface metric such as curvature, slope, shape, axial strain, etc., along the surface of the smooth surface fit is then computed and the positional points in which the surface metric is above a threshold level are identified as on- surface points.
- the positional points that are below a threshold level are identified as off- surface positional points.
- contact sensing information such as
- the contact sensing device 126 may be used in order to determine which positional points are on-surface and off-surface points.
- FORS data allows for registration of the positional points acquired by the deformable registration device without requiring the deformable device to be flush against the structure. This provides a simpler, more efficient registration procedure for the practitioner which requires less care and skill and improves the accuracy of the registration.
- the system and method may be effectively utilized for registration of positional points acquired by a deformable registration device that is flush against the structure in accordance with the principles of this invention.
Landscapes
- Health & Medical Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Robotics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
A system and method for registering a structure (104) of a subject (103) to a coordinate system which includes a deformable registration device (102) having a deformable body (105) that features an optical fiber (108). A FORS system (110) measures a shape of the optical fiber when the deformable body contacts the structure of the subject to obtain positional points (106) for the structure. A pre-processing module (112) analyzes the positional points and determines which positional points are on-surface and off-surface points with respect to the structure. A registration module (118) deletes the off-surface positional points and registers the device to the structure using the on-surface positional points. Positional points (142) from a shape (137) generated on a model which approximates points that would be measured by the deformable registration device of the structure may be combined with the positional points (106) acquired from the deformable body to provide an improved registration.
Description
SYSTEM AND METHOD FOR REGISTERING A STRUCTURE
USING FIBER-OPTICAL REALSHAPE DATA
BACKGROUND:
Technical Field
This disclosure relates to medical devices and more particularly to a system and method for registration of a structure using Fiber-Optical RealShape™ data.
Description of the Related Art
Computer assisted surgery is frequently used to provide live navigational guidance during surgical procedures which allows for the optimal positioning of implants as well as improved intraoperative verification of the biomechanics of a structure. The registration of a structure of the subject, such as a bone or anatomy of interest, to the coordinate system of an imaging modality (e.g., CT, MRI, X-ray, etc.) or a real-world coordinate system is of vital importance for a computer assisted surgery. In order to register the structure to a coordinate system, the practitioner must hold the tip of a tracked pointer to certain landmarks on the anatomy, such as bony landmarks, and indicate to a computerized registration device when the pointer is at the designated landmark. After a series of landmark points are acquired in this fashion, a coarse registration is computed; the practitioner may also refine the registration by running the pointer over the surface, painting the anatomy and digitizing the surface into the tracking coordinate frame.
For example, in the current practice of registration in computer assisted surgery utilizing marker-based registration, fiducial markers need to be acquired in a certain order by the practitioner. In markerless registration or for refinement of the maker-based registration,
a series of points are sampled by sliding the tracked pointer on the surface of the bone.
These existing procedures are time-consuming because the tracked pointer must be moved to sample the desired number of landmarks. Furthermore, during this sampling procedure, the patient must remain still in order to avoid errors in the registration. The marker-based registration also requires the user to locate pre-defined fiducial markers in a particular order. Some tracking systems need one user to hold the pointer to sample the landmarks, and another user to operate the software for recording the sampling points.
Sliding of the pointer over the surface of the structure similarly requires coordination between one user sliding the pointer and one user operating the software. Furthermore, the pointer may inadvertently disengage the surface during the sliding activity, introducing errors into the registration process. These factors prolong and complicate the workflow for an interventional procedure.
In order to provide a more efficient registration, a deformable registration device utilizing Fiber-Optical RealShape™ (also known as "Optical Shape Sensing", "Fiber Shape Sensing", "Fiber Optical 3D Shape Sensing", "Fiber Optic Shape Sensing and Localization" or the like) may be used. A deformable registration device includes a deformable body that is configured to conform to the shape of the structure of the subject to be registered. The deformable registration device may further include an optical fiber for a Fiber-Optical RealShape™ ("FORS") system which is configured to acquire a collection of samples along the surface of the deformable body in a single acquisition snapshot in order to obtain positional points for the structure.
A registration of the positional points obtained by FORS is performed to transform the positional points of the structure so that, for example, they correctly overlay the images of the structure obtained by the imaging modality. In order to ensure that the registration is
accurate, the deformable registration device must be flush against the structure of the subject. If the deformable registration device is not flush, point cloud/surface registration algorithms known in art, such as iterative closest point ("ICP") in its most widely used form, may provide errors in the registration. This is because ICP and other point cloud/surface registration algorithms use the cumulative Euclidean distance error between the input data sets as the optimization criterion and point samples that reside off of the surface of an object have large associated errors that lead to errors in the registration.
SUMMARY
In accordance with the present principles, a system for registering a structure of a subject to a coordinate system using FORS data includes a deformable registration device having a deformable body. The deformable body includes an optical fiber for a FORS system. The system further includes a FORS system that is configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points for the structure. A pre-processing module is configured to analyze the positional points acquired by the FORS system and determine which positional points are on- surface and off-surface points with respect to the structure. A registration module is configured to delete the off-surface positional points and perform a registration using the on- surface positional points.
In another embodiment, a system for registering a structure of a subject to a coordinate system using FORS data includes a deformable registration device having a deformable body. The deformable body includes an optical fiber for a FORS system. A FORS system is configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points for the structure. The system
further includes a workstation having one or more processors, memory and an interface. A pre-processing module is configured to analyze the positional points acquired by the FORS system and determine which positional points are on-surface and off-surface points with respect to the structure. A registration module is configured to delete the off-surface positional points and perform a registration using the on-surface positional points.
In another embodiment, a method for registering a structure of a subject to a coordinate system using FORS data includes the steps of placing a deformable registration device having a deformable body on a structure of the subject. Positional points for the structure are obtained by measuring a shape of the optical fiber using a FORS system. The positional points acquired by the FORS system are analyzed and a determination concerning which positional points are on-surface and off-surface points with respect to the structure is made. The off-surface positional points are deleted and the on-surface positional points are used to perform a registration.
These and other objects, features and advantages of the present disclosure will become apparent from the following detailed description of illustrative embodiments thereof, which is to be read in connection with the accompanying drawings.
BRIEF DESCRIPTION OF DRAWINGS
This disclosure will present in detail the following description of preferred embodiments with reference to the following figures wherein:
FIG. 1 is a block/flow diagram showing a system for registering a structure using FORS data in accordance with one illustrative embodiment;
FIG. 2 shows images of a deformable registration device held taut against the structure;
FIG. 3 shows images of the system determining on-surface and off-surface points using curvature detection;
FIG. 4 shows images of the contact sensing device on the structure;
FIG. 5 is a block/flow diagram showing a contact sensing device;
FIG. 6 shows images of a convex hull generated on a model of the structure and the deformable registration device positioned on the structure;
FIG. 7 shows images of a model of a structure and a convex hull generated from the model;
FIG. 8 shows images of an envelope generated on a model of the structure and the deformable registration device positioned on the structure;
FIG. 9 shows images of a correct alignment of the registration shape and the bone model and a misalignment of the shapes due to inclusion of off-surface points in registration;
FIG. 10 is a flow diagram showing a method for registering a structure using FORS data in accordance with one illustrative embodiment; and
FIG. 1 1 is a flow diagram showing a method for registering a structure using FORS data in accordance with another illustrative embodiment.
DETAILED DESCRIPTION OF EMBODIMENTS
In accordance with the present principles, a system for registering a structure using FORS data is provided. The system includes a deformable registration device having a deformable body that includes an optical fiber. The system further includes a FORS system configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points for the structure. A pre-processing module is configured to analyze the positional points acquired by the FORS system and
determine which positional points are on-surface and off-surface points with respect to the structure. A registration module is configured to delete the off-surface positional points and register using the on-surface positional points.
The system allows for registration of the positional points acquired by the deformable registration device without requiring the deformable device to be flush against the structure. Positional points may be obtained from a shape generated on a model which approximates points as would be measured by the deformable registration device when it is not flush against the structure. The positional points obtained from the shape generated on a model may be combined with the positional points acquired from the deformable body to provide an improved registration. This provides a simpler, more efficient registration procedure for the practitioner which requires less care and skill and improves the accuracy of the registration.
It should be understood that the present invention will be described in terms of medical systems. However, the teachings of the present invention are much broader and in some embodiments, the present principles are employed in complex biological or mechanical systems. Furthermore, the present principles are applicable to internal procedures of biological systems in all areas of the body such as the lungs, liver, brain, uterus, gastrointestinal tract, excretory organs, blood vessels, and any other solid organ tissue, tumor tissue and homogenously or heterogeneously enhancing structures of the body. The elements depicted in the FIGS, may be implemented in various combinations of hardware and software and provide functions which may be combined in a single element or multiple elements.
The functions of the various elements shown in the FIGS, can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual
processors, some of which can be shared. Moreover, explicit use of the term "processor" or "controller" should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor ("DSP") hardware, read-only memory ("ROM") for storing software, random access memory
("RAM"), non-volatile storage, etc.
Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure). Similarly, it will be appreciated that various processes may be substantially represented in computer readable storage media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
Furthermore, embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of
optical disks include compact disk - read only memory (CD-ROM), compact disk - read/write (CD-R/W), Blu-Ray™ and DVD.
In accordance with the present principles, a system for registering a structure using FORS data is provided. Referring now to the drawings in which like numerals represent the same or similar elements and initially to FIG. 1 , a system 100 includes a deformable registration device 102 which includes a deformable body 105 that is configured to conform to the shape of the structure 104 of the subject 103 to be registered.
As shown in FIG. 1 , in one embodiment, the system 100 may include a workstation 101 from which the procedure is supervised and/or managed. The workstation 101 preferably includes one or more processors 107, memory 109 for storing programs and applications and a display 1 15 which permits a user to view images and interact with the workstation 101. The system 100 may further include an interface 123 which may feature a keyboard, mouse, a joystick, a haptic device, or any other peripheral or control to permit user feedback from and interaction with the workstation 101.
The deformable registration device 102 includes an optical fiber 108 for a FORS system. A Fiber-Optical RealShape™ system is a commercial name for systems developed by Koninklijke Philips, N.V. As used herein, the terms FORS and FORS systems are not, however, limited to products and systems of Koninklijke Philips, N.V., but refer generally to fiber optic(al) shape sensing and fiber optic(al) shape sensing systems, fiber optic(al) 3D shape sensing, fiber optic(al) 3D shape sensing systems, fiber optic(al) shape sensing and localization and similar technologies. FORS systems are also commonly known as "optical shape sensing systems". FORS systems include one or more optical fibers 108 that are integrated within the registration device 102 in a set pattern or patterns. The FORS system is connected to a FORS interrogator device (not shown). In one embodiment, the optical fiber
may connect to a workstation 101 through cabling 1 17. The system may include a sensing and interpretation module 1 13 that is configured to receive the FORS data 1 1 1 and interpret this information. The FORS data 1 1 1 may be stored in the memory 109 of the system 100.
A FORS system uses light from the interrogator device along a multicore optical fiber for providing FORS data concerning the shape of the optical fiber during a procedure such as a surgical interventional procedure. The shape along the optical fiber begins at a specific point along the sensor, known as the launch or zero position, and the subsequent shape position and orientation are relative to that point.
The FORS system 1 10 with fiber optics may be based on fiber optic Bragg grating sensors. A fiber optic Bragg grating (FBG) is a short segment of optical fiber that reflects particular wavelengths of light and transmits all others. This is achieved by adding a periodic variation of the refractive index in the fiber core, which generates a wavelength-specific dielectric mirror. A fiber Bragg grating can therefore be used as an inline optical filter to block certain wavelengths, or as a wavelength-specific reflector.
A fundamental principle behind the operation of a fiber Bragg grating is Fresnel reflection at each of the interfaces where the refractive index is changing. For some wavelengths, the reflected light of the various periods is in phase so that constructive interference exists for reflection and, consequently, destructive interference for transmission. The Bragg wavelength is sensitive to strain as well as to temperature. This means that Bragg gratings can be used as sensing elements in fiber optical sensors. In an FBG sensor, the measurand (e.g., strain) causes a shift in the Bragg wavelength.
One advantage of this technique is that various sensor elements can be distributed over the length of a fiber. Incorporating three or more cores with various sensors (gauges) along the length of a fiber that is embedded in a structure permits a three-dimensional form of
such a structure to be precisely determined, typically with better than 1 mm accuracy. Along the length of the fiber, at various positions, a multitude of FBG sensors can be located (e.g., 3 or more fiber sensing cores). From the strain measurement of each FBG, the curvature of the structure can be inferred at that position. From the multitude of measured positions, the total three-dimensional form is determined.
As an alternative to fiber-optic Bragg gratings, the inherent backscatter in
conventional optical fiber can be exploited, such as Raleigh, Raman, Brillouin or
fluorescence scattering. One such approach is to use Rayleigh scatter in standard single- mode communications fiber. Rayleigh scatter occurs as a result of random fluctuations of the index of refraction in the fiber core. These random fluctuations can be modeled as a Bragg grating with a random variation of amplitude and phase along the grating length. By using this effect in three or more cores running within a single length of multi-core fiber, the 3D shape and dynamics of the surface of interest can be followed.
The FORS system 1 10 allows for determination of the shape of the optical fiber 108 when the deformable body 105 of the deformable registration device contacts the structure 104 of the subject. The FORS system 1 10 using the shape of the optical fiber 108 is configured to acquire positional points representing the position of the structure 104 of the subject. While the system 100 is illustratively described as utilizing a FORS system 1 10, other known shape sensor systems and sensors may be utilized for the system in accordance with the present principles.
The deformable registration device 102 is normally required to be flush against the structure of the subject to avoid acquiring erroneous positional points that are not on the surface of the structure 104 and which do not represent a position of the structure. These off- surface points lead to errors in registration of the structure to a coordinate system, such as the
coordinate system of the imaging device, a real-world coordinate system or another global coordinate system. For example, FIG. 2 displays a deformable registration device 102 held taut against a structure 104. The regions of the device 102 in solid lines are in contact or close proximity to the structure 104 and represent on-surface points 1 14. In contrast, the regions of the device 102 in dotted lines are not in contact or close proximity to the structure 104 and represent off-surface points 1 16. A registration of these off-surface points 1 16 by known registration algorithms such as ICP would result in errors in the registered structure. More specifically, with specific reference to ICP, the ICP algorithm uses as an optimization parameter that depends on the distance between each sampled point and its corresponding closest point of the structure. Accordingly, the ICP algorithm would analyze the acquired off-surface points and compute a local minimum that is not necessarily the global minimum for the structure 104.
The system 100 obviates the requirement for the deformable registration device 102 to be held flush against the structure 104 of the subject in order to accurately register the structure 104. The system 100 includes a pre-processing module 1 12 which is configured to analyze the positional points 106 acquired by the FORS system 1 10 and determine which points are on-surface 1 14 and off-surface points 1 16. A registration module 1 18 is then configured to register the acquired points of the structure 104 factoring in whether a point is an on-surface 1 14 or off-surface point 1 16. As shown in FIG. 3, the registration module 1 18 is configured to delete the off-surface points in order to avoid the distortion that would normally occur in the registration of the off-surface points 1 16. "Deletion" of positional points by the registration module 1 18 means that the positional points are either removed or are disregarded in the registration algorithm, such as ICP.
In one embodiment, the pre-processing module includes an interpolation module 120.
The interpolation module is configured to interpolate the positional points 106 from the FORS data and generate a smooth surface fit 121 along the points. For example, FIG. 3 shows positional points 106 acquired from the FORS system which are then interpolated to provide a smooth surface fit 121 over the points.
The pre-processing module includes a computation module 122 that is configured to compute surface metrics, such as curvature, slope, shape, axial strain, etc., along the surface of the smooth surface fit 121. The deformable body 105 of the deformable registration device typically contacts regions of the structure 104 that are more curved than regions of the deformable body that are off of the surface of the structure. Furthermore, flat regions of the structure 104 that are isolated from curved regions are more likely to provide off-surface positional points of the structure 104. Additionally, the further away that the flat regions of the structure are from the curved regions, the more likely that the flat regions will provide off-surface positional points. For example, as shown in FIG. 2, the flat taut portions of the device are off-surface of the concave surfaces of the structure 104 below the deformable body 105 of the device.
In one embodiment, the computation module 122 is configured to compute the curvature along the surface of the smooth surface fit developed by the interpolation module 120. A threshold curvature level is determined in which regions with a larger curvature are likely to be on-surface points 1 14 and regions below the threshold curvature level are likely to be off-surface points 1 16. The threshold curvature level may be developed by the use of models or the analysis of sample data.
The determination module 124 is configured to analyze the curvature level or other surface metric(s) determined by the computation module 122 in comparison to the threshold curvature level and determine if the curvature is above, equal to, or below the threshold. As
shown in FIG. 3, if the curvature level for a point is below the threshold curvature level, the determination module identifies the point as an off-surface point 1 16. If the point is equal to or above the threshold, the point is determined to be an on-surface point 1 14.
In another embodiment, the system 100 may utilize contact sensing information in combination with the information provided by the determination module 124 to determine if a positional point 106 acquired by the FORS system 1 10 is an on-surface point 1 14 or off- surface point 1 16. In one embodiment, the contact sensing is performed by a contact sensing device 126. As shown in FIGS. 4-5, the contact sensing device 126 may include an optical fiber 127 of a FORS system that is in an overlapped configuration to form two parallel segments. While the optical fiber is described as forming two parallel segments, in some embodiments the optical fiber may form more than two segments and/or the fiber segments may be positioned in a non- intersecting configuration which is not strictly parallel. The contact sensing device 126 is configured to apply a pressure on the optical fiber 127 and the optical fiber is placed on the structure 104. As shown in FIG. 4, when the optical fiber 127 contacts an on-surface region 1 14 of the structure, the distance between the parallel fibers decreases due to the pressure applied on the optical fiber. Conversely, when the optical fiber is in contact with an off-surface region 1 16, the distance between the fibers remains approximately the same.
The contact sensing device 126 includes a detection device 130 that is configured to compute the distance between the segments of the optical fiber 127 when it is pressed against the structure 104. The contact sensing device 126 further includes an identification device 132 that is configured to receive the computation of the distance between segments from the detection device 130 and provide contact sensing information 128 which identifies on-surface and off-surface points. The identification device 132 is configured to identify points where
the distance between the segments remains approximately the same from the initial distance between the points as being off-surface points 1 16. The identification device 132 is configured to identify the points where the distance between the segments decrease as being on-surface points 1 14.
While the illustrative embodiment describes the system 100 as including a separate contact sensing device 126, in some embodiments the optical fiber may be configured within the deformable body 105 to enable the deformable body 105 to simultaneously perform the contact sensing function of the contact sensing device 126 and the registration function of the deformable registration device 102 within a single device.
The system 100 is configured to review the determination of on-surface points 1 14 and off-surface points 1 16 by both the determination module 124 and from the contact sensing information 128. In some embodiments, the system 100 may combine both the contact sensing information 128 and the determination from the determination module 124 using a weighted analysis or by other means known in the art.
In another embodiment, the system 100 includes a model 134 (FIG. 6) of the structure
104, such as a statistical atlas model, which is also utilized to identify positional points 142 (FIG. 1) of the structure. The system 100 includes a generation module 136 that is configured to generate a shape 137 (FIG. 8) on the model 134 which approximates points that would be acquired by the deformable registration device 102 on the structure 104 when the deformable registration device 102 is not flush against the surface of the structure 104. For example, as shown in FIGS. 6-7, the model may generate a convex hull shape 138 which approximates the position of the deformable registration device 102 if the deformable body 105 is held taut over a concave surface. Alternatively, as shown in FIG. 8, an envelope 140 with a maximum concave curvature which encloses the structure may be generated by the
generation module 136.
The pre-processing module 1 12 is configured to receive the positional points 142 (FIG. 1) obtained by the generation module 136 from the shape generated on the model 134 and determine which points are on-surface and off-surface points with respect to the structure 104.
The registration module 1 18 is configured to receive the positional points 106 acquired by the deformable registration device from FORS data and the positional points 142 acquired from the generation of a shape on the model 134 by the generation module and perform a registration to a coordinate system. In some embodiments, the registration module 1 18 is configured to solely utilize positional points from the deformable registration device or derived from the model 134 in order to perform the registration. However, in other embodiments both types of acquired positional points 106, 142 are utilized as this technique will generally increase the robustness of the registration.
For example, since the positional points 142 acquired from the model may be a convex hull 138 approximating the position of the deformable registration device 102 when it is held completely taut, the positional points obtained from the model may be used to register the model with positional points 106 obtained from the deformable registration device. This obviates the need for the deformable registration device 102 to be held completely taut when acquiring the positional points. Similarly, if the deformable registration device 102 has a maximum convex curvature that it can deform to, positional points acquired from the envelope 140 generated on the model may be used to register the model with positional points 106 obtained from the deformable registration device. The system 100 is also configured to replace positional points acquired by the model 134 with positional points 142 from the generation module 136. This allows the positional points 106 from the deformable
registration device 102 to morph a modified statistical model of the structure 104 to match the modified shape of the structure and to obtain registration therefor.
The registration module 1 18 is configured to perform registration of the positional points 106, 142 using standard registration algorithms known in the art, such as ICP. The registration module is configured to apply different weights or delete the positional points in order to avoid error in the registration. For example, as shown in FIG. 9, if a standard ICP algorithm is applied to the positional points 106, 142 from both the deformable registration device and the model without modifying the positional points, the registration shape resulting from the model and the deformable registration device may have an error, such having the positional points 106, 142 intersect with respect to each other.
In one embodiment, the registration module 1 18 is configured to perform registration using positional points 106 acquired by the deformable registration device 102 and the positional points 142 from the model. The registration module 1 18 is configured to delete or apply different weights to positional points 106 acquired from the deformable registration device 102 and the positional points 142 acquired from the model. In one embodiment, a weighted approach is applied wherein the positional points 106 from the deformable registration device 102 are weighted based on on-surfaceness and off-surfaceness confidence of the positional points 106 based on a curvature threshold. Alternatively, a weighted approach may be based upon the convexity/concavity of the model 134 or other criteria. For example, since FORS data from concave regions of the structure are likely to be off-surface and thus more erroneous, the registration module 1 18 may apply more weight to positional points acquired from convex regions and less weight to positional points acquired from concave regions of the model.
The device may further include a registration evaluation module 1 19 which is
configured to review the registration for accuracy. If the registration is not accurate, the registration evaluation module 1 19 is configured to generate a signal for the user to reposition the deformable registration device 102 and a new registration is performed by the system 100.
The system 100 may be configured in an integrated computerized and/or electronic unit wherein a registration performed by the workstation 101 is automatically triggered when the deformable body 105 is pressed against the structure 104, in response to a gesture performed by the user of the deformable registration device 102, the user pressing a button on the deformable registration device, etc.
Referring to FIG. 10, methods for registering a structure of a subject to a coordinate system using FORS data are illustratively shown in accordance with the present principles. In block 150, a deformable registration device 102 having a deformable body is placed on a structure 104 of the subject. In block 160, positional points for the structure are obtained by measuring a shape of the optical fiber 108 using a FORS system 1 10. In block 170 the positional points 106 acquired by the FORS system are analyzed and a determination concerning which positional points are on-surface 1 14 and off-surface points 1 16 with respect to the structure is made. In block 180, the off-surface 1 16 positional points are deleted and the on-surface 1 14 positional points are used in registration with the model 134.
In the embodiment shown in FIG. 1 1, the method further comprises the step in block 190 of generating a shape on a model of the structure that is configured to approximate points that would be measured by a deformable registration device of the structure if the deformable registration device was not flush against the surface of the structure. The approximated model from generation module 136 can then be used with all positional points 106 from the deformable registration device 102 to perform registration.
In block 210, the positional points 106, 142 are modified by applying different
weights or deleting at least one positional point to form a modified positional point set. For example, in one embodiment, more weight is applied to positional points from the model that are detected as on-surface points and less weight is applied to positional points that are detected as off-surface points. In block 220, the modified positional point set are registered.
As previously described with respect to the system 100, the method may further comprise the steps of interpolating the positional points from the FORS data to generate a smooth surface fit along the positional points. A surface metric, such as curvature, slope, shape, axial strain, etc., along the surface of the smooth surface fit is then computed and the positional points in which the surface metric is above a threshold level are identified as on- surface points. The positional points that are below a threshold level are identified as off- surface positional points.
In other embodiments of the method, contact sensing information, such as
information obtained by a procedure performed by the contact sensing device 126 may be used in order to determine which positional points are on-surface and off-surface points.
This method for registering a structure of a subject to a coordinate system using
FORS data allows for registration of the positional points acquired by the deformable registration device without requiring the deformable device to be flush against the structure. This provides a simpler, more efficient registration procedure for the practitioner which requires less care and skill and improves the accuracy of the registration. However, the system and method may be effectively utilized for registration of positional points acquired by a deformable registration device that is flush against the structure in accordance with the principles of this invention.
It is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in
the particular embodiments of the disclosure disclosed which are within the scope of the embodiments disclosed herein as outlined by the appended claims.
In interpreting the appended claims, it should be understood that:
a) the word "comprising" does not exclude the presence of other elements or acts than those listed in a given claim;
b) the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements;
c) any reference signs in the claims do not limit their scope;
d) several "means" may be represented by the same item or hardware or software implemented structure or function; and
e) no specific sequence of acts is intended to be required unless specifically indicated.
Having described preferred embodiments for the system and method for registering a structure using FORS data (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the disclosure disclosed which are within the scope of the embodiments disclosed herein as outlined by the appended claims. Having thus described the details and particularity required by the patent laws, what is claimed and desired protected by Letters Patent is set forth in the appended claims.
Claims
1. A system for registering a structure (104) of a subject to a coordinate system using FORS data comprising:
a deformable registration device (102) having a deformable body (105), said deformable body including an optical fiber (108) for a FORS system;
a FORS system (1 10) configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject to obtain positional points (106) for the structure;
a pre-processing module (1 12) configured to analyze the positional points acquired by the FORS system and determine which positional points are on-surface and off-surface points with respect to the structure; and
a registration module (1 18) configured to delete the off-surface positional points and perform a registration using the on-surface positional points.
2. The system as recited in claim 1, wherein the system further includes:
a model (134) of the structure of the subject; and
a generation module (136) configured to generate a shape (137) on the model of the structure, said shape configured to approximate points which would be measured by the deformable registration device of the structure.
3. The system as recited in claim 2, wherein:
the registration module (1 18) is configured to modify the positional points acquired by the deformable registration device and/or positional points acquired from the shape generated on the model by applying different weights or deleting at least one positional point
to form a modified positional point set; and
said registration module is configured to register the modified positional point set.
4. The system as recited in claim 2, wherein the shape (137) generated by the generation module comprises a convex hull or envelope.
5. The system as recited in claim 3, wherein the registration module (1 18) is configured to provide more weight to positional points from the deformable registration device that are on the surface of the structure and less weight to positional points that are off the surface of the structure.
6. The system as recited in claim 3, wherein the registration module (1 18) is configured to provide more weight to positional points from convex regions of the model and less weight to positional points from concave regions of the model.
7. The system as recited in claim 1 wherein the pre-processing module (1 12) further includes:
an interpolation module (120) configured to interpolate the positional points from the FORS data to generate a smooth surface fit along the positional points;
a computation module (122) configured to compute a surface metric along the surface of the smooth surface fit; and
a determination module (124) configured to identify positional points in which the surface metric is above a threshold level as being on-surface points and positional points that are below a threshold level as being off-surface positional points;
8. The system as recited in claim 1, wherein the pre-processing module (1 12) further utilizes contact sensing information (128) in order to determine which positional points are on-surface and off-surface.
9. The system as recited in claim 1, wherein the system further includes a contact sensing device (126), comprising:
an optical fiber (127) configured to form a plurality of non-intersecting segments; a detection device (130) configured to compute an initial distance between the segments and a distance between the segments when they are pressed against the structure; and
an identification device (132) configured to identify positional points where the distance between the segments remains approximately the same as the initial distance as being off-surface positional points and positional points where the distance decreases as being on-surface positional points.
10. A system for registering a structure of a subject to a coordinate system using FORS data, comprising:
a deformable registration device (102) having a deformable body (105), said deformable body including an optical fiber (108) for a FORS system;
a FORS system (129) configured to measure a shape of the optical fiber when the deformable body contacts the structure of the subject and obtain positional points (106) for the structure;
a workstation (101) including:
one or more processors (107), memory (109) and an interface (123);
a pre-processing module (1 12) configured to analyze the positional points acquired by the FORS system and determine which positional points are on-surface and off- surface points with respect to the structure; and
a registration module (1 18) configured to delete the off-surface positional points and perform a registration using the on-surface positional points.
1 1. The system as recited in claim 10, wherein the system further includes:
a model (134) of the structure of the subject stored in the memory; and
a generation module (136) configured to generate a shape (137) on the model of the structure, said shape configured to approximate points which would be measured by a deformable registration device of the structure of the subject.
12. The system as recited in claim 1 1, wherein:
the registration module (1 18) is configured to modify the positional points acquired by the deformable registration device and/or positional points acquired from the shape generated on the model by applying different weights or deleting at least one positional point to form a modified positional point set; and
said registration module is configured to register the modified positional point set.
13. The system as recited in claim 12, wherein the registration module (1 18) is configured to provide more weight to positional points from the deformable registration device that are on the surface of the structure and less weight to positional points that are off the surface of the structure.
14. The system as recited in claim 10, wherein the pre-processing module (1 12) further includes:
an interpolation module configured to interpolate the positional points from the FORS data to generate a smooth surface fit along the positional points;
a computation module configured to compute a surface metric along the surface of the smooth surface fit; and
a determination module configured to identify positional points in which the surface metric is above a threshold level as being on-surface points and positional points that are below a threshold level as being off-surface positional points;
15. A method for registering a structure of a subject to a coordinate system using FORS data comprising the steps of:
placing (150) a deformable registration device having a deformable body on a structure of the subject;
obtaining (160) positional points for the structure by measuring a shape of an optical fiber positioned within the deformable registration device using a FORS system;
analyzing (170) the positional points acquired by the FORS system and determining which positional points are on-surface and off-surface points with respect to the structure; and
deleting (180) the off-surface positional points and registering the on-surface positional points.
16. The method as recited in claim 15, further comprising the step of generating
(190) a shape on a model of the structure which is configured to approximate points which would be measured by a deformable registration device of the structure.
17. The method as recited in claim 15, further comprising the steps of:
modifying (210) the positional points acquired by the deformable registration device and/or positional points acquired from the shape generated on the model by applying different weights or deleting at least one positional point to form a modified positional point set; and registering (220) the modified positional point set.
18. The method as recited in claim 17, wherein the modifying step comprises applying more weight to positional points from the registration device that are on the surface of the structure and less weight to positional points that are off the surface of the structure.
19. The method as recited in claim 15, further comprising the steps of:
interpolating the positional points from the FORS data to generate a smooth surface fit along the positional points;
computing a surface metric along the surface of the smooth surface fit; and identifying positional points in which the surface metric is above a threshold level as on-surface points and positional points that are below a threshold level as off-surface positional points;
20. The method as recited in claim 15, comprising the further step of utilizing contact sensing information in order to determine which positional points are on-surface and off-surface.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562184439P | 2015-06-25 | 2015-06-25 | |
US62/184,439 | 2015-06-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016207163A1 true WO2016207163A1 (en) | 2016-12-29 |
Family
ID=56296777
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2016/064316 WO2016207163A1 (en) | 2015-06-25 | 2016-06-21 | System and method for registering a structure using fiber-optical realshape data |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2016207163A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113660912A (en) * | 2019-04-10 | 2021-11-16 | 博医来股份公司 | Method for sampling relevant surface points of a subject |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013030764A1 (en) * | 2011-09-02 | 2013-03-07 | Koninklijke Philips Electronics N.V. | Rapid dense point cloud imaging using probabilistic voxel maps |
WO2014167511A1 (en) * | 2013-04-12 | 2014-10-16 | Koninklijke Philips N.V. | Shape sensed ultrasound probe for fractional flow reserve simulation |
WO2015089013A1 (en) * | 2013-12-09 | 2015-06-18 | Intuitive Surgical Operations, Inc. | Systems and methods for device-aware flexible tool registration |
-
2016
- 2016-06-21 WO PCT/EP2016/064316 patent/WO2016207163A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013030764A1 (en) * | 2011-09-02 | 2013-03-07 | Koninklijke Philips Electronics N.V. | Rapid dense point cloud imaging using probabilistic voxel maps |
WO2014167511A1 (en) * | 2013-04-12 | 2014-10-16 | Koninklijke Philips N.V. | Shape sensed ultrasound probe for fractional flow reserve simulation |
WO2015089013A1 (en) * | 2013-12-09 | 2015-06-18 | Intuitive Surgical Operations, Inc. | Systems and methods for device-aware flexible tool registration |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113660912A (en) * | 2019-04-10 | 2021-11-16 | 博医来股份公司 | Method for sampling relevant surface points of a subject |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6246213B2 (en) | Alignment system, method and computer program | |
US9607381B2 (en) | Accurate and rapid mapping of points from ultrasound images to tracking systems | |
US11191593B2 (en) | Triggering with optical shape sensing fiber | |
US11547489B2 (en) | Shape sensing of multiple over-the-wire devices | |
EP2846691B1 (en) | System and method for stabilizing optical shape sensing | |
EP2830502B1 (en) | Artifact removal using shape sensing | |
CN105792768B (en) | It is tracked using the equipment longitudinally encoded | |
JP6195795B2 (en) | Storage and retrieval of information unique to shape detection devices | |
JP2014517701A (en) | Template for optical shape detection calibration during clinical use | |
US10267624B2 (en) | System and method for reconstructing a trajectory of an optical fiber | |
WO2015044930A1 (en) | Device specific outlier rejection for stable optical shape sensing | |
EP3547946A1 (en) | Systems and methods for determining the length of a non-shape-sensed interventional device with a shape-sensed guidewire and determining a state of the guidewire with respect to an interventional device | |
EP2879586B1 (en) | Quantifying probe deflection for improved catheter identification | |
WO2016207163A1 (en) | System and method for registering a structure using fiber-optical realshape data | |
US11344222B2 (en) | Systems and methods for determining the position of a non-shape-sensed guidewire with a shape-sensed catheter and for visualizing the guidewire | |
EP3975859B1 (en) | Relative location determining for passive ultrasound sensors | |
EP3771432A1 (en) | Relative location determining for passive ultrasound sensors | |
WO2015092590A1 (en) | System and method for determining the entry point to the body using optical shape sensing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16733906 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16733906 Country of ref document: EP Kind code of ref document: A1 |