US20180360655A1

US20180360655A1 - Methods and systems for oct guided glaucoma surgery

Info

Publication number: US20180360655A1
Application number: US15/868,904
Authority: US
Inventors: Michael S. Berlin
Original assignee: Individual
Current assignee: Individual
Priority date: 2017-06-16
Filing date: 2018-01-11
Publication date: 2018-12-20
Also published as: KR102556071B1; KR20200138443A; US20200281766A1; CA3067561A1; KR20200023385A; CN110996760B; EP3638096A4; CN115191929A; CN110996760A; WO2018232397A1; AU2018285917A1; US10517760B2; KR20230109792A; EP3638096A1; AU2020203628A1; JP7297849B2; US11918515B2; JP6975524B2; JP6751487B2; JP2020524061A

Abstract

Disclosed herein is a system for aiding a physician to perform a surgical procedure on an eye. The operation procedure comprises inserting an elongate probe from an opening into the eye across an anterior chamber to a target tissue region comprising a trabecular meshwork and a Schlemm's canal. The system comprises: an optical microscope for the surgeon to view the eye with a microscope image during the procedure; an optical coherence tomography (OCT) apparatus configured to perform an OCT scans of one or more target locations in the target tissue region during the procedure; and an image processing apparatus configured to generate a plurality of augmented images by overlaying (1) one or more OCT images of the one or more target locations and (2) a plurality of graphical visual elements identifying the one or more target locations, wherein the plurality of graphical visual elements is registered with the microscope image to aid the physician in advancing a distal end of the elongate probe to the one or more target locations.

Description

CROSS-REFERENCE

This application claims the benefit of provisional patent application U.S. Prov. Ser. App. No. 62/521,310 (Attorney Docket No. 35730-705.101), filed Jun. 16, 2017, entitled “Methods and Systems for OCT Guided Glaucoma Surgery”, which is incorporated herein by reference in its entirety.

BACKGROUND

Glaucoma is a disease of the eye in which intraocular structures critical to vision is irreversibly damaged. These structures include portions of the retina and especially portions of the optic nerve. Glaucoma, a treatable condition, is cited as the second leading cause of blindness in the United States. Several million people are affected. There are two major types of glaucoma, open angle glaucoma, and closed angle glaucoma. Open angle glaucoma, the most common type of glaucoma, occurs when the normal appearing outflow pathways malfunction such that the eye does not adequately drain fluid which results in an intraocular elevation of pressure. Elevated intraocular pressure (TOP) in most open-angle glaucoma is due to an obstruction of aqueous outflow localized predominantly at the juxtacanalicular trabecular meshwork (TM) and the inner wall of Schlemm's canal (SC).
Treatments for elevated IOP due to outflow obstruction include topical and systemic medications, office-based laser procedures, and risk inherent invasive surgical procedures (trabeculectomy/tube shunt). Examples of laser procedures include argon laser trabeculoplasty (ALT) and selective laser trabeculoplasty (SLT). More recently less invasive surgical procedures have been introduced into the treatment paradigms, commonly termed minimally invasive glaucoma surgery (MIGS), or micro-invasive glaucoma surgical procedures. Current approaches of IOP reduction by MIGS include increasing trabecular outflow by bypassing the juxtacanalicular trabecular meshwork (TM) and inner wall of SC, increasing uveoscleral outflow via suprachoroidal pathways, reducing aqueous production from the ciliary body, or creating an external, subconjunctival/suprascleral drainage pathway.
The general concept of MIGS is typically to bypass outflow obstruction and enable resumption of flow via the eye's intrinsic outflow system which is often intact and functional beyond the region of outflow obstruction, rather than creating alternative pathways which may have significantly greater short and/or long term risks.
MIGS procedures often involve visualization and access to the intraocular outflow system. Due to the shape of the cornea and the location of intraocular structures related to MIGS procedures in the region where the iris appears to meet the peripheral cornea, total internal reflection occurs and can prevent a surgeon from viewing those outflow structures that reside beyond the “critical angle” of the optical pathway. As such, devices to allow visualization of those outflow structures are often necessary for a surgeon to perform MIGS procedures. Goniolenses, both direct (allowing a straight optical pathway for viewing those structures) and indirect (using mirrors to view those structures) function by overcoming total internal reflection. However, intraoperative use of goniolenses can require significant dexterity and a steep learning curve, which may limit successful MIGS procedures to certain skilled surgeons in at least some instances.
In at least some of these surgical procedures, a surgical opening is created through the trabecular meshwork and the inner wall of Schlemm's canal to enable improved fluidic access into Schlemm's canal in order to reduce intra ocular pressure. Prior approaches to accurately target Schlemm's canal are often less than ideal. Thus, it would be beneficial to provide methods and apparatuses that provide improved consistency and accuracy in targeting Schlemm's canal and other structures of the eye. Also, work in relation to the present disclosure suggests that at least some of the prior approaches may result in openings into Schlemm's canal at less than ideal locations, for example at locations which are far away from collector channels. Alternative MIGS devices which bypass Schlemm's canal and drain aqueous fluid into the suprachoroidal space can also benefit from targeted location placement by improving visualization of adjacent ocular structures. Examples of such implant devices include the intracanalicular iStent®, and iStent inject and the suprachoroidal CyPass® microstent. Excimer laser trabeculostomy (ELT) which creates patent channel openings into Schlemm's canal can also benefit from improved targeting and visualization of structures in the eye.
Current methods and apparatus for viewing structures of the eye near the iridio-corneal angle, such as the trabecular meshwork and scleral spur, can be less than ideal in at least some instances. For example, a goniolens can be somewhat more difficult to use than would be ideal, and it would be beneficial to provide improved methods an apparatus for viewing the structures of the eye near the iridio-corneal angle during surgery in this region.
In light of the above, it would be helpful to have improved methods and apparatus for imaging the eye during surgical procedures, targeting outflow structures of the eye such as Schlemm's canal, and determining target locations for openings through the trabecular meshwork and into Schlemm's canal to improve flow.

SUMMARY

The methods and apparatus disclosed herein allow glaucoma surgery of the outflow structures, including MIGS and many varieties thereof, to be performed without a goniolenses. According to an aspect of the invention, an ophthalmic surgeon can identify these outflow structures and operate on these structures through virtual images and representations of the structures and the surgical tools generated using optical coherence tomography (OCT) scanning.
In one aspect, a system for aiding a physician to perform a surgical procedure on an eye is provided. The operation procedure comprises inserting an elongate probe from an opening into the eye across an anterior chamber to a target tissue region comprising a trabecular meshwork and a Schlemm's canal. The system comprises: an optical microscope for the surgeon to view the eye with a microscope image during the procedure; one or more optical coherence tomography (OCT) apparatus configured to perform OCT scans of one or more target locations in the target tissue region in real time during the procedure; and an image processing apparatus configured to generate a plurality of augmented images (real and virtual) by enabling viewing of and in some cases overlaying (1) one or more OCT images of the one or more target locations and/or (2) a plurality of graphical visual elements identifying the one or more target locations, wherein the plurality of graphical visual elements is registered with the real microscope image to aid the physician in advancing a distal end of the elongate probe to the one or more target locations.

INCORPORATION BY REFERENCE

All publications, patents, and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent, or patent application was specifically and individually indicated to be incorporated by reference.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.

The novel features of the invention are set forth with particularity in the appended claims. A better understanding of the features and advantages of the provided system and methods will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which:

FIG. 1 is schematic sectional view of an eye illustrating anatomical structures;

FIG. 2 is a perspective fragmentary view of the anatomy adjacent to the anterior chamber of an eye depicting the corneo-scleral angle and flow of aqueous fluid;

FIG. 3 is schematic sectional view of an eye illustrating a fiber-optic probe crossing the anterior chamber from a corneal limbal paracentesis site toward the trabecular meshwork in the anterior chamber of the eye;

FIG. 4 and FIG. 5 schematically illustrate a system for aiding a physician to perform a surgical procedure on an eye, in accordance with embodiments of the invention;

FIG. 6 illustrates both real images of the eye and fiber and an exemplary augmented (virtual) image and augmented (virtual) view;

FIGS. 7A-7F shows exemplary real and augmented/virtual images as viewed by a surgeon or user during a procedure;

FIG. 8 shows an exemplary system based on fiberoptic-based OCT, in accordance with embodiments of the invention;

FIG. 9 shows exemplary augmented (virtual) images and augmented (virtual) view obtained using the system in FIG. 8;

FIG. 10 shows an exemplary system based on microscope-based OCT, in accordance with embodiments of the invention;

FIG. 11 schematically illustrates an example of the OCT guidance system 1100, in accordance with embodiments of the invention;

FIGS. 12A-D show examples of instruments that can be used in combination with the provided system;

FIG. 13 shows a flowchart of a method for determining a target location and probe location, in accordance with embodiments;

FIG. 14 shows an analyzing and control system that can be configured to implement any analyzing and control systems disclosed in the present application; and

FIG. 15 shows examples of pre-operative OCT images, and augmented pre-operative OCT images showing collector channels and target locations.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description, reference is made to the accompanying figures, which form a part hereof. In the figures, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, figures, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the scope of the subject matter presented herein. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the figures, can be arranged, substituted, combined, separated, and designed in a wide variety of different configurations, all of which are explicitly contemplated herein.
The methods and apparatuses are well suited for combination with multiple alternative MIGS approaches to treating glaucoma, such as iStent®, iStent Inject, Cypass®, and others, for example. Although reference is made to treatment without a goniolens in some embodiments, the methods and apparatus disclosed herein are also well suited for combination uses with goniolenses.
Methods and systems disclosed herein can allow a larger cohort of ophthalmic surgeons to successfully perform MIGS procedures. For example, the disclosed methods and apparatus can allow for surgeries to more uniformly and consistently create openings to enable improved outflow of aqueous fluid from the eye's anterior chamber into Schlemm's canal, for example. In addition, the disclosed system and methods can lead to improved surgical outcomes, by allowing surgeons to identify target locations for openings into Schlemm's canal intended to increase outflow. The presently disclosed methods and apparatus may include the combination of a surgical microscope image with sensing devices which enable real-time heads-up display images to be concurrently viewed by the surgeon. These real-time images can allow the surgeon to target and treat locations within an eye which may not be readily visualized using the operating microscope alone, such as structures including the trabecular meshwork and Schlemm's canal. The methods and apparatus disclosed herein can allow a surgeon to view angle structures that are obscured or block by total internal reflection. For example, the disclosed methods and apparatus can allow images or information of those otherwise poorly visible or non-visible structures, such as the collector channel system, to be collected using OCT optical coherence tomography (OCT) technologies. A surgeon can concurrently view a real image of the eye with an overlying projected image of ocular structures by the placement of an image of those structures, such as the collector channel system via, for example, an OCT image of the collector channel system obtained earlier which is registered to visible markers, to enable the surgeon to identify and target preferred surgical sites. In this manner, the images viewed by the surgeon include real (optical) and projected (virtual) images combined to enhance surgical targeting. Additional information can also be provided to the surgeon/viewer, such as virtual images of otherwise non-visible structures and one or more symbols to indicate both distances and movement, such as from a probe tip to trabecular meshwork to Schlemm's canal. In some embodiments, OCT imaging can be used to identify collector channels of the eye, and enable the surgeon to identify sites by these target locations displayed to the user to assist in the creation of openings at appropriate locations in eye's trabecular meshwork to increase flow. Such displays can be coupled to the operating microscope in order to present monocular or binocular virtual images from a display which is visually combined with binocular real optical images of the eye, for example. The methods and apparatus disclosed herein are well suited for utilization with ELT surgery and with implant device surgeries which provide openings to drain fluid from the eye. However, the provided system and methods can also be applied to various other surgical procedures where fiberoptic-based OCT may be utilized, e.g. any and all surgeries using an endoscope.
Although specific reference is made to the treatment of glaucoma using excimer laser trabeculostomy (ELT), the methods and systems disclosed herein can be used with many other types of surgeries. For example, the embodiments disclosed herein can be used with other surgical procedures, including endoscopic procedures relating to orthopedic, neurosurgical, neurologic, ear nose and throat (ENT), abdominal, thoracic, cardiovascular, endocardiac, etc. The presently disclosed methods and apparatus can utilize OCT to improve targeting accuracy and provide virtual visualization for enabling surgeons to perform procedures in regions that may not be readily visualized either microscopically or endoscopically. Such applications include any endoscopic procedure in which virtual visualization is augmented to real images to assist surgical accuracy in 3-dimensional space, one example of which is an endovascular procedure in which the vessel curves or bends. Certain aspects may also be used to treat and modify other organs such as brain, heart, lungs, intestines, skin, kidney, liver, pancreas, stomach, uterus, ovaries, testicles, bladder, ear, nose, mouth, soft tissues such as bone marrow, adipose tissue, muscle, glandular and mucosal tissue, spinal and nerve tissue, cartilage, hard biological tissues such as teeth, bone, as well as body lumens and passages such as the sinuses, ureter, colon, esophagus, lung passages, blood vessels, and throat. For example, the devices disclosed herein may be inserted through an existing body lumen, or inserted through an opening created in body tissue.
Devices for performing glaucoma surgery are described in U.S. Pat. No. 4,846,172 and U.S. patent application Ser. No. 09/860,842, the entire contents of which are herein incorporated by reference.
In order to appreciate the described embodiments, a brief overview of the anatomy of the eye is provided. As schematically shown in FIG. 1, the outer layer of the eye includes a sclera 17. The cornea 15 is a transparent tissue which enables light to enter the eye. An anterior chamber 7 is located between the cornea 15 and an iris 19. The anterior chamber 7 contains a constantly flowing clear fluid called aqueous humor 1. The crystalline lens 4 is supported and moved within the eye by fiber zonules, which are connected to the ciliary body 20. The iris 19 attached circumferentially to the scleral spur includes a central pupil 5. The diameter of the pupil 5 controls the amount of light passing through the lens 4 to the retina 8. A posterior chamber 2 is located between the iris 19 and the ciliary body 20.
As shown in FIG. 2, the anatomy of the eye further includes a trabecular meshwork (TM) 9, a triangular band of spongy tissue within the eye that lies anterior to the iris 19 insertion to the scleral spur. The mobile trabecular meshwork varies in shape and is microscopic in size. It is generally triangular in cross-section, varying in thickness from about 100-200 μm. It is made up of different fibrous layers having micron-sized pores forming fluid pathways for the egress of aqueous humor from the anterior chamber. The trabecular meshwork 9 has been measured to about a thickness of about 100 μm at its anterior edge, Schwalbe's line 18, at the approximate juncture of the cornea 15 and sclera 17.
The trabecular meshwork widens to about 200 μm at its base where it and iris 19 attach to the scleral spur. The passageways through the pores in trabecular meshwork 9 lead through a very thin, porous tissue called the juxtacanalicular trabecular meshwork 13, which in turn abuts the interior wall of a vascular structure, Schlemm's canal 11. Schlemm's canal (SC) 11 is filled with a mixture of aqueous humor and blood components, and connects to a series of collector channels (CCs) 12 that drain the aqueous humor into the venous system. Because aqueous humor 1 is constantly produced by the ciliary body, and flows through the pupil into the anterior chamber from which it passes through pores in the TM and JCTM into the SC and aqueous veins, any obstruction in the trabecular meshwork, the juxtacanalicular trabecular meshwork, or Schlemm's canal, prevents the aqueous humor from readily escaping from the anterior eye chamber. As the eye is essentially a closed globe, this results in an elevation of intraocular pressure within the eye. Increased intraocular pressure can lead to damage of the retina and optic nerve, and thereby cause eventual blindness.
The obstruction of the aqueous humor outflow, which occurs in most open angle glaucoma (i.e., glaucoma characterized by gonioscopically readily visible trabecular meshwork), is typically localized to the region of the juxtacanalicular trabecular meshwork (JCTM) 13, located between the trabecular meshwork 9 and Schlemm's canal 11, and, more specifically, the inner wall of Schlemm's canal.
When an obstruction develops, for example, at the juxtacanalicular trabecular meshwork 13, intraocular pressure gradually increases over time. Therefore, a goal of current glaucoma treatment methods is to prevent optic nerve damage by lowering or delaying the progressive elevation of intraocular pressure. Many have searched for an effective method of lowering and controlling intraocular pressure. In general, various pharmaceutical treatments have been employed to control intraocular pressure. While these treatments can be effective for a period of time, the intraocular pressure often continues to increase in many patients. However, patients often fail to follow prescribed treatment regimens. As a result, inadequately controlled glaucoma leads to an increased risk of irreversible damage to the optic nerve, and ultimately, vision loss.
FIG. 3 is a side sectional view of the interior anatomy of a human eye showing fiber-optic probe 23 in relation to an embodiment of a method of treating glaucoma. After applying topical, peribulbar and/or retrobular anesthesia, a small self-sealing paracentesis incision 14 is created in the cornea 15. The anterior chamber is stabilized with either a chamber maintainer using liquid flows or a viscoelastic agent. Fiber-optic probe 23 can then be positioned and advanced through the incision 14 into the anterior chamber 7 until a distal end of the fiber-optic probe 23 contacts and slightly compresses the desired target TM tissues.
Photoablative laser energy produced by laser unit 31 (shown in FIG. 4) is delivered from the distal end of fiber-optic probe 23 in contact to the tissue to be ablated. The tissue to be ablated may include the trabecular meshwork 9, the juxtacanalicular trabecular meshwork 13 and an inner wall of Schlemm's canal 11. An aperture in the proximal inner wall of Schlemm's canal 11 is created in a manner which does not perforate the distal outer wall of Schlemm's canal. In some embodiments, additional apertures are created in the target tissues. Thus, the resultant aperture or apertures are effective to restore relatively normal rates of drainage of aqueous humor.
The fiber-optic probe 23 may comprise an optical fiber or a plurality of optical fibers encapsulated by an encapsulating sheath. The diameter of a single optical fiber should be sufficiently large to transmit sufficient light energy to effectively result in photoablation of target tissues and in some embodiments to enable OCT imaging of the target tissues. In some embodiments, the optical fiber diameter is in a range from about 4-6 μm. A single optical fiber or a plurality of optical fibers can be used in a bundle of a diameter ranging from about 100 μm to about 1000 μm, for example. Core and sheaths can be encased within an outer metal sleeve, or shield. In some embodiments the sleeve is fashioned from stainless steel. In some embodiments, the outer diameter of sleeve is less than about 100 μm. In some embodiments, the diameter can be as small as 100 μm, as where smaller optical fibers are implemented with laser delivery system. In some cases, the optical fiber may have a diameter of about 200 μm and the fiber-optic probe 23 may have a greater diameter such as 500 μm to encapsulate one or more optical fibers. In some embodiments, the sleeve can be flexible so that it can be bent or angled.
FIG. 4 and FIG. 5 schematically illustrate a system 400 for aiding a physician to perform a surgical procedure on an eye, in accordance with embodiments of the invention. The surgical operation procedure may comprise inserting an elongate probe 23 from an opening into the eye across an anterior chamber to a target tissue region comprising a trabecular meshwork and a Schlemm's canal. In some embodiments, the system 400 may comprise an optical microscope 409 for the surgeon to view the eye during the procedure in real-time. Integrated within the optical microscope 409 may be an optical coherence tomography (OCT) apparatus. The microscope may comprise a surgical operating microscope, for example. The system 400 may comprise an OCT unit 401 configured to perform an OCT scan of one or more target locations in the target tissue region during the procedure. The OCT unit 401 as described herein may comprise microscope OCT 403 or Fiber OCT 402, and combinations thereof, for example. Images captured by the OCT unit 403 or 402 may be processed by an image processing apparatus of the controlling unit 410 to generate a plurality of augmented images visualized by the physician in real time. The augmented images can be shown on a display of the heads up display 407, and combined with optical images from the microscope with an internal beam splitter to form monocular or binocular images as is known to one of ordinary skill in the art. The augmented images may be presented to the physician through an eyepiece (or eyepieces) or oculars of the microscope and/or a display of the microscope, and in some configurations may be viewed on a monitor screen.
This may be beneficial to allow a surgeon to maintain a stereoscopic view of an operative site through the oculars of the microscope while simultaneously viewing superimposed or adjacent images or information concurrently either stereoscopically or monocularly, for example. OCT scanned real time images, thereby enabling the creation of 3D OCT images and/or OCT-based real time information can be superimposed to the live view of one or both oculars. In some embodiments, the system and method provides a real-time view including real and virtual images from both outside and inside of the anterior chamber during these surgeries.
The optical microscope 409 may be optically coupled with an OCT unit 401. The optical microscope 409 may comprise a binocular microscope such as a stereo-microscope comprising imaging lens elements to image an object onto an eyepiece(s) or ocular 408 and concurrently to a camera 405. The camera 405 is configured to capture optical images 505 of the eye. The optical images 505 may be transmitted to the controlling unit 410 for processing. The camera 405 may comprise optical elements (e.g., lens, mirrors, filters, etc). The camera may capture color images, greyscale image and the like.
The optical images 505 may be acquired at an appropriate image frame resolution. The image frame resolution may be defined by the number of pixels in a frame. The image resolution can be smaller than or equal to about 160×120 pixels, 320×240 pixels, 420×352 pixels, 480×320 pixels, 720×480 pixels, 1280×720 pixels, 1440×1080 pixels, 1920×1080 pixels, 2048×1080 pixels, 3840×2160 pixels, 4096×2160 pixels, 7680×4320 pixels, 15360×8640 pixels or greater pixel frame, or within a range defined by any two combinations of the preceding pixel ranges. The imaging device or camera may have pixel size smaller than 1 micron, 2 microns, 3 microns, 5 microns, 10 microns, 20 microns and the like. The camera 405 may be, for example, a 4K or higher resolution color camera.
The captured optical images 505 may be a sequence of image frames captured at a specific capture rate. In some embodiments, the sequence of images may be captured at standard video frame rates such as about 24 p, 25 p, 30 p, 48 p, 50 p, 60 p, 72 p, 90 p, 100 p, 120 p, 300 p or higher, 50 i or 60 i. In some embodiments, the sequence of images may be captured at a rate less than or equal to about one image every 0.0001 seconds, 0.0002 seconds, 0.0005 seconds, 0.001 seconds, 0.002 seconds, 0.005 seconds, 0.01 seconds, 0.02 seconds, 0.05 seconds. 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds. In some cases, the capture rate may change depending on user input and/or external conditions under the guidance of the control unit 410 (e.g. illumination brightness).
The optical images 505 may be captured in real time, such that images are produced with reduced latency, that is, with negligible delay between the acquisition of data and the rendering of the image. Real time imaging allows a surgeon the perception of smooth motion flow that is consistent with the surgeon's tactile movement of the surgical instruments (e.g. the elongate probe and the probe tip) during surgery. Real time imaging may include producing images at rates faster than 30 frames per second (fps) to mimic natural vision with continuity of motion, and at twice that rate to avoid flicker (perception of variation in intensity). In many embodiments, the latency may comprises a time interval from light from the OCT system illuminating the eye until information is shown to the user, and can no more than about 100 ms, for example. In many instances, the latency comprises no more than one or two frames of the image shown on the display. For embodiments comprising A-scan imaging from the distal end of the probe inserted into the eye, the latency can be less than an image frame rate, for example no more than about 10 ms.
In some embodiments, the optical microscope 409 may be coupled to an electronic display device 407. The electronic display 407 may be a heads up display device (HUD). The HUD may or may not be a component of the microscope system 409. The HUD may be optically coupled into the field-of-view (FOV) of one or both of the oculars. The display device may be configured to project augmented images 507 generated by the controlling unit 410 to a user or surgeon. The display device may be coupled to the microscope via one or more optical elements such as beam-splitter or semi-reflection mirror 420 such that a physician looking into the eyepieces 408 can perceive in addition to the real image augmented images represented and presented by the display device 407. The display device may be visible through a single ocular to the surgeon or user. Alternatively, the HUD may be visible through both eyepieces 408 and visible to the surgeon as a binocular image combined with the optical image formed with components of the microscope, for example.
The display device or heads up display 407 is in communication with the controlling unit 410. The display device may project augmented images produced by the controlling unit 410 in real-time to a user. As described herein, real time imaging may comprise capturing the images with no substantial latency, and allows a surgeon the perception of smooth motion flow that is consistent with the surgeon's tactile movement of the surgical instruments during surgery. In some cases, the display device 407 may receive one or more control signals from the controlling unit for adjusting one or more parameters of the display such as brightness, magnification, alignment and the like. The image viewed by a surgeon or user through the oculars or eyepieces 408 may be a direct optical view of the eye, images displayed on the display 407 or a combination of both. Therefore, adjusting a brightness of the images on the HUD may affect the view of the surgeon through the oculars. For instance, processed information and markers shown on the display 407 can be balanced with the microscope view of the object.
The heads up display 407 may be, for example, a liquid crystal display (LCD), a LED display, an organic light emitting diode (OLED), a scanning laser display , a CRT, or the like as is known to one of ordinary skill in the art.
In some embodiments, the HUD 407 may comprise an external display. For example, the HUD may not be perceivable through the oculars in some embodiments. The HUD may be located in close proximity to the optical microscope. The HUD may comprise a display screen, for example. The HUD may comprise a light-emitting diode (LED) screen, OLED screen, liquid crystal display (LCD) screen, plasma screen, or any other type of screen. The display device 407 may or may not be a touchscreen. A surgeon may view real-time optical images of the surgical site and depth information provided by OCTs simultaneously from the HUD.
The OCT unit 401 may be coupled to the optical microscope 409. The OCT unit 401 may comprise a microscope OCT unit 403, a fiberoptic-based OCT unit 402 or a combination of both. The OCT unit 401 can comprise swept source OCT (SS-OCT), spectral domain OCT (SD-OCT), Fourier domain OCT (FD-OCT), or time domain OCT (TD-OCT), as known for OCT systems in the art. The OCT system may comprise a suitable resolution for viewing tissue structures of the eye such as Schlemm's canal and/or collector channels and may comprise a resolution within a range from less than 1 to 10 microns, for example within a range from about 3 to 6 microns, for example. The OCT unit 401 may comprise a low-coherence light source suitable for producing OCT image information and interferometric information. The OCT unit 401 may produce OCT images with depth information and transmit the OCT images to the controlling unit 410. The OCT unit may be at least partially controlled by the controlling unit. Control of the OCT unit by the controlling unit may include, for example, activation of an OCT scan, parameters set-up, or customizable control parameters.
The OCT unit may comprise a microscope OCT unit 403. The microscope OCT unit 403 may comprise a component of the optical microscope 409 or share components with the optical microscope. In some cases, the microscope OCT unit 403 may comprise a stand-alone OCT unit adapted for such use. The microscope OCT unit may be positioned at a distance from the eye without contacting the eye. The microscope OCT unit may be operably coupled to the optical microscope. The microscope OCT unit may utilize one or more optical elements of the optical microscope such as the objective lens. The microscope OCT unit 403 may be compatible with the optical microscope system 409. For instance, the microscope OCT unit 403 may be configured to allow for real-time adjustment of the OCT focal plane to maintain parfocality with the microscope view. In another instance, the microscope OCT unit 403 may be capable of adapting to changes in the optical power of one or more optical elements of the optical microscope, such as the magnification of lenses such as the objective lens or other lenses of the microscope. Microscope OCT unit 403 may be configured to acquire OCT images using an engine (e.g., SDOCT engine) with a light source (e.g., NIR light source) and a detector (e.g., line-scan CCD). Depending on the different types of OCT, different spectrometers such as CCD or photodiode array detector may be used. The microscope OCT unit 403 may be configured to produce OCT images as an A-scan, B-scan or C-scan depending on the scanning principles. For instance, by performing a fast Fourier transform (FFT), an axial scan (i.e., A-scan) as a function of depth can be reconstructed. By moving a mirror in x direction, a succession of A-scan lines is created, which can be stacked together to create a B-scan image or two-dimensional image. By moving the mirror in both x-y directions, a full three-dimensional volume image or C-scan image (3D) can be generated. The mirror can be coupled to any suitable actuator known to one of ordinary skill in the art, such as a galvanometer, a translation stage, a MEMs actuator or a piezoelectric crystal, for example. In some embodiments, the microscope OCT unit 403 may be activated to acquire B mode images to provide information about a position of a probe relative to a target location along the anterior and posterior plane of the eye. In some cases, the microscope OCT unit 403 may perform C-scan to generate three-dimensional image of the target tissue region.
The OCT unit may comprise a fiberoptic-based OCT unit 402. The fiberoptic-based OCT unit 402 may comprise an optical fiber or an array of optical fibers to direct laser light pulses internal to the eye structure and to capture images of the internal eye structures. The optical fiber can be inserted within the eye and in contact with tissue inside the eye. In some embodiments, the optical fiber can be the same fiber used in the fiber optical probe 23 to transmit laser light. Alternatively, the optical fiber may be a separate fiber such as a standard single mode or multi-mode optical fiber. The separate fiber may be housed in the same fiber optic probe 23. For instance, the optical fiber may be encapsulated in an encapsulating sheath of the probe 23 that the encapsulating sheath is configured to stiffen the single optical fiber. This enables precise identification of a position of the tip of the probe 23 relative to Schlemm's canal, TM and the other target tissues. In some embodiments, a separate optical fiber for returning the back-scattered signal to the corresponding detector may be employed. A dichroic mirror 32 may be used to deflect the back-scattered signal to the detector. In some embodiments, the optical fiber of the OCT unit and the fiber-optic probe may be coaxial functioning as a coaxial endoscope for identifying a position of the distal end of the probe relative to target tissues. Alternatively, the optical fiber may be non-coaxial with the fiber-optic probe.
The fiberoptic-based OCT unit 402 may be configured to generate axial scan images (A-Scan image). This may be beneficial to provide real time information about the relative position of the distal end of the probe with respect to the target site. The A-scan images may be acquired at a high frequency such as in a range of 10 Hz to 5 kHz. The A-scan images may be processed by the controlling unit 410 to generate an image comprising a plurality of position or distance markers corresponding to a plurality of positions of target tissues and the probe tip. In some cases, a plurality of A-scan images may be averaged to generate an image for improved accuracy. The image from the A-scan(s) may be superimposed to the optical image to provide position information of the fiber optical tip relative to target tissues along the axial direction of the probe.
The system 400 may further comprise a user interface 413. The user interface 413 may be configured to receive user input and output information to a user. The user input may be related to control of a surgical tool such as the probe 23 operation. The user input may be related to the operation of the optical microscope (e.g., microscope settings, camera acquisition, etc). The user input may be related to various operations or settings about the OCT unit. For instance, the user input may include a selection of a target location, displaying settings of an augmented image, customizable display preferences and the like. The user interface may include a screen such as a touch screen and any other user interactive external device such as handheld controller, mouse, joystick, keyboard, trackball, touchpad, button, verbal commands, gesture-recognition, attitude sensor, thermal sensor, touch-capacitive sensors, foot switch, or any other device.
In some embodiments, a microscope-based OCT 403 is used for guiding the probe 23 and visualization. In some embodiments, a fiberoptic-based OCT 402 is used for guiding the probe 23 and visualization. In some embodiments, both of the microscope-based OCT and fiberoptic-based OCT are employed in the system and used for guiding the probe 23 and visualization. The microscope-based OCT and the fiberoptic-based OCT may perform OCT scans along one or more planes of the eye. In some cases, when both of the OCTs are employed, the microscope-based OCT may be configured to perform a first OCT scan along an anterior-posterior plane of the eye and the fiberoptic-based OCT may be configured to perform a second OCT scan along an axis transverse to the anterior-posterior plane. In some cases, either of the microscope-based OCT and fiberoptic-based OCT may be used independently.
The microscope-based OCT and the fiberoptic-based OCT may or may not comprise similar scan resolutions. In some cases, the microscope-based OCT may perform a scan with higher scan resolution than the fiberoptic-based OCT. For instance, a B-scan performed by the microscope-based OCT may have a higher resolution than an A-scan performed by the fiberoptic-based OCT. Alternatively, a scan resolution of the fiberoptic-based OCT may be higher than the microscope-based OCT. The axial resolution may be determined based on the bandwidth of the source spectrum. The scan resolution may be determined to provide a fast enough frame rate to ensure real-time feedback. The resolution of each of the OCT systems can be within ranges as described herein.
The microscope-based OCT and the fiberoptic-based OCT may or may not have the same frame/scan rate. In some cases, the microscope-based OCT performs B-scan and the fiberoptic-based OCT performs A-scan, and need not require a volume scan of the surgical site. This can provide real-time position feedback at a higher rate. The frame rate of the cross-section view provided by the microscope-based OCT and the axial view provided by the fiberoptic-based OCT may be influenced by various factors such as the size of the scanning field, resolution or scanning rate. In some cases, the two-dimensional OCT images (B-scan) obtained by the microscope-based OCT may be used to provide a coarse position of the probe relative to a target tissue or target location, in which case relatively high resolution and slow frame rate may be sufficient. In some cases, the axial scan image (A-scan) obtained by the fiberoptic-based OCT may provide fine and precise position of the distal end of the probe relative to a small sized structure (e.g., SC, CC, TM), thus higher frame rate may be desired. In some cases, high frame rate may be desired to minimize motion artifacts and enhance image quality. For instance, the axial scan of the fiberoptic-based OCT may have one dimensional A-scan frame/scan rate of at least 100 fps, or greater with a structural image resolution within a range from about 1 micron to about 20 microns, for example. In many embodiments, the A-scan frame rate is within a range from about 1 kHz to about 10 kHz. The OCT system can be configured to measure tissue while contacting the probe tip and up to a distance of at least about 10 mm from the probe tip, for example at least about 6 mm from the probe tip. These distances enable the probe tip to target Schlemm's canal from a range of up to 6 mm in distance from the target site. In some embodiments, the OCT apparatus may comprise a phase-based OCT configured to detect a motion of the distal end of the elongate probe, for example motion in a range from about 20 nm to about 1 μm.
The system may provide surgeons augmented information overlaid to live view of optical images of a surgical site. This is beneficial to reduce disruptions in surgical procedures by allowing surgeons to view supplemental information without moving their eyes away from the microscope's viewing optics or a heads up display. The augmented information may comprise a magnified field view of various areas of the eye on which they are operating. The augmented information may comprise depth view comprising position information of the probe relative to a target tissue. The augmented information may comprise a navigate direction of an elongated probe. The augmented information may be provided to a surgeon in substantially real-time. The augmented information may comprise real time OCT images. The augmented information may comprise a plurality of visual graphical elements generated based on real time OCT images and/or static OCT images. The augmented information may comprise still and/or moving images and/or information (such as text, graphics, charts, plots, and the like) to be overlaid into an operating microscope surgical viewing field or an optical microscope image displayed on a screen.
In some cases, the augmented information may be overlaid or superimposed to an optical image obtained by an optical microscope to form an augmented image. The augmented image may be displayed on a screen either such as the heads up display, a separate viewing monitor or both. In some cases, the augmented information may be overlaid over direct optical path image such that the viewing field visible to a surgeon through the oculars of the microscope comprises both the optical path image and the overlaid augmented information. In some cases, the augmented information may be superimposed to the optical image in a picture-in-picture format.
The controlling unit 410 may be configured to generate an augmented layer comprising the augmented information. The augmented layer may be a substantially transparent image layer comprising one or more graphical elements. The augmented layer may be superposed onto the optical view of the microscope, optical images or video stream, and/or displayed on the display device. The transparency of the augmented layer allows the optical image to be viewed by a user with graphical elements overlay on top of it. In some embodiments, the augmented layer may comprise real time OCT images or other information obtained by an OCT unit coupled to the optical microscope.
As described above, the fusing of the optical microscopic image data and the augmented information may comprise incorporating the augmented information into the optical microscopic image. The augmented image data may comprise one or more graphical elements associated with the depth information, target location and various other supplemental information. The graphical elements may be overlaid onto the optical microscopic image with a beam splitter, for example. A graphical element can be directly overlaid onto an image of any object visible in the optical microscopic image. A graphical element may also include any shape, boundary, or contour surrounding an image of any object in the optical microscopic image. The object may be, for example, an instrument inserted into the eye (e.g., probe), a portion of the probe, target tissues (e.g., SC, CC, TM, JCTM, sclera), and the like.
In some embodiments, the graphical elements may be configured to dynamically change as a position or an orientation of the probe or instrument changes relative to a target location. For example, a graphical element may indicate a location of a distal end of the probe shown in the optical image, or relative location or spacing between tissues such as inner wall of SC, TM and the like. The graphical elements may be configured to dynamically show the change in spacing between the tissue walls or distance between the tip and a target location substantially in or near real-time on the optical image, as the relative distance between the probe tip and a target location changes, and/or when the probe tip compresses on tissue (e.g., surface of trabecular meshwork).
In some embodiments, the augmented information may comprise an orientation of the probe relative to the target location. The graphical elements may indicate the orientation of the probe relative to the target location. The graphical elements may be configured to dynamically show the orientation of the probe relative to the target location substantially in or near real-time on the optical image, as the orientation between the probe and the target location changes. In some instances, a graphical element may indicate an orientation or axial location of the elongated probe. To indicate orientation (e.g., direction), the graphical element may be provided in the form of an arrow. The arrow may be configured to change dynamically based on movement/advancing of the probe.
The augmented layer or at least some of the graphical elements can be mapped or matched to the optical image using object recognition techniques or pattern matching techniques, such as feature point recognition. A feature point can be a portion of an image (e.g., scleral landmarks, collector channel patterns, iris landmarks, etc.) that is uniquely distinguishable from the remaining portions of the image and/or other feature points in the image. A feature point may be detected in portions of an image that are relatively stable under perturbations (e.g., when varying illumination and brightness of an image).
FIG. 6 illustrates an exemplary augmented image or augmented view 600. As described above, the augmented image 600 may be viewed binocularly by a user or surgeon through oculars of the microscope, and may be displayed on a heads up display, an external display device, or a display coupled to a user interface. The augmented image or view may comprise an optical image 505 or an optical path view through the oculars of an optical microscope. The optical image 505 may comprise a top-down view of the eye. The optical image or optical view may show anterior of an eye. The optical image or optical view may further show an elongated probe 23. The augmented image or view 600 may comprise a plurality of graphical visual elements and one or more OCT images adjacent to or overlaid over the optical image, for example by optically coupling the display to the optical path of the microscope with a beam splitter. The plurality of graphical visual elements may comprise different shapes and/or colors corresponding to different objects such that different objects shown in the optical image can be easily distinguished from one another.
The plurality of graphical visual elements may comprise one or more treatment reference markers 601, 602, 603 mapped to the one or more target locations. In some cases, the one or more target locations may be determined or identified based on a preoperative OCT image. During real time optical imaging, the one or more treatment reference markers 601, 602, 603 may be superimposed to the target locations by detecting a pattern of the target location identified from the preoperative OCT image (e.g., one or more specific collector channels). In some cases, a user or surgeon may be prompted to select a target location(s) or treatment reference marker(s) through the user interface 413. In some cases, a plurality of treatment reference markers may be shown simultaneously such as in the beginning of a procedure for a user to select a target location. In some cases, the plurality of treatment reference markers may be shown sequentially as the surgical operation progresses.
The plurality of graphical visual elements may also comprise a probe line 604 coaxial with the elongate probe 23. The probe line 604 shows an orientation of the probe in relation to the one or more target locations. The plurality of graphical visual elements may also comprise a distal tip marker 605 overlapping with the distal end of the elongated probe. Both of the probe line and the distal tip marker may dynamically change locations with respect to the actual positions and orientation of the elongate probe shown in the image, as the probe is moved within the anterior chamber of the eye.
The plurality of graphical visual elements may further comprise one or more guidance arrows or markers 612 extending from the distal tip marker 605 towards the one or more treatment reference markers (e.g., marker 601). The one or more guidance arrows 612 may be configured to guide the physician in aligning the distal end of the elongate probe to point towards the one or more target locations during the procedure, or guide the physician in advancing the elongate probe towards the one or more target locations during the procedure. For example, upon a selection of a target location such as 601, a guidance arrow 612 may be generated pointing from the distal end of the probe to the selected target location such that the physician may advance the probe parallel or coaxial to the guidance arrow. The one or more guidance arrows 612 may point radially from within the anterior chamber in different directions toward the target tissue region comprising the trabecular meshwork and the Schlemm's canal. In some cases, the one or more guidance arrows may automatically appear when the distal end of the probe is located at a predetermined distance away from the target location, for example when the distal end of the probe is located about 6 mm or less from the target location. Alternatively, the one or more guidance arrows may appear in response to a user input indicating a target location selected from the plurality of target locations.
The augmented layer may further comprise one or more OCT images overlaid to the optical image. The OCT image or OCT-based image may provide depth information or position of the probe relative to a target location in a plane extending in a direction transverse to the optical image plane, for example substantially perpendicular to the optical image plane. In some embodiments, one or more magnified field views may be generated based on OCT images 610, 620. For example, the OCT-based image may be magnified by at least two to five times as compared to the optical image. For instance, as illustrated in FIG. 6, a two-dimensional OCT image 610 obtained by the microscope OCT is overlaid on the optical image 505. The two-dimensional OCT images 610-4, 610-5, 610-6, 610-7, and 610-8 as described elsewhere herein may comprise embodiments, variation, or examples of the two-dimensional OCT image 610 and may comprise substantially similar characteristics. In some cases, the OCT image 610 may comprise a B-scan image. Alternatively or in combination, the OCT image 610 may be a three-dimensional image (C-scan). In some cases, real time or substantially real-time OCT images may be displayed overlying the optical image in a picture-within-picture format. Alternatively or in combination, information derived from the OCT image may be overlaid to the optical image. In some embodiments, when the distal end of the probe is within a predetermined distance to the selected target location, a microscope-based OCT scan may be performed to produce the two-dimensional OCT image 610. The microscope based OCT scan may extend along a plane defined by the present target location, e.g. 601, and an opening into the eye, e.g. a small incision into the cornea (paracentesis) as described herein.
The two-dimensional image 610 may comprise a B-scan OCT image and one or more visual graphical elements. The B-scan OCT image may comprise a density plot, for example. The horizontal axis may correspond to the direction of transverse scanning and the vertical axis may correspond to the scanning depth. A gray level can be plotted at a particular pixel on the OCT image corresponding to the magnitude of the depth profile at a particular depth and transverse scanning position. The B-scan OCT image may be post-processed by the image processing apparatus of the controlling unit 410 for image enhancement, image compression or the like. In some cases, the two-dimensional image 610 may be generated by averaging a plurality of B-scan OCT images such that the two-dimensional image may be updated at a lower rate than the acquisition frame rate of the B-scan OCT images. Alternatively, the two-dimensional image 610 may be updated at the same frame rate as the acquisition frame rate of the B-scan OCT images.
The B-scan OCT image may be obtained along an OCT image plane along the elongate axis of the probe 604. The B-scan OCT image plane can be aligned with the probe line along an anterior-posterior plane of the eye. For instance, the probe axis may be determined by an analysis of the optical image acquired with the video, and the microscope-based OCT is controlled to align the OCT image plane with the elongate axis of the probe. The microscope OCT plane can be displayed to the user with a line extending along the probe axis with the line being shown on the display and optically coupled to the microscope image.
In some cases, the two-dimensional OCT scan (B-scan) may be performed automatically in a region where the probe line intersects at least one treatment reference markers. The OCT scan region may comprise the anterior-posterior plane of the eye along the probe elongate axis. The OCT scan region may comprise a portion of the anterior-posterior plane such as including a portion of the distal end of the probe and the region in front of the probe. The OCT scan region may not comprise the entire length of the probe. In some cases, the two-dimensional OCT scan may be performed automatically upon detecting that the probe line is substantially aligned coaxially with the one or more guidance arrows and oriented towards the one or more treatment reference markers. In some cases, the two-dimensional OCT scan may be performed automatically upon detecting that the distal end of the elongate probe is at a predefined distance from a target location. For example, the predefined distance can be within a range from about 1 mm to 6 mm.
The two-dimensional OCT image 610 may further comprise a plurality of graphical visual elements overlaid onto OCT image. For instance, one or more treatment reference markers 601-1 may be mapped to the target location in the OCT image. The plurality of graphical visual elements may also comprise a probe marker 611 indicating at least the position of the probe tip with respect to the target location 601-1 in the depth cross-section. This provides the physician depth information, thus guiding the physician in adjusting the advancing direction of the probe in the anterior-posterior plane of the eye (i.e., depth). In some embodiments, a guidance arrow 613 may also be overlaid to the OCT image for guiding the probe movement towards the target location. In some cases, the two-dimensional OCT image 610 may provide information about another OCT scan. For instance, based on the relative position information between the probe tip and a target tissue location, a fiberoptic-based OCT scan may be activated and graphical elements may be overlaid to the OCT image 610 indicating the scan range (e.g., arrows 614 in FIG. 7C) of the fiberoptic-based OCT scan. The scan range may be in a range such as from 1 degree to 45 degrees. Alternatively, the fiberoptic-based OCT scan may comprise an A-scan.
The fiberoptic-based OCT scan can be performed by the fiberoptic-based OCT unit 402 as described above. The fiberoptic-based OCT scan may be performed along the probe line 605 along an axis of the eye. The fiberoptic-based OCT unit 402 may be configured to automatically perform the OCT scan upon detecting that the distal end of the elongate probe is at a second predefined distance from the target location. The second predefined distance may be within a range, for example, from about 1 mm to about 6 mm. In some cases, the fiberoptic-based OCT scan may be performed after the microscope-based OCT scan. In some cases, the fiberoptic-based OCT scan may be performed independent of the microscope-based OCT scan. In an example, the fiberoptic-based OCT scan may be activated when the probe line is detected to be aligned with the guidance arrow either in the x-y plane identified by the optical image or in the cross-section plane identified by the microscope-OCT image, or a combination of both. Alternatively, the fiberoptic-based OCT scan may be activated manually.
In some embodiments, an image 620 or other information based on the fiberoptic-based OCT scan may be generated and overlaid onto the optical image in a picture-within-picture like format. In some embodiments, the image 620 may be generated by the microscopic OCT. The image 620 may or may not comprise the fiberoptic-based OCT image. The image 620 may be positioned close to the tip of the probe. The image 620 can be positioned in any location within the optical view or on the augmented image. The OCT images 620-5, 620-6, 620-7, 620-8, 620-9, 620-90, and 620-91 as described elsewhere herein may comprise embodiments, variation, or examples of the OCT image 620 and may comprise substantially similar characteristics.
The image 620 may comprise a plurality of graphical visual elements 608, 609-1, 609-2, 609-3, 609-4, 609-5 generated based on the fiberoptic-based OCT scan or microscope-based OCT scan. In some embodiments, the fiberoptic-based OCT scan is performed between a distal end of the elongate probe and a target location to generate an OCT A-scan of the target location comprising a portion of the trabecular meshwork and the Schlemm's canal. The plurality of graphical visual elements may comprise one or more A-scan distance markers 608, 609-1, 609-2, 609-3, 609-4, and 609-5. The A-scan distance markers may provide a magnified distance view of the relative position between the probe tip and tissue structures. The A-scan distance markers enable the physician to observe the distal end of the elongate probe when the distal end is no longer visible in the images collected by the optical microscopic apparatus, and also aid the physician in guiding the distal end of the elongate probe towards the target location and also guide the surgeon regarding applying compression to the trabecular meshwork. In some cases, the A-scan distance markers may be generated when the distal end of the elongate probe is no longer visible in the microscope image as a result of the distal end of the elongate probe being obscured due to total internal reflection of the corner near an iridocorneal angle of the eye.
The A-scan distance markers may comprise a plurality of graphical visual elements showing relative distances between one or more of a distal end of the elongate probe 608, surface of the trabecular meshwork 609-1, juxtacanalicular trabecular meshwork (JCTM) 609-2, an inner wall of the Schlemm's canal 609-3, an outer wall of the Schlemm's canal 609-4, or sclera 609-5. In FIG. 6 the graphical elements are shown as lines and circles, however any other shapes or colors can be used to mark the relative distances. The plurality of lines may comprise different colors, patterns, or thicknesses. The plurality of lines may be visually distinguishable from one another. The A-scan distance markers are overlaid onto the microscope image of the eye. The microscope image shows a top-down view of the eye, and the A-scan distance markers show a magnified axial view of the target location. In some cases, the axial view of the target location is magnified by at least two to five times.
As illustrated in FIG. 6, the plurality of graphical visual elements may comprise a first line 608 corresponding to the distal end of the elongate probe, a second line 609-1 corresponding to the surface of the trabecular meshwork, a third line 609-2 corresponding to the juxtacanalicular trabecular meshwork (JCTM), a fourth line 609-3 corresponding to the inner wall of the Schlemm's canal, a fifth line 609-4 corresponding to the outer wall of the Schlemm's canal, and a sixth line 609-5 corresponding to the sclera, for example. Any number of lines or markers may be generated depending on the specific tissue structure. One or more of the graphical visual elements may move relative to each other to reflect the real-time relative position of the corresponding objects. For instance, the first line 608 may appear to move relative to each of the second through sixth lines as the distal end of the elongate probe advances towards the target location. The plurality of lines allows the physician to know where the distal end of the elongate probe is located relative to the surface of the trabecular meshwork, the JCTM, the inner wall of the Schlemm's canal, the outer wall of the Schlemm's canal, and the sclera. The plurality of lines allows the physician to advance the distal end of the elongate probe in a precise manner toward the target location comprising the trabecular meshwork and the inner wall of the Schlemm's canal. In some cases, the plurality of lines allows the physician to advance the distal end of the elongate probe to apply gentle compression on the trabecular meshwork, thereby avoiding over-compressing the trabecular meshwork. In some cases, the plurality of lines allows the physician to know whether the inner wall of the Schlemm's canal has been penetrated, and to avoid penetrating the outer wall of the Schlemm's canal. For instance, when the inner wall of the Schlemm's canal has been penetrated, the line 609-2 may disappear from the augmented image indicating the probe tip has passed the inner wall of the SC and in some cases, the physician may retract the elongate probe once the inner wall of the Schlemm's canal has been penetrated. The laser firing may automatically stop upon detection of penetration of the inner wall of Schlemm's canal, for example. In some cases, when the inner wall of the SC is penetrated, a next target location may be shown in the images to inform the surgeon where to aim the probe next to create another channel in the inner wall of the Schlemm's canal, in the manner as described above. The target information may be generated from a fiber-optic A-scan of the new target location. Additionally or optionally, the target information may be generated from a microscope B-scan of the new target location.
FIGS. 7A-7F shows exemplary augmented images 700, 710, 720, 730, 740, 750, 760, 770, 780, and 790 perceived by a physician or user during a procedure. As illustrated in FIG. 7A (image 700), one or more treatment reference markers 601, 602, 603 corresponding to one or more target locations may be overlaid over the optical image of an eye or an optical path view through the oculars of an optical microscope for a physician to view and select. The one or more target locations may be determined from a preoperative OCT image or other images then mapped to the live optical image as described elsewhere herein. Upon a selection of a target location, a guidance arrow 612, (shown in image 710), extending from the distal tip marker 605 towards the selected treatment reference marker 601 may be generated to guide the physician, to orient the probe to longitudinally align with the guidance arrow. In some cases, the non-selected target locations 602, 603 may disappear from the view after the first target location 601 has been selected. Proceeding to FIG. 7B (image 720), the probe may be advanced towards the selected target location 601 guided by the probe line 604 coaxial with the elongate axis of the probe and the guidance arrow 612. When the probe tip is detected to be within a predetermined distance from the target location or when the probe line is aligned with the guidance arrow as shown in FIG. 7C (image 730), an OCT scan may be performed. As described elsewhere herein, the detection may be based on the live optical images. The OCT scan may be a microscope-based OCT scan and in some cases, a two-dimensional image may be overlaid onto the optical image. In some cases, arrows 614 indicating a scanning range of the microscope-based OCT may be overlaid to the optical image when a 3D scan (i.e., C-scan) is desired. The scanning range or volume may be defined by the two arrows 614 pointing from the fiber tip to the target location. Alternatively, the microscope-based OCT may be 2-D scan (i.e., B-scan). The scanning plane may be along the longitudinal axis of the probe and the anterior-posterior plane of the eye. The scanning range may be from the fiber optic tip to the target location as indicated by the arrow 612. In some cases, the arrows 614 may indicate a scanning range for fiberoptic-based OCT. Similarly, the arrows 614 may define a scanning range for a 3-D scan or 2-D scan of the fiberoptic-based OCT. The scanning range may be in a range defined by an angle 714 such as from 1 degree to 45 degrees.
As shown in image 740, the microscope-based OCT image 610-4 may comprise guidance arrows 613 to guide the physician in adjusting the probe orientation and advancing direction within an anterior-posterior plane of the eye. Alternatively, the guidance arrows may indicate a 3D OCT scan range. This OCT image supplements positional information that may not be perceivable from the optical image. As described elsewhere herein, a probe marker 611 indicating at least the position of the probe tip with respect to the target location 601-1 may be overlaid onto the microscope-based OCT image.
As illustrated in FIG. 7D (image 750), as the probe tip 605 approaches the target location 601 and is detected to be within a predetermined distance from the target location, a second OCT scan may be performed. The second OCT scan may be a fiberoptic-based OCT scan 620-5. In some cases, the second OCT scan may be a B-scan and arrows indicating a scan range may be overlaid to the optical image 610-5. Alternatively, the second OCT scan may be an A-scan along the axial of the probe and the scan range may not be shown on the augmented image. A magnified view of the second OCT scan (A-scan 620-5) may be overlaid onto the optical image in a picture-within-picture like format. For clarity, FIG. 7D shows a magnified view of an A-scan image 620-5 showing a plurality of A-scan distance markers, which may be overlaid on the augmented image. A plurality of A-scan distance markers such as lines may be generated based on the A-scan result and overlaid to the optical image. The distance markers (e.g., fiberoptic tip position marker 608, TM 609-1) may dynamically change locations or spacing to reflect the relative locations between the distal end of the probe and the surface of the trabecular meshwork, the JCTM, the inner wall of the Schlemm's canal, the outer wall of the Schlemm's canal, or the sclera.
The accurate and precise positioning measurements of the probe tip and associated markers can be used in combination with various ophthalmic surgeries. In an example, ELT procedure may be performed under guidance of the augmented images. The plurality of A-scan distance markers as shown in the example, may comprise a distal end of the elongate probe or fiber optic tip 608, surface of the trabecular meshwork 609-1, juxtacanalicular trabecular meshwork (JCTM) 609-2, an inner wall of the Schlemm's canal 609-3, an outer wall of the Schlemm's canal 609-4, or sclera 609-5.
As illustrated in FIG. 7D (image 760), in OCT image 610-6, a real time image may display movement of the probe as the probe tip advances toward the target 601. A shown in OCT image 620-6, when the probe tip advances the fiber optic tip distance marker 608 may move closer to the distance markers of the trabecular meshwork and Schlemm's canal 609-1, 609-2, 609-3, 609-4, and 609-5. For clarity, FIG. 7D shows a magnified view of an A-scan image 620-6 showing a plurality of A-scan distance markers, which may be overlaid on the augmented image.
As shown in FIG. 7E (augmented image 770), when the probe tip is in contact with the trabecular meshwork shown in OCT image 610-7, distance marker 609-1 may disappear from OCT image 620-7. When the probe tip is in contact with the trabecular meshwork, photoablation of the target tissue may be performed. The probe coupled to an energy source may be configured to deliver a plurality of pulses to the target location upon detecting that the distal end of the elongate probe is compressing the portion of the trabecular meshwork. As described herein, the plurality of pulses is configured to produce an aperture through the trabecular meshwork and into the Schlemm's canal by photoablation. For clarity, FIG. 7E shows a magnified view of an A-scan image 620-7 showing a plurality of A-scan distance markers, which may be overlaid on the augmented image.
As shown in FIG. 7E (augmented image 780), the A-scan distance markers in OCT image 620-8 may indicate a penetration of the Schlemm's canal inner wall. For instance, when the inner wall of the Schlemm's canal has been penetrated as shown in OCT image 610-8, the line 609-2 may disappear from the augmented image 780 indicating the probe tip has passed the inner wall of the SC and in some cases, physician may retract the elongate probe once the inner wall of the Schlemm's canal has been penetrated. The laser firing may automatically stop upon detection of penetration of the inner wall of Schlemm's canal, for example. Alternatively, in another example, the user may be notified by a processor to manually stop the laser firing. For clarity, FIG. 7E shows a magnified view of an A-scan image 620-8 showing a plurality of A-scan distance markers, which may be overlaid on the augmented image.
The controlling unit 410 may comprise a steering and control unit configured to automatically control the energy source to deliver the plurality of pulses upon detecting that the distal end of the elongate probe is compressing the portion of the trabecular meshwork. Alternatively, the steering and control unit may be configured to generate an alert to the physician to manually control the energy source to deliver the plurality of pulses upon detecting that the distal end of the elongate probe is compressing the portion of the trabecular meshwork. In some cases, the steering and control unit may be configured to determine an amount by which the portion of the trabecular meshwork is compressed by the distal end of the elongate probe based on the A-scan distance markers. For instance, the amount of compression of the trabecular meshwork is determined based on a change in relative distance between a first distance marker corresponding to the surface of the trabecular meshwork and a second distance marker corresponding to the JCTM. In another instance, the steering and control unit is configured to determine whether the portion of the trabecular meshwork is compressed to a predetermined thickness based on the A-scan distance markers. In some cases, the steering and control unit may be configured to control an energy source to deliver a plurality of pulses to cause photoablation of the portion of the trabecular meshwork and the inner wall of the Schlemm's Canal upon determining that the portion of the trabecular meshwork has been compressed to the predetermined thickness
Referring back to FIG. 7E, the energy source may stop delivering the plurality of pulses to the target location upon detecting that the inner wall of the Schlemm's canal has been penetrated by the laser pulses. The inner wall of the Schlemm's canal penetration may be indicated by the disappearance of the line marker 609-2 corresponding to the inner wall of the Schlemm's canal. In some cases, the steering and control unit may be configured to detect whether the inner wall of the Schlemm's canal has been penetrated by the photoablation of the portion of the trabecular meshwork based in part on changes in relative distances between the A-scan distance markers. In some cases, the steering and control unit is further configured to generate an alert to the physician to retract the elongate probe away from the target location upon detecting that the inner wall of the Schlemm's canal is penetrated. The alert may be in any form such as text, graphical visual elements overlaid over the optical image or audible alert.
As illustrated in FIG. 7F (image 790), the steering and control unit may be further configured to generate an alert to the physician to locate another treatment reference marker corresponding to the mapped location of another target location of the eye upon successful completion of the current operation. For example, when the inner wall of Schlemm's canal is detected to be penetrated and laser pulses are stopped, the subsequent target location 602 may appear and the surgeon can be guided to move to the next treatment location as described elsewhere herein. Some or all of the previous described steps may be repeated for the subsequent target locations. For clarity, FIG. 7F shows a magnified view of an A-scan image 620-9 showing a plurality of A-scan distance markers, which may be overlaid on the augmented image.
FIG. 8 shows another example of the system 800, accordance with embodiments. The system 800 may be substantially the similar to the system 400 as described in FIG. 4, and may comprise one or more components of system 400. The system 800 may utilize only a fiberoptic-based OCT 402 to measure the eye with OCT. The microscope 409 may comprise the same optical microscope as described in FIG. 4. In this case, the OCT unit 401 may comprise only the fiberoptic-based OCT 402, and the OCT unit may not share optical components of the microscope 409. The A-scan information provided by the probe can be used to determine a distance from the trabecular meshwork. The surgeon can use the A-scan information provided on the display to align the probe with Schlemm's canal. For example, the A-scan information can be displayed to the surgeon with an indication of the distance from Schlemm's canal, and an indication as to whether the distal end of the fiber optic probe is aligned with Schlemm's canal, for example.
FIG. 9 shows an exemplary augmented images or optical views 900 and 910 shown to a user during a procedure using the system 800. The steps of overlaying guidance arrows, probe markers, probe tip markers 605, treatment reference markers to the optical image or view may be similar to those described in FIG. 7A and 7B, in images 700, 710, and 720. The orientation and advancing direction of the probe may be adjusted to such that the probe axial marker is aligned with the guidance arrow. The alignment of the probe in the x-y plane may be achieved by using the top-down view of the optical image of the eye. The position of the probe relative to the target location in the anterior-posterior plane may be estimated or calculated by a preoperative OCT image. When the probe tip 605 is detected to be within a predetermined distance from the target location 601, a fiberoptic-based OCT scan may be performed. The fiberoptic-based OCT scan may be an axial scan (i.e., A-scan) or B-scan as described above. The fiberoptic-based OCT scan can be the same as described elsewhere herein. A magnified view 620-90 of the OCT result may be overlaid onto the optical image. The OCT image 620 may comprise a plurality of A-scan distance reference markers such as 608, 609-1 as described previously. Alternatively, the OCT image may comprise a two-dimensional OCT live image when a B-scan is performed. The OCT image 620-90 and 620-91 are useful to guide the physician in advancing the tip in the axial direction, and provides information about the relative position of the probe tip with respect to one or more tissues structures (e.g., trabecular meshwork 609-1). For example, as shown in image 910, as the tip is advanced, the distance marker 608 in the OCT image 620-91 may move toward the other distance markers. For clarity, FIG. 9 shows magnified views of A-scan images 620-90 and 620-91 showing a plurality of A-scan distance markers, which may be overlaid on the augmented image.
FIG. 10 shows another example of the system 1000, in accordance with embodiments of the invention. The system 1000 may utilize only a microscope-based OCT unit 403. The OCT unit in the system 1000 may comprise a microscope-based OCT. In this case, the OCT based augmented information overlaid onto the optical image may be provided by the OCT scan performed by the microscope-based OCT unit 403. For instance, when the probe tip is detected to be within a predetermined distance from the target location, a microscope-based OCT scan may be performed. The scan plane may be along an anterior-posterior plane of the eye and along the probe elongated axis as described elsewhere herein. The OCT scan may be a high resolution scan. For example, a structural scan resolution may be in a range from about 1 μm to about 5 μm. The scan may provide positional information of the probe tip relative to the target location or tissue structures (e.g., trabecular meshwork, juxtacanalicular trabecular meshwork (JCTM), an inner wall of the Schlemm's canal, an outer wall of the Schlemm's canal, or sclera). In some cases, a real time OCT image with markers such as image 610 may be produced and overlaid onto the optical image. In some cases, in addition to the image 610, a magnified view of relative positions of the probe tip and the tissue structure such as image 620 may be generated based on the microscope-based OCT and overlaid onto the optical image.
FIG. 11 schematically illustrates an example of the OCT guidance system 1100, in accordance with embodiments of the invention. The system 1100 may comprise the same components of the system 400 as described in FIG. 4, except that the system 1100 may not comprise a separate laser unit for the fiber optic probe. The system 1100 may be used for guiding any surgical tools inserted internal to the eye as described elsewhere herein. For instance, the system 1100 may provide guidance to locate stent location for implant. Examples of implant devices include the CyPass® microstent and the iStent®, which target the suprachoroidal space and Schlemm's canal, respectively. In this case, the fiber optic for the OCT scan may be co-axial with a surgical tool 1101 that may not comprise the fiber optic for the ELT surgery.
FIGS. 12A-D show examples of instruments that can be used in combination with the provided system. The various instruments may not be coupled to a laser source. The device may comprise a substantially elongated shape. As illustrated in FIG. 12A, augmented information may be overlaid onto the optical view or image of eye and the instrument in a similar as described elsewhere herein. For instance, one or more treatment reference markers 601 and an arrow co-axial to the instrument 604 may be superimposed to the optical image. A guidance arrow 612 may be displayed to guide the advancing direction and orientation of the instrument. In some cases, the fiber optic for OCT scan may be co-axial or enclosed in a housing of the instrument to provide a relative position of the distal end of the instrument with respect to treatment location.
In some cases, an elongate probe may comprise one or more stents loaded thereon, and the stents may be configured to connect the anterior chamber to the Schlemm's canal and create a permanent opening into Schlemm's canal. Embodiments of the system described herein can be configured to aid a physician in advancing and implanting the one or more stents at target locations with aid of the graphical visual elements (e.g. treatment reference markers and arrows) registered with a real microscope image of the eye. For example, the disclosed system may be configured to aid the physician in advancing and sliding a stent sideways into Schlemm's canal and positioning the stent permanently in Schlemm's canal with aid of the graphical visual elements registered with the microscope image. In some cases, the system may be configured to aid the physician in advancing a plurality of stents along an elongate axis of the elongate probe, injecting the plurality of stents into Schlemm's canal, and positioning the plurality of stents permanently in Schlemm's canal, with aid of the graphical visual elements registered with the microscope image.
In some cases, an elongate probe may comprise a micro-stent loaded thereon, and the micro-stent may be configured to create a permanent conduit between the anterior chamber and a supraciliary space. The system disclosed herein can be configured to aid the physician in advancing the micro-stent to the supraciliary space with aid of the graphical visual elements registered with the microscope image. For example, the system can be configured to aid the physician in advancing the micro-stent to the supraciliary space using a real time OCT image of the supraciliary space generated by any of the OCT apparatus described elsewhere herein. The system can also be configured to aid the physician in positioning a proximal collar portion of the micro-stent in an anterior chamber angle with aid of the graphical visual elements registered with the microscope image.
In some cases, an elongate probe may comprise a gel stent configured for subconjunctival filtration loaded thereon. The gel stent may be configured to create a channel through the sclera to allow flow of aqueous humor from the anterior chamber into a subconjunctival space. The system disclosed herein can be configured to aid the physician in positioning and implanting the gel stent with aid of the graphical visual elements registered with the microscope image.
FIG. 13 shows a flowchart of a method 1300 for determining a target treatment location and probe location, in accordance with embodiments. The method may use one or more of the systems described herein. In a first step 1301, an anterior image of the eye may be obtained by a camera or video camera of an optical microscope. In a second step 1303, one or more target locations are overlaid or mapped over the optical image or optical view to the user. The one or more target locations may be determined based on reference image data comprising an OCT image of the eye. The OCT image of the eye may be obtained using an OCT apparatus prior to the surgical procedure. In some cases, the OCT image of the eye may comprise an image of an anterior segment of the eye comprising a network of collector channels and one or more individual collector channels in at least two quadrants from the OCT image may be identified. The preoperative OCT image may have high resolution.
FIG. 15 shows examples of preoperative OCT images 1500, and augmented preoperative OCT images 1510 and 1520 showing collector channels and target locations. As shown in the examples, the preoperative OCT images may be 3D images. One or more collector channels and/or target locations may be identified from the high resolution preoperative images. In some cases, augmented information such as guidance arrows 613 may be overlaid onto the preoperative images. In some cases, the one or more target locations are located at positions corresponding to the one or more individual collector channels proximal to the trabecular meshwork and an inner wall of the Schlemm's canal. In some cases, locations of the one or more individual collector channels may be registered relative to at least one distinguishable anatomical structure in the eye such as the iris. The plurality of target locations may be estimated manually by the user or automatically by the processor. A user or physician may be allowed to select a target location through the user interface as described elsewhere herein.
As shown in FIG. 13, in a third step 1305, one or more guidance graphical elements may be superimposed to the optical image such that the physician may adjust the advancing direction and/or orientation of the probe to move towards the selected target location in at least the optical image plane. In a fourth step 1307, when the probe tip is detected to be within a predetermined distance from the target location, a microscope-based OCT image may be obtained along the longitudinal axis of the probe and the anterior-posterior plane of the eye. Next 1309, the microscope-based OCT image and associated markers may be overlaid onto the optical image to guide the physician in adjusting the probe orientation and advancing direction in the OCT image plane. In a sixth step 1311, a fiberoptic-based OCT scan may be performed along the axis of the probe. The fiberoptic-based OCT scan may be an A-scan or B-scan to provide relative position between the probe tip and tissues when the probe tip is within a predetermined distance from the target location. The fiberoptic-based OCT image and/or distance markers generated based on the OCT image may be overlaid to the optical image 1313. In an eighth step 1315, the treatment may be viewed in real-time at the treatment locations in order to adjust movement of the probe based at least in part on the augmented information.
Although FIG. 13 shows a method in accordance with some embodiments a person of ordinary skill in the art will recognize many adaptations for variations. For example, the steps can be performed in any order. Some of the steps may be deleted, some of the steps repeated, and some of the steps may comprise sub-steps of other steps. The method may also be modified in accordance with other aspects of the disclosure as provided herein.
The controlling unit 410 may comprise one or more processors configured with instructions for perform one or more steps illustrated in FIG. 8 and operations as described elsewhere herein.
Although the methods and apparatus disclosed herein are described in the context of ablation. The user interface and display can be configured to direct surgical placement of implants as described herein. For example, the target locations can be shown with reference to the collector channels, and the surgical placement of an implant can be directed to a target location near Schlemm's canal, for example. The arrows and other features shown on the heads up display can be used to direct placement of a plurality of locations of a plurality of surgical implants to be placed in the eye, for example implants to create openings to Schlemm's canal. The implant can be placed by creating an opening into Schlemm's canal mechanically (e.g. with a sharp instrument) and placing the implant at the target location, for example.
The processor may be a hardware processor such as a central processing unit (CPU), a graphic processing unit (GPU), or a general-purpose processing unit. The processor can be any suitable integrated circuits, such as computing platforms or microprocessors, logic devices and the like. Although the disclosure is described with reference to a processor, other types of integrated circuits and logic devices are also applicable. The processors or machines may not be limited by the data operation capabilities. The processors or machines may perform 512 bit, 256 bit, 128 bit, 64 bit, 32 bit, or 16 bit data operations.
In some embodiments, the processor may be a processing unit of a computer system. FIG. 14 shows a computer system 1401 that can be configured to implement any computing system disclosed in the present application. The computer system 1401 can comprise a mobile phone, a tablet, a wearable device, a laptop computer, a desktop computer, a central server, etc.
The computer system 1401 includes a central processing unit (CPU, also “processor” and “computer processor” herein) 1405, which can be a single core or multi core processor, or a plurality of processors for parallel processing. The CPU can be the processor as described above. The computer system 1401 also includes memory or memory location 1410 (e.g., random-access memory, read-only memory, flash memory), electronic storage unit 1415 (e.g., hard disk), communication interface 1420 (e.g., network adapter) for communicating with one or more other systems, and peripheral devices 1425, such as cache, other memory, data storage and/or electronic display adapters. In some cases, the communication interface may allow the computer to be in communication with another device such as the imaging device or audio device. The computer may be able to receive input data from the coupled devices for analysis. The memory 1410, storage unit 1415, interface 1420 and peripheral devices 1425 are in communication with the CPU 1405 through a communication bus (solid lines), such as a motherboard. The storage unit 1415 can be a data storage unit (or data repository) for storing data. The computer system 1401 can be operatively coupled to a computer network (“network”) 1430 with the aid of the communication interface 1420. The network 1430 can be the Internet, an internet and/or extranet, or an intranet and/or extranet that is in communication with the Internet. The network 1430 in some cases is a telecommunication and/or data network. The network 1430 can include one or more computer servers, which can enable distributed computing, such as cloud computing. The network 1430, in some cases with the aid of the computer system 1401, can implement a peer-to-peer network, which may enable devices coupled to the computer system 1401 to behave as a client or a server.
The CPU 1405 can execute a sequence of machine-readable instructions, which can be embodied in a program or software. The instructions may be stored in a memory location, such as the memory 1410. The instructions can be directed to the CPU 1405, which can subsequently program or otherwise configure the CPU 1405 to implement methods of the present disclosure. Examples of operations performed by the CPU 1405 can include fetch, decode, execute, and writeback.
The CPU 1405 can be part of a circuit, such as an integrated circuit. One or more other components of the system 1401 can be included in the circuit. In some cases, the circuit is an application specific integrated circuit (ASIC).
The storage unit 1415 can store files, such as drivers, libraries and saved programs. The storage unit 1415 can store user data, e.g., user preferences and user programs. The computer system 1401 in some cases can include one or more additional data storage units that are external to the computer system 1401, such as located on a remote server that is in communication with the computer system 1401 through an intranet or the Internet.
The computer system 1401 can communicate with one or more remote computer systems through the network 1430. For instance, the computer system 1401 can communicate with a remote computer system of a user. Examples of remote computer systems include personal computers, slate or tablet PC's, smart phones, personal digital assistants, and so on. The user can access the computer system 1401 via the network 1430.
Methods as described herein can be implemented by way of machine (e.g., computer processor) executable code stored on an electronic storage location of the computer system 1401, such as, for example, on the memory 1410 or electronic storage unit 1415. The machine executable or machine readable code can be provided in the form of software. During use, the code can be executed by the processor 1405. In some cases, the code can be retrieved from the storage unit 1415 and stored on the memory 1410 for ready access by the processor 1405. In some situations, the electronic storage unit 1415 can be precluded, and machine-executable instructions are stored on memory 1410.
The code can be pre-compiled and configured for use with a machine having a processer adapted to execute the code, or can be compiled during runtime. The code can be supplied in a programming language that can be selected to enable the code to execute in a pre-compiled or as-compiled fashion.
Aspects of the systems and methods provided herein, such as the computer system 1401, can be embodied in programming. Various aspects of the technology may be thought of as “products” or “articles of manufacture” typically in the form of machine (or processor) executable code and/or associated data that is carried on or embodied in a type of machine readable medium. Machine-executable code can be stored on an electronic storage unit, such as memory (e.g., read-only memory, random-access memory, flash memory) or a hard disk. “Storage” type media can include any or all of the tangible memory of the computers, processors or the like, or associated modules thereof, such as various semiconductor memories, tape drives, disk drives and the like, which may provide non-transitory storage at any time for the software programming. All or portions of the software may at times be communicated through the Internet or various other telecommunication networks. Such communications, for example, may enable loading of the software from one computer or processor into another, for example, from a management server or host computer into the computer platform of an application server. Thus, another type of media that may bear the software elements includes optical, electrical and electromagnetic waves, such as used across physical interfaces between local devices, through wired and optical landline networks and over various air-links. The physical elements that carry such waves, such as wired or wireless links, optical links or the like, also may be considered as media bearing the software. As used herein, unless restricted to non-transitory, tangible “storage” media, terms such as computer or machine “readable medium” refer to any medium that participates in providing instructions to a processor for execution.
Hence, a machine readable medium, such as computer-executable code, may take many forms, including but not limited to, a tangible storage medium, a carrier wave medium or physical transmission medium. Non-volatile storage media include, for example, optical or magnetic disks, such as any of the storage devices in any computer(s) or the like, such as may be used to implement the databases, etc. shown in the drawings. Volatile storage media include dynamic memory, such as main memory of such a computer platform. Tangible transmission media include coaxial cables; copper wire and fiber optics, including the wires that comprise a bus within a computer system. Carrier-wave transmission media may take the form of electric or electromagnetic signals, or acoustic or light waves such as those generated during radio frequency (RF) and infrared (IR) data communications. Common forms of computer-readable media therefore include for example: a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD or DVD-ROM, any other optical medium, punch cards paper tape, any other physical storage medium with patterns of holes, a RAM, a ROM, a PROM and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave transporting data or instructions, cables or links transporting such a carrier wave, or any other medium from which a computer may read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
The computer system 1401 can include or be in communication with an electronic display 1435 that comprises a user interface 1440 for providing, for example, a management interface. Examples of UI's include, without limitation, a graphical user interface (GUI) and web-based user interface. The user interface 1440 may be the same as the user interface 413 as described in FIG. 4. Alternatively, the user interface may be a separate user interface.
The computer system 1401 may comprise various other computer components to facilitate communication with an external device such as the microscope system, camera, OCT unit, laser unit, external processor or memory. The communication modules may include suitable means for instruction and data transfer such as double data rate. Various means can be employed for communication such as peripheral component interconnect card, computer buses including but not limited to PCI express, PCI-X, HyperTransport, and so forth. Suitable communication means may be selected according to the requirements of the bandwidth and compatibility of the external device and the central processing unit 1405. For example, one data bus may be for command transfer (e.g., AXI4lite bus) to the laser unit 31 and a different data bus (e.g., AXI4 bus) may be used for image data transfer. Alternatively or additionally, wireless communication may be employed.
Methods and systems of the present disclosure can be implemented by way of one or more algorithms. An algorithm can be implemented by way of software upon execution by the central processing unit 1405.
Although reference is made to determining locations of collector channels with markers shown on a display, the eye can be marked prior to surgery at locations corresponding to the collector channels using the methods and apparatus as disclosed herein. The surgeon can use these markings to create openings to Schlemm's canal in response to the markings placed on the eye. For example, the eye can be marked with ink to identify locations of preferred surgical treatment, and the openings created in the trabecular meshwork at locations corresponding to the preferred surgical treatment.
While preferred embodiments of the present invention have been shown and described herein, it will be obvious to those skilled in the art that such embodiments are provided by way of example only. Numerous variations, changes, and substitutions will now occur to those skilled in the art without departing from the invention. It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention. It is intended that the following claims define the scope of the invention and that methods and structures within the scope of these claims and their equivalents be covered thereby.

Claims

1. A system for aiding a physician to perform a surgical procedure on an eye, wherein said procedure comprises inserting an elongate probe from an opening into the eye across an anterior chamber to a target tissue region of the eye, the target tissue region comprising a Schlemm's canal and a trabecular meshwork, said system comprising:

an optical microscope;

an optical coherence tomographer (OCT); and

an image processing apparatus comprising a processor, an electronic storage location operatively coupled with the processor, and processor executable code stored on the electronic storage location and embodied in a tangible non-transitory computer readable medium, the processor executable code comprising machine-readable instructions, that when executed by the processor, cause the processor to generate an augmented image of the eye, the augmented image comprising:

(i) a microscope image of the eye obtained by the optical microscope, the microscope image corresponding to an x-y plane of the eye, the target tissue region not visible in the microscope image due to total internal reflection of the target tissue region,

(ii) an OCT image of the target tissue region of the eye, the OCT image obtained by the OCT, the OCT image corresponding to an anterior-posterior plane of the eye that is perpendicular to the x-y plane of the eye, the OCT image in registration relative to the microscope image,

(iii) a graphical visual element overlaid to and in registration with the microscope image, the graphical visual element mapped to a radial target location of the target tissue region, the radial target location based on a preoperative OCT image or a real-time OCT image obtained by the OCT, and

(iv) a treatment reference marker overlaid to and in registration with the OCT image, the treatment reference marker mapped to an anterior-posterior depth target location of the target tissue region and to the radial target location of the target tissue region, the anterior-posterior depth target location corresponding to the Schlemm's canal,

the graphical visual element aiding the physician in advancing a distal end of the elongate probe to the radial target location and the treatment reference marker aiding the physician in advancing the distal end of the elongate probe to the anterior-posterior depth target location.

2-8. (canceled)

9. The system of claim 1, wherein the OCT comprises a microscope-based OCT.

10-15. (canceled)

16. The system of claim 1, wherein the OCT comprises a fiberoptic-based OCT.

17-30. (canceled)

31. The system of claim 1, wherein the radial target location is based on the preoperative OCT image.

32. The system of claim 1, wherein the radial target location is based on the real-time OCT image.

33. The system of claim 1, wherein the radial target location corresponds to a collector channel network of the eye.