CN112043383A - Ophthalmic surgery navigation system and electronic equipment - Google Patents
Ophthalmic surgery navigation system and electronic equipment Download PDFInfo
- Publication number
- CN112043383A CN112043383A CN202011058294.5A CN202011058294A CN112043383A CN 112043383 A CN112043383 A CN 112043383A CN 202011058294 A CN202011058294 A CN 202011058294A CN 112043383 A CN112043383 A CN 112043383A
- Authority
- CN
- China
- Prior art keywords
- real time
- oct
- target
- dimensional image
- surgical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/107—Visualisation of planned trajectories or target regions
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
Abstract
The application discloses ophthalmic surgery navigation and electronic equipment includes: the model building module is used for building a standard eye three-dimensional model before operation; the information integration module is used for registering and integrating the tomography OCT image of the target operation area captured by the OCT equipment and the two-dimensional image of the target operation area acquired by the microscope in the operation and reconstructing a three-dimensional image corresponding to the target operation area in real time; the focus positioning module is used for registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious focus parts and marking the suspicious focus parts to form a heat map; and the path planning module is used for correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part. Through the interaction of the four modules, auxiliary information is provided for accurate positioning in the operation, timely finding of disease change, planning of an operation path and changing of an operation scheme, the precision is high, and the safety and the precision of the operation are obviously improved.
Description
Technical Field
The invention relates to the technical field of surgical navigation, in particular to an ophthalmic surgical navigation system and electronic equipment.
Background
The ophthalmic minimally invasive microsurgery is the basis of future development of ophthalmology in China, the 3D high-definition microscope technology is a new trend of future ophthalmic surgery development, and the popularization of the technology is more beneficial to the implementation of the surgery and more benefits for patients with eye diseases. However, no matter the traditional microscopic eye surgery or the emerging 3D high-definition microscopic surgery, the existing surgical microscope cannot realize the real-time observation of the longitudinal section structure of the opaque tissue in the surgery, so that the surgical mode is limited, and the complications and the surgical effect in the surgery are also influenced to a certain extent.
In most of the ophthalmic surgeries at the present stage, no matter anterior segment surgery or fundus surgery, doctors usually locate the target structure by anatomical knowledge and clinical practice experience of theoretical learning, or locate the focus region and plan the surgical path by means of preoperative imaging examination. In order to ensure the success of the operation, a larger range of incision is required to be made to expose a target structure, or the accuracy of the operation is verified by an indirect detection method, so that whether the position of an implant is accurate or not and whether a focus is completely cut or not cannot be visually confirmed in the operation, and a tiny focus structure below the resolution of human eyes is easy to miss; the actual success or failure of the operation also needs to be followed and observed and confirmed by image examination such as Optical Coherence Tomography (OCT). In addition, since the eyeball itself is small in size and the operation range by the surgical instrument is limited, the slight deviation causes the operation result to be spurious, and causes serious consequences. Both doctors and patients are under great economic and mental stress.
Disclosure of Invention
In view of the above, an object of the present invention is to provide an ophthalmic surgery navigation system and an electronic device, which can assist in positioning an anatomical structure and a focus site during surgery, have high precision, and significantly improve the safety and precision of the surgery. The specific scheme is as follows:
an ophthalmic surgical navigation system, comprising:
the model building module is used for building a standard eye three-dimensional model before operation;
the information integration module is used for registering and integrating the tomography OCT image of the target operation area captured by the OCT equipment and the two-dimensional image of the target operation area acquired by the microscope in the operation and reconstructing a three-dimensional image corresponding to the target operation area in real time;
the focus positioning module is used for registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious focus positions and marking the suspicious focus positions to form a heat map as an indication;
and the path planning module is used for correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part.
Preferably, in the above-mentioned ophthalmic surgery navigation system provided by the embodiment of the present invention, further includes:
and the display control module is used for controlling the 3D display to display the operation visual field fed back in real time, the target operation area tomography OCT image and the heat map for marking the suspicious lesion part, and is also used for controlling the 3D display to mark and display the operation path corrected in real time.
Preferably, in the above-mentioned ophthalmic surgical navigation system provided in an embodiment of the present invention, the model building module includes:
the OCT data acquisition unit is used for acquiring OCT data of healthy human eyes and diseased human eyes of different sexes, ages and refractive states;
the standard eye library establishing unit is used for establishing a standard eye three-dimensional image library according to the acquired OCT data;
and the three-dimensional model establishing unit is used for training the standard eye three-dimensional image library and establishing a standard eye three-dimensional model through a neural convolution network deep learning algorithm.
Preferably, in the above ophthalmic surgical navigation system provided in the embodiment of the present invention, the path planning module is further configured to obtain distance information between a starting position of the surgical path and a corresponding position of the target surgical field in real time during the surgery, or distance information between the surgical instrument and the suspicious lesion site and the surrounding tissue, and obtain a tissue size parameter in real time, so as to correct the position and the orientation of the surgical instrument in real time.
Preferably, in the above ophthalmic surgical navigation system provided in the embodiment of the present invention, the display control module is further configured to control the 3D display to display the distance information and the tissue size parameter acquired by the path planning module in real time.
Preferably, in the ophthalmic surgical navigation system provided in the embodiment of the present invention, the information integration module is specifically configured to respectively acquire a tomographic OCT image of the target surgical area captured by an OCT device and a two-dimensional image of the target surgical area acquired by a microscope, respectively mark a thermal image interest area on the acquired tomographic OCT image of the target surgical area and the two-dimensional image of the target surgical area, perform registration integration on the image marked with the thermal image interest area, and reconstruct a three-dimensional image corresponding to the target surgical area in real time.
Preferably, in the above-mentioned ophthalmic surgical navigation system provided by the embodiment of the present invention, the OCT apparatus is integrated in the microscope.
The embodiment of the invention also provides electronic equipment, which comprises a memory, a processor and a microscope integrated with the OCT equipment; wherein the memory is used for storing programs; the processor, coupled with the memory, to execute the program stored in the memory to: constructing a standard eye three-dimensional model before operation; in operation, the target operation area tomography OCT image captured by the OCT equipment and the target operation area two-dimensional image collected by the microscope are registered and integrated, and a three-dimensional image corresponding to the target operation area is reconstructed in real time; registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious lesion positions and marking the suspicious lesion positions to form a heat map as an indication; and correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part.
Preferably, in the electronic device provided in the embodiment of the present invention, the electronic device further includes: a 3D display;
the 3D display is used for displaying the operation visual field fed back in real time, the tomography OCT image of the target operation area, the heat map for marking the suspicious lesion part, and the operation path corrected in real time.
The embodiment of the invention also provides electronic equipment which comprises the ophthalmic surgery navigation system provided by the embodiment of the invention.
It can be seen from the above technical solutions that, an ophthalmic surgery navigation system provided by the present invention includes: the model building module is used for building a standard eye three-dimensional model before operation; the information integration module is used for registering and integrating the tomography OCT image of the target operation area captured by the OCT equipment and the two-dimensional image of the target operation area acquired by the microscope in the operation and reconstructing a three-dimensional image corresponding to the target operation area in real time; the focus positioning module is used for registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious focus positions and marking the suspicious focus positions to form a heat map as an indication; and the path planning module is used for correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part.
The invention introduces the optical coherence layer imaging technology into a navigation system of an ophthalmic surgery through the interaction of a model construction module, an information integration module, a focus positioning module and a path planning module, feeds back and scans a tomographic OCT image with the precision reaching the micron level in real time, reconstructs an eye three-dimensional image in real time by combining a two-dimensional image acquired by a microscope, performs registration comparison with a constructed standard eye three-dimensional model, displays a suspicious focus position by using a heat map, performs omission detection and filling for preoperative diagnosis, assists the positioning of an anatomical structure and the focus position in the surgery, visually displays the fine change of a target tissue structure, provides auxiliary information for the precise positioning in the surgery, finds the change of an illness state in time, plans a surgery path and changes a surgery scheme, ensures the safety of the surgery to a certain extent, has high precision and can obviously improve the precision of the surgery. In addition, the invention also provides corresponding electronic equipment for the ophthalmic surgery navigation system, so that the ophthalmic surgery navigation system has higher practicability, and the electronic equipment has corresponding advantages.
Drawings
In order to more clearly illustrate the embodiments of the present invention or technical solutions in related arts, the drawings used in the description of the embodiments or related arts will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 and fig. 2 are schematic structural diagrams of an ophthalmic surgical navigation system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The present invention provides an ophthalmic surgery navigation system, as shown in fig. 1, including:
the model building module 11 is used for building a standard eye three-dimensional model before operation;
the information integration module 12 is configured to perform registration integration on a tomographic OCT image of the target operation region captured by an Optical Coherence Tomography (OCT) device and a two-dimensional image of the target operation region acquired by a microscope during an operation, and reconstruct a three-dimensional image corresponding to the target operation region in real time; it is noted that the OCT device may be integrated in the microscope, i.e. the input of the OCT device may be integrated into the microscope; the image collected by the microscope and the image captured by the OCT device can pass through the same objective lens and the emergent light path;
the focus positioning module 13 is used for registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious focus positions and marking the suspicious focus positions to form a heat map as an indication;
and the path planning module 14 is used for correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part.
In the navigation system for the ophthalmic surgery provided by the embodiment of the invention, the optical coherence tomography imaging technology is introduced into the navigation system for the ophthalmic surgery through the interaction of the model construction module, the information integration module, the focus positioning module and the path planning module, the tomography OCT image with the scanning precision reaching the micron level is fed back in real time, the three-dimensional image of the eye is reconstructed in real time by combining the two-dimensional image acquired by the microscope, and is registered and compared with the established standard eye three-dimensional model, the suspicious lesion site is displayed by a heat map, the preoperative diagnosis is subjected to omission detection and filling, the positioning of an anatomical structure and a focus position in an operation is assisted, the slight change of a target tissue structure is visually displayed, auxiliary information is provided for accurate positioning in the operation, the change of an illness state is found in time, an operation path is planned, an operation scheme is changed, the safety of the operation is guaranteed to a certain degree, the precision is high, and the accuracy of the operation can be obviously improved. In addition, the invention also provides corresponding electronic equipment for the ophthalmic surgery navigation system, so that the ophthalmic surgery navigation system has higher practicability, and the electronic equipment has corresponding advantages.
Further, in practical implementation, in the above ophthalmic surgical navigation system provided in an embodiment of the present invention, as shown in fig. 2, the system further includes: and the display control module 15 is used for controlling the 3D display to display the operation visual field fed back in real time, the tomography OCT image of the target operation area and the heat map for marking the suspicious lesion part, and is also used for controlling the 3D display to mark and display the operation path corrected in real time.
It should be noted that the display control module 15 displays the real-time two-dimensional tomographic OCT image registered in the target operation region, the thermal image (i.e., the reconstructed three-dimensional image) for marking the suspicious lesion site, the corrected path plan and the operation field on one 3D display screen, so that the operating doctor can perform a head-up operation in the whole course, and does not need to probe the eye structure in the operation by additional equipment or compare the images by a plurality of displays, thereby effectively reducing the complex and cumbersome operation procedures in the operation process of the doctor, reducing the cost of the equipment, and reducing the operation space.
In a specific implementation manner, in the above ophthalmic surgical navigation system provided in an embodiment of the present invention, the model building module 11 may include: the OCT data acquisition unit is used for acquiring OCT data of healthy human eyes and diseased human eyes of different sexes, ages and refractive states; the standard eye library establishing unit is used for establishing a standard eye three-dimensional image library according to the acquired OCT data; and the three-dimensional model establishing unit is used for training the standard eye three-dimensional image library and establishing the standard eye three-dimensional model through a neural convolution network deep learning algorithm. It should be noted that, the judgment and marking of the focus position of the operation eye by using the deep learning algorithm can assist the operation doctor in checking the omission, and meanwhile, the focus position is accurately positioned, so that the method is more scientific, stable and accurate compared with the prior determination of the focus position.
In practical applications, the OCT data acquisition unit can be an existing commercial OCT device with the same main parameters (such as wavelength); before operation, more than 500 healthy eyes with different sexes, ages and refractive states and more than 300 glaucoma affected eye images can be collected through the equipment, a training set and a verification set are established together, an algorithm for diagnosing various glaucomas and marking focus positions is obtained through a Neural Convolutional Network (CNNs) deep learning method, and a standard eye three-dimensional model is established as a diagnosis model of corresponding diseases for reference. Next, using a microscope integrated with an OCT device to collect an image of a patient operation eye in operation, carrying out real-time region imaging and three-dimensional reconstruction, and carrying out common display of an operation visual field and a target region tomogram on a 3D display; and identifying and registering the constructed standard eye three-dimensional model and the patient operation eye image reconstructed by OCT scanning in the operation, performing diagnosis and classification in the operation by using CNNs, outputting a heat map for marking a suspicious lesion part, and assisting in planning and adjusting an operation path in the operation.
The above-mentioned convolutional neural network is generally composed of convolutional layers (convolutional layers), pooling layers (posing layers), and fully connected layers (fully connected layers). The convolutional layer is used to compute the convolution between a particular kernel and the input data. An activation function is then applied to generate a new feature map. The convolution operation for a single channel can be expressed as:
where k denotes the convolution kernel, W, H and S denote the dimension of k, the kernel will input izConvolved along its width and height and producing an output value o at x, yz+1. Wherein the nonlinear activation function F is represented as: i.e. iz+1＝F(oz+1). The feature map is then sent to a pooling layer for feature selection and information filtering. Finally, each output cell is connected to all cells of the last feature map in the full link layer.
In specific implementation, in the above ophthalmic surgical navigation system provided in the embodiment of the present invention, the path planning module 14 may be further configured to obtain, in real time, distance information between the initial position of the surgical path and a corresponding position of the target surgical field during surgery, or distance information between the surgical instrument and a suspicious lesion site and surrounding tissues, and obtain a tissue size parameter in real time, so as to correct the position and orientation of the surgical instrument in real time. The display control module 15 may be further configured to control the 3D display to display the distance information and the tissue size parameter acquired by the path planning module 14 in real time.
Specifically, the preoperative surgical path plan is corrected in real time through the path planning module 14 according to the intraoperative focal zone image fed back in real time, and the real-time corrected surgical path, the corresponding measured position distance and the tissue size parameter are marked and displayed on the 3D display; and the qualitative and quantitative position relation between the high-definition scanning area tissues and the surrounding structure and the qualitative and quantitative position relation between the surgical instruments can be fed back in real time in the operation, the information such as the position relation information between the surgical instruments and the focus, the size of the focus tissues and the like can be obtained in real time, an operator can judge the condition in the operation, position and measure the size of the focus and plan an operation path, the position and the trend of the surgical instruments can be corrected in real time, and the accuracy of the operation can be further improved.
In specific implementation, in the above ophthalmic surgery navigation system provided in the embodiment of the present invention, the information integration module 12 may be specifically configured to respectively acquire a tomographic OCT image of the target surgical area captured by the OCT device and a two-dimensional image of the target surgical area acquired by the microscope, respectively mark a thermal image interest area on the acquired tomographic OCT image of the target surgical area and the two-dimensional image of the target surgical area, perform registration integration on the image marked with the thermal image interest area, and reconstruct a three-dimensional image corresponding to the target surgical area in real time. Therefore, suspicious lesion areas can be displayed in the tomography OCT image of the target operation area, the two-dimensional image of the target operation area and the reconstructed three-dimensional image, and the suspicious lesion areas are used for assisting in defining the lesion positions in the operation and planning the operation path.
Correspondingly, the embodiment of the invention also provides electronic equipment, which comprises a memory, a processor and a microscope integrated with the OCT equipment; wherein, the memorizer, is used for storing the procedure; a processor, coupled to the memory, for executing the program stored in the memory to: constructing a standard eye three-dimensional model before operation; in the operation, a target operation area tomography OCT image captured by an OCT device and a target operation area two-dimensional image collected by a microscope are registered and integrated, and a three-dimensional image corresponding to the target operation area is reconstructed in real time; registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious lesion parts and marking the suspicious lesion parts to form a heat map as an indication; and according to the heat map fed back in real time during the operation, correcting the operation path planned before the operation in real time. Because the principle of the electronic device for solving the problems is similar to that of the ophthalmic surgery navigation system, the implementation of the electronic device can be referred to that of the ophthalmic surgery navigation system, and repeated details are not repeated.
Further, in a specific implementation, in the electronic device provided in an embodiment of the present invention, the electronic device further includes: and the 3D display is used for displaying the operation visual field fed back in real time, the tomography OCT image of the target operation area, the heat map for marking the suspicious lesion part and marking and displaying the operation path corrected in real time.
Correspondingly, the embodiment of the invention also provides electronic equipment comprising the ophthalmic surgery navigation system provided by the embodiment of the invention. Because the principle of the electronic device for solving the problems is similar to that of the ophthalmic surgery navigation system, the implementation of the electronic device can be referred to that of the ophthalmic surgery navigation system, and repeated details are not repeated.
The ophthalmic surgery navigation system provided by the embodiment of the invention comprises: the model building module is used for building a standard eye three-dimensional model before operation; the information integration module is used for registering and integrating the tomography OCT image of the target operation area captured by the OCT equipment and the two-dimensional image of the target operation area acquired by the microscope in the operation and reconstructing a three-dimensional image corresponding to the target operation area in real time; the focus positioning module is used for registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious focus positions and marking the suspicious focus positions to form a heat map as an indication; and the path planning module is used for correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part. Through the interaction of the four modules, an optical coherence layer imaging technology is introduced into a navigation system of an ophthalmic surgery, 3D imaging is carried out on a surgical visual field in real time, a tomography OCT image with the precision reaching the micron level is also fed back and scanned in real time, an eye three-dimensional image is reconstructed in real time by combining a two-dimensional image acquired by a microscope, the eye three-dimensional image is registered and compared with a constructed standard eye three-dimensional model, a suspicious focus position is displayed by a heat map, preoperative diagnosis is checked for omission, positioning of an anatomical structure and the focus position in the surgery is assisted, fine changes of a target tissue structure are visually displayed, auxiliary information is provided for accurate positioning in the surgery, changes of an illness state are found in time, a surgery path is planned, and a surgery scheme is changed, the safety of the surgery is guaranteed to a certain extent, the precision is high, and the precision. In addition, the invention also provides corresponding electronic equipment for the ophthalmic surgery navigation system, so that the ophthalmic surgery navigation system has higher practicability, and the electronic equipment has corresponding advantages.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The ophthalmic surgery navigation system and the electronic device provided by the present invention are described in detail above, and the principle and the implementation of the present invention are explained herein by applying specific examples, and the description of the above examples is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. An ophthalmic surgical navigation system, comprising:
the model building module is used for building a standard eye three-dimensional model before operation;
the information integration module is used for registering and integrating the tomography OCT image of the target operation area captured by the OCT equipment and the two-dimensional image of the target operation area acquired by the microscope in the operation and reconstructing a three-dimensional image corresponding to the target operation area in real time;
the focus positioning module is used for registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious focus positions and marking the suspicious focus positions to form a heat map as an indication;
and the path planning module is used for correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part.
2. The ophthalmic-surgical navigation system of claim 1, further comprising:
and the display control module is used for controlling the 3D display to display the operation visual field fed back in real time, the target operation area tomography OCT image and the heat map for marking the suspicious lesion part, and is also used for controlling the 3D display to mark and display the operation path corrected in real time.
3. The ophthalmic-surgical navigation system of claim 2, wherein the model building module comprises:
the OCT data acquisition unit is used for acquiring OCT data of healthy human eyes and diseased human eyes of different sexes, ages and refractive states;
the standard eye library establishing unit is used for establishing a standard eye three-dimensional image library according to the acquired OCT data;
and the three-dimensional model establishing unit is used for training the standard eye three-dimensional image library and establishing a standard eye three-dimensional model through a neural convolution network deep learning algorithm.
4. The ophthalmic surgical navigation system of claim 3, wherein the path planning module is further configured to obtain, in real time, distance information between a starting position of the surgical path and a corresponding position of the target surgical field during surgery, or distance information between the surgical instrument and the suspicious lesion site and surrounding tissues, and obtain tissue size parameters in real time, so as to correct the position and orientation of the surgical instrument in real time.
5. The ophthalmic-surgical navigation system of claim 4, wherein the display control module is further configured to control the 3D display to display the distance information and the tissue-size parameter acquired by the path planning module in real time.
6. The ophthalmic surgery navigation system of claim 5, wherein the information integration module is specifically configured to acquire a tomographic OCT image of the target surgical area captured by the OCT device and a two-dimensional image of the target surgical area acquired by the microscope, respectively, mark a thermal image interesting region on the acquired tomographic OCT image of the target surgical area and the two-dimensional image of the target surgical area, perform registration integration on the image marked with the thermal image interesting region, and reconstruct a three-dimensional image corresponding to the target surgical area in real time.
7. The ophthalmic surgical navigation system of claim 6, wherein the OCT device is integrated in the microscope.
8. An electronic device comprising a memory and a processor, further comprising a microscope integrated with an OCT device; wherein the memory is used for storing programs; the processor, coupled with the memory, to execute the program stored in the memory to: constructing a standard eye three-dimensional model before operation; in operation, the target operation area tomography OCT image captured by the OCT equipment and the target operation area two-dimensional image collected by the microscope are registered and integrated, and a three-dimensional image corresponding to the target operation area is reconstructed in real time; registering and comparing the three-dimensional image reconstructed in real time in the operation with the constructed standard eye three-dimensional model, identifying suspicious lesion positions and marking the suspicious lesion positions to form a heat map as an indication; and correcting the preoperative planned operation path in real time according to the heat map which is fed back in real time during the operation and marks the suspicious lesion part.
9. The electronic device of claim 8, further comprising: a 3D display;
the 3D display is used for displaying the operation visual field fed back in real time, the tomography OCT image of the target operation area, the heat map for marking the suspicious lesion part, and the operation path corrected in real time.
10. An electronic device characterized by comprising an ophthalmic-surgery navigation system according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011058294.5A CN112043383B (en) | 2020-09-30 | 2020-09-30 | Ophthalmic surgery navigation system and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011058294.5A CN112043383B (en) | 2020-09-30 | 2020-09-30 | Ophthalmic surgery navigation system and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112043383A true CN112043383A (en) | 2020-12-08 |
| CN112043383B CN112043383B (en) | 2022-07-15 |
Family
ID=73605652
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011058294.5A Active CN112043383B (en) | 2020-09-30 | 2020-09-30 | Ophthalmic surgery navigation system and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112043383B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113057734A (en) * | 2021-03-12 | 2021-07-02 | 上海微创医疗机器人（集团）股份有限公司 | Surgical system |
| CN113100941A (en) * | 2021-04-12 | 2021-07-13 | 中国科学院苏州生物医学工程技术研究所 | Image registration method and system based on SS-OCT (scanning and optical coherence tomography) surgical navigation system |
| CN113143466A (en) * | 2021-05-31 | 2021-07-23 | 上海阅行医疗科技有限公司 | Intraoperative planning adjustment method and system based on integrated surgical robot |
| CN113693721A (en) * | 2021-07-14 | 2021-11-26 | 北京理工大学 | Multi-condition constrained path planning method and device |
| CN113876427A (en) * | 2021-12-03 | 2022-01-04 | 南京利昂医疗设备制造有限公司 | Detection device and method for intracavity clamp |
| CN113887311A (en) * | 2021-09-03 | 2022-01-04 | 中山大学中山眼科中心 | Method, device and storage medium for protecting privacy of ophthalmologic patient |
| CN114305690A (en) * | 2021-12-31 | 2022-04-12 | 杭州三坛医疗科技有限公司 | Surgical navigation positioning method and device |
| CN114642502A (en) * | 2022-02-21 | 2022-06-21 | 北京工业大学 | Auxiliary design method and device for strabismus operation scheme |
| CN114788734A (en) * | 2022-06-23 | 2022-07-26 | 康达洲际医疗器械有限公司 | Intraoperative three-dimensional navigation method and system based on double-C-arm imaging system |
| CN114931436A (en) * | 2022-07-27 | 2022-08-23 | 中国科学院宁波材料技术与工程研究所 | Cataract surgery navigation system |
| CN115120346A (en) * | 2022-08-30 | 2022-09-30 | 中国科学院自动化研究所 | Target point positioning method and device, electronic equipment and bronchoscope system |
| CN115830235A (en) * | 2022-12-09 | 2023-03-21 | 皖南医学院第一附属医院（皖南医学院弋矶山医院） | Three-dimensional model reconstruction method for room defect image |
| CN116473673A (en) * | 2023-06-20 | 2023-07-25 | 浙江华诺康科技有限公司 | Path planning method, device, system and storage medium for endoscope |
| CN117491686A (en) * | 2023-12-29 | 2024-02-02 | 北京至格科技有限公司 | Microstructure measurement positioning method and system for sample to be measured |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103908344A (en) * | 2012-12-31 | 2014-07-09 | 复旦大学 | Tractive straightening method based on surgical navigation system |
| US20160184029A1 (en) * | 2014-12-31 | 2016-06-30 | Allen Institute | Methods and systems for adaptive 3d imaging-guided single-cell measurement |
| CA3049148A1 (en) * | 2017-01-24 | 2018-08-02 | Tietronix Software, Inc. | System and method for three-dimensional augmented reality guidance for use of medical equipment |
| CN110010219A (en) * | 2019-03-13 | 2019-07-12 | 杭州电子科技大学 | Optical coherence tomography image retinopathy intelligent checking system and detection method |
| CN110037808A (en) * | 2019-05-14 | 2019-07-23 | 苏州大学 | Liver surface real time information sampling method and system in art based on structure light scan |
| CN110236674A (en) * | 2019-05-09 | 2019-09-17 | 苏州大学 | A kind of operation on liver navigation methods and systems based on structure light scan |
| CN110638527A (en) * | 2019-07-01 | 2020-01-03 | 中国科学院苏州生物医学工程技术研究所 | Operation microscopic imaging system based on optical coherence tomography augmented reality |
| CN111179258A (en) * | 2019-12-31 | 2020-05-19 | 中山大学中山眼科中心 | Artificial intelligence method and system for identifying retinal hemorrhage image |
| CN111166489A (en) * | 2018-12-07 | 2020-05-19 | 张永学 | Control method and device for automatic puncture biopsy medical robot and robot |
| CN111529063A (en) * | 2020-05-26 | 2020-08-14 | 广州狄卡视觉科技有限公司 | Operation navigation system and method based on three-dimensional reconstruction multi-mode fusion |
| CN111658145A (en) * | 2020-06-16 | 2020-09-15 | 首都医科大学附属北京同仁医院 | ICL implantation surgical robot system |
-
2020
- 2020-09-30 CN CN202011058294.5A patent/CN112043383B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103908344A (en) * | 2012-12-31 | 2014-07-09 | 复旦大学 | Tractive straightening method based on surgical navigation system |
| US20160184029A1 (en) * | 2014-12-31 | 2016-06-30 | Allen Institute | Methods and systems for adaptive 3d imaging-guided single-cell measurement |
| CA3049148A1 (en) * | 2017-01-24 | 2018-08-02 | Tietronix Software, Inc. | System and method for three-dimensional augmented reality guidance for use of medical equipment |
| CN111166489A (en) * | 2018-12-07 | 2020-05-19 | 张永学 | Control method and device for automatic puncture biopsy medical robot and robot |
| CN110010219A (en) * | 2019-03-13 | 2019-07-12 | 杭州电子科技大学 | Optical coherence tomography image retinopathy intelligent checking system and detection method |
| CN110236674A (en) * | 2019-05-09 | 2019-09-17 | 苏州大学 | A kind of operation on liver navigation methods and systems based on structure light scan |
| CN110037808A (en) * | 2019-05-14 | 2019-07-23 | 苏州大学 | Liver surface real time information sampling method and system in art based on structure light scan |
| CN110638527A (en) * | 2019-07-01 | 2020-01-03 | 中国科学院苏州生物医学工程技术研究所 | Operation microscopic imaging system based on optical coherence tomography augmented reality |
| CN111179258A (en) * | 2019-12-31 | 2020-05-19 | 中山大学中山眼科中心 | Artificial intelligence method and system for identifying retinal hemorrhage image |
| CN111529063A (en) * | 2020-05-26 | 2020-08-14 | 广州狄卡视觉科技有限公司 | Operation navigation system and method based on three-dimensional reconstruction multi-mode fusion |
| CN111658145A (en) * | 2020-06-16 | 2020-09-15 | 首都医科大学附属北京同仁医院 | ICL implantation surgical robot system |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113057734A (en) * | 2021-03-12 | 2021-07-02 | 上海微创医疗机器人（集团）股份有限公司 | Surgical system |
| CN113100941A (en) * | 2021-04-12 | 2021-07-13 | 中国科学院苏州生物医学工程技术研究所 | Image registration method and system based on SS-OCT (scanning and optical coherence tomography) surgical navigation system |
| CN113100941B (en) * | 2021-04-12 | 2022-03-08 | 中国科学院苏州生物医学工程技术研究所 | Image registration method and system based on SS-OCT (scanning and optical coherence tomography) surgical navigation system |
| CN113143466A (en) * | 2021-05-31 | 2021-07-23 | 上海阅行医疗科技有限公司 | Intraoperative planning adjustment method and system based on integrated surgical robot |
| CN113693721A (en) * | 2021-07-14 | 2021-11-26 | 北京理工大学 | Multi-condition constrained path planning method and device |
| CN113887311A (en) * | 2021-09-03 | 2022-01-04 | 中山大学中山眼科中心 | Method, device and storage medium for protecting privacy of ophthalmologic patient |
| CN113876427A (en) * | 2021-12-03 | 2022-01-04 | 南京利昂医疗设备制造有限公司 | Detection device and method for intracavity clamp |
| CN113876427B (en) * | 2021-12-03 | 2022-03-08 | 南京利昂医疗设备制造有限公司 | Detection device and method for intracavity clamp |
| CN114305690B (en) * | 2021-12-31 | 2023-12-26 | 杭州三坛医疗科技有限公司 | Surgical navigation positioning method and device |
| CN114305690A (en) * | 2021-12-31 | 2022-04-12 | 杭州三坛医疗科技有限公司 | Surgical navigation positioning method and device |
| CN114642502A (en) * | 2022-02-21 | 2022-06-21 | 北京工业大学 | Auxiliary design method and device for strabismus operation scheme |
| CN114788734A (en) * | 2022-06-23 | 2022-07-26 | 康达洲际医疗器械有限公司 | Intraoperative three-dimensional navigation method and system based on double-C-arm imaging system |
| CN114931436A (en) * | 2022-07-27 | 2022-08-23 | 中国科学院宁波材料技术与工程研究所 | Cataract surgery navigation system |
| CN115120346A (en) * | 2022-08-30 | 2022-09-30 | 中国科学院自动化研究所 | Target point positioning method and device, electronic equipment and bronchoscope system |
| CN115120346B (en) * | 2022-08-30 | 2023-02-17 | 中国科学院自动化研究所 | Target point positioning device, electronic equipment and bronchoscope system |
| CN115830235A (en) * | 2022-12-09 | 2023-03-21 | 皖南医学院第一附属医院（皖南医学院弋矶山医院） | Three-dimensional model reconstruction method for room defect image |
| CN116473673A (en) * | 2023-06-20 | 2023-07-25 | 浙江华诺康科技有限公司 | Path planning method, device, system and storage medium for endoscope |
| CN116473673B (en) * | 2023-06-20 | 2024-02-27 | 浙江华诺康科技有限公司 | Path planning method, device, system and storage medium for endoscope |
| CN117491686A (en) * | 2023-12-29 | 2024-02-02 | 北京至格科技有限公司 | Microstructure measurement positioning method and system for sample to be measured |
| CN117491686B (en) * | 2023-12-29 | 2024-03-19 | 北京至格科技有限公司 | Microstructure measurement positioning method and system for sample to be measured |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112043383B (en) | 2022-07-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112043383B (en) | Ophthalmic surgery navigation system and electronic equipment | |
| Petroll et al. | In vivo confocal microscopy of the cornea: new developments in image acquisition, reconstruction, and analysis using the HRT-Rostock corneal module | |
| JP5688491B2 (en) | How to do a vision test | |
| US9925017B2 (en) | Medical navigation image output comprising virtual primary images and actual secondary images | |
| EP1982650B1 (en) | Surgery support device, method, and program | |
| JP5820154B2 (en) | Ophthalmic apparatus, ophthalmic system, and storage medium | |
| KR101609025B1 (en) | Image processing apparatus, image processing method, and storage medium | |
| KR101531620B1 (en) | Method of and system for overlaying nbs functional data on a live image of a brain | |
| CN102784003B (en) | Pediculus arcus vertebrae internal fixation operation navigation system based on structured light scanning | |
| CN202751447U (en) | Vertebral pedicle internal fixation surgical navigation system based on structured light scanning | |
| AU2014231346A1 (en) | Planning, navigation and simulation systems and methods for minimally invasive therapy | |
| JPWO2006022045A1 (en) | Optical coherence tomography device | |
| CN112057165B (en) | Path planning method, device, equipment and medium | |
| Roodaki et al. | Introducing augmented reality to optical coherence tomography in ophthalmic microsurgery | |
| US20150320306A1 (en) | Device and method for checking human vision | |
| CN111297319A (en) | Frequency domain OCT (optical coherence tomography) -based full-eye imaging and parameter measuring method and system | |
| JP4901620B2 (en) | Fundus examination image analysis system and fundus examination image analysis program | |
| WO2021151841A1 (en) | Assembly comprising an oct device for ascertaining a 3d reconstruction of an object region volume, computer program, and computer-implemented method for same | |
| JP7358125B2 (en) | Slit lamp microscope, ophthalmological information processing device, ophthalmological system, slit lamp microscope control method, program, and recording medium | |
| US11406346B2 (en) | Surgical position calibration method | |
| US20210137601A1 (en) | Device and method for imaging during implantation of retina implants | |
| CN108143501B (en) | Anatomical projection method based on body surface vein features | |
| US20220354579A1 (en) | Systems and methods for planning and simulation of minimally invasive therapy | |
| WO2022150294A1 (en) | Apparatus for calibrating retinal imaging systems and related methods | |
| CN113907883A (en) | 3D visualization operation navigation system and method for ear-side skull-base surgery |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |