CN111462314A - Organ three-dimensional image reconstruction method, operation navigation method and operation auxiliary system - Google Patents
Organ three-dimensional image reconstruction method, operation navigation method and operation auxiliary system Download PDFInfo
- Publication number
- CN111462314A CN111462314A CN202010258116.0A CN202010258116A CN111462314A CN 111462314 A CN111462314 A CN 111462314A CN 202010258116 A CN202010258116 A CN 202010258116A CN 111462314 A CN111462314 A CN 111462314A
- Authority
- CN
- China
- Prior art keywords
- dimensional image
- organ
- dimensional
- image data
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Abstract
The invention discloses an organ three-dimensional image reconstruction method, an operation navigation method and an operation auxiliary system, wherein the organ three-dimensional image reconstruction method comprises the following steps: step 1, aiming at a target reconstructed organ, processing the target reconstructed organ by using the existing medical equipment to obtain CT or MRI two-dimensional image data; and 2, importing the two-dimensional image data obtained in the step 1 into 3D-DOCTOR software, reconstructing a three-dimensional model of the target reconstruction organ by using the 3D-DOCTOR software, and forming a three-dimensional image data file. The method comprises the steps of processing a target reconstructed organ by using the existing medical equipment, acquiring two-dimensional image data of CT or MRI, importing the two-dimensional image data into 3D-DOCTOR software, reconstructing a three-dimensional image of the target reconstructed organ by using the 3D-DOCTOR software and forming a three-dimensional image data file.
Description
The technical field is as follows:
the invention relates to an organ three-dimensional image reconstruction method, an operation navigation method and an operation auxiliary system.
Background art:
generally, medical imaging equipment obtains only two-dimensional tomographic images of a human body, which is not beneficial to people to obtain the relative spatial position relationship among tissues and can not meet the requirement of accurate analysis of data. The three-dimensional reconstruction can extract information from the image file to create a 3D model, can display organ tissues and lesion parts of a human body in a three-dimensional form, and provides useful visual information for clinical diagnosis and treatment of doctors. Three-dimensional reconstruction techniques are processes for reconstructing three-dimensional images of tissues or organs in the human body from two-dimensional image slices obtained by CT, MRI, and the like, using computer graphics, image processing, and related knowledge in the medical field. The three-dimensional reconstruction can clearly and truly reflect the intra-organ pipeline system and the relative position relation between the intra-organ pipeline system and the tumor, define the invasion range of the tumor and formulate a treatment scheme according to the reconstruction result. The three-dimensional reconstruction technology has high practical value in the aspects of preoperative diagnosis, preoperative evaluation, surgical treatment, prognosis evaluation and the like.
However, the currently found three-dimensional virtual image reconstruction method for organs is relatively complex, and the reconstructed image is not very accurate.
In addition, after the three-dimensional virtual image of the organ is reconstructed, if 3D browser software and 3D glasses are not available, the user can only watch the three-dimensional modeling two-dimensional image, the three-dimensional image, the procedure navigation and other operations cannot be presented, and the function is limited.
The invention content is as follows:
the invention aims to provide a method for reconstructing a three-dimensional image of an organ, which solves the technical problems that the method for reconstructing a three-dimensional virtual image of an organ in the prior art is relatively complex and the reconstructed image is not accurate.
The invention also aims to provide a surgical navigation method, which solves the technical problems that after the three-dimensional virtual image of the organ is reconstructed, only a three-dimensional modeling two-dimensional image can be viewed, three-dimensional images, surgical navigation and other operations cannot be presented, and the function is limited in the prior art.
It is still another object of the present invention to provide a surgical assistant system, which solves the problem that the surgical assistant system in the prior art cannot present a three-dimensional image.
The purpose of the invention is realized by the following technical scheme:
a method for reconstructing a three-dimensional image of an organ, comprising the steps of: step 1, aiming at a target reconstructed organ, processing the target reconstructed organ by using the existing medical equipment to obtain CT or MRI two-dimensional image data; and 2, importing the two-dimensional image data obtained in the step 1 into 3D-DOCTOR software, reconstructing a three-dimensional model of the target reconstruction organ by using the 3D-DOCTOR software, and forming a three-dimensional image data file.
In the step 2, after the two-dimensional image data in the step 1 is imported into the 3D-DOCTOR software, the name of the target reconstructed organ is set, the region of interest of the target reconstructed organ is drawn, the data format of the two-dimensional image data is set, the boundary of the target reconstructed organ is interactively extracted, and then the three-dimensional model of the target reconstructed organ is formed through surface rendering.
The above organ is blood vessel, viscera, bone or muscle.
A surgical navigation method comprises the following steps: step A: obtaining a three-dimensional model of a target reconstructed organ by using the organ three-dimensional virtual image reconstruction method and forming a three-dimensional image data file; and B: opening the three-dimensional image data file by using 3D browser software, and performing corresponding operation; and C: 3D/AR glasses are worn in the operation process, a three-dimensional image of a target reconstruction organ before the operation of a patient is observed, and the three-dimensional image is clearly compared with the anatomical structure of the patient in the operation.
In the step B, the three-dimensional image data file is opened by using 3D browser software, and the operations of 2D/3D mode switching, annotation, size measurement, color setting, or automatic playing are performed.
The 3D browser software has 7 modules, and the 7 modules include: module 1: the import model module is used for importing a three-dimensional image data file; and (3) module 2: the list module is used for hiding and displaying the three-dimensional model, manually moving the three-dimensional model and returning the three-dimensional model to the initial position; and a module 3: the 2D/3D switching module is used for selecting a three-dimensional model to be displayed in a 3D mode or a 2D mode; and (4) module: the annotation module is used for leaving a comment/drawing line at any point on the three-dimensional model and deleting the comment/drawing line; and a module 5: the coloring module is used for coloring the model or adjusting the transparency of the model; and a module 6: the automatic playing module is used for automatically rotating the model; and a module 7: and the measuring module is used for measuring the distance between any two points on the model.
A surgical assistance system characterized by: the three-dimensional image reconstruction system comprises a computer host and 3D/AR glasses, wherein the computer host is provided with an organ three-dimensional image reconstruction module and a 3D display module, the organ three-dimensional image reconstruction module is used for performing three-dimensional reconstruction on two-dimensional image data including a target extract obtained from CT or MRI to form a three-dimensional model and a three-dimensional image data file and sending the three-dimensional image data file to the 3D display module, and the 3D display module displays the three-dimensional image data file and sends the three-dimensional image data file to the 3D/AR glasses; the 3D/AR glasses are used for receiving and displaying the three-dimensional image data file.
The 3D display module described above includes: the import submodel is used for importing the three-dimensional image data file; the list submodule is used for hiding and displaying the three-dimensional model, manually moving the three-dimensional model and returning the three-dimensional model to the initial position; the annotation submodule is used for leaving an annotation/drawing line at any point on the three-dimensional model and deleting the annotation/drawing line; the coloring submodule is used for coloring the model or adjusting the transparency of the model; and the measuring submodule is used for measuring the distance between any two points on the model.
The 3D display module further comprises an automatic playing submodule, and the automatic playing submodule is used for automatically rotating and displaying the three-dimensional model at a certain speed.
The 3D display module further comprises a 2D/3D switching submodule, and the 2D/3D switching submodule is used for selecting to display the three-dimensional model in a 3D mode or a 2D mode.
The 3D/AR glasses comprise a high-definition micro display screen.
Compared with the prior art, the invention has the following effects:
1) the organ three-dimensional image reconstruction method of the invention processes the target reconstructed organ by using the existing medical equipment to obtain the two-dimensional image data of CT or MRI, then the two-dimensional image data is imported into 3D-DOCTOR software, and the three-dimensional image of the target reconstructed organ is reconstructed by using the 3D-DOCTOR software and a three-dimensional image data file is formed.
2) The surgical navigation method of the invention utilizes the organ three-dimensional virtual image reconstruction method to obtain the three-dimensional image data of the target reconstructed organ; then opening the three-dimensional image data by using 3D browser software, and carrying out corresponding operation; the 3D/AR glasses are worn in the operation process, the three-dimensional image of the preoperative target reconstruction organ of the patient is watched, the three-dimensional image is clearly compared with the anatomical structure of the patient in the operation, based on the presentation and observation of the three-dimensional model information, the operation path of the operation is clear for a doctor, the operation wound can be reduced, the operation accuracy of the surgeon is greatly improved, and better medical service is provided for the patient.
3) The operation auxiliary system converts the two-dimensional image data into the three-dimensional image, medical staff can watch the three-dimensional image by using the 3D/AR glasses, the three-dimensional image can clearly and truly reflect the pipeline system in the organ and the relative position relation between the pipeline system and the tumor, the invasion range of the tumor is determined, the medical staff can make a preoperative treatment scheme according to the three-dimensional image and perform auxiliary navigation in the operation, and the difficulty and risk of the operation are reduced.
4) Other advantages of the present invention are described in detail in the examples section.
Description of the drawings:
FIG. 1 is a flow chart illustrating a method for reconstructing a three-dimensional image of an organ according to an embodiment;
FIG. 2 is a flowchart illustrating a three-dimensional image reconstruction method for a blood vessel according to an embodiment of the present disclosure;
FIG. 3 is a flowchart of a visceral three-dimensional image reconstruction method disclosed in the second embodiment;
FIG. 4 is a diagram of the effect of a three-dimensional image of the liver reconstructed using a three-dimensional image reconstruction method of the viscera;
FIG. 5 is a flowchart illustrating a three-dimensional bone image reconstruction method according to a third embodiment;
FIG. 6 is a schematic diagram of a knee joint MRI two-dimensional image used in a bone three-dimensional image reconstruction method;
FIG. 7 is a schematic illustration of the effect of a knee joint reconstructed using a bone three-dimensional image reconstruction method;
FIG. 8 is a schematic diagram of skeletal structure in a three-dimensional image of a knee joint;
FIG. 9 is a flowchart of a surgical navigation method according to the fourth embodiment;
FIG. 10 is a block diagram of 3D browser software in a surgical navigation method;
FIG. 11 is a schematic view of an operation interface of 3D browser software in the surgical navigation method;
FIG. 12 is a block diagram of a surgical assistance system according to the fifth embodiment of the present disclosure;
FIG. 13 is a schematic diagram of a 3D display module in a surgical assistance system displaying a three-dimensional model in a 2D mode;
FIG. 14 is a schematic view of a 3D display module in a surgical assistance system displaying a three-dimensional model in a 3D mode;
FIG. 15 is a schematic diagram of the application of a measurement sub-module in the surgical assistance system;
FIG. 16 is a schematic diagram of 3D/AR glasses in the surgical assistance system;
FIG. 17 is a schematic view of the structure of 3D/AR glasses in the surgical assistance system.
The specific implementation mode is as follows:
the present invention will be described in further detail below with reference to specific embodiments and with reference to the accompanying drawings.
The first embodiment is as follows:
as shown in fig. 1, the present embodiment provides a method for reconstructing a three-dimensional image of an organ, including the following steps:
step 1, aiming at a target reconstructed organ, processing the target reconstructed organ by using the existing medical equipment to obtain CT or MRI two-dimensional image data;
and 2, importing the two-dimensional image data obtained in the step 1 into 3D-DOCTOR software, reconstructing a three-dimensional model of the target reconstruction organ by using the 3D-DOCTOR software, and forming a three-dimensional image data file.
In step 2, after the two-dimensional image data in step 1 is imported into 3D-DOCTOR software, the name of the target reconstructed organ is set, the region of interest of the target reconstructed organ is drawn, the data format of the two-dimensional image data is set, the boundary of the target reconstructed organ is interactively extracted, and then a three-dimensional model of the target reconstructed organ is formed by surface rendering.
As shown in fig. 2, the portal vein is three-dimensionally reconstructed as follows, taking the portal vein as an example, and the specific working process is as follows:
a1, scanning portal veins and hepatic veins of a patient by utilizing CT equipment of a hospital to form CT angiography (CTA), and acquiring CT data including the portal veins, wherein the CT data are stored in a Dicom format, the thickness of the layer is 2.0mm, and the image resolution is 512 × 512 pixels;
step B1: importing CT data of portal vein into 3D-DOCTOR software, and automatically setting picture real object proportion (Calibration) by the software;
step C1: the target extract is set as portal vein (Define object);
step D1: drawing a portal vein region of interest (ROI);
step E1: setting portal vein CT and interactively extracting the portal vein boundary;
step F1: fine-tuning portal vein borders (boundderies);
step G1: the portal vein Surface Rendering (Surface Rendering) forms a portal vein three-dimensional structure.
Example two:
as shown in fig. 3 and 4, the method for reconstructing a three-dimensional image of a liver according to this embodiment is similar to the method for reconstructing a three-dimensional image of a blood vessel, and the method for reconstructing a three-dimensional image of a liver by taking a liver as an example includes the following steps:
a2, scanning the liver of a patient by utilizing CT equipment of a hospital to form liver CT two-dimensional image data, storing the liver CT two-dimensional image data into a Dicom format, storing the two-dimensional image data into the Dicom format, wherein the layer thickness is 2.5mm, and the image resolution is 512 × 512 pixels;
step B2: importing the liver CT two-dimensional image data into 3D-DOCTOR software, and automatically setting picture real object proportion by the software;
step C2: the target extract is set as liver;
step D2: according to the method of automatic identification and manual correction of CT values, a 3D model comprising the liver and the blood vessels inside the liver is reconstructed.
The reconstructed 3D model of the three-dimensional image of the liver is shown in fig. 3.
Example three:
as shown in fig. 5 to 8, the present embodiment provides a bone three-dimensional image reconstruction method, which is similar to the blood vessel three-dimensional image reconstruction method, and the following three-dimensional reconstruction method is performed on a knee joint by taking the knee joint as an example, and specifically includes the following steps:
a3, scanning the knee joint of a patient by using Magnetic Resonance Imaging (MRI) equipment of a hospital to form knee joint MRI two-dimensional image data, wherein the two-dimensional image data are stored in a Dicom format, the layer thickness is 2.5mm, and the image resolution is 512 × 512 pixels;
step B3: importing knee joint MRI two-dimensional image data into 3D-DOCTOR software, and automatically setting picture real object proportion by the software;
step C3: the target extract is set as a knee joint;
step D3: according to the method of automatic identification and manual correction of MRI values, a 3D model comprising the knee joint and the muscles around the knee joint is reconstructed.
Fig. 7 and 8 show 3D models of the knee joint and the muscles around the knee joint after the three-dimensional image reconstruction of the knee joint.
Example four:
as shown in fig. 9, the present embodiment provides a surgical navigation method, which is specifically described below by taking portal vein and hepatic vein as an example, and includes the following steps:
step A4: obtaining a three-dimensional model of a target reconstructed blood vessel by using the blood vessel three-dimensional virtual image reconstruction method and forming a three-dimensional image data file;
step B4: opening the three-dimensional image data file by using 3D browser software, and performing corresponding operation;
step C4: 3D/AR glasses are worn in the operation process, a three-dimensional image of a target reconstructed blood vessel before the operation of the patient is observed, and the three-dimensional image is clearly compared with the anatomical structure of the patient in the operation.
In the step B4, the 3D browser software is used to open the three-dimensional image data file, and perform operations of 2D/3D mode switching, annotation, size measurement, color setting, or automatic playback.
As shown in fig. 10 and 11, the 3D browser software has 7 modules, and as shown in fig. 10, the 7 modules include:
module 1: the import model module is used for importing a three-dimensional image data file;
and (3) module 2: the list module is used for hiding and displaying the three-dimensional model, manually moving the three-dimensional model and returning the three-dimensional model to the initial position;
and a module 3: the 2D/3D switching module is used for selecting a three-dimensional model to be displayed in a 3D mode or a 2D mode;
and (4) module: the annotation module is used for leaving a comment/drawing line at any point on the three-dimensional model and deleting the comment/drawing line;
and a module 5: the coloring module is used for coloring the model or adjusting the transparency of the model;
and a module 6: the automatic playing module is used for automatically rotating the model;
and a module 7: and the measuring module is used for measuring the distance between any two points on the model.
Example five:
as shown in fig. 12, the present embodiment provides a surgical assistant system, characterized in that: the three-dimensional image reconstruction system comprises a computer host 3 and 3D/AR glasses 5, wherein the computer host 3 is provided with an organ three-dimensional image reconstruction module 11 and a 3D display module 32, the organ three-dimensional image reconstruction module 31 is used for performing three-dimensional reconstruction on two-dimensional image data including a target extract obtained from CT or MRI to form a three-dimensional model and a three-dimensional image data file and sending the three-dimensional image data file to the 3D display module 32, and the 3D display module 32 displays the three-dimensional image data file and sends the three-dimensional image data file to the 3D/AR glasses 5; the 3D/AR glasses 5 are used for receiving and displaying three-dimensional image data files. Medical personnel can use 3D AR glasses 5 can watch three-dimensional image, and three-dimensional image can clearly and truly reflect the interior pipe-line system of organ and the relative position relation with the tumour, makes clear the infringement scope of tumour, and medical personnel can make preoperative treatment scheme and carry out the assistance-navigation in the operation according to three-dimensional image, reduces the degree of difficulty and the risk of operation.
Specifically, the organ three-dimensional image reconstruction module 31 reconstructs the two-dimensional image data into the three-dimensional image data file by using the organ three-dimensional image reconstruction method according to the first embodiment, the second embodiment, or the third embodiment.
The present embodiment is specifically described by taking a portal vein as an example. The target extract is internal blood vessels of human bodies such as portal vein, hepatic vein, inferior vena cava and artery.
The 3D display module 32 includes:
an import submodel 321 for importing a three-dimensional image data file;
a list submodule 322 for hiding and displaying the three-dimensional model, manually moving the three-dimensional model, and returning the three-dimensional model to an initial position;
an annotation submodule 323 for leaving an annotation/drawing line, and deleting an annotation/drawing line at an arbitrary point on the three-dimensional model; specifically, the annotation can be left at any point on the model by clicking the point, a line can be left at any point on the three-dimensional model by long-pressing the left mouse button and dragging, and a group of lines drawn last time can be deleted by clicking the drawn line on the three-dimensional model once.
A coloring sub-module 324 for coloring the model or adjusting the transparency of the model;
a measurement submodule 325 for measuring the distance between any two points on the model.
Medical personnel can directly add notes, lines, colors and measure distances in the three-dimensional image, so that the medical personnel can carry out preoperative preparation in more detail.
Specifically, the import submodel 321 supports importing files in multiple formats such as OBJ and ST L, the annotation submodule 323 can leave an annotation at any point on the model by clicking the point, can leave a line at any point on the three-dimensional model by long-pressing the left mouse button and dragging, and can delete a group of lines drawn at the previous time by clicking the drawn lines on the three-dimensional model once, the coloring submodule 324 selects colors in a color wheel to color the selected part after selecting any part of the three-dimensional model, and the long bar of the dragging menu can adjust the transparency of the three-dimensional model, and as shown in fig. 15, the measuring submodule 325 can measure the distance between two points by clicking any two points on the three-dimensional model.
The 3D display module 32 further includes an auto-play sub-module 326, which is used to automatically display the three-dimensional model in a rotating manner at a certain speed.
The 3D display module 32 further includes a 2D/3D switching submodule 327, as shown in fig. 13 and 14, the 2D/3D switching submodule 327 is used to select to display the three-dimensional model in a 3D mode or a 2D mode.
As shown in fig. 16 and 17, the 3D/AR glasses 5 include a micro-display imaging optical system, which includes a micro-display 10 and an optical prism 20, the optical prism is provided with an incident surface 2, a total reflection surface 22 and an exit surface 23, wherein the incident surface 21 is located on the top of the optical prism 20, the exit surface 23 and the total reflection surface 22 are located on the left and right sides of the optical prism 20, the exit surface 23 is located on the side close to the eyeball 40 of the person, light generated by a video image on the micro-display enters the optical prism 20 from the incident surface 21, is reflected to the exit surface 23 by the total reflection surface 22, is refracted from the exit surface 23 to the eyeball of the person and is imaged, and the video image on the micro-display is magnified by the optical prism 20 to form a magnified virtual image on the eyeball 40 of the person.
The micro-display 10 in the 3D/AR glasses is a high-definition micro-display screen. The optical prism 20 of the 3D/AR glasses does not obstruct the user's view, and the human eyeball can view the solid scene outside the virtual image while seeing the three-dimensional video image (virtual image) from the optical prism 20. The optical prism head-mounted display has the characteristics of being clear to see, light in weight, comfortable to wear, low in power consumption and capable of being used in any posture.
The above embodiments are only preferred embodiments of the present invention, but the present invention is not limited thereto, and any other changes, modifications, substitutions, combinations, simplifications, which are made without departing from the spirit and principle of the present invention, are all equivalent replacements within the protection scope of the present invention.
Claims (11)
1. A method for reconstructing a three-dimensional image of an organ, comprising the steps of:
step 1, aiming at a target reconstructed organ, processing the target reconstructed organ by using the existing medical equipment to obtain CT or MRI two-dimensional image data;
and 2, importing the two-dimensional image data obtained in the step 1 into 3D-DOCTOR software, reconstructing a three-dimensional model of the target reconstruction organ by using the 3D-DOCTOR software, and forming a three-dimensional image data file.
2. The method for reconstructing a three-dimensional image of an organ according to claim 1, wherein: in the step 2, after the two-dimensional image data in the step 1 is imported into 3D-DOCTOR software, the name of the target reconstructed organ is set, the region of interest of the target reconstructed organ is drawn, the data format of the two-dimensional image data is set, the boundary of the target reconstructed organ is interactively extracted, and then a three-dimensional model of the target reconstructed organ is formed through surface rendering.
3. The method for reconstructing a three-dimensional image of an organ according to claim 2, wherein: the organ is a blood vessel, an internal organ, a bone or a muscle.
4. A surgical navigation method is characterized in that: it comprises the following steps:
step A: obtaining a three-dimensional model of a target reconstructed organ and forming a three-dimensional image data file by using the organ three-dimensional virtual image reconstruction method according to claim 1, 2 or 3;
and B: opening the three-dimensional image data file by using 3D browser software, and performing corresponding operation;
and C: 3D/AR glasses are worn in the operation process, a three-dimensional image of a target reconstruction organ before the operation of a patient is observed, and the three-dimensional image is clearly compared with the anatomical structure of the patient in the operation.
5. The surgical navigation method according to claim 4, wherein: and B, opening the three-dimensional image data file by using 3D browser software, and carrying out 2D/3D mode switching, annotation, size measurement, color setting or automatic playing.
6. The surgical navigation method according to claim 4, wherein the 3D browser software has 7 modules, the 7 modules including:
module 1: the import model module is used for importing a three-dimensional image data file;
and (3) module 2: the list module is used for hiding and displaying the three-dimensional model, manually moving the three-dimensional model and returning the three-dimensional model to the initial position;
and a module 3: the 2D/3D switching module is used for selecting a three-dimensional model to be displayed in a 3D mode or a 2D mode;
and (4) module: the annotation module is used for leaving a comment/drawing line at any point on the three-dimensional model and deleting the comment/drawing line;
and a module 5: the coloring module is used for coloring the model or adjusting the transparency of the model;
and a module 6: the automatic playing module is used for automatically rotating the model;
and a module 7: and the measuring module is used for measuring the distance between any two points on the model.
7. A surgical assistance system characterized by: the three-dimensional image reconstruction system comprises a computer host and 3D/AR glasses, wherein the computer host is provided with an organ three-dimensional image reconstruction module and a 3D display module, the organ three-dimensional image reconstruction module is used for performing three-dimensional reconstruction on two-dimensional image data including a target extract obtained from CT or MRI to form a three-dimensional model and a three-dimensional image data file and sending the three-dimensional image data file to the 3D display module, and the 3D display module displays the three-dimensional image data file and sends the three-dimensional image data file to the 3D/AR glasses; the 3D/AR glasses are used for receiving and displaying the three-dimensional image data file.
8. The surgical assistance system of claim 7, wherein the 3D display module comprises:
the import submodel is used for importing the three-dimensional image data file;
the list submodule is used for hiding and displaying the three-dimensional model, manually moving the three-dimensional model and returning the three-dimensional model to the initial position;
the annotation submodule is used for leaving an annotation/drawing line at any point on the three-dimensional model and deleting the annotation/drawing line;
the coloring submodule is used for coloring the model or adjusting the transparency of the model;
and the measuring submodule is used for measuring the distance between any two points on the model.
9. The surgical assistance system according to claim 8, wherein: the 3D display module further comprises an automatic playing submodule, and the automatic playing submodule is used for automatically rotating and displaying the three-dimensional model at a certain speed.
10. The surgical assistance system according to claim 8, wherein: the 3D display module further comprises a 2D/3D switching submodule, and the 2D/3D switching submodule is used for selecting to display the three-dimensional model in a 3D mode or a 2D mode.
11. A surgical assistance system according to any one of claims 7 to 10, wherein: the 3D/AR glasses comprise a high-definition micro-display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010258116.0A CN111462314B (en) | 2020-04-03 | 2020-04-03 | Organ three-dimensional image reconstruction method, operation navigation method and operation auxiliary system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010258116.0A CN111462314B (en) | 2020-04-03 | 2020-04-03 | Organ three-dimensional image reconstruction method, operation navigation method and operation auxiliary system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111462314A true CN111462314A (en) | 2020-07-28 |
| CN111462314B CN111462314B (en) | 2023-07-21 |
Family
ID=71680276
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010258116.0A Active CN111462314B (en) | 2020-04-03 | 2020-04-03 | Organ three-dimensional image reconstruction method, operation navigation method and operation auxiliary system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111462314B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113538665A (en) * | 2021-07-21 | 2021-10-22 | 无锡艾米特智能医疗科技有限公司 | Organ three-dimensional image reconstruction compensation method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150049081A1 (en) * | 2013-08-13 | 2015-02-19 | Dane Coffey | Computer Visualization of Anatomical Items |
| CN108847111A (en) * | 2018-06-13 | 2018-11-20 | 广州迈普再生医学科技股份有限公司 | A kind of cranium brain simulation model and preparation method thereof |
-
2020
- 2020-04-03 CN CN202010258116.0A patent/CN111462314B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150049081A1 (en) * | 2013-08-13 | 2015-02-19 | Dane Coffey | Computer Visualization of Anatomical Items |
| CN108847111A (en) * | 2018-06-13 | 2018-11-20 | 广州迈普再生医学科技股份有限公司 | A kind of cranium brain simulation model and preparation method thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113538665A (en) * | 2021-07-21 | 2021-10-22 | 无锡艾米特智能医疗科技有限公司 | Organ three-dimensional image reconstruction compensation method |
| CN113538665B (en) * | 2021-07-21 | 2024-02-02 | 无锡艾米特智能医疗科技有限公司 | Organ three-dimensional image reconstruction compensation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111462314B (en) | 2023-07-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Bernhardt et al. | The status of augmented reality in laparoscopic surgery as of 2016 | |
| JP4421016B2 (en) | Medical image processing device | |
| JP5551957B2 (en) | Projection image generation apparatus, operation method thereof, and projection image generation program | |
| Nelson et al. | Three-dimensional ultrasound imaging | |
| Bichlmeier et al. | Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality | |
| JP6080248B2 (en) | Three-dimensional image display apparatus and method, and program | |
| JP2015180292A (en) | Medical image-processing apparatus | |
| US9198640B2 (en) | System and methods for providing information related to a tissue region of a subject | |
| JP2020506452A (en) | HMDS-based medical image forming apparatus | |
| JP2008509773A (en) | Flexible 3D rotational angiography-computed tomography fusion method | |
| Kutter et al. | Real-time volume rendering for high quality visualization in augmented reality | |
| JP5961504B2 (en) | Virtual endoscopic image generating apparatus, operating method thereof, and program | |
| Abou El-Seoud et al. | An interactive mixed reality ray tracing rendering mobile application of medical data in minimally invasive surgeries | |
| JP4122463B2 (en) | Method for generating medical visible image | |
| CN111369675B (en) | Three-dimensional visual model reconstruction method and device based on lung nodule pleural projection | |
| Ehricke | SONOSim3D: a multimedia system for sonography simulation and education with an extensible case database | |
| CN116188677A (en) | Three-dimensional reconstruction method, system and device for vascular intervention operation area | |
| JP4996128B2 (en) | Medical image processing apparatus and medical image processing method | |
| CN111462314B (en) | Organ three-dimensional image reconstruction method, operation navigation method and operation auxiliary system | |
| Zhang et al. | Autostereoscopic 3D augmented reality navigation for laparoscopic surgery: a preliminary assessment | |
| Robb | Virtual endoscopy: evaluation using the visible human datasets and comparison with real endoscopy in patients | |
| Klein et al. | Visual computing for medical diagnosis and treatment | |
| Karner et al. | Single-shot deep volumetric regression for mobile medical augmented reality | |
| CN111862312B (en) | Brain blood vessel display device and method | |
| CN115105204A (en) | Laparoscope augmented reality fusion display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |