CN109147035B - Three-dimensional model display method and system - Google Patents
Three-dimensional model display method and system Download PDFInfo
- Publication number
- CN109147035B CN109147035B CN201810878700.9A CN201810878700A CN109147035B CN 109147035 B CN109147035 B CN 109147035B CN 201810878700 A CN201810878700 A CN 201810878700A CN 109147035 B CN109147035 B CN 109147035B
- Authority
- CN
- China
- Prior art keywords
- dimensional model
- processed
- local
- model data
- local area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Abstract
The invention discloses a display method and a display system of a three-dimensional model, wherein the display method comprises the following steps: acquiring overall three-dimensional model data of an object to be processed; acquiring an integral region corresponding to the integral three-dimensional model data, and dividing a first local region corresponding to a part to be processed of the object to be processed from the integral region; acquiring first three-dimensional model data of the part to be processed in the first local area; and displaying the first local three-dimensional model of the part to be processed according to the first three-dimensional model data. The invention realizes the real-time processing condition of the three-dimensional model to be quickly refreshed and displayed by means of local reconstruction of the three-dimensional model, avoids the problems of visual blocking and information delay caused by untimely calculation of the whole three-dimensional model in the prior art, ensures that a user can know the real-time processing condition of the three-dimensional model in time, and improves the accuracy of user judgment.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method and a system for displaying a three-dimensional model.
Background
With the advent and popularity of modern medical imaging devices such as CT (Computed Tomography), MRI (Magnetic Resonance Imaging ) and rapid development of computer science and technology, medical image processing is accompanied by the emergence of medical imaging, and thus, traditional medical diagnostic methods are revolutionarily changed.
Traditional medical image observation modes are generally based on two-dimensional images. However, with the popular application of image processing algorithms, computer visualization techniques, machine learning methods, etc., three-dimensional visualization of medical images provides new choices for doctors. In the operation and diagnosis process, a medical image navigation technology is used, and a doctor can directly observe a vivid three-dimensional image through the assistance of a computer, so that the diagnosis efficiency and accuracy are improved. For example, in bone surgery polishing, a bone model with three-dimensional display can be refreshed in real time according to the actual drilling work progress, so as to provide real-time information for doctors to refer to. The refreshing of the three-dimensional bone model mainly comprises the following two steps: 1) Updating the three-dimensional bone model data according to the latest polishing progress; 2) And updating the three-dimensional bone model according to the updated three-dimensional bone model data and rapidly refreshing the display. However, in the prior art, when the three-dimensional bone model is updated, the whole three-dimensional bone model is updated in the process, so that untimely calculation is easy to occur, visual blocking and information delay are caused, and the diagnosis efficiency and accuracy of doctors are affected.
Disclosure of Invention
The invention aims to solve the technical problems that in the prior art, the whole three-dimensional model is updated in the process of updating and displaying the three-dimensional model, and the defects that the calculation is not timely, visual blocking and information delay are caused easily, so that the diagnosis efficiency and the accuracy of doctors are affected and the like are overcome.
The invention solves the technical problems by the following technical scheme:
the invention provides a display method of a three-dimensional model, which comprises the following steps:
s1, acquiring overall three-dimensional model data of an object to be processed;
s2, acquiring an integral region corresponding to the integral three-dimensional model data, and dividing a first local region corresponding to a part to be processed of the object to be processed from the integral region;
s3, acquiring first three-dimensional model data of the part to be processed in the first local area;
and S4, displaying the first local three-dimensional model of the part to be processed according to the first three-dimensional model data.
Preferably, step S1 further comprises:
and displaying the overall three-dimensional model of the object to be processed according to the overall three-dimensional model data.
Preferably, step S4 specifically includes:
refreshing and displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
the step S4 further comprises:
and S5, displaying the whole three-dimensional model and the first local three-dimensional model in an overlapping mode.
Preferably, step S2 further comprises:
dividing a second local area from the first local area;
step S3 further includes:
acquiring second three-dimensional model data of a first part to be processed in the second local area;
the step S4 further includes:
refreshing and displaying a second local three-dimensional model of the first part to be processed according to the second three-dimensional model data;
the step S4 further comprises:
and displaying the whole three-dimensional model, the first local three-dimensional model and the second local three-dimensional model in an overlapping mode.
Preferably, the step of refreshing and displaying the second local three-dimensional model of the portion to be processed further comprises:
judging whether the first part to be processed in the second local area is processed or not, if so, dividing a new second local area in the first local area again for processing and refreshing display until the part to be processed in the first local area is processed, and stopping refreshing display.
Preferably, step S1 specifically includes:
acquiring overall three-dimensional model data of an object to be processed by using a Maring cube algorithm (a surface drawing algorithm);
the step S3 specifically comprises the following steps:
acquiring first three-dimensional model data of the part to be processed in the first local area by using a Marching cube algorithm;
and acquiring second three-dimensional model data of the first part to be processed in the second local area by using a Maring cube algorithm.
Preferably, the object to be treated comprises a bone, and the portion to be treated comprises a portion to be ground in the bone.
The invention also provides a display system of the three-dimensional model, which comprises an overall model data acquisition module, an overall region acquisition module, a first local region acquisition module, a first model data acquisition module and a first local model acquisition module;
the overall model data acquisition module is used for acquiring overall three-dimensional model data of the object to be processed;
the whole region acquisition module is used for acquiring a whole region corresponding to the whole three-dimensional model data;
the first local area acquisition module is used for dividing a first local area corresponding to a part to be processed of the object to be processed from the whole area;
the first model data acquisition module is used for acquiring first three-dimensional model data of the part to be processed in the first local area;
the first local model acquisition module is used for displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data.
Preferably, the display system further comprises an integral model display module;
the whole model display module is used for displaying the whole three-dimensional model of the object to be processed according to the whole three-dimensional model data.
Preferably, the display system further comprises a first overlay display module;
the first local model acquisition module is further used for refreshing and displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
the first overlapping display module is used for overlapping the whole three-dimensional model and the first local three-dimensional model.
Preferably, the display system further comprises a second local area acquisition module, a second model data acquisition module, a second local model acquisition module and a second overlapping display module;
the second local area acquisition module is used for dividing a second local area from the first local area;
the second model data acquisition module is used for acquiring second three-dimensional model data of the first part to be processed in the second local area;
the second local model acquisition module refreshes and displays a second local three-dimensional model of the first part to be processed according to the second three-dimensional model data;
the second overlapping display module is used for overlapping the whole three-dimensional model, the first local three-dimensional model and the second local three-dimensional model.
Preferably, the display system further comprises a judging module;
the judging module is used for judging whether the first part to be processed in the second local area is processed or not, and if so, dividing a new second local area in the first local area again for processing and refreshing display until the part to be processed in the first local area is processed, and stopping refreshing display.
Preferably, the overall model data acquisition module is used for acquiring overall three-dimensional model data of the object to be processed by using a Marving cube algorithm;
the first model data acquisition module is used for acquiring first three-dimensional model data of the part to be processed in the first local area by using a Maring cube algorithm;
the second model data acquisition module is used for acquiring second three-dimensional model data of the first part to be processed in the second local area by using a Maring cube algorithm.
Preferably, the object to be treated comprises a bone, and the portion to be treated comprises a portion to be ground in the bone.
The invention has the positive progress effects that:
according to the method and the device, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, the local three-dimensional model of the part to be processed is refreshed and displayed in real time according to the obtained three-dimensional model data until the part to be processed is completely processed, the real-time processing condition of the three-dimensional model is refreshed and displayed quickly in a mode of reconstructing the three-dimensional model locally, the problems of visual blocking and information delay caused by the fact that the integral three-dimensional model is updated in the prior art are avoided, a user can acquire the real-time processing condition of the three-dimensional model timely, and the accuracy of user judgment is improved.
Drawings
Fig. 1 is a flowchart of a method for displaying a three-dimensional model according to embodiment 1 of the present invention.
Fig. 2 is a flowchart of a method for displaying a three-dimensional model according to embodiment 2 of the present invention.
Fig. 3 is a flowchart of a method for displaying a three-dimensional model according to embodiment 3 of the present invention.
Fig. 4 is a schematic block diagram of a display system for a three-dimensional model according to embodiment 4 of the present invention.
Fig. 5 is a schematic block diagram of a display system for a three-dimensional model according to embodiment 5 of the present invention.
Fig. 6 is a schematic block diagram of a display system for a three-dimensional model according to embodiment 6 of the present invention.
Detailed Description
The invention is further illustrated by means of the following examples, which are not intended to limit the scope of the invention.
Example 1
As shown in fig. 1, the method for displaying a three-dimensional model according to the present embodiment includes:
s101, acquiring overall three-dimensional model data of an object to be processed;
s102, acquiring an integral region corresponding to integral three-dimensional model data, and dividing a first local region corresponding to a part to be processed of an object to be processed from the integral region;
s103, acquiring first three-dimensional model data of a part to be processed in a first local area;
s104, displaying the first local three-dimensional model of the part to be processed according to the first three-dimensional model data.
Wherein the object to be treated comprises bones, and the part to be treated comprises a part to be polished in the bones; in addition, the object to be treated includes bone but is not limited to bone, and may also include other objects to be treated.
In the embodiment, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, and the local three-dimensional model of the part to be processed is displayed according to the obtained three-dimensional model data, so that the real-time processing condition of the three-dimensional model is rapidly displayed in a mode of reconstructing the three-dimensional model locally, the problems of visual blocking and information delay caused by untimely calculation of the integral three-dimensional model in the prior art are avoided, a user can know the real-time processing condition of the three-dimensional model in time, and the accuracy of user judgment is improved.
Example 2
As shown in fig. 2, the display method of the three-dimensional model of the present embodiment is a further improvement of embodiment 1, specifically:
the step S101 specifically includes:
s1011, acquiring overall three-dimensional model data of an object to be processed by using a Marching cube algorithm; in particular, the method comprises the steps of,
11 Reading the region information of the whole region corresponding to the object to be processed into a three-dimensional array;
12 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
13 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
14 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
15 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain an integral surface patch, thereby obtaining integral three-dimensional model data.
The step S103 specifically includes:
s1031, acquiring first three-dimensional model data of a part to be processed in a first local area by using a Maring cube algorithm; in particular, the method comprises the steps of,
21 Reading information of a first local area of the part to be processed into a three-dimensional array;
22 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
23 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
24 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
25 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain a first local panel and obtain first local model data;
26 Repeating steps 21) -25) until the patch calculation in all voxels in the first local region is completed.
Step S101 further includes:
s1012, displaying the whole three-dimensional model of the object to be processed according to the whole three-dimensional model data.
The step S104 specifically includes:
s1041, refreshing and displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
step S104 further includes:
and S105, overlapping and displaying the whole three-dimensional model and the first local three-dimensional model.
Wherein, the overlapped display means that only the first local three-dimensional model corresponding to the part to be processed is refreshed and displayed on the basis of displaying the whole three-dimensional model.
In addition, the open source library VTK (an open source software system) is used to implement three-dimensional model display, and display parameters include a display pipeline, set illumination parameters, camera parameters, rendering parameters, display colors of the background, display colors of the model, transparency, and the like.
In the embodiment, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, the local three-dimensional model of the part to be processed is refreshed and displayed in real time according to the obtained three-dimensional model data, and the integral three-dimensional model and the first local three-dimensional model are overlapped and displayed, so that the real-time processing condition of the three-dimensional model is refreshed and displayed quickly in a local three-dimensional model reconstruction mode, the problems of visual blocking and information delay caused by untimely calculation of the integral three-dimensional model in the prior art are avoided, a user can know the real-time processing condition of the three-dimensional model in time, and the accuracy of user judgment is improved.
Example 3
As shown in fig. 3, the display method of the three-dimensional model of the present embodiment is a further improvement of embodiment 1, specifically:
the step S101 specifically includes:
s1011, acquiring overall three-dimensional model data of an object to be processed by using a Marching cube algorithm; in particular, the method comprises the steps of,
11 Reading the region information of the whole region corresponding to the object to be processed into a three-dimensional array;
12 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
13 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
14 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
15 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain an integral surface patch, thereby obtaining integral three-dimensional model data.
Step S101 further includes:
s1012, displaying the whole three-dimensional model of the object to be processed according to the whole three-dimensional model data.
Step S102 further includes:
dividing a second local area from the first local area;
wherein when the object to be treated is bone, the portion to be treated is a portion to be ground in the bone, and the second partial region is divided into at least a standard that can envelope a grinding surgical instrument (such as an orthopedic grinding drill bit) for grinding the bone. The general orthopaedics grinding drill bit is spherical, and the grinding instrument model can be defined as a sphere with the coordinates of the sphere center (x, y, z) and the radius r.
Acquiring coordinate position information of the polishing surgical instrument in real time through an optical positioning instrument, converting the coordinate position information into coordinates of a bone model three-dimensional space through space coordinates, and representing the coordinates as (x) drill ,y drill ,z drill ) The method comprises the steps of carrying out a first treatment on the surface of the Wherein x is drill ,y drill ,z drill Refers to the center coordinates of the abrading surgical instrument. If the abrading surgical instrument is a sphere, wherein x is drill ,y drill ,z drill Refers to the coordinates of the sphere center of the sphere model.
In addition, according to actual needs, the communication module can be in communication connection with the optical positioning instrument, and then the real-time coordinate position information sent by the optical positioning instrument is received through the communication module.
Step S1031 further includes:
acquiring second three-dimensional model data of the first part to be processed in the second local area by using a Maring cube algorithm; in particular, the method comprises the steps of,
31 Reading information of a second local area of the part to be processed into a three-dimensional array;
32 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
33 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
34 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
35 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain a first local panel and obtain first local model data;
36 Repeating steps 31) -35) until the patch calculation in all voxels in the second local region is completed. Step S104 further includes:
refreshing and displaying a second local three-dimensional model of the first part to be processed according to the second three-dimensional model data;
step S104 further includes:
and S106, overlapping and displaying the whole three-dimensional model, the first local three-dimensional model and the second local three-dimensional model.
Wherein, the overlapped display means that only the second local three-dimensional model corresponding to the part to be processed is refreshed and displayed on the basis of displaying the whole three-dimensional model and the first local three-dimensional model.
The step of refreshing the second local three-dimensional model of the portion to be processed further comprises, after the step of refreshing:
judging whether the first part to be processed in the second local area is processed or not, if so, dividing a new second local area in the first local area again for processing and refreshing display until the part to be processed in the first local area is processed, and stopping refreshing display.
In conclusion, the reconstruction period of the three-dimensional model surface slice is effectively shortened by adopting a local Maring cube algorithm, the three-dimensional model of the bone can be quickly refreshed and displayed in the orthopedic operation, and the actual polishing progress is displayed; can help doctors to quickly know the actual polishing progress, and provides effective reference for surgery and diagnosis and treatment.
The following is a test computer for testing the refreshing display effect of the three-dimensional model in this embodiment, which is specifically as follows:
(1) Hardware configuration and software environment:
hardware configuration: computer model: GL502VML; CPU (controller): intel (R) Core (TM) i7-6700HQ CPU@2.60GHz (8 CPUs), -2.6 GHz; memory: 8192MB of RAM; GPU (graphics processor): NVDIA GeForce GTX 1060;
software environment: windows10 (64-bit operating system); necessary software: VS2015, VTK7.1 (VS 2015, VTK7.1 are all a development software).
(2) Test data
The bone stock data size for the test was: 200X 224, assuming that each region is a cube, taking a first partial region of size 100X 100 according to the predetermined polishing speed of the bone, and taking the second part with the size of 40 multiplied by 40, and carrying out 99 times of display refreshing display on the orthopaedics grinding drill with the size of 20 multiplied by 20.
(3) Test results
Refresh display cycle time for the second partial region: 28 milliseconds;
refresh display cycle time for first partial region: 151 milliseconds;
the time taken for 99 cycles of reconstruction and refreshing is: 5963 milliseconds, i.e., an average one refresh display time of about 60.23 milliseconds;
in the prior art, the Marching Cubes calculation is performed on the whole skeleton model, and the average one-time refreshing display period is about 984.63 milliseconds, namely, is far longer than the average one-time refreshing display time 60.23 milliseconds. Therefore, the technical scheme of the embodiment can effectively solve the problems that in the prior art, the whole three-dimensional model is updated for a long time, and visual blocking and information delay are easily caused due to untimely calculation.
In the embodiment, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, and the local three-dimensional model of the part to be processed is refreshed and displayed in real time according to the obtained three-dimensional model data until the part to be processed is completely processed, so that the real-time processing condition of the three-dimensional model is refreshed and displayed quickly by means of local reconstruction of the three-dimensional model, the problems of visual blocking and information delay caused by untimely calculation of the integral three-dimensional model in the prior art are avoided, the user can know the real-time processing condition of the three-dimensional model in time, and the accuracy of user judgment is improved.
Example 4
As shown in fig. 4, the display system of the three-dimensional model of the present embodiment includes an entire model data acquisition module 1, an entire region acquisition module 2, a first partial region acquisition module 3, a first model data acquisition module 4, and a first partial model acquisition module 5.
The overall model data acquisition module 1 is used for acquiring overall three-dimensional model data of an object to be processed;
the whole region acquisition module 2 is used for acquiring a whole region corresponding to the whole three-dimensional model data;
the first local area acquisition module 3 is used for dividing a first local area corresponding to a part to be processed of the object to be processed from the whole area;
the first model data acquisition module 4 is used for acquiring first three-dimensional model data of the part to be processed in the first local area;
the first local model acquisition module 5 is configured to display a first local three-dimensional model of the portion to be processed according to the first three-dimensional model data.
Wherein the object to be treated comprises bones, and the part to be treated comprises a part to be polished in the bones; in addition, the object to be treated includes bone but is not limited to bone, and may also include other objects to be treated.
In the embodiment, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, and the local three-dimensional model of the part to be processed is refreshed and displayed in real time according to the obtained three-dimensional model data until the part to be processed is completely processed, so that the real-time processing condition of the three-dimensional model is refreshed and displayed quickly by means of local reconstruction of the three-dimensional model, the problems of visual blocking and information delay caused by untimely calculation of the integral three-dimensional model in the prior art are avoided, the user can know the real-time processing condition of the three-dimensional model in time, and the accuracy of user judgment is improved.
Example 5
As shown in fig. 5, the display system of the three-dimensional model of the present embodiment is a further improvement of embodiment 4, specifically:
the overall model data acquisition module 1 is used for acquiring overall three-dimensional model data of an object to be processed by using a Maring cube algorithm; in particular, the method comprises the steps of,
11 Reading the region information of the whole region corresponding to the object to be processed into a three-dimensional array;
12 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
13 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
14 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
15 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain an integral surface patch, thereby obtaining integral three-dimensional model data.
The first model data acquisition module 4 is used for acquiring first three-dimensional model data of a part to be processed in the first local area by using a Maring cube algorithm; in particular, the method comprises the steps of,
21 Reading information of a first local area of the part to be processed into a three-dimensional array;
22 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
23 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
24 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
25 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain a first local panel and obtain first local model data;
26 Repeating steps 21) -25) until the patch calculation in all voxels in the first local region is completed.
The display system of the present embodiment further includes an integral model display module 6 and a first overlay display module 7.
The whole model display module 6 is used for displaying the whole three-dimensional model of the object to be processed according to the whole three-dimensional model data.
The first local model obtaining module 5 is further configured to refresh and display a first local three-dimensional model of the portion to be processed according to the first three-dimensional model data;
the first overlay display module 7 is configured to overlay the entire three-dimensional model and the first local three-dimensional model.
Wherein, the overlapped display means that only the first local three-dimensional model corresponding to the part to be processed is refreshed and displayed on the basis of displaying the whole three-dimensional model.
In addition, the open source library VTK (an open source software system) is used to implement three-dimensional model display, and display parameters include a display pipeline, set illumination parameters, camera parameters, rendering parameters, display colors of the background, display colors of the model, transparency, and the like.
In the embodiment, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, the local three-dimensional model of the part to be processed is refreshed and displayed in real time according to the obtained three-dimensional model data, and the integral three-dimensional model and the first local three-dimensional model are overlapped and displayed, so that the real-time processing condition of the three-dimensional model is refreshed and displayed quickly in a local three-dimensional model reconstruction mode, the problems of visual blocking and information delay caused by untimely calculation of the integral three-dimensional model in the prior art are avoided, a user can know the real-time processing condition of the three-dimensional model in time, and the accuracy of user judgment is improved.
Example 6
As shown in fig. 6, the display method of the three-dimensional model of the present embodiment is a further improvement of embodiment 4, specifically:
the overall model data acquisition module 1 is used for acquiring overall three-dimensional model data of an object to be processed by using a Maring cube algorithm; in particular, the method comprises the steps of,
11 Reading the region information of the whole region corresponding to the object to be processed into a three-dimensional array;
12 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
13 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
14 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
15 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain an integral surface patch, thereby obtaining integral three-dimensional model data.
The display system further comprises an overall model display module 6, a second local area acquisition module 8, a second model data acquisition module 9, a second local model acquisition module 10, a second overlay display module 11 and a judgment module 12.
The whole model display module 6 is used for displaying the whole three-dimensional model of the object to be processed according to the whole three-dimensional model data.
The second local area acquisition module 8 is configured to divide a second local area from the first local area;
wherein when the object to be treated is bone, the portion to be treated is a portion to be ground in the bone, and the second partial region is divided into at least a standard that can envelope a grinding surgical instrument (such as an orthopedic grinding drill bit) for grinding the bone. The general orthopaedics grinding drill bit is spherical, and the grinding instrument model can be defined as a sphere with the coordinates of the sphere center (x, y, z) and the radius r.
Acquiring coordinate position information of the polishing surgical instrument in real time through an optical positioning instrument, converting the coordinate position information into coordinates of a bone model three-dimensional space through space coordinates, and representing the coordinates as (x) drill ,y drill ,z drill ) The method comprises the steps of carrying out a first treatment on the surface of the Wherein x is drill ,y drill ,z drill Refers to the center coordinates of the abrading surgical instrument. If the abrading surgical instrument is a sphere, wherein x is drill ,y drill ,z drill Refers to the coordinates of the sphere center of the sphere model.
In addition, according to actual needs, the communication module can be in communication connection with the optical positioning instrument, and then the real-time coordinate position information sent by the optical positioning instrument is received through the communication module.
The second model data acquisition module 9 is used for acquiring second three-dimensional model data of the first part to be processed in the second local area;
the second model data obtaining module 9 is configured to obtain second three-dimensional model data of the first portion to be processed in the second local area by using a Marching cube algorithm. In particular, the method comprises the steps of,
31 Reading information of a second local area of the part to be processed into a three-dimensional array;
32 Extracting a voxel from the three-dimensional array to form a current voxel, and simultaneously acquiring all information of the voxel, such as values, coordinates and the like of 8 vertexes;
33 Comparing the values of 8 vertexes of the current voxel with the values of the given isosurface to obtain the state of the voxel;
34 According to the state index of the current voxel, finding out the voxel edge intersected with the isosurface, and calculating the position coordinates of each intersection point by adopting a linear interpolation method;
35 Calculating a plane passing through each edge intersection point in the voxel, and taking the normal direction of the plane and each edge intersection point as vertexes to obtain a first local panel and obtain first local model data;
36 Repeating steps 31) -35) until the patch calculation in all voxels in the second local region is completed.
The second local model acquisition module 10 refreshes and displays a second local three-dimensional model of the first part to be processed according to the second three-dimensional model data;
the second overlay display module 11 is configured to overlay the whole three-dimensional model, the first local three-dimensional model, and the second local three-dimensional model.
Wherein, the overlapped display means that only the second local three-dimensional model corresponding to the part to be processed is refreshed and displayed on the basis of displaying the whole three-dimensional model and the first local three-dimensional model.
The judging module 12 is configured to judge whether the first portion to be processed in the second local area is processed, and if so, divide a new second local area into the first local area again for processing and refreshing the display until the portion to be processed in the first local area is processed, and stop refreshing the display.
In conclusion, the reconstruction period of the three-dimensional model surface slice is effectively shortened by adopting a local Maring cube algorithm, the three-dimensional model of the bone can be quickly refreshed and displayed in the orthopedic operation, and the actual polishing progress is displayed; can help doctors to quickly know the actual polishing progress, and provides effective reference for surgery and diagnosis and treatment.
The following is a test computer for testing the refreshing display effect of the three-dimensional model in this embodiment, which is specifically as follows:
(1) Hardware configuration and software environment:
hardware configuration: computer model: GL502VML; CPU (controller): intel (R) Core (TM) i7-6700HQ CPU@2.60GHz (8 CPUs), -2.6 GHz; memory: 8192MB of RAM; GPU (graphics processor): NVDIA GeForce GTX 1060;
software environment: windows10 (64-bit operating system); necessary software: VS2015, VTK7.1 (VS 2015, VTK7.1 are all a development software).
(2) Test data
The bone stock data size for the test was: 200X 224, assuming that each region is a cube, taking a first partial region of size 100X 100 according to the predetermined polishing speed of the bone, and taking the second part with the size of 40 multiplied by 40, and carrying out 99 times of display refreshing display on the orthopaedics grinding drill with the size of 20 multiplied by 20.
(3) Test results
Refresh display cycle time for the second partial region: 28 milliseconds;
refresh display cycle time for first partial region: 151 milliseconds;
the time taken for 99 cycles of reconstruction and refreshing is: 5963 milliseconds, i.e., an average one refresh display time of about 60.23 milliseconds;
in the prior art, the Marching Cubes calculation is performed on the whole skeleton model, and the average one-time refreshing display period is about 984.63 milliseconds, namely, is far longer than the average one-time refreshing display time 60.23 milliseconds. Therefore, the technical scheme of the embodiment can effectively solve the problems that in the prior art, the whole three-dimensional model is updated for a long time, and visual blocking and information delay are easily caused due to untimely calculation.
In the embodiment, the local area corresponding to the part to be processed is divided from the integral area corresponding to the integral three-dimensional model data of the object to be processed, the three-dimensional model data of the part to be processed in the local area is obtained, and the local three-dimensional model of the part to be processed is refreshed and displayed in real time according to the obtained three-dimensional model data until the part to be processed is completely processed, so that the real-time processing condition of the three-dimensional model is refreshed and displayed quickly by means of local reconstruction of the three-dimensional model, the problems of visual blocking and information delay caused by untimely calculation of the integral three-dimensional model in the prior art are avoided, the user can know the real-time processing condition of the three-dimensional model in time, and the accuracy of user judgment is improved.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the principles and spirit of the invention, but such changes and modifications fall within the scope of the invention.
Claims (12)
1. A method for displaying a three-dimensional model, the method comprising:
s1, acquiring overall three-dimensional model data of an object to be processed;
s2, acquiring an integral region corresponding to the integral three-dimensional model data, and dividing a first local region corresponding to a part to be processed of the object to be processed from the integral region;
s3, acquiring first three-dimensional model data of the part to be processed in the first local area;
s4, displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
step S2 further includes:
dividing a second local area from the first local area;
step S3 further includes:
acquiring second three-dimensional model data of a first part to be processed in the second local area;
the step S4 further includes:
refreshing and displaying a second local three-dimensional model of the first part to be processed according to the second three-dimensional model data;
wherein the object to be treated comprises a bone, the portion to be treated comprises a portion of the bone to be ground, and the second partial region is divided at least on the basis of a grinding surgical instrument which can be enveloped for grinding the bone.
2. The method for displaying a three-dimensional model according to claim 1, wherein step S1 further comprises:
and displaying the overall three-dimensional model of the object to be processed according to the overall three-dimensional model data.
3. The method for displaying a three-dimensional model according to claim 2, wherein step S4 specifically comprises:
refreshing and displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
the step S4 further comprises:
and S5, displaying the whole three-dimensional model and the first local three-dimensional model in an overlapping mode.
4. The method for displaying a three-dimensional model according to claim 2, wherein,
the step S4 further comprises:
and displaying the whole three-dimensional model, the first local three-dimensional model and the second local three-dimensional model in an overlapping mode.
5. The method of displaying a three-dimensional model according to claim 4, wherein the step of refreshing the second partial three-dimensional model of the portion to be processed further comprises, after the step of refreshing the second partial three-dimensional model:
judging whether the first part to be processed in the second local area is processed or not, if so, dividing a new second local area in the first local area again for processing and refreshing display until the part to be processed in the first local area is processed, and stopping refreshing display.
6. The method for displaying a three-dimensional model according to claim 4, wherein step S1 specifically comprises:
acquiring overall three-dimensional model data of an object to be processed by using a Marching cube algorithm;
the step S3 specifically comprises the following steps:
acquiring first three-dimensional model data of the part to be processed in the first local area by using a Marching cube algorithm;
and acquiring second three-dimensional model data of the first part to be processed in the second local area by using a Maring cube algorithm.
7. A display system of a three-dimensional model is characterized in that the display system comprises a whole model data acquisition module, a whole area acquisition module, a first local area acquisition module, a first model data acquisition module and a first local model acquisition module;
the overall model data acquisition module is used for acquiring overall three-dimensional model data of the object to be processed;
the whole region acquisition module is used for acquiring a whole region corresponding to the whole three-dimensional model data;
the first local area acquisition module is used for dividing a first local area corresponding to a part to be processed of the object to be processed from the whole area;
the first model data acquisition module is used for acquiring first three-dimensional model data of the part to be processed in the first local area;
the first local model acquisition module is used for displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
the display system further comprises a second local area acquisition module, a second model data acquisition module and a second local model acquisition module;
the second local area acquisition module is used for dividing a second local area from the first local area;
the second model data acquisition module is used for acquiring second three-dimensional model data of the first part to be processed in the second local area;
the second local model acquisition module refreshes and displays a second local three-dimensional model of the first part to be processed according to the second three-dimensional model data;
wherein the object to be treated comprises a bone, the portion to be treated comprises a portion of the bone to be ground, and the second partial region is divided at least on the basis of a grinding surgical instrument which can be enveloped for grinding the bone.
8. The display system of a three-dimensional model of claim 7, wherein the display system further comprises an overall model display module;
the whole model display module is used for displaying the whole three-dimensional model of the object to be processed according to the whole three-dimensional model data.
9. The display system of a three-dimensional model of claim 8, wherein the display system further comprises a first overlay display module;
the first local model acquisition module is further used for refreshing and displaying a first local three-dimensional model of the part to be processed according to the first three-dimensional model data;
the first overlapping display module is used for overlapping the whole three-dimensional model and the first local three-dimensional model.
10. The display system of a three-dimensional model of claim 8, wherein the display system further comprises a second overlay display module; the second overlapping display module is used for overlapping the whole three-dimensional model, the first local three-dimensional model and the second local three-dimensional model.
11. The display system of a three-dimensional model of claim 10, wherein the display system further comprises a judgment module;
the judging module is used for judging whether the first part to be processed in the second local area is processed or not, and if so, dividing a new second local area in the first local area again for processing and refreshing display until the part to be processed in the first local area is processed, and stopping refreshing display.
12. The display system of three-dimensional model as set forth in claim 10, wherein the global model data acquisition module is configured to acquire global three-dimensional model data of the object to be processed using a Marching cube algorithm;
the first model data acquisition module is used for acquiring first three-dimensional model data of the part to be processed in the first local area by using a Maring cube algorithm;
the second model data acquisition module is used for acquiring second three-dimensional model data of the first part to be processed in the second local area by using a Maring cube algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810878700.9A CN109147035B (en) | 2018-08-03 | 2018-08-03 | Three-dimensional model display method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810878700.9A CN109147035B (en) | 2018-08-03 | 2018-08-03 | Three-dimensional model display method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109147035A CN109147035A (en) | 2019-01-04 |
| CN109147035B true CN109147035B (en) | 2023-08-08 |
Family
ID=64791743
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810878700.9A Active CN109147035B (en) | 2018-08-03 | 2018-08-03 | Three-dimensional model display method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109147035B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113140038B (en) * | 2021-05-13 | 2022-10-25 | 天讯方舟(北京)信息科技有限公司 | Real-time three-dimensional visualization method for large-scene urban building |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107292960A (en) * | 2017-06-30 | 2017-10-24 | 浙江科澜信息技术有限公司 | A kind of Local hydrodynamic unit method that large-scale terrain is rendered in three-dimensional scenic |
| CN107582167A (en) * | 2017-09-19 | 2018-01-16 | 上海龙慧医疗科技有限公司 | Orthopaedics joint replacement surgery system |
| WO2018040126A1 (en) * | 2016-08-31 | 2018-03-08 | 广州华端科技有限公司 | Tomosynthesis image reconstruction method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8170306B2 (en) * | 2007-04-25 | 2012-05-01 | Siemens Aktiengesellschaft | Automatic partitioning and recognition of human body regions from an arbitrary scan coverage image |
-
2018
- 2018-08-03 CN CN201810878700.9A patent/CN109147035B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018040126A1 (en) * | 2016-08-31 | 2018-03-08 | 广州华端科技有限公司 | Tomosynthesis image reconstruction method and system |
| CN107292960A (en) * | 2017-06-30 | 2017-10-24 | 浙江科澜信息技术有限公司 | A kind of Local hydrodynamic unit method that large-scale terrain is rendered in three-dimensional scenic |
| CN107582167A (en) * | 2017-09-19 | 2018-01-16 | 上海龙慧医疗科技有限公司 | Orthopaedics joint replacement surgery system |
Non-Patent Citations (1)
| Title |
|---|
| 三维动画技术在数控加工仿真中的应用;姜晓峰等;《机械设计与制造工程》;20020430(第02期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109147035A (en) | 2019-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107067398B (en) | Completion method and device for missing blood vessels in three-dimensional medical model | |
| JP2007537770A (en) | A dynamic crop box determination method for display optimization of luminal structures in endoscopic images | |
| WO2017020580A1 (en) | Medical tissue slice image 3d reconstruction method and apparatus | |
| CN104794758A (en) | Three-dimensional image cutting method | |
| US20050237336A1 (en) | Method and system for multi-object volumetric data visualization | |
| US20060104495A1 (en) | Method and system for local visualization for tubular structures | |
| Hachaj et al. | Visualization of perfusion abnormalities with GPU-based volume rendering | |
| CN108320314A (en) | A kind of image processing method and device based on the cross-section images of CT, Bone images display system | |
| Hastreiter et al. | Fast analysis of intracranical aneurysms based on interactive direct volume rendering and CTA | |
| CN109147035B (en) | Three-dimensional model display method and system | |
| CN109308735B (en) | Data holing method based on Unity3D volume rendering and storage medium thereof | |
| US9237849B1 (en) | Relative maximum intensity projection | |
| US10561443B2 (en) | Image-guided embryo transfer for in vitro fertilization | |
| Klein et al. | Visual computing for medical diagnosis and treatment | |
| JP6944492B2 (en) | Image acquisition method, related equipment and readable storage medium | |
| CA3085814C (en) | Hypersurface reconstruction of microscope view | |
| WO2020217807A1 (en) | Image orientation setting device, method, and program | |
| Liu et al. | Optimization of reconstruction of 2D medical images based on computer 3D reconstruction technology | |
| US9384544B2 (en) | Method and apparatus for measuring a ratio of a variable in medical imaging data | |
| Enders et al. | Hardware-accelerated glyph based visualization of major white matter tracts for analysis of brain tumors | |
| Drapikowski | Surface modeling—uncertainty estimation and visualization | |
| Wang | Three-dimensional medical CT image reconstruction | |
| JPWO2020090445A1 (en) | Area modifiers, methods and programs | |
| Bohak et al. | Neck veins: an interactive 3D visualization of head veins | |
| Neubauer et al. | Advanced virtual corrective osteotomy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |