KR20160028393A - Method and apparatus 3d surgery simulation of nasal cavity - Google Patents

Abstract

According to the present invention, a 3D-based nasal cavity surgery simulation apparatus includes: a 2D nasal cavity area division and volume generation unit which divides areas of medical image data to generate the 2D-based nasal cavity volume; a 3D nasal cavity volume generation unit which reconfigures the 2D-based nasal cavity volume in order to generate the 3D-based nasal cavity volume; a 3D nasal cavity volume post-processing unit which makes the 3D-based nasal cavity volume smooth; a 3D nasal cavity volume which converts the smooth 3D-based nasal cavity to a 3D nasal cavity model; a flow analysis unit which analyzes the flow of the nasal cavity through numerical model for the converted 3D nasal cavity model; and a 3D nasal cavity model modifying unit which modifies the 3D nasal cavity model based on the haptic feedback based on the flow analysis result.

Description

METHOD AND APPARATUS 3D SURGERY SIMULATION OF NATURAL CAVITY [0002]

The present invention relates to a technique for nasal surgery simulation, and more particularly, to a 3D nasal surgery simulation method for performing a surgical simulation using a 3D nasal model generated based on a medical image before actual nasal surgery, And more particularly, to a method and apparatus for nasal surgery simulation.

As it is well known, it is common to remove the problematic factor through nasal surgery if there is a problem in the anatomical structure of the nose as the cause of discomfort caused by breathing through the nose.

Currently, most of the nasal surgery simulations are proceeding with the procedure of reconstructing the 3-D model by modifying the 2-dimensional CT image section, requiring a high level of expertise and a lot of effort and time.

In other words, in order to determine the cause of the discomfort felt during breathing, the medical image expressing the inside of the human body is acquired and used for medical treatment. If it is judged that the cause of discomfort is due to the anatomical structure inside the nose, It is removing the inconvenient element.

In recent years, numerical analysis and analysis have been conducted using a computer to analyze and predict the cause of respiratory disturbance prior to nasal surgery, and furthermore, Research is also being conducted to perform a surgical simulation by modifying the image into a two-dimensional plane to create a three-dimensional nasal model.

However, because of the high level of anatomical expertise and labor and time required for 2-D section-based surgical simulation, a new nasal surgery simulation technique based on 3-dimensional direct deformation of 3-D models is needed. There is no suggestion about the nasal surgery simulation technique.

Korean Patent Publication No. 2010-0099507 (published on September 13, 2010) Korean Patent Laid-Open Publication No. 2013-0109794 (Disclosure Date: Oct. 10, 2014) Japanese Laid-Open Patent Application No. 2010-131047 (Publication date: 2010. 06. 17)

The present invention provides a three-dimensional (3D) based user interface model for smooth and convenient nasal model modification by developing a three-dimensional (3D) based nasal surgery simulation system.

In order to verify the validity of the 3D interface (3D), the nasal cavity model, which is directly transformed by the 3D method with the 3D interface, is converted into the data format for the numerical analysis study in which the nasal internal function is analyzed as objective data, We can simulate the flow in the nasal cavity before and after the nasal cavity, visualize the simulation results, and provide a simulation model that can demonstrate the performance of the developed user interface.

The problems to be solved by the present invention are not limited to those mentioned above, and another problem to be solved by the present invention can be clearly understood by those skilled in the art from the following description will be.

The present invention relates to a 2D nasal region segmentation and volume generation unit for segmenting medical image data to generate a 2D nasal volume based on a viewpoint and reconstructing the 2D nasal volume generated to generate a 3D nasal volume A 3D nasal cavity volume processor for smoothing the generated 3D nasal cavity volume; a 3D nasal cavity volume processor for converting the smoothing processed 3D based nasal cavity volume into a 3D nasal cavity model; And a controller for analyzing the flow in the nasal cavity through a numerical analysis on the converted 3D nasal cavity model and displaying the analysis result on a monitor, And a 3D nasal model modification unit for transforming the 3D nasal model based on a haptic feedback.

The 3D nasal cavity volume generating unit of the present invention may generate the 3D nasal cavity volume by rendering using a Marching-cube algorithm based on the voxel size information of the medical image data.

The 3D nasal volume post-processor of the present invention may perform the smoothing process using an HC-Laplacian algorithm.

The 3D nasal volume post-processor of the present invention may repeat the smoothing process N times.

The flow-flow analysis unit of the present invention can analyze the flow flow by measuring a change in pressure occurring in the respiratory pathway in the nasal cavity and a degree of pressure on the wall surface.

The flow-flow analysis unit of the present invention can analyze the flow flow using a Navier-Stokes Equation.

According to another aspect of the present invention, there is provided a method for generating a nasal cavity, the method comprising: generating a 2D-based nasal cavity volume by segmenting medical image data; reconstructing the 2D nasal cavity volume to generate a 3D- Processing the 3D-based nasal cavity volume, post-processing the 3D-based nasal cavity volume, converting the posteriorized 3D-based nasal cavity volume to a 3D nasal cavity model, and numerically analyzing the converted 3D nasal cavity model, Analyzing the 3D nasal cavity model, and transforming the 3D nasal model based on the analysis result of the flow flow.

The post-processing of the present invention may smooth the 3D-based nasal cavity volume.

The smoothing process of the present invention can be performed using an HC-Laplacian algorithm.

The smoothing process of the present invention can be repeatedly performed N times.

The 3D-based nasal cavity volume of the present invention may be generated by rendering using a Marching-cube algorithm based on the voxel size information of the medical image data.

The flow of the present invention can be analyzed through measurement of the degree of pressure on the wall surface and the change in pressure occurring in the respiratory pathways in the nasal cavity.

The analysis of the flow of the present invention may utilize the Navier-Stokes Equation.

The present invention can analyze nasal flow through a three-dimensional (3D) medical imaging-based model.

Further, the present invention can complete a smooth process of diagnosis and prognosis determination through an interface for three-dimensional (3D) based surgical simulation.

In addition, while it takes approximately one week to prepare a 2D (2D) based surgical simulation model for the conventional application, the three-dimensional haptic device-based surgical simulation of the present invention takes about one day , It can be usefully used in experiments and simulations to determine patient-specific diagnosis and prognosis.

1 is a block diagram of a 3D-based nasal surgery simulation apparatus according to an embodiment of the present invention.
FIG. 2 is a view illustrating a screen of a medical image visualization for explaining a process of generating a 3D-based nasal cavity volume according to the present invention.
FIG. 3 is an exemplary view of STL (Stereo Lithography) data provided for 3D printing according to the present invention.
4A and 4B are diagrams illustrating an example of a high-resolution 3D model implemented by surface rendering.
5 is a schematic diagram for explaining the concept of HC-Laplacian allergy.
FIG. 6 is a view showing a result of performing HC-Laplacian smoothing up to four times as surface rendering according to the present invention.
FIG. 7 is a diagram illustrating a result of a comparative analysis of the performance evaluation of the degree of stress according to the conventional method and the nasal flow according to the present invention.
FIG. 8 is a view showing a result of comparative analysis of the performance evaluation of the pressure distribution according to the conventional method and the nasal flow according to the present invention.
FIG. 9 is a view showing a screen showing results of analyzing nasal fluid flow (pressure distribution) for each of four patients according to the conventional method and the present invention.
FIG. 10 is an enlarged view of an analysis result of the case where the nasal obstruction of S2 is appealed among the analysis results of four subjects of FIG. 9; FIG.
FIG. 11 is a view showing a screen for viewing the nasal cavity model moving from a 3D space to a region of interest in which a shape is to be deformed, in order to deform the 3D nasal cavity model.
Fig. 12 is a diagram showing an example of a screen expressing contents of transforming a nasal cavity model in a 3D space. Fig.
Figure 13 is an exemplary illustration of using a haptic interface for deformation work on a nasal model.
FIGS. 14A and 14B are diagrams illustrating another example of the operation of directly deforming the shape of the nasal cavity model in the 3D space using the haptic device. FIG.
15a is an exemplary view of a collision check, 15b is an example of a directional arrow representation for an x-axis model transformation, 15c is an example of a directional arrow representation for a z-axis model transformation, and 15d is a y- Fig. 8 is an illustration of a directional arrow representation. Fig.
FIG. 16 is a view showing a screen of a cross-sectional representation showing the adjustment of the volume size of the nasal cavity model. FIG.
Figs. 17A to 17C are exemplary views of nose models before and after the surgical simulation, and 17D are graphs showing the results of analysis of the surgical simulation.
FIG. 18A is an illustration of a view that is visible to a user when the nasal model is three-dimensionally deformed, and FIG. 18B is a screen exemplary view of a coronal view. FIG.
FIG. 19A is a diagram showing an example of a screen to which a CT slice is not applied, and FIG. 19B is a diagram illustrating a screen to which a CT slice is applied.
FIG. 20 is a diagram illustrating a view showing a view mode, a moving picture, and a view mode of the Rhinostation from the left side.
FIG. 21 is a diagram illustrating a deformation mode (Deform Mode), a moving image, and a deformation mode (Deform Mode) of the Rhinostation from the left side.
22 is a graph of the Gaussian distribution.
Fig. 23 is a diagram showing an example of a screen on the outside, the center, and the inside (coronal reference) of the nasal CT slice from the left side.
FIG. 24 is a view showing a result of correcting the left side non-degree by using a mouse.
25 is an exemplary table of keyboard and mouse operation buttons applied to an interface necessary to execute the simulator device.

First, the advantages and features of the present invention, and how to accomplish them, will be clarified with reference to the embodiments to be described in detail with reference to the accompanying drawings. While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. It is to be understood that the following terms are defined in consideration of the functions of the present invention, and may be changed according to intentions or customs of a user, an operator, and the like. Therefore, the definition should be based on the technical idea described throughout this specification.

First, the present invention converts a 3D-based nasal cavity volume created through 2D reconstruction of the nasal cavity volume generated by the reconstruction of the nasal cavity volume into a 3D nasal cavity model, and numerically analyzes the converted 3D nasal cavity model, Based on the analyzed results, it is possible to implement the nasal surgery simulation by deforming the 3D nasal model based on the haptic feedback interaction (3D user interface) (transforming the volume size of the deformable region, etc.) It is possible to provide a feasible nasal surgery simulation with relatively reduced time and effort without the need for specialized grindstones.

In the present invention, a model generated based on a medical image can use a 2D CT image to mitigate a nasal valve portion and a nasal septum nasal septum, And then generate a modified 3D nasal model.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram of a 3D-based nasal cavity surgery simulation apparatus according to an embodiment of the present invention. The apparatus includes a medical image input unit 102, a 2D nasal region division and volume generation unit 104, a 3D nasal cavity volume generation unit 106 A 3D nasal volume post-processing unit 108, a 3D nasal cavity model generating unit 110, a flow flow analyzing unit 112, and a 3D nasal model deforming unit 114, and the like.

Referring to FIG. 1, the medical image input unit 102 may provide a function of receiving and loading nasal-related medical images such as a digital image communication in medicine (CT) data set (DICOM).

First, the 2D nasal region segmentation and volume generation unit 104 may provide a function of dividing the medical image data provided from the medical image input unit 102 and creating a nasal cavity volume based on 2D.

The 3D nasal cavity volume generating unit 106 may provide functions such as reconstructing a 2D nasal cavity volume generated through the 2D nasal cavity region dividing and volume generating unit 104 to generate a 3D nasal cavity volume .

That is, the nasal cavity, which is the breathing path region, is an empty space through which the air in the human body passes. As a characteristic of such a region, it is suitable to express the result of the actual division operation by a surface rendering method that does not include the inside. To this end, in the present invention, a matching cube (x, y, z) Marching-cube) algorithm. Also, if necessary, volume rendering is performed to grasp the relation between the other organs in the human body region and the non-human body.

FIG. 2 is a view showing a screen image of a medical image visualization for explaining a process of generating a 3D-based nasal cavity volume according to the present invention, in which (a) is a section in the axial direction, (b) is a sagittal (C) shows a coronal section, and (d) and (e) show a volume rendering view, respectively.

Here, the 3D nasal cavity model generated through the 3D nasal cavity volume generating unit 106 is data that can be used for flow flow analysis experiments in the nasal cavity. Therefore, the generated data needs to be provided in the form of data supporting Rapid Prototyping, which is a 3D printer, for analysis experiment, as shown in Fig. 3 as an example.

That is, FIG. 3 is an illustration of STL (Stereo Lithography) type data provided for 3D printing according to the present invention.

Next, the 3D nasal volume post-processing unit 108 performs smoothing processing (e.g., smooth processing of angular corner portions) of the 3D-based nasal cavity volume generated through the 3D nasal volume generating unit 106 Can be provided.

As is well known, the data reconstructed from the 2D image into the 3D space can be represented by a high-resolution model having a dense mesh, as shown in FIG. 4 as an example.

That is, FIGS. 4A and 4B are diagrams illustrating an example of a high-resolution 3D model implemented by surface rendering.

At this time, the 3D reconstructed model in the 2D data is generated based on the voxel (x, y, z) information indicating the size of one point, and thus has a staircase phenomenon.

Therefore, in order to solve the step problem of the model shown in FIG. 4A, in the present invention, noise is given to a circle mesh which is a disadvantage of Laplacian smoothing, and then smoothing is attempted again, that is, the original shape of the mesh is not maintained The smoothing process minimizes morphological deformation of the original model by applying the HC-Laplacian algorithm of Equation (1) below. This smoothing process can be repeated N times.

[Equation 1]

Here, the HC-Laplacian algorithm is an extended concept for processing a surface including a center point to compensate for the disadvantages of the Laplacian algorithm. Equation (1), as illustrated in Figure 5 as an example, it will return the newly created position Pi after the Laplacian process by the average value (d i) of the difference between them with respect to the previous position q _j and a starting point of Oi. b _i represents the difference value for each point.

FIG. 6 is a schematic view showing a result of performing HC-Laplacian smoothing up to four times as surface rendering according to the present invention, wherein (a) shows a circular model showing a stepped phenomenon, (b) (C) shows the result of performing HC-Laplacian smoothing twice, (d) shows the result of performing HC-Laplacian smoothing three times, and HC-Laplacian smoothing 4 times.

That is, the formation of a mesh is very important to the result of the numerical analysis. Particularly, since the rate of change is large at the inner wall of the nasal cavity, the mesh on the wall surface needs to be more compact.

Therefore, according to the present invention, the 3D nasal model subjected to the N smoothing process can reduce the execution time of the analysis experiment with a high-resolution model minimizing volume change, and improve the accuracy of the flow analysis result.

Next, the 3D nasal cavity model generation unit 110 may provide a function of converting the smoothing processed 3D-based nasal cavity volume into the 3D nasal cavity model through the 3D nasal cavity volume post-processing unit 108. [ For example, a nasal model for three-dimensional numerical analysis can be generated from relatively accurate CT images (0.35 * 0.35 * 0.6 mm) for nasal flow analysis using medical images.

Meanwhile, the flow analysis unit 112 analyzes the flow in the nasal cavity by numerically analyzing the 3D nasal cavity model generated through the 3D nasal cavity model generation unit 110, and displays the analysis result on a monitor Can be provided.

First, the model generated through the segmentation process is generated as a high-resolution solid model with a dense mesh. The solid model thus generated can be used as a material for the flow analysis experiment. Here, the flow analysis experiment means an operation of measuring and analyzing the pressure change in the respiratory path and the pressure on the wall surface. For example, Navier-Stokes equations (Navier- Stokes Equation) can be used to perform flow analysis.

&Quot; (2) "

In the above equation (2), and that of u at the time point f, and means suitable for taking the external force per unit, is ρ p is the ν, respectively.

The above Equation 1 can be expressed by the following Equation 3 using a vector.

&Quot; (3) "

In the above Equation (3), there is also Fig. And? Represents? And?, Respectively.

Here, in order to analyze the flow in the nasal cavity using the butterfly-Stokes equation, it is necessary to divide the 3D nasal model into a small unit grid. In other words, the solid region in the breathing path is divided into smaller grids to divide the calculation region. In this way, as the quality of the model is improved in the division by grids, a more dense grid is created for the flow analysis experiment, It is possible to accurately analyze the change in pressure and the flow field at the inlet.

FIG. 7 is a diagram illustrating a result of a comparative analysis of the performance evaluation of the degree of stress according to the conventional method and the nasal flow according to the present invention.

7 (a) and 7 (b) show the result of analyzing the degree of stress on the wall surface according to the nasal flow in the conventional method, and (c) and (d) It can be seen clearly that when comparing the results of two analyzes, a grid for numerical analysis that is not elaborated due to a non-smooth surface mesh is generated and also affects the result of numerical analysis. It can be seen that the shear stress is high in the entrance part of the nose and the progress of the overall flow is well interpreted without interruption.

FIG. 8 is a view showing a result of comparative analysis of the performance evaluation of the pressure distribution according to the conventional method and the nasal flow according to the present invention.

Referring to FIG. 8, (a) and (b) show the results of the nasal pressure distribution according to the conventional method, (c) and (d) represent the distribution results of the nasal pressure according to the present invention, In the case of receiving a lot of pressure, it may include the meaning of a region that may cause pain or discomfort in the site.

FIG. 9 is a view showing a result of analyzing nasal fluid flow (pressure distribution) for each of four patients according to the conventional method (a) and the present invention (b).

Referring to FIG. 9, numerical analysis results are shown in which the flow data is analyzed by selecting medical data that appeal to four nasal-related diseases generated by the division process. N1 and N2 are groups in which nasal obstruction And S1 and S2 are the result of the experiment in which the patients are classified into the group which does not feel uncomfortable although it seems that there is an uncomfortable symptom when the nasal cavity is seen.

FIG. 10 is an enlarged view of an analysis result of the case where the nasal obstruction of S2 is appealed among the analysis results of four subjects of FIG. 9; FIG.

Referring to FIG. 10, it can be seen that the result of the experiment of flow analysis after the 3D nasal cavity model according to the present invention of (b) is compared with the conventional method of (a) . This accurate analysis of the inconvenience site can be an important data for finding the exact site to be operated in the future.

Next, the 3D nasal model deforming unit 114 transforms the 3D nasal model based on the haptic feedback while viewing the analysis result of the flow flow analyzed by the flow flow analyzing unit 112 and displayed through the monitor Can be provided.

Typically, when analyzing the causes of respiratory-related diseases and performing surgery on the part of the nasal cavity that is the source of discomfort in the course of treatment, pre-operative planning should be planned and the planned treatment method reviewed for the patient Treatment is progressing through the process. In planning these preoperative methods, virtual surgery methods can be used to plan the surgical method based on the anatomical nasal type of the patient.

In the present invention, using virtual surgery for nasal surgery planning implies a task of transforming the anatomical shape of the nasal cavity. In other words, it is a modification of the 3D nasal model that modifies the mesh coordinates of the 3D nasal model created by reconstructing based on 2D medical images. In order to perform the correction of the nasal cavity model in the 3D space, the nasal cavity may be moved to the region of interest of the nasal cavity to deform the anatomical shape of the desired region.

FIG. 11 is a view showing a screen for viewing the nasal cavity model moving from a 3D space to a region of interest in which a shape is to be transformed in order to deform the 3D nasal cavity model. You can navigate to the desired area by looking at it.

Here, deforming the shape of the 3D nasal cavity model means increasing or decreasing the airway, which is the air passage inside the nose. Increasing (reducing) work not only eliminates existing areas while modifying the model, but also modifies the coordinates of the mesh to expand (or narrow) the path of the area with discomfort to the anatomy. .

FIG. 12 is a diagram showing an example of a screen in which the nasal cavity model is transformed in the 3D space. FIG. 12A is a three dimensional nasal cavity model separated from the medical image, It visually shows the shape of the nasal cavity in the desired region.

In addition, since the work of deforming the shape of the nasal cavity model is performed in 3D space, it proceeds with the concept of X, Y, Z axis coordinate. In order to realize more realistic virtual surgery, As an example of an interface that can be used, the use of the haptic interface as shown in FIG. 13 can further enhance the immersion feeling of the deforming operation on the nasal model.

FIGS. 14A and 14B are diagrams illustrating another example of the operation of directly deforming the shape of the nasal cavity model in the 3D space using the haptic device. FIG.

Referring to FIGS. 14A and 14B, a modified nasal model can be generated by performing a 3D surgery simulation so that the 3D model can be transformed directly into a 3D operation using a haptic device, and the 3D nasal model can be relatively narrowed.

3D collision detection between the 3D nasal model and the cursor of the haptic device is necessary to naturally perform endoscopic 3D navigation to understand the internal structure of the nasal cavity.

It is possible to provide a navigation method in which a coordinate value of a position to be moved is directly input and used for more efficient and direct movement.

15a is an exemplary view of a collision check, 15b is an example of a directional arrow representation for an x-axis model transformation, 15c is an example of a directional arrow representation for a z-axis model transformation, and 15d is a y- Fig. 8 is an illustration of a directional arrow representation. Fig.

Referring to FIGS. 15A-15D, a three-dimensional haptic interface can be provided that can perform deformations that increase or decrease the 3D nasal model along the three axes (x, y, and z) to accurately deform the nasal model.

In addition, you can freely modify the volume size of the deformable region for fine adjustment in 3D, and you can also work with the 3D-based model volume expressed as a 2D section.

FIG. 16 is a view showing a screen of a sectional representation showing the adjustment of the volume size of the nasal cavity model. FIG.

Figs. 17A to 17C are exemplary views of nose models before and after the surgical simulation, and 17D are graphs showing the results of analysis of the surgical simulation.

17A to 17D, in terms of the change of the velocity field, the left side of the first column shows the nose model before surgery, the right side shows the model after the surgery simulation on the right side, the model after the 3D surgery simulation on the left side, The right side of the column represents the preoperative nose model in terms of pressure enhancement.

17D, v1 represents the result of the model after the 2D-based surgical simulation, and v2 represents the result of the model after the 3D surgery simulation, respectively.

17A to 17D, as a result of examining the change in the velocity field of the model after the 2D-based surgical simulation and the 3D operation simulation, the portion having the narrowest and fastest flow velocity in the nasal cavity was defined as P1, P2, P3, and P4 are defined from the starting section.

It can be seen that the local high velocity distribution area is decreased by the order of the preoperative, v2 and v1 models, and it is predicted that pressure drop occurs before and after the operation (vS_v1 and vS_v2).

On the other hand, the following interface (interface for surgical simulation) may be required to develop a more useful and practical simulator for haptic surgical simulator for nasal surgery.

first, The user should be able to see the whole of the nasal cavity in the form of a coronal view rather than a limited view such as the view of the endoscope and should be able to see a section of a certain area such as a CT image.

Second, when revising the non-degree, it is easy to work through the 3D view when the viewpoint is fixed in the 2D plane, and when viewing the entire 3D nasal model after the modification.

Third, even if the non-degree is corrected while the viewpoint is fixed in the 2D plane, the corrected ratio should be applied to at least 5 faces instead of only one face based on the coronal view CT slice.

Fourth, there are some users who can handle the haptic device professionally according to the skill of the user equipment, but there are some users who do not. Therefore, it is necessary to design the keyboard and the mouse so that all operations can be performed in parallel with the haptic device.

18A is a view showing a view of a view of a 3D nasal model three-dimensional deformed to a user, and FIG. 18B is a view showing a screen of a corona view.

FIG. 19A is a view showing a screen to which a CT slice is not applied, and FIG. 19B is a view showing a screen to which a CT slice is applied.

In the case where only a limited portion such as the view of the endoscope is visible, there is a problem that the user can not know which part of the current operation is being corrected in the entire portion of the current operation. To solve this problem, .

Referring to FIGS. 18A and 18B, when a nasal cavity is viewed through a corona view, a section of a certain area can be seen. Whether or not to use such a function (hereinafter referred to as a CT slice function) 'Can be determined by toggling the' number 'button.

Referring to FIGS. 19A and 19B, when the CT slice function is operated using a keyboard, a screen in which only a predetermined area is sliced in the form shown in FIG. 9B is provided, thereby providing an environment in which the user can concentrate more on a part to be corrected have.

Meanwhile, the simulator apparatus of the present invention supports two modes, i.e., a view mode and a deformation mode. The view mode means a mode in which the modified rain rate can be viewed in a 3D environment , And the deformation mode means a mode for modifying the non-degree in the 2D environment.

FIG. 20 is a diagram illustrating a view showing a view mode, a moving picture, and a view mode of the Rhino station from the left side.

The toggle of the view / deformation mode is activated, for example, by pressing the number '0' on the keyboard.

The view mode is a mode that allows you to observe the modified rainfall using a mouse in 3D environment. If you drag the mouse with the left button pressed, you can switch between the top, bottom, left and right by pressing and holding the right button. Direction movement can be performed.

Fig. 21 is a diagram showing a screen showing a deformation mode, a moving image, and a deformation mode of the lino station from the left side.

The deformation mode is a mode for modifying the non-degree. It supports the 2D environment. It corrects the non-degree by utilizing the Phantom Omni, and when the haptic cursor touches or modifies the wall while modifying, Force feedback can be provided to the user.

Here, the correction of the non-degree can be corrected in the state of being fixed in the X-axis or the Y-axis in the 2D plane, and the X-axis can be modified, for example, by pressing the keyboard '7' and the Y-

On the other hand, as for the non-deformed mode in the deformation mode, for example, five slides before and after the Gaussian distribution as shown in FIG. 22 can be simultaneously modified.

In the conventional case, the simulator apparatus of the present invention can modify 5 slides at the same time, as compared with the case where only one slide is applied, so that the user can relieve the trouble of having to repeat the operation.

The σ of the Gaussian distribution can be directly controlled by the user by, for example, '5' and '6' of the keyboard, thereby directly changing the magnitude of non-variation.

Fig. 23 is a diagram showing an example of a screen for the outside, the center, and the inside (coronal reference) of the nasal CT slice from the left side.

In deformation mode, for example, you can search for CT slices in a 2D environment using the keyboard '+' and '-'. View mode does not need to support CT slice navigation because it only requires CT slice navigation. In other words, in view mode, you can right-click instead.

Although it is possible to handle all tasks using only the Phantom Omni, it is possible to provide a simulator environment that can be operated using a mouse, considering the convenience of the user and the determination of the application environment.

FIG. 24 is a view showing a result of correcting the left side non-degree by using a mouse.

That is, the manipulation can be performed using a mouse other than the deformation mode in which the non-correction of the non-degree is performed. For example, in the view mode, a model can be observed using a mouse.

The mouse version of the simulator can support the same view / deformation mode as the existing simulator, and all operations are the same, except that the mouse is used instead of the phantom omni when performing non-correction operations in the deformation mode.

For example, if you place the mouse near the desired rainfall and click the mouse on the desired location, the rainfall will be corrected to the clicked location. The modification principle follows the Gaussian distribution shown in FIG.

For the interface necessary for executing the simulator device of the present invention, the operation buttons of the keyboard and the mouse can be defined as shown in the table shown in Fig. 25 as an example.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims. It is easy to see that this is possible. That is, the embodiments disclosed in the present invention are not intended to limit the scope of the present invention but to limit the scope of the present invention.

Therefore, the scope of protection of the present invention should be construed in accordance with the following claims, and all technical ideas within the scope of equivalents should be interpreted as being included in the scope of the present invention.

Claims (13)

A 2D nasal region segmentation and volume generation unit for segmenting the medical image data to generate a 2D nasal cavity volume,
A 3D nasal cavity volume generating unit for reconstructing the generated 2D based nasal cavity volume to generate a 3D based nasal cavity volume;
A 3D nasal volume post-processor for smoothing the generated 3D-based nasal cavity volume;
A 3D nasal cavity model generating unit for transforming the 3D-based nasal cavity volume smoothed into a 3D nasal cavity model,
A flow analysis unit for analyzing the flow in the nasal cavity through numerical analysis for the 3D nasal cavity model and displaying the analysis result on a monitor,
A 3D nasal model modification unit for transforming the 3D nasal model based on the haptic feedback based on the analysis result of the flow,
Based nasal surgery simulation device.
The method according to claim 1,
Wherein the 3D nasal cavity volume generating unit comprises:
The 3D-based nasal cavity volume is generated through rendering using a Marching-cube algorithm based on the voxel size information of the medical image data
3D based nasal surgery simulation device.
The method according to claim 1,
Wherein the 3D nasal volume post-
The smoothing process is performed using the HC-Laplacian algorithm
3D based nasal surgery simulation device.
The method of claim 3,
Wherein the 3D nasal volume post-
The smoothing process is repeatedly performed N times
3D based nasal surgery simulation device.
The method according to claim 1,
The flow-
The flow is analyzed by measuring the change in pressure occurring in the respiratory pathway in the nasal cavity and the degree of pressure on the wall surface
3D based nasal surgery simulation device.
6. The method of claim 5,
The flow-
The flow is analyzed using a Navier-Stokes Equation
3D based nasal surgery simulation device.
Generating a 2D-based nasal cavity volume by segmenting the medical image data;
Generating a 3D-based nasal cavity volume by reconstructing the generated 2D-based nasal cavity volume;
Processing the generated 3D-based nasal cavity volume;
Transforming the post-processed 3D-based nasal cavity volume into a 3D nasal cavity model;
Analyzing the flow in the nasal cavity through numerical analysis on the converted 3D nasal model,
A process of transforming the 3D nasal cavity model based on the analysis result of the flow flow
Based nasal surgery simulation method.
8. The method of claim 7,
The post-
Smoothing the 3D-based nasal cavity volume
3D based nasal surgery simulation method.
9. The method of claim 8,
In the smoothing process,
Performed using the HC-Laplacian algorithm
3D based nasal surgery simulation method.
10. The method of claim 9,
In the smoothing process,
And repeatedly performed N times
3D based nasal surgery simulation method.
8. The method of claim 7,
The 3D-based nasal cavity volume,
And a rendering process using a Marching-cube algorithm based on the voxel size information of the medical image data
3D based nasal surgery simulation method.
8. The method of claim 7,
The flow-
The changes in pressure occurring in the nasal cavity within the respiratory pathway and the degree of pressure on the wall are analyzed
3D based nasal surgery simulation method.
13. The method of claim 12,
The analysis of the flow-
Using the Navier-Stokes Equation
3D based nasal surgery simulation method.

Images