WO2016099205A1

WO2016099205A1 - Surgical operation result display method and surgical operation result display system using same

Info

Publication number: WO2016099205A1
Application number: PCT/KR2015/013952
Authority: WO
Inventors: 김상용
Original assignee: 주식회사 고영테크놀러지
Priority date: 2014-12-19
Filing date: 2015-12-18
Publication date: 2016-06-23
Also published as: KR20160074885A

Abstract

Disclosed are a surgical operation result display method capable of immediately displaying, during a surgical operation, the status of a subject to be operated on, and a surgical operation result display system using the same. The surgical operation result display method comprises the steps of: photographing a part of the body, including the subject to be operated on, so as to generate a transmissive image for the part of the body; photographing a state in which at least a part of the subject to be operated on is removed, via a through hole formed in the part of the body so as to be connected to the subject to be operated on, thereby forming a three-dimensional image for the subject to be operated on; matching the three-dimensional image to the transmissive image so as to generate a matching image including the three-dimensional image; and displaying the matching image to the outside through a display device.

Description

Surgical Result Display Method and Surgical Result Display System Using the Same

The present invention relates to a surgical result display method and a surgical result display system using the same, and more particularly, to a surgical result display method for displaying the surgical results to the surgeon to easily confirm the surgical results, and a surgical result display system using the same.

In general, if a brain tumor develops in the patient's head, it must be removed through surgical surgery. Such brain tumor surgery is usually performed by forming a predetermined through hole in the patient's head so that the surgeon is connected to the brain tumor, inserting a surgical tool into the through hole, and then removing the brain tumor.

On the other hand, surgery to accurately remove the brain tumor formed part is a difficult task. In particular, since the operation must be performed while checking the removal state of the brain tumor with the human eye through a predetermined through hole formed in the head of the patient, it is a surgical operation that requires very great skill and precision. Therefore, it is preferable to remove the brain tumor while removing all of the brain tumors in small portions, rather than removing all of the brain tumors at once.

However, it may be less reliable for the surgeon to confirm with the human eye how much the brain tumor has been removed during surgery. Therefore, it is necessary to confirm the removal state of the brain tumor using a transmission imaging device capable of imaging the inside of the human body, such as CT or MRI.

However, the method of confirming the removal state of the brain tumor through the transmission imaging apparatus must move to the transmission imaging apparatus to perform imaging every time a part of the brain tumor is removed, so that the operation time is excessively increased and the intensity of the intensity Surgical concentration can also lead to a problem that is lowered.

Accordingly, the present invention is to solve this problem, the problem to be solved by the present invention is to provide a surgical result display method that can immediately display the state of the operation target during surgery.

In addition, another object of the present invention is to provide a surgical result display system using the surgical result display method.

Surgical results display method according to an embodiment of the present invention comprises the steps of photographing a portion of the body including the operation target, generating a transmission image for a portion of the body; Photographing a state in which at least a portion of the surgical object is removed through a through hole formed in a portion of the body to be connected to the surgical target, thereby generating a 3D image of the surgical target; Matching the three-dimensional image with the transmission image to generate a matching image including the three-dimensional image; And displaying the matching image to the outside through the display device.

In the generating of the 3D image, the 3D image may be generated by using a 3D measuring device disposed at a position corresponding to the through hole.

The three-dimensional measuring apparatus irradiates the plurality of grating pattern lights to the surgery object N times at different angles, and then sequentially detects the grating pattern lights reflected from the surgery object, and thus N pattern images of the surgery object. And the N pattern images may be generated using the N-bucket algorism.

In the generating of the matching image, coordinate matching of the transmission image and the 3D image may be performed based on the surgical object to generate the matching image obtained by synthesizing the 3D image with the transmission image.

A portion of the body may comprise a human head and the surgical subject may comprise a brain tumor.

The surgical result display system according to an exemplary embodiment of the present invention includes a transmission imaging apparatus, a 3D measuring apparatus, an image matching processing apparatus, and a display apparatus.

The transmission photographing apparatus photographs a part of a body including a surgical object, and generates a transmission image of a part of the body. The three-dimensional measuring apparatus photographs a state in which at least a portion of the surgical object is removed through a through hole formed in a portion of the body to be connected to the surgical target, thereby generating a three-dimensional image of the surgical target. The image matching processing apparatus generates the matching image including the 3D image by matching the 3D image with the transmission image. The display device displays the matching image provided from the image matching processing device.

The 3D measuring device may be disposed at a position corresponding to the through hole to generate the 3D image.

Alternatively, the 3D measuring device may include an optical coherence tomography (OCT) device.

The image matching processing apparatus may generate the matching image by synthesizing the transmission image and the three-dimensional image based on the surgery target, and synthesizing the three-dimensional image with the transmission image.

As described above, according to the surgical result display method and the surgical result display system using the same, the real-time surgeon responsible for the operation of removing the surgical target, such as a brain tumor, is displayed in real time through the display device. As it can be confirmed, the accuracy of the removal of the surgical target can be improved without excessively increasing the operation time or deterioration of the concentration of the operation of the surgical collection.

1 is a block diagram showing a surgical result display system according to an embodiment of the present invention.

FIG. 2 is a side view illustrating a state in which a 3D measuring device is mounted on an operating table in the surgical result display system of FIG. 1.

FIG. 3 is a view for explaining a positional relationship between a three-dimensional measuring apparatus and a part of a body including a surgical target in FIG. 2.

FIG. 4 is a view showing a matching image representing a state of a surgery target according to FIG. 3.

5 is a view showing a state after a part of the surgical object is removed in FIG.

FIG. 6 is a view showing a matching image showing a state of a surgery target according to FIG. 5.

7 is a flowchart illustrating a method of displaying surgical results according to an embodiment of the present invention.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the text.

However, this is not intended to limit the present invention to the specific disclosed form, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "having" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described in the specification, and that one or more other features It should be understood that it does not exclude in advance the possibility of the presence or addition of numbers, steps, actions, components, parts or combinations thereof.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a surgical result display system according to an embodiment of the present invention, Figure 2 is a side view showing a state in which the three-dimensional measurement device is mounted on the operating table of the surgical result display system of Figure 1, 3 is a view for explaining the positional relationship between the three-dimensional measuring device and the part of the body including the surgical object in Figure 2, Figure 4 is a view showing a matching image showing the state of the surgical target according to FIG.

1 to 4, the surgical result display system according to the present embodiment is a system in which a surgeon in charge of a surgical operation can display a part of a patient's body including a surgical target during an operation, and includes a transmission imaging device ( 100, the 3D measuring apparatus 200, the image matching processing apparatus 300, and the display apparatus 400. Here, the patient may lie on the operating table 10, for example.

On the other hand, a part of the body refers to a part of the body of the person who can perform a surgical operation, such as the head of the patient or the back or waist of the patient. Here, when a part of the body is the head of the patient, the surgical target may be a brain tumor generated in the brain. In addition, when a part of the body is the back or waist of the patient, the surgical target may be a disk formed in the spine. In the present embodiment, a part of the body is the head of the patient, and the operation target will be described as an example that the brain tumor in the brain.

The transmission photographing apparatus 100 photographs a part of the body in which the surgery target 30 is included, and generates a transmission image of a part of the body. For example, the transmission photographing apparatus 100 is a photographing apparatus capable of photographing the inside of the body through a human body such as CT, MRI, etc., but is preferably disposed at a position adjacent to the operating table 10. Alternatively, the operating table 10 may be disposed at a distant position regardless of the operating table 10. Also, the transmission imaging apparatus 100 may be a digital X-ray detector capable of moving and photographing.

In the present embodiment, the transmission image generated by the transmission photographing apparatus 100 may be a two-dimensional image in the form of a photograph, but preferably may be a digital image that can be processed by a computer. In this case, when the transmission image is a two-dimensional image in the form of a photograph, an image conversion apparatus (not shown) provided separately may convert the transmission image into the digital image. Meanwhile, the transmission imaging apparatus 100 may generate a plurality of transmission images by photographing a part of the body at different angles.

The three-dimensional measuring apparatus 200 is photographed through the through-hole 40 formed in a portion of the body to be connected to the surgical target 30 to remove the at least a portion of the surgical target 30, the surgical target Generate a 3D image for 30.

Specifically, the three-dimensional measuring device 200 is disposed in a position facing the through hole 40, to shoot the surgical target 30 through the through hole 40 to generate the three-dimensional image. Can be. For example, the three-dimensional measuring apparatus 200 may be fixedly disposed to face the through hole 40 by a fixing unit 20 mounted on the operating table 10.

In this embodiment, the three-dimensional measuring device 200 may be a measuring device for measuring the three-dimensional shape of the object to be measured using an N-bucket algorithm (N-bucket algorism). For example, the three-dimensional measuring apparatus 200 irradiates the grating pattern lights to the surgical object 30 at different angles N times, and then sequentially measures the grating pattern lights reflected from the surgical object 30. As a result, N pattern images of the surgical object 30 may be obtained, and the N pattern images may be generated using the N-bucket algorism. That is, the three-dimensional measuring apparatus 200 extracts a phase at each irradiation angle corresponding to each position of an XY coordinate system from the N pattern images, and calculates a height at each irradiation angle from the phase. Then, the three-dimensional image representing the three-dimensional surface shape of the surgical target 30 can be generated using these heights.

Also, in the present embodiment, the three-dimensional measuring device may be an optical coherence tomography (OCT) device.

The optical coherence tomography apparatus is a high resolution imaging apparatus capable of three-dimensional imaging of microstructures inside biological tissues by combining the interference phenomenon of light and the principle of confocal microscopy, for example, near infrared (wavelength 0.6 μm to 1.3 An optical tomography apparatus for imaging a cross section of a living tissue in a non-contact and non-invasive manner using a light source in the (μm) region.

Specifically, for example, the optical coherence tomography apparatus may be operated based on a Michelson interferometer. That is, when the optical signal generated from the light source is divided into two optical signals in the optical coupler and incident on the reference stage and the sample stage, the reference light returned from the reference stage and the sample light scattered back from the sample stage meet again to cause optical interference. The cross section of the object to be photographed may be imaged using the optical interference signal.

The image matching processing apparatus 300 may be connected to the 3D measuring apparatus 200 through a signal line to receive the 3D image in real time from the 3D measuring apparatus 200. In this case, the image matching processing apparatus 300 may be disposed at a position adjacent to the operating table 10 and may be connected to the 3D measuring apparatus 200 through a signal line. However, when the image matching processing device 300 is disposed at a remote location irrespective of the operating table 10, the 3D measurement device 200 may be moved from the 3D measuring device 200 through a wired or wireless data transmission system built in a hospital. The image may be provided in real time.

In addition, the image matching processing apparatus 300 stores the transmission image generated by the transmission imaging apparatus 100. In this case, a worker manually stores the transmission image in the image matching processing apparatus 300 through a mobile memory such as a USB, or the transmission image is transferred to the image matching processing apparatus 300 through the wired / wireless data transmission system. It can be automatically sent and stored.

The image matching processing apparatus 300 generates the matching image including the 3D image by matching the 3D image with the transmission image. For example, the image matching processing apparatus 300 coordinate-aligns the transmission image and the three-dimensional image with respect to the surgical target 30, thereby matching the matching image obtained by synthesizing the three-dimensional image with the transmission image. Can be generated. That is, the image matching processing apparatus 300 matches the three-dimensional image with the image of the surgical target 30 included in the transmission image so as to be matched in XY coordinates, and then performs the operation of matching the matched three-dimensional image. The matching image may be generated by inserting the image of the object 30 in place of the image.

The display device 400 is connected to the image matching processing device 300 by a signal line to receive the matching image from the image matching processing device 300, and displays the brazed matching image to the outside. In this case, the display device 400 may be disposed at a position adjacent to the operating table 10 to display the surgical result of the surgical target 30 to the surgical surgeon in real time.

FIG. 5 is a view illustrating a state after a part of the surgery target is removed in FIG. 3, and FIG. 6 is a view illustrating a matching image showing a state of the surgery target according to FIG. 5.

5 and 6, the surgeon will remove at least a portion of the surgical object 30 using various surgical tools. In this case, the 3D measuring apparatus 200 generates the 3D image by photographing the current state of the surgical target 30 and transmits the 3D image to the image matching processing apparatus 300 in real time. Thereafter, the image matching processing apparatus 300 generates the matching image reflecting the current state of the surgery target 30 in real time and displays it externally through the display device 400.

Hereinafter, a method of displaying the surgical result using the surgical result display system described above will be described in detail.

Referring to FIG. 7, first, before the operation of the surgery target 30 is performed, the transmission apparatus 100 photographs a part of the body including the surgery target 30 to capture the transmission image. It generates (S100). Here, the step (S100) of generating the transmission image may be performed before the through hole 40 is formed in a part of the body, but may alternatively be performed even after the through hole 40 is formed.

Subsequently, when the surgeon proceeds to remove at least a portion of the surgical target 30, the 3D measuring apparatus 200 receives the removed state of the surgical target 30 through the through hole 40. Photographing to generate the three-dimensional image (S200).

On the other hand, before the step of generating the three-dimensional image (S200), the three-dimensional measuring apparatus 200 through the through-hole 40 to the state before the removal surgery for the surgical target 30 is in progress It may be taken to generate a three-dimensional image before surgery.

Subsequently, the image matching processing apparatus 300 stores the transmission image generated by the transmission imaging apparatus 100, receives the 3D image in real time from the 3D measurement apparatus 200, and then stores the 3D image. The dimensional image is matched with the transmission image to generate the matching image (S300).

Meanwhile, the image matching processing apparatus 300 receives the preoperative 3D image from the 3D measuring apparatus 200 before the surgical operation on the surgical target 30 is performed, and then the preoperative 3 The dimensional image may be matched with the transmission image to generate a preoperative matching image including the preoperative 3D image.

Subsequently, the display device 400 receives the matching image from the image matching processing device 300 and displays the matching image outside (S400). In this case, the surgeon may check the matching image displayed through the display device 400 and then proceed with the removal operation on the surgical target 30. As such, when the removal surgery is performed on the surgical target 30, the generation of the 3D image (S200), the generation of the matching image (S300), and the display of the matching image (S400) are continued. Can be done.

Meanwhile, the display device 400 may receive the pre-operational matching image from the image matching processing device 300 and display it externally before the removal operation on the surgical object 30 is performed.

As described above, according to the present exemplary embodiment, the surgeon in charge of the surgical operation confirms in real time through the display device 400 how much the surgical target 30 is removed during the operation for removing the surgical target 30. As such, the accuracy of the removal of the surgical target 30 may be improved without excessively increasing the operation time or decreasing the concentration of the surgery.

In addition, as the state of the surgical object 30 is three-dimensionally imaged and projected and displayed on the transmission image generated by the transmission photographing apparatus 100, the surgical collection point is an accurate state of the surgical object 30. You can check.

In the detailed description of the present invention described above with reference to the preferred embodiments of the present invention, those skilled in the art or those skilled in the art having ordinary skill in the art will be described in the claims to be described later It will be understood that various modifications and variations can be made in the present invention without departing from the scope of the present invention.

Claims

Photographing a portion of the body that includes a surgical object, and generating a transmission image of the portion of the body;

Photographing the surgical object by using a three-dimensional measuring device to generate a three-dimensional image of the surgical object;

Matching the three-dimensional image with the transmission image to generate a matching image including the three-dimensional image; And

Displaying the matching image to the outside through a display device;

The surgical subject is at least partially removed.

How to display surgical results.
The method of claim 1,

The generating of the three-dimensional image may include photographing the surgical target through a through hole.
The method of claim 2,

And the three-dimensional measuring device is disposed at a position corresponding to the through hole.
The method of claim 1,

The three-dimensional measuring device

After irradiating the plurality of grating pattern lights to the surgery object N times at different angles, the grating pattern lights reflected from the surgery object are sequentially detected to obtain N pattern images of the surgery object, and the N And generating three-dimensional images of N pattern images using an N-bucket algorism.
The method of claim 1,

In the step of generating the matching image,

And matching the transmission image and the three-dimensional image with respect to the surgery target to generate the matching image obtained by synthesizing the three-dimensional image with the transmission image.
The method of claim 1,

The operation target is a surgical result display method characterized in that it comprises a brain tumor or spinal disc.
A transmission photographing apparatus for photographing a part of a body including a surgical object and generating a transmission image of the part of the body;

A three-dimensional measuring apparatus for generating a three-dimensional image of the surgical target by photographing a state where at least a portion of the surgical target is removed through a through hole formed in a portion of the body to be connected to the surgical target;

An image matching processing device for matching the 3D image with the transmission image to generate a matching image including the 3D image; And

And a display device for displaying the matching image provided from the image matching processing device.
The method of claim 7, wherein

The three-dimensional measuring device

Surgical result display system, characterized in that arranged in the position corresponding to the through-hole to generate the three-dimensional image.
The method of claim 8,

The three-dimensional measuring device

After irradiating the plurality of grating pattern lights to the surgery object N times at different angles, the grating pattern lights reflected from the surgery object are sequentially detected to obtain N pattern images of the surgery object, and the N Surgical result display system characterized in that for generating the three-dimensional image of the pattern images using the N-bucket algorithm (N-bucket algorism).
The method of claim 8,

The three-dimensional measuring device

A surgical result display system comprising an optical coherence tomography (OCT) device.
The method of claim 7, wherein

The image matching processing device

And coordinate matching the transmission image and the three-dimensional image with respect to the surgical object to generate the matching image obtained by synthesizing the three-dimensional image with the transmission image.
The method of claim 7, wherein

A portion of the body comprises a human head,

The surgical target display system, characterized in that the surgical target comprises a brain tumor.