KR102098958B1 - Three Dimensions Image Dysplay System for The Organ - Google Patents

Abstract

The present invention is a first image acquiring unit that is inserted into the human body to take an image of an organ in two dimensions and to generate a first image in which the photographed two-dimensional image matches a preset reference coordinate; A second image acquiring unit for photographing an organ in the human body in three dimensions from outside through X-rays, a magnetic field, or ultrasound irradiated from the outside, and generating a second image in which the photographed image is matched with a reference coordinate; The first image is transmitted from the first image acquisition unit and the second image is transmitted from the second image acquisition unit to generate a third image, a three-dimensional image in which the first image and the second image are superimposed based on the reference coordinates. A first image synthesizing unit; A fourth image is transmitted, receives a first input signal for movement and rotation of a third image based on a reference coordinate from the outside, and a fourth image in which the third image is moved and rotated based on the first input signal A second image synthesizing unit for generating a; And a display unit that receives the first image and displays it in two dimensions, and receives and displays the second image, the third image, and the fourth image in three dimensions.

Description

Human organs 3D image display system {Three Dimensions Image Dysplay System for The Organ}

The present invention relates to a 3D image display system for a human body device, and specifically, an image of a human organ taken through a laparoscope or an endoscope without opening the human body in 3D, and moving or rotating the implemented 3D image It relates to a human body organ 3D image display system that can be.

In general, the method of observing the organs in the human body is by directly opening the human body to observe the organs, or by placing an endoscope or laparoscope in the human body, or by examining the human body with X-rays, ultrasound, magnetic fields, etc. There is a way to observe organs indirectly.

However, since all of the above-described methods are two-dimensional images, in order to realize them as three-dimensional images, special glasses that implement two-dimensional images in three dimensions, or separate image processing of two-dimensional images must be implemented in three dimensions. There was a problem in that it was inconvenient, and a medical practitioner performing a medical practice could not immediately confirm the image photographed in the process of examining a patient's internal organs in three dimensions.

In addition, when observing the organs in the human body while observing the organs from a different direction, in the case of laparotomy, the medical practitioner's gaze must be observed in another direction or by directly rotating or moving the organs, such as endoscopy or laparoscopy. When using, the surgical tool has to be moved in the direction that the medical actor wants to observe, and when using X-rays, ultrasound, magnetic fields, etc., the patient's position has to be changed and taken again.

In this problem, if the medical practitioner is inexperienced with manipulations such as an endoscope or laparoscopy, other organs may be damaged during directional movement, and when using radiation such as X-rays, a lot of radiation is irradiated to the patient. In the case, there was a problem that the opening range was wider.

Korean Patent Publication No. 2012-0117165

The present invention has been invented to solve the above problems, the purpose of which is the same reference coordinates for a 3D image taken in advance of a 2D image of an organ observed by an instrument such as an endoscope inserted into the human body through a medical actor. The purpose of the present invention is to provide a 3D image display system for human organs that can be perfectly overlapped even if the sizes between the 2D image and the 3D image are different because they are overlapped by using.

In addition, by observing the organ by moving or rotating the image created by inverting the two-dimensional image and the three-dimensional image, the medical practitioner does not need to observe the organ while moving an instrument such as an endoscope inserted in the human body. The object of the present invention is to provide a three-dimensional image display system for human organs that can reduce the pain of patients, reduce the time to observe organs, and prevent medical accidents due to inadequate manipulation of medical devices by medical actors.

In addition, by observing the organ by enlarging or reducing the image generated by indirectly grafting the 2D image and the 3D image, the medical practitioner does not need to extract the tissue to observe the tissue of the organ in more detail. It is an object of the present invention to provide a 3D image display system for human organs capable of preventing pain caused by the human body.

The present invention for achieving the above technical problem is a first image acquisition unit that is inserted into the human body to take an image of an organ in two dimensions, and to generate a first image in which the captured two-dimensional image is matched with a preset reference coordinate; A second image acquiring unit that photographs an organ in the human body in three dimensions through X-rays, a magnetic field, or ultrasound irradiated from the outside, and generates a second image in which the photographed image matches the reference coordinates; The first image is transmitted from the first image acquisition unit and the second image is transmitted from the second image acquisition unit to generate a third image, a three-dimensional image in which the first image and the second image are superimposed based on the reference coordinates. A first image synthesizing unit; A fourth image is transmitted, receives a first input signal for movement and rotation of a third image based on a reference coordinate from the outside, and a fourth image in which the third image is moved and rotated based on the first input signal A second image synthesizing unit for generating a; And a display unit that receives the first image and displays it in two dimensions, and receives and displays the second image, the third image, and the fourth image in three dimensions.

In addition, a third image is received, a second input signal for enlargement and reduction of a third image based on a reference coordinate is received from the outside, and the third image is enlarged and reduced based on the second input signal. A third image combining unit generating a fifth image; and further comprising, the display unit is characterized in that it further receives the fifth image and displays it in three dimensions.

Further, the second image synthesizing unit detects a mechanism having a preset shape from the third image, and generates a fourth image in which the third image is moved and rotated based on the first input signal based on the detected end portion of the mechanism. It is characterized by.

In addition, the third image synthesizing unit detects a mechanism having a predetermined shape from the third image, and generates a fifth image in which the third image is moved and rotated based on the second input signal based on the detected end portion of the mechanism. It is characterized by.

In addition, the display unit may be characterized in that the first image, the second image, the third image, the fourth image and the fifth image are displayed in multiple numbers.

According to the human body organ 3D image display system of the present invention, a device such as an endoscope is inserted into a human body through a medical actor to superimpose a 2D image of an organ observed by using the same reference coordinates on a 3D image taken in advance. Therefore, even if the size between the 2D image and the 3D image is different, it is possible to provide a human organ 3D image display system capable of perfectly overlapping.

In addition, by observing the organ by moving or rotating the image created by inverting the two-dimensional image and the three-dimensional image, the medical practitioner does not need to observe the organ while moving an instrument such as an endoscope inserted in the human body. It is possible to provide a 3D image display system for a human organ that can reduce a patient's pain, reduce the time to observe an organ, and prevent medical accidents due to inadequate manipulation of medical devices by medical actors.

In addition, by observing the organ by enlarging or reducing the image generated by indirectly grafting the 2D image and the 3D image, the medical practitioner does not need to extract the tissue to observe the tissue of the organ in more detail. It is possible to provide a 3D image display system for human organs that can prevent pain caused by the human body.

1 is a block diagram of a human organ 3D image display system according to a preferred embodiment of the present invention,
2 is a block diagram further comprising a third image synthesizing unit in the human organ 3D image display system according to a preferred embodiment of the present invention,
Figure 3 is a schematic diagram of the third image generated in the human body 3D image display system according to a preferred embodiment of the present invention is moved and rotated,
Figure 4 is a schematic diagram of the enlargement and reduction of the third image generated in the human organ 3D image display system according to a preferred embodiment of the present invention,
5 is a schematic diagram in which a third image generated in a 3D image display system of a human body according to a preferred embodiment of the present invention is moved and rotated through a mechanism having a preset shape,
6 is a schematic diagram in which a third image generated in a 3D image display system of a human body according to a preferred embodiment of the present invention is enlarged and reduced through a mechanism having a preset shape.

In order to fully understand the present invention, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be interpreted as being limited to the embodiments described in detail below. This embodiment is provided to more fully describe the present invention to those skilled in the art. Accordingly, the shape of the elements in the drawings may be exaggerated to emphasize a clearer description. It should be noted that in each drawing, the same members may be indicated by the same reference numerals. In addition, detailed descriptions of well-known functions and configurations that are judged to unnecessarily obscure the subject matter of the present invention are omitted.

Hereinafter, a three-dimensional image display system of the present invention will be described in detail by explaining preferred embodiments of the present invention with reference to the accompanying drawings.

3D image display system of the present invention, as shown in Figure 1, the first image acquisition unit 100, the second image acquisition unit 200, the first image synthesis unit 300, the second image synthesis unit ( 400) and a display unit 500.

The first image acquisition unit 100 is inserted into the human body to take an image of an organ in two dimensions, and generates a first image in which the photographed two-dimensional image is matched with a preset reference coordinate.

Here, the preset reference coordinates may be coordinates using the X-axis, Y-axis, and Z-axis, or may be coordinates used for latitude and longitude. If 3D coordinates are used, coordinates using X-axis, Y-axis, and Z-axis are used, but only X-axis and Y-axis are used without Z-axis to match the 2D image.

The second image acquisition unit 200 photographs an organ in the human body in three dimensions from outside through X-rays, a magnetic field, or ultrasound, and generates a second image in which the photographed image is matched with a reference coordinate.

Here, the preset reference coordinates may be coordinates using the X-axis, Y-axis, and Z-axis, or may be coordinates used for latitude and longitude.

The first image synthesizing unit 300 receives the first image from the first image acquisition unit 100 and receives the second image from the second image acquisition unit 200, and the first image and the first image based on the reference coordinates. A third image, which is a three-dimensional image in which two images are superimposed, is generated.

Here, since the first image and the second image are implemented using the same reference coordinates, the X-axis, Y-axis of the first image, which is a two-dimensional image, and the X-axis, Y-axis, and Z-axis of the second image that is a three-dimensional image. After overlapping and matching the X and Y axes, the Z axis of the second image is image-processed to generate a 3D image, which is a 3D image.

If the coordinates using different criteria are used, the principle of generating the third image by overlapping the first image and the second image is as described above.

As shown in FIG. 3, the second image synthesis unit 400 receives the third image, receives a first input signal for movement and rotation of the third image based on the reference coordinate from the outside, and receives the third image. A fourth image in which the third image is moved and rotated is generated based on the 1 input signal.

Here, FIG. 3 (a) shows a third image generated by superimposing a first image photographed by a device such as a simple endoscope in the human body and a second image photographed by X-rays, ultrasound, and magnetic fields from the outside, (b) shows a fourth image with the third image rotated to the left, and (c) shows a fourth image with the third image rotated to the right.

In addition, as illustrated in FIG. 5, the second image synthesizing unit 400 detects a mechanism having a preset shape in the third image, and a third image based on the first input signal based on the detected end portion of the mechanism. Creates a fourth image that has been moved and rotated.

Here, FIG. 5 (a) is a preset shape of a third image generated by overlapping a first image photographed with a device such as a simple endoscope in the human body and a second image photographed with X-rays, ultrasound, and magnetic fields from outside. The dragging through the distal end A of the instrument 10 is shown, and (b) the third image is rotated in the direction dragged through the distal end A of the instrument 10 having a preset shape in (a). The fourth image is shown.

In addition, the instrument 10 of a preset shape may be a shape such as an endoscope or a laparoscopic instrument, and it is detected only when there is an image of the instrument having a preset shape in the image area of the image.

The display unit 500 receives the first image and displays it in two dimensions, and receives the second image, the third image, and the fourth image and displays it in three dimensions.

Also, the display unit 500 displays the first image, the second image, the third image, and the fourth image in multiple numbers. Here, since the first image, the second image, the third image, and the fourth image are displayed in multiple numbers, a medical practitioner may view them at once because the types of images required are different depending on the situation when performing medical procedures. This is to reduce the time required to find an image to be confirmed during the procedure.

As such, the 3D image display system uses a same reference coordinate to superimpose a 2D image of an organ observed by an instrument such as an endoscope inside a human body through a medical actor, using the same reference coordinates. Even if the sizes between the image and the 3D image are different, there is an advantage that a 3D image can be realized by perfectly overlapping them.

In addition, by moving or rotating the third image, which is a 3D image implemented through the first image synthesizing unit 300, to observe the organ, a medical practitioner moves an instrument such as an endoscope inserted into the human body and does not observe the organ. Since there is no need, there is an advantage that the pain of the patient receiving the medical action is less, the time for observing the organ is reduced, and the medical accident due to the inadequate operation of the medical device by the medical actor is prevented.

The 3D image display system described above may generate and display an image in which the third image is enlarged and reduced.

As described above, the 3D image display system further includes a third image synthesizing unit 600.

As illustrated in FIG. 4, the third image synthesis unit 600 receives the third image, receives a second input signal for enlargement and reduction of the third image based on the reference coordinate from the outside, and receives the third image. 2 Generates a fifth image in which the third image is enlarged and reduced based on the input signal.

Here, (a) of FIG. 4 is a third image and a third image generated by overlapping a first image photographed with a device such as a simple endoscope in the human body and a second image photographed with X-rays, ultrasound, and magnetic fields from the outside. Shows an enlarged fifth image, and (b) shows a third image and a fifth image in which the third image is reduced.

In addition, as illustrated in FIG. 6, the third image synthesis unit 600 detects a mechanism having a predetermined shape from the third image, and the third image is based on the second input signal based on the distal end of the detected mechanism. Creates a fifth image enlarged and reduced.

Here, FIG. 6 (a) is a preset shape of a third image generated by overlapping a first image photographed with a device such as a simple endoscope in the human body and a second image photographed with X-rays, ultrasound, and magnetic fields from outside. Dragging through the distal end (A) of the instrument 10, shows a fifth image in which the third image is reduced in the dragged direction, and (b) shows the third image at the distal end of the instrument 10 of a preset shape. A fifth image in which the third image is enlarged in the dragged direction by dragging through (A) is illustrated.

The display unit 500 receives the fifth image and further displays it in three dimensions, and multiplexes the first image, the second image, the third image, the fourth image, and the fifth image.

Since the 3D image display system can enlarge and reduce the third image, the patient does not need to remove the tissue in order to observe the tissue of the organ in more detail, so the patient suffers from the tissue extraction It has the advantage of disappearing.

The embodiment of the three-dimensional image display system of the present invention described above is only exemplary, and those skilled in the art to which the present invention pertains can realize that various modifications and other equivalent embodiments are possible. You will know well. Therefore, it will be understood that the present invention is not limited to the forms mentioned in the above detailed description. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims. It is also to be understood that the invention includes all modifications and equivalents and alternatives within the spirit and scope of the invention as defined by the appended claims.

100: first image acquisition unit 200: second image acquisition unit
300: first image synthesis unit 400: second image synthesis unit
500: display unit 600: third image synthesis unit

Claims (5)

A first image acquiring unit 100 that generates a first image in which a two-dimensional image of an organ observed through a photographing device inserted in a human body is matched with a preset reference coordinate;
A second image acquisition unit 200 that photographs an organ in the human body in three dimensions in advance through X-rays, a magnetic field, or ultrasound irradiated from the outside, and generates a second image in which the pre-photographed image matches the reference coordinates. ;
The first image is received by the first image acquisition unit 100 and the second image is received by the second image acquisition unit 200, and the first image and the second image are superimposed based on the reference coordinates. A first image synthesizing unit 300 that generates a third image, which is a three-dimensional image;
The third image is received, a first input signal for movement and rotation of the third image based on the reference coordinate is received from the outside, and the third image is moved and moved based on the first input signal. A second image combining unit 400 generating a rotated fourth image;
The third image is received, a second input signal for enlargement and reduction of the third image based on the reference coordinate is received from the outside, and the third image is enlarged and enlarged based on the second input signal. A third image synthesizing unit 600 for generating a reduced fifth image; And
It includes; a display unit 500 for receiving the first image and displaying it in two dimensions, and receiving and displaying the second image, the third image, the fourth image, and the fifth image in three dimensions.
The second image synthesizing unit 400 detects an instrument having a predetermined shape from the third image, and the third image is moved and rotated based on the distal end in a direction dragged through the distal end of the instrument. Create a fourth image,
The third image synthesizing unit 600 detects an instrument having a predetermined shape from the third image, and the third image is enlarged and reduced based on the distal end in a direction dragged through the distal end of the instrument. A human body organ 3D image display system, characterized by generating a fifth image.
delete delete delete According to claim 1, The display unit 500,
The first image, the second image, the third image, the fourth image and the fifth image, a human body organ three-dimensional image display system, characterized in that to display multiple.

Images