WO2015020093A1

WO2015020093A1 - Surgical image-observing apparatus

Info

Publication number: WO2015020093A1
Application number: PCT/JP2014/070752
Authority: WO
Inventors: 聖治倉本; 宏行美濃; 裕介佐藤; 義亜星野
Original assignee: オリンパスメディカルシステムズ株式会社
Priority date: 2013-08-08
Filing date: 2014-08-06
Publication date: 2015-02-12

Abstract

The surgical image-observing apparatus is equipped with: a recording device for recording observation images from an image pickup unit; a liquid-detecting section for performing image analysis of the observation images from the image pickup unit to detect a specified liquid in the observation images using changes in color in the observation images, and for estimating the time at which changes in the specified liquid began in the observation images; and a display control section for regenerating the observation images that have been recorded during a specified time from the time corresponding to the time at which changes in the specified liquid began and are a portion of the observation images recorded in the recording device, and displaying same on a display unit. The apparatus easily and quickly ascertains the state of hemorrhaging.

Description

Surgical image observation device

The present invention relates to a surgical image observation apparatus capable of detecting a bleeding position.

In recent years, medical observation devices such as endoscopes and surgical microscopes for observing the surgical site during medical procedures such as surgery have become widespread. Surgery using this medical observation device, for example, inserting an endoscope into a body cavity such as the abdominal cavity or chest cavity from a small fistula opened on the patient's body surface, and treating organs in the body cavity under the endoscopic observation, etc. Endoscopic surgery is frequently performed. As an advantage of such endoscopic surgery, it is mentioned that the invasiveness to a patient is low.

Such a surgical image observation apparatus includes an image sensor, and is configured to be able to capture an observation image in a patient body cavity by the image sensor. Observation images obtained by imaging can be output to a monitor or recorded, and images can be shared among surgical personnel such as an operator, an assistant, or a nurse.

By the way, during such endoscopic surgery, unexpected bleeding may occur from the surgical field. The surgical area may be obscured by bleeding, and the surgeon needs to remove blood from the surgical area and check the bleeding position to perform hemostasis. However, since the tissue within the observation range is covered with blood due to bleeding, it is not easy for the surgeon to check the bleeding position and the degree of bleeding.

In this case, it is considered that the surgeon confirms the bleeding position by reproducing the recorded observation image. For example, Japanese Patent Application Laid-Open No. 2010-17452 discloses a technique for displaying a recorded moving image and still image on the display screen of a parent image, and Japanese Patent Application Laid-Open No. 2000-358242 discloses a live image. A technique for reproducing a recorded image at an arbitrary timing on the display screen is disclosed. By using these techniques, it is possible to reproduce an image of a predetermined time at a timing designated by the operator.

However, the time from the start of bleeding until the surgeon gives an instruction to regenerate varies depending on the surgeon and the surgical environment. For this reason, the playback position cannot be set in advance, and in order to check the bleeding time, it is necessary to perform reverse playback to check the playback image, which wastes time and hinders medical practice. End up. Moreover, in the state where bleeding is occurring, it is a priority to perform hemostasis anyway, and there is currently only a method of trying to stop hemostasis by blindly applying gauze.

As described above, an object of the present invention is to provide a surgical image observation apparatus that can easily and quickly confirm the state of bleeding.

The surgical image observation apparatus according to the present invention includes a recording device that records an observation image from the imaging unit, and performs image analysis on the observation image from the imaging unit, and changes the color of the observation image in the observation image A liquid detection unit that detects the specific liquid and estimates a change start time of the specific liquid in the observation image, and a change in the specific liquid that is a part of the observation image recorded in the recording apparatus A display control unit that reproduces an observation image recorded for a predetermined time from a time corresponding to the start time point and displays the observation image on a display device.

The block diagram which shows the surgery image observation apparatus which concerns on the 1st Embodiment of this invention. The flowchart for demonstrating operation | movement of 1st Embodiment. Explanatory drawing for demonstrating operation | movement of 1st Embodiment. Explanatory drawing which shows the example when bleeding arises during observation. Explanatory drawing which shows a picture in picture display. Explanatory drawing for demonstrating the reproduction | regeneration image displayed on the small-screen area | region 60. FIG. The flowchart which shows the operation | movement flow employ | adopted in the 2nd Embodiment of this invention. Explanatory drawing which shows the example of a display of the amount of bleeding. Explanatory drawing which shows the modification of 2nd Embodiment. Explanatory drawing for demonstrating the display employ | adopted in the 3rd Embodiment of this invention. The flowchart which shows the selection processing flow of a display image. Explanatory drawing for demonstrating the display employ | adopted in the 4th Embodiment of this invention. Explanatory drawing which shows another modification. Explanatory drawing which shows the flexible endoscope 91 employable as an endoscope camera.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a surgical image observation apparatus according to a first embodiment of the present invention.

In the present embodiment, an example in which the endoscope camera 10 is used as an apparatus for outputting an observation image will be described. In addition, this invention is applicable not only to an endoscope camera but a microscope and various observation apparatuses. The endoscopic camera 10 can capture an image of a body cavity with an imaging unit (not shown) and output a captured image obtained by imaging. An observation image from the endoscope camera 10 is supplied to the surgical image observation apparatus 20.

The endoscopic camera 10 can generate a control signal for controlling the surgical image observation apparatus 20. The control signal includes a recording start signal for instructing recording start of an observation image that is a moving image, a recording end signal for instructing end of recording, a still image recording signal for instructing recording of an observation image that is a still image, and the like. For example, the endoscope camera 10 performs imaging in response to various scope operations such as a release button and a recording start button provided on the endoscope, and generates control signals corresponding to the various scope operations to perform surgery. The image can be output to the image observation apparatus 20.

Furthermore, in the present embodiment, the endoscope camera 10 can output a control signal for shifting to the bleeding check mode in accordance with a simple operation of the operator such as a button operation. Yes. In the present embodiment, an example of shifting to the bleeding confirmation mode according to the operation of the operator will be described. However, as described later, the configuration is configured to automatically shift to the bleeding confirmation mode depending on the image analysis result. It is also possible to do.

The surgical image observation apparatus 20 includes an interface (hereinafter referred to as I / F) 21 that receives a control signal from the endoscope camera 10 and an input circuit 22 that captures an observation image from the endoscope camera 10. The I / F 21 is an interface based on the RS-232C standard, for example. The input circuit 22 is an interface suitable for image transmission, and takes an observation image from the endoscope camera 10 and outputs it to the video processing circuit 23.

The video processing circuit 23 is controlled by the control unit 24 to perform predetermined video signal processing, such as matrix processing, white balance processing, enhancement processing, γ correction processing, character superimposition processing, etc., on the input observation image. Perform video signal processing. An observation image from the video processing circuit 23 is supplied to the output circuit 26. The output circuit 26 converts the input observation image into a video signal corresponding to the monitor 30 and outputs it to the monitor 30. The monitor 30 is composed of an LCD or the like and displays the input observation image.

Further, the video processing circuit 23 can be controlled by the control unit 24 to give the observation image after the signal processing to the recording device 25 for recording. The recording device 25 is configured by a hard disk device, a semiconductor storage device, or the like, and is controlled by the control unit 24 to record the observation image from the video processing circuit 23 and reproduce the recorded observation image to reproduce the video processing circuit. 23 can be output.

The surgical image observation apparatus 20 is provided with a clock unit 28. The clock unit 28 outputs time information to the video processing circuit 23. When recording the observation image, the video processing circuit 23 can record the time information based on the output of the clock unit 28 so as to be superimposed on the observation image. Thereby, the observation image of the time slot | zone designated from the recording device 25 is reproducible.

The video processing circuit 23 can switch between the observation image from the input circuit 22 and the reproduction image of the observation image from the recording device 25 and provide it to the output circuit 26. Further, the video processing circuit 23 can combine the observation image (live image) from the input circuit 22 and the reproduced image of the observation image from the recording device 25 and output the combined image to the output circuit 26. For example, the video processing circuit 23 can output a composite image for displaying a child image, which is a reproduction image, as a parent image in a picture-in-picture display in the parent image, and can also display the live image and the reproduction image. A composite image for picture-out-picture display can also be output.

The video processing circuit 23 is adapted to give the observation image to the memory 27 as well. The memory 27 has a capacity for storing an observation image of a predetermined field, and stores the observation image from the video processing circuit 23 and can output the stored observation image to the control unit 24. Yes.

The control unit 24 is configured by a CPU or the like, and controls each unit in the surgical image observation apparatus 20. In the present embodiment, the control unit 24 is given the observation image from the video processing circuit 23 and the observation image read out from the memory 27, and performs image analysis of the observation image, so that the bleeding state in the surgical region is determined. It can be confirmed.

For example, the control unit 24 performs image analysis of continuous observation images, and detects a bleeding start time, a starting position, a bleeding state, a change in the amount of bleeding, and the like based on changes in the preceding and following observation images. . The control unit 24 can detect the presence or absence of bleeding from a change in the color of the observation image, for example, a state in which a red color spreads within the observation range.

In the present embodiment, when a control signal for shifting to the bleeding confirmation mode is input, the control unit 24 designates the bleeding confirmation mode for each part. In the bleeding confirmation mode, the control unit 24 instructs the recording device 25 to output a reproduction image and reproduces the image processing circuit 23 so that an observation image captured at a time corresponding to the bleeding start time is reproduced. Instructs to output the playback image. Thereby, the video processing circuit 23 can simultaneously display an observation image after the bleeding time in a live image, for example.

When the bleeding spreads and the red color range is included in the observation image at a predetermined ratio or more, the control unit 24 shifts to the bleeding confirmation mode regardless of the presence or absence of the control signal. Also good. In the above description, an example is shown in which image analysis is always performed during observation to detect bleeding. However, when a control signal instructing a bleeding confirmation mode by an operator is input, the control signal is reversed from the input timing of the control signal. The observation image may be reproduced at high speed in the direction, and image analysis may be performed on the reproduced image to detect the bleeding start time, the start position, and the like.

Next, the operation of the embodiment configured as described above will be described with reference to the flowchart of FIG. 2 and the explanatory diagrams of FIGS.

It is assumed that the operator presses a recording start button provided on the endoscope camera 10 or the like and instructs the start of recording. By this operation, the endoscope camera 10 acquires an observation image in the body cavity and outputs it to the surgical image observation apparatus 20. If the power of the surgical image observation apparatus 20 is turned on, the control unit 24 displays an observation image in step S1. That is, an observation image from the endoscope camera 10 is supplied to the video processing circuit 23 through the input circuit 22 and subjected to predetermined image signal processing, and then supplied to the monitor 30 through the output circuit 26. . In this way, the observation image (live image) is displayed over the entire display screen of the monitor 30.

Next, the control unit 24 causes the recording device 25 to record the observation image in step S2 for the bleeding confirmation mode. Next, the control unit 24 detects a marker in order to set a region for detecting bleeding (hereinafter referred to as a region of interest) (step S3). For example, a specific object such as forceps may be detected as a marker. The control unit 24 sets a region of interest near the detected marker. Note that the control unit 24 may designate the entire range of the observation image as the region of interest. In this case, marker detection is not necessary.

FIG. 3 is an explanatory diagram for explaining an example of a marker and a region of interest. FIG. 3 shows the observed state in the body cavity. The state in the body cavity shown in FIG. 3 is observed by the endoscope camera 10. A blood vessel 41 is included in the observation range of the endoscope camera 10. In the example of FIG. 3, the blood vessel 41 is bifurcated within the observation range. FIG. 3 shows that the forceps 42 is located on the near side of the blood vessel 41. A part of the forceps 42 is provided with a marker 43 (shaded portion) colored with a predetermined color.

The marker 43 is colored with a predetermined color, and the control unit 24 can detect the marker 43 by relatively simple image analysis. When the control unit 24 detects the marker 43 from the observation image, the control unit 24 sets a predetermined region of interest 44 (broken line region) based on the position of the marker 43. The control unit 24 performs bleeding detection by image analysis only for the region of interest 44. There is a high possibility that the blood vessel 41 is damaged by the forceps 42. By setting only the vicinity of the forceps 42 in the region of interest 44, it is possible to detect bleeding that requires hemostasis at high speed and with high accuracy.

The control unit 24 detects the color change in the region of interest of the observation image by comparing the observation image from the memory 27 with the observation image from the video processing circuit 23. For example, the control unit 24 detects pixels that have changed to red in the region of interest, and observes changes in the number of red pixels, so that there is bleeding in the region of interest, bleeding start time, bleeding position, and amount of bleeding. Etc. are detected.

The control unit 24 determines the presence or absence of bleeding from the result of the bleeding detection process in step S4 (step S5). When it is determined that there is no bleeding, the control unit 24 returns the process to step S1. If the control unit 24 determines that bleeding is present in step S5, the process proceeds to step S6, and the bleeding start time is recorded in the memory 27, for example.

Next, in step S6, the control unit 24 determines whether or not a control signal for shifting to the bleeding confirmation mode is input from the endoscope camera 10. The control part 24 returns a process to step S1, when transfer to the bleeding confirmation mode is not instruct | indicated. It is assumed that the surgeon operates the endoscope camera 10, for example, and instructs to shift to the bleeding confirmation mode. Then, in step S8, the control unit 24 gives the bleeding start time to the recording device 25 and instructs the reproduction of the recorded observation image for a predetermined period from the bleeding start time. The reproduced image from the recording device 25 is given to the video processing circuit 23, and the video processing circuit 23 displays the reproduced image from the recording device 25 in a picture-in-picture (PinP) in the observation image from the input circuit 22, for example. .

In this case, the video processing circuit 23 may enlarge and display the region of interest for one or both of the live image and the reproduced image.

FIG. 4 is an explanatory diagram showing an example in the case where bleeding occurs during observation. FIG. 4 shows an observation image 52 displayed on the display screen 51 of the monitor 30. 4A and 4B show an observation image 52 in the same observation range, and the observation image 52 includes an image of a blood vessel 53 that is bifurcated. FIG. 4A shows a state immediately after the wound 55 is generated in the blood vessel 53 by the forceps 54, for example.

FIG. 4 (b) shows an observation image 52 after a predetermined time has elapsed from FIG. 4 (a). The observation image 52 shows that blood 56 has spread from the position of the wound 55 and has spread. In FIG. 4B, it can be clearly seen that the blood 56 spreads due to bleeding from the wound 55, but actually, when the blood 56 spreads over a wide range, the position of the wound 55 often becomes unobservable.

For example, it is assumed that the surgeon performs an operation for instructing the bleeding confirmation mode when the blood 56 spreads and enters the state of FIG. By this operation, a control signal for shifting to the bleeding confirmation mode is supplied to the surgical image observation apparatus 20. As described above, the control unit 24 repeats the bleeding detection process by image analysis from before the bleeding, and detects immediately after the bleeding, the presence or absence of bleeding, the bleeding start time, the position of the bleeding, the amount of bleeding, and the like. ing.

When the control signal is input, the control unit 24 instructs the recording device 25 to reproduce the recorded observation image for a predetermined period from the bleeding start time. For example, the recording device 25 instructs the reproduction of the observation image up to the time when the control signal is input. The control unit 24 also controls the video processing circuit 23 to execute picture-in-picture display for displaying a reproduced image in a live image.

FIG. 5 is an explanatory diagram showing a picture-in-picture display. On the display screen 51 of the monitor 30, an observation image (live image) 52 based on the current observation image from the endoscope camera 10 is displayed over the entire area. A reproduced image (playback) is displayed on a small screen in a partial small screen area 60 in the center of the observation image 52.

FIG. 6 is an explanatory diagram for explaining a reproduced image displayed in the small screen area 60. FIG. 6 shows four reproduced images 60a to 60d among the observed images of the moving image captured between the imaging time of FIG. 4 (a) and the imaging time of FIG. 4 (d).

FIG. 6A shows a reproduced image 60a at the bleeding start time, which is the timing at which the control unit 24 detects bleeding. In the reproduced image 60a, a past image 53a corresponding to the blood vessel 53 in FIG. 4, a past image 54a corresponding to the forceps 54, and a past image 55a corresponding to the wound 55 are displayed. Further, an image 56a of blood that has started to spread from the image 55a of the wound 55 is also displayed. 6B shows a reproduced image 60b after a predetermined time elapses from FIG. 6A, and FIG. 6C shows a reproduced image 60c after a predetermined time elapses from FIG. 6B. Yes. FIG. 6D shows a reproduced image 60d at the time when the control signal is input.

In the sub-screen area 60, the reproduced image is displayed as a moving image. As shown in the blood images 56a to 56d in the reproduced images 60a to 60d, the blood spreads within the observation range with time. The surgeon can confirm the state of bleeding by viewing the reproduced image in the small screen area 60. The reproduced image 60a shows a state immediately after the bleeding, and the operator can easily confirm the wound 55 that is the position of the bleeding with the reproduced image 60a with less bleeding. Further, since the reproduced image is displayed as a moving image, the surgeon can check the state of bleeding. The control unit 24 always detects bleeding and can display the reproduced image 60a immediately after the input of the control signal. As a result, the surgeon can confirm the bleeding position and the like in a relatively short time immediately after the start of bleeding, and is extremely effective for hemostasis work and the like.

For example, the control unit 24 displays a playback image from the time when the bleeding is detected to the time when the control signal is input, and controls so that the playback image during this period is repeatedly played and displayed until the operator gives an instruction. can do. The control unit 24 repeatedly displays the reproduced image until a control signal based on the operation of the operator is input from the endoscope camera 10 in step S9 in FIG. When the control signal is input, the control unit 24 returns the process from step S9 to step S1.

In addition, although demonstrated as what reproduce | regenerates the observation image corresponding to the time of detecting bleeding, the control part 24 starts reproduction | regeneration from the observation image corresponding to the time before predetermined time from the time of detecting bleeding, and predetermined time after You may control to do.

As described above, in the present embodiment, during observation in the body cavity, bleeding is detected by analyzing the image of the observation image, particularly by analyzing the color change. Then, when a control signal by the operator's operation is input, the mode is shifted to the bleeding check mode, and the reproduction of the observation image corresponding to the start point of the bleeding is started, and for example, a child screen is displayed in the live image. Thus, the surgeon can confirm the observation image at the time of bleeding on the screen by performing a simple operation for shifting to the bleeding confirmation mode after bleeding. At the time of bleeding, there is little spread of blood, and the operator can easily check the bleeding position and the state of the wound from the reproduced image. Moreover, bleeding is always detected by image analysis of the control unit, so that the operator can check the reconstructed image at the time of bleeding immediately after a simple operation, which is extremely useful for hemostasis work and the like. is there.

(Second Embodiment)
FIG. 7 is a flowchart showing an operation flow employed in the second embodiment of the present invention. The hardware configuration of this embodiment is the same as that of the first embodiment.

In the first embodiment, the example in which the observation image is reproduced from the bleeding start time or a time in the vicinity thereof and displayed on the live image is displayed. However, the present embodiment additionally displays information on the amount of bleeding. An example is given.

FIG. 7 shows the display insertion process of the bleeding amount adopted simultaneously with step S8 of FIG. In step S8 of FIG. 2, the recorded observation image from the bleeding start time until the control signal is input is displayed as a picture-in-picture on the live image. In the present embodiment, the processing of FIG. 7 is performed simultaneously with step S8. That is, the control unit 24 starts reproduction of the recorded observation image (step S11), and acquires a still image of a predetermined field. The control unit 24 obtains the area of the red range from the acquired still image (step S13). There is a correlation between the size of the area and the amount of bleeding that has occurred, and the control unit 24 estimates the amount of bleeding from the area in the red range (step S14).

The control unit 24 generates display data based on the calculated bleeding amount and outputs it to the video processing circuit 23 (step S15). The video processing circuit 23 inserts a display indicating the amount of bleeding into the reproduced image from the recording device 25 and outputs it to the output circuit 26. In step S17, the control unit 24 determines whether or not a predetermined time, which is a measurement interval, has elapsed. If not, the control unit 24 waits until the predetermined time elapses while determining whether or not reproduction has ended in step S18. . When the predetermined time has elapsed, the control unit 24 returns the process to step S12, obtains the next still image, and repeats the bleeding amount display insertion process.

Thus, the display data of the bleeding amount is generated at predetermined time intervals. The video processing circuit 23 continues displaying the bleeding amount before the update until the display data of the bleeding amount is updated.

FIG. 8 is an explanatory view showing a display example of such a bleeding amount. FIGS. 8A to 8D correspond to FIGS. 6A to 6D, respectively, and blood loss indications 57a to 57d are inserted. For example, the amount of bleeding at the time of the reproduction image 60a is shown to be 0 cc, and the amount of bleeding changes to 0.5 cc, 1 cc, and 3 cc as the reproduction images 60b to 60d change.

Thus, in this embodiment, the same effect as in the first embodiment can be obtained, and not only the state of bleeding is displayed, but also the amount of bleeding is displayed numerically, It is easier to check the bleeding.

In the present embodiment, an example has been described in which the display data is generated by obtaining the bleeding amount when the recorded observation image is reproduced. However, when it is determined in step S5 in FIG. The amount of bleeding may be obtained while recording, or display data may be simultaneously generated and recorded simultaneously with the observation image.

(Modification)
FIG. 9 is an explanatory view showing a modification of the second embodiment. FIGS. 9 (a) to 9 (d) correspond to FIGS. 8 (a) to 8 (d), respectively, and show that the digitized bleeding amount displays 57a to 57b are changed to bar graph display 58a to 58d. Different from the display of 8.

According to this modification, it is possible to intuitively recognize a change in the amount of bleeding by using a bar graph. In the flow of FIG. 7, an example is shown in which the display is updated at a predetermined measurement time interval in consideration of the visibility of the numerical value. However, in the case of a graphic display, it is easy to recognize even if it is a continuous change. Therefore, the amount of bleeding and display data may be generated as fast as possible.

(Third embodiment)
FIG. 10 is an explanatory diagram for explaining a display employed in the third embodiment of the present invention. FIG. 11 is a flowchart showing a display image selection processing flow. The hardware configuration of this embodiment is the same as that of the first embodiment.

In the first embodiment, an example in which an observation image is reproduced from a bleeding start time or a time in the vicinity thereof and displayed as a moving image overlaid on a live image has been described, but this embodiment includes a live image of a moving image, An example in which the reproduced still image observation image is displayed in an overlapping manner is shown.

10, an observation image 52 that is a live image is displayed on the display screen 51 of the monitor 30 (not shown). In the present embodiment, the video processing circuit 23 displays the observation image reproduced from the recording device 25 as a still image. In this case, the control unit 24 may select and display the reproduced image at a predetermined time interval, and may determine the number of still images to be displayed based on the detection result of the bleeding amount. Good. For example, the control unit 24 may display a still image each time the bleeding increases by a predetermined increase amount, and selects the still image to be displayed based on the relationship between the maximum bleeding amount and the specified number of sheets to be displayed. You may do it. The control unit 24 can display an appropriate number of still images according to the operation of the operator.

The example of FIG. 10 shows an example in which four still images 70a to 70d are displayed on the observation image 52. These still images 70a to 70d include a blood vessel past image 53a, a wound image 55a, and bleeding

images

56c and 56d. By these still images 70a to 70d, the surgeon can indicate the state and position of the bleeding. I can grasp it.

FIG. 11 shows an example of display image selection processing. In FIG. 11, the same steps as those in FIG. In steps S11 to S14 in FIG. 11, the bleeding amount is calculated from the reproduced still image by reproducing the recorded observation image.

In step S21, the control unit 24 determines whether or not the amount of bleeding has reached a prescribed increase amount. If the prescribed increase amount has not been reached, the process returns to step S12 to acquire the next still image, and the bleeding amount is calculated. When the amount of bleeding has reached the prescribed increase amount, the control unit 24 outputs the still image to the video processing circuit 23 in step S22.

The control unit 24 repeats the selection processing in steps S12 to S22 until it is determined in step S23 that the specified number has been reached. When the number reaches the specified number, the video processing circuit 23 displays the selected reproduced image.

As described above, also in this embodiment, the same effect as that of the first embodiment can be obtained. This embodiment has an advantage that the state of bleeding can be confirmed by a still image, and confirmation can be easier than when displaying a moving image.

(Fourth embodiment)
FIG. 12 is an explanatory diagram for explaining a display employed in the fourth embodiment of the present invention. The hardware configuration of this embodiment is the same as that of the first embodiment.

In the third embodiment, an example in which an observation image is reproduced from a bleeding start time or a time in the vicinity thereof and displayed as a still image on a live image has been described. However, in the present embodiment, a bleeding position is further included in a live image. The example which displays the display which shows is shown. In addition, although this Embodiment has shown the example applied to 3rd Embodiment, it is clear that you may apply to 1st, 2nd Embodiment.

In FIG. 12, an observation image 52 that is a live image is displayed on the display screen 51 of the monitor 30. In the observation image 52, an image of the blood vessel 53 is displayed. The observation image 52 also displays an image of blood 74 that has bleed so as to cover part of the blood vessel 53. From the image of blood 74, the bleeding position (scratch position) cannot be confirmed only by the observation image 52.

In the present embodiment, as described above, the control unit 24 detects the bleeding position, generates display data indicating the bleeding position, and outputs the display data to the video processing circuit 23. The video processing circuit 23 displays the observation image reproduced from the recording device 25 as a still image, and displays a display 75 indicating the bleeding position on the observation image 52 that is a live image.

As described above, also in this embodiment, the same effect as that of the first embodiment can be obtained. Furthermore, in the present embodiment, a display indicating the bleeding position can be displayed on the observation image that is a live image. Thus, the surgeon can confirm the bleeding position on the current observation image, and can perform the hemostasis work while confirming the positional relationship between the forceps for hemostasis and the bleeding position.

(Other variations)
FIG. 13 is an explanatory view showing another modification. In the surgical field, a scalpel or treatment tool using ultrasonic waves or high frequency may be used. FIG. 13 shows an example in which such a treatment tool 81 is employed. The treatment instrument 81 is supplied with energy from an output circuit 82 that supplies high-power energy, whereby a predetermined treatment can be performed.

The output circuit 82 supplies energy to the treatment instrument 81. In the present modification, the surgical image observation device 20 communicates with the output circuit 82 so that information on whether or not energy is supplied to the treatment instrument 81 is given from the output circuit 82. It has become.

When it is detected from this information that energy is supplied to the treatment instrument 81, the control unit 24 detects the image of the treatment instrument 81 by image analysis of the observation image, and sets a region of interest in the vicinity of the treatment instrument 81. Be able to.

Thereby, for example, even when the region of interest is set for the entire observation image in the initial state, the region of interest can be set in the vicinity of the treatment instrument 81. Thereby, even when bleeding occurs due to the treatment of the treatment instrument 81, the bleeding position can be detected with high accuracy.

Since the treatment tool 81 is treated by being supplied with relatively large energy, bleeding may occur in the surgical field. For this reason, it is possible to reliably detect the bleeding state by setting the region of interest in the vicinity of the treatment tool 81 based on the information from the output circuit 82 as in this modification.

If the control unit 24 determines from the detection result of the bleeding amount that the bleeding amount is greater than a predetermined threshold, the control unit 24 outputs control information to the output circuit 82 so as to increase the output of the output circuit 82. You may do it. Thereby, it can comprise so that comparatively big energy may be supplied to the treatment tool 81 only when it is required, and it is possible to perform a hemostatic treatment etc. effectively.

In addition, as the endoscope camera 10, the flexible endoscope 91 shown in the explanatory view of FIG. 14 can be employed. An optical window member 93, an objective lens 94, a treatment instrument channel 95, and the like are disposed at the insertion portion distal end portion 92 of the flexible endoscope 91, and an observation image in a body cavity incident from the objective lens 94 is observed as a surgical image. It can be transmitted to the device 20.

Further, in each of the above embodiments, it has been described that red is detected by image analysis and bleeding is detected. However, the present invention is not limited to bleeding, and can be applied to detection of various liquids by determining various colors by image analysis. can do. Further, the brightness of red is relatively low, and bleeding can be detected also by monochrome image analysis, that is, luminance analysis, and the present invention is also applicable to those performing such monochrome image analysis. .

Also, as the endoscope camera 10, a camera capable of 3D shooting can be employed. By adopting a camera capable of 3D imaging, it is possible to calculate the distance from the camera to a specific position in the observation region, and the calculation results such as the distance from the camera to the region of interest and the distance from the forceps to the region of interest Can be displayed in a live image.

The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

This application is filed on the basis of the priority claim of Japanese Patent Application No. 2013-165330 filed in Japan on August 8, 2013, and the above disclosure includes the present specification, claims, And cited in the drawings.

Claims

A recording device for recording an observation image from the imaging unit;
Image analysis is performed on the observation image from the imaging unit, and a specific liquid in the observation image is detected by a change in color of the observation image, and a change start time of the specific liquid in the observation image is estimated. A liquid detector to perform,
A display control unit that reproduces an observation image that is a part of the observation image recorded in the recording device and is recorded for a predetermined time from a time corresponding to the change start time of the specific liquid, and displays it on the display device A surgical image observation apparatus comprising:
The surgical image observation apparatus according to claim 1, wherein the display control unit starts reproduction of the observation image based on a predetermined control signal.
The operation according to claim 1, wherein the display control unit starts reproduction of the observation image when the specific liquid is detected by the liquid detection unit over a predetermined area in the observation image. Image observation device.
4. The liquid detection unit according to claim 1, wherein the liquid detection unit detects at least one of a change start position of the specific liquid and the amount of the specific liquid in the observation image. 5. Surgical image observation device.
The surgical image observation apparatus according to claim 4, wherein the display control unit displays a detection result of the liquid detection unit.
The surgical image observation apparatus according to any one of claims 1 to 5, wherein the display control unit simultaneously displays an observation image from the imaging unit and a reproduction image from the recording device.
The surgical image observation apparatus according to claim 1, wherein the display control unit displays the reproduced image as a moving image.
The surgical image observation apparatus according to any one of claims 1 to 6, wherein the display control unit displays the reproduced image as a still image.
The surgical image observation apparatus according to any one of claims 1 to 8, wherein the liquid detection unit detects the specific liquid from a predetermined region of interest in the observation image.
The surgical image observation apparatus according to claim 9, wherein the liquid detection unit detects the marker in the observation image and sets the region of interest.
The surgical image observation apparatus according to claim 9 or 10, wherein the display control unit performs an enlarged display of the region of interest.
The surgical image observation apparatus according to any one of claims 1 to 11, wherein the imaging unit is provided in an endoscope.