JP2016046780A - Image recording apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image recording apparatus capable of reproducing a 3D endoscopic image having a three-dimensional appearance, even when a display environment of the endoscopic image at recording is different from a reproduction environment by reproduction equipment having a different reproduction method for reproducing a recorded image.SOLUTION: The image recording apparatus determines, from the information of an observation environment and the information of the display environment recorded in the recording apparatus, whether or not there is a difference between both information sets. If there is a difference only in the reproduction method, the image recording apparatus converts the reproduction method, whereas if there is a difference in a screen size etc., calculates a corresponding correction value from an adjustment table stored in a parameter storage device, so as to correct alignment and output to the reproduction equipment an output image, which reproduces a stereoscopic vision of the display environment, from the 3D image reproduced from the recording apparatus.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an image recording apparatus that records a 3D image and outputs the recorded 3D image to a playback device.

In recent years, endoscopes have been widely used in the medical field and the like. When an operation or the like is performed using an endoscope, an endoscopic image during the operation is recorded in an image recording device.
In some cases, surgery or the like is performed using a stereoscopic endoscope (also referred to as a 3D endoscope) including left and right imaging elements. In that case, the image recording apparatus records a 3D endoscope image. . The recorded 3D endoscope image may be reproduced at a conference or the like.
For example, Japanese Patent Application Laid-Open No. 2011-223482 as a first conventional example includes a first acquisition unit that acquires an assumed visual environment parameter that is a parameter of an assumed visual environment together with image data of a 3D image; A second acquisition unit configured to acquire a real visual environment parameter that is a parameter of an actual visual environment of a user who views the image; and the 3D according to a difference between the acquired assumed visual environment parameter and the real visual environment parameter. An image processing apparatus including correction processing means for correcting an image is disclosed.
Japanese Patent Application Laid-Open No. 2012-85102 as a second conventional example inputs stereoscopic video conversion by inputting two or more videos with different viewpoints and changing the convergence angles of the input two or more videos. In the apparatus, a maximum parallax amount of the two or more videos is calculated, a convergence angle correction value is calculated such that the calculated maximum parallax amount is equal to or less than a predetermined maximum parallax amount, and based on the calculated convergence angle correction value And generating an image in which a convergence angle is changed when the two or more images are captured.

JP 2011-223482 A JP2012-85102A

The first conventional example discloses that the parameter of the visual environment is at least one of the binocular interval, the visual distance, and the display size. If they are different, a 3D image with a stereoscopic effect cannot be reproduced. Similarly, the second conventional example cannot cope with the case where the playback method of the playback device for playback is different from that at the time of recording.
The present invention has been made in view of the above points, and even when the display environment of an endoscopic image at the time of recording is different from the playback environment of a playback device that plays back a recorded image, the stereoscopic effect is reduced. An object of the present invention is to provide an image recording apparatus capable of reproducing a certain 3D endoscopic image.

  An image recording apparatus according to an aspect of the present invention includes an endoscope image input unit that selectively inputs one 3D endoscopic image among a plurality of 3D endoscopic images, and an input to the endoscopic image input unit A display environment information acquisition unit that acquires information about the display environment of the 3D endoscopic image, and the display environment information acquisition unit that receives the image data of the 3D endoscopic image input to the endoscopic image input unit. A recording data generation unit that generates recording data to which information on the acquisition result is added as meta-complement information, a recording unit that records the recording data generated by the recording data generation unit, and the recording unit that records the recording data A parallax adjustment unit that adjusts the parallax amount of the left and right images of the 3D endoscopic image when reproduced based on recorded data, and a plurality of types of reproduction methods for the 3D endoscopic image recorded in the recording unit Re-enabling conversion to 3D images A format conversion unit; an output image setting information storage unit that stores setting information referred to when the recorded data is reproduced and an output image is output to an external reproduction device; and the image recorded in the recording unit A reproduction environment information acquisition unit that acquires information on a reproduction environment of a reproduction device that is actually connected and used in a plurality of types of reproduction devices for reproducing data; information on an acquisition result of the reproduction environment information acquisition unit; When the information of the acquisition result of the display environment information acquisition unit is different, the playback system conversion unit is controlled so as to convert in a playback system that can be played back by the playback device in the playback environment, and the output image setting information storage unit A control unit that controls to adjust the amount of parallax by the parallax adjustment unit according to the stored setting information.

  According to the present invention, a stereoscopic 3D endoscope image can be reproduced even when the display environment of an endoscopic image at the time of recording is different from the playback environment by a playback device that plays back a recorded image. it can.

FIG. 1 is a diagram illustrating an endoscope system including the image recording apparatus according to the first embodiment. FIG. 2 is a diagram showing a configuration of main devices in FIG. FIG. 3A is an explanatory diagram illustrating a state in which left and right imaging signals having a parallax amount with respect to a subject are generated by two imaging units that are spaced apart from each other on the left and right. FIG. 3B is an explanatory diagram showing how left and right imaging signals are generated by increasing or decreasing the amount of parallax by shifting the imaging region in the left-right direction. FIG. 4 is a diagram showing the configuration of the image recording apparatus of the first embodiment to which a playback device is connected. FIG. 5A is a table showing the contents of an adjustment table for calculating a correction value from acquired information in a table format. FIG. 5B is an explanatory diagram when the left and right images in the 3D playback method are set to a predetermined alignment value. FIG. 6 is a flowchart showing a processing procedure of operations during recording. FIG. 7 is a flowchart showing a processing procedure of operations during reproduction. FIG. 8A is an explanatory diagram when reproduction is performed on a reproduction monitor in the image recording apparatus of the first embodiment. FIG. 8B is an explanatory diagram showing a configuration when the playback device is a streaming client PC in the image recording apparatus of the first embodiment. FIG. 8C is an explanatory diagram showing a configuration when the playback device is an external medium in the image recording apparatus of the first embodiment. FIG. 9 is an explanatory diagram of the operation of FIG. 8C. FIG. 10 is a flowchart showing a processing procedure of an operation of a modification of the processing of FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment)
As shown in FIG. 1, an endoscope apparatus 1 including an image recording apparatus according to a first embodiment of the present invention is for stereoscopic observation (3D observation) on a patient 3 lying on an operating table 2 in an operating room. A stereoscopic endoscope (abbreviated as 3D endoscope) 4 and a plurality of medical devices mounted on a trolley 5.
The trolley 5 performs image processing on the light source device 6 that generates illumination light and the 3D endoscope 4 as a plurality of medical devices, and generates a three-dimensional endoscope image signal (3D endoscope image signal). A 3D processor 7 as an image generation device, and a 3D observation monitor (abbreviated as an observation monitor or a reproduction monitor) 8 as an intraoperative monitor for displaying a 3D endoscope image signal generated by the 3D processor 7 as a 3D endoscope image; An image recording device 9 according to the first embodiment for recording a 3D endoscope image signal output from the 3D processor 7 and a high frequency power supply device (electric knife power supply device) 10 are mounted. In this embodiment, a 3D endoscopic image or 3D endoscopic image signal is simply abbreviated as a 3D image or a 3D image signal. In this specification, as described later, a 3D monitor used in a reproduction environment for reproducing a 3D image recorded (recorded) in the image recording device 9 is referred to as an external monitor or a reproduction monitor.

An observation monitor 8 shown in FIG. 1 is an observation monitor (or display monitor) displayed when the operator D observes a 3D image acquired by the 3D endoscope 4, and is recorded in the image recording device 9. 3D image display means of the display environment at the time of display.
For example, the 3D endoscope 4 is inserted into the abdomen of the patient 3 via a trocar (not shown), and the 3D endoscope 4 is connected to the light source device 6 via the light guide cable 11. The 3D endoscope 4 is connected to the 3D processor 7 through signal cables 12a, 12b, and 12c (see FIG. 2) inserted through the light guide cable 11.

Moreover, the high frequency power supply device 10 supplies a high frequency signal via the electric knife cable 14 to the electric knife 13 for performing treatment by high frequency.
FIG. 2 shows the internal configuration of the main medical device in FIG.
The 3D endoscope 4 includes an insertion portion 21 to be inserted into the body, and a grip portion 22 provided at the rear end (base end) of the insertion portion 21 and gripped by the operator D or the like. An end portion of the light guide cable 11 extending from the light source device 6 is detachably connected to the light source device 6.

The light source device 6 includes a lamp 23 a that generates white illumination light, and a condensing lens 23 b that condenses the illumination light and enters (supplies) to the end of the light guide cable 11. The illumination light incident on the light guide cable 11 is incident on the proximal end portion of the light guide 24 inserted through the insertion portion 21. The light guide 24 transmits the illumination light incident on the proximal end portion to the distal end portion of the light guide 24, and emits the illumination light from the illumination window in which the distal end surface of the light guide 24 is disposed. Illuminate subjects such as lesions in the body.
A left-eye objective lens 25a and a right-eye objective lens 25b are disposed at the distal end portion of the insertion portion 21 by a distance d in the left-right direction (between both optical axes), and an optical image of a subject such as an affected part in the body. Is imaged in a state having parallax. At the imaging positions of the left-eye objective lens 25a and the right-eye objective lens 25b, the imaging surface of a left-eye charge-coupled device (abbreviated as CCD) 26a as a left-eye imaging device and the right-eye CCD 26b as a right-eye imaging device The imaging surface is arranged.

In the present specification, the left image sensor has the same meaning as the left-eye image sensor, and the right image sensor has the same meaning as the right-eye image sensor. . For example, the left-eye image signal and the right-eye image signal have the same meaning as the left and right image signals.
The left and right CCDs 26a and 26b output imaging signals as output signals obtained by photoelectrically converting the formed optical image. The left-eye objective lens 25a and the left-eye CCD 26a form a left-eye imaging unit or left imaging unit 27a, and the right-eye objective lens 25a and the right-eye CCD 26b form a right-eye imaging unit or right imaging unit 27b. The same subject having the distance d is imaged by the imaging units 27a and 27b having different line-of-sight directions, and the 3D observation image is displayed on the observation monitor 8 serving as a display device. The operator D (being an observer or a user) can observe the subject by perceiving a stereoscopic effect or a sense of depth.

The left imaging signal imaged by the CCD 26a is inserted into the 3D endoscope 4 and input to the 2D image generation circuit 31L for the left eye in the 3D processor 7 via the signal cable 12a extended to the outside. The
Also, the right image signal picked up by the CCD 26b is inserted into the 3D endoscope 4 and sent to the 2D image generation circuit 31R for the right eye in the 3D processor 7 through the signal cable 12b extended to the outside. Entered.
The left 2D image signal generated by the 2D image generation circuit 31L and the right 2D image signal generated by the 2D image generation circuit 31R are input to the 3D image generation circuit 32, and the 3D image generation circuit 32 outputs the 3D image. Generate a signal.
FIG. 3A shows a state in which the left and right optical images Il and Ir are formed on the imaging surfaces 28a and 28b of the CCDs 26a and 26b by the left and right objective lenses 25a and 25b with the subject Ob at a distance L from the objective lenses 25a and 25b. Show.

The central portion Sc in the subject Ob is imaged as a common optical image portion Ic in the left and right imaging regions 30a and 30b via the left and right objective lenses 25a and 25a, and the left portion Sa in the subject Ob is only the imaging region 30a. Are formed as non-common optical image portions Ia (not common), and the right portion Sa of the subject Ob is formed as a non-common optical image portion Ib (not common) only in the imaging region 30b. In addition, since the optical axis directions of the left and right objective lenses 25a and 25b are different from each other, the common optical image portion Ic on both the imaging surfaces 28a and 28b is actually different optical images according to the unevenness.
As described above, the left and right CCDs 26a and 26b photoelectrically convert the optical images Il and Ir having the common optical image portion Ic and the non-common optical image portions Ia and Ib formed on the left and right with respect to the same subject Ob. The converted imaging signal is generated, and the 3D processor 7 generates a 3D image signal having right and left 2D image signals reflecting the common optical image portion Ic and the non-common optical image portions Ia and Ib, and the observation monitor 8 displays such a 3D image.
In the present embodiment, the CCDs 26a and 26b are provided on both the left and right sides of the imaging regions 30a and 30b in addition to the normal imaging regions 30a and 30b when parallax adjustment is not performed as shown in the uppermost part of FIG. 3B. In addition, imaging regions 30a 'and 30b' for parallax adjustment are provided.

3B is an optical image (described as “no parallax adjustment”) when the image is captured in the parallax state of FIG. 3A, and an optical image obtained by enhancing parallax from the state of FIG. 3A (denoted as parallax enhancement). 3) schematically shows an optical image (described as parallax reduction) in which the parallax is reduced from the state of FIG. 3A.
When it is desired to increase the left and right parallaxes, the ratio of the common optical image portion Ic is reduced by shifting the imaging region in the left and right directions as shown in FIG. 3B as parallax-enhanced optical images. By increasing the ratio of the non-common optical image portions Ia and Ib that are not common, the left and right are adjusted with a large parallax similar to that when the distance d is increased in a state where the distance d is not actually changed (largely). These optical images can be acquired (generated).
Further, by shifting the imaging region in the direction opposite to that in the case of parallax enhancement, an optical image with a reduced amount of parallax can be acquired (generated).

In other words, the left and right imaging signals having different amounts of parallax can be output by moving the imaging area when the CCDs 26a and 26b are actually output as imaging signals in the horizontal direction on the imaging surface as shown in FIG. 3B. The 2D image generation circuits 31L and 31R convert the captured image signals into left and right 2D images having different amounts of parallax.
It should be noted that by limiting the range of the imaging signal that is actually extracted from the imaging signals output from the entire imaging surfaces 28a and 28b (pixels) of the CCDs 26a and 26b, the left and right parallax amounts described in FIG. A 2D image signal can be generated. In this way, left and right 2D images in which the amount of parallax is easily increased or decreased by shifting the imaging range in the left-right direction when an imaging signal is extracted from the entire pixels of the imaging surfaces 28a and 28b while maintaining a certain size. A signal can be generated.
On the other hand, if the size of the imaging range when extracting to increase or decrease the amount of parallax is changed, the image size of the left and right 2D images changes with the increase or decrease of the amount of parallax, so that it does not change For this purpose, further enlargement or reduction processing is required. In the present embodiment, the amount of parallax in the left and right 2D images forming the 3D image is reflected by an alignment value corresponding to the amount of parallax.
Specifically, as shown in FIG. 5B, the display image positions in the left and right 2D images forming the 3D image (simply referred to as “left image” and “right image” in FIG. 5B) are displayed separately in the left-right direction, and the parallax amount is The larger the distance, the larger the distance in the left-right direction (in FIG. 5B, +15 dots, −15 dots). Therefore, a user such as a surgeon who observes perceives (visually recognizes) that the stereoscopic effect is large as the alignment distance between the left and right images is large.

The 3D endoscope 4 shown in FIG. 2 includes an ID generator (in FIG. 2, simply an ID) that includes a ROM (read only memory) that generates identification information (abbreviated as ID) unique to the 3D endoscope 4. 29).
The ID of the ID generator 29 is input to the ID reading circuit 33 in the 3D processor 7 via the signal cable 12c, and the 3D image generation circuit 32 reads the ID and outputs it to the control circuit 34 that controls the 3D processor 7. . The control circuit 34 generates from the input ID based on the number of pixels of the left and right CCDs 26a and 26b, the focal length f of the left and right objective lenses 25a and 25a, the angle of view of the left and right imaging units 27a and 27b, and the distance d between the optical axes. Information about the amount of parallax to be obtained can be acquired.
As shown in FIG. 3A, when the distance L is determined, the parallax amounts of the imaging units 27a and 27b in the left and right optical images Il and Ir formed on the imaging surfaces 28a and 28b when the distance between the optical axes is d. It is an optical image reflecting the above. Then, it is possible to acquire the ratio between the common optical image portion Ic and the non-common optical image portion Ia or Ib that is information about the amount of parallax.

For this reason, as information on the amount of parallax acquired and acquired from the imaging units 27a and 27b of the 3D endoscope 4 (also referred to as parallax amount parameter), the inter-optical axis distance d, the distance L, the common optical image portion Ic and the non-optical image portion Ic Information on the ratio or size of the common optical image portion Ia (Ib) may be used. The distance L may be calculated using known characteristics of the imaging units 27a and 27b of the 3D endoscope 4. The distance L can be calculated by detecting the position at which the position on the same subject is imaged on the left and right imaging surfaces.
The 3D processor 7 outputs the 3D image signal generated by the 3D image generation circuit 32 forming the 3D image generation unit to the observation monitor 8 and the image recording device 9 from the output end.
The control circuit 34 of the 3D processor 7 also provides information on the distance d and distance L between the optical axes of the 3D endoscope 4, the ratio of the common optical image portion Ic and the non-common optical image portion Ia (Ib), or size information. May be output as parallax amount parameter information to the image recording device 9 via the communication circuit 35 so as to be used when correcting the parallax amount. Alternatively, the information on the number of pixels of the CCDs 26a and 26b, the focal length f of the left and right objective lenses 25a and 25a, the angle of view, the distance d between the optical axes, and the distance L is used as information about the amount of parallax as a communication circuit. Alternatively, the image data may be output to the image recording device 9 via the control unit 35.

In the following description, the 3D processor 7 will describe a case where the alignment value is output to the image recording apparatus 9 as information reflecting the amount of parallax, mainly as display environment information.
The 3D processor 7 is provided with an operation panel 36 provided with a parallax amount increase / decrease switch 37. An operation signal of the parallax amount increase / decrease switch 37 operated by a user such as an operator is input to the control circuit 34, and the control circuit 34 generates the left and right 2D images generated by the 2D image generation circuits 31L and 31R according to the operation signal. Control to increase or decrease the parallax amount of the image.
In addition to the (normal) parallax amount parameter, the control circuit 34 can also output information on the parallax amount adjustment parameter that is increased or decreased by the parallax amount increase / decrease switch 37 to the image recording apparatus 9 via the communication circuit 35. it can. When the parallax amount is increased / decreased by the method described in FIG. 3B, it can be approximated to be equivalent to the case where the optical axis distance d is increased / decreased in a range where the increase / decrease amount is not large. For this reason, information on the parallax amount adjustment parameter that is increased or decreased by the parallax amount increase / decrease switch 37 may be included in the alignment value as information obtained by increasing or decreasing the value of the inter-optical axis distance d.

It is possible to set the reproduction method (or display method) of the 3D image generated by the 3D image generation circuit 32 from the operation panel 36. The 3D image generation circuit 32 has a plurality of types of reproduction methods (or display methods) so that the 3D image generation circuit 32 can generate a 3D image signal in accordance with the reproduction method for displaying the 3D image of the observation monitor 8. Has a function of generating a 3D image signal.
A user such as an operator is set to generate a 3D image signal of a reproduction method corresponding to the reproduction method of the observation monitor 8. Note that the 3D processor 7 and the observation monitor 8 are connected via a communication circuit, and the 3D processor 7 acquires information on the reproduction method of the observation monitor 8 connected via the communication circuit, and according to the acquired information. Alternatively, a 3D image signal having the same reproduction method as that of the observation monitor 8 may be automatically generated.
For this reason, the 3D image signal input to the image recording device 9 is normally input with a 3D image signal having the same playback method as the playback method of the observation monitor 8. Therefore, as shown in FIG. 1, when an observation monitor of a different type is used as the observation monitor 8 used during surgery or the like, a reproduction method (3D image signal input to the image recording device 9) ( The display method may also be different.

The observation monitor 8 includes a display image generation circuit 41 that performs image processing for generating a 3D display image on the 3D image signal generated by the 3D image generation circuit 32, and the 3D display image generated by the display image generation circuit 41. It has a 3D display panel 42 that displays signals, a communication circuit 43 that communicates with the image recording device 9, and a display image generation circuit 41 and a control circuit 44 that controls the operation of the communication circuit.
The control circuit 44 transmits information about the display size (for example, inch size) of the 3D display panel 42 that displays a 3D image to the image recording device 9 via the communication circuit 43.
2 and 4 is an image input circuit 50 to which a 3D image signal is input from the 3D processor 7 and a 3D image (data) of the 3D image signal input to the image input circuit 50. A recording data generating circuit 51 for generating recording data to be recorded on the recording data, and a recording device 52a configured by, for example, a hard disk device (abbreviated as HDD) that forms a recording unit for recording the recording data generated by the recording data generating circuit 51. And adjustment parameters that form adjustment information or setting information for adjusting or setting the output image suitable for the playback device when the recorded data is played back and the output image is output to an external playback device (also simply referred to as a parameter). ), And a parameter storage device 52b forming an output image setting information storage unit. More specifically, the parameter storage device 52b stores table data for calculating or determining a parallax amount parameter as an adjustment parameter.

In FIG. 4, the parameter storage device 52b is provided separately from the recording device 52a. However, the parameter storage device 52b may be provided inside the recording device 52a. In the image recording apparatus 9 of FIG. 4, the dotted line represents the flow of the image signal, and the solid line represents the flow of the control signal.
The image recording device 9 also includes a parallax adjustment circuit 54 that adjusts the parallax amount of a 3D playback image (3D image) obtained by playing back the recording data recorded in the recording device 52a, and the 3D output through the parallax adjustment circuit 54. Communication with the external monitor 71 is performed, and a reproduction method conversion circuit 55 that converts a reproduction method for an image signal, an image output circuit 56 that outputs a 3D image signal that has passed through the reproduction method conversion circuit 55 to an external monitor 71 for reproduction, and the like. A communication circuit 57 is included.
The 3D image recorded (recorded) in the recording device 52a is input to the parallax adjustment circuit 54 at the time of reproduction, and passes through the parallax adjustment circuit 54 and the reproduction method conversion circuit 55, so that a reproduction image suitable for the reproduction device forming the reproduction environment is obtained. (Or an output image) and output to an external monitor 71 or the like constituting a plurality of types of playback devices.

Even when only the external monitor 71 is used as a playback device, there are a plurality of types of external monitors 71 with different playback methods, so the external monitor 71 constitutes a plurality of types of playback devices.
The communication circuit 57 acquires information on the playback method of the external monitor 71 and the screen size (inch size) of the external monitor 71 that form a playback environment when a 3D image is played back on the external monitor 71 as playback environment information. . The communication circuit 57 sends the reproduction environment information acquired from the external monitor 71 to, for example, the control circuit 59, and the control circuit 59 stores the acquired reproduction environment information in, for example, the memory 59a in the control circuit 59. Therefore, the communication circuit 57 or the control circuit 59 forms a reproduction environment information acquisition unit, and the memory 59a forms a reproduction environment information storage unit that stores the acquired reproduction environment information. The memory 59a may be provided outside the control circuit 59.
The image recording apparatus 9 includes a communication circuit 58 that communicates with the communication circuit 35 of the 3D processor 7 and the communication circuit 43 of the observation monitor 8, a control circuit 59 that controls the operation of the image recording apparatus 9, an operator, and the like. An operation / display unit 60 for inputting data and instructing operations, a streaming output circuit 61 for outputting a streaming signal to an external streaming client PC 72, and an external media writing for writing an external media to an external medium 73 Circuit 62. The external medium 73 includes a USB medium, an optical medium, a PC (personal computer) / server, and the like.

An external monitor 71, a streaming client PC 72, and an external medium 73 shown in FIG. 4 are detachably connected to the image recording device 9, and reproduce a 3D image (data) recorded in the recording device 52a. Form multiple types of playback equipment.
When the streaming client PC 72 is connected to the image recording device 9, the output signal of the reproduction method conversion circuit 55 is output to the streaming client PC 72 via the streaming output circuit 61.
When the external medium 73 is connected to the image recording device 9, the output signal of the reproduction method conversion circuit 55 is output to the external medium 73.
Also, the parallax adjustment circuit 54 and the playback method conversion circuit 55 are connected to the external monitor 71 and the streaming client PC 72 in an external playback device so that bidirectional communication can be performed. For example, the parallax adjustment circuit 54 and the reproduction method conversion circuit 55 can perform bidirectional communication with the external monitor 71 via the communication circuit 57. Also, the parallax adjustment circuit 54 and the playback method conversion circuit 55 can perform bidirectional communication with the streaming client PC 72 via the streaming output circuit 61. Further, the parallax adjustment circuit 54 and the reproduction method conversion circuit 55 can write a 3D image signal to the external medium 73 via the external media writing circuit 62.

The streaming output circuit 61 can also acquire the reproduction environment information of the streaming client PC 72 therein, send the acquired information to the control circuit 59, and store it in the memory 59a.
On the other hand, the external media writing circuit 62 inputs information on the playback environment when playback is to be performed using the external media 73 from the operation / display unit 60, thereby generating an output image generated based on the display environment. The amount of parallax is adjusted by the parallax adjustment circuit 54 so as to match the information of the reproduction environment, and the reproduction method is converted so that the reproduction method matches the reproduction environment, and then output to the external medium 73. Therefore, the operation / display unit 60 constitutes an operation unit that varies the adjustment parameter as the setting information of the output image (stored in the parameter storage device 52b that constitutes the output image setting value information storage unit).
The communication circuit 58 includes a display environment acquisition unit that acquires information about a display environment in which a 3D image is displayed on the observation monitor 8 by communicating with the communication circuit 35 of the 3D processor 7 and the communication circuit 43 of the observation monitor 8. Forming and communicating with the communication circuit 35 of the 3D processor 7 to obtain information on the amount of parallax of the imaging units 27a and 27b of the 3D endoscope 4 (alignment information) and information on the 3D image reproduction method of the 3D processor 7 At the same time, information on the screen size of the observation monitor 8 is acquired and stored in the memory 58a in the communication circuit 58, for example. The memory 58a forms a display environment information storage unit (or display environment information storage device) that stores display environment information.

The operation / display unit 60 is configured by, for example, a touch panel, and a user such as an operator inputs an instruction to record an image by performing an operation of touching an image recording and displayed portion on the touch panel. It is possible to input an instruction for reproduction or the like by performing an operation of touching the displayed portion as image reproduction.
The 3D image signal input to the image input circuit 50 is input to the recording data generation circuit 51, and the recording data generation circuit 51 generates recording data of the 3D image signal. In addition, when a recording instruction is input from the operation / display unit 60 via the control circuit 59, the recording data generation circuit 51 3D displays the display environment information stored in the memory 58a of the communication circuit 58. By adding meta information as information related to the image signal, recording data of the 3D image signal is generated. Then, the recording device 52a records the recording data of the 3D image signal to which the meta information is added.
The parallax adjustment circuit 54 acquires (or refers to) display environment information from the meta information in the recording data read from the recording device 52a.

The parallax adjustment circuit 54 is connected to the communication circuit 71 a of the external monitor 71 via the communication circuit 57, and can acquire (or refer to) the reproduction environment acquired by the communication circuit 57. The control circuit 59 is also electrically connected to the communication circuit 57, the communication circuit 58, and the parallax adjustment circuit 54 so that bidirectional communication is possible. As will be described later, when the display environment and the reproduction environment are different, the control circuit 59 refers to the adjustment parameter stored in the parameter storage device 52b for setting the output image, and the stereoscopic effect in the display environment. Can be output in a playback environment so that an adjusted output image can be output.
For example, when the screen sizes of the observation monitor 8 and the external monitor 71 are different, the stereoscopic effect when the user observes the display size of the observation monitor 8 is reproduced in the stereoscopic effect when the observation size of the external monitor 71 is observed. The control circuit 59 adjusts the alignment value as an adjustment parameter (also referred to as a parallax amount parameter) related to the parallax amount in the output image (reproduced image) when the recorded data is reproduced so that the recording data can be reproduced.

In addition, when the 3D image recording method when recorded in the recording data is different from the 3D image reproduction method of the external monitor 71 that displays the 3D image, for example, the control circuit 59 displays the recording data (the recording method). The playback method of the output image (reproduced image) when played back is converted to the playback method of the external monitor 71, and a 3D image signal is output.
In the configuration example shown in FIG. 4, the control circuit 59 is connected to the communication circuit 58 so as to be able to acquire information on the display environment, and the communication circuit 57, the streaming output circuit 61, and the external media writing circuit 62 are all in the reproduction environment. It is connected so that information can be acquired, and is further connected so that the operations of the parallax adjustment circuit 54 and the reproduction system conversion circuit 55 can be controlled.
In addition, the control circuit 59 controls the operation of storing the adjustment parameter for setting the output image in the parameter storage device 52b, and when a more appropriate adjustment parameter is calculated, the control circuit 59 stores the adjustment parameter in the parameter storage device 52b. The adjustment parameter being updated is updated to a more appropriate adjustment parameter.

In addition, the control circuit 59 determines the reproduction method by the reproduction method conversion circuit 55 according to the acquisition result of the reproduction environment information, the acquisition result of the display environment information, and the adjustment parameter stored in the parameter storage device 52b, and the parallax. A control unit for adjusting the amount of parallax by the adjustment circuit 54 is formed.
More specifically, when the reproduction environment information and the display environment information are the same, the control circuit 59 performs control so that reproduction is performed with the display environment information as it is. That is, in this case, playback is performed and the output image is set using the same display environment as that recorded in the recording device 52a as the playback environment.
On the other hand, when the reproduction environment information and the display environment information are not equal (if different), the control circuit 59 uses the observation monitor used to display the 3D image in the display environment information. 8 determines whether or not the screen size of the playback monitor (external monitor 71) used for the playback device in the playback environment information is different from the screen size, and if both screen sizes are different, adjustment as setting information In accordance with the parameter, the parallax adjustment circuit 54 is controlled so that the parallax amount is in accordance with the value of the difference in screen size between the observation monitor 8 and the reproduction monitor. Further, the control circuit 59 determines whether or not the reproduction method in the display environment information is different from the reproduction method of the reproduction device in the reproduction environment information. Controls to generate a 3D image of the playback method of the playback device.

The parallax adjustment circuit 54 may also serve as (part or all) the function of the control circuit 59, or the reproduction system conversion circuit 55 may serve as (part or all) the function of the control circuit 59. For example, the parallax adjustment circuit 54 may be configured to include the control circuit 59 (for example, a part), or the reproduction system conversion circuit 55 may be configured to include the control circuit 59 (for example, a part).
FIG. 5A shows an output alignment correction value as an adjustment parameter correction value for correcting the stereoscopic effect of the display environment so that it can be reproduced in the reproduction environment based on the information acquired from the display environment and the information acquired from the reproduction environment. The contents to be displayed are shown in a lookup table format.
In other words, FIG. 5A shows an adjustment table (or correction table) for calculating an output alignment correction value that reproduces the parallax amount of the display environment from the display environment information and the reproduction environment information. The acquired alignment corrected with the output alignment correction value is the output image that reproduces the alignment in the display environment or the alignment on the reproduction monitor in the reproduction environment. This adjustment table is stored in, for example, the parameter storage device 52b.

In FIG. 5A, the output alignment correction value can be calculated (determined) from the display environment information and the reproduction environment information. However, instead of the output alignment correction value, the output for reproducing the alignment of the display environment. You may make it calculate (determine) the alignment in the reproduction monitor of an image or reproduction environment.
In FIG. 5A, the inch size representing the screen size as the observation monitor information and the alignment (value) as the 3D processor information are acquired via the communication circuit 58 as display environment information. Also, the inch size representing the screen size as the external monitor information is acquired via the communication circuit 57 as information on the reproduction environment.
In FIG. 5A, it is not explicitly shown that the alignment is acquired as the reproduction environment information, but it can be considered that a standard alignment value is set. In FIG. 7 to be described later, when the reproduction operation is described, when it is determined whether or not there is a difference between the reproduction environment information and the display environment information (although it is clear that the display environment has alignment information). )) Processing differs depending on whether or not the reproduction environment information includes alignment information. For this reason, in the following description, first, description will be made on the assumption that the reproduction environment information includes alignment information.

In FIG. 5A, the alignment (value) as 3D processor information is set to, for example, less than ± 15 or ± 15 to less than ± 20.
The alignment is, for example, ± 15, as shown in FIG. 5B, the display position of the left end of the right image (which constitutes the 3D image) is shifted to the right by +15 dots from the reference position O, and the display position of the left end of the left image Represents a state where the image is set and displayed at a position shifted by 15 dots to the left side (-) which is the opposite when the right side is + from the reference position O. For example, +15 dots is based on the number of dots in the horizontal direction of a high-definition television (HD-TV) standard.
FIG. 5B shows a case where a 3D image of a 3D playback method such as line by line or frame packing is displayed. Although not shown, in the case of top and bottom, alignment is set as in the case of line by line.
On the other hand, in the left and right images of the 3D image of the side by side 3D playback method, as shown in FIG. 9, the images are compressed in half in the left and right directions in the image state before the display, and are therefore displayed. Is expanded twice as much in the left-right direction, so that the alignment is set to half that in the case of line-by-line (for the same screen size).

As shown in FIG. 5A, when the alignment is ± 15 to ± 20, the display positions of the left and right images are displayed further apart in the left-right direction than in the case where ± 15 dots are separated in the left-right direction. Become. The larger the value of I in the alignment value ± I, the larger the left and right images with a large amount of parallax.
Further, the output alignment correction value in the rightmost column in FIG. 5A is a correction value for correcting the alignment value of the display environment. For example, ± 0 indicates that it is not corrected, and the (output alignment) correction value ± 1 indicates that the alignment ± J before correction is corrected by ± 1, that is, the alignment ± J before correction is corrected to ± (J + 1). In this case, the alignment value (or the amount of parallax) is increased or expanded. On the other hand,-+ 1 in the (output alignment) correction value (represents the positions where + and-in ± 1 are exchanged) is corrected by-+ 1 for the alignment ± J before correction, that is, before alignment ± This indicates that J is corrected to ± (J−1). In this case, the alignment value (or parallax amount) is reduced or reduced.

FIG. 5A specifically shows the correction values in the case of some screen sizes, but is set to have the following characteristics.
In this embodiment, when the screen size of the observation monitor in the display environment is different from the screen size of the playback monitor in the playback environment, the alignment as the parallax amount of the playback environment is basically performed so that the stereoscopic effect of the display environment can be reproduced. Set. For this reason, when both screen sizes (inch sizes) are equal, the alignment in the display environment is used as it is (in other words, the correction value is set to 0).
On the other hand, when the two screen sizes are different, adjustment or correction is performed as follows.
The larger the screen size of the playback monitor is than the screen size of the observation monitor, the smaller the alignment acquired in the display environment, in other words, the left-right distance at the left-right placement position of the left-right image displayed on the playback monitor. Make it smaller than for the observation monitor.

Conversely, as the screen size of the playback monitor is smaller than the screen size of the observation monitor, the alignment acquired in the display environment is increased. In other words, the horizontal spacing of the left and right images displayed on the playback monitor is increased in the horizontal direction. The amount is made larger than in the case of the observation monitor. Further, the above feature is set to be more prominent as the parallax amount (alignment) of the display environment is larger. The control circuit 59 performs such adjustment control operation.
FIG. 5A shows an example of data related to the amount of parallax, and information on the reproduction method of the observation monitor 8 and the reproduction method of the external monitor 71 may also be stored in the parameter storage device 52b. For example, when the reproduction method of the observation monitor is different from the reproduction method of the external monitor, parameters necessary for conversion from the reproduction method of the observation monitor to the reproduction method of the external monitor may be stored. In other words, the parameter storage device 52b may store a plurality of types of adjustment parameters.
In the present embodiment, when the information on the display environment and the reproduction environment is different except for the reproduction method, the reproduction environment is configured so as to reproduce the stereoscopic effect in the display environment as described above by referring to the adjustment table. The alignment when displaying a 3D image is adjusted so that an equivalent stereoscopic effect can be obtained.

    The image recording apparatus 9 of the present embodiment includes an image input circuit 50 that forms an endoscope image input unit to which one 3D endoscope image among a plurality of 3D endoscope images is selectively input, and the endoscope A communication circuit 58 (memory 58a) forming a display environment information acquisition unit for acquiring information on the display environment of the 3D endoscope image input to the mirror image input unit, and the endoscope image input unit. A recording data generation circuit 51 that forms a recording data generation unit that generates recording data obtained by adding information of an acquisition result of the display environment information acquisition unit to the image data of the 3D endoscope image as meta-complementary information; and the recording A recording device 52a that forms a recording unit that records the recording data generated by the data generation unit, and right and left of the 3D endoscopic image when reproduced based on the recording data recorded in the recording unit image A parallax adjustment circuit 54 that forms a parallax adjustment unit that adjusts the parallax, and a reproduction method conversion unit that can convert the 3D endoscopic image recorded in the recording unit into 3D images of a plurality of types of reproduction methods are formed. A reproduction method conversion circuit 55; a parameter storage device 52b that forms an output image setting information storage unit that stores setting information referred to when reproducing the recorded data and outputting an output image to an external reproduction device; A control circuit 59 (or a reproduction environment information acquisition unit) that acquires information on the reproduction environment of a reproduction device that is actually connected and used in a plurality of types of reproduction devices that reproduce the image data recorded in the recording unit (or If the communication circuit 57, the streaming output circuit 61), and the acquisition result information of the reproduction environment information acquisition unit and the acquisition result information of the display environment information acquisition unit are different, The playback method conversion unit is controlled so as to convert in a playback method that can be played back by a playback device in the environment, and the parallax amount by the parallax adjustment unit is set according to the setting information stored in the output image setting information storage unit. And a control circuit 59 that forms a control unit that performs control so as to be adjusted.

Next, the operation of this embodiment will be described. First, the recording operation will be described with reference to the flowchart of FIG. For example, as shown in FIG. 1, a plurality of medical devices are connected and the endoscope apparatus 1 is turned on to be in an operating state. In this case, the 3D endoscope 4, the light source device 6, the 3D processor 7, the observation monitor 8, and the image recording device 9 are connected as shown in FIG.
In the first step S1, the 3D processor 7 is set manually or automatically so as to generate a 3D image signal of the same method as the display method (reproduction method) of the observation monitor 8. Then, the 3D processor 7 generates a 3D image signal.
As shown in step S2, the observation monitor 8 displays a 3D image. Further, as shown in step S3, the communication circuit 58 of the image recording apparatus 9 acquires information forming a display environment from the 3D processor 7 side, and stores the acquired information in the memory 58a. In this case, the communication circuit 58 acquires display method information and alignment information corresponding to the amount of parallax in the 3D endoscope 4.

Further, as shown in step S4, the communication circuit 58 of the image recording apparatus 9 acquires information on the screen size of the observation monitor 8.
In the next step S <b> 5, the control circuit 59 of the image recording device 9 determines whether or not there is a change in the information of the connected device connected to the image recording device 9 from the information acquired through communication by the communication circuit 58, for example. If there is a change in the information on the connected device, the process returns to step S3, and the above-described information acquisition and the acquired information are stored again in the changed connection device display environment.
On the other hand, if there is no change in the information on the connected device, the control circuit 59 determines whether or not there has been an operation for starting recording from the operation / display unit 60 in the next step S6. If there is no recording start operation, the process returns to step S5.
When performing an operation or the like while observing the 3D image on the observation monitor 8, the surgeon performs an operation of starting recording to record the 3D image. If there is an operation to start recording, in the next step S7, the control circuit 59 controls the recording data generation circuit 51 with a control signal so as to start recording.

The recording data generation circuit 51 to which the control signal is sent starts recording 3D image data of the 3D image signal input through the image input circuit 50 and relates to the amount of parallax stored in the memory 58a of the communication circuit 58. Information or the like is added to the recorded data as meta information. Then, as shown in step S8, the recording data generation circuit 51 generates recording data (recording data) to which the meta information is added, and the generated recording data (recording data) is stored in the recording device 52a.
In the next step S9, the control circuit 59 monitors whether or not the recording stop operation has been performed. If the recording stop operation has not been performed, the control circuit 59 returns to the process of step S8, and if the recording stop operation has been performed. Then, the process of FIG. 6 is ended or the process returns to the process of step S3.
Next, an operation for reproducing the image data recorded in the recording device 52a will be described with reference to the flowchart of FIG. In the following description, an operation when reproduction is performed with the external monitor 71 connected to the image recording device 9 as a reproduction device will be described.

In this case, the image recording apparatus 9 shown in FIG. 4 includes a streaming output circuit 61 in which an image signal and a control signal as shown in FIG. 8A are involved in the operation, and neither an image signal nor a control signal is input or output. The external media writing circuit 62 is not related to this operation.
When the reproduction operation is performed, in the first step S11 in FIG. 7, the communication circuit 57 (or the control circuit 59) receives the display method (reproduction method) of the external monitor 71 and the screen size (from the connected external monitor 71). (Inch size) information is acquired as playback environment information, and the acquired playback environment information is sent to the control circuit 59. The control circuit 59 stores the playback environment information in, for example, the memory 59a. In addition, as information on the reproduction environment, information on the amount of standard parallax (alignment value) is set in advance as information on parallax. A case where the reproduction environment information does not include information on parallax will be described later.
In the next step S12, the control circuit 59 acquires information on the display environment in the reproduction data obtained by reproducing the recording data of the recording device 52a, and stores it in the memory 59a, for example.

In the next step S13, the control circuit 59 compares the reproduction environment information and the display environment information to determine whether there is a difference.
If there is no difference, the process proceeds to step S19, and the reproduced image reproduced from the recorded data (recorded data) is passed through the parallax adjusting circuit 54 and the reproduction method converting circuit 55 to the external monitor 71 from the image output circuit 56. Output.
As described above, when the display environment information and the reproduction environment information are not different from each other and coincide with each other, the same 3G image as the 3D image displayed in the display environment is output to the external monitor 71, and the operator or other user. Can observe a 3D image of the display environment with good reproducibility.
If there is a difference between the display environment information and the reproduction environment information in the determination processing in step S13, the control circuit 59 determines in step S14 whether there is a difference in the information of only the reproduction method. In the case of a determination result in which there is a difference in information only in the reproduction method, the process proceeds to step S18, and a determination result in which there is no difference in information only in the reproduction method (that is, a determination result in which there is a difference in at least information other than the reproduction method). ), The process proceeds to the next step S15.

In step S15, the control circuit 59 acquires (or calculates) a correction value that eliminates the difference in information from the adjustment parameter stored in the parameter storage device 52b. In the next step S16, the parallax adjustment circuit 54 corrects the alignment that is the amount of parallax so that the information on the display environment is matched with the information on the reproduction environment.
In the next step S17, the control circuit 59 determines whether or not there is a difference in the information of the reproduction method. If the determination result indicates that the information of the reproduction method is different, the reproduction method conversion circuit 55 in the next step S18. Then, the format is converted so that the image data input to the reproduction system conversion circuit 55 matches the reproduction system of the external monitor 71, and the process proceeds to the next step S19.
For example, when the reproduction method of the observation monitor 8 is set to frame packing and the reproduction method of the external monitor 71 is line-by-line, the reproduction method conversion circuit 55 changes the line-by-line reproduction method of the external monitor 71. Convert the format. When the external monitor 71 is connected to the image recording apparatus 9 as a playback device in this way, there are a plurality of types of playback methods for the external monitor 71, so the playback method conversion circuit 55 is connected to the actually connected external monitor 71. Format conversion so that it can be played back in

On the other hand, in the case of a determination result in which there is no difference in the reproduction method information, the process proceeds to step S19 without performing step S18. In step S19, even when there is a difference between the reproduction environment and the display environment, a 3D image corresponding to the reproduction environment is generated so as to reproduce the parallax amount when the surgeon observes in the state of the display environment. An output image in which the recorded data is reproduced is generated.
In the next step S20, the control circuit 59 monitors whether or not a playback end operation has been performed. If the playback end operation has not been performed, the control circuit 59 returns to the process of step S19 to continue the process of playing back recorded data. If the playback end operation is performed, the playback processing in FIG. 7 ends.
Although the operation of FIG. 7 has been described in the case where the playback device is the external monitor 71, when the playback device is a streaming client PC, the signal flow is as shown in FIG. 8B. In this case, the operation is performed when the external monitor 71 in the above-described operation is replaced with the streaming client PC 72.

In this case, the reproduction method conversion circuit 55 generates a 3D image of a reproduction method suitable for the streaming client PC 72 according to the acquisition result of the reproduction environment information of the streaming client PC 72, and the parallax adjustment circuit 54 The alignment correction is performed so that the parallax amount reproduces the stereoscopic effect in the environment.
When the playback device is the external medium 73, the signal flow is as shown in FIG. 8C. In this case, since the playback environment for playback is unknown (or undecided), the playback environment in which the external media 73 is used (for the scheduled playback device) can be set manually as shown in FIG. 9, for example. I am doing so. The user can set from the operation / display unit 60 to be 3D image data that matches the information of the playback environment to be played using the external medium 73.
As shown in FIG. 9, it is possible to selectively set the screen size (inch size) of the external monitor to be reproduced using the external medium 73 and to selectively set the reproduction method. Thus, the reproduction environment can be set and the image data reproduced from the recording device 52a can be written to the external medium 73.

Then, the external media 73 thus written is connected to an external monitor to be reproduced and a 3D image is displayed, so that the 3D image displayed on the external monitor is displayed by the user in the state of the display environment. It is possible to obtain a state in which the stereoscopic effect when observed is reproduced.
In the description of the reproduction operation of FIG. 7 described above, the case where the reproduction environment information includes information related to parallax has been described, but the operation in the case where information related to parallax is not included will be described with reference to FIG.
Since the process of FIG. 10 is similar to the process of FIG. 7, only different parts will be described. Steps S11 and S12 in FIG. 10 are the same as those in FIG. However, in step S11, when information on the reproduction environment is acquired, information on parallax is not included.
In step S31 following step S12 in FIG. 10, the control circuit 59 determines whether the screen size of the observation monitor 8 constituting the display environment information is equal to the screen size of the external monitor 71 constituting the reproduction environment information. Judgment is made.

If the screen sizes are equal, in the next step S32, the control circuit 59 uses the information regarding the parallax amount of the display environment as it is. In other words, the left and right images in the display environment are used as they are. In the next step S33, the control circuit 59 determines whether or not a parallax adjustment instruction operation is performed by the user. When an instruction operation for parallax adjustment is performed, in the next step S34, the parallax adjustment circuit 54 corrects (or adjusts) the left and right images by the designated adjustment value of the parallax amount, and in the next step S35. Proceed to processing.
The parallax adjustment instruction operation may be performed from, for example, the operation / display unit 60 of FIG. If a parallax adjustment instruction operation is not performed, the process proceeds to step S35 without performing step S34. The parallax adjustment circuit 54 may generate the left and right images with the parallax amount adjusted by adjusting the alignment value, or as described with reference to FIG. 3A and FIG. Shifting in the direction may generate left and right images that are close to the case where the distance between the optical axes is varied.
When the user intends to faithfully reproduce the stereoscopic effect in the display environment, the user may not perform the parallax adjustment instruction operation. For this reason, the processing of steps S33 and S34 in FIG. 10 may be omitted.

On the other hand, if the screen sizes are not equal in the determination process in step S31, in step S36, the control circuit 59 obtains a correction value corresponding to the screen size from the adjustment parameter stored in the parameter storage device 52b.
As the adjustment parameter, when the screen size of the observation monitor 8 in the display environment is different from the screen size of the external monitor 71 in the reproduction environment, the output alignment correction value as a correction value that can reproduce the stereoscopic effect in the display environment is previously set as table data or the like. Is set as
Then, in the next step S37, the parallax adjustment circuit 54 corrects the left and right 2D images constituting the 3D image acquired and reproduced from the recording device 52a with the correction value, and then proceeds to the process of step S35.
In step S <b> 35, the control circuit 59 determines whether or not the reproduction methods in both the reproduction environment and the display environment are the same. If the reproduction methods are not equal, the reproduction method conversion circuit 55 converts the reproduction method of the 3D image data input to the reproduction method conversion circuit 55 into the reproduction method of the external monitor 71 in the reproduction environment after step S38. The process proceeds to step S19. If it is determined in step S35 that the two playback methods are equal, the process proceeds to step S19 without performing step S38. Steps S19 and S20 are the same as in FIG.

As shown in FIG. 10, when information about the playback environment is acquired from the external monitor 71 side, the screen size and playback in the display environment are referred to with reference to the adjustment parameter related to the parallax amount without acquiring information about the parallax amount in the playback environment. From the information on the screen size in the environment, a correction value that provides the same stereoscopic effect as in the display environment may be acquired.
In the process of FIG. 10, the process of step S <b> 37 is performed and then the process of step S <b> 35 is described. However, the process of step S <b> 37 may be performed and then the process of step S <b> 33 may be performed. In other words, in addition to the function of allowing a user to observe a 3D image with the same stereoscopic effect as in the display environment, the user can observe with a more stereoscopic effect or lower the stereoscopic effect depending on the user's preference. Then, a 3D image may be played back.

According to this embodiment that operates in this way, even when the display environment of the endoscopic image at the time of recording is different from the playback environment by a playback device that plays back a recorded image, it is equivalent to the display environment. A stereoscopic 3D endoscope image can be reproduced.
In addition, when the processing of FIG. 10 is performed, the user can reproduce and observe the 3D endoscope image in a state where a stereoscopic effect equivalent to that of the display environment can be obtained, and can also use the stereoscopic effect of the display environment according to the user's preference. It is also possible to observe with more or less stereoscopic effect. For example, when a user reproduces and observes a 3D endoscopic image for a long time, the function of the stereoscopic effect is weakened (from a state in which the stereoscopic effect of the display environment is reproduced) and the reproduction is performed for a long time. In some cases, observation can be performed in a state where eyes are not tired. In addition, when the state of the operation is reproduced and observed for a short time, the function of the stereoscopic effect can be increased and the observation can be performed with a more stereoscopic effect.

The present invention belongs to an embodiment configured by partially combining the above-described embodiments. For example, when adjusting (correcting) the amount of parallax using the adjustment table of FIG. 5A, when correcting to increase the amount of parallax, the output alignment of the left and right images is corrected by ± I. As shown, correction for shifting the imaging region may also be performed.
Specifically, the output alignment of the left and right images is corrected by ± I, and the right and left images in that case are those in the imaging region corresponding to the parallax enhancement in FIG. 3B (left and right images with a reduced proportion of common parts). It may be used. In this way, the left and right images are substantially left and right images corresponding to parallax enhancement. Also in this case, the larger the value of I in ± I, the more the proportion of the common part may be reduced.
Similarly, when correcting to reduce the amount of parallax, the output alignment of the left and right images is corrected by − + I (the position where + and − in ± I are exchanged as described above), and further, FIG. As shown in the parallax reduction, correction for shifting the imaging region (to the side opposite to parallax enhancement) may be performed. In this way, the left and right images become substantially right and left images corresponding to parallax reduction. Also in this case, the larger the value of I in − + I, the larger the ratio of the common part may be.

Further, when combining the alignment and the shift of the imaging region in this way, a combination weighting factor may be set. In other words, the imaging region shift amount with respect to the value of I in ± I or − + I may be set. Note that the 3D processor 7 allows the image recording device 9 to shift the image area, and the image range serving as a margin for adjusting the parallax amount on both sides of the left and right image ranges displayed on the observation monitor 8. The recording device 52a may output a 3D image consisting of left and right images having an image range as a margin.
In addition, when the user only performs alignment correction, the imaging region is shifted (by parallax enhancement or parallax reduction) together with the alignment correction, and the imaging region is shifted (by parallax enhancement or parallax reduction). You may be able to select the case. For example, the user may be able to select one of the above three cases from the operation / display unit 60. If it does in this way, it can respond to the request of a wider range of users. In the above description, when acquiring the display environment information, the display environment information may be acquired from the meta information actually recorded in the recording device 52a. In this case, for example, the control circuit 59 may acquire the display environment information directly from the recording device 52a (or via the parallax adjustment circuit 54). As described above, when the information of the display environment is acquired from the information actually recorded in the recording device 52a, the observation monitor 8 used in the display environment corresponds to, for example, a plurality of different reproduction methods. Even in cases, it can be more reliably determined whether or not there is a difference from the playback method of the playback device in the playback environment.

  DESCRIPTION OF SYMBOLS 1 ... Endoscope apparatus, 3 ... Patient, 4 ... 3D endoscope, 5 ... Trolley, 6 ... Light source apparatus, 7 ... 3D processor, 8 ... Observation monitor, 9 ... Image recording apparatus, 10 ... Electric knife power supply apparatus, DESCRIPTION OF SYMBOLS 13 ... Electric knife, 21 ... Insertion part, 23a ... Lamp, 25a, 25b ... Objective lens, 26a, 26b ... CCD, 27a, 27b ... Imaging part, 31L, 31R ... 2D image generation circuit, 32 ... 3D image generation circuit, 34 ... control circuit, 35 ... communication circuit, 36 ... operation panel, 37 ... parallax amount increase / decrease switch, 41 ... display image generation circuit, 42 ... 3D display panel, 43 ... communication circuit, 44 ... postnatal circuit, 50 ... image input circuit 51 ... Recording data generation circuit, 52a ... Recording device, 52b ... Parameter storage device, 54 ... Parallax adjustment circuit, 55 ... Playback method adjustment circuit, 56 ... Image output circuit, 57, 58 ... Communication circuit, 58a Memory, 59 ... control circuit, 60 ... operation / display unit, 61 ... streaming output circuit, 62 ... external media document detecting circuit, 71 ... external monitor (playback monitor), 72 ... streaming client PC, 73 ... external medium,

Claims (6)

An endoscope image input unit for selectively inputting one 3D endoscope image among a plurality of 3D endoscope images;
A display environment information acquisition unit that acquires information of a display environment of the 3D endoscopic image input to the endoscopic image input unit;
A recording data generation unit that generates recording data in which information of an acquisition result of the display environment information acquisition unit is added as meta-complementary information to the image data of the 3D endoscopic image input to the endoscopic image input unit;
A recording unit for recording the recording data generated by the recording data generation unit;
A parallax adjustment unit that adjusts the parallax amount of the left and right images of the 3D endoscopic image when reproduced based on the recording data recorded in the recording unit;
A reproduction method conversion unit capable of converting the 3D endoscopic image recorded in the recording unit into 3D images of a plurality of types of reproduction methods;
An output image setting information storage unit for storing setting information when reproducing the recorded data and outputting an output image to an external reproduction device;
A reproduction environment information acquisition unit that acquires information of a reproduction environment of a reproduction device that is actually connected and used in a plurality of types of reproduction devices for reproducing the image data recorded in the recording unit;
When the information of the acquisition result of the reproduction environment information acquisition unit and the information of the acquisition result of the display environment information acquisition unit are different from each other, the reproduction method conversion unit converts the reproduction method in a reproduction method that can be reproduced by the reproduction device in the reproduction environment. A control unit that controls the parallax amount by the parallax adjustment unit according to the setting information stored in the output image setting information storage unit;
An image recording apparatus comprising: The control unit, when the information of the acquisition result of the reproduction environment information acquisition unit and the information of the acquisition result of the display environment information acquisition unit are different,
It is determined whether or not the reproduction method in the display environment information is different from the reproduction method of the reproduction device in the reproduction environment information, and when both reproduction methods are different, the reproduction method conversion unit performs the 3D endoscope. Control to convert the image into a 3D image of the playback method of the playback device;
Furthermore, whether the screen size of the observation monitor used to display the 3D endoscope image in the display environment information is different from the screen size of the playback monitor used in the playback device in the playback environment information If the two screen sizes are different, the parallax adjustment unit is set so that the amount of parallax is in accordance with the value of the difference in screen size between the observation monitor and the reproduction monitor according to the setting information. The image recording apparatus according to claim 1, wherein the image recording apparatus is controlled. When the screen size of the observation monitor is different from the screen size of the reproduction monitor, the control unit displays on the reproduction monitor as the screen size of the reproduction monitor is larger than the screen size of the observation monitor. The left-right distance in the left-right arrangement position of the left-right image is smaller than in the case of the observation monitor,
As the screen size of the reproduction monitor is smaller than the screen size of the observation monitor, the horizontal distance in the horizontal arrangement position of the left and right images displayed on the reproduction monitor is made larger than in the case of the observation monitor. The image recording apparatus according to claim 2, wherein the image recording apparatus is controlled as follows.   The information on the display environment includes an alignment value as a horizontal position when displaying the left and right images of the 3D endoscope image, a screen size of an observation monitor for observing the 3D endoscope image, and the 3D endoscope. The image recording apparatus according to claim 1, wherein the image recording apparatus is at least one of a mirror image reproduction method.   The image recording apparatus according to claim 1, further comprising an operation unit that varies setting information of the output image stored in the output image setting value information storage unit. The output image setting value information storage unit determines the parallax amount forming the setting information of the corresponding output image from information of the acquisition result of the display environment information acquisition unit and the acquisition result of the reproduction environment information acquisition unit. Store table data,
The said control part controls the said parallax adjustment part to adjust the parallax amount of the said right-and-left image displayed in the said reproducing | regenerating apparatus so that it may become the determined said parallax amount. Image recording device.

Images