JP2021149089A - Control device and medical observation system - Google Patents

Abstract

To provide a control device and a medical observation system that enable focus adjustment by voice input by low-load simple processing.SOLUTION: A control device includes: an acquisition unit to acquire an operation command through voice input to an imaging device including an imaging unit and an optical system including a focus lens; and a control unit to transition to a mode for performing control for returning a position of the focus lens such that a focus position of the focus lens is returned from a focus position at a time of stoppage of the focus lens by an amount of return equal to or less than a reference focal depth in the optical system when the operation command is a command to stop operation of the focus lens.SELECTED DRAWING: Figure 3

Description

The present disclosure relates to control devices and medical observation systems.

There is known a medical observation system that magnifies and images the surgical site when performing surgery on the brain, heart, etc. of a patient to be observed, and displays the captured image on a monitor (see, for example, Patent Document 1). ). In this medical observation system, the microscope device has a focus function.

When a user such as a doctor uses the focus function to focus an image, the user needs to operate a predetermined switch. During this operation, the user has to interrupt the operation or change his / her posture, which is not efficient. Therefore, it is conceivable that the user performs various operations by inputting voice.

However, in the case of voice input, the time required for the user to speak, the time for transmitting the voice signal to the control device, the time for the control device to recognize the utterance content, and the time for completing the operation are required, and the user needs. There is a delay from the timing when. Therefore, for example, when the user focuses by voice input, the focus lens does not stop at the position intended by the user, and the focus cannot be achieved.

Therefore, it is conceivable to apply a technique for realizing the processing intended by the user in consideration of the time difference between the operation command timing intended by the user and the operation command timing actually given by the user (for example, Patent Document 2). See).

Japanese Unexamined Patent Publication No. 2016-42882 Japanese Unexamined Patent Publication No. 2001-175281

However, the above-mentioned technique of Patent Document 2 has a problem that the processing is complicated and the load on the system becomes high.

The present disclosure has been made in view of the above, and an object of the present invention is to provide a control device and a medical observation system capable of performing focus adjustment by voice input by a simple process with a small load.

In order to solve the above-mentioned problems and achieve the object, the control device according to the present disclosure includes an acquisition unit that acquires an operation instruction by voice input to an imaging device including an optical system including a focus lens and an imaging unit, and the above-mentioned. When the operation instruction is an instruction to stop the operation of the focus lens, the focus position of the focus lens returns from the focus position when the focus lens is stopped by a return amount equal to or less than the reference depth of focus in the optical system. Also includes a control unit that shifts to a mode for controlling the return of the position of the focus lens.

The medical observation system according to the present disclosure includes an imaging device including an optical system including a focus lens and an imaging unit, an acquisition unit that acquires an operation instruction by voice input to the imaging device, and the operation instruction of the focus lens. In the case of an operation stop instruction, the position of the focus lens is such that the focus position of the focus lens returns from the focus position when the focus lens is stopped by a return amount equal to or less than the reference depth of focus in the optical system. It is provided with a control device having a control unit for shifting to a mode for performing control to return the lens, and a display device for displaying an image captured by the image pickup device.

According to the present disclosure, focus adjustment by voice input can be performed by a simple process with less load.

FIG. 1 is a diagram schematically showing a medical observation system according to the first embodiment of the present disclosure. FIG. 2A is a diagram schematically showing the movement of the focal position of the focus lens until the focusing operation is stopped. FIG. 2B is a diagram schematically showing a movement in which the focal position of the focus lens returns in the opposite direction after the focus operation is stopped. FIG. 3 is a block diagram showing a functional configuration of the medical observation system according to the first embodiment of the present disclosure. FIG. 4 is a flowchart showing an outline of the processing performed by the control device according to the first embodiment of the present disclosure. FIG. 5 is a flowchart showing an outline of the processing performed by the control device according to the second embodiment of the present disclosure. FIG. 6 is a flowchart showing an outline of the processing performed by the control device according to the third embodiment of the present disclosure. FIG. 7 is a flowchart showing an outline of the processing performed by the control device according to the fourth embodiment of the present disclosure.

Hereinafter, embodiments for carrying out the present disclosure (hereinafter referred to as “embodiments”) will be described with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a diagram schematically showing a medical observation system according to the first embodiment of the present disclosure. FIG. 1 shows a situation in which a user 101 such as a doctor performing an operation using the medical observation system 1 is operating the head of the patient 102. The medical observation system 1 shown in FIG. 1 includes a medical observation device 2, a display device 3, and a microphone 4.

The medical observation device 2 is a surgical microscope, and includes a microscope device 5 and a control device 6. The microscope device 5 has a function as an image pickup device that images an observation target and generates an image signal.

The display device 3 is wirelessly or wiredly connected to the control device 6, receives a three-dimensional image signal or a two-dimensional image signal from the control device 6, and receives a three-dimensional image signal (3D image) based on the three-dimensional image signal. ) Or a two-dimensional image (2D image) based on the two-dimensional image signal is displayed. The display device 3 has a display panel made of a liquid crystal display or an organic EL (Electro Luminescence). The display device 3 displays an image of the surgical site of the patient 102 imaged by the medical observation device 2. FIG. 1 schematically shows a situation in which a display device 3 displays a 3D image and a user 101 wears 3D glasses 201 and visually observes the 3D image.

The microphone 4 is wirelessly or wiredly connected to the control device 6, receives the voice input of the user 101, generates a voice signal, and transmits the voice signal to the control device 6.

The appearance configuration of the microscope device 5 will be described. The microscope device 5 includes a microscope unit 7 that magnifies and images the microstructure of an observation target, a support unit 8 that supports the microscope unit 7, and a base unit that holds the base end of the support unit 8 and incorporates a control device 6. Has 9 and.

The microscope unit 7 has a cylindrical portion having a columnar shape. A cover glass is provided on the opening surface at the lower end of the main body (not shown). The tubular portion can be grasped by the user, and has a size that allows the user to move the tubular portion while grasping it when changing the imaging field of view of the microscope unit 7. The shape of the tubular portion is not limited to a cylindrical shape, and may be a polygonal tubular shape.

The support portion 8 has a plurality of links on the arm portion, and the adjacent links are rotatably connected to each other via the joint portion. In the hollow portion formed inside the support portion 8, a transmission cable for transmitting various signals between the microscope unit 7 and the control device 6 and a light guide for transmitting the illumination light generated by the control device 6 to the microscope unit 7. Is passing.

The control device 6 acquires an audio signal generated by the microphone 4 and recognizes the content of the audio signal. For example, the expression indicating the focus operation of the microscope device 5 is “focus in” or “focus out”, and the expression of stopping the focus operation of the microscope device 5 is “stop”. When the control device 6 performs the focus operation of the microscope device 5, the control device 6 stops the focus operation of the focus lens 511 (described later) of the microscope device 5 in response to a voice input corresponding to a stop instruction, and then the focus position of the focus lens 511. It is possible to set a return mode for returning the position of the focus lens 511 so that the lens returns in the opposite direction by a predetermined return amount from the focus position when the focus lens 511 is stopped. The above expression when instructing the focus operation by voice is only an example, and other expressions may be used.

2A and 2B are diagrams schematically illustrating the focus operation when the return mode is set. FIG. 2A schematically shows the movement of the focus position of the focus lens 511 until the focus operation is stopped. Further, FIG. 2B schematically shows a movement in which the focus position of the focus lens 511 returns in the opposite direction after the focus operation is stopped.

First, FIG. 2A will be described. When the focus operation is stopped, the user 101 voice-inputs "stop" to the microphone 4. In FIG. 2A, the target focus position where the focus lens 511 is desired to be stopped is set as the target position P, and the user 101 voice-inputs "stop" to the microphone 4 at the timing when the focus position of the focus lens 511 is located at the target position P. Shows the case. After recognizing the audio signal acquired from the microphone 4, the control device 6 transmits a control signal instructing the microscope device 5 to stop the focus operation. Therefore, there is a time difference between the input timing (I) of "stop" by the user 101 and the stop timing (II) of the focus lens 511, and the focal position when the focus lens 511 is stopped (hereinafter, "stop position"). ”) Q overruns by the time difference from the target position P. FIG. 2A shows a situation in which _{the stop position Q is located outside the focal depth (depth L 0} ) of a predetermined magnification when the focal position of the focus lens 511 is located at the target position P. In this case, the display device 3 displays an image that is out of focus. The predetermined magnification is a magnification higher than the center of the magnification within the range that the microscope device 5 can take.

Next, FIG. 2B will be described. FIG. 2B schematically shows the movement of the focus position of the focus lens 511 when the user 101 inputs a voice (for example, “fine”) instructing the return at the stop position Q to the microphone 4. In this case, the focus lens 511 moves in the direction opposite to the moving direction of FIG. 2A. The amount of movement of the focus position of _{the focus lens 511, that is, the amount of return L 2 at that time} is from _{the depth of focus L 1} when the focus lens 511 is located at the stop position R of the focus position after the focus lens 511 returns. small. If the return amount L ₂ is more than half the depth L ₁ of focal depth _{(L 2 ≧ L 1/2} ), it requires only a number of times even less back. In FIG. 2B, the target position P is inside the depth of focus of the focus lens 511 at the stop position R. Therefore, the user 101 can determine that the focus lens 511 does not have to be returned any more. When the user 101 sees the image corresponding to this situation through the display device 3, if it is determined that the image is in focus, the process may be terminated as it is, or if it is determined that further adjustment is necessary. May allow the user to voice "fine" into the microphone 4 again.

_{When the depths L 0} and L _{1 of the} two depths of focus described above are equal, if the stop position R is located within the depth of focus (FIG. 2A) at the target position P, the case shown in FIG. 2B and the case shown in FIG. A similar effect can be obtained.

The expressions corresponding to the various operation instructions described above (“focus in”, “focus out”, “stop”, “fine”) are merely examples, and other expressions may be adopted.

FIG. 3 is a block diagram showing a functional configuration of the medical observation system 1. First, the functional configuration of the microscope device 5 will be described. The microscope device 5 includes a lens unit 51, a lens drive unit 52, an aperture 53, an aperture drive unit 54, a detection unit 55, an imaging unit 56, an arm drive unit 57, an input unit 58, and a communication unit 59. And a control unit 5a.

The lens unit 51 is an optical system that is configured by using a plurality of lenses that can move along the optical axis and forms a focused subject image on the image pickup surface of the image pickup device included in the image pickup unit 56. The lens unit 51 includes a focus lens 511 that adjusts the focus and a zoom lens 512 that changes the angle of view. The focus lens 511 and the zoom lens 512 are configured by using one or more lenses, respectively.

The lens driving unit 52 has an actuator for moving the focus lens 511 and the zoom lens 512, respectively, and a driver for driving the actuator under the control of the control unit 5a.

The aperture 53 is provided between the lens unit 51 and the image pickup unit 56, and adjusts the amount of light of the subject image from the lens unit 51 toward the image pickup unit 56 under the control of the control unit 5a. The aperture 53, together with the lens unit 51, constitutes the optical system of the microscope device 5.

The aperture drive unit 54 operates the aperture 53 under the control of the control unit 5a to adjust the aperture value (also referred to as F value).

The detection unit 55 includes two position sensors that detect the positions of the focus lens 511 and the zoom lens 512, respectively, an encoder that detects the aperture value of the aperture 53, and the like. The detection unit 55 outputs the detected position of the zoom lens 512 and the aperture value of the aperture 53 to the control unit 5a.

The image pickup unit 56 removes noise and removes noise from the image pickup element that forms an image of the subject image focused by the lens unit 51 to generate an image pickup image (analog signal) and the image signal (analog signal) from the image pickup element. It has a signal processing unit that performs signal processing such as / D conversion. The image sensor is configured by using an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The image pickup unit 56 may have two image pickup elements. In this case, the imaging unit 56 can generate a three-dimensional image (3D image).

The arm drive unit 57 operates a plurality of joints of the support unit 8 under the control of the control unit 5a. Specifically, the arm drive unit 57 includes an actuator provided at a joint between the arms and a driver for driving the actuator.

The input unit 58 receives inputs such as an operation signal of the lens unit 51 and an operation signal of the arm of the support unit 8. The input unit 58 has a plurality of switches, buttons, and the like provided at positions on the side surface of the cylindrical portion of the microscope unit 7 that can be operated by the user while holding the microscope unit 7.

The communication unit 59 is an interface for communicating with the control device 6. The communication unit 59 transmits the image signal (digital signal) generated by the image pickup unit 56 to the control device 6, and receives the control signal from the control device 6.

The control unit 5a controls the operation of the microscope device 5 in cooperation with the control unit 66 of the control device 6. The control unit 5a operates the microscope device 5 based on the operation instruction signal that the input unit 58 receives the input and the operation instruction signal sent from the control unit 66 of the control device 6. In the present embodiment, the control unit 66 of the control device 6 receives a signal for operating the arm to move the imaging field of view of the microscope device 5.

The control unit 5a is configured by using at least one processor such as a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).

Next, the functional configuration of the control device 6 will be described. The control device 6 includes a communication unit 61, an image processing unit 62, an input unit 63, a light source unit 64, a voice recognition unit 65, a control unit 66, and a storage unit 67. The communication unit 61 acquires an image signal imaged by the microscope device 5 and transmitted via a transmission cable. The image signal includes information related to imaging such as a gain adjustment value at the time of imaging, a focus lens position, a zoom lens position, a shutter speed, and an aperture value. Further, the communication unit 61 acquires the voice signal of the user 101 whose input is received by the microphone 4 as an operation instruction. In this sense, the communication unit 61 has the function of an acquisition unit.

The image processing unit 62 generates an image signal for display by performing various signal processing on the image signal acquired by the communication unit 61, and outputs the generated image signal to the display device 3. Specific image processing includes known image processing such as brightness level detection processing of an image signal, gain adjustment, interpolation processing, color correction processing, color enhancement processing, and contour enhancement processing. The image processing unit 62 is configured by using at least one processor such as a CPU, FPGA, and ASIC.

The input unit 63 accepts input of various information. The input unit 63 is configured by using a user interface such as a keyboard, a mouse, a touch panel, and a foot switch. The input unit 63 may have at least a part of the functions of the input unit 58 of the microscope device 5.

The light source unit 64 generates illumination light to be supplied to the microscope device 5 via the light guide. The light source unit 64 is configured by using, for example, a solid-state light emitting element such as an LED (Light Emitting Diode) or an LD (Laser Diode), a laser light source, a xenon lamp, a halogen lamp, or the like.

The voice recognition unit 65 executes the recognition processing of the voice signal received from the microphone 4. The voice recognition unit 65 recognizes the content of the voice signal by comparing the feature amount of the voice signal with the feature amount stored in the storage unit 67.

The control unit 66 controls the operation of the control device 6 and controls the operation of the medical observation device 2 in cooperation with the control unit 5a of the microscope device 5. When the content of the voice signal recognized by the voice recognition unit 65 is an instruction to stop the operation of the focus lens 511, the control unit 66 refers to the focus position of the focus lens 511 from the focus position when the focus lens 511 is stopped in the optical system. The mode shifts to a mode (return mode) in which the position of the focus lens 511 is controlled to be returned so that the return amount is equal to or less than the depth of the focal depth of. When the control device 6 is set to the return mode, the control unit 66 generates a control signal for operating the microscope device 5 based on the content of the voice signal recognized by the voice recognition unit 65, and transmits the control signal to the microscope device 5. .. The depth of focus of the reference may be the depth of focus at the position when the focus lens 511 is stopped, but it is the depth of focus at the position where the stop instruction of the focus lens 511 is input. It may be the depth of focus at an arbitrary position of the focus lens 511. Further, the control unit 66 adjusts the shutter speed of the image pickup unit 56, the gain adjustment performed by the image processing unit 62, and the light source unit 64 in order to set the brightness level of the image signal imaged by the microscope device 5 to a predetermined brightness level. Controls the amount of illumination light generated by. Further, the control unit 66 controls the display of the display device 3.

The control unit 66 is configured by using at least one processor such as a CPU, FPGA, and ASIC. The image processing unit 62 and the control unit 66 may be configured by using a common processor.

The storage unit 67 stores the return amount in the return mode. This return amount is preset according to the depth of focus of a predetermined magnification. The predetermined magnification is higher than the magnification of the center of the settable range among the magnifications that can be set for the lens unit 51 of the microscope device 5. Further, the amount of return may be half or less of the depth of focus.

The storage unit 67 stores various programs for the control device 6 to operate, and temporarily stores the data being processed by the control device 6. The storage unit 67 is configured by using a ROM (Read Only Memory), a RAM (Random Access Memory), or the like.

FIG. 4 is a flowchart showing an outline of the processing performed by the control device 6. In parallel with the processing described below, the control device 6 sequentially acquires the image data captured by the imaging unit 56 from the microscope device 5, and the image processing unit 62 sequentially acquires the image signal for display. Is generated and output to the display device 3. This point is common to all the flowcharts described later.

First, when the communication unit 61 acquires the voice signal (step S1: Yes), the voice recognition unit 65 performs the voice signal recognition process (step S2). If the communication unit 61 does not acquire the audio signal in step S1 (step S1: No), the control device 6 repeats step S1.

As a result of the recognition process, when the focus operation is input (for example, “focus in” or “focus out”) (step S3: Yes), the control unit 66 operates a control signal (operation) for operating the lens drive unit 52 of the microscope device 5. A control signal) is generated and transmitted to the control unit 5a (step S4). As a result, the lens driving unit 52 moves the focus lens 511 under the control of the control unit 5a. If the result of the recognition process is not the input of the focus operation (step S3: No), the control device 6 returns to step S1.

After step S4, when the communication unit 61 acquires the voice signal (step S5: Yes), the voice recognition unit 65 performs the voice signal recognition process (step S6). If the communication unit 61 does not acquire the audio signal in step S5 (step S5: No), the control device 6 repeats step S5. If the communication unit 61 does not acquire the voice signal even after a lapse of a predetermined time after step S4, the control unit 66 may display the information prompting the user 101 for voice input on the display device 3. Further, the control unit 66 may output a message or an alarm sound prompting the user 101 to input voice from the speaker.

When the result of the recognition process in step S6 is a stop instruction (for example, "stop") for the focus operation (step S7: Yes), the control unit 66 controls the operation of the lens drive unit 52 (stop control signal). Is generated and transmitted to the control unit 5a (step S8). As a result, the lens driving unit 52 stops the focus lens 511 under the control of the control unit 5a.

As a result of the recognition process in step S6, if it is not an instruction to stop the focus operation (step S7: No), the control device 6 returns to step S5. If the focus operation stop instruction is not input even after a lapse of a predetermined time after step S4, the control unit 66 may display the information prompting the user 101 for voice input on the display device 3. Here, too, the control unit 66 may output a message or an alarm sound prompting the user 101 to input voice from a separately installed speaker.

After step S8, the control unit 66 shifts to the return mode (step S9).

After that, when the communication unit 61 acquires the voice signal (step S10: Yes), the voice recognition unit 65 performs the voice signal recognition process (step S11). When the communication unit 61 does not acquire the audio signal in step S10 (step S10: No), the control device 6 shifts to step S14, which will be described later.

When the result of the recognition process in step S11 is a return instruction (for example, "fine") (step S12: Yes), the control unit 66 determines that the focus position of the focus lens 511 is determined from the focus position when the focus lens 511 is stopped. A control signal for returning the position of the focus lens 511 (hereinafter, also referred to as a return control signal) is generated and transmitted to the control unit 5a so as to return by the amount of return (step S13). As a result, the lens driving unit 52 returns the focus position of the focus lens 511 from the focus position when the focus lens 511 is stopped to the direction opposite to the movement before the stop by the amount under the control of the control unit 5a. , Return the position of the focus lens 511.

When a predetermined time has elapsed after step S13 (step S14: Yes), the control device 6 ends a series of processes. On the other hand, if a predetermined time has not elapsed after step S13 (step S14: No), the control device 6 returns to step S10.

If the result of the recognition process in step S11 is not a return instruction (step S12: No), the control device 6 returns to step S10.

According to the first embodiment of the present disclosure described above, the content of the audio signal acquired from the microphone that receives the audio input of the operator of the medical observation device including the optical system including the focus lens and the imaging unit is recognized. If the content is an instruction to stop the operation of the focus lens, the focus is set so that the focus position of the focus lens returns from the focus position when the focus lens is stopped by a return amount equal to or less than the reference depth of focus in the optical system. Since the mode shifts to the mode (return mode) in which the lens position is controlled to be returned, the focus can be adjusted only by voice input. Therefore, the focus adjustment by voice input can be performed by a simple process with less load.

Further, according to the first embodiment, even if a delay from the voice input occurs, fine adjustment can be performed only by the voice input, so that the focus adjustment can be easily performed.

Further, according to the first embodiment, the number of fine adjustments can be reduced by further setting the return amount to half or more of the depth of focus.

(Embodiment 2)
In the second embodiment of the present disclosure, the return amount in the return mode is set based on the depth of focus of the reference according to the imaging conditions at the time of imaging. The functional configuration of the medical observation system according to the second embodiment is the same as that of the first embodiment. The imaging conditions referred to here are, for example, the magnification and aperture value of the optical system.

In the second embodiment, the control unit 66 of the control device 6 has a magnification and / or an aperture 53 according to the positions of the focus lens 511 and the zoom lens 512 when the microphone 4 receives an audio signal instructing the focus operation. The depth of the reference focal depth is extracted based on the aperture value, and the return amount is set according to the depth. The magnification and the aperture value are detected by the detection unit 55.

The storage unit 67 stores the depth of the reference depth of focus according to the above-mentioned magnification and / or aperture value in the table, and also stores the relationship between the depth of the reference depth of focus and the amount of return. For example, the storage unit 67 stores the return amount as any value in the range of 50 to 90% of the depth of focus of the reference. The relationship between the depth of focus of the reference and the amount of return can be changed by the user 101 via the input unit 63.

FIG. 5 is a flowchart showing an outline of the processing performed by the control device according to the second embodiment. First, the processes of steps S21 to S24 sequentially correspond to the processes of steps S1 to S4 described in the first embodiment.

After step S24, the control unit 66 requests the microscope device 5 for information on the magnification and the aperture value via the communication unit 61, and acquires the information from the microscope device 5 (step S25). The processing order of steps S24 and S25 may be reversed or may be performed in parallel.

Subsequently, the control unit 66 extracts the depth of focus of the reference by referring to the table of the storage unit 67 based on the acquired magnification and / or aperture value information, and this depth and the storage unit 67 The return amount in the return mode is set based on the relationship between the depth of focus depth of the reference to be stored and the return amount (step S26).

Subsequent processes in steps S27 to S36 sequentially correspond to the processes in steps S5 to S14 described above. The return amount of the focal position of the focus lens 511 in step S35 is the return amount set by the control unit 66 in step S26.

According to the second embodiment of the present disclosure described above, the focus adjustment by voice input can be performed by a simple process with less load, as in the first embodiment.

Further, according to the second embodiment, since the return amount is set according to the magnification and / or the aperture value at the time of imaging, the return amount can be set according to the imaging conditions such as the optical parameters at the time of imaging. ..

(Embodiment 3)
In the third embodiment of the present disclosure, after the focus lens is stopped by the voice input of the user, the focus lens is automatically returned by a predetermined return amount from the focus position when the focus lens is stopped. Return the position of. The return amount may be determined in the same manner as in the first embodiment. The functional configuration of the medical observation system according to the third embodiment is the same as that of the first embodiment.

In the third embodiment, the control unit 66 of the control device 6 stops the movement of the focus lens 511 in response to the input of the stop instruction to the microphone 4 by the user 101, and then the focus position of the focus lens 511 is the focus lens 511. Control is performed to return the position of the focus lens 511 so that the focus position at the time of stop is automatically returned by a predetermined return amount.

FIG. 6 is a flowchart showing an outline of the processing performed by the control device according to the third embodiment. In FIG. 6, the processes of steps S41 to S49 sequentially correspond to the processes of steps S1 to S9.

In step S50, the control unit 66 generates a return control signal and transmits it to the control unit 5a (step S50). This process is automatically performed regardless of the voice input by the user 101.

After that, when the predetermined time elapses (step S51: Yes), the control device 6 ends a series of processes.

The case where the predetermined time has not elapsed in step S51 (step S51: No) will be described. In this case, when the communication unit 61 acquires the voice signal (step S52: Yes), the voice recognition unit 65 performs the voice signal recognition process (step S53). If the communication unit 61 does not acquire the audio signal in step S52 (step S52: No), the control device 6 returns to step S51.

If the result of the recognition process in step S53 is a return instruction (step S54: Yes), the control device 6 returns to step S50. On the other hand, if the result of the recognition process in step S53 is not a return instruction (step S54: No), the control device 6 returns to step S51.

According to the third embodiment of the present disclosure described above, the focus adjustment by voice input can be performed by a simple process with less load, as in the first embodiment.

Further, according to the third embodiment, after the focus lens is stopped by the voice input of the user, the focus position of the focus lens is automatically returned by a predetermined return amount, so that the number of operations by voice input can be reduced. can.

Also in the third embodiment, as in the second embodiment, the depth of focus according to the imaging conditions at the time of imaging such as the magnification and / or the aperture value when the control unit receives the instruction input of the focus operation. The return amount may be set based on the depth.

Further, in the third embodiment, the user may be able to set whether or not to automatically return the focus lens after stopping the focus lens by the user's voice input.

(Embodiment 4)
In the fourth embodiment of the present disclosure, the depth of focus of the reference is extracted as in the second embodiment, and when the depth of focus is smaller than a predetermined value, the focus lens is stopped in the return mode. After that, the position of the focus lens is automatically returned. The functional configuration of the medical observation system according to the fourth embodiment is the same as that of the first embodiment.

In the fourth embodiment, the control unit 66 of the control device 6 has a magnification according to the positions of the focus lens 511 and the zoom lens 512 detected by the detection unit 55 when the microphone 4 receives an audio signal instructing the focus operation. The depth of the reference focal depth is extracted based on the aperture value of the and / or aperture 53, and the return amount is set according to the depth. Further, the control unit 66 compares the depth of the reference focal depth with the predetermined value, and if the depth is smaller than the predetermined value, the focus lens responds to the input of the stop instruction to the microphone 4 by the user 101. After stopping the movement of the 511, the focus lens 511 is controlled to return to the position of the focus lens 511 so that the focus position of the focus lens 511 automatically returns from the focus position when the focus lens 511 is stopped by a predetermined return amount.

The storage unit 67 sets the depth of focus of the reference according to the above-mentioned magnification and / or aperture value as a table, and in addition to the relationship between the depth of focus of the reference and the amount of return, the depth of focus of the reference Stores a predetermined value to be compared with. This predetermined value is the amount of overrun when the focus position of the focus lens 511 is stopped, which is assumed based on the input time of voice to the microphone 4 by the user 101 and the communication delay from the microphone 4 (target position P in FIG. 2A). It is a value set based on (the distance between and the stop position Q). The predetermined value is set as a value such that it is not necessary to return the focal position of the focus lens 511 when the depth of the reference focal depth is larger than the predetermined value.

FIG. 7 is a flowchart showing an outline of the processing performed by the control device according to the fourth embodiment. The processes of steps S61 to S70 sequentially correspond to the processes of steps S21 to S30 described in the second embodiment.

In step S71, the control unit 66 compares the depth of the reference depth of focus with the predetermined value. When the depth of focus of the reference is smaller than a predetermined value (step S71: Yes), the control unit 66 shifts to the return mode (step S72). On the other hand, when the depth of focus of the reference is equal to or greater than a predetermined value (step S71: No), the control device 6 ends a series of processes.

The processes of steps S73 to S77 sequentially correspond to the processes of steps S50 to S54 described in the third embodiment.

According to the fourth embodiment of the present disclosure described above, the focus adjustment by voice input can be performed by a simple process with less load, as in the first embodiment.

Further, according to the fourth embodiment, when the depth of focus of the reference is smaller than a predetermined value, the focal position of the focus lens is automatically returned by a predetermined return amount, and the depth is equal to or larger than the predetermined value. In the case of, since the process is completed without returning the focus lens, unnecessary operations can be avoided when the focus is within the depth of focus.

(Other embodiments)
Although the embodiments for carrying out the present disclosure have been described so far, the present disclosure should not be limited only to the above-described embodiments 1 to 4. For example, the present disclosure is not limited to the focus operation, and the same process can be performed after the various functional members are stopped by the user's voice input in the case of the zoom operation or the field of view movement.

Further, the medical observation device according to the present disclosure may be an endoscope or an endoscope provided with an imaging device.

The present technology can also have the following configurations.
(1)
An acquisition unit that acquires operation instructions by voice input to an imaging device including an optical system including a focus lens and an imaging unit, and an acquisition unit.
When the operation instruction is an instruction to stop the operation of the focus lens, the focal position of the focus lens returns from the focal position when the focus lens is stopped by a return amount equal to or less than the reference depth of focus in the optical system. As described above, the control unit that shifts to the mode of controlling to return the position of the focus lens and
A control device comprising.
(2)
The acquisition unit
The control device according to (1) above, which acquires a voice signal generated by a microphone that accepts voice input as the operation instruction.
(3)
The control device according to (1) or (2), further comprising a voice recognition unit that recognizes the content of the operation instruction acquired by the acquisition unit.
(4)
The control device according to any one of (1) to (3), wherein the return amount is at least half the depth of the reference depth of focus.
(5)
The reference depth of focus is the depth of focus according to a magnification higher than the magnification of the center of the settable range among the magnifications that can be set for the optical system, according to the above (1) or (2). Control device.
(6)
The control device according to any one of (1) to (5) above, wherein the reference depth of focus is a depth of focus according to the imaging conditions at the time of imaging of the imaging unit.
(7)
The control device according to (6) above, wherein the imaging condition is the magnification of the optical system.
(8)
The control device according to (6) above, wherein the imaging condition is an aperture value of the optical system.
(9)
The control unit
The control device according to any one of (6) to (8), wherein the return amount is set based on the depth of focus of the reference according to the imaging condition.
(10)
The control device according to (9), wherein the reference depth of focus is the depth of focus of the focus lens at the stopped position.
(11)
The control device according to (9), wherein the reference depth of focus is the depth of focus of the focus lens at a position where the stop instruction is input.
(12)
The control unit
When a return instruction is received as the operation instruction after shifting to the mode, the position of the focus lens is returned so that the focus position of the focus lens is returned by the return amount. The control device according to any one item.
(13)
The control unit
The control device according to any one of (1) to (12) above, which returns the position of the focus lens so that the focus position of the focus lens automatically returns by the amount of the return after shifting to the mode. ..
(14)
The control unit
When the operation instruction is to stop the operation of the focus lens and the depth of focus of the reference is smaller than a predetermined value, any one of the above (1) to (13) for shifting to the mode. The control device described in.
(15)
An imaging device including an optical system including a focus lens and an imaging unit,
When the acquisition unit that acquires an operation instruction by voice input to the image pickup device and the operation instruction is an instruction to stop the operation of the focus lens, the focal position of the focus lens is the focal position when the focus lens is stopped. A control device having a control unit that shifts to a mode for controlling the return of the position of the focus lens so that the return amount is equal to or less than the reference depth of focus in the optical system.
A display device that displays an image captured by the image pickup device, and
Medical observation system equipped with.

1 Medical observation system 2 Medical observation device 3 Display device 4 Microscope 5 Microscope device 5a, 66 Control unit 6 Control device 7 Microscope unit 8 Support unit 9 Base unit 51 Lens unit 52 Lens drive unit 53 Aperture 54 Aperture drive unit 55 Detection 56 Imaging unit 57 Arm drive unit 58, 63 Input unit 59, 61 Communication unit 62 Image processing unit 64 Light source unit 65 Voice recognition unit 67 Storage unit 101 User 102 Patient 201 3D glasses 511 Focus lens 512 Zoom lens L ₁ Depth of focus Depth L ₂ Return amount P Target position Q, R Return position

Claims (15)

An acquisition unit that acquires operation instructions by voice input to an imaging device including an optical system including a focus lens and an imaging unit, and an acquisition unit.
When the operation instruction is an instruction to stop the operation of the focus lens, the focal position of the focus lens returns from the focal position when the focus lens is stopped by a return amount equal to or less than the reference depth of focus in the optical system. As described above, the control unit that shifts to the mode of controlling to return the position of the focus lens and
A control device comprising. The acquisition unit
The control device according to claim 1, wherein a voice signal generated by a microphone that accepts voice input is acquired as the operation instruction. The control device according to claim 1, further comprising a voice recognition unit that recognizes the content of the operation instruction acquired by the acquisition unit. The control device according to claim 1, wherein the return amount is at least half the depth of the reference depth of focus. The control device according to claim 1, wherein the reference depth of focus is a depth of focus corresponding to a magnification higher than the magnification of the center of the settable range among the magnifications that can be set for the optical system. The control device according to claim 1, wherein the reference depth of focus is a depth of focus according to the imaging conditions at the time of imaging of the imaging unit. The control device according to claim 6, wherein the imaging condition is a magnification of the optical system. The control device according to claim 6, wherein the imaging condition is an aperture value of the optical system. The control unit
The control device according to claim 6, wherein the return amount is set based on the depth of focus of the reference according to the imaging condition. The control device according to claim 9, wherein the reference depth of focus is the depth of focus of the focus lens at the stopped position. The control device according to claim 9, wherein the depth of focus of the reference is the depth of focus of the focus lens at a position where the stop instruction is input. The control unit
The control device according to claim 1, wherein when a return instruction is received as the operation instruction after shifting to the mode, the position of the focus lens is returned so that the focus position of the focus lens is returned by the return amount. The control unit
The control device according to claim 1, wherein after shifting to the mode, the position of the focus lens is returned so that the focus position of the focus lens automatically returns by the amount of the return. The control unit
The control device according to claim 1, wherein the operation instruction shifts to the mode when the depth of focus of the reference is smaller than a predetermined value when the operation instruction is to stop the operation of the focus lens. An imaging device including an optical system including a focus lens and an imaging unit,
When the acquisition unit that acquires an operation instruction by voice input to the image pickup device and the operation instruction is an instruction to stop the operation of the focus lens, the focal position of the focus lens is the focal position when the focus lens is stopped. A control device having a control unit that shifts to a mode for controlling the return of the position of the focus lens so that the return amount is equal to or less than the reference depth of focus in the optical system.
A display device that displays an image captured by the image pickup device, and
Medical observation system equipped with.

Images