JP2010207460A - Observation apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the following problem: when automatic light adjustment is employed when an object to be observed has a difference in focal distance by a difference between a projection and a recess or a part, such as white, where luminance becomes high is included in an imaging range (observation visual field range), a part to become reference for light adjustment is not always a part where an observer wants to observe, so that the light is not adjusted to desired brightness. <P>SOLUTION: When an observer moves a mirror body 2, displays a part he or she wants to observe to a monitor, and displays an object 6 to be observed in the center of a display screen, a distance is measured. When an observation distance WD from an objective lens to an interference object is almost equal to a measured distance f, it is determined that it is a part which the observer wants to observe, the observation apparatus adjusts light in accordance with the measured distance f to optimal brightness under which the object to be observed is easy to observe. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an observation apparatus that performs dimming of an image at a desired observation location based on a focal distance to an object having an unevenness in an imaging range and brightness of the object.

In general, when a subject image is captured by an imaging device, distance measurement and photometry are performed on a main subject within the imaging range, and imaging is performed by setting an imaging condition with optimum focus and brightness.
For example, in Patent Document 1, a range in which the imaging range and the visual field range overlap is determined based on the distance to the subject and the focal length of the lens, and the luminance component of the video signal is extracted to calculate the photometric value. The technology to be put out has been proposed.
Patent Document 2 proposes a technique for creating a photometric frame that equally divides an imaging screen into a plurality of detection areas, and calculating an imaging condition (focal length) based on image data.

JP-A-6-105217 JP 2003-153071 A

  In the setting of the shooting conditions described above, the difference in unevenness (difference in depth of field) before and after the subject to be imaged, that is, when the focal length is different between the parts of the subject, or within the imaging range (observation visual field range). Parts that increase in brightness, for example, when white parts are included in parts that are based on dark colors, using automatic light control, a situation occurs in which the white part becomes the reference, and the photographer The part to be observed is not always adjusted to the optimum brightness.

In an observation apparatus used for an electronic image microscope or the like, if the site to be observed is an affected part to be treated by surgery in a body cavity, it is located at an affected part located in a substantially flat surface or a deep hole-like bottom. There are affected areas. For example, if the affected part located at the bottom of a deep hole is the object to be observed, if there is a relatively white-based part such as the brain or bone near or in the middle of the hole entrance, In addition, when the white is dimmed with reference, the affected area at the bottom of the hole that the observer (operator) wants to observe becomes dark. Therefore, it is necessary to re-enter the image pickup unit again to perform resetting or to perform a manual correction operation.
SUMMARY OF THE INVENTION An object of the present invention is to provide an imaging apparatus that performs appropriate light control on a desired site of an observation object without being affected by the surface shape or color of the observation object to be imaged.

  In order to achieve the above object, an embodiment according to the present invention provides:

  According to the present invention, it is possible to provide an imaging apparatus in which appropriate light control is performed on a desired site of an observation object without being affected by the surface shape and color of the observation object to be imaged.

FIG. 1 is a diagram showing an overall configuration of an observation system used for surgery according to the second embodiment. FIG. 2 is a diagram showing in detail the optical configuration of the mirror part in the observation apparatus. FIG. 3 is a diagram illustrating a configuration of a mirror body portion and a support portion that movably supports the mirror body portion in the observation apparatus. FIG. 4 is a block configuration diagram relating to imaging and image processing in the observation system. FIGS. 5A, 5 </ b> B, 5 </ b> C, and 5 </ b> D are diagrams for explaining imaging (dimming) by the observation system. FIG. 6 is a flowchart for explaining light control by the observation system of the first embodiment. FIG. 7A is a diagram showing a first arrangement example by a plurality of distance measuring spots arranged in the visual field range, and FIG. 7B is a photometric measurement in which the visual field range is divided concentrically from the center. FIG. 7C is a diagram illustrating an arrangement example of areas, and FIG. 7C is a diagram illustrating a second arrangement example using a plurality of ranging spots arranged in the visual field range. FIG. 8 is a block configuration diagram of an observation apparatus according to the observation system of the second embodiment. FIG. 9 is a flowchart for explaining light control by the observation system of the second embodiment. FIG. 10 is a block configuration diagram for performing imaging and light control processing of an observation object according to the third embodiment. FIG. 11A is a diagram showing a second arrangement example with a plurality of distance measuring spots arranged in the observation range, and FIG. 11B is an arrangement example of the photometry area that divides the visual field range into five. FIG. FIG. 12 is a flowchart for explaining light control by the observation system of the third embodiment. FIG. 13 is a block configuration diagram for performing imaging and light adjustment processing of an observation object according to the fourth embodiment. FIG. 14A is a diagram for explaining the depth of focus with respect to the observation object, and FIG. 14B is a diagram showing the relationship between the visual field range and the depth of focus. FIG. 15 is a flowchart for explaining light control by the observation system of the fourth embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
With reference to FIG. 1 thru | or FIG. 6, the observation system which concerns on 1st Embodiment is demonstrated. The observation system of this embodiment is an imaging device mounted on an endoscope or a video surgical microscope (electronic image microscope). In the following example, an observation system including an observation device used as a microscope for surgery will be described. . Note that the observation apparatus may employ either an imaging apparatus that captures a still image or an imaging apparatus that captures a moving image.

  FIG. 1 is a diagram showing an overall configuration of an observation system used for surgery according to the second embodiment. FIG. 2 is a diagram showing in detail the optical configuration of the mirror part in the observation apparatus. FIG. 3 is a diagram illustrating a configuration of a mirror body portion and a support portion that movably supports the mirror body portion in the observation apparatus. FIG. 4 is a block configuration diagram relating to imaging and image processing in the observation system. FIGS. 5A, 5 </ b> B, and 5 </ b> C are diagrams for explaining imaging (dimming) by the observation system. FIG. 6 is a flowchart for explaining light control by the observation system of the first embodiment.

  As shown in FIG. 1, the observation system 1 is roughly divided into an observation apparatus including a mirror unit 2 and a support unit 3, a 3D monitor 4 for displaying a captured subject, and a 3D monitor 4 movably supported. And a foot switch 17 for instructing a focus operation and a zoom operation.

  The mirror unit 2 is an imaging unit main body, and as shown in FIG. 2, two imaging systems are provided in the housing to capture a stereoscopic image (3D). Specifically, the objective lens 12, the zoom optical systems 13L and 13R, the imaging lenses 14L and 14R, the image sensors (for example, CCDs) 15L and 15R, and the distance measuring sensor 18 are accommodated. An objective lens position sensor 19 is arranged in the vicinity of the objective lens 12. A zoom lens position sensor 19 ′ is provided in the vicinity of the zoom lens 13. In this configuration, an image of the observation object (affected part) 6 is imaged on the image sensor 15L at a desired magnification through the objective lens 12, the zoom lens 13L, and the imaging lens 14L, and is subjected to photoelectric conversion on the left side. It is generated as an image signal. Similarly, an image is formed on the image sensor 15R at a desired magnification through the objective lens 12, the zoom lens 13R, and the imaging lens 14R, and is generated as a right image signal by photoelectric conversion. The generated left image and right image are processed as a stereoscopic image by an image processing unit in a camera control unit (CCU) 16 described later and displayed on the 3D monitor 4.

  The distance measuring sensor 18 includes an infrared light irradiation unit (not shown) and an infrared sensor that receives infrared light reflected by the subject.

  As shown in FIG. 3, a grip 10 is attached to the exterior of the mirror unit 2 so that the observer can easily move. The grip 10 is provided with a push button type grip switch 11. The grip switch 11 is arranged so as to come to the fingertip when the grip 10 is gripped.

  When moving the lens body 2, the grip 10 is gripped and the grip switch 11 is pressed to move the arm 3 described later to a free state. Thereafter, when the grip switch 11 is released, the arm part 3 is fixed in the form at that time, and the mirror part 2 can be fixed at the position and orientation desired by the observer 7.

  Moreover, as shown in FIG. 3, the arm part 3 connects the mount frame 8 fixed to a predetermined position, a plurality of arm rods 3 (3a, 3b, 3c, 3d), and these arm rods so as to be bent. It is comprised by the joint 9 (9a, 9b, 9c, 9d). These joints 9 are provided with an electromagnetic brake (not shown), and a fixed (locked) state or an open (free) state is set by the operation or release of the electromagnetic brake by turning on / off the grip switch 11. By releasing the electromagnetic brake with the grip switch 11, each joint can be rotated, and the mirror 2 can be moved to an arbitrary position by gripping the grip 10.

  In addition, a CCU 16 (to be described later) is provided on the gantry 8, and the mirror unit 2, the 3D monitor 4, and the control unit 24 (see FIG. 4) are connected to each other by cables.

  Further, the foot switch 17 is provided with a focus switch 17a and a zoom switch 17b for instructing the mirror unit 2 when taking an image. The focus switch 17a is provided so that the focus can be UP / DOWN, and the objective lens 12 is moved in the direction of the optical axis by a drive system (not shown) by an operation, thereby performing focusing adjustment. The zoom switch 17b is provided so that zoom UP / DOWN is possible. In accordance with the instruction, the zoom switch 17b drives a drive system (not shown) to move the zoom lenses in the zoom optical systems 13L and 13R in the direction of the optical axis. Make adjustments.

  FIG. 4 shows a block configuration for performing imaging and light adjustment processing of the observation object 6. In this configuration, the imaging devices 15L and 15R, the CCU 16, the 3D monitor 4, and the control unit 24 are provided. As the imaging elements 15L and 15R, known image sensors such as a CCD (Charge Coupled Device) image sensor or a CMOS image sensor are used.

  The CCU 16 includes at least image processing (3D image processing), a plurality of photometry modes and their mode switching, and a dimming control function (circuit).

  The control unit 24 includes a distance measuring sensor control unit 20 that calculates a distance to the observation object, an optical system control unit 21 that calculates a distance WD between the objective lens and the observation object, and a comparison operation based on an observation distance WD described later. It is comprised with the comparison calculating part 22 which performs. The distance measurement sensor control unit 20 processes the distance information detected by the distance measurement sensor 18 and calculates the distance to the observation target part. The optical system control unit 21 performs processing of position information detected by the objective lens position sensor 19, and focusing and zoom control by instruction signals from the focus switch 17a and the zoom switch 17b. The comparison calculation unit 22 performs a comparison calculation based on a distance measurement result by the distance measurement sensor control unit 20 and an observation distance WD described later from the optical system control unit 21.

  FIG. 5A shows a first example of a divided photometry area in which a photometry area having the same area as the visual field range in the mirror unit 2 is divided into a plurality of parts. In the first example, a split photometry area is divided into two concentric circles from the center to the inside and outside, and a split photometry area A on the center side and a split photometry area B on the outer ring side are provided. In addition, a distance measuring spot is provided in a minimal area at the center of the visual field range. In this embodiment, since a single distance measuring spot is adopted, it is arranged at the center of the circular field of view. However, depending on the shape of the objective lens (or the shape of the field of view) and the method of use, the arrangement is limited to the center. It does not have to be done.

  Here, FIG. 5B shows an observation example when the distance (distance information) fb to the position to be measured is the same as the distance WDb to the position Pb of the object to be observed. FIG. 5C shows an example of observation when the distance fc is longer (distant) than the distance WDc at the distance fc to the position to be measured and the distance WDc to the position Pc of the object to be observed. FIG. 5D shows an example of observation when the distance WDd is longer (far) than the distance fd at the distance fd to the position to be measured and the distance WDb to the position Pd of the object to be observed.

  In these illuminations, as shown in FIG. 5B, when the distance WDb to the position Pb of the object to be observed is the same, if the illumination light is based on the distance measurement position, appropriate illumination light is obtained. In order to image the object 6 to be irradiated, an image of the object with appropriate brightness is displayed on the 3D monitor 4.

Further, as shown in FIG. 5C, when the distance fc of distance measurement is longer (distant) than the distance WDc to the object, if the illumination light is based on the position of distance measurement, the brightness becomes brighter. An image of the object 6 that is too bright and difficult to see is displayed on the 3D monitor 4 in order to capture the object 6 irradiated with excessive illumination light. On the other hand, as shown in FIG. 5D, when the distance WDb is longer (distant) than the distance fd for distance measurement, the object 6 to be observed can be observed if the illumination light is based on the distance measurement position. Since a desired illumination light is not irradiated to the position of, the object in the dark image is displayed on the 3D monitor 4.

Next, dimming at the time of imaging in the observation apparatus of the first embodiment will be described with reference to the flowchart shown in FIG.
First, the observer (operator) activates the observation system, releases the electromagnetic brake by holding the grip 10, moves the mirror body 2 to an arbitrary position, and observes the object to be imaged by the mirror body 2. The image of (affected part) 6 is processed by the CCU 16 and displayed on the 3D monitor 4. At this time, the position of the objective lens 12 is detected by the position sensor 19, and is calculated as an observation distance WD from the objective lens 12 by the optical system controller 21 (step S1). The current observation distance WD is notified to the comparison calculation unit 22.

  Next, the distance to the observation object is measured by the distance sensor 18, and the measurement signal (distance information) f from the objective lens 12 to the observation object 6 is calculated by the distance sensor control unit 20 based on the detection signal. (Step S2). The calculated measurement distance f is notified to the comparison calculation unit 22.

  The comparison calculation unit 22 compares the observation distance WD and the measurement distance f (step S3). In this comparison, if the observation distance WD is larger than the measurement distance f (YES), the mode in which the photometry in the photometry area B is measured preferentially is switched (step S4). On the other hand, if the observation distance WD is not greater than the measurement distance f (NO), it is determined whether or not the observation distance WD is substantially equal to the measurement distance f (step S5). If the observation distance WD is substantially equal to the measurement distance f in this determination (YES), the mode for focusing light metering on the light metering area A is switched (step S6). On the other hand, in this determination, if the observation distance WD is not substantially equal to the measurement distance f, that is, if the observation distance WD is smaller than the measurement distance f (YES), the peripheral portion weighted photometry mode is switched (step S7).

  Next, photometry is performed in the photometry mode set in steps S4, S6, and S7, and the CCU 16 performs dimming (adjustment of the amount of light taken into the image sensors 15L and 15R) according to the photometry results ( Step S8). If the system has a light source, light source dimming may be performed. After dimming, the process returns to step S1, and the dimming is repeated.

  Therefore, for example, in a scene where the observer wants to see the affected part located at the bottom of the deep hole, when the observer moves the mirror 2 and displays the observation object (affected part) 6 in the center of the displayed screen. Distance measurement is performed. If the observation distance WD is substantially equal to the measurement distance f, it is determined that the observation target is the part that the observer wants to see, and optimal brightness that makes it easy to observe the observation object by performing dimming according to the measurement distance f. Dimmed. In other words, by increasing the illuminance of the illumination light, the deep hole-shaped bottom becomes easy to see. At this time, the periphery of the hole is excessively bright.

  Further, if the observation distance WD is not substantially equal to the measurement distance f, it is determined that the part to be observed is not the current measurement distance but the measurement distance is shorter and the peripheral part of the hole. Dimming, that is, lowering the illuminance of the illumination light to illuminate the surrounding area This makes it difficult for the observer to see the bottom of the hole, but the desired peripheral portion has a brightness that is easy to see.

  In particular, even if a white part that is not an observation target is included in the observation field, the observation distance WD is not a distance to the white part, and thus is not a reference for light control. It is possible to prevent the sighting from being aimed.

  As described above, according to the first embodiment, by adding a software process to the autofocus technique with a simple configuration, the surface shape and color of the observation target to be imaged are not affected. In addition, light control is appropriately performed on a desired portion of the observation object. Therefore, since it can implement | achieve without adding a new circuit and a structure part, the increase in manufacturing cost, the enlargement of an apparatus, etc. can be suppressed to the minimum.

  Next, an observation system according to the second embodiment will be described with reference to FIGS. In the constituent parts of the observation apparatus of this embodiment, the same parts as those of the observation apparatus of the first embodiment described above are denoted by the same reference numerals, and the description thereof is omitted. Here, FIG. 7A is a diagram showing a first arrangement example by a plurality of distance measuring spots arranged in the visual field range, and FIG. 7B is a concentric circle (annular) from the center in the visual field range. FIG. 7C is a diagram showing an example of the arrangement of the divided photometry areas divided into two, and FIG. 7C is a diagram showing a second example of arrangement with a plurality of distance measuring spots arranged in the visual field range. FIG. 8 is a block configuration diagram of an observation apparatus according to the observation system of the second embodiment. FIG. 9 is a flowchart for explaining light control by the observation system of the second embodiment.

  As shown in FIG. 7A, in the present embodiment, a multi-ranging method using a plurality of distance measuring spots is used in place of one distance measuring sensor 18. The plurality of ranging spots are arranged in two lines orthogonal to each other at the center of the visual field range. Here, with the distance measurement spot C as the center, the distance measurement spots L2, L1, C, R1, and R2 are line-shaped, and the distance measurement spots T2, T1, C, B1, and B2 are orthogonal to each other. Each is arranged at equal intervals. With this arrangement, the distance measuring spots are arranged every 90 degrees so that the visual field range is divided into four quarters from the center.

  Further, as shown in FIG. 7B, the photometry area is divided into a distance measurement area A0 arranged at the center so as to correspond to the multi-range measurement spot in FIG. An intermediate divided ranging area A1 divided concentrically corresponding to L1, T1, L1, B1, and an outer divided divided concentrically corresponding to the outermost peripheral ranging spots L2, T2, L2, B2. The distance measuring area A2 is divided into three rings. As shown in FIG. 7B, in the present embodiment, the diameter of the divided ranging area A0 and the radius length of the divided ranging area A1 and the divided ranging area A2 are described so as to be substantially equal. However, it is not particularly limited, and it is a matter of course that each length is appropriately changed according to specifications such as design.

  As shown in FIG. 8, the observation apparatus includes an imaging optical system including the imaging elements 15L and 15R, the CCU 16, the 3D monitor 4, the optical system control unit 21, the objective lens position sensor 19, and the foot switch 17a. , 17b and a comparison operation unit 22. Further, the zoom lens position detection unit 35 that detects the positions of the zoom lenses 13L and 13R, the multi-range measurement unit 23 having a plurality of distance measurement spots, and the distance measurement sensor control unit 20 that calculates the distance between the distance measurement spots. And are provided.

With reference to the flowchart shown in FIG. 9, the light control at the time of imaging in the observation apparatus of 2nd Embodiment is demonstrated. In addition, when it is the same operation | movement as the step operation | movement shown in FIG. 6 mentioned above, it simplifies and demonstrates.
First, the observer (operator) activates the observation system and moves the mirror body 2 so that the desired observation object (affected part) 6 or its vicinity is displayed on the 3D monitor 4. At this time, the positions of the objective lens 12 and the zoom lens 13L or 13R are detected by the position sensor 19 and the zoom lens position detector 35, respectively. The optical system control unit 21 calculates the observation distance WD from the detected position information of the objective lens 12 (step S11). The current observation distance WD is notified to the comparison calculation unit 22.

Next, the distance to the observation object 6 at each distance measurement spot (C, R1, R2, L1, L2, T1, T2, B1, and B2) is measured by the multi-range distance unit 23, and the detection signal is measured. the distance sensor control unit 20 calculates the measured distance f of the objective lens 12 to the observation object _{6 (fc, f R1, f} R2, f L1, f L2, f T1, f T2, f B1, f B2) (Step S12). The calculated measurement distances f are notified to the comparison calculation unit 22.

The comparison calculation unit 22 compares whether or not the observation distance WD and each measurement distance f are substantially the same (step S13). In this comparison, if the observation distance WD and the measurement distance f are substantially the same (YES), photometry is performed on the entire photometric areas A ₀ , A ₁ , A ₂ (step S14). On the other hand, if the observation distance WD and the measurement distance f are not substantially the same (NO), the divided distance measurement areas (R2, L2, T2, and B2) arranged on the outer peripheral side of the visual field range are selected. Next, it is determined whether or not the sum of the distances f _R2 , f _L2 , f _T2 , and f _B2 measured by these divided ranging areas is not the same as the observation distance WD (step S15).

In this determination, if the sum of the distances f and the observation distance WD are not the same (YES), photometry is performed in the center and middle photometry areas A ₀ and A ₁ of the visual field range (step S16), while the sum of the distances f and if the observation distance WD is the same (NO), photometry only at the center of the photometric area a ₀ of the field-of-view range (step S17).

Next, the CCU 16 performs dimming (adjustment of the amount of light taken into the image sensors 15L and 15R) according to the observation distance WD and the photometric result measured in any of steps S14, S16, and S17 (step S18). ). If the system has a light source, light source dimming may be performed. After dimming, the process returns to step S11 and the dimming is repeated.
In the present embodiment, the distance measuring spots are arranged in a cross shape orthogonal to the center of the visual field range. However, in order to reduce the cost as in the modification shown in FIG. You may arrange | position in a Y shape so that it may divide into three from the center. In addition, a plurality of distance measuring spots may be arranged uniformly in the entire visual field range, or may be arranged at different densities per unit area. For example, a large number of ranging spots are arranged on the center side of the visual field range and a small number are arranged on the peripheral side.

  As described above, according to the second embodiment, it is assumed that the target region to be observed is out of the center of the visual field range (ranging spot position: FIG. 5A) by adopting multi-ranging. In addition, it is possible to select a distance measuring spot closest to the target part and perform distance measurement. Thereby, if it is an observation target displayed in the visual field range, appropriate light control can be performed without moving the mirror body 2.

  The observation apparatus of this embodiment is suitable for a surgical microscope used for an operation performed by opening a deep hole, for example, an extracerebral operation. The distance measurement spot may be selected, for example, by placing a touch panel on a 3D monitor and instructing it, or by selecting a pointer by displaying a pointer on the monitor screen. Furthermore, it is also possible to select by eye-gaze detection using a glasses-type input device.

Next, an observation system according to the third embodiment will be described with reference to FIGS. 10 to 12.
In the constituent parts of the observation apparatus according to the observation system of the present embodiment, the same reference numerals are assigned to the same parts as those of the observation apparatus of the second embodiment described above, and the description thereof is omitted. Here, FIG. 10 is a block configuration diagram for performing imaging and dimming processing of an observation object according to the third embodiment. FIG. 11A is a diagram showing a second arrangement example with a plurality of distance measuring spots arranged in the observation range, and FIG. 11B shows an arrangement example of the photometry area that divides the visual field range into five. FIG. 12 and FIG. 12 are flowcharts for explaining light control by the observation system of the third embodiment.

In this embodiment, as shown in FIG. 7A, an image measuring unit 36 is provided in place of the ranging by the ranging sensor 18 (23) and the ranging sensor control unit 20 in the first and second embodiments. 2
Using the two left and right images picked up by the imaging optical system of the system, the distance to the observation object is calculated and used as the observation distance WD.

  As shown in FIG. 10, the observation apparatus of the present embodiment includes an imaging optical system including the above-described imaging elements 15L and 15R, the CCU 16, the 3D monitor 4, the optical system control unit 21, the objective lens position sensor 19, and the like. , Foot switches 17a and 17b, a zoom lens position detection unit 35, a comparison calculation unit 22, and an image measurement unit 36.

As shown in FIG. 11A, five measurement locations (equivalent to ranging spots) are arranged in the observation range as a second arrangement example. In this arrangement, in the image displayed on the observation range, that is, on the display screen of the 3D monitor 4, the measurement point c is arranged at the center, and the measurement points A, B, D, E are arranged near the diagonal lines. The image measurement unit 36 calculates measurement distances f _C , f _A , f _B , f _D , and f _E from these measurement points, respectively. These measurement distances are output to the comparison calculation unit 22. At this time, the optical system control unit 21 determines the focal length and the distance from the position information of the objective lens 12 detected by the objective lens position sensor 19 and the position information of the zoom lenses 13L and 13R detected by the zoom lens position detection unit 35. The zoom magnification is calculated and the depth of focus is calculated. This depth of focus is notified to the comparison calculation unit 22, and is used for determination described later as ΔD.

  FIG. 11B shows an arrangement example of photometric areas A, B, C, D, and E that divide the observation range into five. In the present embodiment, a photometric area C having a circular area shape is arranged at the center of the observation range, and a photometric area having a rectangular area shape in which the observation range is divided into four equal parts in the periphery except for the photometric area C. Areas A, B, D, and E are arranged. Each photometry area is provided with at least one distance measurement location.

With reference to the flowchart shown in FIG. 12, the light control at the time of imaging in the observation apparatus of 3rd Embodiment is demonstrated. In addition, when it is the same operation | movement as the step operation | movement shown in FIG.6 and FIG.9 mentioned above, it simplifies and demonstrates.
First, the observer (operator) starts up the observation system and then moves the mirror body 2 to display the desired observation object (affected part) 6 or its vicinity on the 3D monitor 4. At this time, the position information of the objective lens 12 is detected by the objective lens position sensor 19, and the current observation distance WD is calculated (step S21). The current observation distance WD is notified to the comparison calculation unit 22.

Next, the image measuring unit 36 calculates measurement distances (distance information) f _C , f _A , f _B , f _D , and f _E at the measurement location (step S22). The calculated measurement distances f are notified to the comparison calculation unit 22.

The comparison calculation unit 22 compares whether or not each measurement distance f is substantially the same as the observation distance WD. First, it is determined whether or not the observation distance WD and the measurement distance f _C are substantially the same (step S23). In this determination, the observation distance WD and measuring distance _{f C} is equal substantially identical (YES), sets a photometry area C to the photometry target area (step S24). On the other hand, if the observation distance WD and measuring distance _{f C} is not substantially the same (NO), then the observation distance WD and measuring distance _{f A} determines whether substantially the same (step S25).

In this determination, the observation distance WD and measuring distance _{f A} is as long as approximately the same (YES), sets a photometry area A to the photometry target area (step S26). On the other hand, if the observation distance WD and measuring distance _{f A} is not substantially the same (NO), then the observation distance WD and measuring distance _{f B} determines whether substantially the same (step S27).

Similarly, if the observation distance WD and measuring distance _{f B} is substantially the same (Step S27: YES), sets the photometric area B to the photometry target area (step S28), the observation distance WD between the measured distance _{f D} if bets are substantially the same (step S29: YES), sets the photometric area D on the photometry target area (step S30), if the observation distance WD and measuring distance _{f E} is substantially the same (step S31: YES ), The photometric area E is set as the photometric target area (step S32).

If these are set, photometry is performed in the set photometry area, and light control is performed based on the photometric value (step S33). If the system has a light source, light source dimming may be performed. After dimming, the process returns to step S21, and the dimming is repeated.
As another method, prior to dimming, the optical system control unit 21 obtains and records the focal depth according to the focal length and the zoom magnification. Further, the optical system control unit 21 calculates the depth of focus from the focal length and the zoom magnification. The above determination is performed with this depth of focus as ΔD.

That is, in step S23 described above, in the determination of the WD ≒ _{f C,} as WD ± ΔD ≒ _{f C,} may be used [Delta] D described above as any fixed value (range). Furthermore, the observer may perform setting input using an input unit such as a keyboard (not shown).

  Furthermore, the image measurement unit 36 shown in FIG. 10 may calculate the distance to the observation object from the left image and the right image captured by the two imaging optical systems, and may be based on the measurement result. .

  If the observation apparatus according to the third embodiment described above is used, in addition to the effects of the first and second embodiments described above, the distance measuring spot is minimized. Suitable and manufacturing cost is also low.

  Next, an observation system according to a fourth embodiment will be described with reference to FIGS. In the constituent parts of the observation apparatus according to the observation system of the present embodiment, the same parts as those of the observation apparatus of the first embodiment described above are denoted by the same reference numerals, and the description thereof is omitted. Here, FIG. 13 is a block configuration diagram for performing imaging and dimming processing of the observation object according to the fourth embodiment. FIG. 14A is a diagram for explaining the depth of focus with respect to the observation object, and FIG. 14B is a diagram showing the relationship between the visual field range and the depth of focus. FIG. 15 is a flowchart for explaining light control by the observation system of the fourth embodiment.

  As shown in FIG. 12, the observation apparatus of the present embodiment includes a mirror unit 2a, an optical system control unit 21, a focus switch 17a provided in a foot switch, and distance sensor control that performs distance measurement using infrared light. The unit 34, the comparison calculation unit 22, the CCU 16, and the 2D monitor 37 are included.

The mirror unit 2a includes an imaging optical system and a distance measuring optical system on the same optical axis.
The imaging optical system includes an objective lens 25, an imaging lens 28, and an imaging element (CCD) 29. An objective lens position sensor 19 is provided in the vicinity of the objective lens 25 to detect the position of the objective lens 25.

  The distance measuring optical system adopts an infrared time-of-flight measurement method, and includes an infrared light source 30 that emits infrared light, a condensing lens 31 that converges infrared light into a beam, and an optical axis. The half mirror 26 which is arranged and bends infrared light (emitted infrared light) from the side and guides it on the optical axis, and bends the infrared light (reflected infrared light) on the optical axis to the side. It comprises a beam splitter 27 for guiding, an image forming lens 32 for reflecting infrared light guided to the side, and a surface distance sensor 33 for receiving the imaged reflected infrared light. In this example, a half mirror 26 and a beam splitter 27 are disposed on the optical axis between the objective lens 25 and the imaging lens 28.

  The ranging sensor control unit 34 drives and controls the infrared light source 30 to emit infrared light, emit the infrared light to the observation target, and receive the reflected infrared light that is reflected light from the surface distance sensor 33. It is converted into distance information f [x, y] (x and y are variables indicating pixel positions) for each detected pixel. This distance information is notified to the comparison calculation unit 22.

  Further, for imaging of the observation object, a light image condensed by the objective lens 25 and the imaging lens 28 is formed on the light receiving surface of the imaging element 29. The image sensor 29 generates an image signal by photoelectric conversion and outputs the image signal to the CCU 16. The CCU 16 performs the above-described image processing and displays it on the 2D monitor 37.

  Next, light control by the observation apparatus according to the observation system of the fourth embodiment will be described with reference to the flowchart shown in FIG.

  First, the observer (surgeon) activates the observation system and then moves the mirror body 2 to display the desired observation object (affected part) 6 or its vicinity on the 2D monitor 37. At this time, the position information of the objective lens 25 is detected by the objective lens position sensor 19, and the current observation distance WD is calculated (step S41). The current observation distance WD is notified to the comparison calculation unit 22.

  Next, the distance measuring sensor control unit 34 detects distance information f for each pixel from the surface distance sensor 33 that has received the reflected infrared light described above (step S42). The calculated distance information f is notified to the comparison calculation unit 22.

  Next, as shown in FIG. 14A, the comparison calculation unit 22 compares the distance information f [x, y] from the distance measurement sensor control unit 33 with each other within WD ± Δd. The area to be measured by the surface distance sensor 33 is mapped (step S43). Next, the photometric object area map is converted into a pixel map in the image sensor 29 and notified to the CCU 16 (step S44).

The CCU 16 performs photometry on the photometry target based on the notified photometry target area map (step S45). Note that the area to be measured is an area within WD ± Δd. The CCU 16 performs light control based on the photometric value obtained by this photometry (step S46). If the system has a light source, light source dimming may be performed. After dimming, the process returns to step S41 and the dimming is repeated.
In the configuration of the present embodiment, by adding the 3D monitor 4a and the 3D processor 38 indicated by broken lines in FIG. 13, a 3D image by DepthMap can be generated, and the 3D image can be displayed by the corresponding 3D monitor 4a. it can. As described above, according to the fourth embodiment, a system for generating a 3D image is constructed based on DepthMap, can be configured more easily, and the finest light control can be realized.

  As described above, the observation system according to the present embodiment has a portion where the observation target has unevenness (altitude difference or depth of field difference) or a portion where white portions are included and the luminance is increased. Even if it is, the part of the part that the observer wants to see is adjusted to the optimum brightness, and can be imaged and displayed on the monitor. Therefore, even if the site to be observed is an affected part located at the bottom of a deep hole, the light is adjusted to a suitable brightness that is easy to see.

  Further, if it is mounted on an endoscope or a video surgical microscope (electronic image microscope) without requiring other operations for correction, the surgeon can concentrate on the surgery while observing.

  According to each embodiment invented above, the following invention is included.

(1) an imaging means for acquiring an observation image including an object desired to be observed via an objective optical system having a variable focal length;
Ranging means capable of measuring the distance between the imaging means and the object in the observation image;
A computing means for comparing the focal length with the distance measured by the distance measuring means;
A plurality of photometry modes for measuring the brightness of the object, and a photometry means for changing the photometry mode based on a calculation result by the calculation means;
Dimming means for controlling the brightness of the observation image based on the photometric mode;
Display means for displaying the observation image whose brightness is dimmed;
An observation apparatus comprising:

(2) The plurality of photometry modes by the photometry means are for selecting any one or a combination of divided photometry areas divided into at least two or more. Observation device.

(3) The observation device according to (2), wherein a distance measurement point by the distance measurement unit is associated with at least one of the divided photometry regions by the photometry unit.

(4) The observation apparatus according to (2), wherein the photometric means is a surface distance sensor that measures the distance of the entire region within the observation field.

(5) The observation apparatus according to (4) above, wherein the first surface distance sensor is realized by an infrared time-of-flight measurement method.

(6) The observation apparatus according to any one of (1) to (5), wherein the objective optical system is a stereoscopic optical system capable of stereoscopic observation, and the imaging unit captures a stereoscopic image.

(7) The observation apparatus according to (1), wherein the distance measuring unit calculates a distance based on a parallax obtained by two images captured through the stereoscopic optical system.

(8) The observation apparatus according to any one of (1) to (5) above, wherein the imaging means is an endoscope / video surgical microscope.

  DESCRIPTION OF SYMBOLS 1 ... Observation system, 2 ... Mirror body part, 3 ... Support part, 3a, 3b, 3c, 3d ... Arm rod, 4 ... 3D monitor, 5 ... Monitor arm, 6 ... Observation object, 7 ... Observer (operator) ), 8 ... Fixing base, 9, 9a, 9b, 9c, 9d ... Joint, 10 ... Grip, 11 ... Grip switch, 12,25 ... Objective lens, 13L, 13R ... Zoom optical system, 14L, 14R, 28 ... Image formation Lenses, 15L, 15R, 29 ... Imaging device (CCD), 16 ... Camera control unit (CCU), 17 ... Foot switch, 17a ... Focus switch, 17b ... Zoom switch, 18 ... Distance sensor, 19 ... Objective lens position sensor , 20, 34 ... Distance sensor control unit, 21 ... Optical system control unit, 22 ... Comparison calculation unit, 24 ... Control unit, 30 ... Infrared light source, 33 ... Surface distance sensor, 35 ... Zoom lens position Detector, 36 ... image measurement unit, 37 ... 2D monitor.

Claims (7)

An imaging means for acquiring an observation image including an object desired to be observed through an objective optical system having a variable focal length;
Ranging means capable of measuring the distance between the imaging means and the object in the observation image;
A computing means for comparing the focal length with the distance measured by the distance measuring means;
A plurality of photometry modes for measuring the brightness of the object, and a photometry means for changing the photometry mode based on a calculation result by the calculation means;
Dimming means for controlling the brightness of the observation image based on the photometric mode;
Display means for displaying the observation image whose brightness is dimmed;
An observation apparatus comprising: The distance measuring means measures the distance by the imaging means for a plurality of locations in the observation image including the object,
The observation apparatus according to claim 1, wherein the calculation unit compares the focal distance with a plurality of distances measured by the distance measurement unit. The photometric means has a selectable divided photometric area obtained by dividing the observation image into a plurality of parts,
3. The observation apparatus according to claim 2, wherein the divided photometry area is selected according to an approximate distance or a large / small distance difference based on a plurality of measurement results measured by the distance measuring means.   The observation apparatus according to claim 2, wherein the photometric means is a surface distance sensor that measures the distance of the entire region in the observation field.   4. The observation apparatus according to claim 3, wherein the photometry means includes a plurality of divided photometry areas divided concentrically from the center in the circular observation image.   The photometry means includes a first divided photometry area having a circular shape centered on the center of the observation image, and a second area obtained by dividing the area in the observation image around the first division photometry area into a plurality of areas. 4. The observation apparatus according to claim 3, wherein a divided photometric area is provided.   The observation apparatus according to claim 1, wherein the calculation unit performs the calculation based on a distance measured by the ranging unit and a focal depth of the objective optical system.

Images