JP2016035604A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus suitable for detailed observation of the three-dimensional structure of a minute object.SOLUTION: The imaging apparatus of the present invention includes an object lens (11), zoom image-forming optical systems (13, 14), and an imaging device (10) arranged in the order from an object (1). Each of the zoom image-forming optical systems (13, 14) comprises: light selection means (12) including a mask section that keeps an entrance pupil of its zoom image-forming optical system at almost the same pupil position regardless of the zoom position of the zoom image-forming optical system, and reduces incident light within a surface intersect with the optical axis of the zoom image-forming optical system at almost the same position as the pupil position, and an opening that transmits the incident light at a higher transmission rate than the mask section; and control means (100) that moves the formation position of the opening of the light selection means in three or more regions in the surface, images the object with the imaging device in each state of the three or more different formation positions of the opening, and thereby generates three or more parallax images of the object in a time division manner.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus applied to a microscope or the like.

  A stereomicroscope forms an image of an object from different angles by a pair of imaging optical systems, and allows a pair of images formed thereby to be individually observed with respect to the left and right eyes of the user. The user can feel the unevenness (depth) of the object by processing in the brain the difference between a pair of images observed individually by the left and right eyes.

  In recent stereomicroscopes, it has already been proposed that a camera is individually attached to a pair of imaging optical systems to capture left and right parallax images and display these parallax images on a binocular three-dimensional display. .

  Patent Document 1 discloses a technique in which this technique is applied to a general microscope that performs observation at a higher magnification than that of a stereomicroscope (see Patent Document 1 and the like).

JP 2010-128354 A

  However, when a minute object such as a cell is handled as in a general microscope, there is a high demand for more detailed observation of the three-dimensional shape of the object.

  Therefore, an object of the present invention is to provide an imaging apparatus suitable for observing in detail the three-dimensional structure of a fine object.

  An example of an imaging apparatus according to the present invention includes an objective lens, a plurality of zoom imaging optical systems arranged in parallel, and an imaging element that captures images of the plurality of zoom imaging optical systems, in order from the object side. In the imaging apparatus including the control unit, the entrance pupils of the plurality of zoom imaging optical systems correspond to different regions of the exit pupil of the objective lens, and each of the zoom imaging optical systems includes the Regardless of the zoom position of the zoom imaging optical system, the entrance pupil of the zoom imaging optical system is kept at the same pupil position, and in the plane intersecting the optical axis of the zoom imaging optical system at the same position as the pupil position And a light selection means having a mask part for reducing incident light and an opening part for transmitting the incident light at a higher transmittance than the mask part, and the control means includes each of the zoom imaging optics. The light selection hand included in the system In each of the three or more states where the opening forming positions of the light selecting means are moved to three or more regions in the plane, respectively, and each of the zoom imaging optical systems has different opening forming positions. Control is performed to generate three or more parallax images related to the object in a time division manner by imaging the object with the imaging device.

  According to the present invention, an imaging apparatus suitable for observing a three-dimensional structure of a fine object in detail is realized.

It is a block diagram of the microscope system of this embodiment. It is a 1st example of the pupil division pattern by the controller 100. FIG. It is a 2nd example of the pupil division pattern by the controller 100. FIG. It is a 3rd example of the pupil division pattern by the controller 100. It is a 4th example of the pupil division pattern by the controller 100. It is a 5th example of a pupil division pattern by controller 100. This is an example of a zoom microscope in which the number of pupil division optical systems is two. It is a figure which shows the relationship between the exit pupil of the objective lens 11, and the entrance oblique pupil of two pupil division | segmentation optical systems. 4 is an example of a side-by-side image generation / transfer system by a controller 100.

[First Embodiment]
Hereinafter, a microscope system will be described as an embodiment of the present invention.

  FIG. 1 is a configuration diagram of the microscope system of the present embodiment. As shown in FIG. 1, the microscope system includes a zoom microscope 30, a controller 100, a three-dimensional display 200, an epi-illumination optical system 20, and a coupling mechanism 40.

  In the zoom microscope 30, an objective lens 11, a shutter 12, an afocal zoom system 13, an imaging optical system 14, and an image sensor 10 are arranged in order from the sample 1 side. Among these, a part of the epi-illumination optical system 20 (half mirror 19) is inserted between the afocal zoom system 13 and the imaging optical system 14.

  The objective lens 11 is an infinity correction type objective lens, and the rear focal plane of the objective lens 11 (= exit pupil of the objective lens 11) is located between the objective lens 11 and the afocal zoom system 13. Yes. The specification of the objective lens 11 is equivalent to that applied to many microscopes, and the numerical aperture of the objective lens 11 is as high as 0.2, 0.3, 0.5, for example. The objective lens 11 focuses the light beam emitted from the specimen 1 toward infinity.

  The objective lens 11 is mounted on a revolver (not shown) or the like and can be exchanged between a plurality of objective lenses having different focal lengths. However, it is assumed that the distance from the body-mounted surface of the objective lens to the rear focal plane is set in common among the plurality of replaceable objective lenses. In this case, even if the objective lens 11 is replaced, the position of the exit pupil of the objective lens 11 does not change.

  The shutter 12 is disposed on the rear focal plane of the objective lens 11. The shutter 12 has an opening 12a having a high transmittance at a part of the exit pupil of the objective lens 11 (for example, an opening having a transmittance of 100%), and transmits through the other part of the pupil than the opening 12a. A transmission type mask having a mask portion 12b having a low rate (for example, a mask portion having a light shielding rate of 100%), and the position of the opening 12a in the pupil is variable (the position of the mask portion 12b in the pupil is variable). . As long as the degradation of the image displayed on the three-dimensional display 200 is negligible, at least one of the transmittance of the opening 12a and the light shielding rate of the mask portion 12b may be lower than 100%.

  As such a shutter 12, for example, a transmissive mask member that can move or rotate, a liquid crystal element that changes a transmittance distribution in accordance with a given electric signal, and the like can be used. In the following, it is assumed that a liquid crystal element is applied to the shutter 12. If this liquid crystal element is applied, not only the position of the opening portion 12a (the position of the mask portion 12b) but also the shape of the opening portion 12a (the shape of the mask portion 12b) and the transmittance of the opening portion 12a can be freely changed. It is possible.

  The afocal zoom system 13 includes, in order from the shutter 12 side, a first lens group G1 having a positive refractive power, a second lens group G2 having a negative refractive power, and a third lens group having a positive refractive power. G3 and a fourth lens group G4 having a weak positive refractive power are arranged, and the diameter of the light beam that has passed through the shutter 12 is converted and incident on the imaging optical system 14. The entrance pupil position of the afocal zoom system 13 combined with the imaging optical system 14 coincides with the rear focal plane of the objective lens 11 (the arrangement plane of the shutter 12).

  In the afocal zoom system 13, the combination of the positions of the second lens group G2 and the third lens group G3 in the optical axis direction is variable, and the second lens group G2 and the third lens group G3 are the zoom lenses. A group. Note that the afocal zoom system 13 is designed to maintain the above-described entrance pupil position even when the zoom lens groups G2 and G3 move (even if the zoom operation is performed). Therefore, in the zoom microscope 30, the shutter 12 does not come off the pupil of the zoom microscope 30 even if the zoom operation of the afocal zoom system 13 is performed. Incidentally, examples of such an afocal zoom system are also disclosed in Japanese Patent Application Laid-Open Nos. 2006-178440 and 2009-008701.

  The imaging optical system 14 condenses the light beam emitted from the afocal zoom system 13 and forms an image of the sample 1 on the imaging surface of the imaging device 10.

  The image sensor 10 captures an image formed on the imaging surface in accordance with a drive signal given from the controller 100 and sends the captured image to the controller 100 as an image.

  The epi-illumination optical system 20 includes a light source 18 composed of a fiber end of an optical fiber, a pupil position correcting optical system 16 in which a diffusing plate G6 and a movable lens G5 are sequentially arranged, a field stop 10c, an imaging lens 15, and a half. The mirror 19 is arranged in order. The optical axis of the epi-illumination optical system 20 is orthogonal to the optical axis of the optical system of the zoom microscope 30, and the half mirror 19 is located at a position where these optical axes are orthogonal.

  Along with the afocal zoom system 13, the lens G5 and the imaging lens 15 of the epi-illumination optical system 20 project the image of the light source 18 onto the entrance pupil (arrangement position of the shutter 12) of the afocal zoom system 13. Therefore, the light emitted from the light source 18 and traveling toward the specimen 1 becomes a parallel light beam by the condensing action of the objective lens 11. Therefore, the sample 1 is Koehler illuminated by the light emitted from the light source 18.

  The pupil position correcting optical system 16 of the epi-illumination optical system 20 is movable in the optical axis direction, and is connected to the zoom lens groups G2 and G3 of the afocal zoom system 13 via the connecting mechanism 40. The coupling mechanism 40 interlocks the pupil position correcting optical system 16 with the zoom lens groups G2 and G3 to thereby change the projection position of the image of the light source 18 on the entrance pupil of the afocal zoom system 13 (position of the shutter 12). Keep). Therefore, the epi-illumination optical system 20 can maintain the illumination state of the sample 1 even during the zoom operation. Incidentally, an example of such an epi-illumination optical system 20 is also disclosed in Japanese Unexamined Patent Application Publication No. 2009-008701.

  Here, the coupling mechanism 40 is used as means for interlocking the pupil position correcting optical system 16 with the zoom lens groups G2 and G3. However, instead of the coupling mechanism 40, the pupil position correcting optical system 16 and the zooming mechanism are used. Two motors that individually drive the lens groups G2 and G3, and a drive circuit that supplies drive signals for interlocking the pupil position correcting optical system 16 and the zoom lens groups G2 and G3 to the two motors. May be used.

  The controller 100 causes the image sensor 10 to generate three or more images by repeatedly driving the image sensor 10 while moving the position in the pupil of the opening 12a of the shutter 12 in three or more ways. These images are images formed individually by passing light beams of three or more partial regions shifted from each other in the pupil, and correspond to parallax images when the sample 1 is viewed from three or more positions shifted from each other. Therefore, the controller 100 generates three or more parallax images by pupil division in a time division manner.

  Here, it is assumed that the pupil division pattern (combination of the pupil division direction and the number of pupil divisions) by the controller 100 is, for example, “four divisions in the x direction” as shown in FIGS. The “x direction” is a direction corresponding to the horizontal line of the image sensor 10, and the “y direction” is a direction corresponding to the vertical line of the image sensor 10.

  Note that the partial areas A1, A2, A3, and A4 shown in FIG. 2 are individual partial pupils generated by pupil division, and the positions and shapes of the partial areas A1, A2, A3, and A4 are the shutters. 12 is defined by the position and shape of each aperture 12a at the time of imaging (the same applies to pupil division patterns in FIGS. 3 to 6 described later).

  According to the pupil division pattern shown in FIG. 2, the pupil of the zoom microscope 30 is divided into four partial areas A1, A2, A3, and A4 having the same width arranged in the x direction. , A2, A3, and A4, four parallax images I1, I2, I3, and I4 are sequentially generated.

  Here, when the four partial areas A1, A2, A3, and A4 are compared, the partial areas A2 and A3 that are closer to the center of the pupil have a larger area than the partial areas A1 and A4 that are closer to the pupil periphery. Therefore, the parallax image corresponding to the latter partial area tends to be brighter. For this reason, there may be a variation in brightness (due to the area difference of the opening 12a) between the four parallax images I1, I2, I3, and I4.

  Therefore, the controller 100 controls the charge accumulation time of the image sensor 10 when generating the four parallax images I1, I2, I3, and I4, thereby adjusting the brightness between the parallax images I1, I2, I3, and I4. It is desirable to suppress variations. Specifically, the controller 100 desirably sets the charge accumulation time when generating the parallax images I2 and I3 to be shorter than the charge accumulation time when capturing the parallax images I1 and I4.

  The control amount of the charge accumulation time is set in consideration of not only the brightness variation due to the area difference of the opening 12a but also the brightness variation due to the illumination unevenness of the sample 1. Is desirable. In this way, variations in brightness of the parallax images I1, I2, I3, and I4 can be reliably suppressed.

  Subsequently, the controller 100 converts the series of parallax images generated as described above (here, four parallax images I1, I2, I3, and I4) into a format suitable for the three-dimensional display 200 (for example, four parallax images). The series of parallax images are stereoscopically displayed on the three-dimensional display 200 by transferring them to the three-dimensional display 200 (by a side-by-side method in which I1, I2, I3, and I4 are arranged in the horizontal direction).

  Note that the controller 100 repeatedly generates and transfers a series of parallax images (here, four parallax images I1, I2, I3, and I4), and continuously performs stereoscopic display regarding the sample 1. As the generation and transfer methods, for example, any one of the following two methods can be applied.

  The first method is a method of generating and transferring a side-by-side image for one frame every time a series of parallax images (here, four parallax images I1, I2, I3, and I4) are acquired (FIG. 9 ( a)). According to this method, the shortest update cycle of the side-by-side image is equivalent to the time required to acquire a series of parallax images. Note that the series of blocks (four blocks) shown in FIG. 9 show a series of parallax images (here, four parallax images I1, I2, I3, and I4) from which side-by-side images for one frame are generated. The code “−j” assigned to the code “Ii” of each of these parallax images indicates the acquisition order between the same type of parallax images.

  The second method is a method of generating and transferring a side-by-side image for one frame every time one of a series of parallax images (here, four parallax images I1, I2, I3, and I4) is acquired. Yes (FIG. 9B). In this method, a series of parallax images (here, four parallax images I1, I2, I3, and I4) that are generation sources of side-by-side images are accumulated in a memory, and a series of parallax images (here, four parallax images I1) are stored. , I2, I3, and I4), the memory is updated and the side-by-side image is generated and transferred each time one is acquired.

  Therefore, in this second method, the first frame is between the series of parallax images that are the generation source of the side-by-side image of the first frame and the series of parallax images that is the generation source of the side-by-side image of the second frame. Except for the second parallax image, a non-parallax image is common, and a series of parallax images from which the second frame side-by-side image is generated and a series of parallax images from which the third frame side-by-side image is generated Are common (the same applies to subsequent frames). However, according to the second method, the shortest update cycle of the side-by-side image can be made equal to the time required to acquire one parallax image.

  In addition, the transfer rate of the side-by-side image by the controller 100 is assumed to be performed at a high speed such as 1/30 second per frame.

  The three-dimensional display 200 is a multi-eye type naked-eye type three-dimensional display corresponding to the pupil division pattern (here, four divisions in the x direction) of the zoom microscope 30, and a series of parallax images (in this case, transferred from the controller 100). Four parallax images I1, I2, I3, and I4) are stereoscopically displayed in real time. For example, a paralask barrier method, a lenticular lens method, a microlens array method, or the like can be applied to the stereoscopic display separation method.

  Each of a large number of blocks arranged on the screen of the three-dimensional display 200 is a series of pixels (here, 4) corresponding to each other between a series of parallax images (here, four parallax images I1, I2, I3, and I4). Are arranged in accordance with the pupil division pattern (here, four divisions in the x direction) of the zoom microscope 30, and on the exit side of the block, the spread of each of the emitted light beams from the respective parallax pixels in the block A separating member (barrier or lens) that limits the angle is provided.

  Specifically, a series of parallax pixels having coordinates (i, j) between a series of parallax images I1, I2, I3, and I4 are represented by I1 (i, j), I2 (i, j), I3 (i , J), I4 (i, j), the block located at the coordinates (i, j) on the screen has a series of parallax pixels I1 (i, j), I2 (i, j), I3 (I, j) and I4 (i, j) are arranged side by side in the horizontal direction.

  As a result, only one certain parallax image is visible to one eye of the user at a certain distance from the three-dimensional display 200, and one parallax image adjacent to the parallax image is visible to the other eye. Only you will see. That is, the three-dimensional display 200 separates a series of parallax images (here, four parallax images I1, I2, I3, and I4) and stereoscopically displays them.

  A touch panel (not shown) is laid on the screen of the three-dimensional display 200, and the user can input various instructions to the controller 100 by operating the touch panel. Examples of instructions that the user can input to the controller 100 include an instruction to switch the mode of the zoom microscope 30 between the 2D mode and the 3D mode, an instruction to start image generation (capture instruction), and the like.

  The 2D mode is a mode in which the controller 100 generates only one image without performing pupil division (using the entire pupil as the opening 12a), and the 3D mode is a series of parallaxes in which the controller 100 performs pupil division. In this mode, images (here, four parallax images I1, I2, I3, and I4) are generated. When the three-dimensional display 200 is compatible with the four side-by-side method, the controller 100 in the 2D mode may arrange four generated images in the horizontal direction and transfer them to the three-dimensional display 200. .

  As described above, the microscope system according to this embodiment includes the objective lens 11, the zoom imaging optical system (the afocal zoom system 13 and the imaging optical system 14), and the image sensor 10 in order from the object side (sample 1 side). The zoom image forming optical system keeps the pupil position of the zoom microscope 30 stationary regardless of the zoom position of the zoom image forming optical system.

  Further, the microscope system of the present embodiment includes a mask unit (shutter 12) that is disposed at a pupil position, has an opening 12a in a part of the pupil, and has a mask part 12b in another part of the pupil, and the pupil. Control means (controller 100) that generates three or more parallax images related to the specimen 1 in a time-division manner by repeatedly driving the imaging device 10 while moving the formation position of the opening of the mask means among three or more positions. ).

  That is, the microscope system of the present embodiment performs pupil division of the zoom microscope 30 to generate three or more parallax images, and the pupil position of the zoom microscope 30 is set to be immovable regardless of the zoom operation. For this reason, in the microscope system of this embodiment, each of three or more parallax images can be appropriately generated regardless of the zoom operation.

  Therefore, the user of the microscope system of the present embodiment can both observe the specimen 1 from three or more angles and observe the specimen 1 at an arbitrary magnification.

  Further, in the microscope system of the present embodiment, since the variation in brightness among three or more parallax images is suppressed, while maintaining the balance of the brightness of a pair of parallax images observed by the user's left and right eyes simultaneously, It is possible to prevent the brightness flicker that the user feels when the viewing angle of the three-dimensional display 200 is changed.

  In the microscope system of the present embodiment, the incident illumination optical system 20 projects the image of the light source 18 onto the pupil position via at least a part of the zoom imaging optical system (the afocal zoom system 13 and the imaging optical system 14). The epi-illumination optical system 20 maintains a conjugate relationship between the light source and the pupil position regardless of the zoom position of the zoom imaging optical system.

  Therefore, in the microscope system of the present embodiment, the illumination state (Kohler illumination) at the time of generating three or more parallax images can be appropriately maintained regardless of the zoom operation.

[Modification]
In the microscope system of the present embodiment, the charge accumulation time of the image sensor 10 at the time of generating these parallax images is controlled in order to suppress the brightness variation among the three or more parallax images. Charge storage time, gain of the image sensor 10, aperture ratio of the shutter 12, intensity of observation light from the sample 1 toward the image sensor 10, and intensity of illumination light that illuminates the sample 1 May be controlled.

  Further, in order to control the aperture ratio of the shutter 12 (here, the transmission mask), the combination of the size of the opening 12a and the transmittance of the opening 12a may be controlled.

  In order to control the intensity of the observation light, the former single optical path (from the half mirror 19 to the image sensor 10) out of the optical path of the observation light emitted from the sample 1 and the optical path of the illumination light emitted from the light source 18 is used. The optical element such as a variable-transmittance filter and a shutter that opens and closes the optical path may be arranged and controlled at any part of the optical path.

  Further, in order to control the intensity of the illumination light, the latter single optical path (from the light source 18 to the half mirror 19) of the optical path of the observation light emitted from the sample 1 and the optical path of the illumination light emitted from the light source 18 is used. An optical element such as a filter having a variable transmittance and a shutter for opening and closing the optical path may be disposed at any location on the optical path and controlled.

  Further, in the microscope system of the present embodiment, the generation parameters of the parallax images are controlled in order to suppress the brightness variation among the three or more parallax images, but at least of the generated three or more parallax images. One luminance may be corrected.

  In the microscope system of this embodiment, the pupil division direction is set only in the x direction (horizontal direction) (see FIG. 2), but the pupil division direction may be set in a plurality of directions.

  For example, in the microscope system of the present embodiment, the pupil division pattern may be “four divisions in the x direction and four divisions in the y direction” as shown in FIGS.

  According to the pupil division pattern shown in FIG. 3, the pupil of the zoom microscope 30 is divided into four partial areas A1, A2, A3, and A4 of equal width arranged in the x direction. , A2, A3, A4 corresponding to each of the four parallax images I1, I2, I3, I4 are sequentially generated, and the pupil of the zoom microscope 30 has four partial areas A5 of equal width arranged in the y direction. , A6, A7, and A8, and the image sensor 10 sequentially generates four parallax images I5, I6, I7, and I8 corresponding to each of the partial areas A5, A6, A7, and A8.

  When this pupil division pattern is adopted, pupil division in the x direction and pupil division in the y direction are performed continuously, and eight parallax images I1, I2, I3, I4, I5, I6, I7 , I8 is preferably generated continuously. These eight parallax images I1, I2, I3, I4, I5, I6, I7, and I8 are transferred to the three-dimensional display 200 as a series of parallax images (to be displayed simultaneously).

  For example, eight parallax pixels having a common coordinate (i, j) between a series of parallax images I1, I2, I3, I4, I5, I6, I7, and I8 are represented by I1 (i, j), I2 (i, j ), I3 (i, j), I4 (i, j), I5 (i, j), I6 (i, j), I7 (i, j), I8 (i, j) In the block located at the coordinates (i, j), four parallax pixels I1 (i, j), I2 (i, j), I3 (i, j), and I4 (i, j) are arranged in the horizontal direction. The four parallax pixels I5 (i, j), I6 (i, j), I7 (i, j), and I8 (i, j) are arranged side by side in the vertical direction.

  As described above, for example, a three-dimensional display disclosed in Japanese Patent Laid-Open No. 6-214323 can be applied as a three-dimensional display that separates parallax images in two or more directions and stereoscopically displays them. Incidentally, in the three-dimensional display disclosed in Japanese Patent Application Laid-Open No. 6-214323, as a separation method, two lenticular lenses that are overlapped by rotating the busbar direction by 90 ° are employed. It goes without saying that a microlens array may be used instead.

  According to the pupil division pattern shown in FIG. 3, the pupil division size (size of the opening 12a) is not common between a series of parallax images, but the maximum pupil diameter is circular as shown by the dotted line in FIG. If the rectangle is not a rectangle, the pupil division size (the size of the opening 12a) can be shared between a series of parallax images. Such a modification can be similarly applied to the example of FIG.

  In the example shown in either FIG. 3 or FIG. 4, when the opening 12a is moved in the x direction, the width of the opening 12a in the y direction is set to the maximum (corresponding to the maximum diameter of the pupil), and the opening 12a. The width in the x direction of the opening 12a is set to the maximum (equivalent to the maximum diameter of the pupil) when moving the image in the y direction. For example, as shown in FIG. 5, the width in the xy direction of the partial region (opening 12a) May be set sufficiently small, and the opening 12a may be moved in the xy direction. In this case, although the brightness of the series of parallax images may be insufficient as a whole, the openings 12a are completely separated from each other between the series of parallax images (the overlap between the openings is eliminated). Can do.

  Alternatively, as shown in FIG. 6, pupil division is performed by using a sectoral partial area (opening 12a) having a vertex at the center of the pupil and rotating the sectoral opening 12a around the center of the pupil. You may plan. Also in this case, it is possible to completely separate the openings 12a from each other between a series of parallax images (eliminating overlap between the openings).

  Incidentally, when the shape of the opening 12a is made common between a series of parallax images as in the examples shown in FIGS. 5 and 6, a mask member whose opening pattern is not changed is used as the shutter 12. Pupil division can be performed simply by moving or rotating.

  In the above description, it is assumed that either one of a liquid crystal element having a variable aperture pattern and a mask member having an unchanged aperture pattern is used, but it goes without saying that both may be used in combination. .

  Further, the zoom microscope 30 of the above-described embodiment has only one optical system (referred to as “pupil division optical system”) from the shutter 12 to the image sensor 10. For example, as shown in FIG. The split optical system may be a plurality of systems.

  FIG. 7 is an example of a zoom microscope in which the number of pupil division optical systems is two. The two pupil division optical systems individually separate two regions of the exit pupil of the common objective lens 11 that do not overlap each other. The pupil is divided.

  In this case, as shown in FIG. 8, the entrance pupils P2 and P3 of the two pupil splitting optical systems are arranged in the exit pupil P1 of the objective lens 11 so as not to overlap each other, and out of the pupil P1 from the pupils P2 and P3. A light-shielding part (mask part) is provided in advance so that excess light does not pass through the region, and two pupil-dividing optical system shutters 12 are provided for the pupils P2 and P3 (however, these light-shielding parts). Needless to say, at least two of the two shutters may be configured as one shutter).

  In this case, if the two pupil division optical systems are driven in parallel, a pair of parallax images can be generated in parallel (that is, generated simultaneously). For example, if the respective pupil division patterns of the two systems of pupil division optical systems are set in the same manner as in the example of FIG. 2, eight parallax images in the x direction (horizontal direction) are generated by capturing four shots. Can do.

  Although the description has been given here of the case where the pupil division optical system is two systems, it goes without saying that three or more parallax images may be generated in parallel by using three or more systems.

  Further, although all of the optical system portion of the microscope system of the present embodiment is configured as a refractive type, a part or all of the optical system portion may be configured as a reflective type.

  For example, the shutter 12 has an opening 12a having a high reflectance at a part of the exit pupil of the objective lens 11, and a mask part 12b having a reflectance lower than that of the opening 12a at the other part of the pupil (the reflectance is low). A reflective mask having a mask portion 12b) that is zero and having a variable position of the opening 12a in the pupil (a variable position of the mask portion 12b in the pupil) may be used.

  As such a shutter 12, for example, a reflective mask member that can be moved or rotated, a digital mirror device (DMD) that changes a reflectance distribution in accordance with a given electric signal, and the like can be applied. If this digital mirror device is applied, not only the position of the opening 12a (the position of the mask 12b) but also the shape of the opening 12a (the shape of the mask 12b) and the reflectance of the opening 12a can be freely changed. Therefore, it can be used in the same manner as the liquid crystal element described above.

  For example, in order to control the aperture ratio of the shutter 12 (reflection mask), the combination of the size of the opening 12a and the reflectance of the opening 12a may be controlled.

  In the present embodiment, the present invention is applied to a microscope system that performs macro observation of the specimen 1. However, the present invention can also be applied to an imaging system that performs macro observation of a general subject.

  The inventions described in the above embodiments are organized and disclosed as supplementary notes.

(Appendix 1)
In order from the object side, an objective lens, a plurality of zoom imaging optical systems arranged in parallel, and an imaging device that respectively images the images of the plurality of zoom imaging optical systems are arranged, and an imaging apparatus including a control unit There,
The entrance pupils of the plurality of zoom imaging optical systems correspond to different areas of the exit pupil of the objective lens,
Each of the zoom imaging optical systems
Regardless of the zoom position of the zoom imaging optical system, keeping the entrance pupil of the zoom imaging optical system at the same pupil position,
A mask portion that attenuates incident light in a plane that intersects the optical axis of the zoom imaging optical system at the same position as the pupil position, and an opening that transmits the incident light with a higher transmittance than the mask portion And a light selection means arranged,
The control means includes
For each of the light selection means included in each of the zoom imaging optical systems, the formation position of the opening of the light selection means is moved to three or more regions in the plane,
In each of the zoom imaging optical systems, three or more parallax images related to the object are generated in a time-division manner by imaging the object with the imaging element in each of three or more states having different opening formation positions. An imaging apparatus characterized by performing control.

(Appendix 2)
In the imaging device according to attachment 1,
An imaging apparatus, further comprising suppression means for suppressing variation in brightness among the three or more parallax images.

(Appendix 3)
In the imaging device according to attachment 2,
The suppression means is
In order to suppress the variation, the charge accumulation time of the image sensor at the time of generating the three or more parallax images, the gain of the image sensor, the aperture ratio of the light selection means, the observation light traveling from the object to the image sensor At least one of the intensity of the illumination light and the intensity of the illumination light that illuminates the object.

(Appendix 4)
In the imaging device according to attachment 2,
The suppression means is
In order to suppress the variation, at least one luminance among the three or more parallax images is corrected.

(Appendix 5)
In the imaging device according to attachment 2,
The light selection means has a different opening area when the opening is formed at different positions.
The image pickup apparatus, wherein the suppression unit suppresses a variation in brightness among the parallax images so as to cancel a difference in opening area of the opening.

(Appendix 6)
In the imaging device according to any one of Appendix 1 to Appendix 5,
The control means includes
The moving direction of the opening is set in a plurality of directions.

(Appendix 7)
In the imaging device according to any one of Supplementary Notes 1 to 6,
The light selection means includes
An imaging apparatus characterized by being a liquid crystal element having a variable transmittance distribution.

(Appendix 8)
In the imaging device according to any one of Appendix 1 to Appendix 7,
An epi-illumination optical system that projects an image of a light source onto the pupil position via at least a part of the zoom imaging optical system;
The epi-illumination optical system is
An imaging apparatus, wherein a conjugate relationship between the light source and the pupil position is maintained regardless of a zoom position of the zoom imaging optical system.

DESCRIPTION OF SYMBOLS 30 ... Zoom microscope, 100 ... Controller, 200 ... Three-dimensional display, 20 ... Epi-illumination optical system, 40 ... Connection mechanism 40, 1 ... Sample, 11 ... Objective lens, 12 ... Shutter, 13 ... Afocal zoom system, 14 ... Imaging optical system, 10 ... imaging device

Claims (1)

  Invention described in the specification.

Images