WO2020161905A1

WO2020161905A1 - Microscope, control device for microscope, and program

Info

Publication number: WO2020161905A1
Application number: PCT/JP2019/004676
Authority: WO
Inventors: 智裕川崎; 良一左高; 正宏水田
Original assignee: 株式会社ニコン
Priority date: 2019-02-08
Filing date: 2019-02-08
Publication date: 2020-08-13

Abstract

A microscope comprising: a first optical system with a first optical axis that includes a shared objective lens or a first objective lens and a first imaging optical system; a second optical system with a second optical axis that includes a shared objective lens or a second objective lens and a second imaging optical system; a first imaging element that acquires an optical image focused by the first imaging optical system as a first image; a second imaging element that acquires an optical image focused by the second imaging optical system as a second image; and a control unit capable of switching between a first mode for displaying the first image on an image display device and a second mode for displaying the first image and the second image having a resolution different from the first image on the image display device as a three-dimensional display image.

Description

Microscope, microscope control device and program

The technology of the present disclosure relates to a microscope, a microscope control device, and a program.

　Microscopes are known to have various functions depending on their use. A surgical microscope also has, for example, two optical systems for the observer's right eye and left eye, and stereoscopic vision is performed by providing a parallax angle to the observation optical axis from the observation target of the two optical systems. A microscope that makes it possible is known.

　Microscopes for such applications are required to have high resolution and variable magnification in order to magnify and view not only the stereoscopic image but also the observation target image. Generally, in order to achieve high resolution, it is necessary to use a lens having a large numerical aperture, or to combine a plurality of lenses to reduce aberrations as much as possible. A zoom optical system in which a plurality of lenses are combined is used to change the magnification.

In addition, there are types of surgical microscopes that include an optical system that allows a second doctor or an assistant to observe the target, in addition to two optical systems that allow the doctor to stereoscopically observe the target.

Japanese Unexamined Patent Publication No. 2017-23583 discloses an ophthalmic microscope including an illumination system, a pair of main light receiving systems, a pair of main eyepiece systems, a control unit, a light separating element, and a pair of sub light receiving systems. Has been done.

The microscope that enables stereoscopic vision by having multiple optical systems as described above is generally expensive and large in size. Therefore, a microscope with reduced cost or size is desired.

The microscope according to this embodiment,
A first optical system having a first optical axis, including a shared objective lens or a first objective lens and a first imaging optical system;
A second optical system having a second optical axis, including the shared objective lens or the second objective lens and a second imaging optical system;
A first image sensor for obtaining an optical image formed by the first image forming optical system as a first image;
A second image sensor for acquiring an optical image formed by the second image forming optical system as a second image;
A first mode in which the first image is displayed on the image display device, and a second mode in which the first image and the second image having different resolutions from each other are displayed on the image display device as three-dimensional display images. And a control unit capable of switching between two modes.

Further, the microscope according to the present embodiment,
A first optical system having a first optical axis, including a shared objective lens or a first objective lens and a first imaging optical system;
A second optical system having a second optical axis, including the shared objective lens or the second objective lens and a second imaging optical system,
Of the first optical system and the second optical system, only the first optical system includes a zoom optical system.

Further, the microscope according to the present embodiment,
A first optical system having a first optical axis, including a shared objective lens or a first objective lens and a first imaging optical system;
A second optical system having a second optical axis, including the shared objective lens or the second objective lens and a second imaging optical system;
A third optical system having a third optical axis, including the shared objective lens or the third objective lens and a third imaging optical system,
The resolution of the first optical system is higher than the resolution of the second optical system,
The resolution of the third optical system is higher than the resolution of the second optical system.

The microscope control device according to the present embodiment,
An image acquisition unit that acquires a first image captured by the first image sensor and a second image captured by the second image sensor;
A first mode in which the first image is displayed on the image display device, and a second mode in which the first image and the second image having different resolutions from each other are displayed as three-dimensional display images on the image display device. A control unit capable of switching between two modes,
Equipped with.

The program according to this embodiment is
On the computer,
Obtaining a first image captured by the first image sensor and a second image captured by the second image sensor,
A first mode in which the first image is displayed on the image display device, and a second mode in which the first image and the second image having different resolutions from each other are displayed as three-dimensional display images on the image display device. Step to switch between 2 modes,
Is a program for executing.

It is a schematic block diagram which shows an example of arrangement which looked at the microscope which concerns on 1st Embodiment from the side surface. It is a schematic block diagram which shows an example of the arrangement which looked at the microscope which concerns on 1st Embodiment from the upper surface. It is a block diagram which shows an example of the hardware constitutions of the electric system of the microscope which concerns on 1st Embodiment. It is a block diagram which shows an example of a structure of the computer of the control part of the microscope which concerns on 1st Embodiment. It is a schematic diagram showing an example of the lens composition of the 1st optical system. It is a schematic block diagram which shows an example of the structure which can change the substantial angle of the microscope which concerns on 1st Embodiment. It is a detailed display image which displays the image of the microscope which concerns on 1st Embodiment in 1st mode. It is a stereoscopic display image which displays the image of the microscope which concerns on 1st Embodiment in 2nd mode. 6 is a variable-magnification display image for displaying an image of the microscope according to the first embodiment in a third mode. It is a schematic block diagram seen from the side of the microscope concerning the modification 1. It is a schematic block diagram seen from the side surface of the microscope which concerns on the modification 2. It is a schematic block diagram seen from the side surface of the microscope which concerns on the modification 3. It is a schematic structure figure showing an example of arrangement seen from the side of a microscope concerning a 2nd embodiment. It is a schematic structure figure showing an example of arrangement seen from the upper surface of a microscope concerning a 3rd embodiment. It is a schematic block diagram which shows an example of arrangement|positioning seen from the AA direction of FIG. FIG. 15 is a schematic configuration diagram excluding an illumination system showing an example of the arrangement viewed from the BB direction in FIG. 14. It is a block diagram which shows an example of the hardware constitutions of the electric system of the microscope which concerns on 3rd Embodiment. It is a schematic block diagram which shows an example of the structure which can change the substantial angle of the microscope which concerns on 3rd Embodiment. It is a plane layout diagram showing movement of the 2nd optical system when changing a parallax angle concerning this embodiment. It is a schematic diagram of the image obtained from each optical system of the microscope which concerns on 3rd Embodiment. It is a schematic diagram of the 1st mode image for assistants which concerns on this embodiment. It is a schematic diagram of a second mode image for an assistant according to the present embodiment. It is a schematic diagram of the 3rd mode image for assistants concerning this embodiment. It is an image schematic diagram of the 4th mode which displays a display image for surgeons on a display screen for assistants concerning this embodiment. It is a schematic diagram of a stereoscopic display image for an operator according to the present embodiment. It is a schematic diagram which installs the microscope control program from the storage medium which concerns on this embodiment.

Hereinafter, an example of an embodiment of the technology of the present disclosure will be described with reference to the drawings.
In the following description, “CCD” is an abbreviation for “Charge Coupled Device”. “CMOS” is an abbreviation for “Complementary Metal-Oxide-Semiconductor”. “OCT” is an abbreviation for “Optical Coherence Tomography”.

Also, in the following description, “CPU” is an abbreviation for “Central Processing Unit”. “I/F” refers to an abbreviation for “Interface” (interface). “HDD” is an abbreviation for “Hard Disk Drive”. “ROM” is an abbreviation for “Read Only Memory”. “RAM” is an abbreviation for “Random Access Memory”. “CD-ROM” is an abbreviation for “Compact Disc Read Only Memory”. “ASIC” is an abbreviation of “Application Specific Integrated Circuit” (application-specific integrated circuit). “FPGA” is an abbreviation for “Field-Programmable Gate Array”. “PLD” is an abbreviation for “Programmable Logic Device”. “SoC” is an abbreviation for “System on Chip”. “IC” is an abbreviation for “Integrated Circuit”. “SSD” is an abbreviation for “Solid State Drive”. “USB” is an abbreviation for “Universal Serial Bus”. “EEPROM” is an abbreviation for “Electrically Erasable Programmable Read-Only Memory”.

(First embodiment)
A microscope 100 for eye surgery according to the first embodiment will be described with reference to the drawings. In the following drawings, a housing (or a cover) for covering an optical system described later of the microscope 100 and the like is omitted unless otherwise specified. FIG. 1 shows a schematic configuration diagram of a microscope 100 including two optical systems and capable of stereoscopic vision as viewed from the lateral direction (side). FIG. 2 shows a plan configuration view of the microscope 100 viewed from above (eg, an upper side in the vertical direction). 1 and 2, for convenience, the height direction when the microscope 100 is horizontally arranged is the Z-axis direction, and the horizontal direction is the X-axis direction and the Y-axis direction. It should be noted that FIGS. 1 and 2 are schematic diagrams for showing an arrangement relationship, not according to actual dimensions and scales. The same applies to the following drawings unless otherwise specified.

As an example, as shown in FIGS. 1 and 2, the microscope 100 includes a first objective optical system 26 including a shared objective lens 12, a first zoom optical system 20, and a first imaging optical system 22. The microscope 100 includes a second optical system 36 including the shared objective lens 12 and the second imaging optical system 32. The second optical system 36 does not include a zoom optical system. The shared objective lens 12 has a role of an objective lens in the first optical system 26 and a role of an objective lens in the second optical system 36, and is a shared objective lens for the first optical system 26 and the second optical system 36. is there. The microscope 100 also includes a first illumination system 40 that illuminates the target surface 10A of the observation target 10. Although the first zoom optical system 20 and the first imaging optical system 22 will be described separately for convenience, they may be a zoom imaging optical system in which the zoom optical system and the imaging optical system are combined.

The effective aperture of the lens of the second optical system 36 closest to the shared objective lens 12 in the optical path is different from the effective aperture of the lens of the first optical system 26 closest to the shared objective lens 12. For example, the effective aperture of the lens of the second imaging optical system 32 closest to the shared objective lens 12 is different from the effective aperture of the lens of the first zoom optical system 20 closest to the shared objective lens 12. The effective aperture of the lens of the first zoom optical system 20 closest to the shared objective lens 12 is also referred to as the effective aperture of the first optical system 26. The effective aperture of the lens of the second imaging optical system 32 closest to the shared objective lens 12 is also referred to as the effective aperture of the second optical system 36. For example, when the optical magnifications of the first optical system 26 and the second optical system 36 are the same, the effective aperture of the second optical system 36 is smaller than the effective aperture of the first optical system 26. Therefore, the substantial numerical aperture of the second optical system 36 is smaller than the substantial numerical aperture of the first optical system 26. Therefore, the resolution of the second optical system 36 is lower than that of the first optical system 26.

In this specification, the level of resolution is determined based on at least one of the numerical aperture, the depth of focus, the aberration, and the material of the lens in the optical system to be compared. Further, the level of resolution may be determined based on the number of pixels of an image pickup element that acquires an optical image as an image or the presence or absence of a zoom optical system. It is determined that the larger the numerical aperture and the depth of focus are, the higher the resolution is, the smaller the various aberrations are, the higher the resolution is, and the higher the transmittance of each wavelength light is, the higher the resolution of the lens material is. Further, it is determined that the larger the number of pixels of the image sensor, the higher the resolution. Further, it is determined that the resolution with the zoom optical system is higher than that without the zoom optical system. Further, for example, in the present embodiment, the first optical system 26 and the second optical system 36 have a configuration in which the performance of the optical system or the performance of the image sensor is different from each other due to the difference in resolution as described above.

The microscope 100 forms an image by the first image-capturing device 24, which acquires the optical image of the observation target formed by the first image-forming optical system 22 as an image (for example, a first image), and the second image-forming optical system 32. And a second image sensor 34 that acquires an optical image of the observation target as an image (for example, a second image). The first image sensor 24 and the second image sensor 34 are image sensors using, for example, a CCD sensor or a CMOS sensor. The first image sensor 24 is, for example, a 4K image sensor including approximately 8,300,000 pixels having 3840 pixels×2160 pixels. The second image pickup device 34 is an HD image pickup device including, for example, 1280 pixels×720 pixels, which is approximately 920,000 pixels.

In the first embodiment, as described above, the first image sensor 24 that acquires, as the first image, the optical image formed by the first optical system 26 that has a relatively higher resolution than the second optical system 36. Uses an image sensor having a relatively large number of pixels. On the other hand, the number of pixels of the second image sensor 34 that acquires an optical image formed by the second optical system 36 having a relatively lower resolution than the first optical system 26 as the second image is relatively small. An image sensor is used. However, the invention is not limited to this, and the first image sensor 24 and the second image sensor 34 may use image sensors having the same number of pixels. The number of pixels of the first image sensor 24 and the number of pixels of the second image sensor 34 described above are merely examples, and the specific number of pixels is not limited in the technology of the present disclosure. In addition, the synchronization in the technique of the present disclosure includes that two or more signals, timings of processing, and the like match, and the timings include matching or a slight deviation in an allowable range.

As shown in FIG. 1, the first light beam 5 emitted from the target surface 10A is converted into parallel light by the shared objective lens 12 of the afocal system along the first optical axis OL1 and enters the first deflection mirror 14. .. The first light flux 5 along the first optical axis OL1 is also simply referred to as the light of the first optical axis OL1. The same applies to light beams along other optical axes. The first deflection mirror 14 is an example of a first deflection element according to the technique of the present disclosure. The first light flux 5 that has entered the first deflection mirror 14 is deflected from the Z direction to the minus X direction, further passes through the first diaphragm 16, and reaches the first half mirror 15. The total amount of the first light flux 5 that has reached the first half mirror 15 is deflected in the Y direction as shown in FIG. 2, and is guided to the first zoom optical system 20. The first light flux 5 that has passed through the first zoom optical system 20 is imaged by the first imaging optical system 22 on the imaging surface of the first imaging device 24, and is imaged by the first imaging device 24.

On the other hand, as shown in FIG. 1, the second light beam 6 emitted from the target surface 10A is converted into parallel light by the shared objective lens 12 along the second optical axis OR1, and passes through the second diaphragm 17 to the second light beam. It is guided to the imaging optical system 32. The second light flux 6 is imaged and imaged by the second imaging optical system 32 on the imaging surface of the second imaging element 34. The microscope 100 does not have a zoom optical system in the second optical system 36.

The afocal system is a system in which the first light flux 5 and the second light flux 6 emitted from the target surface 10A at the focal position become parallel light that neither converges nor diverges. Alternatively, the afocal system is a system in which the first optical axis OL1 and the second optical axis OR1 are parallel to each other. By making the imaging side from the shared objective lens 12 an afocal system, the bending design of the light of the first optical axis OL1 of the first optical system 26 and the arrangement of optical elements such as a lens, a polarizing element, a half mirror and/or a diaphragm. Design becomes easy. Further, as will be described later, the configuration for changing the parallax angle between the first optical system 26 and the second optical system 36 becomes easy.

The first illumination system 40 includes a first illumination light source 41 and a first light source optical system 42. The illumination light emitted from the first illumination light source 41 is collimated by the first light source optical system 42 and reaches the first half mirror 15 along the illumination optical axis LA. The illumination light that has reached the first half mirror 15 passes through the first half mirror 15 and travels backward along the path of the first light flux 5 along the first optical axis OL1. The illumination light reaches the target surface 10A through the first deflection mirror 14 and the shared objective lens 12 and illuminates the target surface 10A. The first illumination light source 41 is, for example, a transillumination light source that illuminates and reflects the retina via the pupil of the eyeball and uses the reflected light as illumination light. In this case, the illuminated target surface 10A is the anterior segment. The first illumination light source 41 may include, for example, an optical fiber that carries light from the light source.

Note that, although only the first illumination system 40 is illustrated in FIG. 1, in addition to the first illumination system 40, an oblique illumination system (not shown) for illuminating the posterior segment may be provided. The oblique illumination system is an illumination system that illuminates the posterior segment or the fundus from the outside of the transillumination illumination through the pupil. When an oblique illumination system is provided, a front lens is detachably arranged on the observation target side of the shared objective lens 12 so that the posterior eye can be focused.

Also, a near infrared light irradiation system (not shown) for the optical coherence tomography (OCT) may be provided. This makes it possible to obtain the tomographic image of the fundus using OCT while directly observing the fundus and to confirm the presence or absence of a lesion.

By introducing the illumination light from the first half mirror 15 that changes the direction of the first optical axis OL1, the first optical axis OL1 (or the optical path of the first optical axis OL1) and the illumination optical axis LA (or the illumination optical axis LA). (Optical path) can be matched, and the degree of freedom of arrangement is improved. Although the first deflecting mirror 14 is movable as will be described later, since the moving direction of the first deflecting mirror 14 coincides with the direction of the illumination optical axis LA, even if the first deflecting mirror 14 moves, the illumination system is moved. Need not be moved. The microscope 100 does not have a light source that illuminates the target surface 10A via the second optical system 36. Since the eye that is the observation target 10 is illuminated only with the illumination light from the first illumination light source 41, the influence of the illumination light on the eye can be reduced.

The first image of the observation target 10 based on the first light flux 5 captured by the first image sensor 24 is used as an image for the left eye, for example. The second image of the observation target 10 based on the second light flux 6 captured by the second image sensor 34 is used, for example, as an image for the right eye. Other methods of using the first image and the second image will be described later.

As an example, as shown in FIG. 3, the microscope 100 includes the above-described optical element, the control unit 90, the image transmission unit 60, and the input unit 140. The control unit 90 includes an image processing unit 50, an image selection unit 55, an output I/F 56, an input I/F 57, a first deflection mirror driving unit 81, a second imaging optical system driving unit 82, and a second imaging optical system driving unit 82. It includes a 1-zoom optical system drive unit 84, a first illumination light source drive unit 86, a computer 110, and an external I/F 130. These are connected to the bus line 120.

The first image captured by the first image sensor 24 and the second image captured by the second image sensor 34 are acquired by the computer 110 via the input I/F 57 as electrical image signals, and the RAM 114 described below is used. Memorized in. The computer 110 is an example of an image acquisition unit according to the technique of the present disclosure. The image processing unit 50 performs image processing on the stored first image and second image. The image selection unit 55 selects an image to be displayed on the image display device 70. The output I/F 56 is an interface between the image transmission unit 60 and the control unit 90. The input I/F 57 is an interface between the input unit 140, the first image sensor 24, the second image sensor 34, and the control unit 90. The first deflection mirror drive unit 81 drives the first deflection mirror 14. The second imaging optical system drive unit 82 drives together the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34. The first zoom optical system drive unit 84 moves the lens group of the first zoom optical system 20 in the optical axis direction to change the magnification. The first illumination light source drive unit 86 turns on and off the first illumination light source 41, adjusts the light source intensity, and the like. The external I/F 130 is an interface for connecting an external device (not shown). Examples of the external device include a personal computer, a USB memory, an SSD, a server, and the like.

The image selection unit 55 selects a display image for the left eye which is observed by the user from the first image and the second image which have been image-processed according to the observation mode set by the observer, that is, the plurality of observation modes. Select the display image for the right eye. The selected display image for the left eye and the selected display image for the right eye are transmitted to the image display device 70 by the image transmission unit 60 via the output I/F 56. The image display device 70 displays the display image for the left eye on the left side of the screen, and the display image for the right eye on the right side of the screen, for example. The position for displaying each image is not limited to the left side and the right side of the screen of the image display device 70, but for convenience, the display image for the left eye is also referred to as the left image and the display image for the right eye is also referred to as the right image. For example, in the case where each image is displayed alternately on the screen in a striped pattern or when each image is displayed on the upper side and the lower side of the screen, the display image for the left eye is displayed for convenience. The left image and the display image for the right eye are also referred to as the right image. In the present embodiment, the first image is selected as the left image and the second image is selected as the right image, but the present invention is not limited to this. Details of the image processing unit 50, the first deflection mirror driving unit 81, and the second imaging optical system driving unit 82, and details of the observation mode will be described later.

The user uses the input unit 140 to make various settings regarding the observation of the observation target 10 and operate the microscope 100. The input unit 140 is, for example, a keyboard, various switches, a touch panel, a voice input microphone, and/or a foot pedal. For example, the user sets the observation mode, adjusts the magnification of the image, adjusts the light source intensity, changes the substantial angle, and the like via the input unit 140. The input information is acquired by the computer 110 via the input I/F 57. The computer 110 controls each part based on the input information.

As an example, as illustrated in FIG. 4, the computer 110 includes a CPU 112, a RAM 114, and a ROM 116, and the CPU 112, the RAM 114, and the ROM 116 are connected to the bus line 120. The CPU 112 controls the entire microscope 100. The RAM 114 is a volatile memory used as a work area or the like when executing various programs. The ROM 116 is a non-volatile memory that stores a microscope control program 118 that controls basic operations of the microscope 100, various parameters, and the like. Although the first CPU 112 is illustrated in the first embodiment, it is also possible to use a plurality of CPUs.

The ROM 116 stores a microscope control program 118. The microscope control program 118 is an example of a “program” according to the technique of the present disclosure. In the first embodiment, the example in which the microscope control program 118 is stored in the ROM 116 is given, but the technique of the present disclosure is not limited to this. For example, the microscope control program 118 may be stored in an HDD, an EEPROM, a flash memory or the like (not shown) connected to the bus line 120.

The CPU 112 reads the microscope control program 118 from the ROM 116 and expands the read microscope control program 118 in the RAM 114. Then, the CPU 112 executes the microscope control program 118, and as an example, the image processing unit 50, the image selection unit 55, the first deflection mirror drive unit 81, the second imaging optical system drive unit 82, and the second image formation optical system drive unit 82 shown in FIG. It operates as the 1-zoom optical system drive unit 84 and the first illumination light source drive unit 86.

Returning to FIG. 1 and FIG. 2, the first zoom optical system 20 and the first imaging optical system 22 are incident with the light of the first optical axis OL1 deflected by the first deflection mirror 14 and the first half mirror 15. They are sequentially arranged along the Y-axis direction (eg, horizontal direction). With this configuration, the size of the portion of the first image pickup device in the microscope 100 in the thickness direction (eg, Z-axis direction, vertical direction) can be reduced.

As mentioned above, the effective aperture of the second optical system 36 is smaller than the effective aperture of the first optical system 26. Further, the second optical system 36 does not have a zoom optical system. That is, of the first optical system 26 and the second optical system 36, only the first optical system 26 has a zoom optical system. With such a configuration, the size of the second optical system 36 can be designed compactly. Therefore, the size of the microscope 100 can be made smaller than that of a microscope including two first optical systems 26 for both eyes, and the manufacturing cost can be reduced.

The shared objective lens 12 is described as being composed of one lens in FIG. 1, but may be composed of a plurality of lenses in combination. Similarly, each of the first zoom optical system 20, the first imaging optical system 22, the second imaging optical system 32, and the first light source optical system 42 is composed of one or more lenses.

As an example, as shown in FIG. 5, the first zoom optical system 20 is composed of four lenses. The four lenses are the first lens 20A, the second lens 20B, the third lens 20C, and the fourth lens 20D from the side closer to the shared objective lens 12. The first lens 20A is a lens that substantially determines the numerical aperture of the first optical system 26. As shown by the arrows, the second lens 20B and the third lens 20C determine the magnification of the first zoom optical system 20 by changing their positions in conjunction with each other. The second lens 20B moves in one direction along the optical axis from the lowest magnification to the highest magnification. The zoom cam is configured such that the moving direction of the third lens 20C is reversed during the magnification change.

As shown in FIG. 1, the first optical axis OL1 and the second optical axis OR1 form a parallax angle of the real angle R1 at the position of the observation target 10. By having this parallax angle, when the user simultaneously views the first image and the second image with the left eye and the right eye respectively, they are viewed as a stereoscopic image. Note that the parallax angle is also referred to as a body angle. The first image and the second image obtained from the respective light fluxes that have passed through the two optical axes having the substantial angle at the position of the observation target 10 by the two optical systems are also referred to as parallax images. For example, the first image obtained by the first optical system 26 and the second image obtained by the second optical system 36 form a parallax image. In other words, in order to form a parallax image, the optical axis of the first optical system 26 and the optical axis of the second optical system 36 are configured to have a parallax angle.

As an example, as shown in FIG. 6, the first deflecting mirror 14 is driven by the first deflecting mirror driving unit 81 so as to move along the parallax direction in which parallax is desired (in this case, the X-axis direction). In other words, the first deflection mirror 14 is movable in a direction that changes the substantial angle formed by the first optical axis OL1 and the second optical axis OR1 at the position of the observation target 10.

Further, at least one optical element of the second optical system 36 is movable in a direction in which the substantial angle R1 formed by the first optical axis OL1 and the second optical axis OR1 at the position of the observation target 10 is changed. Specifically, the second diaphragm 17, the second image forming optical system 32, and the second image sensor 34 are driven by the second image forming optical system driving unit 82 to generate a parallax direction (in this case, the X-axis direction). Is driven to move integrally along. That is, the second diaphragm 17, the second imaging optical system 32, and the second imaging element 34 are arranged in a direction in which the substantial angle R1 formed by the first optical axis OL1 and the second optical axis OR1 at the position of the observation target 10 is changed. Can be moved.

FIG. 6 shows that the first deflecting mirror 14 has moved from the position indicated by the dotted line in the X direction to the position indicated by the first deflecting mirror 14 indicated by the solid line. Although the first diaphragm 16 does not move in FIG. 6, the first diaphragm 16 may move in conjunction with the first deflection mirror 14. Similarly, it shows that the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 are integrally moved in the minus X direction from the position indicated by the dotted line and moved to the positions indicated by the solid lines.

In the example shown in FIG. 6, the first optical axis OL1 shown by the dotted line moves to the position of the optical axis OL2 shown by the dashed line, and the second optical axis OR1 shown by the dotted line moves to the position of the optical axis OR2 shown by the dashed line. ing. As a result, the actual angle R2 formed by the optical axis OL2 and the optical axis OR2 is the actual angle R1 before the first deflection mirror 14, the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 are moved. Will be smaller than. When the first deflection mirror 14, the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 are moved in the opposite directions, the substantial angle R2 becomes large.

By changing the real angle in this way at a predetermined timing or for each user, the stereoscopic effect of the observation target 10 seen by the user can be changed. With this configuration, it is possible to adjust the stereoscopic angle at which the user can obtain an optimal stereoscopic effect depending on the state of the observation target 10, the illumination conditions, the purpose of use, and the like.

The image processing unit 50 is configured to obtain an optimum stereoscopic image when the user views the first image captured by the first image sensor 24 and the second image captured by the second image sensor 34 with both eyes. Image processing. Specifically, the image processing unit 50 adjusts the electronic zoom magnification so that the magnification of the first image and the magnification of the second image are aligned. “Matching the same magnification” means that the magnifications are about the same, but not only the magnifications are completely the same, but the magnifications are not so large when the user sees the first image and the second image. Includes magnification. "Same magnification" is also referred to as "substantially the same magnification". By matching the magnifications of the two images, the two images are adjusted to a magnification integrated with each other (integration magnification).

As described above, the first image is used as an image for the left eye, and the second image is used as an image for the right eye, for example. The first optical system 26 has the first zoom optical system 20, but the second optical system 36 has no zoom optical system. Therefore, when the first zoom optical system 20 is driven to change the magnification of the first image, the optical magnification of the image differs between the first image and the second image. Therefore, the image processing unit 50 electronically enlarges or reduces the second image, and the magnification of the second image is adjusted to the magnification of the optically enlarged first image. The process of electronically enlarging or reducing an image is also referred to as electronic zoom.

As for the method of matching the optical zoom magnification with the electronic zoom magnification, it is also possible to set the optical zoom magnification and the electronic zoom magnification individually and match them. However, when the optical zoom magnification of the first image is set by the user, the electronic zoom magnification of the second image is adjusted by the control unit 90 (or the image processing unit 50) based on the magnification of the first image. It is preferable. Alternatively, it is preferable that the electronic zoom magnification of the second image is adjusted in association with the magnification of the first image. Adjusting the magnification of the second image based on the magnification of the first image includes adjusting the visual field range of the first image and the visual field range of the second image so as to be approximately the same.

As an example, the image processing unit 50 adjusts the electronic zoom magnification of the second image in association with the optical magnification change of the first image by the first zoom optical system 20. That is, the image processing unit 50 adjusts the electronic zoom magnification so as to be substantially the same as the optical magnification achieved by the first zoom optical system 20. As a result, a stereoscopic image with a changed magnification can be observed with binocular vision without a sense of discomfort. Therefore, as compared with the case where zoom optical systems are provided in both the first optical system 26 and the second optical system 36, stereoscopic viewing can be performed with a resolution that does not change so much, and manufacturing cost and size can be reduced. ..

The image processing unit 50 may electronically enlarge or reduce the first image. Thereby, for example, the first image and the second image can be magnified more than the magnifying power of the first zoom optical system 20. On the contrary, the first image and the second image can be reduced to be smaller than the minimum magnification of the first zoom optical system 20. As a result, the user can perform stereoscopic viewing with a magnification in a range exceeding the magnification range of the first zoom optical system 20.

The method of changing the electronic magnification in association with the change of the optical magnification by the first zoom optical system 20 is to detect the magnification of the first zoom optical system 20 set by the user and set the electronic zoom magnification to the first value. It suffices to match the magnification of the zoom optical system 20. The user inputs the magnification of the first zoom optical system 20 via the input unit 140. The user's magnification input method is to enter a numerical value using a keyboard, select a preset magnification, or change the magnification continuously with a lever or dial to change the desired magnification position. There is a method to stop at.

Alternatively, the magnification (eg, the magnification of the first zoom optical system 20) may be calculated by detecting the position of a specific lens of the first zoom optical system 20, and the magnification of the electronic zoom may be adjusted to that. The specific lens is a lens whose position uniquely corresponds to the magnification of the first zoom optical system 20, and corresponds to, for example, the second lens 20B in FIG. A table or a functional expression that associates a specific lens position with the magnification of the first zoom optical system 20 is stored in advance in the ROM 116, and the magnification can be calculated from the position of the lens or the rotation speed of the drive motor.

Also, as a method of changing the electronic magnification in association with the change of the optical magnification by the first zoom optical system 20, a method of adjusting the magnification by image analysis may be used. For example, when the magnifications of the first image and the second image are relatively close to each other, similar-shaped objects are detected from the first image and the second image, and the similar-sized objects are made equal in size. 2 Enlarge or reduce the image with electronic zoom. When the first image and the second image have a large difference in magnification and a similar shape cannot be found, the electronic zoom magnification is changed until a similar shape is detected in both the first image and the second image. After detecting a similar shape, the magnification is adjusted by the above method.

For example, in the first embodiment, since the effective aperture of the second optical system 36 is smaller than the effective aperture of the first optical system 26, the first image is relatively bright and the second image is relatively dark. In such a case, the image processing unit 50 performs brightness adjustment, white balance adjustment, RGB correction, and the like of the first image and the second image to make the brightness of the first image and the second image uniform. Further, the image processing unit 50 may adjust the orientations of the two images (eg, the first image and the second image) displayed on the image display device 70 so that they are oriented in a predetermined direction for the user. ..

The image transmitting unit 60 transmits the first image and the second image processed by the image processing unit 50 to the image display device 70. In the first embodiment, the image transmitter 60 is, for example, an image transmitter for wirelessly transmitting an image. It is also possible to transmit the image by wire, and in that case, the image transmission unit 60 includes an output unit such as an output terminal for image transmission.

The image display device 70 displays, for example, the first image and the second image. In particular, the image display device 70 can display the first image and the second image so that they can be viewed stereoscopically. In the technology of the present disclosure, the type of the image display device 70 that enables stereoscopic observation is not limited, and a known display device that allows stereoscopic viewing can be used.

For example, the image display device 70 is a head-mounted display that can be worn on the head or face. The head-mounted display has, for example, two independent display screens for the right eye and the left eye (or a display screen in which an image is displayed in space), and each of the two screens has an image for the right eye and an image for the right eye. Display the image for the left eye. By displaying two images having a substantial angle, a stereoscopic effect can be generated in the displayed image.

Further, the image display device 70 may be a head-mounted display that alternately displays a frame image for the left eye and a frame image for the right eye. This type of display device alternately displays a first image for the left eye and a first image for the right eye at high speed, and displays a shutter for the right eye and a shutter for the left eye in accordance with the display of each image. Open and close alternately. The shutter for the right eye is closed while the first image for the left eye is displayed, and the shutter for the left eye is closed while the second image for the right eye is displayed. By this method, the user can see the first image and the second image with the left eye and the right eye, respectively, and stereoscopic vision is realized.

The image display device 70 may be a display device having one flat liquid crystal display screen. The image display device 70 alternately displays an image for the right eye and an image for the left eye for each scanning line, for example. On the screens of the scanning lines of the image for the right eye and the scanning lines of the image for the left eye, polarizing plates having opposite polarization directions are provided. The user has a polarizing filter having the same polarization direction as the polarizing plate provided on the scanning line for the right eye on the right side and a polarizing filter having the same polarization plane as the polarizing plate provided on the scanning line for the left eye on the left side. Wear glasses to observe the image.

The image display device 70 may be a display device using a lenticular lens in which a large number of cylindrical lenses are arranged. The lenticular display device displays an image for the right eye and an image for the left eye for each pixel line. Then, the display device displays the displayed right-eye image and left-eye image in the right-eye direction and the left-eye direction by the cylindrical lens arranged for each pixel line. When using a lenticular display device, there is an advantage that it is not necessary to wear polarized glasses. Further, the image display device 70 may use a parallax barrier type image display device as an image display device capable of stereoscopic vision with the naked eye. The parallax barrier system is a system in which different pixels are visible to the left and right eyes of an observer. Specifically, for example, a shield plate having a hole or a groove for every two left and right pixels is arranged in front of the display pixel. As a result, the right eye sees only the image for the right eye, and the left eye sees only the image for the left eye. Since the image for the right eye and the image for the left eye have a parallax angle, binocular parallax can be created with the naked eye.

When the image display device 70 is a head-mounted display, the image display device 70 is a device separate from the microscope 100. However, when the image display device 70 is of a type having a flat liquid crystal display screen, the image display device 70 may be configured as a microscope system integrated with the microscope 100. In this case, it is preferable to reduce the dimension of the microscope 100 in the Z-axis direction and arrange the image display device 70 above the first optical system 26 and the second optical system 36. Accordingly, the layout design can be performed so that the image display device 70 is arranged in front of the user.

In the above description, the image display device 70 is described as being controlled or operated independently of the microscope 100. However, the image display device 70 may be controlled by the control unit 90 of the microscope 100.

The control unit according to the first embodiment acquires, for example, a first image captured by the first image sensor and a second image captured by the second image sensor, a first image, and a second image. Among them, a first mode in which the first image is displayed on the image display device 70 and a second image in which the resolution of the first image and the first image are different from each other are three-dimensional display images (for example, stereoscopic image capable of stereoscopic viewing, parallax). It is possible to switch between the second mode in which the image is displayed on the image display device 70 as an image.

For example, in the microscope 100, the user can select and set the observation mode. Specifically, the user can set the first mode which is the detailed observation mode, the second mode which is the stereoscopic observation mode, and the third mode which is the variable magnification observation mode. The image selection unit 55 selects and combines the left-eye image and the right-eye image from the first image and the second image based on the observation mode set by the user.

For example, when the user selects the first mode, the image selection unit 55 selects the first image 72 having a relatively high resolution as the image for the left eye and the image for the right eye, as shown in FIG. 7, for example. To do. In this case, the observed image does not become a stereoscopic image because there is no substantial angle, but there is an advantage that the user can see a relatively high-resolution image with both eyes. This is suitable when the observation target 10 is enlarged and viewed at high resolution.

Note that stereoscopic viewing is not performed in the first mode, so it is not necessary to display the same first image 72 as the image for the left eye and the image for the right eye on the two image display surfaces. You may display one 1st image 72 on an image display surface, and it may be viewed with both eyes.

When the user selects the second mode, the image selection unit 55 selects the first image 72 for the left eye and the second image 73 for the right eye, as shown in FIG. 8, for example. In addition, in FIG. 8, the second image 73 is schematically represented as an image having a lower resolution than the first image 72. In this case, the user can see the stereoscopic image of the observation target 10. At this time, the user can adjust the stereoscopic effect by adjusting the stereoscopic angle. In the second mode, the control unit 90 forms a parallax image with the first image 72 obtained by the first optical system 26 and the second image 73 obtained by the second optical system 36. In the second mode, the control unit 90 causes the image display device 70 to display the second image 73 in synchronization with the display timing of the first image 72. Although the second image 73 has a lower resolution than the first image 72 in the present embodiment, the first image 72 may have a lower resolution than the second image 73.

Further, when the user selects the third mode, the image selection unit 55 selects the second image 73 having a relatively low resolution as the image for the right eye and the image for the left eye, as shown in FIG. 9, for example. .. In this case, although the resolution of the observed image is relatively low, there is an advantage that the user can quickly zoom and observe the image from low magnification to high magnification by the electronic zoom. Note that, in FIGS. 7 to 9, the left-eye image and the right-eye image are arranged side by side for the sake of clarity, but as described above, the left-eye image and the right-eye image are not necessarily shown. It does not have to be displayed on the left and right sides of the screen at the same time. The image for the left eye and the image for the right eye are appropriately displayed according to the method of the display device.

Note that since the third mode does not perform stereoscopic vision, it is not always necessary to display the same second image 73 as images for the left eye and the right eye on the two image display surfaces. One second image 73 may be displayed on the image display surface so that it can be viewed with both eyes.

The microscope 100 having the above-described configuration has two optical systems having different configurations such as resolution, thereby providing a microscope capable of stereoscopic viewing and suppressing cost and size. Specifically, the effective aperture of the second optical system is smaller than the effective aperture of the first optical system 26. Therefore, while the microscope 100 is capable of stereoscopic viewing, the manufacturing cost and size can be suppressed as compared with the configuration in which the effective diameters of the two optical systems are the same. Further, the microscope of this embodiment can display an image obtained from two optical systems by a plurality of display methods (image display methods).

Also, in the conventional microscope, the optical system for the right eye and the optical system for the left eye have the same configuration and are used only for stereoscopic viewing. In contrast, the microscope 100 according to the first embodiment has the first zoom optical system 20 only in the first optical system 26, the second optical system 36 does not have the zoom optical system, and the first optical system 26 does not. It has a simpler configuration. The first image can be used as a left-eye image, the second image can be used as a right-eye image for stereoscopic viewing, and the first image can be used as a left-eye image and a right-eye image. Alternatively, the second image can be used as an image for the left eye and an image for the right eye. With this configuration, the user can set a plurality of observation modes.

The microscope 100 having such a configuration enables stereoscopic viewing and can reduce the manufacturing cost and size as compared with the configuration including the zoom optical system on both sides. Further, in addition to the stereoscopic observation mode, it is possible to select a detailed observation mode or a variable magnification observation mode. Further, by using an image sensor having a smaller number of pixels than the first image sensor 24 as the second image sensor 34, the manufacturing cost can be further reduced.

(Modification 1)
In the above-described first embodiment, the light of the optical axis OL1 is deflected in two directions (eg, the X-axis direction and the Y-axis direction) by using the first deflection mirror 14 and the first half mirror 15, and the first zoom optical The system 20 and the first imaging optical system 22 are arranged along the Y-axis direction. As a result, the size of the microscope 100 in the Z-axis direction, that is, the height can be reduced. However, like the microscope 100A shown in FIG. 10, without using the first deflection mirror 14, the first zoom optical system 20 and the first imaging optical system 22 are moved in the same Z-axis direction as the second imaging optical system 32. You may arrange in line. According to the first modification, the size of the microscope 100 in the Y-axis direction, that is, the lateral direction can be reduced. The first half mirror 15 is used to guide the illumination light from the first illumination light source 41 to the target surface 10A along the first optical axis OL1. Other configurations are the same as those in the first embodiment.

Further, instead of aligning the first zoom optical system 20 and the first image forming optical system 22 in the same Z direction as the second image forming optical system 32, a deflecting element is used to form the second image forming optical system 32 and the second image pickup device. 34 may be aligned in the same Y direction as the first zoom optical system 20 and the first imaging optical system 22 (not shown). In this modification, the size of the microscope 100 in the Z-axis direction, that is, the height can be further reduced.

(Modification 2)
In the above-described first embodiment, the optical image of the target surface 10A is acquired as an image using the first image sensor 24 and the first image sensor 34. Then, the user observes the captured image using the image display device 70. However, the optical image may be directly observed without using the first image sensor 24 and the first image sensor 34. For example, like the microscope 100B shown in FIG. 11, the first zoom optical system 20 and the first imaging optical system 22 are arranged in the same direction as the second imaging optical system 32 without using the first deflection mirror 14. To do. Then, the first eyepiece lens 23 is arranged in the first image formation optical system 22, and the second eyepiece lens 33 is arranged in the second image formation optical system 32. In this case, an erecting prism or the like is arranged so that the image viewed through the eyepiece is erect (not shown). According to this modification 2, the size of the microscope 100B in the Y-axis direction can be reduced. Further, the microscope 100B does not need to include the image display device 70. Further, the eyepiece lens and the image pickup device may be exchangeable by adding an exchange adapter for the device.

(Modification 3) In the above-described first embodiment, the objective lens of the first optical system 26 and the objective lens of the second optical system 36 use the shared objective lens 12 that also serves as both. However, as shown in FIG. 12, the microscope 100C may be provided with a first objective lens 45 dedicated to the first optical system 26 and a second objective lens 46 dedicated to the second optical system 36 instead of the shared objective lens 12. .. That is, the first objective lens 45, the first zoom optical system 20, and the first image forming optical system are included in the first optical system 26. The second objective lens 46 and the second imaging optical system 32 are included in the second optical system 36. In this case, the effective aperture of the first optical system 26 is the effective aperture of the first objective lens 45, and the effective aperture of the second optical system 36 is the effective aperture of the second objective lens 46. Other configurations are the same as those in the first embodiment.

According to the third modification, the microscope 100C does not need to have the relatively large-sized shared objective lens 12, and can use the relatively small first objective lens 45 and the second objective lens 46. In this configuration, for example, the entire element from the first objective lens 45 to the first imaging element 24 is moved in the direction of arrow W1 with the observation target 10 as the center. In addition, the entire element from the second objective lens 46 to the second image pickup element 34 is moved in the direction of the arrow W2 around the observation target 10. By doing so, the microscope 100C can change the body angle R1.

(Modification 4)
In the above-described first embodiment, the effective aperture of the first optical system 26 and the effective aperture of the second optical system 36 are different. However, in the microscope of this embodiment, the effective aperture of the first optical system 26 and the effective aperture of the second optical system 36 may be the same. Even if the second optical system 36 does not have a zoom optical system, if the effective aperture of the second optical system 36 is the same as the effective aperture of the first optical system 26, it is easy to obtain an image with uniform brightness. Also in each of the modified examples described above, the same effects as the basic effects described in the first embodiment can be obtained.

(Second embodiment)
Next, a second embodiment will be described with reference to the drawings. The same elements as those in the first embodiment are designated by the same reference numerals, and detailed description thereof will be omitted. As shown in FIG. 13, a microscope 200 for ophthalmologic surgery includes a shared objective lens 12, a first imaging optical system 222, a first imaging element 224, a second imaging optical system 32, and a second imaging element. 34 and 34. The microscope 200 also includes a first half mirror 15, a first diaphragm 16, a second diaphragm 17, and a first illumination system 40.

The shared objective lens 12 and the first imaging optical system 222 constitute a first optical system 226, and the shared objective lens 12 and the second imaging optical system 32 constitute a second optical system 36. The first imaging optical system 222 and the second imaging optical system 32 have substantially the same optical configuration. Neither the first optical system 226 nor the second optical system 36 has a zoom optical system. Therefore, the optical resolutions of the first optical system 226 and the second optical system 36 are the same.

The observation light for the left eye emitted from the target surface 10A is converted into parallel light by the common objective lens 12 along the first optical axis OL1, passes through the diaphragm 16, and is incident on the first half mirror 15. The observation light that has entered the first half mirror 15 passes through the first half mirror 15, and is then imaged on the imaging surface of the first imaging element 224 by the first imaging optical system 222, so that the optical image of the target surface 10A is 1 image pickup element 224.

On the other hand, the observation light for the right eye emitted from the target surface 10A is converted into parallel light by the common objective lens 12 along the second optical axis OR1, and passes through the second diaphragm 17 to the second imaging optical system 32. Be led to. Then, the observation light is imaged on the imaging surface of the second imaging element 34 by the second imaging optical system 32, and the optical image of the target surface 10A is acquired by the second imaging element 34.

Here, the number of pixels of the first image sensor 224 is about 3840 pixels×2160 pixels, about 8.3 million pixels, and the number of pixels of the second image sensor 34 is about 1280 pixels×720 pixels, about 920,000 pixels. Thus, in the second embodiment, the number of pixels of the first image sensor 224 and the number of pixels of the second image sensor 34 are different. Note that the number of pixels of the first image sensor 224 and the number of pixels of the second image sensor 34 described above are examples, and it is sufficient that the numbers of pixels of the two are different, and in the technique of the present disclosure, specific pixels of each. The number is not limited.

The first image acquired by the first image sensor 224 having a large number of pixels has a relatively high resolution compared to the second image, and the second image acquired by the second image sensor 34 having a small number of pixels is the first image. The resolution is relatively low compared to one image. The image processing unit 50 is capable of enlarging and reducing the first image and the second image by electronic zoom, respectively. However, it is preferable that the first image and the second image are scaled up and down in association with each other so that the first image and the second image have the same scale.

The first illumination system 40 is the same as in the first embodiment. The illumination light emitted from the first illumination light source 41 is collimated by the first light source optical system 42 and enters the first half mirror 15 along the illumination optical axis LA. The illumination light that has entered the first half mirror 15 is deflected by the first half mirror 15 and enters the target surface 10A via the shared objective lens 12 along the first optical axis OL1.

In the microscope 200, at least one optical element of the second optical system 36 moves in a direction (parallax direction) that changes the substantial angle R1 formed by the first optical axis OL1 and the second optical axis OR1 at the position of the observation target 10. It is possible. Specifically, the second diaphragm 17, the second imaging optical system 32, and the second image pickup device 34 are integrally driven by the second imaging optical system driving unit 82 so as to move along the X axis. It That is, the second diaphragm 17, the second imaging optical system 32, and the second imaging element 34 are arranged in a direction in which the substantial angle R1 formed by the first optical axis OL1 and the second optical axis OR1 at the position of the observation target 10 is changed. Can be moved. By making the body angle R1 changeable, the body angle R1 can be adjusted so that the user can obtain the most appropriate stereoscopic effect.

The control unit of the microscope 200 has the same configuration as the control unit 90 of the first embodiment shown in FIG. 3 except that it does not have the first deflection mirror drive unit 81 and the first zoom optical system drive unit 84. The configuration of the image display device 70 is similar to that of the first embodiment.

The microscope 200 can display a combination of the first image and the second image on the image display device 70 based on the above-described observation mode set by the user. For example, when the user sets the first mode which is the detailed observation mode, the image selection unit 55 selects the first image as an image for the left and right eyes. The displayed image is not a stereoscopic image, but the user can see a high resolution image.

Further, when the user sets the second mode which is the stereoscopic observation mode, the image selection unit 55 selects the first image and the second image as the images for the left eye and the right eye. The user can observe the object as a stereoscopic image by viewing this with both eyes. That is, in the second mode, the parallax image is formed by the first image 72 obtained by the first optical system 226 and the second image 73 obtained by the second optical system 36.

Further, when the user sets the third mode which is the variable magnification observation mode, the image selection unit 55 selects the second image as the image for the left and right eyes. Although the user has a low-resolution image, the user can quickly zoom in and view an image from low magnification to high magnification by electronic zoom.

According to the microscope 200 of the second embodiment having the above configuration, the number of pixels of the first image sensor 224 is about 8.30 million pixels, and the number of pixels of the second image sensor 34 is about 920,000 pixels. Therefore, the manufacturing cost can be suppressed as compared with the case where the image pickup device having approximately 8.30 million pixels is used for both the first image pickup device 224 and the second image pickup device 34.

Also, the user can observe a stereoscopic image by viewing the first image and the second image displayed on the image display device with both eyes. Further, the first image can be used as a binocular image, or the second image can be used as a binocular image. With this configuration, a plurality of observation modes can be set.

(Modification 5)
The modified example or the alternative configuration described in the first embodiment can also be applied to the microscope 200 in the second embodiment. For example, in the above microscope 200, the first optical system and the second optical system do not have a zoom optical system. However, the microscope 200 may include a zoom optical system (not shown) in the first optical system. With this configuration, the microscope 200 can further increase the optical resolution of the first optical system. That is, the optical resolution of the microscope 200 can be substantially increased.

(Modification 6)
In the example of the microscope 200 described above, the first optical system 226 and the second optical system 36 are arranged along the Z-axis direction. However, in the technique of the present disclosure, the orientation of the arrangement of the first optical system 226 and the second optical system 36 is not limited. The two optical systems may be arranged along the Y-axis direction by using deflection elements (not shown). In this case, the microscope 200 can reduce the size of the microscope 200 in the Z-axis direction.

(Modification 7)
In the example of the microscope 200 described above, the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 are moved to change the substantial angle R1. Instead of or in addition to this, the microscope 200 may move the optical axis OL1 of the first optical system 226 to change the substantial angle R1. For example, as shown in FIG. 6, the first deflection mirror 14 and the first half mirror 15 are combined to deflect the light of the first optical axis OL1, and the first deflection mirror 14 is moved to change the substantial angle R1. can do. Alternatively, the microscope 200 may be configured such that the first half mirror 15, the first diaphragm 16, the first imaging optical system 222, and the first image sensor 224 are moved as a unit so that the substantial angle R1 can be changed.

(Third Embodiment)
Next, a microscope 300 for eye surgery according to the third embodiment will be described with reference to the drawings. As an example, as shown in FIGS. 14 to 16, the microscope 300 has a structure in which another observation optical system is added to the microscope 100 of the first embodiment. The microscope 300 is a microscope that allows an operator (doctor) and an assistant to stereoscopically observe the observation target 10. As shown in FIG. 14, the operator observes from the direction of arrow DA, and the assistant observes from the direction of arrow DB.

Specifically, the microscope 300 includes a first optical system 26 including a shared objective lens 12, a first zoom optical system 20, and a first imaging optical system 22. The microscope 300 includes a second optical system 36 including the shared objective lens 12 and the second imaging optical system 32. The microscope 300 includes a third optical system 326 including the shared objective lens 12, a third zoom optical system 320, and a third imaging optical system 322. That is, the shared objective lens 12 serves also as the objective lens of the first optical system 26, the objective lens of the second optical system 36, and the objective lens of the third optical system 326.

The effective aperture of the first optical system 26 is about the same as the effective aperture of the third optical system 326. The effective aperture of the second optical system 36 is different from the effective aperture of the first optical system 26 or the third optical system 326. Specifically, when the optical magnifications of the optical systems are the same, the effective aperture of the second optical system 36 is smaller than the effective aperture of the first optical system 26 or the third optical system 326. That is, the substantial numerical aperture of the second optical system 36 is smaller than the substantial numerical aperture of the first optical system 26 and the third optical system 326. Note that the first optical system 26 and the third optical system 326 may be configured to have different substantial numerical apertures. Even in that case, it is preferable that the substantial numerical aperture of the first optical system 26 and the third optical system 326 be larger than the substantial numerical aperture of the second optical system 36.

The microscope 300 includes a first imaging device 24 that acquires an optical image of an observation target formed by the first imaging optical system 22 as a first image, and an observation target formed by the second imaging optical system 32. It includes a second image sensor 34 that acquires an optical image as a second image, and a third image sensor 324 that acquires an optical image of an observation target formed by the third imaging optical system 322 as a third image. The microscope 300 also includes a first illumination system 40 that illuminates the target surface 10A of the observation target 10.

As shown in FIG. 15, the first light flux 5 emitted from the target surface 10A is converted into parallel light by the common objective lens 12 along the first optical axis OL1 and is incident on the first deflection mirror 14. The first light flux 5 that has entered the first deflection mirror 14 is deflected from the Z direction to the negative Y direction, further passes through the first diaphragm 16, and enters the first half mirror 15. As shown in FIG. 14, the entire amount of the first light flux 5 that has entered the first half mirror 15 is deflected in the minus X direction and is guided to the first zoom optical system 20. The first light flux 5 that has passed through the first zoom optical system 20 is imaged on the imaging surface of the first imaging element 24 by the first imaging optical system 22, and an optical image of the target surface 10A is acquired.

On the other hand, the third light flux 307 emitted from the target surface 10A is converted into parallel light by the shared objective lens 12 along the third optical axis OR3 and enters the third deflection mirror 314. The third deflection mirror 314 is an example of the third deflection element according to the technique of the present disclosure. The third light flux 307 incident on the third deflection mirror 314 is deflected from the Z direction to the Y direction, further passes through the third diaphragm 316, and is incident on the third half mirror 315. As shown in FIG. 14, the third light flux 307 that has entered the third half mirror 315 is deflected in the minus X direction and guided to the third zoom optical system 320. The third light flux 307 that has passed through the third zoom optical system 320 is imaged on the imaging surface of the third imaging element 324 by the third imaging optical system 322, and an optical image of the target surface 10A is acquired.

As shown in FIG. 16, the second light flux 6 emitted from the target surface 10A is converted into parallel light by the shared objective lens 12 along the second optical axis OR1, and the second image is formed via the second diaphragm 17. It is guided to the optical system 32. The second light flux 6 is imaged on the imaging surface of the second imaging element 34 by the second imaging optical system 32, and the optical image of the target surface 10A is acquired. The microscope 300 does not have a zoom optical system in the second optical system 36. In addition, the microscope 300 includes a zoom optical system only in the first optical system 26 and the third optical system 326 of the first optical system 26, the second optical system 36, and the third optical system 326.

As shown in FIG. 15, the first optical axis OL1 and the third optical axis OR3 form a substantial angle R3 at the position of the observation target 10. Further, as shown in FIG. 16, the first optical axis OL1 and the second optical axis OR1 form a substantial angle R1 at the position of the observation target 10.

The first image acquired by the first image sensor 24 is used as an image for the left eye of the operator. The third image acquired by the third image sensor 324 is used as an image for the right eye of the operator. Since the first image and the third image have the substantial angle R3, the operator can see the stereoscopic image by viewing the first image and the third image with both eyes.

The first image is also used as an image for the left eye of the assistant, and the second image obtained by the second image sensor 34 is provided as an image for the right eye of the assistant. In this case, since the first image and the second image have the substantial angle R1, the assistant can see the stereoscopic image by viewing the first image and the second image with both eyes.

The first image sensor 24, the second image sensor 34, and the third image sensor 324 are image sensors using, for example, a CCD sensor or a CMOS sensor. The first image pickup device 24 and the third image pickup device 324 are 4K image pickup devices each composed of about 8.3 million pixels of 3840 pixels×2160 pixels. Unlike the first image sensor 24, the second image sensor 34 is an HD image sensor that is composed of approximately 920,000 pixels of 1280 pixels×720 pixels. Note that the above-described number of pixels is an example, and the specific number of pixels is not limited.

As shown in FIG. 17 as an example, the microscope 300 includes an image transmitting unit 60, a control unit 91, and an input unit 140 in addition to the above-mentioned optical elements. The control unit 91 includes an image processing unit 50, an image selection unit 55, an output I/F 56, an input I/F 57, a first deflection mirror driving unit 81, a second imaging optical system driving unit 82, and a second imaging optical system driving unit 82. The three-deflection mirror drive unit 83, the first zoom optical system drive unit 84, the third zoom optical system drive unit 85, the first illumination light source drive unit 86, the computer 110, and the external I/F 130 are included. All of these are connected to the bus line 120.

The first image captured by the first image sensor 24, the second image captured by the second image sensor 34, and the third image captured by the third image sensor 324 are electrical image signals. It is acquired by the computer 110 via the input I/F 57 and stored in the RAM 114. The image processing unit 50 performs image processing on the stored first image, second image, and third image. The image selection unit 55 selects an image to be displayed on the image display device 370. The output I/F 56 is an interface between the image transmission unit 60 and the control unit 91. The input I/F 57 is an interface between the input unit 140, the first image sensor 24, the second image sensor 34, the third image sensor 324, and the control unit 91. The third deflection mirror driving section 83 drives the third deflection mirror 314. The third zoom optical system drive unit 85 moves the lens group of the third zoom optical system 320 to change the magnification. Other configurations are the same as the configurations described in the control unit 90 of the first embodiment.

The user uses the input unit 140 to perform various settings related to observation and operate the microscope 300. The input unit 140 is, for example, a keyboard, various switches, a touch panel, a voice input microphone, and/or a foot pedal. The user sets the observation mode, adjusts the magnification of the image, adjusts the light source intensity, changes the substantial angle, and the like via the input unit 140. The input information is acquired by the computer 110 via the input I/F 57. The computer 110 controls each part based on the input information.

The microscope 300 basically uses the first image and the second image as observation images for the assistant. In addition, the first image and the third image are used as observation images for the operator. However, the observation image for the assistant can be selected in a plurality of observation modes as described later.

Magnification of the first image is optically changed by the first zoom optical system 20, and magnification of the third image is optically changed by the third zoom optical system 320. On the other hand, when the second image is observed in combination with the first image, the second image is aligned with the magnification of the first zoom optical system 20 in association with the change of the magnification of the first image by the first zoom optical system 20. The image processing unit 50 adjusts the electronic zoom magnification. The method of adjusting the magnifications of the optical zoom and the electronic zoom in conjunction with each other is as described in the first embodiment. The image processing unit 50 can enlarge or reduce the first image and the third image by electronic zoom. Even in this case, the two images selected by the first image, the second image, and the third image, which are observed by the operator or the assistant, have the magnification combined with the optical zoom, that is, the visual field range adjusted to the same degree. Preferably.

The image selection unit 55 selects the display image for the left eye from the first image, the second image, and the third image that have been image-processed by the image processing unit 50 according to the above-described observation mode set by the operator and the assistant. And the display image for the right eye. The selected left-eye display image and right-eye display image are transmitted to the image display device 370 by the image transmitting unit 60 via the output I/F 56. The image display device 370 displays the display image for the left eye and the display image for the right eye. The image display device 370 includes a first display portion 371 for an assistant and a second display portion 372 for an operator. The first display unit 371 displays any two of the first image, the second image, and the third image. The second display unit 372 displays any two of the first image, the second image, and the third image. The first display unit 371 and the second display unit 372 are examples of the first image display unit and the second image display unit of the present disclosure, respectively. Hereinafter, the “surgeon and/or assistant” is also referred to as “user”.

An image selection unit 55 selects a display image for the left eye and a display image for the right eye from the first image, the second image, and the third image that have been image-processed by the image processing unit 50. The selected display image is transmitted to the image display device 370 by the image transmission unit 60 via the output I/F 56. The first display unit 371 of the image display device 370 displays, for example, a first image and a second image for the assistant to observe the observation target 10. The second display unit 372 of the image display device 370 displays, for example, a first image and a third image for the operator to observe the observation target 10.

The first display unit 371 and the second display unit 372 are, for example, the display devices of the types described in the first embodiment. For example, the first display unit 371 may be a head-mounted display for an assistant and the second display unit 372 may be a head-mounted display for an operator. Further, the image display device 370 may be a display device having a first flat liquid crystal display unit 371 and a second flat liquid crystal display unit 372. The flat liquid crystal type image display device 370 is arranged, for example, above the first optical system 26, the second optical system 36, and the third optical system 326. In this case, as described in the first embodiment, the assistant looks at the first flat liquid crystal display unit 371 by wearing the deflecting glasses, and the surgeon wears the deflecting glasses to make the second flat liquid crystal display unit. Look at 372.

In the microscope 300, at least one of the first deflecting mirror 14 and the third deflecting mirror 314 is movable in a direction in which the substantial angle R3 formed by the first optical axis OL1 and the third optical axis OR3 at the position of the observation target is changed. Is. As an example, as shown in FIG. 18, the first deflection mirror 14 is driven in the Y-axis direction by the first deflection mirror drive unit 81. Further, the third deflecting mirror 314 is driven in the Y-axis direction by the third deflecting mirror driving section 83.

FIG. 18 is a diagram in which the first deflecting mirror 14 is driven in the Y direction from the position indicated by the dotted line to the position indicated by the solid line, and the third deflecting mirror 314 is driven in the negative Y direction from the position indicated by the dotted line to the position indicated by the solid line. Is. The physical angle R4 formed by the optical axis OL3 after the first deflection mirror 14 has moved and the optical axis OR4 after the third deflection mirror 314 has moved is smaller than the physical angle R3 before the movement. When the first deflecting mirror 14 and the third deflecting mirror 314 are moved in opposite directions, the real angle becomes large.

When the first deflection mirror 14 moves, the first optical axis OL1 moves to the optical axis OL3 as shown in FIG. With the assistant looking at the first image from the first optical axis OL1 and the second image from the second optical axis OR1 as shown in FIG. 16, only the first optical axis OL1 of the first image is optical axis OL3. Moving to, the direction and angle of the real angle R1 change, and the stereoscopic image viewed by the assistant feels uncomfortable. In order to prevent this discomfort from occurring, at least one optical element included in the second optical system 36 can move in the same direction in conjunction with the movement of the first deflection mirror 14. As an example, as shown in FIG. 19, the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 are integrated so that they move in the same direction in conjunction with the movement of the first deflection mirror 14. You may comprise. Accordingly, it is possible to prevent the stereoscopic image viewed by the assistant from being uncomfortable.

The microscope 300 can be set by the user by selecting an observation mode for an assistant. Specifically, the user can set the first mode which is the detailed observation mode, the second mode which is the stereoscopic observation mode, and the third mode which is the variable magnification observation mode. The image selection unit 55 selects the image for the left eye and the image for the right eye from the first image, the second image, and the third image based on the observation mode set by the user.

As an example, an arrow DA shown in FIG. 14, that is, a first image 72 acquired by the first image sensor 24 as viewed from the operator, a second image 73 acquired by the second image sensor 34, and a third image sensor 324. It is assumed that the third image 74 acquired in step 1 is an image as shown in FIG. The operator sees the first image 72 and the third image 74, and the assistant basically sees the first image 72 and the second image 73.

When the assistant selects the first mode, the image selection unit 55 selects the first image 72 having a relatively high resolution as the image for the left eye and the image for the right eye, and the selected image is, for example, FIG. Is displayed on the first display unit 371 as shown in. Here, since the assistant sees from the DB direction in FIG. 20, the displayed image is rotated 90 degrees counterclockwise. In this case, the observed image does not become a stereoscopic image because there is no substantial angle, but there is an advantage that the assistant can see a relatively high-resolution image with both eyes. This is suitable for enlarging and viewing the fine target surface 10A with high resolution.

Further, when the assistant selects the second mode, the image selection unit 55 selects the first image 72 for the left eye and the second image 73 for the right eye. In this case, the selected image is displayed on the first display unit 371 as shown in FIG. 22, for example, and the assistant can see the stereoscopic image viewed from the arrow DB. That is, the control unit 91 forms a parallax image with the first image 72 obtained by the first optical system 26 and the second image 73 obtained by the second optical system 36. In the second mode, the control unit 91 displays the second image 73 on the first display unit 371 in synchronization with the display timing of the first image 72. In the second mode, since the second image 73 having a lower resolution than the first image 72 and the third image 74 is used, the resolution is lower than the image viewed by the operator, but stereoscopic vision is possible. Although the second image 73 has a lower resolution than the first image 72 in the present embodiment, the first image 72 may have a lower resolution than the second image 73.

Further, when the assistant selects the third mode, the image selection unit 55 selects the second image 73 having a relatively low resolution as the image for the right eye and the image for the left eye. In this case, the selected image is displayed on the first display unit 371 as shown in FIG. 23, for example. The image to be observed is not stereoscopic and its resolution is relatively low, but the assistant has the advantage that the image can be quickly zoomed and observed from low magnification to high magnification by electronic zoom.

Furthermore, the assistant can set the fourth mode in which the same image as the image viewed by the operator (eg, high-resolution image, parallax image) is displayed on the first display unit 371. When the fourth mode is set, the image selection unit 55 selects the first image 72 as the display image for the left eye displayed on the first display unit 371, and the third image 74 as the display image for the right eye. Select. That is, in the fourth mode, the control unit 91 forms the parallax image using the first image 72 and the third image 74. In this case, the image processing unit 50 can display the first image 72 and the third image 74 viewed from the DA direction as shown in FIG. 24, for example. By displaying in this way, the assistant can also view the high-resolution stereoscopic image in the direction viewed by the operator. That is, a parallax image is formed by the first image 72 obtained by the first optical system 26 and the third image 74 obtained by the third optical system 326. The orientations of the first image 72 and the third image 74 to be viewed by the assistant can be set to a predetermined orientation of the image viewed from the place where the assistant is located.

On the other hand, when the surgeon sets the surgeon's stereoscopic observation mode, the image selection unit 55 sets the display image for the surgeon, for example, as the left-eye image displayed on the second display unit 372 as shown in FIG. 25. The first image 72 and the third image 74 as the image for the right eye are selected. This allows the operator to see a high-resolution stereoscopic image viewed from the DA direction. This mode is the normal mode for the surgeon.

Note that in FIGS. 21 to 25, the left-eye image and the right-eye image are arranged side by side for the sake of clarity, but as described above, the left-eye image and the right-eye image are not necessarily shown. It is not necessary to display images on the left and right of the image display surface (eg, screen) at the same time. As described in the first embodiment, it is appropriately displayed depending on the model of the display device.

Also, as the observation mode for the operator, a mode other than the normal mode may be selected. For example, the operator may display a fifth mode in which the second image 73 is displayed as an image for the left eye on the operator's second display section 372 and the third image 74 is displayed as an image for the right eye in the second display section 372. You may make it selectable. The second image 73 has a lower resolution than the third image 74, but it is easy to change the magnification with the digital zoom.

Furthermore, the combination of modes that can be selected by the surgeon and the assistant is arbitrary. For example, the operator basically selects the normal mode in which the first image 72 and the third image 74 are displayed on the second display section 372 for the operator, and the assistant displays the first image 72 and the second image 73. The second mode to be displayed on the first display portion 371 for use is selected. However, the combination of the operator and the observation mode of the assistant is not limited to this.

For example, if the surgeon has selected the normal mode, the assistant can select any of the first mode to the fourth mode. Further, the control unit 91 causes the second display unit 372 for the operator to display the second image 73 and the third image 74 (fifth mode), and the first display unit 371 for the assistant displays the first image 72 and the third image 74. The two images 73 can be displayed (second mode). Further, the control unit 91 causes the second display unit 372 for the operator to display the second image 73 and the third image 74 (fifth mode), and the first display unit 371 for the assistant displays the first image 72 and the third image 74. Three images 74 can be displayed (fourth mode). Alternatively, the control unit 91 can be displayed in the fourth mode for the surgeon and in the fifth mode for the assistant.

According to the third embodiment having the above configuration, the substantial numerical aperture of the second optical system 36 is smaller than the substantial numerical aperture of the first optical system 26 and the third optical system 326. Furthermore, the second optical system 36 does not have a zoom optical system. Therefore, the manufacturing cost and size can be reduced as compared with the case where the second optical system 36 has the same numerical aperture as the first optical system 26 and the third optical system 326 and the zoom optical system. On the other hand, the surgeon and the assistant can each see a stereoscopic image.

Also, according to the third embodiment, both the operator and the assistant can observe the stereoscopic image. Furthermore, the assistant can set a plurality of observation modes, and the mode in which the assistant sees the observation image viewed by the operator can also be set. According to the third embodiment, it is possible to fully utilize a plurality of optical systems having different resolutions. In addition, the assistant can perform an observation substantially equivalent to the case where the second optical system 36 has the same numerical aperture as the first optical system 26 and the third optical system 326.

(Modification 8)
Also in the microscope 300 in the third embodiment, it is possible to apply the modified examples or alternative configurations described in the first embodiment or the second embodiment. For example, in the technique of the present disclosure, the orientation of the arrangement of the first optical system 26 and the third optical system 326 is not limited to the orientation shown in FIG. It is possible to freely change the direction of each optical system by changing the direction and the number of polarizing mirrors. Further, in the third embodiment, the third zoom optical system 320 is provided in the third optical system 326, but the third optical system 326 may not have the third zoom optical system.

(Modification 9)
In the third embodiment, the shared objective lens 12 is used as the objective lens of the first optical system 26, the second optical system 36, and the third optical system 326. However, in the microscope 300, the first optical system 26 is provided with a dedicated first objective lens, the second optical system 36 is provided with a dedicated second objective lens, and the third optical system 326 is provided with a dedicated third objective lens. May be. In Modification 9, the microscope 300 is provided with a relatively small dedicated objective lens instead of the relatively large shared objective lens 12, and thus the size can be reduced.

(Modification 10)
In the third embodiment, the substantial angle R3 formed by the first optical axis OL1 and the third optical axis OR3 can be changed, but at least one optical element included in the second optical system 36 is the first optical axis OL1. The second optical axis OR1 and the second optical axis OR1 may be configured to be movable in a direction that changes the substantial angle R1 formed at the position of the observation target. For example, the microscope 300 may be configured such that the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 can be moved in the direction in which the real angle R1 is changed as shown in FIG. In the tenth modification, the microscope 300 can adjust the stereoscopic effect even for the image for the assistant.

(Modification 11)
The microscope 300 may be configured so that the first deflection mirror 14 does not move but only the third deflection mirror 314 moves, as a configuration in which the body angle R3 can be changed. In the modified example 11, the first deflection mirror driving unit 81 is unnecessary. Further, there is an advantage that it is not necessary to move the second diaphragm 17, the second imaging optical system 32, and the second image pickup device 34 in conjunction with the movement of the first deflection mirror 14 as shown in FIG. Furthermore, in order to change the substantial angle R1 of the image viewed by the assistant, the second diaphragm 17, the second imaging optical system 32, and the second image sensor 34 may be moved in only one direction. Therefore, the configuration in which both the body angle R1 and the body angle R3 can be changed becomes easy.

In each of the above embodiments, the case where the microscope control program 118 is read from the ROM 116 is illustrated, but it is not always necessary to store the microscope control program 118 in the ROM 116 from the beginning. For example, as shown in FIG. 26, the microscope control program 118 may be stored in an arbitrary portable storage medium 400 such as SSD, USB memory, or CD-ROM. In this case, the microscope control program 118 of the storage medium 400 is installed in the RAM 114 of the computer 110, and the installed microscope control program 118 is executed by the CPU 112.

Further, the microscope control program 118 is stored in a storage unit such as another computer or a server device connected to the

microscope

100, 200, 300 via a communication network (not shown), and the microscope control program 118 causes the

microscope

100, 200, It may be downloaded in response to the request of 300. In this case, the downloaded microscope control program 118 is executed by the CPU 112.

In the above embodiment, for example, the hardware structure of the processing unit that executes various processes such as the image processing unit and the image selection unit is a general-purpose unit that executes software (program) and functions as various processing units. In addition to a CPU, which is a processor, a processor having a circuit configuration specifically designed to execute a specific process, such as a PLD (Programmable Logic Device) or an ASIC, which is a processor whose circuit configuration can be changed after manufacturing the FPGA. It includes a dedicated electric circuit.

One processing unit may be configured by one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). Combination). Further, the plurality of processing units may be configured by one processor.

As an example of configuring a plurality of processing units with one processor, firstly, one processor is configured with a combination of one or more CPUs and software, as represented by computers such as clients and servers. There is a form in which the processor functions as a plurality of processing units. Secondly, as represented by SoC (system on chip) and the like, there is a form in which a processor that realizes the functions of the entire system including a plurality of processing units by one IC chip is used. In this way, the various processing units are configured by using one or more of the above various processors as a hardware structure.

Further, as the hardware structure of these various processors, more specifically, an electric circuit in which circuit elements such as semiconductor elements are combined can be used.

In the present specification, “A and/or B” is synonymous with “at least one of A and B”. That is, “A and/or B” means that only A may be used, only B may be used, or a combination of A and B may be used. Further, in the present specification, the same concept as “A and/or B” is also applied to the case where three or more matters are linked by “and/or”.

All documents, patent applications and technical standards mentioned in this specification are to the same extent as if each individual document, patent application and technical standard was specifically and individually noted to be incorporated by reference. Incorporated by reference in the book.

Claims

A first optical system having a first optical axis, including a shared objective lens or a first objective lens and a first imaging optical system;
A second optical system having a second optical axis, including the shared objective lens or the second objective lens and a second imaging optical system;
A first image sensor for obtaining an optical image formed by the first image forming optical system as a first image;
A second image sensor for acquiring an optical image formed by the second image forming optical system as a second image;
A first mode in which the first image is displayed on the image display device, and a second mode in which the first image and the second image having different resolutions from each other are displayed as three-dimensional display images on the image display device. A microscope comprising: a control unit capable of switching between two modes.
2. The parallax image is formed by the first image obtained by the first optical system and the second image obtained by the second optical system, in the second mode, the control unit. microscope.
The microscope according to claim 1 or 2, wherein the control unit can switch to a third mode in which the second image is displayed on the image display device.
The microscope according to any one of claims 1 to 3, wherein only the first optical system of the first optical system and the second optical system includes a zoom optical system.
An image processing unit capable of electronically changing the magnification of the second image is provided, and the image processing unit adjusts the magnification of the second image based on the first image enlarged or reduced by the zoom optical system. The microscope according to claim 4, which comprises:
The microscope according to claim 5, wherein the image processing unit adjusts a visual field range of the first image and the second image.
At least one optical element included in the second optical system is movable in a direction in which a substantial angle formed by the first optical axis and the second optical axis at a position of an observation target is changed. The microscope according to claim 6.
The microscope according to any one of claims 1 to 7, wherein the number of pixels of the first image sensor is different from the number of pixels of the second image sensor.
The microscope according to any one of claims 1 to 8, wherein the effective aperture of the first optical system and the effective aperture of the second optical system are different.
A third optical system including the shared objective lens or the third objective lens and a third imaging optical system, having a third optical axis, and an optical image formed by the third imaging optical system as a third image. The microscope according to any one of claims 1 to 9, further comprising:
The microscope according to claim 10, wherein the resolution of the third optical system is higher than the resolution of the second optical system, or the number of pixels of the third image sensor is larger than the number of pixels of the second image sensor.
A first optical system having a first optical axis, including a shared objective lens or a first objective lens and a first imaging optical system;
A second optical system having a second optical axis, including the shared objective lens or the second objective lens and a second imaging optical system,
A microscope including a zoom optical system only in the first optical system of the first optical system and the second optical system.
A first image sensor for obtaining an optical image formed by the first image forming optical system as a first image;
A second image sensor for obtaining an optical image formed by the second image forming optical system as a second image,
The microscope according to claim 12, wherein the number of pixels of the first image sensor and the number of pixels of the second image sensor are different.
An image processing unit capable of electronically changing the magnification of the second image is provided, and the image processing unit adjusts the magnification of the second image based on the first image enlarged or reduced by the zoom optical system. The microscope according to claim 13, wherein
The microscope according to claim 14, wherein the image processing unit adjusts a visual field range of the first image and the second image.
A first mode in which the first image is displayed on the image display device, a second mode in which the first image and the second image are displayed as three-dimensional display images on the image display device, and the second image The microscope according to any one of claims 13 to 15, further comprising a control unit capable of switching between a third mode displayed on the image display device and the third mode.
17. The parallax image according to claim 16, wherein in the second mode, the control unit forms a parallax image with the first image obtained by the first optical system and the second image obtained by the second optical system. microscope.
13. At least one optical element included in the second optical system is movable in a direction in which a substantial angle formed by the first optical axis and the second optical axis at an observation target position is changed. The microscope according to claim 17.
A third optical system including the shared objective lens or the third objective lens and a third imaging optical system, having a third optical axis, and an optical image formed by the third imaging optical system as a third image. The 3rd image sensor acquired as.
The microscope according to claim 19, wherein the resolution of the third optical system is higher than the resolution of the second optical system.
A first optical system having a first optical axis, including a shared objective lens or a first objective lens and a first imaging optical system;
A second optical system having a second optical axis, including the shared objective lens or the second objective lens and a second imaging optical system;
A third optical system having a third optical axis, including the shared objective lens or the third objective lens and a third imaging optical system,
The resolution of the first optical system is higher than the resolution of the second optical system,
A microscope in which the resolution of the third optical system is higher than the resolution of the second optical system.
22. The microscope according to claim 21, wherein only the first optical system and the third optical system of the first optical system, the second optical system, and the third optical system include a zoom optical system.
A first image sensor for obtaining an optical image formed by the first image forming optical system as a first image;
A second image sensor for acquiring an optical image formed by the second image forming optical system as a second image;
A third image sensor for obtaining an optical image formed by the third image forming optical system as a third image,
The microscope according to claim 21 or 22, wherein the number of pixels of the first image sensor is different from the number of pixels of the second image sensor.
The microscope according to claim 23, comprising an image processing unit capable of electronically enlarging and reducing the first image, the second image, and the third image.
The microscope according to claim 24, wherein the image processing unit generates two images of which the magnification is adjusted from the first image, the second image, and the third image.
The microscope according to claim 24 or 25, wherein the image processing unit generates two images in which the visual field range is adjusted from the first image, the second image, and the third image.
A first mode in which the first image is displayed on the image display device, a second mode in which the first image and the second image are displayed as three-dimensional display images on the image display device, and the second image The microscope according to any one of claims 24 to 26, comprising a control unit capable of switching between a third mode displayed on the image display device and the third mode.
28. In the second mode, the control unit forms a parallax image with the first image obtained by the first optical system and the second image obtained by the second optical system. microscope.
29. The microscope according to claim 27 or claim 28, wherein the control unit can switch to a fourth mode in which the first image is a left image and the third image is a right image and is displayed on the image display device.
30. In the fourth mode, the control unit forms a parallax image with the first image obtained by the first optical system and the third image obtained by the third optical system. microscope.
31. The microscope according to claim 29 or claim 30, wherein the image processing unit matches the orientations of the first image and the third image with a predetermined orientation.
The image display device includes a first image display unit that displays any two of the first image, the second image, and the third image; and the first image, the second image, and the third image. 32. The microscope according to claim 27, further comprising a second image display unit that displays any two of the above.
The control unit causes the first image display unit to display in the second mode in which a parallax image is formed using the first image and the second image, and uses the second image and the third image. 33. The microscope according to claim 32, wherein the microscope is displayed in the second image display unit in a fifth mode for forming a parallax image.
The control unit causes the first image display unit to display in a fifth mode in which a parallax image is formed using the second image and the third image, and uses the first image and the third image. The microscope according to claim 32, wherein the microscope is displayed on the second image display unit in a fourth mode for forming a parallax image.
33. The microscope according to claim 27, wherein the control unit causes the image display device to display the second image in synchronization with the display of the first image in the second mode. ..
A first deflecting element that deflects the light of the first optical axis and a third deflecting element that deflects the light of the third optical axis are provided, and at least one of the first deflecting element and the third deflecting element is provided. The microscope according to any one of claims 21 to 35, wherein the first optical axis and the third optical axis are movable in a direction that changes a substantial angle formed at a position of an observation target.
37. The microscope according to claim 36, wherein at least one optical element included in the second optical system is movable in the same direction in conjunction with the movement of the first deflecting element.
Of the first deflecting element and the third deflecting element, only the third deflecting element moves in a direction in which the substantial angle formed by the first optical axis and the third optical axis at the position of the observation target is changed. 37. The microscope according to claim 36, which is possible.
22. At least one optical element included in the second optical system is movable in a direction in which a substantial angle formed by a position of an observation target between the first optical axis and the second optical axis is changed. The microscope according to claim 38.
The microscope according to any one of claims 21 to 39, wherein the resolution of the third optical system is a resolution corresponding to the resolution of the first optical system.
The level of resolution of each of the first optical system, the second optical system, and the third optical system depends on the numerical aperture and the depth of focus of the first optical system, the second optical system, and the third optical system. The microscope according to any one of claims 21 to 40, which is determined based on at least one of the following: the aberration, the material of the lens, and the presence or absence of a zoom optical system.
An image acquisition unit that acquires a first image captured by the first image sensor and a second image captured by the second image sensor;
A first mode in which the first image is displayed on the image display device, and a second mode in which the first image and the second image having different resolutions from each other are displayed as three-dimensional display images on the image display device. A control unit capable of switching between two modes,
And a control device for a microscope.
On the computer,
Obtaining a first image captured by the first image sensor and a second image captured by the second image sensor,
Selection for displaying on the image display device a first mode for displaying the first image on the image display device and the second image having a different resolution from the first image as a three-dimensional display image on the image display device To switch the second mode to
A program to execute.