JP2005037683A - Imaging device for microscope, its control method and program for control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device for a microscope in which the microscope side detects the state of movement, the situations of operation or the like of a microscope, the imaging device side detects them without necessitating the notice to the imaging device, performs the setting of exposure time in accordance with the change of the state of an observation image by the operation etc. of the microscope and displays moving pictures optimum in exposure, and to provide its control method and a program for the control method. <P>SOLUTION: A contrast calculation part 48 detects the change of the state of a microscope from the change of the observation image accompanying the operation of the microscope. When the contrast calculation part 48 detects the change of the state of the microscope, an AE calculation part 49 judges whether the setting of the exposure time adapted for the change is necessary or not. When the AE calculation part 49 judges that the setting of the exposure time adaptive to the change is necessary, the exposure time adapted for the change of observation image is set. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus used attached to a microscope, a control method therefor, and a program related to the control method, and in particular, detects a change in the state of an observation image caused by operation of the microscope and controls exposure time. The present invention relates to a microscope imaging apparatus, a control method thereof, and a program related to the control method.

Conventional technology detects the flickering of moving images and high-intensity light emission that occur when operating an electric microscope stage, objective lens (revolver), cube unit, illumination shutter, etc. Based on information from the detecting means, a microscope imaging device that can be prevented by fixing the exposure time of the microscope imaging device or stopping the update of the moving image is disclosed (for example, Patent Document 1).
JP 2001-292369 A

The above-described microscope imaging device is premised on use in combination with an expensive electric microscope, and when used in combination with an inexpensive manual microscope, the above effects cannot be obtained.
Further, assuming that the information on the operation state and operation state of the microscope is detected on the microscope side, an electrical and software information notification means must be provided between the microscope and the imaging device. For this reason, the microscope system must be complicated and expensive.

  In view of the above points, the present invention does not require that the operation state or operation state of the microscope is detected on the microscope side and notified to the imaging device, but is detected on the imaging device side, and is based on the operation of the microscope. An object of the present invention is to provide a microscope imaging apparatus that sets an exposure time according to a change in the state of an observation image and displays a moving image with an optimal exposure, a control method thereof, and a program related to the control method.

  According to one aspect of the present invention, in a microscope imaging apparatus having a function of calculating a required exposure time in order for the microscope to obtain an observation image with appropriate exposure, the change in the observation image accompanying the operation of the microscope Detecting means for detecting a change in the state of the microscope from the detection means, and when the detecting means detects a change in the state of the microscope, a determining means for determining whether an exposure time setting adapted to the change is necessary; and And an exposure time setting means for setting an exposure time adapted to the change in the observation image when it is determined that an exposure time adapted to the change is necessary. An imaging apparatus for a microscope is provided. .

A change in the state of the observation image due to operation of the microscope is detected on the imaging device side, and an exposure time adapted to the change is set as necessary.
According to another aspect of the present invention, in a microscope imaging apparatus having a function of calculating a required exposure time in order for a microscope to obtain an observation image with proper exposure, an observation image accompanying operation of the microscope is obtained. Detection means for detecting a change in the state of the microscope from the change, a determination means for determining whether an exposure time setting adapted to the change is necessary when the detection means detects a change in the state of the microscope, and the determination means However, when it is determined that it is necessary to set the exposure time adapted to the change, an exposure time setting means for setting the exposure time adapted to the change of the observation image is provided. The detection unit detects a change in contrast of the observation image due to a focusing operation of the microscope, and the determination unit calculates a change in the contrast of the observation image, and changes when the calculated value exceeds a threshold value. Adapted to Out time setting is microscope imaging apparatus characterized by determining that it is not necessary provided.

From the change in the contrast of the observed image, the imaging device detects the focusing operation of the microscope, and judges whether it is necessary to calculate the exposure time adapted to the change, thereby preventing flickering of the observed image due to the focusing operation of the microscope .
According to another aspect of the present invention, in a microscope imaging apparatus having a function of calculating a required exposure time in order for a microscope to obtain an observation image with proper exposure, an observation image accompanying operation of the microscope is obtained. Detection means for detecting a change in the state of the microscope from the change, a determination means for determining whether an exposure time setting adapted to the change is necessary when the detection means detects a change in the state of the microscope, and the determination means However, when it is determined that it is necessary to set the exposure time adapted to the change, an exposure time setting means for setting the exposure time adapted to the change of the observation image is provided. The detection unit detects a change in luminance of the observation image data, and the determination unit calculates a luminance evaluation value based on the luminance of the observation image data, and the calculated value is equal to or less than a threshold value indicating a lower limit of the luminance evaluation value. If you change If the calculated value exceeds the threshold value indicating the lower limit of the luminance evaluation value, it is determined that it is necessary to set the exposure time to adapt to the change. An imaging apparatus for a microscope is provided.

From the change in the brightness of the image data of the observation image, the operation to switch the microscopy method of the microscope is detected on the imaging device side, and the exposure time is fixed as necessary. Prevents high brightness light emission.
According to another aspect of the present invention, in a microscope imaging apparatus having a function of calculating a required exposure time in order for a microscope to obtain an observation image with proper exposure, an observation image accompanying operation of the microscope is obtained. Detection means for detecting a change in the state of the microscope from the change, a determination means for determining whether an exposure time setting adapted to the change is necessary when the detection means detects a change in the state of the microscope, and the determination means However, when it is determined that it is necessary to set the exposure time adapted to the change, an exposure time setting means for setting the exposure time adapted to the change of the observation image is provided. The determination means, as a result of comparing the calculated luminance evaluation value and a threshold value indicating the lower limit of the luminance evaluation value, the calculated value exceeds the threshold value indicating the lower limit of the luminance evaluation value, and the calculated value and the luminance Threshold value indicating the upper limit of evaluation value If the calculated value exceeds the threshold value indicating the upper limit, it is determined that the exposure time setting adapted to the change is necessary, and the exposure time setting means adjusts the exposure time adapted to the change. Before setting the image, the exposure time is set to the shortest possible range, and further, a display holding means for temporarily not displaying the observation image of the microscope is provided. An apparatus is provided.

  When switching the microscopy method and opening the optical path, the display of the observation image is temporarily suspended and not displayed. In addition, once the exposure time is set to the shortest possible range, automatic exposure control is performed. By switching to automatic exposure control, the observation image is displayed, thereby preventing high-luminance emission of the observation image when switching from a spectroscopic method with a dark observation field to a bright spectroscopic method.

  According to the present invention, the entire microscope system can be made cheaper by detecting a change in the state of the microscope on the imaging device side and setting a suitable exposure time. In addition, it is possible to reduce discomfort felt when the spectrographer performs observation while operating the microscope.

  Examples suitable for carrying out the invention are listed below.

FIG. 1 shows a configuration diagram of a microscope system to which the microscope imaging apparatus according to the first embodiment is applied.
In FIG. 1, an objective lens 27 is arranged in the microscope main body 1 so as to face the sample 3 placed on the sample stage 26. A trinocular tube unit 5 is disposed on the upper part of the microscope main body 1 on the observation optical axis via the objective lens 27. An eyepiece unit 6 is disposed via the trinocular tube unit 5, and an imaging device 36 is disposed above the trinocular tube unit 5 via the imaging lens unit 100. The sample stage 26 can be moved on the optical axis of the objective lens 27 by rotating the Z revolver 7.

FIG. 2 shows a detailed configuration of the microscope system shown in FIG. The microscope system shown in FIG. 2 is configured such that, for example, various spectroscopic methods such as transmitted bright field observation, dark field observation, phase difference observation, differential interference observation, and fluorescence observation can be appropriately selected.
The microscope system shown in FIG. 2 includes a transmission illumination optical system 11 and an epi-illumination optical system 12 as an illumination system.

  The transmission illumination optical system 11 includes a transmission illumination light source 13, a collector lens 14, a transmission filter unit 15, a transmission field stop 16, a transmission shutter 161, a bending mirror 17, a transmission aperture stop 18, a condenser optical element unit 19, and a top lens. The unit 20 is configured. The optical elements from the transmission illumination light source 13 side to the collector lens 14 to the top lens unit 20 are arranged in order. The collector lens 14 collects the transmitted illumination light from the transmitted illumination light source 13.

  The epi-illumination optical system 12 includes an epi-illumination light source 21, an epi-illumination filter unit 22, an epi-illumination shutter 23, an epi-illumination field stop 24, and an epi-illumination aperture stop 25. On the optical path of the epi-illumination light emitted from the epi-illumination light source 21, the optical elements from the epi-illumination light source 21 side to the epi-illumination filter unit 22 to the epi-illumination aperture stop 25 are sequentially arranged.

A sample stage 26, a revolver 28, an objective lens side optical element unit 29, a cube unit 30 and a beam splitter 31 are arranged on the observation optical path S where the optical axes of the transmitted illumination optical system 11 and the epi-illumination optical system 12 overlap. .
A specimen to be observed is placed on the sample stage 26. The sample stage 26 can move in the observation optical path S-axis direction by the rotation operation of the Z revolver 7 shown in FIG. 1, and can move and adjust the specimen to the focal position of the objective lens 27. Further, a handle (not shown) is attached to the sample stage 26. By operating this handle, the sample stage 26 can be moved in a plane orthogonal to the observation optical path S axis. As a result, the part of the specimen to be observed can be moved and adjusted on the observation optical path S.

A plurality of objective lenses 27 are attached to the revolver 28, and one objective lens 27 is selected by the revolving operation by the revolver 28 and positioned on the observation optical path S.
The cube unit 30 switches the dichroic mirror on the observation optical path S according to various spectroscopic methods such as transmission bright field observation and fluorescence observation.

A beam splitter 31 is arranged in the trinocular tube unit 5, and the observation optical path S is divided into a first observation optical path S ′ toward the eyepiece lens and a second observation optical path S ″ toward the imaging device 36. Branch to
An eyepiece lens 6a is disposed on the first observation light path S ′, and the observation light that has passed through the eyepiece lens 6a is observed by the spectrographer. In addition, on the second observation optical path S ″, an imaging lens unit 100 including an intermediate variable magnification optical system (zoom lens barrel) 33 and a photographic eyepiece lens unit 35, and an image pickup device 36 are arranged. Light can be photographed by the imaging device 36.

  The intermediate variable magnification optical system (zoom lens barrel) 33 includes a variable magnification zoom lens 33 a for changing the magnification of an image picked up by the image pickup device 36. If intermediate zooming is not required, the intermediate zooming optical system (zoom lens barrel) 33 can be removed. The imaging device 36 includes an imaging element 42 therein.

The observation light from the objective lens 27 forms an image on the imaging surface of the image sensor 42 by the photographic eyepiece lens 35 a in the photographic eyepiece unit 35.
The transmission filter unit 15 in the transmission illumination optical system 11, the transmission field stop 16, the transmission shutter 161, the transmission aperture stop 18, the condenser optical element unit 19 and the top lens unit 20, and the incident light filter unit 22 in the incident illumination optical system 12. , Epi-illumination shutter 23, epi-illumination field stop 24 and epi-illumination aperture stop 25, sample stage 26, revolver 28, objective lens side optical element unit 29, cube unit 30, beam splitter 31, and intermediate variable magnification optical system (zoom lens barrel) 33 can perform various switching operations, adjustment operations, and moving operations by manual operation of the spectrographer.

  The configuration of the microscope imaging apparatus according to the first embodiment will be described with reference to FIG. The imaging device 36 includes an imaging device 42, a preprocessing unit 43, a CCD driving unit 44, a frame memory 45, a memory controller 46, a display unit 47, a contrast calculation unit 48, an AE calculation unit 49, a control unit 50, and an information input unit 51. Consists of

  The image pickup element 42 is arranged on the observation optical path S ″ together with the photographic eyepiece unit 35 of FIG. 2 in the microscope system described above, and picks up and photoelectrically converts an observation image of the specimen from the microscope. Is driven by a drive timing signal generated from the CCD drive unit 44. Further, an exposure time is set in the CCD drive unit 44 from the AE calculation unit 49 or the control unit 50 as a drive parameter of the image sensor 42. .

The imaging output signal of the imaging element 42 is input to the preprocessing unit 43. The pre-processing unit 43 has a function of converting the output signal of the image sensor 42 into a video signal and separating it into R (red), G (green), and B (blue) color signals.
The color signals R, G, and B separated by the pre-processing unit 43 are converted into digital signals and input to the frame memory 45 as digital image data. The frame memory 45 stores image data corresponding to one frame of the observation image captured by the image sensor 42. A memory controller 46 is connected to the frame memory 45.

  The memory controller 46 sends a control signal for writing the image signal from the front processing unit 43 to the frame memory 45 in accordance with an instruction from the control unit 50 and the image data stored in the frame memory 45 to the display unit 47. A control signal for reading is output to the frame memory 45 to control a write / read address of the frame memory 45. The observation image data stored in the frame memory 45 is sent to the display unit 47 by the memory controller 46 and displayed as an image.

The contrast calculation unit 48 has a function of calculating the contrast value of the image data stored in the frame memory 45.
The AE calculation unit 49 has a function of calculating an exposure time such that the image data stored in the frame memory 45 is properly exposed.

  The control unit 50 controls various parts of the imaging device 36, and determines whether the contrast calculation unit 48 determines whether an image region parameter for calculating a contrast value, which will be described later, or the contrast value has greatly changed. Set parameters such as the contrast value fluctuation threshold. Further, parameters such as an image area parameter and a target value for calculating a luminance evaluation value, which will be described later, are set in the AE calculation unit 49. As these parameters, values stored in the control unit 50 in advance can be used. Alternatively, a value input from the information input unit 51 connected to the control unit 50 may be used. The control unit 50 includes a memory 50a that stores data necessary for executing various processes.

  In such a microscope system, automatic exposure is performed. The spectrographer operates the Z revolver 7 of the microscope main body 1 in FIG. 1 to move the specimen placed on the sample stage 26 up and down with respect to the focal position of the objective lens 27 to perform focusing. At this time, if the exposure is still set to automatic, the imaging device 36 causes brightness flickering of the moving image. This is because when the observation image is out of focus by the operation of the Z revolver 7, the exposure time is changed in accordance with the change in the observation image accompanying the focusing operation due to the followability of the automatic exposure control.

Assume that the spectrographer performs focusing while viewing the observation image of the specimen 3 displayed on the display unit 47. The operation of the imaging apparatus according to the present embodiment for preventing the flickering of the brightness of the observation image that occurs at this time will be described below.
When the observation image is captured according to the drive signal generated by the CCD drive unit 44, charges corresponding to the image of the specimen 3 are accumulated in the image sensor 42. The electric charge (electrical signal) accumulated in the image sensor 42 is read from the image sensor 42 after the photographing is finished and input to the pre-processing unit 43.

When an electrical signal is input from the image sensor 42, the preprocessing unit 43 converts the electrical signal into a video signal and separates it into R, G, and B color component signals.
The R, G, and B color component signals are digitally converted and stored in the frame memory 45. By controlling writing / reading of the frame memory 45 by the memory controller 46, the image data from the image sensor 42 is recorded in the frame memory 45 in real time and simultaneously displayed on the display unit 47 as a real-time moving image.

  In the contrast calculation unit 48, a contrast value, which will be described later, of the image data stored in the frame memory 45 is calculated each time image data for one frame is stored in the frame memory 45, and is displayed on the display unit 47 together with the observation image data. Is displayed. Hereinafter, processing executed by the contrast calculation unit 48 will be described.

  FIG. 4 is a flowchart illustrating processing executed by the contrast calculation unit. The processing in FIG. 5 is realized by the control unit 50 executing a control program stored in the memory 50a in the control unit 50, and is executed when image data for one frame is accumulated in the frame memory 45. Is done.

  The contrast calculation unit 48 reads image data from the frame memory 45 via the memory controller 46 (step C11). A contrast value is calculated for the image area designated by the control unit 50 (step C12). The contrast value is obtained, for example, as the sum of squares of differences between adjacent pixel data in the designated area.

The calculated contrast value is notified to the display unit 47 (step C13). The contrast value is displayed on the display unit 47 together with the observation image data, and is used as an index for focusing.
The contrast value calculated this time is compared with the contrast value calculated last time (step C14). The amount of change in contrast value is given by the following equation, for example.
(Change amount of contrast value) = {(Contrast value calculated this time) − (Contrast value calculated last time)} / (Contrast value calculated last time) × 100
The amount of change in contrast value is compared with a contrast value variation threshold set by the control unit 50. For example, in this embodiment, it is 20%.

  If the amount of change in the contrast value is equal to or greater than the contrast value fluctuation threshold (YES in step C14), the spectrograph determines that the Z revolver 7 of the microscope body 1 has been operated and focused, and this is determined as the AE calculation unit. 49 is notified (step C15). If the change amount of the contrast value is less than the contrast value fluctuation threshold (NO in Step C14), the process ends without performing the process of Step C15.

  On the other hand, in the AE calculation unit 49, the exposure time is calculated and updated every time one frame of image data is stored in the frame memory 45 so that the image data stored in the frame memory 45 is properly exposed. ing. Hereinafter, processing executed by the AE calculation unit 49 will be described.

  FIG. 5 is a flowchart showing processing executed by the AE calculation unit 49. The processing in FIG. 5 is realized by the control unit 50 executing a control program stored in the memory 50a in the control unit 50, and is executed when image data for one frame is accumulated in the frame memory 45. Is done.

  In the processing executed by the AE calculation unit 49, first, image data is read from the frame memory 45 via the memory controller 46 (step A11). The brightness evaluation value of the image area designated by the control unit 50 is calculated (step A12). The luminance evaluation value is, for example, the maximum value of the average value of each luminance of R, G, and B in the designated area.

  In step A13, the exposure state of the image data is determined from the calculated luminance evaluation value and the target value designated by the control unit 50. The target value designated by the control unit 50 is an index value indicating proper exposure, and is set to 163, for example, while the range of the luminance data of the image is 0 to 255.

  Regarding the determination of the exposure state, for example, an image obtained with an exposure time that is one step longer than the current exposure time from the luminance evaluation value of the image obtained at the current exposure time (the luminance evaluation value calculated at step A12). If it is within the range up to the luminance evaluation value, it is determined that the exposure is appropriate.

If it is determined in step A13 that the exposure is appropriate, the process ends. If it is determined that the exposure is not appropriate, the process proceeds to step A14.
In step A14, the contrast calculation unit 48 waits for the process in step C14 in FIG. When recognizing that the process of step C14 in FIG. 4 is completed, the process proceeds to step A15.

  In step A15, it is determined whether or not a notification is received from the contrast calculation unit 48 that the contrast value has changed significantly. In the case of YES, that is, when a notification is received from the contrast calculation unit 48, no particular processing is performed, and the processing of the AE calculation unit 49 ends. If NO, that is, if no notification is received from the contrast calculation unit 48, the process proceeds to step A16.

In step A16, an exposure time is calculated such that the luminance evaluation value calculated in step A12 approaches the target value designated by the control unit 50. The formula for calculating the exposure time is given by the following formula, for example.
(Exposure time) = (target value) / (luminance evaluation value calculated in step A12) × (current exposure time)
The exposure time calculated in step A16 is set in the CCD drive unit 44 (step A17). The exposure time set in the CCD drive unit 44 is used for imaging the next frame.

  As described above, when the spectrographer normally does not focus the observation image, the display unit 47 displays a moving image subjected to automatic exposure control in real time. On the other hand, when the spectroscope is focusing the observation image, the AE calculation unit 49 stops the update of the exposure time upon receiving a notification from the contrast calculation unit 48 that the contrast value has changed significantly. Fix the exposure time. Therefore, a moving image with a fixed exposure time is displayed on the display unit 47.

  Even when the spectrographer is focusing the observation image, if a moving image with automatic exposure control is displayed, the brightness distribution of the image data changes due to the focusing, so the exposure time also changes, resulting in a moving image. Flickering occurs. By using the imaging apparatus for a microscope according to the present embodiment, a moving image without flickering is displayed in order to fix the exposure time when the spectroscope is focusing the observation image.

FIG. 6 is a diagram showing an outline of the temporal change in contrast value when the spectroscope is focusing the observation image. The vertical axis represents the contrast value, and the horizontal axis represents time. FIG. 6 is used to show the relationship between the operation of the spectrographer and the operation of the microscope imaging apparatus according to the above-described embodiment.
At time 0 to t _1, a state in which in focus of the observation image. At the time t _1, the observer is to start the operation of the focusing. When the observation image becomes out of focus by the focusing operation, the contrast value starts to decrease.

At the point A, the imaging device detects that the contrast value fluctuates by 20% or more with respect to the contrast value 100 (contrast value is 80 or less), and the AE calculation unit 49 exposes it. Fix time. Focusing operation at the time t ₂ is completed. Time t ₂ later, when the contrast variation value falls within 20%, detects that the imaging apparatus is completed focusing operation by the contrast calculating section 48, AE calculation unit 49, to release the exposure time, again Perform automatic exposure time control.

  As described above, according to the imaging apparatus for a microscope according to the present embodiment, it is detected from the operation of the revolver 7 of the microscope body 1 in FIG. 1 whether or not the spectroscope is focusing the observation image. There is no need. It can be detected from changes in the contrast value of the image data captured on the imaging device side. Therefore, when the spectroscope is focusing the observation image, the exposure time is fixed and a flicker-free moving image is provided. can do.

A second embodiment is shown.
In the second embodiment, the spectrographer operates the revolver 28 of the microscope main body 1 in FIG. 1 to switch the objective lens 27, operates the cube unit 30 to switch the spectroscopic method, When operating the epi-illumination shutter 23 to open and close the illumination optical path, or perform a microscope operation that opens after the optical path has been interrupted, high-luminance emission of moving images captured in real time by the imaging device It is to prevent.

  The basic configuration of the microscope used in the second embodiment and the microscope imaging apparatus according to the present embodiment is the same as that of the first embodiment. The microscope is as shown in FIGS. 1 and 2, and the description thereof is omitted here. Regarding the microscope imaging apparatus, as shown in FIG. 7, the imaging device 42, the pre-processing unit 43, the CCD driving unit 44, the frame memory 45, the memory controller 46, the display unit 47, the AE calculation unit 49 ′, the control unit 50, and An information input unit 51 is included.

In the microscope system according to the second embodiment, the operation of the imaging apparatus when the examiner performs a microscope operation while viewing the observation image of the specimen displayed on the display unit 47 will be described.
When an observation image is captured in accordance with the drive signal generated by the CCD drive unit 44, charges corresponding to the image of the specimen 3 are accumulated in the image sensor 42. The electric charge (electrical signal) accumulated in the image sensor 42 is read from the image sensor 42 after the photographing is finished and input to the pre-processing unit 43.

When an electrical signal is input from the image sensor 42, the preprocessing unit 43 converts the electrical signal into a video signal and separates it into R, G, and B color component signals.
The R, G, and B color component signals are digitally converted and stored in the frame memory 45. By controlling writing / reading of the frame memory 45 by the memory controller 46, the image data from the image sensor 42 is recorded in the frame memory 45 in real time and simultaneously displayed on the display unit 47 as a real-time moving image.

In the AE calculation unit 49 ′, the exposure time is calculated and updated in real time so that the image data stored in the frame memory 45 has a proper exposure. Hereinafter, processing executed by the AE calculation unit 49 ′ will be described.
FIG. 8 is a flowchart showing processing executed by the AE calculation unit 49. The processing in FIG. 5 is realized by the control unit 50 executing a control program stored in the memory 50a in the control unit 50, and is executed when image data for one frame is accumulated in the frame memory 45. Is done.

  First, the AE calculation unit 49 ′ reads image data from the memory controller 46 (step A21). For the read image data, the luminance evaluation value of the image area designated by the control unit 50 is calculated (step A22). Note that the luminance evaluation value is, for example, the maximum value of the average value of each luminance of R, G, and B in the designated area.

  In step A23, the exposure state of the image data is determined from the calculated luminance evaluation value and the target value designated by the control unit 50. The target value designated by the control unit 50 is an index value indicating proper exposure, and is set to 163, for example, while the range of the luminance data of the image is 0 to 255.

  Regarding the determination of the exposure state, for example, an image obtained with an exposure time that is one step longer than the current exposure time from the luminance evaluation value of the image obtained at the current exposure time (the luminance evaluation value calculated at step A22). If it is within the range up to the luminance evaluation value, it is determined that the exposure is appropriate.

If it is determined in step A23 that the exposure is appropriate, the process ends. If it is determined that the exposure is not appropriate, the process proceeds to step A24.
In step A24, an exposure time fixing / update determination process to be described later is executed. If the result of the fixed exposure time / update determination process is “fixed exposure time”, the process ends. When the result is “update exposure time”, the process proceeds to step A25, and the exposure time is calculated so that the luminance evaluation value calculated in step A22 approaches the target value specified by the control unit 50 (step A25).

The calculation of the exposure time in step A25 is expressed by the following formula, for example.
(Exposure time) = (target value) / (luminance evaluation value calculated in step A12) × (current exposure time)
The exposure time calculated in step A25 is set in the CCD drive unit 44 (step A26). The exposure time set in the CCD drive unit 44 is used for imaging the next frame.

Next, the exposure time fixed / update determination process will be described with reference to a flowchart showing the exposure time fixed / update determination process of FIG. The processing in the figure is also realized by the control unit 50 executing a control program stored in the memory 50a in the control unit 50.
First, the luminance evaluation value for the entire area of the image data is calculated (step A2401). Next, the dark luminance threshold value of the image is calculated (step A2402). The dark luminance threshold is a value for determining whether the optical path of the microscope body 1 is blocked and the entire image is dark or whether the light path is opened and the brightness of the entire image is brighter than when the optical path is blocked. is there. This dark luminance threshold is given by the following equation, for example.
(Dark luminance threshold) = (predicted luminance evaluation value of the entire image when the optical path is blocked) × (current exposure time) / (exposure time when predicting the luminance evaluation value of the entire image when the optical path is blocked) ) X (margin factor)
Note that the predicted brightness evaluation value of the entire image at the time of the light path interruption, the exposure time when measuring the brightness evaluation value of the entire image at the time of the light path interruption, and the margin coefficient (for example, 1.2 in this embodiment). ) And the like are stored in the control unit 50, and are set from the control unit 50 to the AE calculation unit 49 ′.

  After calculating the dark luminance threshold value in step A2402, it is determined in step S2403 whether or not the exposure time is fixed. When the exposure time is not fixed, that is, when the exposure time is updated, the process proceeds to step S2404. When the exposure time is fixed, the process proceeds to step S2407.

  When the exposure time is in the updated state, it is determined in step A2404 whether the optical path of the microscope body 1 is blocked and the entire image is dark. Specifically, for example, when the luminance evaluation value of the entire area calculated this time in step A2401 is equal to or less than the dark luminance threshold value, it is determined that the entire image has become dark, that is, the optical path is blocked.

  If it is determined in step A2404 that the optical path of the microscope body 1 has been blocked and the entire image has become dark, the process proceeds to step A2405. In step A2405, an exposure time fixed state duration counting timer described later is started, and the process proceeds to step A2406. As a result of determining the state of the exposure time, “exposure time fixed” is returned to step A24 in FIG. 8 (step A2406), and the exposure time fixed / update determination process is terminated.

  If it is not determined in step A2404 that the optical path of the microscope body 1 has been blocked, the process proceeds to step A2410. In step A2410, “exposure time update” is returned to step A24 in FIG. 8 as a result of determining the state of the exposure time, and the exposure time fixed / update determination process is terminated.

If it is determined in step A2403 that the exposure time is fixed, the process proceeds to step A2407.
In step A2407, it is determined whether or not the optical path of the microscope main body 1 is opened and the brightness of the entire image is brighter than the brightness in the optical path blocking state. Specifically, for example, when the luminance evaluation value of the entire area calculated in step A2401 exceeds the dark luminance threshold value, it is determined that the entire image is brighter than the brightness in the light path blocking state, that is, the light path is opened.

  If YES in step A2407, that is, if it is determined that the optical path of the microscope main body 1 is opened and the entire image is brightened, the process proceeds to step S2409. In step A2409, the exposure time fixed state duration count timer is stopped, and the process proceeds to step A2410. In step A2410, “exposure time update” is returned to step A24 in FIG. 8 as a result of determining the state of the exposure time, and the exposure time fixed / update determination process is terminated.

  If NO in step A2407, that is, if it is determined that the optical path of the microscope main body 1 is not opened and remains blocked, the process proceeds to step A2408. In step A2408, it is confirmed whether the exposure time fixed state duration count timer has timed out.

  If the exposure time fixed state duration count timer has not timed out in step A2408, the process proceeds to step A2406. As a result of determining the state of the exposure time in step A2406, “exposure time fixed” is returned to step A24 in FIG. 8, and the exposure time fixed / update determination process is terminated.

  If the exposure time fixed state duration count timer has timed out in step A2408, the process proceeds to step A2409. In step A2409, the exposure time fixed state duration count timer is stopped, and the process proceeds to step A2410. In step A2410, in order to forcibly cancel the exposure time fixed state, “exposure time update” is returned to step A24 in FIG. 8, and the exposure time fixed / update determination process is terminated.

  FIG. 10 is a diagram showing an outline of a change in the luminance evaluation value of the entire area of the image data when the spectrographer switches the spectroscopic method from bright field observation to fluorescence observation. The vertical axis represents the luminance evaluation value of the entire area of the image data, and the horizontal axis represents time. FIG. 10 is used to show the relationship between the operation of the spectroscope and the operation of the microscope imaging apparatus according to the above-described embodiment.

At time 0 to t ₃ , the optical path of the microscope body 1 remains open, for example, while the spectroscope is observing observation image data. While the image brightness is kept constant, it is executed every time image data for one frame is stored in the frame memory 45, and the exposure time is updated in real time.

At time t _3, switch the objective lens 27 observer operates the revolver 28 of the microscope main body 1, or switch microscopy by operating the cube unit 30, operates the transmission shutter 161 and the shutter 23 for reflected illumination The microscope is operated such that the illumination optical path is opened and closed and the optical path is opened after being interrupted. At this time, first, the brightness of the image data captured by the image sensor 42 and stored in the frame memory 45 is a dark image. At point B, the luminance evaluation value of the entire area of the image data becomes equal to or less than the dark luminance threshold value, and the exposure time is fixed by the AE calculation unit 49 ′.

When the spectroscope operates the microscope and the optical path is opened (time t ₄ ), the brightness of the image data captured by the image sensor 42 and stored in the frame memory 45 becomes brighter than the brightness in the optical path blocking state. . At point C, the luminance evaluation value of the entire area of the image data exceeds the dark luminance threshold value, and the calculation and update of the exposure time are resumed. Thus, switching to fluorescence observation is completed. Even if the imaging device does not determine that the optical path has been opened despite the optical path being opened, the exposure time fixed state duration count timer times out after a certain period of time, and the exposure time calculation and Update is resumed.

  As described above, according to the microscope imaging apparatus according to the present embodiment, the exposure time is fixed while the optical path is blocked. Therefore, the exposure time does not become longer due to automatic control. For this reason, it is possible to prevent the high-intensity light emission.

A third embodiment is shown. For example, it relates to the control of the exposure time when switching from a relatively dark image to a bright image, such as switching from fluorescent observation to bright field observation.
The microscope system according to the third embodiment has the configuration shown in FIGS. 1, 2 and 7 as in the second embodiment. This is the same as the second embodiment in that the fixing / updating of the exposure time is controlled based on the change in the luminance evaluation value of the image data read from the frame memory 45. However, it is different from the second embodiment in that the exposure time can be set to the shortest when the luminance increases.

Hereinafter, a case where the spectrographer switches from the fluorescence observation to the bright field observation while looking at the observation image of the sample displayed on the display unit 47 with respect to the difference from the second embodiment in the processing of the AE calculation unit 49 ′. Let's take an example.
In the initial state, since observation is performed by fluorescence observation, the observation image is relatively dark and the exposure time is a long exposure state.

  In the long exposure state, the spectrographer operates the microscope to switch the spectroscopic method from fluorescence observation to bright field observation. At this time, the optical path is blocked, and the image data captured by the image sensor 42 and stored in the frame memory 45 is a dark image whose entire image is equal to or less than the dark luminance threshold. As a result, the AE calculation unit 49 ′ performs a process of fixing the exposure time.

  Eventually, when the operation of the spectrographer is completed and the spectroscopic method is switched to bright field observation, the optical path is opened. At this time, since the sample is irradiated with illumination light in the long exposure state, the brightness of the image data captured by the image sensor 42 and stored in the frame memory 45 becomes very bright. At this time, a process for setting the exposure time to the shortest within a range in which the exposure time can be set is performed.

Hereinafter, the processing executed by the AE calculation unit 49 ′ will be described in detail using a flowchart.
FIG. 11 is a flowchart illustrating a process executed by the AE calculation unit of the microscope imaging apparatus according to the third embodiment. The processing in FIG. 5 is realized by the control unit 50 executing a control program stored in the memory 50a in the control unit 50, and is executed when image data for one frame is accumulated in the frame memory 45. Is done.

  First, upon receiving a notification that the luminance has increased, the AE calculation unit 49 ′ instructs the memory controller 46 to temporarily hold the reading of image data from the frame memory 45 to the display unit 47 (step A30). When the reading of the image data is suspended, even if an instruction to read the image data is issued from the frame memory 45 to the display unit 47 from the control unit 50 to the memory controller 46, the frame memory is not executed until the suspension is released. The 45 image data is not displayed on the display unit 47.

  After setting not to display the image data on the display unit 47, the AE calculation unit 49 ′ reads the image data from the frame memory 45 via the memory controller 46 (step A31). For the read image data, the luminance evaluation value of the image area designated by the control unit 50 is calculated (step A32). The definition of the luminance evaluation value is the same as in the previous embodiment.

  The exposure state of the image data is determined from the brightness evaluation value calculated in step A32 and the target value designated by the control unit 50 (step A33). The target value is also defined in the same way as in the previous embodiment. The determination of the exposure state is obtained, for example, with an exposure time that is one step longer than the current exposure time from the luminance evaluation value of the image obtained at the current exposure time (that is, the luminance evaluation value calculated at step A32). If it is within the range up to the luminance evaluation value of the image, it is determined that the exposure is appropriate.

  As a result of the determination process in step A33, when it is determined that the exposure state of the image data is proper exposure, the process proceeds to step A38. The memory controller 46 is instructed to cancel the temporary hold of the image data read from the frame memory 45 to the display unit 47 (step A38), and the processing of the AE calculation unit 49 'is terminated. The instruction to read out image data to the display unit 47 from the control unit 50 that has been temporarily suspended becomes valid again, and the image data is read from the frame memory 45 to the display unit 47.

As a result of the determination process in step A33, if it is determined that the exposure state of the image data is not proper exposure, an exposure time operation type determination process described later is executed (step A34). Hereinafter, the exposure time operation type determination process will be described.
There are three types of exposure time operation types: fixed exposure time, updated exposure time, and shortest exposure time. The fixed exposure time means an exposure time control process in which the exposure time is kept at the current exposure time. Exposure time update means the process of changing the exposure time to an appropriate exposure time, and the shortest exposure time means the process of setting the exposure time to the shortest exposure time that can be set. To do.

  If the result of the exposure time operation type determination process in step A34 is the exposure time update, the process proceeds to step A35. In step A35, the exposure time is calculated so that the luminance evaluation value calculated in step A32 approaches the target value specified by the control unit 50. The formula for calculating the exposure time is the same as in the previous embodiment.

The exposure time calculated in step A35 is set in the CCD drive unit 44 (step A36), and the process proceeds to step A38. The exposure time set in the CCD drive unit 44 is used for imaging the next frame.
An instruction to cancel the temporary hold of the image data read from the frame memory 45 to the display unit 47 is issued to the memory controller 46 (step A38), and the process is terminated.

  If the result of the exposure time operation type determination process in step A34 is a fixed exposure time, the process proceeds to step A38. In step A38, an instruction is issued to the memory controller 46 to cancel the temporary hold of reading the image data from the frame memory 45 to the display unit 47. When the process of step A38 is executed, the process in the AE calculation unit 49 ′ is terminated.

If the result of the exposure time operation type determination process in step A34 is the shortest exposure time, the process proceeds to step A37. In step A37, the shortest exposure time within a settable range is set in the CCD drive unit 44, and the process in the AE calculation unit 49 ′ is terminated.
In the process with the shortest exposure time, the temporary hold of reading image data from the frame memory 45 to the display unit 47 is not canceled. Therefore, the image data stored in the frame memory 45 is not displayed on the display unit 47.

The exposure time operation type determination process in step A34 will be described in detail below in comparison with the exposure time fixed / update determination process according to the second embodiment.
FIG. 12 is a flowchart illustrating the exposure time operation type determination process of the microscope imaging apparatus according to the third embodiment. The processing in the figure is also realized by the control unit 50 executing a control program stored in the memory 50a in the control unit 50.

The calculation of the luminance evaluation value for the entire area of the image data in step A3401 and the calculation of the dark luminance threshold value in step A3402 are the same as in the second embodiment, and thus description thereof is omitted here. In step A3403, an exposure time operation type is determined.
The processing for determining the exposure time operation type in step A3403 is different from the exposure time fixing / update determination processing according to the second embodiment, such as when the optical path is opened after switching from fluorescence observation to bright field observation. This is a process in the case where the brightness of the data increases, and this corresponds to the process from step A3407 to step A3410.

Processing in steps A3407 to A3410 will be described.
In step A3407, the luminance evaluation value of the entire area of the image data obtained in step A3401 is compared with the dark luminance threshold obtained in step A3402. When the optical path is opened after switching from the fluorescence observation to the bright field observation, the luminance evaluation value of the entire image data area is larger than the dark luminance threshold value (in the case of YES at step A3407), the processing proceeds to step A3408. move on.

  In step A3408, in order to determine whether or not the brightness of the entire image is too bright, the brightness evaluation value of the entire image data area used in step A3407 is compared with the bright brightness threshold. Note that the bright brightness threshold is a value designated by the control unit 50, and is, for example, 240 for the range of the brightness data of the image from 0 to 255.

  When the optical path is opened after switching from the fluorescence observation to the bright field observation, the brightness evaluation value of the entire image data area is equal to or greater than the bright brightness threshold, that is, the brightness of the entire image becomes brighter as the optical path of the microscope body 1 is opened. It becomes too much. Therefore, the determination result of step A3408 is YES, and the process proceeds to step A3409.

  In step A3409, the exposure time fixed state duration count timer is stopped, and the process proceeds to step A3410. In step A3410, as a result of determining the exposure time operation type, “shortest exposure time” is returned to step A34 in FIG. 11, and the exposure time operation type determination process is ended.

  As described above, when the luminance evaluation value of the entire area of the image data becomes too large in the processing from step A3407 to step A3410, the exposure time is set to the shortest possible range. Unlike the case where the exposure time is automatically controlled, high-luminance emission can be prevented even when the optical path is opened.

  In the exposure time operation type determination process in step A3403 for the next image data read from the frame memory 45 after the opening of the optical path is detected on the imaging device side and the exposure time is set to the shortest possible range, the exposure time The operation type is set to the shortest exposure time. At this time, the process proceeds to step A3413. In step A3413, “exposure time update” is returned to step A34 in FIG. 11 as a result of determining the exposure time operation type, and the exposure time operation type determination process is ended.

  Thus, for example, in order to switch the spectroscopic method from fluorescence observation to bright field observation, when the optical path is first blocked and then opened again after switching, the exposure time can be set once before the optical path is opened. Set to the shortest. Once the exposure time is set to the shortest time, it is reset to the updated state and the exposure time is automatically controlled.

  In fluorescence observation, if the exposure time is automatically controlled, it becomes a long exposure time. Therefore, if the optical path is opened by switching to bright field observation, the brightness rapidly increases immediately after the optical path is released and there is a possibility of emitting high brightness. . According to the imaging apparatus for a microscope according to the present embodiment, it is possible to prevent this high luminance light emission.

It is a figure which shows the structure of the microscope system to which the imaging device for microscopes concerning a present Example is applied. It is a figure which shows the detailed structure of a microscope system. It is a figure which shows the structure of the imaging device for microscopes concerning a 1st Example. 5 is a flowchart illustrating processing executed by a contrast calculation unit in the first embodiment. 5 is a flowchart illustrating processing executed by an AE calculation unit in the first embodiment. In a 1st Example, it is a figure which shows the outline of the time change of the contrast value accompanying a focusing operation. It is a figure which shows the structure of the imaging device for microscopes concerning a 2nd Example. It is a flowchart which shows the process performed by the AE calculating part in a 2nd Example. 10 is a flowchart showing exposure time fixing / update determination processing in the second embodiment. In a 2nd Example, it is a figure which shows the outline of a change of a brightness | luminance evaluation value when the spectrographer switches the spectroscopic method from bright field observation to fluorescence observation. It is a flowchart which shows the process performed in the AE calculating part in a 3rd Example. In a 3rd Example, it is a flowchart which shows an exposure time operation classification determination process.

Explanation of symbols

1 Microscope body 3 Sample (specimen)
6 eyepiece unit 6a eyepiece 7 Z revolver 27 objective lens 28 revolver 36 imaging device 42 imaging element 43 pre-processing unit 44 CCD drive unit 45 frame memory 46 memory controller 47 display unit 48 contrast calculation unit 49 AE calculation unit 49 'AE Calculation unit 50 Control unit 50a Memory 51 Information input unit

Claims (12)

In a microscope imaging apparatus having a function of calculating the required exposure time in order for the microscope to obtain an observation image with proper exposure,
A detection means for detecting a change in the state of the microscope from a change in the observed image accompanying the operation of the microscope;
When the detection means detects a change in the state of the microscope, a determination means for determining whether it is necessary to set an exposure time adapted to the change;
An imaging apparatus for a microscope, comprising: an exposure time setting means for setting an exposure time adapted to a change in an observation image when the judgment means judges that an exposure time adapted to the change is necessary. . The detection means detects a change in contrast of an observation image due to a focusing operation of a microscope,
The determination means calculates a change in contrast of the observation image, and determines that it is unnecessary to set an exposure time adapted to the change when the calculated value exceeds a threshold value. The imaging apparatus for a microscope according to 1. The detection means detects a change in luminance of the observation image data,
The determination means calculates a luminance evaluation value based on the luminance of the observation image data. If the calculated value is equal to or less than a threshold value indicating a lower limit of the luminance evaluation value, it is determined that it is not necessary to set an exposure time adapted to the change. 2. The microscope imaging apparatus according to claim 1, wherein when the calculated value exceeds a threshold value indicating a lower limit of the luminance evaluation value, it is determined that an exposure time adapted to the change needs to be set. . The determination means, as a result of comparing the calculated luminance evaluation value and a threshold value indicating the lower limit of the luminance evaluation value, the calculated value exceeds the threshold value indicating the lower limit of the luminance evaluation value, and the calculated value and the luminance evaluation value A comparison is made with a threshold value indicating the upper limit of the value, and if the calculated value exceeds the threshold value indicating the upper limit, it is determined that it is necessary to set an exposure time adapted to the change,
The exposure time setting means sets the exposure time to the shortest possible range before setting the exposure time adapted to the change, and
4. The microscope imaging apparatus according to claim 3, further comprising display holding means for temporarily not displaying an observation image of the microscope. In the control method of the imaging apparatus for a microscope having a function of calculating a required exposure time in order for the microscope to obtain an observation image with proper exposure,
Detects changes in the state of the microscope from changes in the observed image that accompany the operation of the microscope,
When a change in the microscope state is detected, it is determined whether an exposure time setting suitable for the change is necessary,
A control method for an imaging apparatus for a microscope, comprising: setting an exposure time adapted to a change in an observed image when it is determined that an exposure time adapted to the change is necessary. Detect changes in the contrast of the observed image due to the focusing operation of the microscope,
6. The microscope according to claim 5, wherein a change in contrast of the observation image is calculated, and when the calculated value exceeds a threshold value, it is determined that setting of an exposure time adapted to the change is unnecessary. Control method of imaging apparatus. Detect changes in brightness of observation image data,
When a luminance evaluation value based on the luminance of the observation image data is calculated and the calculated value is equal to or lower than a threshold value indicating the lower limit of the luminance evaluation value, it is determined that setting of an exposure time adapted to the change is unnecessary, and the calculated value is 6. The method for controlling an imaging apparatus for a microscope according to claim 5, wherein when a threshold value indicating a lower limit of the luminance evaluation value is exceeded, it is determined that an exposure time adapted to the change needs to be set. As a result of comparison between the calculated luminance evaluation value and the threshold value indicating the lower limit of the luminance evaluation value, the calculated value exceeds the threshold value indicating the lower limit of the luminance evaluation value, and indicates the upper limit of the calculated value and the luminance evaluation value. Compared with the threshold value, if the calculated value exceeds the threshold value indicating the upper limit, it is determined that it is necessary to set the exposure time adapted to the change,
Before setting the exposure time to adapt to changes, set the exposure time to the shortest possible range,
8. The method for controlling a microscope imaging apparatus according to claim 7, wherein an observation image of the microscope is not displayed once. A program executed by a control unit in a microscope imaging apparatus having a function of calculating a required exposure time in order for the microscope to obtain an observation image with proper exposure,
Detects changes in the state of the microscope from changes in the observed image that accompany the operation of the microscope,
When a change in the microscope state is detected, it is determined whether an exposure time setting suitable for the change is necessary,
A program comprising a procedure for setting an exposure time adapted to a change in an observation image when it is determined that an exposure time adapted to the change is necessary. Detect changes in the contrast of the observed image due to the focusing operation of the microscope,
10. The method according to claim 9, further comprising a step of calculating a change in contrast of the observation image and determining that setting of an exposure time adapted to the change is unnecessary when the calculated value exceeds a threshold value. The program described. Detect changes in brightness of observation image data,
When a luminance evaluation value based on the luminance of the observation image data is calculated and the calculated value is equal to or lower than a threshold value indicating the lower limit of the luminance evaluation value, it is determined that setting of an exposure time adapted to the change is unnecessary, and the calculated value is The program according to claim 9, further comprising a procedure for determining that an exposure time adapted to a change needs to be set when a threshold value indicating a lower limit of the luminance evaluation value is exceeded. As a result of comparison between the calculated luminance evaluation value and the threshold value indicating the lower limit of the luminance evaluation value, the calculated value exceeds the threshold value indicating the lower limit of the luminance evaluation value, and indicates the upper limit of the calculated value and the luminance evaluation value. Compared with the threshold value, if the calculated value exceeds the threshold value indicating the upper limit, it is determined that it is necessary to set the exposure time adapted to the change,
Before setting the exposure time to adapt to changes, set the exposure time to the shortest possible range,
The program according to claim 11, further comprising a procedure of temporarily not displaying an observation image of the microscope.

Images