WO2012117673A1

WO2012117673A1 - Digital microscope

Info

Publication number: WO2012117673A1
Application number: PCT/JP2012/000823
Authority: WO
Inventors: 洋一上代
Original assignee: 株式会社ハイロックス
Priority date: 2011-03-03
Filing date: 2012-02-08
Publication date: 2012-09-07
Also published as: JP2012185210A

Abstract

A digital microscope (1) includes: a light emitting diode (34); an optical system for irradiating a sample with light emitted from the light emitting diode (34); an image capturing element that captures an image of the sample by subjecting the light reflected or scattered by the sample to optical-electrical conversion; a control unit (35) that controls the image capturing element so as to capture images of the sample a plurality of times; and a display unit (31) that displays the images captured by the image capturing element. Thus, an unprecedented digital microscope is provided by solving the problem that illuminance does not become stable in a certain period of time after the light source is lit up.

Description

Digital microscope

Related applications

This application claims the benefit of Patent Application No. 2011-046470 filed in Japan on March 3, 2011, the contents of which are incorporated herein by reference.

The present invention relates to a digital microscope that displays an image picked up by an image pickup device such as a CCD on a monitor.

Conventionally, for example, as shown in Patent Document 1, a digital microscope has been known in which a sample is imaged by an image sensor such as a CCD and the captured image is displayed on a monitor. Conventionally, lamps such as halogen lamps have been used as light sources for such digital microscopes.

JP 2000-214790 A

By the way, halogen lamps require a certain amount of time (approximately 5 to 10 minutes depending on the product) to stabilize after the lamps are turned on. For this reason, when a plurality of images are captured within a certain period of time after the lamp is turned on, there are cases in which it is impossible to capture under the same conditions. In view of the above background, an object of the present invention is to provide a digital microscope that has not existed before.

The digital microscope of the present invention includes a light emitting diode, an optical system for irradiating the sample with light emitted from the light emitting diode, and an imaging unit that images the sample by photoelectrically converting light reflected or scattered from the sample. A control unit that controls the imaging unit so that the sample is imaged a plurality of times, and a display unit that displays an image captured by the imaging unit.

発光 Light emitting diodes have a shorter time from when they are lit until the illuminance is stabilized, compared to halogen lamps. According to the configuration of the present invention, since the light emitting diode is used as the light source, it is possible to take an image under the same irradiation condition even if imaging is performed a plurality of times immediately after lighting, and an image captured under the same irradiation condition is displayed on the display unit. can do. The display unit may display the images at the same time by arranging or synthesizing images based on the imaging data captured at different times. Thus, even when images taken at different times are displayed at the same time, since the images are taken under the same irradiation conditions, a sense of incongruity caused by the difference in the imaging conditions is unlikely to occur.

The digital microscope according to the present invention includes an image processing unit that performs a process of connecting a plurality of images captured while shifting a position to be captured by the imaging unit, and the display unit is connected by the image processing unit. An image may be displayed. Further, the control unit may perform control to move a stage on which the sample is placed so as to image the sample while shifting a position to be imaged.

When performing so-called “tiling” to create a wide range of images by joining together multiple images with slightly different locations (imaging areas), it is necessary to capture multiple images under the same conditions. It is. According to the configuration of the present invention, since a plurality of images captured under the same irradiation condition can be connected, an appropriate tiling image can be generated.

The digital microscope of the present invention includes an operation unit that accepts setting of an imaging schedule, and a storage unit that stores the imaging schedule received by the operation unit, and the imaging unit stores the imaging schedule stored in the storage unit. Imaging may be performed based on this.

For example, in the case of repeatedly capturing images at a predetermined time based on the imaging schedule, such as when capturing the state of mold propagation, under the same conditions in order to appropriately grasp changes over time It is necessary to take an image. According to the configuration of the present invention, since imaging can be performed under the same irradiation conditions, it is possible to appropriately grasp the temporal change of the sample from the captured image.

In the digital microscope of the present invention, the light emitting diode may be turned on immediately before imaging by the imaging unit, and the light emitting diode may be turned off after the imaging.

Since the brightness level of the light emitting diode is stable immediately after lighting, it is possible to save power by lighting it immediately before imaging.

In the present invention, by using a light emitting diode as a light source, it is possible to capture images under the same irradiation conditions even after multiple times of imaging with a time interval immediately after lighting, and display the image on the display unit. Have

As described below, there are other aspects of the present invention. Accordingly, the disclosure of the present invention is intended to provide part of the invention and is not intended to limit the scope of the invention described and claimed herein.

It is a figure which shows the external appearance of the digital microscope of embodiment. It is a figure which shows the structure of an imaging device typically. It is a figure which shows the structure of a main body apparatus. It is a figure which shows operation | movement of a tiling process. It is a figure which shows the operation | movement of a timer imaging. It is a figure which shows the conventional tiling image. It is a figure which shows the tiling image by the digital microscope of this Embodiment.

Hereinafter, a digital microscope according to an embodiment of the present invention will be described with reference to the drawings. The embodiments described below are merely examples of the present invention, and the present invention can be modified in various ways. Accordingly, the specific configurations and functions disclosed below do not limit the scope of the claims.

FIG. 1 is a diagram illustrating an appearance of a digital microscope according to the embodiment. The digital microscope 1 includes an imaging device 10 that images a sample, and a main body device 30 that processes and manages the captured image. The imaging device 10 and the main device 30 are connected by an optical fiber bundle 19 and a data cable 20. In the present embodiment, the aspect in which the imaging device 10 and the main body device 30 are separated is described. However, the digital microscope 1 integrates the imaging device 10 and the main body device 30 and displays a captured image on the imaging device 10. You may provide the function to process and the screen which displays an image.

The optical fiber bundle 19 supplies light from the light source of the main body device 30 to the imaging device 10. The data cable 20 transmits image data captured by the imaging device 10 and data indicating the zoom magnification and the position of the stage 11 to the main body device 30. In FIG. 1, one data cable 20 is shown. However, a cable for transmitting image data, a cable for transmitting zoom magnification data, and a cable for transmitting data indicating the position of the stage 11 may be provided. Good.

FIG. 2 is a diagram schematically illustrating the configuration of the imaging device 10. The imaging device 10 basically has the same configuration as the optical microscope. The imaging device 10 includes a stage 11 on which a sample is placed, and an imaging element 15 that images the sample placed on the stage 11. On the optical axis connecting the stage 11 and the image sensor 15 (hereinafter referred to as “imaging optical axis A”), the objective lens 12, the half mirror 13, and the magnifying optical system 14 are arranged.

The half mirror 13 reflects light incident from the direction perpendicular to the imaging optical axis A. The reflected light is irradiated on the stage 11 as bright field irradiation light. The half mirror 13 is reflected or scattered by the sample on the stage 11 and transmits light traveling toward the image sensor 15. A ring lens 16 is attached to the objective lens 12. An optical fiber is connected to the ring lens 16, and light is supplied through the optical fiber. The ring lens 16 supplies dark field illumination light to the stage 11 from the side. A ring-shaped prism (not shown) is attached to the ring lens 16, and the light from the ring lens 16 is directed to the sample placed on the stage 11 by the prism.

The optical fiber bundle 19 that connects the main body device 30 and the imaging device 10 is branched in the imaging device 10. Two

optical fiber bundles

17 and 18 are arranged adjacent to each other in the same direction in the vicinity of the light output end of the optical fiber bundle 19. The light exit end of the optical fiber bundle 19 and the light entrance ends of the

optical fiber bundles

17 and 18 face each other, and light emitted from the optical fiber bundle 19 enters the

optical fiber bundles

17 and 18. One of the two

optical fiber bundles

17 and 18 is an optical fiber bundle 17 that supplies light to the half mirror 13. An irradiation optical system 21 including a plurality of lenses and mirrors is disposed at the light output end of the optical fiber bundle 17. The other optical fiber bundle 18 is an optical fiber that supplies light to the ring lens 16. The optical fiber bundle 18 extends to the objective lens 12 to which the ring lens 16 is attached.

The optical fiber bundle 19 is held by a holding member 22 (see FIG. 2). This holding member 22 slides by operation of the operation part 23 (refer FIG. 1). The direction of sliding is within the plane where the light exit end of the optical fiber bundle 19 and the light entrance ends of the optical fiber bundle 17 and the optical fiber bundle 18 are opposed to each other, and the center of the light entrance end of the optical fiber bundle 17 and the optical fiber. This is a linear direction connecting the centers of the light incident ends of the bundle 18. With this configuration, the amount of light entering the optical fiber bundle 17 and the optical fiber bundle 18 from the optical fiber bundle 19 can be changed to change the mixing ratio of the bright field illumination light and the dark field illumination light.

The movement amount of the optical fiber bundle 19 is determined according to the operation amount of the operation unit 23 provided in the imaging device 10. In the present embodiment, the operation unit 23 is a dial-type operation unit 23 as shown in FIG. In this embodiment, the digital microscope 1 capable of performing both bright field illumination and dark field illumination is taken as an example. However, the present invention may be applied to a digital microscope that performs only bright field illumination or only dark field illumination. Is possible.

FIG. 3 is a diagram illustrating a configuration of the main body device 30 of the digital microscope 1. The main unit 30 includes a display unit 31 that displays an image, an operation unit 32 that receives input of necessary information, a storage unit 33 that stores an image captured by the imaging device 10, and a light emitting diode as a light source. 34 and a control unit 35 that controls the operation of the main body device 30.

The light emitting diode 34 is connected to the open end of the optical fiber bundle 19 through a collimating lens. The collimating lens is arranged so that the light emitted from the light emitting diode 34 is matched with N / A at the opening end of the optical fiber bundle 19.

The control unit 35 includes a lighting control unit 36 that controls the lighting of the light emitting diode 34, a stage control unit 37 that controls the operation of the stage 11, an image sensor control unit 38 that controls the image sensor 15, and a captured image. It has an image processing unit 39 that performs processing, and a timer management unit 40 that manages imaging timing. Here, reference is made to the configuration necessary for the description of the digital microscope 1 of the present embodiment, but the control unit 35 has a function for operating the digital microscope 1 in addition to the functions described here. is doing.

The image processing unit 39 has an image processing function such as enlarging or reducing a captured image, or generating a stereoscopic image of a sample using images captured from a plurality of directions. One has a tiling function. Tiling is a function that generates a large image by stitching together aligned images.

FIG. 4 is a flowchart showing the tiling process. First, the control unit 35 of the main body device 30 causes the imaging device 15 to perform imaging under the control of the imaging device control unit 38 while gradually moving the stage 11 on which the sample is placed by the stage control unit 37. Then, the main device 30 stores the captured image in the storage unit 33 (S10). Thereby, a plurality of images with continuous imaging regions are obtained.

Next, the image processing unit 39 performs image matching between adjacent images and obtains corresponding pixels (S12). At this time, by predicting the range in which the corresponding pixel exists based on the movement amount of the stage 11 when the image is captured, the matching range can be limited, and the calculation amount can be reduced. Subsequently, the image processing unit 39 synthesizes adjacent images so that corresponding pixels match based on the matching result (S14). The image processing unit 39 determines whether or not the synthesis of all captured images has been completed (S16), and if it is determined that the synthesis of all images has not been completed (NO in S16), the next image The synthesis process is performed. If it is determined that all the images have been combined (YES in S16), the tiling process ends. With the above operation, one tiling image can be generated from a plurality of images captured while moving the stage 11. In the present embodiment, an example has been described in which the stage 11 is moved under the control of the stage control unit 37, and an image in which a position to be imaged is shifted is captured. However, the stage 11 may be moved manually. Also in this case, the image processing unit 39 manually obtains corresponding pixels from a plurality of images picked up by moving the stage 11 and synthesizes adjacent images.

The timer management unit 40 manages the timing of imaging with a timer. The timer management unit 40 transmits a signal instructing the imaging timing to the imaging element 15. By managing the imaging timing by the timer management unit 40, it is possible to realize timer imaging that performs imaging at a predetermined timing.

FIG. 5 is a flowchart showing the timer imaging process. First, the main body device 30 receives an input of setting values (for example, an imaging interval and an end time) that define imaging timing (S20). When a setting value is input from the operation unit 32, the main body device 30 stores the setting value in the storage unit 33. The timer management unit 40 refers to the setting value stored in the storage unit 33 and determines whether or not the imaging time has come (S22). When the imaging time has arrived (YES in S22), the timer management unit 40 transmits an imaging instruction signal to the image sensor 15 and performs imaging (S24). The timer management unit 40 determines whether or not the end time has come (S26). If the end time has come (YES in S26), the timer imaging ends. If it is not the end time (NO in S26), the process returns to the determination of whether or not the imaging time has come, and the timer imaging is continued.

The configuration of the digital microscope 1 according to the present embodiment has been described above. Since the digital microscope 1 of the present embodiment uses the light emitting diode 34 as a light source, the time required for the illuminance to stabilize is shorter than that of a conventionally used halogen lamp. Thereby, even when imaging is performed at different times immediately after lighting, an image with the same irradiation condition is obtained. The display unit 31 displays a plurality of images taken at different times. However, since the irradiation conditions are the same, the display unit 31 can appropriately compare or appropriately combine the images.

Since the digital microscope 1 according to the present embodiment performs tiling using a plurality of images captured under the same irradiation conditions, an appropriate tiling image can be generated. FIG. 6A is a diagram showing a problem of a tiling image generated using an image captured by the conventional digital microscope 1, and FIG. 6B is a tie generated using an image captured by the digital microscope 1 of the present embodiment. It is a figure which shows a ring image.

As shown in FIG. 6A, in the conventional digital microscope 1, since the illuminance is not stable until a certain time has elapsed after the light source is turned on, the image becomes dark when the luminance level is low. When there is such a part, it is not preferable to perform luminance correction of the part. Because it is difficult to determine whether the brightness is dark because the illuminance was unstable or whether there was any defect, and if the image is corrected, the defect that actually exists is overlooked This is because there is a possibility. Therefore, if there is a defect in a part, it is necessary to retake all the images constituting the tiling image, which is very inefficient. On the other hand, in the digital microscope 1 according to the present embodiment, as shown in FIG. 6B, it is possible to generate an appropriate tiling image by connecting images captured at the same luminance level.

Since the digital microscope 1 according to the present embodiment can perform imaging under the same irradiation condition even after a long time, in the timer imaging that performs imaging at a predetermined interval, the temporal change of the sample can be performed under the same irradiation condition. An image suitable for observation can be taken.

Although the presently preferred embodiments of the present invention have been described above, various modifications can be made to the present embodiments, and such modifications are within the true spirit and scope of the present invention. It is intended that the appended claims include all modifications.

As described above, the present invention has an effect of being able to capture images under the same irradiation conditions even when captured multiple times at intervals, and is useful as a digital microscope that displays captured images on a display unit.

DESCRIPTION OF SYMBOLS 10 Image pick-up equipment 11 Stage 12 Objective lens 13 Half mirror 14 Magnification optical system 15 Image pick-up element 16 Ring lens 17-19 Optical fiber bundle 20 Data cable 21 Irradiation optical system 22 Holding member 23 Operation part 30 Main body apparatus 31 Display part 32 Operation part 33 Storage unit 34 Light emitting diode 35 Control unit 36 Lighting control unit 37 Stage control unit 38 Image sensor control unit 39 Image processing unit 40 Timer management unit

Claims

A light emitting diode;
An optical system for irradiating the sample with light emitted from the light emitting diode;
An imaging unit that photoelectrically converts light reflected or scattered by the sample and images the sample;
A control unit that controls the imaging unit so as to image the sample a plurality of times;
A display unit for displaying an image captured by the imaging unit;
Digital microscope equipped with.
An image processing unit that performs a process of stitching together a plurality of images captured while shifting the location to be imaged by the imaging unit;
The digital microscope according to claim 1, wherein the display unit displays the images joined by the image processing unit.
3. The digital microscope according to claim 2, wherein the control unit performs control to move a stage on which the sample is placed so as to capture the sample while shifting a position to be imaged.
An operation unit for accepting an imaging schedule setting;
A storage unit for storing an imaging schedule received by the operation unit;
With
The digital microscope according to claim 1, wherein the imaging unit performs imaging based on an imaging schedule stored in the storage unit.
The digital microscope according to any one of claims 1 to 4, wherein a light emitting diode is turned on immediately before imaging is performed by the imaging unit, and the light emitting diode is turned off after the imaging.