JPH10253896A - Image input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image input device allowing easy operation and having the capability of quickly composing an optimum and proper image of large depth, depending on a subject. SOLUTION: Judgement is quickly made about which side of a contrast curve corresponds to a stage 102, on the basis of a contrast change resulting from the slight motion of the stage 102. Then, the stage 102 is moved in a direction for lowering contrast and then the motion of the stage 102 is reversed in a direction where a contrast value increases toward a peak value. Also, an image adding circuit 102 starts an image adding process, when the extent of the change of the contrast value of the photographed image of a sample at each focused position as a result of the reversed motion, satisfies the prescribed condition.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image in which the depth of focus is enlarged by adding the images of the thick object to be observed with an optical microscope at the respective focal planes at each height position (hereinafter, referred to as "the depth of focus"). A high-depth image).

[0002]

2. Description of the Related Art When an image of a subject is analyzed using an input image of the subject, it is required that the input image be a bright, high-resolution, deep-focus image. .

Therefore, in order to optically capture a bright image having a high resolution and a high magnification, an imaging optical system using an optical element having a large numerical aperture is used.

However, an imaging optical element represented by a lens has a small depth of focus as the numerical aperture increases.
If an imaging optical element with a large aperture is used to secure a large magnification, the depth of focus becomes shallow, so if a thick object has different height positions in the optical axis direction, Can focus only on one height position, and the image of the other part is blurred.

Therefore, in the field of using image equipment such as a microscope, a camera, and an endoscope, various means for increasing the depth of focus so as to focus on all the different height positions of the object are conventionally considered. ing.

As an example, Japanese Patent Application Laid-Open No. Hei 5-313068 discloses a multi-area distance measuring device. The spatial frequency characteristic in each area is changed by changing the focus position on the object plane by driving a lens with a lens driving device. After measuring the distance to each object in advance (preprocessing), the spatial frequency characteristics of the images of the plurality of object surfaces in the field of view become the most uniform in each area of the cumulatively added image. There is disclosed a technique (post-processing) of combining such images by driving a lens with a lens driving device to perform cumulative addition.

Japanese Patent Application Laid-Open No. 60-68312 discloses that the focus position is moved from the focus position of the most convex portion of the sample in the field of view to the focus position of the most concave portion. There has been disclosed a technique for constructing an image with an increased depth of focus by sequentially integrating light amounts on a film.

Further, Japanese Patent Application Laid-Open No. 1-309478 discloses a technology for taking and integrating images while discretely changing the focus position of an optical system at appropriately set distance intervals and distance ranges, and a TV camera. A technique is disclosed in which the focus plane of a sample is continuously changed by a focus level driving device to capture and integrate images during a time period during which an image is accumulated in the light receiving element section.

[0009]

SUMMARY OF THE INVENTION However, Japanese Patent Application Laid-Open No.
In the device disclosed in Japanese Patent No. 313068, since a lens must be driven in advance in an expected focusing range of an object and a spatial frequency characteristic must be measured before an image capturing operation, a high-depth image can be obtained. There is a problem that extra time is required until construction, and the one disclosed in Japanese Patent Application Laid-Open No. 60-68312 does not require that the most convex part and the most concave part of the sample be set first. Therefore, there is a problem that the operation is troublesome and it takes a long time. Further, the method disclosed in Japanese Patent Application Laid-Open No. 1-309478 discloses a method in which the distance interval and the distance range set in advance are different for each sample. There is a problem that the operation has to be troublesome because the setting has to be reset every time is changed.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has as its object to provide an image input apparatus which is easy to operate and can quickly construct an optimal and good high-depth image according to an object. And

[0011]

According to the first aspect of the present invention,
Imaging means for imaging the object; focus position moving means for moving the focus position of the object relative to the image means; and imaging means for the object moved by the focus position movement means Image adding means for adding an image captured by the image capturing apparatus; contrast calculating means for calculating a contrast value of the image of the object captured by the image capturing means; The control unit monitors a change in the contrast value of the captured image and instructs the image addition unit to perform image addition based on a predetermined change in the contrast value.

According to a second aspect of the present invention, there is provided an image pickup means for picking up an image of an object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and a focus position moving means. Image adding means for adding an image of the moving object to be taken by the imaging means; contrast calculating means for calculating a contrast value of the image of the object to be taken by the imaging means; Parameter calculating means for calculating an image capturing parameter from the contrast value calculated by the contrast calculating means for each photographed object; and image adding to the image adding means based on the image capturing parameter calculated by the parameter calculating means. And a control means for instructing.

According to a third aspect of the present invention, there is provided an image pickup means for picking up an image of an object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and an image picked up by the image pickup means. Storage means for storing the amount of blur, a detection means for detecting a blur amount generated in the image obtained by the imaging means due to the movement of the focal point by the focus position moving means, and a storage means for the storage means based on the blur amount detected by the detection means. writing,
Address control means for controlling a read address, and an image obtained by adding the image obtained by the imaging means to the image read from the storage means by the address control of the address control means, and writing the added image in the storage means A contrast calculating means for calculating a contrast value of the image of the object captured by the adding means and the image capturing means, and monitoring a change in a contrast value of the image of the object calculated by the contrast calculating means; The control means instructs the image adding means to add an image when the contrast value changes to a predetermined value.

According to a fourth aspect of the present invention, in the first or third aspect of the invention, the control means can set a predetermined contrast value at a start position of the image addition by the image addition means.

According to a fifth aspect of the present invention, there is provided an image pickup means for picking up an image of an object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and an image picked up by the image pickup means. Storage means for storing the amount of blur, a detection means for detecting a blur amount generated in the image obtained by the imaging means due to the movement of the focal point by the focus position moving means, and a storage means for the storage means based on the blur amount detected by the detection means. writing,
Address control means for controlling a read address; contrast calculation means for calculating a contrast value of the image of the object imaged by the imaging means; and a contrast value of the image of the object image calculated by the contrast operation means. The control means monitors the change and instructs the storage means to store an image when the change in the contrast value becomes a predetermined change.

As a result, according to the first aspect of the present invention,
Image addition can be performed from the point in time when the contrast value of the captured image at a different focus position of the object changes at a predetermined value, so that a stable image region where the contrast value sharply increases is selected and image addition is performed. This makes it possible to quickly construct an optimal and good high-depth image according to the object to be photographed. In addition, since it is not necessary to set various conditions according to the object to be photographed in advance, which is conventionally required,
Operation is also easy.

According to the second aspect of the present invention, even for a sample that causes an error, a presample is performed before the image is captured, and the image capture parameters are set using the contrast curve of the sample. By using this parameter for the next image capture, it is determined that an error has occurred,
A high-depth image can be obtained even for a sample for which a final image was not obtained.

According to the third aspect of the present invention, when automatically constructing a high-depth image, even if the stage on which the observation sample is placed is shaken due to movement, it is similar to the case where no shake occurs. By performing contrast calculation, it is possible to determine an accurate focusing range, and by using this determined focusing range, blur correction is performed for image integration at the time of capturing and inputting an image so that an accurate image is not blurred. Input and obtain a good high-depth image.

According to the fourth aspect of the present invention, in addition to the operation of the first or third aspect of the present invention, a predetermined contrast can be obtained without setting a start position of image addition to capture a blurred image. Since only an image having a value or more is taken in, a high-quality high-depth image can be constructed without deteriorating the image quality of the added image.

According to the fifth aspect of the present invention, even if the stage on which the observation sample is mounted is shaken by the movement,
Contrast calculation is performed in the same manner as in the case where no blur occurs, an accurate in-focus position is determined, a blur correction is performed at the time of capturing and inputting an image at the determined in-focus position, and an accurate image is input without blur. be able to.

[0021]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 shows a schematic configuration of an image input apparatus to which the present invention is applied. In this case, the image input device includes an imaging unit 1, a device main body 2, a television monitor 3, and an operation unit 4.

The image pickup means 1 picks up an observation image of the object to be observed by the optical microscope 101. Here, the observation image of the sample as the object to be mounted on the stage 102 of the optical microscope 101 is converted to an intermediate magnification. CCD through lens 103
An image is taken by the camera 104. In this case, the stage 102 of the optical microscope 101 can be moved in the optical axis direction, that is, in the vertical direction by the stage driving circuit 105.

The apparatus main body 2 includes an image capturing circuit 201 as an image input means, an image adding circuit 202 as an image adding and storing means, an adding memory 203, a contrast calculating memory 204 as a contrast calculating means, a DSP2.
05, a CPU 206 as central control means, a spatial filter circuit 207 for performing a restoration process on the added image,
Displaying the image restored by the spatial filter circuit 207,
It has a display memory 208 for storing and an image display circuit 209 for displaying an image on the television monitor 3. In this case, the image capturing circuit 201 is connected to the video output terminal of the CCD camera 104 of the imaging means 1, and the output terminal of the image capturing circuit 201 is connected to one of the two inputs of the image adding circuit 202 and the contrast calculation memory 204.
Connected to each other. Contrast calculation memory 2
A DSP 205 is connected to the CPU 04, and a CPU 206 is connected to the DSP 205. An output terminal of the image addition circuit 202 is connected to an addition memory 203. An output terminal of the addition memory 203 is connected to an input terminal of the spatial filter circuit 207 and another input terminal of the image addition circuit 202. ing. An output terminal of the spatial filter circuit 207 is connected to an input terminal of the display memory 208, and an output terminal thereof is connected to an input terminal of the image display circuit 209. The television monitor 3 is connected to the output terminal of the image display circuit 209. Also, CPU2
06, an image addition circuit 202, an addition memory 203, a spatial filter circuit 207, a display memory 208, and an image display circuit 209 are connected. Further, the stage drive circuit 10 as a focus position moving means for the above-described imaging means 1 is connected.
5. The operation unit 4 is connected.

The television monitor 3 displays an image processed by the apparatus main body 2 via an image display circuit 209. The operation unit 4 is used to perform various control operations such as an operation start setting. For example, FIG.
As shown in (b), a focus handle 401 for raising and lowering the stage 102 of the microscope 101 in the optical axis direction, a ready LED 402, a start button 403 for starting an operation for constructing a high-depth image, and a contrast level are determined. For adjusting the contrast level.

Next, the operation of the embodiment configured as described above will be described.

Now, the stage 102 of the optical microscope 101
When the observation image of the sample placed on the camera is captured by the CCD camera 104 through the intermediate magnification lens 103, this video signal is converted from an analog signal to a digital signal by the image capturing circuit 201 of the apparatus main body 2, and the image signal is converted into digital image data. Addition circuit 202 and contrast calculation memory 2
04 sequentially.

The image data in the contrast calculation memory 204 is read out by the DSP 205, and the image contrast is obtained. In this case, as shown in FIG. 3, the contrast of each of the vertical and horizontal lines 12 and 13 at the center of the image data screen 11 and the diagonal lines 14 and 15 is calculated to obtain the contrast value of the entire screen 11. I do. In order to improve the S / N of the contrast value, of the pixels (hatched circles shown) stored in the field (1), as shown in FIGS. Each of the four pixels (black circles in the figure) of the vertical and horizontal lines 12 and 13 and the diagonal lines 14 and 15 at the center of the block is regarded as one block, and the average of these four pixels is used as the average pixel data of the block. Screen 1 by adding the square of the difference between the average pixel data of the blocks in all blocks
A contrast value of 1 is obtained. That is,
The CCD camera 104 generally employs an interlaced scanning method, and a video signal for one screen is divided into two fields (1) and (2). After confirming that the field (1) has been completed, the image data of the field (1) is used to determine each of the lines 12 to 12 shown in (a) to (d) of FIG.
The contrast value at 15 is determined.

Then, when the contrast calculation is completed, the DSP 205 instructs the CPU 206 during the field (2) of the fields (1) and (2) corresponding to the vertical synchronizing signal V as shown in FIG. , Generates a DSP interrupt signal indicating that the contrast calculation has been completed.

On the other hand, in the image adding circuit 202, the image data read from the adding memory 203 and the image capturing circuit 2
01 is added to the image data taken in, and the added image data is stored in the addition memory 203 again. Then, the addition memory 203
The image data read from the
Is input to In the spatial filter circuit 207, for example,
Two-dimensional image processing up to a × 7 pixel size is performed to restore the image. Thereafter, the image data is temporarily stored in the display memory 208 for display, and then the image display circuit 2
The video signal is converted into a video signal by 09 and displayed on the television monitor 3.

In this state, the CPU 206 compares the contrast level preset by the contrast level adjusting knob 404 of the operation unit 4 for starting the construction of a high-depth image with the level of the contrast value obtained by the DSP 205, and the contrast of the DSP 205 When it is determined that the value level is higher, the ready LED 402 is turned on, and the use of the start button 403 for obtaining a high-depth image is permitted.

Next, the operation for obtaining such a high-depth image will be further described.

In this case, in order to prevent a malfunction, the user operates the contrast level adjustment knob 404 of the operation unit 4 only once at the beginning to construct a high-depth image (hereinafter, referred to as A operation). A startable contrast level is set.

The setting of the start level is performed by the microscope 10
After placing the sample to be observed on the first stage 102, turning the focusing handle 401 of the operation unit 4 to focus on the sample, and operating the contrast level adjustment knob 404,
The operation is completed by setting the ready LED 402 to a position where the ready LED 402 is lit. In this case, it is not necessary that the specimen is in focus, but it is sufficient that the specimen can be recognized.

If the sample is out of focus due to this setting, the ready LED 402 does not light up, and the A operation cannot be started even if the start button 403 of the operation unit 4 is pressed. Thus, if the sample is out of focus greatly, the A operation is not started, and a malfunction of the algorithm that is the basis of the A operation, which will be described later, can be prevented. In addition, it can be understood that in a state where the focus is largely out of focus, even if the sample images before and after are added to construct a high-depth image, it has no meaning.

From this state, the ready LED 4
Stage 1 of the microscope 101 until 02 lights up.
02 is moved by operating the focusing handle 401 of the operation unit 4, and the stage 102 is moved by the focusing handle 401 of the operation unit 4.
Then, the start button 403 is pressed and operated.

Then, as shown in FIG.
In step 1, the interrupt of V 'for executing the A operation is permitted, and in step 602, variables used in the interrupt processing routine of V' are initialized to mode = 1 and stutas = 1. The interruption of V 'is performed in synchronization with the vertical synchronization signal V of the field (1) among the vertical synchronization signals V of the fields (1) and (2) as shown in FIG.

Thereafter, the A operation is executed in accordance with the algorithm shown in FIGS. 7 to 11 described in the interrupt processing routine of V '.

The change in the contrast value when the stage 102 is moved from top to bottom is almost as shown in FIG. 5. FIGS. 8 to 11 show the processing 1 to processing shown in the flowchart of FIG. This corresponds to No. 3. Since the routine shown in FIG. 7 is called every time V 'is interrupted, the variable "sta" is
tus is used. This sttus is processed 1
In the process 3, 1 is added to prepare for a call at the time of the next interrupt. Also, as an exception, the same processing can be performed again if the call at the time of the next interrupt is waited without adding the status.

First, when mode = 1 in step 701,
Process 1 of step 702 is called. This processing 1
Is executed according to the flowcharts shown in FIGS. The outline of the processing 1 is to move the stage 102 up or down and determine a stage position where the sample image is not sufficiently focused (hereinafter, referred to as a stage position).

First, at status = 1, 30 μm /
The stage 102 starts moving downward at a constant speed of sec, and initializes various variables (steps 801 to 80).
3). Here, the previous contrast value beforeC
If the current contrast value nowC is equal to
tus is incremented. If Err = 1, the next interrupt is waited. If Err = 1, the stage is stopped.
V 'interrupt is disabled (steps 804 to 806),
The user will be notified that the A operation was not successful.

Next, since there is no status = 2,
The process waits until tus = 3. This is a statu
This is because a weight is set until the stage 102 is sufficiently moved stably after the movement of the stage 102 is started at a = 1.

When status = 3, the current contrast value nowC is changed to the contrast value startC at the start.
It is determined whether or not nowC is smaller than the contrast value nonimgC when there is no image, and if it is smaller, the process proceeds to step 826 and thereafter to perform a process of setting the current stage position as a start position (step 807-809). If not, the process moves to the above-described steps 804 to 806.

Next, when status = 4, the immediately preceding contrast value beforeC and nowC are compared, and
When wC is small, 1 is added to the status so that the next status = 6 can be immediately transferred, and the variables are initialized (steps 810 to 813). Otherwise, a variable PKDIR indicating in which direction of the stage the maximum point of the contrast of the sample is located from the current time is PKDI.
Assuming that R = 0, the movement of the stage 102 is stopped, and the stage 102 is moved upward at a rate of 30 μm / sec in the opposite direction.
And the variables are initialized (step 814,
813). Then, the process proceeds to steps 804 to 806 described above.

In this status = 4, it is determined whether the current position of the stage 102 is on any slope of the contrast curve shown in FIG. 5 by comparing the previous contrast value with the current contrast value. I have.

Next, if status = 6 and cnt is 15
Smaller, comparing nowC and nonimgC
If wC is small, the process proceeds to the processing of step 826 and subsequent steps described later. Also, nowC is compared with beforeC, and nowC is small, and beforeC-nowC is compared with contrast value unfoutC when the sample is not substantially in focus. If unfucC is large, npcnt is incremented by 1 (steps 815 to 82).
1) Then, if npcnt becomes 2 or more, the process proceeds to steps 804 to 806. On the other hand, nowC and b
Compared to beforeC, nowC is larger and beforeC
eC-nowC is compared with the contrast value unfoucC when the sample is out of focus, and unfoucC is obtained.
If ucC is small, npcnt is set to 0 and cnt is set to 1
Is added and status is subtracted by 1 (step 822,
823), and shifts to the processing of steps 804 to 806.
Further, when cnt exceeds 15, Err is set to 1 (step 824), and the processing shifts to the processing after step 826 described later.

At this status = 6, it has been confirmed that the differential coefficient of contrast at that stage position is not more than unfucC, that is, that the contrast curve has become gentle.

When the status = 7, the movement of the stage 102 is stopped, and nowC is compared with the contrast value ccdC when the CCD camera 104 is dirty.
If owC is large, a variable Err for performing error processing as an error is set to 1 (steps 825 to 82).
8). Otherwise, the current contrast value nowC
Is the contrast value startC of the start position (steps 829 and 830). Here, ccdC is C
When the CD camera 104 is dirty and the overall contrast level is high, an error occurs. Then, the process proceeds to steps 804 to 806.

That is, in the process 1, when the stage 102 is matched to (1) shown in FIG. 5, the stage 102 is moved to the position (2), and the stage 15 is matched to (4) in FIG. Stage 1 to the position (5)
02 is moved. That is, in process 1,
The direction in which the contrast decreases is detected once, and the stage 102 is moved in that direction to prepare for the subsequent movement. Therefore, it is possible to prevent the stage 102 from moving unnecessarily.

Next, returning to FIG. 7, when the processing 1 is completed without error, it is determined that ret = 1, and mode = mod
e + 1, status = 1 (steps 703, 7
04), Process 2 is called. In this case, if nowC is smaller than the contrast value peak MaxC, the process is terminated, and the contrast value peak Ma is returned.
If nowC is larger than xC, MaxC = nowC, and the process ends (steps 705 and 706).

When mode = 2 in step 707, processing 2 in step 708 is called. In the process 2, the flowchart shown in FIG. 10 is executed. The outline of the process 2 is to determine a stage position at which the stage 102 is slowly moved and the addition of images is started to construct a high-depth image.

First, with the status = 1, the moving direction of the stage 102 is determined according to the PKDIR obtained in the process 1. Here, if PKDIR is 0, the peak of the contrast of the sample is in the direction of moving the stage 102 downward, and if PKDIR is 1, it indicates that it is in the direction of moving upward. Is moved (steps 1001 to 1004). At this time, the moving speed of the stage 102 is such that the interruption of V 'occurs twice as long as the interlace scanning, that is, 1/30 sec.
For each c, the focal depth of the objective lens is set to about 0.4 μm, and the image of one screen is
In order to shoot at a pitch of μm, the following equation is set: 12 μm / sec = 0.4 μm × 30 screens / sec. Then, the variables are initialized (step 10).
05).

Here, the previous contrast value befo
If reC and the current contrast value nowC are equal,
The status is incremented. If Err = 1 is not set, the next interrupt is waited. If Err = 1, the stage is stopped and the interrupt of V 'is prohibited (steps 1006 to 1006).
008) The user is notified that the A operation has not been successful.

Next, if status = 3 and cnt is 31
Smaller, nowC is greater than startC, no
When wC-beforeC, that is, when the differential coefficient exceeds 100, it is possible to shift to the next processing. If not, add 1 to cnt and prepare for error processing, subtract 1 from status, and again
Us = 3 can be executed (step 100
9-1013). Then, steps 1006 to 1008
Move to the processing of. When cnt exceeds 31,
Err is set to 1 because the condition is not met (step 101).
4), the process proceeds to steps 1006 to 1008.

Here, from status = 1 to status
What is flying at s = 3 is the weight before confirming that the stage 102 completely starts moving and before entering the constant speed movement.

Next, when status = 4, the image addition processing is started, variables are initialized, and the processing 2 is completed (steps 1015 and 1016).

Next, returning to FIG. 7, when the processing 2 is completed without error, it is determined that ret = 1, and mode = mod
e + 1, status = 1 (steps 709 and 7
10), Process 3 is called.

When mode = 3 in step 711, process 3 in step 712 is called. In the process 3, the flowchart shown in FIG. 11 is executed. The outline of the processing 3 is that the addition processing of the image started in the processing 2 is appropriately terminated when the contrast curve shown in FIG. is there.

First, if status = 1, nowC and b
Compare with beforeC and wait until the change in contrast comes in the direction of decreasing (step 1101). now
When C is larger, it indicates that the vehicle is still on the upside of the contrast curve, and when it is smaller, it is determined that it is down. Here, if nowC becomes smaller than startC, the status is immediately incremented by 1, and the process proceeds to the next process (step 1104). Otherwise, in order to surely confirm that the contrast has decreased, the fact that the contrast has decreased four times is counted by npcnt. Further, it falls four times in succession, and is １ ／ of the difference between the contrast value peaks MaxC and startC.
If (nowC) is smaller than (= tmp), the process proceeds to the next process (steps 1105 to 1107, step 11).
04). In step 1102, nowC is set to bef.
If it is still larger than oreC, npcnt is set to 0, cnt is added by 1, status is subtracted by 1, and the process proceeds to the next processing (steps 1108 and 1109).
If npcnt is 3 or less in step 1105 or if nowC is larger than tmp in step 1107, npcnt is incremented by 1 in step 1110, and step 11
09.

Next, when status = 3, the image addition processing and the movement of the stage 102 are stopped (step 1011).
-1013), the interruption of V 'is prohibited, and the process 3 ends.

In this processing 3, the end of the image addition processing is determined under the condition that the nowC is smaller than 1/2 of the difference between the contrast value peak MaxC and the stsrtC, so that an unnecessary low-contrast image is added. And the image quality of the high-depth image is not degraded.

When the processes 1 to 3 are completed without error, the added image in the addition memory 203 is sent to the spatial filter circuit 207, and the characteristics of the objective lens, the size of the CCD camera 104, the microscope 101 And CCD
An image restoration process is performed using a two-dimensional image processing filter coefficient obtained from the characteristics of the imaging optical system such as the intermediate magnification lens 103 between the cameras 104. At this time, if the image data is read from the addition memory 203 in a non-interlaced scanning format and processed by the spatial filter circuit 207, the processing can be performed without deteriorating the image quality.

The image data processed by the spatial filter circuit 207 is stored in the display memory 208 in a non-interlaced scanning format, and is sent to the image display circuit 209. In this case, the image display circuit 209 may read out the image data from the display memory 208 by using any of the interlace scanning and the non-interlace scanning in accordance with the display format of the television monitor 3.

Therefore, by doing this, it is possible to quickly determine which side of the contrast curve is on the basis of a change in contrast when the stage 102 is slightly moved first, and to move the stage 102 in a direction in which the contrast decreases. Thereafter, the movement of the stage 102 is reversed in the direction in which the contrast value goes to the peak value. With this movement, image addition is performed by the image addition circuit 102 from the time when the contrast value of the captured image with respect to the sample exhibits a predetermined change. Therefore, there is no needless movement such as moving the in-focus position over the entirety, and the image addition can be performed by selecting a stable image region in which the contrast value sharply increases. Accordingly, an optimal and good high-depth image can be quickly constructed. In addition, since there is no need to perform various operations such as setting various conditions according to an object to be photographed in advance, the operation can be simplified.

Further, since the start position is set as the minimum condition for adding images, a blurred image is not captured, and only an image having a predetermined contrast value or more is captured. A good high-depth image can be constructed without deteriorating the image quality.

In this way, all the height positions of the sample are focused on each of the height positions of the thick sample using the optical microscope 101 from the plurality of focused input images. A high-depth image as if the depth was enlarged can be obtained stably.

In the above-described first embodiment, the vertical and horizontal lines 12 and 13 and the diagonal lines 14 and 15 of the screen 11 are used as calculation regions for calculating the contrast. However, the present invention is not limited to this. In the calculation of the contrast, the S / N is improved by a method of collecting four discrete pixels and taking an average, but the present invention is not limited to this. Furthermore, the constants used in processing 1 to processing 3 are not limited to these. The drive speed of the stage is not limited to this, and the depth of focus of the objective lens may be accurately obtained, and the drive speed may be changed each time the objective lens changes. This device does not restrict the video signal system of the CCD camera to NTSC, PAL, SECAM, etc., and can respond to each system.

(Second Embodiment) In the above-described first embodiment, the parameters for capturing images are fixed. However, in the second embodiment, the parameters for capturing images are different for each sample. By calculating, even in the case of a sample determined to be in error, it is possible to capture an image and obtain a high-depth image.

FIG. 12 shows a schematic configuration of the second embodiment, and the same parts as those in FIG. 1 are denoted by the same reference numerals.

In this case, the CPU 206 is connected to a sample registration unit 210 for calculating parameters at the time of image capture and a data storage unit 211 for storing the calculated parameters. The data storage unit 211 stores NVRA
A non-volatile memory such as M is used.

As shown in FIGS. 13 (a) and 13 (b), the operating section 4 is provided with a stage moving focus handle 40 for moving the stage 102 of the microscope 101 up and down in the optical axis direction.
1. Ready LED 402, start button 403 for starting an operation of constructing a high-depth image, contrast level adjustment knob 40 for determining a contrast level
In addition, a mode select knob 405 and a sample registration start button 406 for setting whether to manually or automatically capture an image are provided.

In such a configuration, in the normal automatic image capturing, the calculation of the contrast value and the CPU are performed by the algorithm described in the first embodiment.
In step S206, it is determined whether image capturing is possible. If the contrast level is too low, it may be determined that there is no sample image in the image capturing range, and the image capturing may be stopped.

Therefore, in such a case, the user registers the sample by the sample registering unit 210 in the following manner, resets the image capture expectation parameter, and specifies the capture range again, thereby obtaining the sample image. It is possible to capture.

First, for sample registration, a prescanner is performed in a range of ± 20 μm from which the focused image disappears from the sample registration start position, and a contrast curve in this range is obtained. The method of obtaining this contrast curve is described in FIG.
Is used.

When the contrast calculation is completed by the DSP 205, a DSP interrupt signal is generated to notify the CPU 206 that the contrast calculation shown in FIG. 4 has been completed.

Such a work is performed within a range of ± 20 μm from the sample registration start position SS as shown in FIG. 14, a contrast value is calculated, and the calculated contrast value is stored in a work memory. Next, when the pre-scan is completed, FIG.
From the contrast curve obtained by the calculation as shown in FIG.
_MAX is obtained, and the average C _non of the contrast value at a position ± 15 μm from this position is determined as an image having no focal plane in the image.
The contrast value of the blurred image is used. That is, an area where the contrast value is equal to or less than this is an area where there is no in-focus surface in the screen and the entire screen is blurred.

Next, the intermediate position Z _start of the maximum value C _MAX of the image contrast thus obtained is set to the image addition start position, and Z _{end is set} to the image addition end position (FIG. 16). Then, from the next time, image capture will be performed using these parameters. The calculated parameters for image capture are switched by switching channels such as switches.
The data is stored in the data recording unit 211 for each sample. When the sample is changed, the channel is switched by a switch or the like as in the case of saving, and when the start button 404 of the operation unit 4 is pressed, the parameters are read out and the image is taken in. Even adaptable.

Next, a method of actually registering a sample and taking in an image will be described.

First, the user operates the operation unit 4 only once at the beginning.
The contrast level adjustment knob 404 is scanned to set a contrast level (hereinafter, a start level) at which an operation for constructing a high-depth image can be started. This setting
This is performed to prevent a malfunction when constructing a high-depth image. The reason is that the CPU 206 moves the stage 102 in a direction in which the contrast value decreases, but if, for example, there is no sample or the focus is out of focus, the contrast curve obtained at this time becomes completely meaningless and malfunctions. In order to prevent this, the start level is set to a position where the sample can be generally recognized by the contrast level adjustment knob 404.

In this setting, the sample to be observed is placed on the stage 102, the focusing handle 401 of the operation unit 4 is turned to focus on the sample, and then the contrast level adjustment knob 404 is turned to the position where the ready LED 402 is lit. I do. In this case, it is not necessary that the sample be in focus, but it is sufficient that the sample can be recognized roughly.

Next, the channels AUTO1-AUTO3 of the sample registration are set by the mode select knob 405.
Select and set one of. Note that 1 to 6 written on the mode select knob 405 indicate the image capturing range in the manual image capturing mode.

In the sample registration, the automatic capture mode 1 to 3 (AUTO1 to AUTO3) are selected.
Then, after the channel to be registered is determined, a sample registration start button 406 is pressed. Then, the sample registration is started with this position as the sample registration start position.

In this case, as shown in FIG. 17, first, in step 1701, the CPU 206
In step 05, the stage is lowered by 20 μm from the sample registration start position. Next, in step 1702, a prescan is performed 40 μm upward from that position, that is, ± 20 μm from the sample registration start position.

Then, in step 1703, the DSP 20
5 reads out the image data from the contrast calculation memory 204 every time an interrupt of V ′ comes during the pre-scan, calculates the contrast value of the image, and executes the DSP shown in FIG.
By generating an interrupt signal, the CPU 206 is notified that the calculation has been completed. When confirming the interruption, the CPU 206 reads the current position contrast value in step 1704 and stores it in the work memory.

The operations in steps 1703 and 1704 are as follows. In step 1705, the upward moving distance is 4
Repeat until determined to be 0 μm.

Next, in step 1706, the maximum contrast value C _MAX is checked from the stored contrast data to find its coordinate Z _MAX , and further, step 1707
In the position of the _{Z MAX -15μm Z a, Z MAX} + 15μm
_{Is set} as Z _b , and in step 1708, the contrast level C _non of the blurred image is set from the average value C _non = C (Z _a ) + C (Z _b ) / 2 of the respective position contrast values. Then, the start and end levels C _th of the image integration are set from the average value C _th = (C _MAX + C _non ) / 2 of C _MAX and C _non .

When these parameters are determined,
In step 1710, the CPU 206 stores these parameters in a nonvolatile memory such as NVRAM of the data storage unit 211, and ends the sample registration.

Next, a method for taking in an image from the next time will be described with reference to FIG.
8 will be described.

First, the user presses the start button 403 of the operation unit 4 from the position where the ready LED 402 lights up. Then, in step 1801, the CPU 206 moves the stage 102 downward by the stage driving unit 105. Next, in step 1802, the DSP 205 calculates a contrast value for each interrupt of V '. When the calculation is completed, in step 1803, it is checked whether or not the contrast has decreased due to the DSP interrupt.

If the contrast has increased, the stage 102 is moved upward in step 1804, and the process returns to step 1802.

[0091] Further, if the decrease contrast, in step 1805, the CPU 206, checks whether the contrast value is equal to or less than C _th. Here, if it is still equal to or greater than C _th , the process returns to step 1803, and
The movement of the stage 2 is stopped when the movement of the stage 2 becomes equal to or less than _Cth .

Then, at step 1806, image integration is started while moving the stage 102 in the reverse direction. Then, in step 1807, calculates a contrast value every fall of V', in step 1808, and monitors a contrast value, at the following again C _th, Step 1
In step 809, the stage 102 is stopped, and the image capturing ends.

Thereafter, as in the first embodiment,
After performing the restoration process by the spatial filter 208, the image data is temporarily stored in the display memory 208, and then is displayed by the image display circuit 209.
Is converted into an analog video signal and displayed on the television monitor 3.

Therefore, in this way, in the automatic capture, pre-sample is performed before capture of an image even for a sample in which a CCD surface becomes dirty or an error occurs when a sample image is determined to be absent. , The parameters for image capture can be set using the contrast curve of the sample, so using this parameter for the next image capture will determine that an error has occurred and the final image could not be obtained A high-depth image can be obtained for a sample.

Further, by registering the sample in advance, the time required for the pre-scan for performing the pre-processing of image capturing and the calculation of the parameters can be reduced each time, and a mode for switching the parameters is also provided when exchanging the samples. This eliminates the necessity of registering a sample every time a sample is exchanged or when the power is turned on, thereby realizing an efficient and efficient operation of this kind.

Further, by using a non-volatile memory for writing parameters, the number of times of sample registration can be minimized.

In the second embodiment described above, the diagonal line is selected as the calculation area for obtaining the contrast. However, the present invention is not limited to this, and another calculation method may be used. The calculation of the contrast is based on four skipped pixels.
The S / N was improved by a method that collects and averages.
Not limited to this. Further, the range of the prescan used for sample registration does not need to be limited to ± 20 μm, but may be a range in which the characteristics of the contrast curve of the sample can be recognized. The calculation formulas for determining the contrast level of the blurred image and the image capture level need not be limited to the formulas used this time, and the constants used in the calculation may be changed. Further, the shape and function of the operation unit are not limited to those of this time. The method of registering the sample does not need to be a dedicated registration button, and may be shared with another button. And this device is CCD
The video signal system of the camera is NTSC, PAL, SEC
There is no restriction to AM or the like, and it is possible to respond to each. As a method of adjusting the distance between the sample and the objective lens, not only a method of driving the stage, but also a method of driving an objective revolver, a method of driving an imaging lens in front of an image pickup device of a television camera, and a method of driving an electromagnetic wave. motor,
An ultrasonic motor, a piezo element, or the like may be used, and the method is not limited.

(Third Embodiment) FIG. 19 shows a schematic configuration of an image input apparatus to which the present invention is applied.
Denotes an optical microscope body. This optical microscope body 21
An observation image of the sample specimen 23 placed on the stage 22 is taken by a microscope observation television camera 24 via an observation optical system including an objective lens.

An A / D converter 25 is connected to the television camera 24, and the A / D converter 25
4 is converted into a digital signal and the adder 2
6 and the luminance memory 33.

The adder 26 adds the image input from the television camera 24 and the image stored in the image memory 27 for addition, and the addition result is stored in the image memory 2 for addition.
7 is output. The image memory for addition 27 includes an adder 26.
Is stored, and the stored contents are read out by the adder 26 and the divider 28.

The divider 28 is used to divide the added image stored in the addition image memory 27 by using the number of added images as a divisor to obtain one image, and the image obtained by the divider 28 is obtained. CPU 3 to be described later with a spatial filter 29
The restoration processing is performed by the spatial frequency filter having the characteristic selected in step 8, and the restored display image data is stored in the display image memory 30. Then, the D / A converter 31 reads out the display image data stored in the display image memory 30, converts it into analog data, and causes the display unit 32 to display the data.

The luminance memory 33 writes the luminance data sent from the A / D converter 25 under the control of the luminance memory controller 35, and outputs the DSP (Digital S).
signal processor 34).

The DSP 34 calculates a contrast value based on the brightness data read from the brightness memory 33, and sends the calculated contrast value to the focusing range detecting section 37.

The focus range detection section 37 detects the focus range of the stage 22 from the calculated contrast value, and the detection result is sent to the CPU 38.

The CPU 38 controls the operation of the entire apparatus. In particular, the adder 26, the spatial filter 29, the luminance memory controller 35, and the image memory controller 3
6. Send control commands for image processing, image blur correction, and drive control to the stage drive unit 39;
3, the operation of the entire apparatus including the dynamic focus is accepted.

Thus, the stage 22 is provided with an optical encoder 40 as a shake detecting section, and an objective lens information acquiring section 41 is provided corresponding to the objective lens of the optical microscope main body 21. Here, the optical encoder 40
Is provided fixed to the stage 22 of the optical microscope main body 21 and detects the amount of shake of the stage 22 in the X and Y directions. The detected amount of shake is determined by the image shake correction amount calculation unit 4.
Sent to 2.

On the other hand, the objective lens information acquisition section 41 reads the magnification of the currently used objective lens, and the read magnification information of the objective lens is also used as the image blur correction amount calculation section 4.
Sent to 2.

The image blur correction amount calculation unit 42 calculates the number of correction pixels based on the blur amount detected from the optical encoder 40 and the magnification information of the objective lens of the objective lens information acquisition unit 41. The number information is output to the luminance memory controller 35 and the image memory controller 36.

The luminance memory controller 35 controls the writing and reading addresses in the luminance memory 33 based on the image blur correction amount calculated by the image blur correction amount calculation section 42.

The image memory controller 36 controls the writing and reading addresses in the addition image memory 27 based on the image blur correction amount calculated by the image blur correction amount calculator 42.

The stage drive section 39 drives the stage 22 in the Z direction, that is, in the direction of the observation optical axis, in accordance with a control command from the CPU 16.

In the apparatus configured as described above, the blur detection and the image correction based on the blur detection, the calculation of the contrast value, the addition of the image, and the recovery processing will be briefly described first along the flow of the processing signal.

When the start of image capture is instructed by operating the operation section 43, the stage drive section 39 drives the stage 22 in the Z direction. And the TV camera 24
, The optical encoder 40 detects the amount of shake of the stage 22 in the X and Y directions in synchronization with obtaining an image of the sample specimen 23.

The detected blur amount is calculated by the image blur correction amount calculation unit 42.
The number of pixels to be corrected is calculated based on the magnification information of the objective lens obtained by the objective lens information acquisition unit 41. The calculated number of corrected pixels is transmitted to the luminance memory controller 35 and the image memory controller 36. Can be

On the other hand, the image of the sample 23 obtained by the television camera 24 is digitized by the A / D converter 25 and sent to the A / D converter 25 and the luminance memory 33. Here, in the luminance memory 33, the number of corrected pixels corresponding to the shift amount is sent to the luminance memory controller 35 as described above. Therefore, after writing the luminance data, the luminance memory controller 35 The read address position is adjusted and controlled, and the stored luminance data is read. Specifically, for example, the luminance data along the lines 12 to 15 having a shift as shown in FIG. Then, by performing the address adjustment by the brightness memory controller 35, the brightness data is read at a position where the influence of the displacement is eliminated.

The luminance data read out from the luminance memory 33 is sent to the DSP 34, where the contrast value is calculated. The range with high contrast is determined as the focusing range in which image addition is to be performed, and is output to the CPU 38.

In the focusing range, the digitized image obtained from the A / D converter 25 is added to the adder 26.
Are added to the same image obtained before that stored in the addition image memory 27, and the sum thereof is added to the addition image memory 2.
7, the image memory controller 36 adjusts the read address using the number of corrected pixels from the image blur correction amount calculation unit 42, and compares the stored image with the newly obtained image. The addition is performed with the deviation eliminated.

Thus, the added image stored in the addition image memory 27 is divided by the divider 28 into one image, and the spatial filter 29 uses the same filter selected from the CPU 38 by the spatial filter 29. The image subjected to the restoration processing is temporarily stored in the display image memory 30, read out, converted into an analog signal by the D / A converter 31, and displayed on the display unit 32.

Next, the actual processing will be described with reference to the flowchart of FIG.

The processing in FIG. 21 is performed under the control of the CPU 38. When the processing is started, the stage 22 is moved along the Z direction by the stage driving unit 39, and at that time, the DSP 34 and the focusing range are set. As shown in FIG. 22, the contrast value is set to the threshold value Cth by the detection unit 37.
The range of the positions Za to Zb in the Z direction of the stage 22 described above is taken.

For this purpose, first, the stage 22 is moved downward by the stage driving section 39 (step A1).
At this time, the DSP 34 calculates the contrast value of the image at each falling edge of the vertical synchronizing signal (V) in the digital video signal obtained from the A / D converter 25 (step A2).

FIG. 23 shows a subroutine for calculating a contrast value performed by the CPU 38 at this time. First, the blur amount of the stage 22 is detected by the optical encoder 40 (step B1). At the same time, the objective lens information acquisition unit 41 acquires magnification information of the objective lens inserted into the observation optical axis of the optical microscope main body 21 (step B2), and the image blur correction amount calculation unit 42 detects the magnification information based on the information. An image blur correction amount indicating how many pixels the blur amount corresponds to on the CCD surface of the television camera 24 is calculated (step B3).

Next, when the image blur correction amount calculation section 42 sends the calculated image blur correction amount to the luminance memory controller 35 and the image memory controller 36, the luminance memory controller 35 outputs the image written in the luminance memory 33. The readout address is adjusted so that the luminance data does not include the influence of image blur at all, and the DSP 34 reads the luminance data (step B4). In the DSP 34, the luminance data processed so as to have no image blur is used. A contrast value is calculated (step B5).

The contrast value is calculated as follows using continuous luminance data on the screen. That is, assuming that the luminance data at the j-th point position on the i-th line for calculating the contrast value is Yi, j, the contrast value C
i, j (Zk) is Ci, j (Zk) = (Yi, j (Zk) −Yi, j-1 (Zk)) ² (1), and the sum of the contrast values Ci, j of the ith line
To

(Equation 1)

Then, the sum of the contrast values of all the lines is calculated as

(Equation 2)

Is obtained. The obtained contrast value C (Z
k) is normalized by the number of pixels on the calculation line in consideration of the fact that the amount of image blur is large and the number of pixels of each line used in the calculation decreases as shown in FIG. The contrast value, that is, C (Zk) = C (Zk) / Dnum (4) (where Dnum: the number of pixels on the line used in the calculation) is obtained, and the subroutine in FIG.

When the calculation of the contrast value of the image in which the blur amount of the stage 22 has been corrected is completed, the process returns to the main routine of FIG. 21 and the CPU 38 which receives the interrupt from the DSP 34 sets the calculated contrast value at the previous timing. It is determined whether or not the contrast value is reduced as compared with the calculated contrast value (step A3).

When the contrast value has decreased,
Since the contrast value has decreased due to the lowering of the stage 22, it is determined that it is located in the left half on the contrast curve shown in FIG. Is the threshold value C
It is determined whether it is less than th (step A5).

Here, if the calculated contrast value is less than the threshold value Cth, the stage 2 at that time is
Since the position of No. 2 is Za, the moving direction of the stage 22 is set again in the opposite direction, that is, set to the upward direction by the stage driving unit 39 (step A6). (Step A)
7).

FIG. 25 shows a subroutine for image addition performed by the CPU 38 at this time.
The image blur correction amount used in the contrast calculation of Step 3 is read from the image blur correction amount calculation unit 42 to the image memory controller 36 (Step C1).
In step 6, the read address of the image in the image memory for addition 27 is adjusted by using the image blur correction amount, and the luminance data of the image is read by the adder 26 and the divider 28 so as not to include the influence of the image blur at all. (Step C2).

Next, the addition area of the new image sent from the television camera 24 via the A / D converter 25 is determined by adjusting the same using the image blur correction amount (step C).
3) The addition of the new image and the image read from the addition image memory 27 is performed by the adder 26 (step C4).

Thereafter, the obtained addition image is written and set in the addition image memory 27 while adjusting the writing address by the image memory controller 36 as the sum of the two images (steps C5 and C6). Ends the subroutine.

After executing the addition of the images in this manner, the process returns to the main routine of FIG.
The DSP 34 calculates the contrast value of each image at each falling timing of the vertical synchronizing signal in the digital value video signal obtained from the D converter 25 (step A8).

Then, it is determined whether or not the calculated contrast value is less than the threshold value Cth (step A9).
Here, if the calculated contrast value is equal to or larger than the threshold value Cth, the process returns to the step A7 to repeat the image adding process.

Thereafter, when the contrast value calculated in step A9 becomes less than the threshold value Cth, the stage 2
2 moves the stage 22 to the position Z in FIG.
b, which means that the addition of the images within the in-focus range has been completed. Therefore, the movement of the stage 22 by the stage drive unit 39 is stopped, and the capture of the images by the television camera 24 is ended (step A10) At that time, an added image obtained by adding a large number of images within the focusing range stored in the addition image memory 27 is read out, and divided by the number of images by the divider 28 to obtain one image. Later, a recovery process is performed by the spatial filter 29 (step A11).
The obtained high-depth image is temporarily stored in the display image memory 30 and then converted into an analog signal by the D / A converter 31 to be displayed on the display unit
2 is displayed.

In step A3, the stage 22
When it is determined that the contrast value calculated when the image is moved downward has not decreased compared to the contrast value calculated at the previous timing, the position of the stage 22 is changed to the contrast curve shown in FIG. Since the stage 22 is located at the upper right half, the stage 22 is moved upward by the stage driving unit 39 and the moving direction is changed (step A4). Then, the process returns to step A2 and returns to step A2. To A5, and the stage 22 is moved to a point where the obtained contrast value is less than the threshold value Cth, that is, the position of Zb in FIG.
To move.

Thereafter, in step A6, the stage 22 is set again to be moved downward, that is, in the opposite direction. Then, the processing of steps A7 to A9 is repeatedly executed, and while the stage 22 is moved downward, Images obtained within the focus range are sequentially added.

Then, the point where the contrast value obtained in step A9 becomes smaller than the threshold value Cth, that is, FIG.
With the stage 22 moved to the position of Za inside,
Since the addition of the images within the in-focus range has been completed, the process proceeds to step A10 and subsequent steps in the same manner as described above.

As described above, in the process of obtaining a high-depth image by performing the restoration process after adding a plurality of microscope images, even if the stage 22 on which the sample 23 is placed is shaken due to the movement, In the same manner as in the case where the image does not occur, the contrast calculation is performed, and the accurate focusing range can be determined. In addition, a correct high-depth image can be obtained by sequentially adding accurate images excluding the influence of blur and performing a restoration process.

In the above embodiment, the movement of the stage 22 with respect to the image capturing speed may be continuously and continuously moving at a high speed, or may be stepwise moved so as to stop only at the time of image capturing. It may be a thing.

This is because, for example, when the stage driving section 39 is constituted by a pulse motor and the stage 22 is moved linearly at high speed, the television camera 24 can input an image of one screen in the NTSC system and one frame of the CCD in the standard. Since the accumulation time is about 1/30 [sec], the image data of the desired in-focus surface is input within this time, that is, the input in-focus surface is the light guided from the characteristics of the objective lens of the optical microscope main body 21. It is driven at a constant speed so that image input can be performed while moving within the axial sample depth of focus range.

The television system of the image picked up by the television camera 24 is not limited to the NTSC system, but may be another system such as PAL, SECAM, or high-definition.

In the above description, the stage 22 is moved by the stage driving unit 39 as a means for changing the focus position with respect to the sample 23, but the point is that the stage 22 is moved along the direction of the observation optical axis to move the focus. If focusing can be performed, a revolver equipped with an objective lens instead of the stage 22 or an imaging lens in front of the CCD of the television camera 24 can be moved. The drive may be controlled by a motor, an ultrasonic motor, a piezo element, or the like.

Further, four diagonal lines are selected as a calculation area for calculating the contrast value of the image. However, the number and direction of the lines, the calculation formula, and the like are also determined by the method of the present embodiment. It is not limited.

In the above description, the optical encoder 40 is used as the detection unit for detecting the amount of blur. However, any other device that has the accuracy of detecting a microscope image on the CCD surface of the television camera 24 in pixel units can be used. May be used.

The luminance memory 3 for performing image blur correction
Although access to 3 is performed by adjusting the read address by the luminance memory controller 35, it goes without saying that image blur correction can be similarly performed by adjusting the write address.

(Fourth Embodiment) Next, a fourth embodiment in which the present invention is applied to an automatic focusing mechanism for a microscope will be described with reference to the drawings.

FIG. 26 shows a schematic structure thereof, which is basically the same as that shown in FIG. 19 above. Therefore, the same portions are denoted by the same reference characters and description thereof is omitted.

However, images are taken by the television camera 24,
The image data digitized by the A / D converter 25 is supplied to the luminance memory 33 and the direct display image memory 30.

An image blur correction amount calculation for calculating the number of correction pixels based on a blur amount from an optical encoder 40 provided as a blur detection unit on the stage 22 and magnification information of an objective lens from an objective lens information acquisition unit 41. The unit 42 outputs the calculated correction pixel number information to the luminance memory controller 35 and the display memory controller 51 as an image blur correction amount.

The luminance memory controller 35 is a CPU
Under the control of 8 ', the writing and reading addresses in the luminance memory 33 are controlled based on the image blur correction amount from the image blur correction amount calculation unit 42.

The display memory controller 51 controls the writing and reading addresses of the display image memory 30 based on the image blur correction amount from the image blur correction amount calculator 42.

The contrast value of the image calculated by the DSP 34 is sent to the in-focus position detecting section 52. The in-focus position detecting section 52 detects an accurate in-focus position from the contrast value and sends the detection result to the CPU 38 '. I do.

The CPU 38 'is responsible for controlling the operation of the entire apparatus. In particular, the CPU 38' sends control commands for image blur correction and drive control to the luminance memory controller 35, display memory controller 51, and stage drive unit 39. And
Further, an operation instruction of the entire apparatus including the autofocus is received from the operation unit 43.

In the above-described configuration, the sample 23 placed on the stage 22 of the optical microscope main body 21 is imaged by the television camera 24 via an observation optical system including an objective lens.

The captured image of the sample 23 is digitized by the A / D converter 25 and sent to the luminance memory 33 and the display image memory 30. The luminance memory 33 converts the image data (luminance data) into luminance. Memory controller 35
Is temporarily stored based on the control of.

In the DSP 34, the contrast value of the image is calculated based on the brightness data from the brightness memory 33. In the calculation, a region required by the observer is provided in the calculation region of the screen 11 as shown in FIG. Shall be.

The specific calculation of the contrast value in this case is the same as that described with reference to FIG. 23, and the description thereof is omitted. However, the amount of blur of the stage 22 is detected by the optical encoder 40 and the objective value is calculated. The image blur correction amount is calculated using the magnification information of the lens, and the luminance memory controller 35 adjusts the read address of the luminance memory 33 using the calculated image blur correction amount.

Then, the position where the contrast value calculated by the DSP 34 becomes maximum is detected as the in-focus position, and the detection result is sent to the CPU 38 '.

At the same time as adjusting the read address in the luminance memory 33, the read memory of the display image memory 30 is adjusted by the display memory controller 51, so that the display is performed by the divider 28 via the addition image memory 27. The image of the sample specimen 23 can also be a fine image without blurring on the stage 22.

In the above embodiment, the stage 22 is moved by the stage driving unit 39 as a means for changing the focus position with respect to the sample 23, but the point is that the stage 22 is moved along the direction of the observation optical axis. If it is possible to move and focus the sample sample 23, a revolver equipped with an objective lens instead of the stage 22,
An imaging lens or the like at a position in front of the CCD of the television camera 24 may be movable, and may be driven and controlled by a pulse motor, an electromagnetic motor, an ultrasonic motor, a piezo element, or the like.

In addition, four diagonal lines are selected as a calculation area for calculating the contrast value of an image. However, the number and direction of the lines, and other calculation formulas and the like are also applied to the method of the present embodiment. It is not limited.

Further, the optical encoder 40 has been described as being used as the detection unit for detecting the amount of blur. However, any other device that has the accuracy of detecting the microscope image on the CCD surface of the television camera 24 in pixel units can be used. May be used.

The luminance memory 3 for performing image blur correction
Although access to 3 is performed by adjusting the read address by the luminance memory controller 35, it goes without saying that image blur correction can be similarly performed by adjusting the write address.

In addition, the present invention is not limited to the first to fourth embodiments, and can be variously modified and implemented without departing from the gist of the present invention.

[0166]

As described above, according to the present invention, it is possible to select a stable image region in which the contrast value sharply increases and to perform image addition. A high depth image can be quickly constructed. In addition, since operations such as setting various conditions according to an object to be photographed in advance in the related art are not required, the operation can be simplified. Further, by setting the start position of the image addition, it is possible to capture only an image having a predetermined contrast value or more without capturing a blurred image. A depth image can be constructed.

In the automatic capturing algorithm, among the specimens for which the effective range could not be captured, the contrast is relatively high. However, the parameter value is not appropriate for the sample, and the image cannot be captured. Even when the image is judged to be dust on the CCD, a high-depth image can be obtained. Furthermore, compared to manual image capturing, adjustment of the image capturing position, adjustment of the sample thickness, and the like are not required, and efficient work can be realized.

Further, even when the stage on which the observation sample is mounted is shaken due to movement, the contrast calculation can be performed in the same manner as in the case where no shake occurs, and an accurate focusing range can be determined. By performing the blur correction on the integration of the image at the time of inputting the image according to the obtained focusing range, an accurate focusing range can be input without blurring.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a schematic configuration according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a schematic configuration of an operation unit according to the embodiment;

FIG. 3 is an exemplary view for explaining a method for obtaining a contrast value of one screen according to the embodiment;

FIG. 4 is an exemplary view for explaining the timing of a DSP interrupt signal for notifying that contrast calculation according to the embodiment has been completed;

FIG. 5 is a view showing a change in contrast value when the stage according to the embodiment is moved from top to bottom.

FIG. 6 is a flowchart for explaining an operation according to the embodiment;

FIG. 7 is a flowchart for explaining an operation according to the embodiment;

FIG. 8 is a flowchart for explaining the operation according to the embodiment;

FIG. 9 is a flowchart for explaining the operation according to the embodiment;

FIG. 10 is a flowchart for explaining the operation according to the embodiment;

FIG. 11 is a flowchart for explaining the operation according to the embodiment;

FIG. 12 is a block diagram showing a schematic configuration according to a second embodiment of the present invention.

FIG. 13 is a diagram showing a schematic configuration of an operation unit according to the embodiment.

FIG. 14 is an exemplary view for explaining a sample registration method according to the embodiment;

FIG. 15 is an exemplary view for explaining a sample registration method according to the embodiment;

FIG. 16 is an exemplary view for explaining a sample registration method according to the embodiment;

FIG. 17 is a flowchart for explaining the operation according to the embodiment;

FIG. 18 is a flowchart for explaining the operation according to the embodiment;

FIG. 19 is a block diagram showing a schematic configuration according to a third embodiment of the present invention.

FIG. 20 is an exemplary view for explaining displacement of an image in the imaging screen according to the embodiment;

FIG. 21 is a flowchart showing the contents of an operation process according to the embodiment;

FIG. 22 is a view showing the relationship between the position of the stage and the contrast value according to the embodiment.

FIG. 23 is a flowchart showing a subroutine for calculating a contrast value during the processing of FIG. 21;

FIG. 24 is an exemplary view for explaining displacement of an image in the imaging screen according to the embodiment;

FIG. 25 is a flowchart showing a subroutine of image addition during the processing of FIG. 21;

FIG. 26 is a block diagram showing a schematic configuration according to a fourth embodiment of the present invention.

FIG. 27 is a diagram showing a calculation direction of a contrast value in an image according to the embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Imaging means 101 ... Optical microscope 102 ... Stage 103 ... Intermediate magnification lens 104 ... CCD camera 105 ... Stage drive circuit 2 ... Device main body 201 ... Image capture circuit 202 ... Image addition circuit 203 ... Addition memory 204 ... Contrast calculation memory 205 ... DSP 206 ... CPU 207 ... spatial filter circuit 208 ... display memory 209 ... image display circuit 210 ... sample registration unit 211 ... data storage unit 3 ... TV monitor 4 ... operation unit 401 ... focusing handle 402 ... ready LED 403 ... start button 404: Contralast level adjustment knob 11: Screen 12, 13, vertical and horizontal lines, 14, 15: diagonal line. DESCRIPTION OF SYMBOLS 21 ... Optical microscope main body 22 ... Stage 23 ... Sample specimen 24 ... Television camera 25 ... A / D converter 26 ... Adder 27 ... Addition image memory 28 ... Divider 29 ... Spatial filter 30 ... Display image memory 31 ... D / A converter 32 ... display unit 33 ... brightness memory 34 ... DSP 35 ... brightness memory controller 36 ... image memory controller 37 ... focusing range detection unit 38 ... CPU 39 ... stage drive unit 40 ... optical encoder 41 ... object lens information Acquisition unit 42 Image blur correction amount calculation unit 43 Operation unit 51 Display memory controller 52 Focused position detection unit

Claims (5)

[Claims] 1. An image pickup means for picking up an image of an object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and the object moved by the focus position move means. Image addition means for adding an image of the object imaged by the imaging means; contrast operation means for calculating the contrast value of the image of the object imaged by the imaging means; and operation by the contrast operation means And a control unit for monitoring a change in the contrast value of the captured image of the object to be photographed, and instructing the image adding unit to perform image addition when the change in the contrast value becomes a predetermined change. Image input device. 2. An image pickup means for picking up an image of the object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and the object moved by the focus position move means. Image addition means for adding an image of the object imaged by the imaging means; contrast operation means for calculating the contrast value of the image of the object imaged by the imaging means; Parameter calculating means for calculating an image capturing parameter from the contrast value calculated by the calculating means; and control means for instructing the image adding means to add an image based on the image capturing parameter calculated by the parameter calculating means. An image input device, comprising: 3. An image pickup means for picking up an image of an object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and a storage means for storing an image picked up by the image pickup means. Detecting means for detecting a blur amount generated in the image obtained by the imaging means due to the movement of the focal point by the focus position moving means; and controlling a write / read address of the storage means based on the blur amount detected by the detecting means. Address adding means for adding an image obtained by the image pickup means to an image read from the storage means by the address control of the address controlling means, and writing the added image to the storage means; Contrast calculating means for calculating a contrast value of the image of the object to be imaged by the imaging means; and the object to be calculated by the contrast calculating means And a control means for monitoring a change in the contrast value of the image, and instructing the image adding means to add an image when the change in the contrast value becomes a predetermined change. 4. The image input device according to claim 1, wherein said control means is capable of setting a predetermined contrast value at a start position of image addition of said image addition means. 5. An image pickup means for picking up an image of an object, a focus position moving means for moving a focus position of the object with respect to the image pickup means, and a storage means for storing an image picked up by the image pickup means. Detecting means for detecting a blur amount generated in the image obtained by the imaging means due to the movement of the focal point by the focus position moving means; and controlling a write / read address of the storage means based on the blur amount detected by the detecting means. Address control means, a contrast calculation means for calculating a contrast value of the image of the object imaged by the imaging means, and a change in contrast value of the image of the object calculated by the contrast operation means. And control means for instructing the storage means to store an image when the change in the contrast value becomes a predetermined change. Characteristic image input device.