JPH0829140A - Object identifying apparatus - Google Patents

Abstract

PURPOSE:To classify an unshaped object highly accurately by providing an unshaped-object imaging means, which picks up the image of a microscope, an image-signal processing means, an optical Fourier transform means, a power- spectrum detecting means, an identifying and judging means and the like. CONSTITUTION:The output of the picked-up image of an image pickup means 11 is sent into an identification object position detecting means 12. The object of the identification, e.g. leukocyte, is detected from dyed color information and the like. The picked up image signal is sent into an image preprocessing means 15 and the like. The means 15 sends the preprocessed signal into a a liquid crystaly display driving circuit 19. The image signal, which is transformed and processed in the circuit 19, is displayed on a liquid crystal panel display device 22. On the display panel of the device 22, the laser light from a semiconductor laser 20 is applied. The laser light outputted from the liquid crystal panel is made to pass an optical Fourier transformer lens 23, and the Braunhofer diffraction image in the fringe pattern is formed on the light receiving surface of a ring detector 24. The detected signal is sent into an identifying and judging means 27 from a power spectrum detecting means 26.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an object identifying apparatus for identifying an amorphous object from a biological microscope image or a fluorescence microscope image of a sample containing particle components such as blood, urine, and pathological samples, and more particularly, optical Fourier transform. The present invention relates to an object identification device for identifying an amorphous object by using a Fraunhofer diffraction image by conversion.

[0002]

BACKGROUND OF THE INVENTION White blood cells in blood are lymphocytes, neutrophils,
It is classified into eosinophils, basophils, monocytes, and various types of immature leukocytes. What is the concentration (percentage) of such leukocytes in blood is conventionally determined by an object identification device. It was determined using.

The conventional object identifying apparatus first obtains a biological microscope image of a stained blood sample, and applies a laser beam to a specific enlarged white blood cell image of the biological microscope image to perform an optical Fourier transform, A striped Fraunhofer diffraction image of the converted image is obtained. Parameters based on the power spectrum pattern of this Fraunforfa diffraction image are analyzed using a specific judgment algorithm such as neuro-fuzzy analysis or statistical analysis in the discrimination judgment means having learning means, and the irregular shape object is analyzed. Was being classified.

[0004]

In such a conventional object identifying apparatus, the Fraunhofer diffraction image is simply analyzed using a specific determination algorithm without taking the color information into consideration. However, there is a problem that identification is not possible when irregular-shaped objects having different colors (including fluorescence) have similar power spectrum patterns. Also, for example, when identifying white blood cells as an amorphous object,
It has not been performed in the past to obtain a Fraunhofer diffraction image for an image obtained by extracting, enlarging or emphasizing a specific portion such as the nucleus or cytoplasm of white blood cells,
There is a problem that it is difficult to perform highly accurate identification.

The present invention has been proposed in order to solve the problems of the prior art, and it is an object of the present invention to provide an object identification device capable of classifying irregularly shaped objects with high accuracy.

[0006]

In order to achieve this object, an object identifying apparatus according to the present invention comprises an amorphous object image pickup means for picking up a microscopic image of an amorphous object and a two-dimensional spatial light for the imaged amorphous object. The image signal processing means projected on the modulator and the amorphous object image projected on the two-dimensional spatial light modulator are irradiated with laser light to perform an optical Fourier transform, and a plurality of Fraunhofer diffraction images of the amorphous object are obtained. Optical Fourier transforming means to be formed in the ring detector consisting of concentric ring-shaped light receiving area, and receiving the detection output of the ring detector,
The power spectrum detecting means for detecting the power spectrum pattern of the Fraunhofer diffraction image, the auxiliary parameter detecting means for extracting the color information of the imaged amorphous object as an auxiliary parameter, and the detection output of the power spectrum detecting means. In response, the power spectrum pattern of the Fraunhofer diffraction image is analyzed to identify an irregularly shaped object, and if the identification is ambiguous or impossible, the color information from the above auxiliary parameter detection means is used as an auxiliary parameter for identification. It is configured to include an identification determination unit that takes in and identifies an irregular-shaped object.

Further, the object identifying apparatus according to the present invention comprises an amorphous object image pickup means for picking up a microscope image of an amorphous object,
The imaged amorphous object is displayed on the two-dimensional spatial light modulator, and if the identification of the amorphous object is ambiguous or impossible, a specific part of the amorphous object is extracted, enlarged or emphasized to the two-dimensional spatial light modulator. An image signal processing means for performing a projecting process and an optical Fourier transform by irradiating a laser beam to the image of the amorphous object projected on the two-dimensional spatial light modulator to obtain a Fraunhofer diffraction image of the amorphous object. Optical Fourier transform means to form a ring detector consisting of a plurality of concentric ring-shaped light-receiving area, receiving the detection output of the ring detector, power spectrum detection means for detecting the power spectrum pattern of the Fraunhofer diffraction image, Receiving the detection output of the power spectrum detection means, the power spectrum pattern of the Fraunhofer diffraction image is analyzed to identify an irregular object. If the identification is ambiguous or impossible, the identification determination means for identifying the amorphous object by analyzing the power spectrum pattern of the Fraunhofer diffraction image of the image obtained by extracting, enlarging or enhancing the specific portion of the amorphous object It is configured to have and.

Further, the object identifying apparatus according to the present invention comprises an amorphous object image pickup means for picking up a microscopic image of an amorphous object,
The imaged amorphous object is displayed on the two-dimensional spatial light modulator, and if the identification of the amorphous object is ambiguous or impossible, a specific part of the amorphous object is extracted, enlarged or emphasized to the two-dimensional spatial light modulator. An image signal processing means for performing a projecting process and an optical Fourier transform by irradiating a laser beam to the image of the amorphous object projected on the two-dimensional spatial light modulator to obtain a Fraunhofer diffraction image of the amorphous object. Optical Fourier transform means to form a ring detector consisting of a plurality of concentric ring-shaped light-receiving area, receiving the detection output of the ring detector, power spectrum detection means for detecting the power spectrum pattern of the Fraunhofer diffraction image, Auxiliary parameter detecting means for extracting color information of the imaged amorphous object as an auxiliary parameter, and detection output of the power spectrum detecting means In response, the power spectrum pattern of the Fraunhofer diffraction image is analyzed to identify an irregularly shaped object, and if the identification is ambiguous or impossible, the color information from the above auxiliary parameter detection means is used as an auxiliary parameter for identification. The irregular shape object is captured, and if the identification is ambiguous or impossible, the power spectrum pattern is analyzed for the Fraunhofer diffraction image of the image in which a specific part of the irregular object is extracted, enlarged or emphasized. It is configured to have an identification determination unit for identifying a fixed object.

[0009]

According to the structure corresponding to the above-mentioned claim 1, not only the power spectrum pattern of the Fraunhofer diffraction image obtained by optical Fourier transform of the liquid crystal display image of the amorphous object is analyzed, but also Since the color information of the fixed object is taken in as an auxiliary parameter for the identification, the accuracy of identifying the irregular object such as white blood cells can be improved.

According to the structure corresponding to claim 2,
Fraunfora diffraction image obtained from not only the power spectrum pattern of the Fraunhofer diffraction image obtained from the entire image of the irregular object but also the extraction, enlargement or enhancement image of a specific part of the irregular object Since the power spectrum pattern of is also analyzed, it is possible to further improve the accuracy of identifying an amorphous object.

According to the structure corresponding to claim 3,
In addition to analyzing the power spectrum pattern of the Fraunhofer diffraction image obtained from the entire image of the irregular object, the color information of the irregular object is captured as an auxiliary parameter for identification, and the specific part of the irregular object is identified. Since the power spectrum pattern of the Fraunhofer diffraction image obtained from the extraction, enlargement, or enhancement image of is also analyzed, the accuracy of identifying an irregular object can be further improved.

[0012]

Embodiments of the present invention will now be described in detail with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the object identifying device according to the present invention. In this figure, a sample 4 in which, for example, stained blood is placed on a slide is placed on a sample table 3, and the light from the light source 1 is placed on the sample 4 by the condenser lens 2
It is focused and irradiated by. The light emitted from the sample 4 passes through the objective lens 5, the beam splitter 6, and the relay lens 7 to C
A microscopic image is captured by the image capturing means 11 including a CD camera. The light from the beam splitter 6 is sent to the identification object focus detection means 8, and this detection output is input to the automatic focus control means 9. The output of the control means 9 controls the vertical movement means 14 for moving the sample stage 3 and the condenser lens 2 to automatically focus the sample 4.

The image pickup output of the image pickup means 11 is sent to the identification target object position detection means 12 and white blood cells, which are the identification objects, are detected as the target object from the dyed color information and the like. The detection output of the identification target object position detection means 12 is
It is sent to the sample stage control means 13, and the control stage output drives the sample stage left-right front-back direction moving means 14,
For example, white blood cells are sequentially detected as the identification target object. By this operation, for example, a microscope image of one white blood cell is picked up by the image pickup means 11, and this image signal is sent to the image preprocessing means 15, the auxiliary parameter detection means 16, the observation display means 18, and stored in the memory 17. It

The image preprocessing means 15 performs preprocessing on the detected image of one white blood cell and sends this image signal to the liquid crystal display drive circuit 19. This drive circuit 19
The image signal that has been sent to and converted into a display signal is displayed on the display panel of the liquid crystal display device 22. Here, the image preprocessing unit 15 and the liquid crystal display drive circuit 19 constitute an image signal processing unit. The liquid crystal display panel of the liquid crystal display device 22 is irradiated with laser light from the semiconductor laser 20 after being converted into parallel light by the lens 21. The laser light emitted from the liquid crystal display panel is used for the optical Fourier transform lens 2
As a result, the striped Brown Forfar diffraction image of the optical Fourier transformed image is formed by a plurality of concentric ring-shaped light receiving areas.
Formed. The detection signal of the ring detector 24 is sent to the power spectrum detection means 26, and the power spectrum pattern of the Fraunhofer diffraction image is detected. Here, the semiconductor laser 20, the lens 21,
The liquid crystal display device 23 and the liquid crystal display device 22 constitute optical Fourier transforming means for an irregular object image. Power spectrum detection means 26
The detection signal of is sent to the identification determination means 27 having learning means. The identification determination means 27 is provided with a table 28 for accumulating learning knowledge that is enhanced by the identification processing of the irregular shaped object each time.

On the other hand, in the auxiliary parameter detecting means 16,
The color information of the amorphous object to be identified (in this example, the color information of one white blood cell stained) is detected, and the identification determination unit 2
Sent to 7. The color information sent to the identification determination means 27 is
It is used as an auxiliary parameter for identification when an amorphous object cannot be identified or the identification is ambiguous only by analysis of the power spectrum pattern by the Fraunhofer diffraction image.

Further, when the amorphous object cannot be identified even if the auxiliary parameter based on the color information is used or the identification is ambiguous, the image signal read from the memory 17 is fetched into the image preprocessing means 15 and the amorphous object is read. A specific part of
For example, the process of extracting, enlarging or emphasizing the nucleus portion of one white blood cell is performed. As a result, the power spectrum analysis of the Fraunhofer diffraction image of a specific portion is performed, and detailed identification of an amorphous object becomes possible.

Next, the operation of the object discriminating apparatus having the above structure will be described with reference to the flow chart of FIG. First, a sample 4 of an amorphous object is set on the sample table 3 (step S
1). After the sample is set, the image automatically focused by the identification object focus detection means 8 is input to the imaging means 11 (step S2).

After that, the image taken by the image pickup means 11 is sent to the identification target object position detection means 12. As a result, the position of the identification target is detected, and the image of the amorphous object is input to the image pickup means 11 (steps S3 to S).
4). The image pickup signal of the amorphous object output from the image pickup means 11 is used as the image preprocessing means 15 and the auxiliary parameter detection means 1.
6 and is stored in the memory 17.

The image sent to the image preprocessing means 15 is displayed on the display panel of the liquid crystal display device 22 after the preprocessing (step S5). This liquid crystal display panel is irradiated with the collimated coherent light flux from the semiconductor laser 20, and a Fraunhofer diffraction image is formed on the ring detector 24 placed on the optical free conversion surface (step S6).

The detection output of the ring detector 24 is sent to the power spectrum detecting means 26 to detect the power spectrum pattern of the Fraunhofer diffraction image, and this detection signal is sent to the discrimination determining means 27.
The discrimination determining means 27 performs neuro-fuzzy analysis or statistical analysis on the input power spectrum pattern by using a discrimination table created by learning in advance, and discriminates an amorphous object (step S7). ).

When it is determined by this analysis that it is difficult to identify the irregular-shaped object (step S8), the color information of the irregular-shaped object extracted by the auxiliary parameter detecting means 16 according to the instruction from the control unit 29 is determined by the identification determining means. Sent to 27,
Color information as an auxiliary parameter is added to further determine an irregular-shaped object (steps S9 to S10).

If it is determined that it is difficult to identify an irregularly shaped object using the color information of the auxiliary parameter (step S1)
1) In response to a command from the control unit 29, an image of an amorphous object is read from the memory 17 to the image preprocessing unit 15, and a specific portion of the amorphous object is extracted, enlarged or emphasized on the display panel of the liquid crystal display device 22. Image processing for displaying is performed (step S12). With this process,
A Fraunforfer diffraction image for an image obtained by extracting, enlarging or enhancing a specific portion of an irregular-shaped object is detected by the ring detector 24, and the identification determination means 27 analyzes the power spectrum pattern of this Fraunforfer diffraction image. It is performed (steps S13 to S14).

When an amorphous object is identified by this analysis processing, the control unit 29 causes the identification target object position detecting means 12 to perform identification.
A control signal for detecting the position of the next target to be identified is sent to. As a result, when the position of the identification target is detected, the processes of steps S3 to S14 are repeated. When the determination process has been performed for all identification targets (step S15), the operation ends.

Although the liquid crystal display panel is used as the two-dimensional spatial light modulator in this embodiment, the same applies to a spatial light modulator using a BSO crystal or a PLZT sintered body.

Further, by analyzing the power spectrum pattern of the Fraunhofer diffraction image obtained from the result of the optical Fourier transform of the entire image of the amorphous object and the analysis considering the color information of the amorphous object, the amorphous object is analyzed. May be determined.

Further, the analysis of the power spectrum pattern of the Fraunhofer diffraction image obtained from the entire image of the irregular object and the Fraunhofer diffraction of the image in which a specific portion of the irregular object is extracted, enlarged or emphasized. It is also possible to discriminate irregular-shaped objects by analyzing the power spectrum pattern of the image.

The present invention can be used not only for identifying white blood cells, but also for identifying other blood cells, particle components in urine, pathological samples and the like.

[0028]

As described above, according to the present invention, which corresponds to claim 1, the power spectrum pattern of the Fraunhofer diffraction image obtained by performing an optical free Fourier transform on an image of an amorphous object is analyzed. Since not only the irregular object is identified but also the irregular object is identified in consideration of the color information, the irregular object such as white blood cell can be discriminated with high accuracy.

According to the present invention corresponding to claim 2, not only the amorphous object is identified by analyzing the power spectrum pattern of the Fraunhofer diffraction image obtained from the entire image of the amorphous object. Since the power spectrum pattern of the Fraunhofer diffraction image obtained from the image obtained by extracting, enlarging or emphasizing the specific portion of the amorphous object is also analyzed and identified, the amorphous object can be discriminated with higher accuracy.

Further, according to the present invention corresponding to claim 3, not only the amorphous object is identified by analyzing the power spectrum pattern of the Fraunhofer diffraction image obtained from the entire image of the amorphous object. , The color information is also taken into consideration for the identification, and the specific part of the irregular object is extracted.
Since the power spectrum pattern of the Fraunhofer diffraction image obtained from the magnified or emphasized image is also analyzed and identified, the amorphous object can be discriminated with higher accuracy.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of an object identification device according to the present invention.

FIG. 2 is a flow chart showing a processing procedure of the object identifying apparatus of FIG.

[Explanation of symbols]

 3 sample stage 4 sample 6 beam splitter 8 identification object focus detection means 11 imaging means 12 identification target object position detection means 15 image preprocessing means 16 auxiliary parameter detection means 17 memory 19 liquid crystal display drive circuit 20 semiconductor laser 22 liquid crystal display 24 Ring detector 25 Light receiving surface of ring detector 26 Power spectrum detection means 27 Identification determination means 28 Table 29 Control unit

Front page continued (72) Inventor Yutaka Nagai 1-31-4 Nishi-Ochiai, Shinjuku-ku, Tokyo Japan Toko Tomioka Co., Ltd. (72) Mami Ikeda 1-34-1 Nishi-Ochiai, Shinjuku-ku, Tokyo Nihon Kohden Tomioka Co., Ltd.

Claims (3)

[Claims] 1. An amorphous object image pickup means for picking up a microscopic image of an amorphous object, an image signal processing means for displaying the imaged amorphous object on a two-dimensional spatial light modulator, and an image signal processing means for displaying the image on the two-dimensional spatial light modulator. An optical Fourier transform means for irradiating a laser beam on an image of an amorphous object to perform an optical Fourier transform, and forming a Fraunhofer diffraction image of the amorphous object on a ring detector composed of a plurality of concentric ring-shaped light receiving areas. A power spectrum detecting means for detecting the power spectrum pattern of the Fraunhofer diffraction image by receiving the detection output of the ring detector, and an auxiliary parameter detecting means for extracting the color information of the imaged amorphous object as an auxiliary parameter. The power spectrum pattern of the Fraunhofer diffraction image is analyzed by receiving the detection output of the power spectrum detection means. When a shaped object is identified, if the identification is ambiguous or impossible, it is characterized by including identification determination means for taking in the color information from the auxiliary parameter detection means as an auxiliary parameter for identification and identifying an amorphous object. Object identification device. 2. An amorphous object image pickup means for picking up a microscopic image of an amorphous object, the imaged amorphous object being projected on a two-dimensional spatial light modulator, and when the amorphous object is ambiguous or impossible to identify. Image signal processing means for extracting, enlarging or emphasizing a specific part of the irregular object and projecting it on the two-dimensional spatial light modulator, and laser light on the image of the irregular object projected on the two-dimensional spatial light modulator. Optical Fourier transform is performed to irradiate the light to form a Fraunhofer diffraction image of an indeterminate object on a ring detector consisting of multiple concentric ring-shaped light-receiving areas, and the detection output of the ring detector. , A power spectrum detecting means for detecting the power spectrum pattern of the Fraunhofer diffraction image, and a detection unit for receiving the detection output of the power spectrum detecting means. Fraunhofer diffraction of an image in which an amorphous object is identified by analyzing the power spectrum pattern of the ower diffraction image, and a specific portion of the amorphous object is extracted, magnified or emphasized when the identification is ambiguous or impossible. An object identification device, comprising: an identification determination unit that analyzes a power spectrum pattern of an image to identify an irregular-shaped object. 3. An amorphous object imaging means for capturing a microscopic image of an amorphous object, the captured amorphous object being projected on a two-dimensional spatial light modulator, and when the amorphous object is ambiguous or impossible to identify. Image signal processing means for extracting, enlarging or emphasizing a specific part of the irregular object and projecting it on the two-dimensional spatial light modulator, and laser light on the image of the irregular object projected on the two-dimensional spatial light modulator. Optical Fourier transform is performed to irradiate the light to form a Fraunhofer diffraction image of an indeterminate object on a ring detector consisting of multiple concentric ring-shaped light-receiving areas, and the detection output of the ring detector. , A power spectrum detection means for detecting the power spectrum pattern of the Fraunhofer diffraction image, and the color information of the imaged amorphous object as an auxiliary parameter. Auxiliary parameter detection means for receiving the detection output of the power spectrum detection means, the power spectrum pattern of the Fraunhofer diffraction image is analyzed to identify an amorphous object, and if the identification is ambiguous or impossible, The color information from the auxiliary parameter detecting means is taken in as an auxiliary parameter for identification to identify an amorphous object, and if the identification is ambiguous or impossible, a specific portion of the amorphous object is extracted, enlarged or emphasized. An object identification device, comprising: an identification determination unit that identifies an irregular object by analyzing a power spectrum pattern of a Fraunhofer diffraction image.