JP2024090256A - Optical identification device and method - Google Patents

Abstract

A technology capable of improving the accuracy and efficiency of optical identification is provided.
[Solution] The optical identification device is an optical identification device for optically identifying an object by detecting fluorescence or phosphorescence from one or more fluorescent or phosphorescent substances contained in the object, and in accordance with the light-emitting characteristics of each of the one or more substances, light reception by the imaging element begins after a first time period determined in accordance with the light-emitting characteristics has elapsed from the time (time t2) when the irradiation of excitation light from the light source device to the substance is turned off, and light is received at second times (TA1, TB1, TC1) determined in accordance with the light-emitting characteristics, to obtain a detected electrical signal.
[Selected figure] Figure 7

Description

This disclosure relates to optical identification technology.

There is a technology that detects phosphorescence or fluorescence from media such as banknotes or biological samples, allowing for optical identification and discrimination.

An example of the prior art is JP 5-180751 A (Patent Document 1). Patent Document 1 describes a particle image analysis device that "is configured to flow a sample containing fluorescently dyed particles into a flow cell, irradiate the particles in the flow cell with light of a specific wavelength, measure the fluorescence emitted from the particles, determine whether or not they are target particles, and then capture a white image or a fluorescent image of the target particle."

Japanese Patent Application Laid-Open No. 5-180751

Patent document 1 (claim 1) describes the inclusion of an "optical filter that obtains fluorescent excitation light of a predetermined wavelength from the light emitted from the first light source" (optical filter 18 in Figure 1).

In the case of an optical identification device that uses such an optical filter (in other words, a bandpass filter, etc.), the following problems arise:

When the excitation light spectrum of the light source and the fluorescence spectrum of the target object are close or the same, it is necessary to narrow the wavelength band of the bandpass filter in order to detect the fluorescence while avoiding the excitation light. In this case, the excitation light spectrum components are likely to be mixed and detected in addition to the fluorescence spectrum components through the bandpass filter.

Therefore, even when the characteristics of the light source excitation light and the fluorescence/phosphorescence of the object have such a relationship, the following measures can be considered to be able to suitably detect the fluorescence/phosphorescence of the object. That is, a configuration that does not use an optical filter, or a configuration that uses an optical filter and is able to distinguish between the excitation light and the fluorescence/phosphorescence and detect the fluorescence/phosphorescence with a sufficient amount of light can be considered.

In addition, the target object may contain multiple types of substances with different fluorescent/phosphorescent emission characteristics (e.g., wavelength band, light amount, delay time, etc.). In this case, a single bandpass filter is not sufficient to enable optimal detection of the fluorescent/phosphorescent emission of each of the multiple substances.

In addition, in the past, when optical identification was performed on a biological sample, for example, if the fluorescence emitted from the biological sample was weak, the amount of light required to detect the weak fluorescence was small, making it difficult to detect and generate a high-contrast image, and optical identification could be difficult or take a long time.

The objective of this disclosure is to provide a technology that can improve the accuracy and efficiency of optical identification with respect to the above optical identification technology.

A representative embodiment of the present disclosure has the configuration shown below. One embodiment is an optical identification device for optically identifying an object by detecting fluorescence or phosphorescence emitted from one or more fluorescent or phosphorescent substances contained in the object, and in accordance with the emission characteristics of each of the one or more substances, the device starts receiving light with an image sensor after a first time determined according to the emission characteristics has elapsed from the time when irradiation of the substance from a light source device is turned off, and receives light for a second time determined according to the emission characteristics to obtain a detected electrical signal.

According to a representative embodiment of the present disclosure, the accuracy and efficiency of optical identification can be improved with respect to the optical identification technology described above. Problems, configurations, effects, etc. other than those described above are described in the description of the embodiment of the invention.

FIG. 1 is a perspective view showing an example of the external configuration of an optical identification device according to the first embodiment. FIG. 2 is a cross-sectional view showing an example of the configuration of the optical identification device according to the first embodiment, as viewed from the side. FIG. 3A is a diagram showing an example of the structure of a biological sample in the optical identification device of the first embodiment. FIG. 3B is a diagram showing an example of a configuration of a detected image in the optical identification device according to the first embodiment. FIG. 3C is a diagram showing an example of a configuration of a detected image in the optical identification device according to the first embodiment. FIG. 3D is a diagram showing an example of a configuration of a detected image in the optical identification device according to the first embodiment. FIG. 4 is a diagram showing an example of a functional block configuration in the optical identification device according to the first embodiment. FIG. 5 is a timing chart showing a basic configuration of timing control in the optical identification method by the optical identification device of the first embodiment. FIG. 6 is a timing chart showing an example of the fluorescence pattern characteristics of a plurality of substances in the optical identification method using the optical identification device of the first embodiment. FIG. 7 is a timing chart showing an example of timing control according to the fluorescence pattern characteristics of a plurality of substances in the optical identification method by the optical identification device of the first embodiment. FIG. 8 is a timing chart showing an example of integration timing control according to the fluorescence pattern characteristics of a plurality of substances in the optical identification method by the optical identification device of the first embodiment. FIG. 9A is a diagram showing an example of a display of a detection image in the optical identification method by the optical identification device according to the first embodiment. FIG. 9B is a diagram showing an example of a display of a detection image in an optical identification method using an optical identification device according to a modification of the first embodiment. FIG. 9C is a diagram showing an example of a display of a detection image in an optical identification method using an optical identification device according to a modification of the first embodiment. FIG. 10 is a diagram showing an example of a GUI screen display for settings in the optical identification device according to the first embodiment. FIG. 11 is a diagram showing advance monitoring in the optical identification device according to the first embodiment. FIG. 12 is a diagram showing an example of a GUI screen display for setting image capturing conditions in the optical identification device according to the first embodiment. FIG. 13 is a diagram showing an example of the excitation light spectrum of a light source, the fluorescence spectrum of an object, and the configuration of a bandpass filter (optical filter) in a comparative example. FIG. 14 is a diagram showing an example of excitation light from a light source and fluorescence from an object in a comparative example.

Below, an embodiment of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same parts are generally given the same reference numerals, and repeated explanations will be omitted. In the drawings, the representation of components may not represent the actual position, size, shape, range, etc., in order to facilitate understanding of the invention.

For the purpose of explanation, when describing processing by a program, the program, functions, processing units, etc. may be described as the main components, but the main hardware components of these are the processor, or a controller, device, computer, system, etc. that is composed of the processor. The computer executes processing according to the program read into the memory by the processor, appropriately using resources such as memory and communication interfaces. This realizes the specified functions, processing units, etc. The processor is composed of semiconductor devices such as a CPU/MPU or GPU, for example. Processing is not limited to software program processing, and can also be implemented by dedicated circuits. Dedicated circuits such as FPGAs, ASICs, and CPLDs can be used.

The program may be pre-installed as data on the target computer, or may be distributed as data from a program source to the target computer. The program source may be a program distribution server on a communication network, or a non-transient computer-readable storage medium, such as a memory card or a disk. The program may be composed of multiple modules. The computer system may be composed of multiple devices. The computer system may be composed of a client-server system, a cloud computing system, an IoT system, etc. The various data and information are composed of structures such as, for example, tables and lists, but are not limited to these. Expressions such as identification information, identifiers, IDs, names, and numbers are mutually interchangeable.

[Issues, etc.]
FIG. 13 is a supplementary explanatory diagram for the above-mentioned problem, and shows an example of the configuration of an excitation light spectrum 1301 of a light source, a fluorescence spectrum 1302 of an object, and a bandpass filter 1303 which is an optical filter. In the graph of FIG. 13, the horizontal axis is wavelength ([nm]) and the vertical axis is light intensity ([AU]). In the example of FIG. 13, the wavelength bands of the excitation light spectrum 1301 of the light source and the fluorescence spectrum 1302 of the object are close to each other. It is desirable for the optical identification device to efficiently detect only the fluorescence. For this purpose, as shown in the figure, the bandpass filter 1303 has a narrow wavelength band in accordance with the fluorescence spectrum 1302 to be detected, for example, a wavelength band to be passed is set to about 540 nm to 600 nm. However, since the wavelength bands of the excitation light spectrum 1301 and the fluorescence spectrum 1302 are close to each other, the components of the excitation light spectrum 1302 are likely to be detected in a mixed manner through the bandpass filter 1303 in addition to the components of the fluorescence spectrum 1301.

Depending on the characteristics of the light source and the characteristics of the object, a time difference (in other words, a shift) may occur between the emission of excitation light from the light source and the emission of fluorescence/phosphorescence from the object. Depending on the characteristics of the light source, a time lag may occur from when the emission of the light source excitation light is turned off until the light source excitation light actually disappears. For example, in the case of an LED (Light Emitting Diode) light source, the time lag is relatively small, but in the case of a halogen lamp light source, the time lag is relatively large. Depending on these time lags, the light source excitation light may be mixed with the fluorescence/phosphorescence, which is the detection light.

Figure 14 is a supplementary explanatory diagram regarding the time lag of the excitation light. (a) shows the on/off control of the emission of excitation light from a light source. Light source A in (b) is, for example, an LED light source, and there is a relatively short time lag (time) 1401 from the point at which the light source is controlled to be turned off until the excitation light disappears. Light source B in (c) is, for example, a halogen lamp light source, and there is a longer time lag (time) 1402 than in (b) from the point at which the light source is controlled to be turned off until the excitation light disappears.

The excitation light with the time lag described above is irradiated onto the object, affecting the fluorescence/phosphorescence emission, and there is also a possibility that the excitation light may be incident on the fluorescence/phosphorescence detection element. Such time-lag excitation light is undesirable as it reduces the accuracy of the detection image. Fluorescence A in (d) shows the emission of fluorescence from the object due to the excitation light from light source A, and fluorescence B in (e) shows the emission of fluorescence from the object due to the excitation light from light source B. Light source B irradiates more excitation light than light source A, so fluorescence B in (e) emits more light for a longer period of time than fluorescence A in (d).

As will be described later, the amount of light and delay of fluorescent/phosphorescent emission will differ even for the same excitation light depending on the characteristics of each of the multiple substances in the target object (e.g., a biological sample). For the sake of explanation, such characteristics may be referred to as a fluorescent pattern, etc.

The optical identification device and method of this embodiment are configured to take into account the above-mentioned problems, and control the timing of the emission of the light source excitation light and the detection and exposure of the target light (fluorescence/phosphorescence) taking into account the time difference between when the emission of the light source excitation light is turned off and when the fluorescence/phosphorescence of the target is detected, and also taking into account the emission characteristics of each substance (light amount, delay, etc.).

The optical identification device and method of this embodiment also take into account the differences in the characteristics of each target material and obtain the required amount of light by integrating the detection and exposure signals (in other words, calculations and processing such as adding up multiple detection signals).

Even when the target object contains multiple types of substances with different light emission characteristics such as fluorescence/phosphorescence, the optical identification device and method of this embodiment controls the timing of detection, exposure, etc., and performs accumulation processing appropriate for each of those substances. In this way, a detection image appropriate for each substance is obtained.

<Embodiment>
An optical identification device and method according to an embodiment of the present disclosure will be described with reference to FIGS. 1 to 14. FIG.

In this embodiment, a biological sample (in other words, a specimen) is treated as the object, and optical identification is performed by detecting fluorescence emitted from the biological sample. Examples of biological samples include human mucus and saliva. In this embodiment, a case where fluorescence is treated is described, but the present invention is not limited to this, and can be similarly applied to a case where phosphorescence is treated. In addition, in this embodiment, a slide is prepared in which multiple types of reaction reagents are applied to the biological sample in advance to cause a reaction, and the reaction is optically identified using the slide (Figure 3A described below).

In the present embodiment, particularly in embodiment 1, a case will be described in which timing control of imaging (exposure, etc.) is performed based on on/off control of the light source, without using an open/close shutter for the light source (open/close shutter 70 in FIG. 2). The configuration of embodiment 1 is applied when the time 1401 of leakage/shift of excitation light after the light source is turned off is relatively short, such as light source A (e.g., an LED light source) in FIG. 14(b).

In addition, among the present embodiments, particularly in embodiment 2, a case will be described in which an open/close shutter for a light source (open/close shutter 70 in FIG. 2) is used to control the timing of imaging (exposure, etc.) by controlling the opening/closing of the open/close shutter (in other words, the blocking of excitation light on/off) as well as the on/off control of the light source. The configuration of embodiment 2 is applied when the time 1402 of leakage/shift of excitation light after the light source is turned off is relatively long, such as light source B (e.g., a halogen lamp light source) in FIG. 14(c).

[Optical identification device (1)]
Fig. 1 shows a perspective view of the exterior of an optical identification device 1 according to an embodiment. The optical identification device 1 includes components mounted in a housing 20, such as an opening 3, a display device 5, a control device 10, an image sensor 8, a lens 9, and a light source device 7 (Fig. 2) not shown in Fig. 1. The housing 20 has a rectangular parallelepiped shape in this example, but is not limited thereto.

In FIG. 1, the housing 20 is placed on the XY plane, which is a horizontal plane in the spatial coordinate system (X, Y, Z) shown in the figure. An opening 3 is provided on the bottom surface of the housing 20 in the Z direction. The opening 3 is a portion that is optically transparent for the light source excitation light and the fluorescent/phosphorescent light, in other words, a window portion. The opening 3 may be an empty portion, or a portion in which a member that is optically transparent (e.g., a glass plate) is disposed. Also, FIG. 1 shows a state in which a preparation 30 (see FIG. 3A described below) is disposed as the object 2 below the opening 3 on the XY plane.

In the housing 20, from top to bottom in the Z direction, the display device 5, the control device 10, the image sensor 8, the lens 9, the light source device 7 in FIG. 2, etc., and the opening 3 are arranged.

The control device 10 corresponds to a controller that controls the entire optical identification device 1 and each part. The control device 10 controls the light source device 7 (Figure 2), the image sensor 8, etc., acquires an image signal captured by the image sensor 8, and generates an image from the image signal. The control device 10 performs a predetermined optical identification process based on the captured image, and displays the captured image and the processing results on the screen of the display device 5.

The display device 5 is, for example, a color LCD monitor (LCD: liquid crystal display device). The housing 20 may also include other operation devices, not shown, such as operation buttons for the user to input operations. The control device 10 (see FIG. 4 below) of the optical identification device 1 may also be provided with a communication interface and an input/output interface, and data may be input/output between the control device 1 and an external device via the communication interface. In FIG. 1, the display device 5 is integrally built into the housing 20, but this is not limiting, and the display device 5 may be connected separately from the housing 20.

The light source device 7 is a light source that generates excitation light of a specific wavelength component, and in embodiment 1, it is an LED light source, and in embodiment 2, it is a halogen lamp light source.

The imaging element 8 is an imaging element such as a CCD or CMOS sensor that has light receiving sensitivity in the wavelength region of the fluorescence/phosphorescence emitted from the object 2, in other words, a light receiving circuit or a camera. Based on the control of the control device 10, the imaging element 8 accumulates electric charges corresponding to the intensity of the received light for each light receiving element corresponding to a pixel, outputs the accumulated electric charges as an electrical signal at the timing of reading, and discharges the accumulated electric charges at the timing of discharging. In this example, the imaging element 8 is an element capable of full color photography. The lens 9 is an optical adjustment element, for example an imaging lens. In this embodiment, no optical filter is provided between the object 2 and the lens 9.

A user performing optical identification work prepares a preparation 30 (FIG. 3A) on a workbench with a reagent applied to the specimen, and with the preparation 30 placed, positions the opening 3 of the housing 20 of the optical identification device 1 above the preparation 30. The user then presses a main switch (not shown) of the optical identification device 1 to execute the optical identification process. This generates a detection image (particularly an integrated image and a composite image, described below), which are displayed on the screen of the display device 5.

[Optical identification device (2)]
FIG. 2 shows a cross-sectional view of the optical identification device 1 of FIG. 1 as seen from the side, and shows a Y-Z cross section taken along line A-A in FIG. 1. FIG. 2 shows the configuration of embodiment 2 having an opening/closing shutter 70, but embodiment 1 does not have the opening/closing shutter 70. For example, the imaging element 8 and the lens 9 are arranged facing downward in the center of the housing 20 in the Y-axis direction, with the optical axis c0 indicated by a dashed line. At a predetermined height position in the Z-axis direction, the light source device 7 is arranged on both the left and right sides in the Y-axis direction. In this example, the two light source devices 7 are arranged diagonally downward facing the optical axis c0, with the optical axis c1 indicated by a dashed line. The imaging element 8 and the light source device 7 are electrically connected to the control device 10 by a signal line not shown.

The control device 10 controls the on/off timing of the light emission of each light source device 7. The control device 10 controls the timing of detection and exposure of the fluorescence (e.g., fluorescence c2) by the imaging element 8.

In addition, in the second embodiment, an opening/closing shutter 70 is disposed near the light source device 7. In this example, for each of the two light source devices 7, an opening/closing shutter 70 is disposed on both the left and right sides in the Y-axis direction at a predetermined height position on the optical axis c1 above the opening 3. The opening/closing shutter 70 is a mechanism that can switch between a closed state that blocks the excitation light from the light source device 7 and an open state that allows the excitation light to pass. The opening/closing shutter 70 is electrically connected to the control device 10 (FIG. 4) through a signal line (not shown). The control device 10 controls the timing of opening and closing the opening/closing shutter 70.

The mechanism for opening and closing the opening/closing shutter 70 is, for example, a mechanical opening and closing mechanism, but is not limited to this.

Excitation light from the light source device 7 is irradiated onto the object 2 through the opening 3. Then, for example, fluorescence is generated from a specific substance contained in the object 2. The fluorescence is emitted upward in the Z direction as, for example, fluorescence c2, and enters the lens 9. The fluorescence c2 is collected through the lens 9 and then enters the image sensor 8. The image sensor 8 exposes the fluorescence c2 and detects it as a detection signal (in other words, an image signal). The detection signal is sent to the control device 10, which generates an image from the detection signal.

When the first embodiment is configured without the opening/closing shutter 70, the device may be configured such that the opening/closing shutter 70 is mounted on the housing 20 as shown in FIG. 2, and the opening/closing shutter 70 is always kept open.

[Subject (biological sample)]
3A shows an example of a preparation 30 in which a biological sample (specimen) is stored as the object 2. In this preparation 30, a specimen 31 (e.g., human mucus) is placed on a glass slide, and three types of reagents (reaction reagents) indicated by A to C are applied to the specimen, which is then sealed under a cover glass. That is, the object 2 contains, as a plurality of types of substances, reactants A to C with the reagents A to C, respectively. In a specified test, the result of the reaction between such a specimen and the reagents is confirmed. In the optical identification device 1 and the optical identification method of this embodiment, the result of the reaction between such a specimen and the reagents is optically identified by using fluorescence generated in response to each reactant.

In FIG. 3A, three types of reactants, indicated as A, B, and C, are provided at positions separated to some extent on a preparation 30 containing a specimen 31, which is the object 2.

Figures 3B, 3C, and 3D show detection images that are images captured by the optical identification device 1 of this embodiment based on the preparation 30 of Figure 3A. This detection image is an image in which fluorescence is detected for each reactant, and is an image at the time of detection by the control device 10 and before it is displayed. Figure 3B shows a detection image 300A for reactant A. Figure 3C shows a detection image 300B for reactant B. Figure 3D shows a detection image 300C for reactant C. As will be described later, the optical identification device 1 of this embodiment can obtain detection images (particularly integrated images described later) separately for each reactant, and can also obtain a detection image (sometimes referred to as a composite image) in which the detection images of each reactant are combined into one.

In the detection image 300A of FIG. 3B, the fluorescence mainly from reactant A is detected as image 301A. In the detection image 300A, the fluorescence of this reactant A has a brightness value corresponding to the detection signal (for example, relatively high brightness compared to the fluorescence of reactants B and C). In the detection image 300B of FIG. 3C, the fluorescence mainly from reactant B is detected as image 301B. In the detection image 300B, the fluorescence of this reactant B has a brightness value corresponding to the detection signal (for example, relatively high brightness compared to the fluorescence of reactants A and C). In the detection image 300C of FIG. 3D, the fluorescence mainly from reactant C is detected as image 301C. In the detection image 300C, the fluorescence of this reactant C has a brightness value corresponding to the detection signal (for example, relatively high brightness compared to the fluorescence of reactants A and B).

When these detection images 300A, 300B, and 300C are displayed as individual detection images or as a composite image described below, each fluorescence image of the reactants (A to C) is displayed in a predetermined color. For example, the fluorescence image of reactant A in detection image 300A is displayed in green, the fluorescence image of reactant B in detection image 300B is displayed in red, and the fluorescence image of reactant C in detection image 300C is displayed in blue. When displaying these three detection images on the screen of the display device 5, the control device 10 treats them as a green image, a red image, and a blue image, and generates and displays a composite image by combining these as a color image. The predetermined colors for each of the above fluorescence images are set as different predetermined colors so that the user can easily distinguish the fluorescence of each reactant.

The optical identification device 1 and method of this embodiment can be used to optically identify multiple types of substances (reactants A to C) at once. The optical identification device 1 and method of this embodiment captures an image of the object 2 (preparation 30) to simultaneously obtain, for example, three types of detection images as shown in Figures 3B to 3D.

In another example of the object 2, only a reactant substance based on one reagent may be provided on the preparation 30. In another example of the object 2, multiple specimens may be placed at separate positions within the range of the opening 3.

[Function block]
Fig. 4 shows an example of a functional block configuration of the optical identification device 1. Fig. 4 shows a case where the opening and closing shutter 70 is controlled as in the case of the second embodiment, but in the case of the first embodiment, the opening and closing shutter 70 is not controlled by the shutter opening and closing control unit 107.

The control device 10 has, as its functional blocks, a display control unit 101, an image signal conversion unit 102, a timing control unit 103, and a setting unit 108. More specifically, the timing control unit 103 has an image capture readout control unit 104, an emission control unit 105, a light source emission control unit 106, and a shutter opening/closing control unit 107. Each functional block is realized by a processor, memory, etc. provided in the optical identification device 1. Specifically, the processor realizes the timing control unit 103, etc. by executing processing according to a program read onto the memory. The implementation of each functional block is not limited to program processing, and may be a dedicated circuit, etc.

The display control unit 101 controls the image display on the screen of the display device 5 based on data such as images obtained by the image signal conversion unit 102.

The image signal conversion unit 102 generates a detection image by conversion and processing based on the detection signal from the image sensor 8. The detection image here also includes the concepts of an accumulated image and a composite image. Note that circuits such as an analog/digital conversion circuit and an amplifier circuit may be included as part of the image sensor 8, between the image sensor 8 and the control device 10, or as part of the image signal conversion unit 102.

The timing control unit 103 controls the timing of exposure (in other words, light reception) and discharge by the image sensor 8, the timing of light emission by the light source device 7, and the timing of opening and closing by the opening and closing shutter 70.

The setting unit 108 is a part where the optical identification device 1 system or the user sets the settings. The settings made by the setting unit 108 (described later) are reflected in the operation of the timing control unit 103, the image signal conversion unit 102, etc.

The imaging readout control unit 104 controls the reading out of detection signals (in other words, imaging signals, image signals) from the imaging element 8 by supplying signals (readout control signals) to the imaging element 8. The detection signals are electrical signals resulting from charges accumulated in each pixel of the imaging element 8 upon exposure (light reception).

The discharge control unit 105 controls the discharge of the electric charge accumulated in the image sensor 8 by supplying a signal (discharge control signal) to the image sensor 8. The discharge resets the electric charge accumulation of each pixel.

The light source emission control unit 106 controls the on/off of the emission of excitation light by each light source device 7 by supplying a signal (light emission control signal) to the light source device 7.

In the case of embodiment 2, the shutter opening/closing control unit 107 supplies a signal to the opening/closing shutters 70 to control the opening/closing of each opening/closing shutter 70.

The parameter values of the timing control of the timing control unit 103 are configured to be changeable. In a specific example, each parameter value of the timing control is stored in a non-volatile memory in the control device 10, and these parameter values can be rewritten by settings.

[Implementation example (supporting multiple types of substances)]
One implementation example of the optical identification device 1 of this embodiment is a configuration in which hardware and software are implemented to be able to handle a specific number of types of substances (e.g., reactive substances shown as A to C in Figure 3) in a specific object 2 when these types of substances are fixedly determined in advance.

Another implementation example of the optical identification device 1 of this embodiment is a configuration in which a setting function is implemented so that when there are multiple types of materials in the target object 2, the device can variably accommodate the various materials. In this embodiment, in order to accommodate the latter implementation, a setting unit 108 is provided in the control device 10 as shown in FIG. 4. Setting information is also displayed on the screen of the display device 5. The user checks the setting information on the screen of the display device 5, and when making user settings, inputs setting values, etc. The setting unit 108 saves the information based on the user settings, and sets control parameter values in the timing control unit 103, etc. Examples of control parameter values that can be set will be described later.

The setting unit 108 may be implemented using an external device such as a PC. In that case, the setting unit 108 in FIG. 4 has an interface that inputs and receives setting information from an externally connected device such as a PC, and sets control parameter values in the circuits of the control device 10, etc.

[Basic timing control]
Fig. 5 shows a time chart of basic timing control in the optical identification device 1 and method of the embodiment. Fig. 5 shows a case where the opening and closing shutter 70 is controlled as in the second embodiment, but in the case of the first embodiment, the control of the opening and closing shutter 70 of (b) is not performed. The control device 10 in Fig. 4 (particularly the timing control section 103) performs timing control as shown in this chart. In Fig. 5, the horizontal axis represents time, and the vertical axis represents each component.

The light source in (a) indicates the on/off state of the emission of excitation light from the light source device 7. The open/close shutter in (b) indicates the opening/closing of the open/close shutter 70. The excitation light in (c) indicates the excitation light generated from the light source device 7 and irradiated onto the object 2, in other words, the excitation light after passing through the open/close shutter 70. The fluorescence in (d) indicates the fluorescence generated from the object 2 based on the irradiation of the excitation light. The discharge in (e) indicates the discharge of the charge from the imaging element 8. In (e), discharge is indicated by the on state of the signal, and non-discharge (charge accumulation) is indicated by the off state of the signal. The light reception, image capture, and output in (f) indicate the reception of the fluorescence in (d) by the imaging element 8, image capture, and output of the detection signal (in other words, readout by the control device 10).

First, the control device 10 turns on (ON) the light emission of the light source device 7 (a) at time t1. Note that by time t1, the open/close shutter 70 (b) is in the open state, and the image sensor 8 (e) is in the ejected state. The control device 10 maintains the light emission of the light source device 7 (a) in the ON state for a predetermined time T1 from time t1 to time t2. The control device 10 turns off (OFF) the light emission of the light source device 7 (a) at time t2.

The control device 10 controls the opening and closing of the opening/closing shutter 70 (b) in accordance with the on/off of the light source (a). Specifically, the control device 10 opens the opening/closing shutter 70 during the time T1 when the light source (a) emits light, and closes the opening/closing shutter 70 to the closed state at the same time as the light emission is turned off at time t2.

By controlling the light source device 7 (a) and the opening/closing shutter 70 (b), the excitation light (c) is irradiated onto the object 2 for a time T1 from time t1 to time t2. Even if the excitation light is still being generated after the light is turned off at time t2, as shown in FIG. 14, the opening/closing shutter 70 is closed, so that no excess excitation light is irradiated onto the object 2.

Based on the irradiation of the excitation light (c), fluorescence is generated from the object 2 as shown in (d). This fluorescence is generated during time T1 when the excitation light is irradiated, and continues to be generated to a certain extent even after time t2 when the excitation light is no longer irradiated, while attenuating. The characteristics of the generation of the excitation light after time t1 and after time t2 (e.g., light amount and delay) depend on the material of the object 2. In this example, the excitation light is generated as a delay while attenuating during time T2, from time t2 to time t3.

In the discharge control of (e), the image sensor 8 is in a discharge state before time t1, and the control device 10 turns on the light source at time T1, and at time t2 turns off the light source (OFF), and at the same time stops the discharge of charge from the image sensor 8. In other words, the period from time t2 onwards is the time of light reception during which charge is accumulated in the pixels of the image sensor 8.

In the control of light reception, photography, and output (f), the control device 10 controls the light reception (in other words, charge accumulation) to start from time t2 when emission (e) is turned off, for the time T2 of the fluorescence (d), and ends the light reception at time t3. After the light reception ends at time t3, the control device 10 reads out the detection signal due to the light reception from the image sensor 8.

As described above, in this embodiment, the control device 10 controls the timing of turning on/off each component so that the irradiation of excitation light from the light source device 7, the emission of fluorescence from the object 2, and the reception of light by the image sensor 8 are separated in time. In this embodiment, the control device 10 sets and controls the time of reception of light by the image sensor 8 so as to match the characteristics of the fluorescence in the substance of the object 2 (fluorescence pattern described below), for example, the time T2 at which fluorescence such as (d) occurs. In this embodiment, the control device 10 controls so that the discharge of electric charge continues until the start of reception of light by the image sensor 8 (time t2).

The control device 10 performs the timing control shown in FIG. 5 in a similar manner, with different timing controls adapted to the characteristics of the target material.

[Fluorescence characteristics of substances (fluorescence patterns)]
FIG. 6 shows an example of the fluorescence characteristics (in other words, the fluorescence patterns) of a plurality of types of substances (for example, the reaction substances shown in A to C in FIG. 3). In FIG. 6, the excitation light in (c) is the same as the excitation light in (c) in FIG. 5, and is generated from time t1 to time t2. The fluorescence pattern of substance A in (A) shows the fluorescence characteristics of a first type of substance (for example, the reaction substance shown in A in FIG. 3). The fluorescence pattern of substance B in (B) shows the fluorescence characteristics of a second type of substance (for example, the reaction substance shown in B in FIG. 3). The fluorescence pattern of substance C in (C) shows the fluorescence characteristics of a third type of substance (for example, the reaction substance shown in C in FIG. 3). The light reception period suitable for each substance in (g) shows the light reception period of the image sensor 8 suitable for each of the substances (A) to (C).

In the fluorescence pattern of substance A in (A), the fluorescence is generated while attenuating during time TA from time t2 to time t3 (note that this is different from time t3 in Figure 5). In the fluorescence pattern of substance B in (B), the fluorescence is generated while attenuating during time TB from time t2 to time t4. Time t4 is after time t3, so TB > TA. In the fluorescence pattern of substance C in (C), the fluorescence is generated while attenuating during time TC from time t2 to time t5. Time t5 is even later than time t4, so TC > TB.

In the fluorescence patterns of each of the substances (A), (B), and (C), for example, the amount of fluorescence emission is large for substance A, medium for substance B, and small for substance C. Also, in the fluorescence patterns of each of the substances (A), (B), and (C), for example, the fluorescence emission time, or in other words the delay, is short for substance A, medium for substance B, and long for substance C.

The control device 10 sets the light reception period of the image sensor 8 for the fluorescence of each of the multiple types of substances as described above, and captures and detects the fluorescence of each substance. In doing so, the control device 10 takes into consideration the differences in the fluorescence characteristics of each of the multiple types of substances as described above, and sets separate light reception periods for each substance so that the reception of each fluorescence does not overlap in time between the substances as much as possible. An example is shown in the light reception period of (g). For substance A, a light reception period TA1 is set for time TA. For substance B, a light reception period TB1 is set for a period of time TB that does not overlap with time TA. For substance C, a light reception period TC1 is set for a period of time TC that does not overlap with time TA and time TB.

In this way, the control device 10 selects and sets a light receiving period appropriate for each substance depending on the target substance. The control device 10 selects and sets the light receiving period taking into consideration the amount of fluorescent light and emission time of each substance, as well as the temporal separation of each fluorescence. This allows the fluorescence of each substance A to C to be received at an appropriate light amount during the time-separated light receiving periods TA1, TB1, and TC1. During the light receiving period for each substance, fluorescence from other types of substances is less likely to mix in, making it easier to detect the fluorescence of the target substance.

Furthermore, when the light receiving period is set as in (g), if a single light receiving does not provide a sufficient amount of light received by each substance, the control device 10 controls the accumulation by receiving light multiple times so as to obtain a total amount of light received appropriate for each substance. The control device 10 sets a light receiving period appropriate for each substance as in (g), taking into account each fluorescence emission time and amount, and multiple light receiving, for each substance. In the example of FIG. 6, the amount of light received by substance C in one light receiving period TC1 is relatively small, so accumulation is performed by receiving light multiple times. The control device 10 also selects and sets the number of times light receiving is repeated for accumulation, taking into account the total amount of light received for each substance.

In the example of Figure 6, the light reception periods of each substance A to C are separated, but this is not limiting. For example, as shown as a modified example in (f), the light reception periods of each substance may be set so that they partially overlap in time. In the example of (f), the light reception periods TA1, TB1, and TC1 of each substance start at the same time t2 and end at a time that matches the fluorescence delay times TA, TB, and TC of each substance. In this case, the light reception period of each substance will be mixed with fluorescence from other types of substances, but the amount of received light will be greater.

[Timing control based on the fluorescent properties of substances]
FIG. 7 shows a specific example of timing control based on the characteristics of fluorescence in the multiple types of materials in FIG. 6. The light source in (a), the opening and closing shutter in (b), and the excitation light in (c) are the same as in FIG. 5. (A1) is the fluorescence of material A, and is the same as in FIG. 6. (A2) shows the discharge of material A at the imaging element 8, which is discharged until time t2 corresponding to the light source OFF, and the start of charge accumulation coincides with the start of the light reception period TA1 of material A. (A3) shows the reception of light (image capture, etc.) at the imaging element 8 for material A, which corresponds to the light reception period TA1 in FIG. 6, starts immediately (first time = 0 seconds) from time t2 when the light source is OFF, and ends at time t3 after the light reception period TA1 (second time = TA1) has elapsed.

(B1) shows the fluorescence of substance B, and is the same as in Figure 6. (B2) shows the emission of substance B at the imaging element 8, which continues until time t3 when the light reception period TA1 of substance A ends, and charge accumulation begins at the start of the light reception period TB1 of substance B. (B3) shows the reception of light (image capture, etc.) at the imaging element 8 for substance B, which corresponds to the light reception period TB1 in Figure 6, and begins at time t3 after the light reception period TA1 of substance A has elapsed (first time = TA1) from time t2 when the light source is OFF, and ends at time t4 after the light reception period TB1 of substance B has elapsed (second time = TB1).

(C1) is the fluorescence of material C, and is the same as in Figure 6. (C2) shows emission at the imaging element 8 for material C, which continues until time t4 when the light reception period TA1 of material A and the light reception period TB1 of material B end, and charge accumulation begins at the start of the light reception period TC1 of material C. (C3) shows light reception (imaging, etc.) at the imaging element 8 for material C, which corresponds to the light reception period TC1 in Figure 6, and begins at time t4 after the light reception period TA1 of material A and the light reception period TB1 of material B have elapsed (first time = TA1 + TB1) from time t2 when the light source is turned off, and light reception ends at time t5 after the light reception period TC1 of material C (second time = TC1) has elapsed.

As described above, in the timing control of FIG. 7, the first time from when the light source is turned off to when light reception begins, and the second time, which is the light reception period, are set to different values for each substance according to the characteristics of the fluorescence. With timing control as shown in FIG. 7, the fluorescence can be received at periods appropriate for each substance and detected as a detection image, and the fluorescence of each substance can be distinguished in each detection image, making it easier to optically identify it.

[Integration control]
Fig. 8 shows an example of timing control in the case where integration is performed by capturing images multiple times based on the timing control for one time as shown in Fig. 7. The setting unit 108 in Fig. 4 is used to set integration settings in advance according to multiple types of substances in the object 2 (e.g., the reactive substances shown as A to C in Fig. 3). As an example of such settings, the number of times of imaging for integration of each substance is set as follows: 1 time for substance A, 3 times for substance B, 10 times for substance C, and so on. As described above, these numbers are set in consideration of the fluorescence characteristics (light amount, delay, etc.) of each substance, and are variable.

In FIG. 8, the vertical axis shows the timing of the light source (a), the opening and closing shutter (b), the excitation light (c), the fluorescence (d), the emission (e), the light reception and imaging (f), and the output of the integrated data (g), and (a) to (f) are basically the same as FIG. 5 and the like. In (d), the fluorescence of each substance (A to C) is divided on the time axis for each imaging for integration. In (f), the light reception and imaging of each substance (A to C) is divided on the time axis for each imaging for integration. In (g), the timing of outputting the imaging signals as integrated data immediately after the imaging for each substance (A to C) in (f) is completed. The output timing of the integrated data in (g) is a signal that indicates the timing of the generation of an integrated image by the control device 10 based on the detection signal (in other words, the imaging signal, the image signal) from the imaging element 8. Alternatively, if the image sensor 8 has an accumulation function, the image sensor 8 may perform accumulation from the detection signal and output the accumulated signal to the control device 10.

In this example, when capturing images using the image sensor 8, a total of 14 frame periods (F1 to F14) are used for accumulation. In the first frame period F1, one image is captured of material A. In the second frame period F2 to the fourth frame period F4, three images are captured of material B. In the fifth frame period F5 to the fourteenth frame period F14, ten images are captured of material C.

In the first frame period F1, one image is captured during the light-receiving period TA1 (times t2 to t3). In the second frame period F2, the first image is captured during the light-receiving period TB1 (times t6 to t7). In the third frame period F3, the second image is captured during the light-receiving period TB2 (times t10 to t11). In the fourth frame period F4, the third image is captured during the light-receiving period TB3 (times t14 to t15). In the fifth frame period F5, the first image is captured during the light-receiving period TC1 (times t19 to t20). Although omitted, each image is captured in the same way during the light-receiving period of each frame period. Finally, in the fourteenth frame period F14, the tenth image is captured during the light-receiving period TC10 (times t25 to t26).

As a modified example, the light receiving period for each substance in (f) may be as follows. As for the light receiving period for each substance in (f), the light receiving period may be set at a fixed interval, and the optimal detection image may be determined by the number of times of accumulation. In particular, when the characteristics of the fluorescence of the target substance are unknown or when inspecting an unspecified substance, such control can eliminate oversights. (h) of FIG. 6 shows the timing control of this modified example. The control device 10 repeats a unit light receiving period (TA1 = TB1 = TC1) of the same length as a plurality of light receiving periods at fixed intervals (in other words, a fixed delay time) from time t2. For example, for substance A, the first unit light receiving period from time t2 is set as the light receiving period TA1, and an optimal detection image is obtained from the image captured (in other words, a delayed image). For substance B, the second unit light receiving period from time t2 is set as the light receiving period TB1, and an optimal detection image is obtained from the image captured (in other words, a delayed image). For substance C, the third, fourth, and fifth unit light receiving periods from time t2 are set as light receiving period TC1, and an optimal detection image is obtained from the captured images (in other words, delayed images) and the image obtained by accumulating these.

In (g), in the first frame period F1, at time t3 when one light receiving period TA1 ends, imaging signals for one light receiving period TA1 are output as integrated data (substance A detection image data) based on an ON signal indicating the output timing of the integrated data. In the fourth frame period F4, at time t15 when the third light receiving period TB3 ends, imaging signals for three light receiving periods TB1, TB2, and TB3 are output as integrated data (substance B detection image data) based on an ON signal. In the fourteenth frame period F14, at time t26 when the tenth light receiving period TC10 ends, imaging signals for ten light receiving periods TC1 to TC10 are output as integrated data (substance C detection image data) based on an ON signal.

Based on the detection signals from the imaging element 8, the control device 10 (Fig. 4) performs an accumulation process in the image signal conversion unit 102 to obtain an accumulated image (e.g., Figs. 3B, 3C, and 3D) as a detection image for each substance. For example, for substance B, accumulation (e.g., addition of brightness values) is performed based on the detection signals captured during three frame periods (F2 to F4) in Fig. 8, and the detection image 300B in Fig. 3C is obtained as an accumulated image.

By controlling the accumulation as shown in Figure 8, a detection image (particularly an accumulated image) can be obtained with a sufficient and suitable amount of light for each substance, and the fluorescence of each substance can be distinguished in each detection image (accumulated image) to facilitate optical identification. Furthermore, a composite image (Figure 9A described below) can be obtained by combining each detection image (accumulated image) into one, and the fluorescence of each substance can also be distinguished in this composite image to facilitate optical identification.

[Detection image output]
FIG. 9A shows an example of the output of the detection image obtained based on the above timing control. The control device 10 (FIG. 4) displays the detection image (particularly the integrated image and the composite image) obtained based on the above timing control on the screen of the display device 5 by the display control unit 101. First, the above-mentioned FIGS. 3B, 3C, and 3D show an example in which the reaction materials A to C in the target 2 are obtained separately as separate detection images. The control device 10 determines in what color each material will be displayed in the detection image (particularly the composite image) based on the setting in the setting unit 108. In the above-mentioned example, the detection image 300A of the material A is set so that the fluorescent image is displayed in, for example, green when composited. The detection image 300B of the material B is set so that the fluorescent image is displayed in, for example, red when composited. The detection image 300C of the material C is set so that the fluorescent image is displayed in, for example, blue when composited. The display color of this fluorescent image is a correspondence for facilitating optical identification of the fluorescence of multiple types of materials A to C, and can be set arbitrarily without being limited to green or the like. The control device 10 converts the three types of detection images 300A, 300B, and 300C for each substance into R (red), G (green), and B (blue) images, and displays them as a full-color composite image ( FIG. 9A ). By displaying the detection images in this manner, it is possible to improve the visibility of the user during optical identification during specimen testing, etc., and to improve the accuracy of optical identification.

9A shows a case where the control device 10 first accumulates and synthesizes the detection signals obtained based on the timing control of FIG. 7 and FIG. 8 to obtain one detection image 900 and displays it on the screen 50 of the display device 5. In other words, this detection image 900 is a composite image of the fluorescence of multiple substances. In this detection image 900, the image 901A of the fluorescence of substance A is displayed in green, the image 901B of the fluorescence of substance B is displayed in red, and the image 901C of the fluorescence of substance C is displayed in blue-purple. The reason why the image 901C of the fluorescence of substance C is displayed in blue-purple is that it is obtained as a result of a composite image based on the three primary colors of light, which is obtained by synthesizing the red image based on the detection image 300B of FIG. 3C and the blue image based on the detection image 300C of FIG. 3D. Even in the case of such a detection image 900, the fluorescence of each substance is displayed in a different display color, so that the visibility and accuracy of optical identification can be improved.

Figure 9B shows a modified example regarding the output of detection images. In this modified example, the control device 10 displays, on the screen 50 of the display device 5, integrated images (images of each color) based on the detection images for each substance as shown in Figures 3B to 3D, while switching between them in sequence. First, a green image is displayed as detection image 911 of the fluorescence of substance A. After a user input operation or a predetermined time has passed, a red image is displayed as detection image 912 of the fluorescence of substance B. After a user input operation or a predetermined time has passed, a blue image is displayed as detection image 913 of the fluorescence of substance C. After a user input operation or a predetermined time has passed, the display similarly returns to displaying detection image 911 of the fluorescence of substance A.

Figure 9C shows another modified example regarding the output of detection images. In this modified example, the control device 10 displays detection images 911, 912, and 913, which are integrated images for each substance as shown in Figure 9B based on the detection images of Figures 3B to 3D, in parallel as detection images 921, 922, and 923 on the screen 50. The control device 10 may also display information for each detection image (for example, a description of image A, substance A, etc., and the luminance value of luminescence, etc.) on the screen 50.

[setting]
FIG. 10 shows an example of a GUI screen display related to the setting using the setting unit 108 in FIG. 4 (GUI: Graphical User Interface). When setting, the control device 10 displays a setting screen as shown in FIG. 10 on the screen of the display device 5. The setting screen in FIG. 10 has a target substance item 1001, a light receiving period item 1002, a number of times of accumulation item 1003, and a display color item 1004 of the detected image as setting items. In the target substance item 1001, information on the target substance is displayed. In the light receiving period item 1002, the light receiving period (for example, the light receiving periods TA1, TB1, and TC1 as shown in FIG. 7 described above) for each target substance (in other words, for each corresponding image) can be set, in other words, the first time and the second time described above. In the number of times of accumulation item 1003, the number of times of accumulation (for example, 1 time, 3 times, and 10 times as shown in FIG. 8 described above) for each target substance can be set. In the display color item 1004, the display color of the detected image for each target substance (for example, green, red, or blue as shown in FIG. 9B) can be set. In each item, a GUI such as a list box may be used to select and input from options.

[Functions that can accommodate the characteristics of various materials]
As one implementation example, the optical identification device 1 of the above embodiment may be implemented as a fixed function of performing a predetermined timing control (for example, FIG. 7 or FIG. 8) so as to be compatible with a specific substance of a specific target having specific fluorescent/phosphorescent characteristics (for example, the above-mentioned reactants A to C). Not limited to this, the optical identification device 1 of the embodiment may be configured to be configurable so as to be compatible with various target substances having different fluorescent/phosphorescent characteristics. In the latter implementation, the setting unit 108 of FIG. 4 is used. A user (a business person or a user) can set a setting value according to the target substance on a setting screen such as that shown in FIG. 10. Details of the latter implementation example will be described below.

There are cases where the fluorescence/phosphorescence characteristics of a substance that is a fluorescent or phosphorescent component (such as a reactant with the reaction reagent described above) in the object 2 (test medium or biological sample) are unknown. To be able to handle such cases, the optical identification device 1 of the embodiment provides functions such as advance monitoring as described below.

The optical identification device 1 first performs pre-monitoring of an object whose characteristics are unknown. During the pre-monitoring, the control device 10 collects predetermined data and information (also referred to as monitoring data) in advance and registers it in a library (in other words, a database) in the following procedure. The library is provided in the memory of the control device 10 or in the memory of an external device. The control device 10 determines the characteristic amount of each substance from the monitoring data in the library and stores the characteristic amount in association with the monitoring data. Then, the control device 10 determines control parameter values such as the period for receiving and photographing the fluorescence/phosphorescence under timing control and the number of times for accumulation according to the characteristic amount. The control device 10 sets the determined control parameter values in each section of the control device 10 (particularly the timing control section 103).

An example of the procedure for pre-monitoring is as follows. FIG. 11 shows a timing chart for pre-monitoring. As shown in FIG. 11, the control device 10 performs imaging of an object 2 (including, for example, materials X, Y, and Z) whose fluorescence/phosphorescence characteristics are unknown, using the image sensor 8 under various predetermined imaging conditions (for example, imaging conditions 1 to N in this case), and obtains image signals (in other words, imaging data) under each imaging condition. In FIG. 11, (a) is the light source, (b) is the opening and closing shutter, (c) is the excitation light, (d) is the fluorescence/phosphorescence, (e) is the emission, and (f) is the light reception/imaging, which are the same as described above. In the example of FIG. 11, imaging is performed sequentially under each imaging condition 1 to N on the time axis, and the number of times (n) for accumulation is repeated for each imaging condition. As a result, imaging data 1100 for each corresponding imaging condition is obtained.

Examples of various shooting conditions include, as shown in the figure, various different times (first time) from when the light source is turned off to when emission is turned off and when light reception begins, and various different lengths of the light reception period (second time).

The control device 10 generates an image (detection image, accumulated image) 1110 for each accumulation based on each shooting data 1100. For example, from shooting data 1100 under shooting condition 1, n images 1110 are obtained, such as an image based on the detection signal of the first shooting, an image based on the accumulation of the detection signals up to the second shooting, ..., an image based on the accumulation of the detection signals up to the nth shooting. Furthermore, when accumulation is performed based on several detection signals under the same shooting conditions, the content of the accumulated image obtained may be saturated in the fluorescence/phosphorescence brightness values for all substances, as in the illustrated image 1130. Image 1130 is a saturated image obtained by accumulating images of substances A, B, and C at different times. When saturated in this way, no further accumulation is necessary.

The control device 10 judges the contents of each image 1110, selects or generates suitable shooting conditions, and determines control parameter values corresponding to the shooting conditions. Suitable shooting conditions are, for example, shooting conditions that correspond to image 1120 in which the luminance value representing the fluorescence/phosphorescence from the target substance in image 1110 appears with as high contrast as possible. Image 1120 is an accumulated image of substances A, B, and C at different times, and is an optimal image corresponding to suitable shooting conditions, and such an optimal image is extracted. The selection and judgment of the suitable shooting conditions may be made by an expert or may be made by machine learning. In the illustrated example, image 1120 surrounded by a dashed line frame among images 1110 is an image in which the fluorescence/phosphorescence of substances X, Y, and Z is detected with sufficiently high contrast.

Based on the above-described advance monitoring, the control device 10 can determine the imaging conditions suitable for the target substance (in other words, the suitable control parameter values for timing control).

In addition, when the optical identification device 1 of the embodiment has the above-mentioned pre-monitoring function, it has the function of controlling image capture under various image capture conditions as described above. Therefore, it is also possible to capture an image of an object under image capture conditions specified by the user.

Figure 12 shows an example of a GUI screen display that allows the shooting conditions to be set. The control device 10 displays a shooting condition setting screen as shown in Figure 12 on the screen of the display device 5. On this setting screen, the user can confirm and set the parameter values of the shooting conditions, such as the light reception period (the time from the first time to the second time after the light source is turned off) and the number of times of accumulation, for each shooting condition, such as "Shooting condition 1" and "Shooting condition 2". The shooting conditions set here can be freely specified and selected by the user for use.

[Effects, etc.]
As described above, according to the optical identification device and method of the embodiment, even in the case of an object containing a plurality of types of substances with different fluorescent/phosphorescent emission characteristics, a high-contrast image for optical identification can be generated and detected, and the time required for optical identification can be shortened. According to the embodiment, a high-contrast image that is easy to optically identify can be generated and output by color-coding each substance with different characteristics. Furthermore, according to the first and second embodiments, appropriate timing control is possible depending on the characteristics of the light source (e.g., LED or halogen lamp) and whether or not the opening/closing shutter 70 is used. According to the present embodiment, as shown in Figs. 6 and 7, the light receiving period is separated for each type of substance, so that an optical filter (band pass filter) as in the comparative example is not required.

Although the embodiments of the present disclosure have been specifically described above, they are not limited to the above-mentioned embodiments and can be modified in various ways without departing from the gist of the disclosure. In each embodiment, components can be added, deleted, or replaced, except for essential components. Unless otherwise specified, each component can be singular or plural. Forms that combine each embodiment and its modified examples are also possible.

1...Optical identification device, 2...Object, 3...Opening (bottom surface, window), 5...Display device (color LCD monitor), 7...Light source device, 8...Imaging element (light receiving circuit), 9...Lens, 10...Control device (controller), 20...Housing, 30...Preparation, 70...Opening/closing shutter.

Claims (11)

1. An optical identification device for optically identifying an object by detecting fluorescence or phosphorescence emission from one or more substances, the one or more substances being fluorescent or phosphorescent substances, contained in the object, comprising:
According to the light emission characteristics of each of the one or more substances, after a first time period determined according to the light emission characteristics has elapsed from a timing when the irradiation of the excitation light from the light source device onto the substance is turned off, light reception by the image pickup element is started for a second time period determined according to the light emission characteristics, and a detected electrical signal is obtained.
Optical identification device. 2. The optical identification device according to claim 1,
Repeating light reception by the imaging element a predetermined number of times according to the light emission characteristics of each of the one or more substances;
By integrating the electrical signals detected at the number of times, an integrated image is obtained for each of the substances.
Optical identification device. 2. The optical identification device according to claim 1,
generating a detection image for each of the substances, the detection image representing the fluorescence or phosphorescence emission in a predetermined display color based on the detected electrical signal;
displaying the detected image on a screen of a display device;
Optical identification device. 3. The optical identification device according to claim 2,
generating an integrated image in which the fluorescent or phosphorescent light is expressed in a predetermined display color based on the detected electrical signal for each of the substances;
displaying the integrated image on a screen of a display device;
Optical identification device. 2. The optical identification device according to claim 1,
The first time for each of the substances is set to a different value.
Optical identification device. 2. The optical identification device according to claim 1,
The second time for each of the substances is set so that at least a part of the time does not overlap.
Optical identification device. 2. The optical identification device according to claim 1,
Taking an image including receiving light by the image sensor under a specified photographing condition among a plurality of photographing conditions set in advance;
The photographing conditions include set values of the first time and the second time.
Optical identification device. 8. The optical identification device according to claim 7,
performing the imaging under the plurality of imaging conditions on an object including one or more substances whose luminescence characteristics are unknown, and acquiring imaging data under each imaging condition;
selecting suitable imaging conditions including set values of the first time and the second time for each of the substances based on the imaging data;
Optical identification device. 2. The optical identification device according to claim 1,
a shutter for blocking the excitation light is provided in a space between the light source device and the object;
controlling the opening/closing shutter to close in accordance with a timing at which the light source device turns off the emission of the excitation light;
Optical identification device. 2. The optical identification device according to claim 1,
Controlling the image sensor so as to continue discharging electric charges until the image sensor starts receiving light.
Optical identification device. 1. An optical identification method in an optical identification device for optically identifying an object by detecting fluorescence or phosphorescence emitted from one or more substances that are fluorescent or phosphorescent substances contained in the object, comprising:
a step in which the optical identification device starts receiving light with an image sensor after a first time period determined according to the light emission characteristics of each of the one or more substances has elapsed from a timing when irradiation of the substance with excitation light from a light source device is turned off, and receives light for a second time period determined according to the light emission characteristics, thereby obtaining a detected electrical signal;
The optical identification method according to claim 1,

Images