JP7127288B2 - Coloring reaction observation assistance system, coloration reaction observation assistance method and program - Google Patents

Description

The present invention provides a color reaction observation assistance system, a color reaction observation assistance method, and a program for detecting the color reaction of in vitro diagnostics such as urine tests and pregnancy tests, and sheet-like simple analysis kits for identifying pathogenic bacteria. Regarding.

In recent years, in-vitro diagnostic agents and sheet-like simple analysis kits for identifying pathogenic bacteria and the like have come to be used frequently for determining diseases, pregnancy, chemical substances, pathogenic bacteria, and the like. For example, as an example of a simple test kit, a general example of a urine test strip will be described below. A single or a plurality of reaction regions are arranged on the test paper, and when a sample solution containing the sample is dropped, the sample causes a color reaction in the reaction regions. After dropping the test solution, visually confirm the color reaction result and the color legend corresponding to the test result after the predetermined time lapse determined for each test item to be tested, and check the test result for the test object. Analysis is done.

There is also an analysis method of measuring the spectral absorbance of a reaction region in which a color reaction occurs, and measuring the concentration of the analyte, which is the target substance contained in the sample solution.

A dedicated device for analyzing a subject using a urine test strip as described above and a method of detecting a subject using this dedicated device already exist. It is a device for medical workers). For this reason, the above-mentioned dedicated devices are generally expensive, installed only in extremely limited places, and only specialists can operate the analysis processing.
In addition, the detection method using the above-mentioned dedicated device is premised on illuminating with a special optical device incorporated in this dedicated device and photographing the reaction area under a predetermined environment (for example, patent Reference 1). In addition, the position of the urine test strip is mechanically controlled with respect to the imaging optical system, and the lighting conditions and imaging conditions at the time of photography are ideal for observing and judging the test strip.

In recent years, "Point of Care Testing (POCT)" has been advocated, and biochemical test items that could only be processed with dedicated equipment in hospitals can now be performed with specialized biochemical knowledge and skills to operate dedicated equipment. There is an urgent need to create a system that allows anyone to use a simple device at any time, anywhere, and at a low cost to perform examinations easily, even if they do not have such equipment. Also, in the medical field, test results can be obtained immediately, and there is an advantage that doctors can take prompt treatment. By using this simple test kit, a preliminary diagnosis can be easily performed in an ambulance or at home outside the medical field, and treatment at the medical site after being transported to the hospital can be efficiently advanced.

Japanese Patent No. 5351090

However, even in the analysis method described above, it is assumed that the analysis is performed using a dedicated device.
Assuming an analysis method that can be used more widely, it would be impossible, for example, from the viewpoint of cost, to introduce a dedicated device in general households. In addition, these test sheets are not intended for visual judgment by general users who do not have specialized knowledge. For this reason, especially with test papers that have many test items with different color reaction times, it is too complicated and difficult to understand which part should be observed at what timing. Accurate determination of results is not possible.

For example, in the case of the urinalysis paper, a plurality of items such as white blood cells, occult blood, and glucose in urine can be tested. Here, since the time of color reaction in the reaction area may differ from item to item, it is necessary to observe the coloration after the passage of predetermined time determined for each inspection item.
However, since the reaction area where colorimetry is performed continues to react even after the predetermined time has elapsed, it is difficult to obtain an accurate determination result of the inspection item if the predetermined time is shorter than or longer than the predetermined time. Therefore, if it is not possible to accurately determine the timing at which the sample was dropped and the elapsed time since the drop, the accuracy of the determination result is affected.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances. Provided are a coloration reaction observation assistance system, a coloration reaction observation assistance method, and a program that enable accurate observation of the determination result of the coloration reaction on the test paper as described above after the passage of time.

In order to solve the above-described problems, the color reaction observation assistance system of the present invention provides a color reaction reaction area for each test item formed in the color reaction area of an analysis kit. A color reaction observation assisting system for assisting observation of a color reaction caused by a target substance to be detected contained in a test solution, wherein an observation target surface including each of the colorimetric reaction regions in an image captured by an imaging device. an observation target surface detection unit for determining whether or not a a dropping detection unit for detecting that the test solution has been dropped; an elapsed time detection unit for detecting; a display unit; an observation reaction area instruction unit for prompting observation by presenting a mark corresponding to the colorimetric reaction area for which the reaction time has elapsed on the image of the display unit; and the reaction time. At the time when the reaction time has elapsed among the reference reaction color patterns for determining the color reaction color of the colorimetric reaction area that has passed, the mark corresponding to the reference colorimetric pattern of the inspection item corresponding to the reaction time is displayed. and a reference reaction color pattern presenting part for presenting the image of the part.

In the color reaction observation assistance system of the present invention, a colorimetric reaction area image, which is an image of a colorimetric reaction area in which the elapsed time detection unit detects that the reaction time has elapsed, is stored in the data storage unit. Further provided is a color reaction area image storage control section for writing and storing, wherein the observation reaction area designating section reads the colorimetric reaction area image from the data storage section, and the corresponding reaction time on the observation target surface has elapsed. It is characterized in that it is presented at the position of the colorimetric reaction area.

In the color reaction observation assisting system of the present invention, the observation target plane detection unit detects the observation target plane so that the observation target plane is included in the captured image when the observation target plane is not included in the captured image. It is characterized by prompting to perform imaging by.

In the color reaction observation auxiliary system of the present invention, the dropping detection unit detects the colorimetric reaction regions in each of the colorimetric reaction regions according to the change in coloration and dark color of the image of each of the colorimetric reaction regions in the captured image. It is characterized by detecting that the solution has been dropped.

In the color reaction observation assisting system of the present invention, the test solution is dripped onto each of the colorimetric reaction regions by a change in the color reaction color of each image of the colorimetric reaction regions in the captured image. is detected.

In the color reaction observation auxiliary system of the present invention, the elapsed time detection unit measures the elapsed time from the time when the test solution was dropped for each colorimetric reaction area, and the It is characterized by detecting whether or not the reaction time has elapsed.

In the color reaction observation assistance system of the present invention, when the reference reaction color pattern presenting unit prompts observation of the colorimetric reaction area by the observation reaction area instruction unit, the colorimetric reaction area of each of the inspection items is displayed. It is characterized in that the reference reaction color pattern corresponding to the colorimetric reaction region prompted to be observed is indicated in the color reaction specimen on which the reference reaction color pattern is described.

In the color reaction observation assistance system of the present invention, when the reference reaction color pattern presenting unit has the reference reaction color pattern pre-written and stored in the data storage unit, the observation reaction area designating unit may It is characterized by presenting the reference reaction color pattern that is color-calibrated in correspondence with the imaging conditions of the captured image when prompting observation of the reaction region.

In the color reaction observation auxiliary system of the present invention, the analysis kit includes at least pH test paper, urine test paper, It is characterized by using a simple test paper for measuring the degree of oxidation.

In the method for assisting color reaction observation of the present invention, in a colorimetric reaction area for each test item formed in a color reaction area of an analysis kit, an object to be detected contained in a test solution dropped into the color reaction area is A color reaction observation assisting method for assisting observation of a color reaction by a substance, wherein an observation target plane detection unit includes an observation target plane including each of the colorimetric reaction regions in a captured image supplied from an imaging device. an observation target surface detection process for determining whether or not an observation target surface is detected; an observation position specification process for an observation position specifying unit to specify the position of each of the colorimetric reaction regions on the observation target surface; a dropping detection process for detecting that the test solution has been dropped onto each of the colorimetric reaction regions; an elapsed time detection process for detecting whether or not a reaction time set in advance has elapsed each time ; and a reference reaction color pattern presenting unit selects the reaction color pattern among the reference reaction color patterns for determining the color reaction color of the colorimetric reaction region for which the reaction time has elapsed. and a reference reaction color pattern presenting step of presenting a mark corresponding to the reference colorimetric pattern of the inspection item corresponding to the reaction time on the image of the display section at the time when the time has elapsed .

The program of the present invention is a colorimetric reaction area for each test item formed in the coloration reaction area of the analysis kit. A program for causing a computer to execute functions of a color reaction observation assistance system that assists observation of the colorimetric reaction region, the computer causing the image captured by the imaging device to include an observation target surface including each of the colorimetric reaction regions. observation target surface detection means for determining whether or not the colorimetric reaction area is detected; observation position specifying means for specifying the position of each of the colorimetric reaction regions on the observation target surface; Dropping detection means for detecting that the test solution has been dropped, and elapsed time detection for detecting whether or not a reaction time preset for each of the colorimetric reaction regions has elapsed since the dropping was performed. observation reaction area instruction means for prompting observation by presenting a mark corresponding to the colorimetric reaction area for which the reaction time has elapsed on an image on a display unit; and color reaction color of the colorimetric reaction area for which the reaction time has elapsed. reference reaction color pattern presenting means for presenting a mark corresponding to the reference colorimetric pattern of the inspection item corresponding to the reaction time on the image of the display unit at the time when the reaction time has elapsed among the reference reaction color patterns for determining It is a program for functioning as

As described above, according to the present invention, even general users who do not have special and expensive inspection equipment and who do not have specialized knowledge can use simple devices such as general-purpose digital cameras, smartphones, and spectacle-type displays. A color reaction observation aid that enables the observation of the colorimetric reaction area after the lapse of a predetermined time for each test item using an image captured by an imaging device, and the ability to accurately and simply obtain test results for each of a plurality of test items. A system, color reaction observation assistance method, and program can be provided.

1 is a block diagram showing a configuration example of a color reaction observation assistance system according to a first embodiment of the present invention; FIG. FIG. 4 is a diagram showing an example of the appearance of an analysis kit to be analyzed by the color reaction observation assistance system according to the present embodiment. FIG. 3 is a diagram showing an example of a colorimetric reaction specimen for collating the coloration state of each colorimetric reaction area in the coloration reaction area of FIG. 2; FIG. 4 is a diagram for explaining an observation angle of the imaging unit 101 when imaging a color reaction region; FIG. 11 is a diagram illustrating a display example in which the reference colorimetric part of the inspection item to be observed and the reference colorimetric pattern are associated with each other after the reaction time has elapsed; 4 is a flow chart showing an operation example of color reaction detection processing for a color reaction detection target using a simple test paper or a simple test drug in the color reaction observation assistance system of one embodiment of the present invention. FIG. 10 is a diagram illustrating another display in which the reference colorimetric part of the inspection item to be observed and the reference colorimetric pattern are associated with each other after the reaction time has elapsed;

<First Embodiment>
A first embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration example of a color reaction observation assistance system according to a first embodiment of the present invention. In FIG. 1, the color reaction observation assistance system 1 includes an imaging unit 101, an exposure control unit 102, an imaging control unit 103, an object detection unit 104, an observation position identification unit 105, a drop detection unit 106, an elapsed time detection unit 107, an observation A reaction area designating unit 108, a reference reaction color pattern presentation unit 109, a reaction area image storage control unit 110, a display unit 111, an illumination unit 112, and a data storage unit 113 are provided.

The imaging unit 101 is, for example, a digital camera using an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), or an imaging device provided in a mobile terminal. Output captured image data. Also, captured image data may be captured as a moving image. In the present embodiment, the captured image data is, for example, a color image of a moving image including the gradation of each color component RGB. The imaging unit 101 adds a time stamp to the captured image data for each frame, and writes and stores the data in the data storage unit 113 .

The exposure control unit 102 controls the imaging conditions of the imaging unit 101, such as shutter speed, aperture value, presence/absence of illumination light, intensity of illumination light, etc., as exposure imaging conditions. In addition, the exposure control unit 102 responds to the brightness around the color reaction region (analysis kit) to be imaged by the color reaction detection system 1, and turns on illumination light such as a flash light source as necessary during imaging. An instruction is output to an illumination unit (not shown).

FIG. 2 is a diagram showing an example of the appearance of an analysis kit to be analyzed by the color reaction observation assistance system in this embodiment. An analysis kit to be detected in this embodiment is, for example, an analysis kit 900 having an appearance shown in FIG. The analysis kit 900 has a coloration reaction area 902 on an observation target surface 901 . Colorimetric reaction regions 903, 904, 905, 906, . In addition, these colorimetric reaction regions are regions that develop colors by the substance to be detected contained in the sample solution dropped into the color reaction region, and are provided for each substance to be detected, and each of them corresponds to a detection target. Each responds to the target substance.
In addition, a color correction patch area 909 is provided on the surface of the analysis kit 900 on which the observation target surface 901 exists. Color correction patches 1001, 1002, and 1003 for correcting the color of the captured image data of the color reaction region 902 are formed in the color correction patch region 909 (described later).

FIG. 3 is a diagram showing an example of a colorimetric reaction sample for collating the coloration state of each colorimetric reaction area in the coloration reaction area of FIG. In the reference reaction color pattern sample 900', all colorimetric reaction coloration patterns that can be changed in each of the colorimetric reaction areas 903, 904, 905, 906, . 904', 905', 906', . . . , 907', 908'.
For example, in the row of the reference colorimetric pattern 903′, the reference colorimetric part 903′_3 located in the central “0” character column indicates the color of the colorimetric reaction area before the test solution is dropped. Taste is shown. In addition, in the row of the reference colorimetric patterns 903′, the more similar the color tone is from the center reference colorimetric part 903′_3 to the left reference colorimetric parts 903′_2 and 903′_1 in the coloring state, the more the colorimetric reaction Region 903 indicates that the object detected is more likely to be negative.

Conversely, the more similar the color from the central reference colorimetric portion 903′_3 to the right reference colorimetric portions 903′_4 and 903′_5 in the colored state, the more positive the object detected by the colorimetric reaction region 903 is. indicates that the possibilities are greater. As an example, when the coloration state of the colorimetric reaction region 903 is observed after the reaction time specified for the colorimetric reaction region 903 from the drop of the test solution, the color is different from that of the reference colorimetric pattern 903'. If the color is closest to the color of the second reference colorimetric part 903'_2 from the left in the row, the target detected by the colorimetric reaction area 903 is judged to be "N1 (Negative 1: negative reaction level 1)". Further, when the coloration state of the colorimetric reaction region 903 is observed after the reaction time specified for the colorimetric reaction region 903 from the dropping of the sample solution, the color is the same as that of the reference colorimetric pattern 903′. , the target detected by the colorimetric reaction area 903 is determined to be "P2 (Positive 2: positive reaction level 2)".
Further, the reference reaction color pattern sample 900' is provided with a color correction patch pattern 909'. The color correction patches 1001', 1002' and 1003' in this color correction patch pattern 909' correspond to the color correction patches 1001, 1002 and 1003 in FIG. 2, respectively.

Returning to FIG. 2 , when the imaging unit 101 captures captured image data, which is the captured image of the analysis kit, the imaging control unit 103 controls the depth of focus, the sensitivity of the imaging element (ISO (International Organization for Standardization) sensitivity), and other imaging parameters. The imaging conditions of the unit 101 are controlled to preset numerical values.

When the imaging unit 101 captures captured image data, which is the captured image of the analysis kit, the imaging control unit 103 analyzes the current captured image data, and exposes the captured image data of the color reaction region of the analysis kit. A process for eliminating the influence of the light source environment is performed according to an instruction from the control unit 102 . If a general-purpose digital camera has a white balance function, the white balance function may be used to eliminate the influence of the light source environment.

The object detection unit 104 determines whether each of the color reaction region 902 and the color correction patch region 909 in FIG. 2 exists in the captured image data. In this determination, reference image data of the design pattern (three-dimensional shape model) of the analysis kit itself is stored in the data storage unit 113 in advance. Then, the object detection unit 104 determines whether the image feature points of the reference image data stored in the data storage unit 113 and the image data of the design pattern in the captured image data match each other in the three-dimensional space. In other words, the degree of similarity between the reference image data and the image data is calculated, and whether or not the calculated degree of similarity is within a predetermined similarity range set in advance is used to determine whether or not there is a match. .

For example, the above-described determination method performs window matching in the vicinity of the image feature point, and if the square difference of all luminance values in the window is within a preset threshold (for example, within a predetermined similarity range), the similarity is high, it is determined that they match.
Also, if the design pattern of the analysis kit itself does not have sufficient image characteristics, a pattern dedicated to position detection is arranged outside each of the color reaction region 902 and the patch region 909 for color correction in the analysis kit, and the data It may be determined by the above-described calculation whether or not the image feature points on the position detection dedicated patterns of the reference image data in the storage unit 113 and the image data in the captured image data match each other.

When the object detection unit 104 determines that the color reaction region 902 and the color correction patch region 909 do not exist in the captured image data, the object detection unit 104 displays the color reaction region 902 and the color correction patch region 902 on the display screen of the display unit 111 . A notification is displayed (presented) that instructs the user to image each of the analysis kit 900 and the reference reaction color pattern sample 900′ so that each of the patch areas 909 for measurement is included in the captured image data. This notification continues to be displayed until the captured image data includes each of the color reaction region 902 and the color correction patch region 909 .

Further, when the object detection unit 104 determines that each of the color reaction region 902 and the color correction patch region 909 exists in the captured image data, in the three-dimensional space in which the captured image data is captured, The observation position (coordinate value), which is the position of the image capturing unit 101 that captured the image, and the image capturing direction of the image capturing unit 101 are each converted from a predetermined coordinate conversion formula (a conversion formula obtained from internal parameters of the image capturing unit 101, which will be described later). Ask. Here, the observation position indicates coordinate values captured (or observed) by the imaging unit 101 in a three-dimensional coordinate system representing a three-dimensional space. That is, based on each of the observation position and imaging direction of the analysis kit 900 by the imaging unit 101 stored in the data storage unit 113, the color reaction region 902 of the color reaction region in each captured image data and the color correction region A relative viewing angle, or imaging angle, for each of the patch regions 909 is estimated.

In this embodiment, each of the color reaction region 902 and the patch region for color correction 909 is imaged by the imaging unit 101 at a predetermined focal length set in advance for the imaging unit 101, and is used as captured image data. . Here, color reaction area 902 includes colorimetric reaction areas 903 through 908 as previously described.
Then, the object detection unit 104 detects the color reaction region 902 and the patch region for color correction in the three-dimensional space from the image data of the imaged image data by using the preset coordinate transformation formula as described above. 909, and each of the observation position and observation angle of the captured image data is estimated.

The coordinate conversion formula for obtaining the observation angle described above is used for preprocessing for detecting the color reaction with respect to the color reaction region provided in the analysis kit 900 . In this preprocessing, when a three-dimensional space is reproduced from a plurality of captured image data (captured image data obtained by imaging a calibration board, which will be described later) in advance, the positions of pixels in the two-dimensional coordinates of the plurality of captured image data and the three-dimensional It is an expression generated when associating coordinate positions in space. The pre-generated coordinate transformation formula is pre-written and stored in the data storage unit 113 for each color reaction detection target. Here, the color reaction detection target indicates the type of analysis kit. If the shape of the analysis kit is different, it is necessary to prepare a coordinate transformation formula corresponding to each container shape.

FIG. 4 is a diagram for explaining the observation angle of the imaging unit 101 when imaging the color reaction region. In FIG. 4, a test solution is dropped onto a color reaction area, and if there is a target substance to be detected in the test solution, the color of each colorimetric reaction area changes according to the concentration or intensity of the target substance to be detected. can be changed to observe the color reaction.

A normal line 400 is a reference line for indicating the observation angle α of the imaging direction of the captured image data, and is a normal line indicating the planar direction of the surface of the color reaction region 902 . The observation angle α is the angle formed by the imaging direction 101A of the imaging unit 101 and the normal line 400 .
For example, the object detection unit 104 sets the direction parallel to the normal line 400 as the z-axis, and sets the analysis kit in a three-dimensional coordinate system so that each side of the color reaction region is parallel to each of the x-axis and y-axis. Deploy. For example, in the three-dimensional coordinate system, the analysis kit consists of x-axis and y-axis such that one of the vertices formed by each side of the container of the analysis kit 900 coincides with the origin O of the three-dimensional coordinate system. Place in a dimensional plane. Therefore, the thickness direction of the container of the analysis kit 900 is parallel to the z-axis. The three-dimensional shape of the container of the analysis kit 900 is stored in advance in the data storage unit 113 as known information together with the coordinate transformation formula already described.

Returning to FIG. 1, when the object detection unit 104 obtains the observation angle when the captured image data was captured, each coordinate of the three-dimensional shape of the container of the analysis kit 900 in the three-dimensional coordinate system and the captured image data (2 Each pixel (coordinates) of the dimensional coordinate system) is associated with each other by the above coordinate conversion formula. Then, the object detection unit 104 obtains the imaging position of the captured image data in the three-dimensional coordinate system of the three-dimensional space and the imaging direction of the captured image data from this imaging position by the above correspondence. At this time, as already described, the object detection unit 104 sets any vertex of the three-dimensional shape of the coloration reaction region in the three-dimensional coordinate system as the origin, the normal line parallel to the z-axis, and the x A three-dimensional space is defined on the container of the assay kit 900 so as to be parallel to the axis or y-axis.

Based on the three-dimensional shape of the container of the analysis kit 900, the object detection unit 104 obtains the imaging position and imaging direction of the image data captured by the imaging unit 101 in the three-dimensional coordinate system. Thereby, the object detection unit 104 obtains the observation angle α between the normal line 400 and the imaging direction of the imaging unit 101, as described above.

In this embodiment, it is necessary as a premise that camera calibration (camera calibration) is performed on the imaging unit 101 in advance. This camera calibration means that a calibration board whose three-dimensional shape is known in advance is imaged once or multiple times within the imaging area, and three-dimensional images in a three-dimensional space are obtained using one or more captured image data. A plurality of coordinate points of the coordinate points in the coordinate system and the coordinate points (two-dimensional pixels) in the two-dimensional coordinate system of the captured image data are matched. As a result, the coordinate transformation formula indicating the relative positional relationship (hereinafter referred to as an external parameter) between the imaging unit 101 and the calibration board, the light incident direction vector at the optical center of the imaging unit 101 and each pixel (two-dimensional pixel), the lens Distortion and the like (hereinafter referred to as internal parameters of the imaging unit 101) are estimated.

Here, in the present embodiment, since the object detection unit 104 estimates the observation angle of the captured image data, two-dimensional images of the calibration board captured in advance by the image capturing unit 101 from a plurality of different viewpoint directions, that is, A global coordinate system (three-dimensional coordinate system) is reconstructed from multi-viewpoint captured image data. Then, a coordinate conversion formula indicating the correspondence relationship between the coordinate points in the reconstructed three-dimensional coordinate system for the same pixel and the coordinate points in the two-dimensional coordinate system of the captured image data captured by the imaging unit 101 is obtained during camera calibration. Keep

As described above, in this embodiment, the estimation of the observation angle is performed by performing camera calibration on the imaging unit 101 in advance. is known, and the three-dimensional shape of the container and the color reaction area of the analysis kit 900 is known (if a pattern dedicated to position detection is used, the three-dimensional shape of the pattern is known). Accordingly, the imaged image data of the color reaction region is imaged, and a plurality of corresponding point information between the coordinate points in the three-dimensional coordinate system and the pixels of the two-dimensional coordinate system of the imaged image data is obtained by the above coordinate conversion formula. The relative positional relationship between the imaging unit 101 and the color reaction region can be estimated from the coordinates of the corresponding points. That is, the observation position and observation angle (imaging direction) of the imaging unit 101 in the three-dimensional coordinate system when the color reaction region is imaged can be estimated.

The observation position specifying unit 105 identifies the analysis kit 900 stored in the data storage unit 113 based on the observation position and observation angle of the color reaction region 902 and the color correction patch region 909 estimated by the object detection unit 104 . In order to project the three-dimensional coordinates of the colorimetric reaction region 902 on the captured image data, the coordinates of each of the colorimetric reaction regions 903 to 908 (for example, four corner coordinates in the case of a rectangular region) are calculated. Similarly, the observation position specifying unit 105 stores in the data storage unit 113 based on each of the observation positions and observation angles of the color reaction region 902 and the color correction patch region 909 estimated by the object detection unit 104 . In order to project the three-dimensional coordinates of the color correction patch area 909 in the analysis kit 900 onto the captured image data, the coordinates of each of the color correction patches 1001, 1002, and 1003 (for example, four corner coordinates in the case of a square area). Calculate

With the above-described configuration, the observation position specifying unit 105 determines the positional correspondence between the coordinate values of the colorimetric reaction regions stored in the data storage unit 113 and the coordinate values of the colorimetric reaction regions on the captured image data. Ask for As a result, it is possible to define which position of the captured image data displayed on the display unit 111 corresponds to each colorimetric reaction area of the coloration reaction area 902 in the analysis kit 900 in the three-dimensional model.
Based on the positional correspondence obtained by the observation position specifying unit 105, the observation reaction area designation unit 108 selects the reaction time of the test item to be observed from among the colorimetric reaction areas 903 to 908 in the color reaction area 902. , a mark showing the colorimetric reaction area of the test item corresponding to the reaction time is presented on the image of the display unit 111 . As a result, the user can easily recognize the colorimetric reaction area that needs to be observed in the color reaction area 902 after the reaction time has elapsed.

In addition, the observation reaction area instruction unit 108 blinks the mark from a predetermined time before the observation reaction time elapses, for example, and keeps the mark constantly lit from the time the reaction time elapses. Alternatively, the user may be notified of the colorimetric reaction area to be observed. This allows the user to observe the colorimetric reaction area for which the reaction time has elapsed with plenty of time to spare.

Further, as will be described later, the observation reaction region designating unit 108 selects a frame in which a colorimetric reaction region of the inspection item corresponding to the time when the data reaction time has passed from the captured image data of the moving image at the time when the reaction time has passed. may be extracted, identification information for identifying inspection items for which the reaction time has elapsed may be added, and the extracted image data may be written and stored in the data storage unit 113 . In this case, when the captured image data for each frame of the moving image is sequentially acquired, the observation reaction region instruction unit 108 chronologically writes the captured image data to the data storage unit 113 by the imaging unit 101. The captured image data corresponding to the inspection item at the time of the inspection is extracted. At this time, the observation reaction area designating unit 108 extracts only the colorimetric reaction area of the inspection item at the time when the reaction time has elapsed from the captured image data corresponding to the inspection item at the time when the reaction time has elapsed, as partial image data. Then, the colorimetric reaction area at the time when the reaction time has elapsed in the image of the coloration reaction area 902 on the display unit 111 is displayed. That is, the observation reaction area designating unit 108 displays the image at the coordinates of the colorimetric reaction area at the time when the reaction time has elapsed in the image of the color reaction area 902 on the display unit 111, and displays the image at the time when the reaction time has elapsed. continue.

, 907', 908' in the reference reaction color pattern sample 900'. is also calculated from the three-dimensional shape of the reference reaction color pattern sample 900' stored in the data storage unit 113 and the coordinate transformation formula corresponding to this reference reaction color pattern sample 900'.
Then, the observation position specifying unit 105 stores the coordinate values of the reference colorimetric units in the reference colorimetric patterns stored in the data storage unit 113 and the coordinate values of the reference colorimetric units on the captured image data. Find the positional correspondence of each. As a result, it is possible to define to which position in the captured image data displayed on the display unit 111 each of the reference colorimetric parts in each reference colorimetric pattern in the reference reaction color pattern sample 900' in the three-dimensional model corresponds. .

The reference reaction color pattern presenting unit 109 selects the reaction time of the inspection item to be observed from among the reference colorimetric patterns 903′ to 908′ in the reference reaction color pattern sample 900′ based on the positional correspondence obtained by the observation position specifying unit 105. , a mark is presented on the image of the display unit 111 so that the line of the reference colorimetric pattern of the inspection item corresponding to the reaction time can be recognized. As a result, the user can easily recognize the reference colorimetric pattern corresponding to the colorimetric reaction area that needs to be observed in the color reaction area 902 after the reaction time has elapsed.
Further, the reference reaction color pattern presentation unit 109 blinks the mark from a predetermined time before the time when the reaction time to be observed elapses, and puts the mark in a constantly lit state after the elapse of the reaction time. A configuration may be adopted in which the user is notified in advance of the reference colorimetric pattern to be observed. This allows the user to have sufficient time to observe the reference colorimetric pattern to be compared with the colorimetric reaction area for which the reaction time has elapsed.

FIG. 5 is a diagram for explaining a display example in which the reference colorimetric part of the examination item to be observed and the reference colorimetric pattern are associated with each other after the reaction time has elapsed.
A display screen 111a of the display unit 111 displays captured image data captured by the imaging unit 101 and including each of the analysis kit 900 and the reference reaction color pattern sample 900′. This captured image data is displayed, for example, in gradation representation using a single color that does not develop color in the color reactions of all test items.
After the reaction time for the inspection item has elapsed, the observation reaction area designating unit 108 displays the display color of the image of the colorimetric reaction area corresponding to this inspection item in the color of the color that is actually captured.

In addition, the reference reaction color pattern presenting unit 109 actually captures each image of the reference colorimetric part in the reference colorimetric pattern corresponding to the inspection item after the reaction time for the inspection item has elapsed. Display by color.
As described above, after the reaction time has elapsed, the colorimetric reaction areas 905 that need to be observed in each of the analysis kit 900 and the reference reaction color pattern specimen 900′ and the reference colorimetric reaction areas 905 corresponding to the colorimetric reaction areas 905 By marking the pattern 905', the user can easily observe the color reaction of the colorimetric reaction area 905 of the inspection item after the reaction time has passed.

Returning to FIG. 1, the drop detection unit 106 detects that the subject has been dropped. For example, the drop detection unit 106 detects the color of each of the colorimetric reaction regions of the analysis kit 900 in the captured image data normalized by the target detection unit 104, and an arbitrary color from the start of imaging of the normalized captured image data. Compare the color of each of the colorimetric reaction areas of the analysis kit 900 in the captured image data over time. Then, the dropping detection unit 106 detects the color of the colorimetric reaction region in each colorimetric reaction region in time series from the start time until a predetermined time elapses from the start time every time an arbitrary time elapses from the start of imaging of the captured image data. is calculated, and if the calculated difference value is equal to or greater than a preset drip threshold value, it is detected that the subject has been dripped.

When the drop detection unit 106 supplies the time when the test solution was dropped into the colorimetric reaction area, the elapsed time detection unit 107 counts the elapsed time from this time, and detects the reaction time set for each inspection item. It is detected whether or not has elapsed.
Then, the elapsed time detection unit 107 outputs the inspection item for which the reaction time has elapsed to the observation reaction region designation unit 108 and the reference reaction color pattern presentation unit 109, respectively.
As a result, each of the observation reaction region designation unit 108 and the reference reaction color pattern presentation unit 109 displays the colorimetric reaction region and the reference colorimetric pattern at the time when the reaction time of each test item has elapsed, as described above. The marking prompts the user to make an observation.

That is, the user captures an image of each of the analysis kit 900 and the reference reaction color pattern sample 900′ using the imaging unit 101, and the target detection unit 104 detects each of the colorimetric reaction regions and the reference colorimetric pattern in the color reaction region 902. is detected, and each of the viewing position and imaging direction is estimated. Then, the observation position specifying unit 105 calculates the coordinates on the captured image of each of the colorimetric reaction region and the reference colorimetric pattern in the coloration reaction region 902 from the observation position and the imaging direction. Each of the observation reaction region designating unit 108 and the reference reaction color pattern presenting unit 109 displays the analysis kit 900 and the reference reaction color pattern sample on the display unit 111 in a state in which the luminance values within the coordinate values are highlighted (marked state). By presenting each of 900', it is possible to suggest the observation timing and observation point of the colorimetric reaction area to the user in real time at the time when the reaction time has elapsed.

With the configuration described above, according to the present embodiment, the colorimetric reaction area in the analysis kit 900 and the reference colorimetric pattern corresponding to the colorimetric reaction area of the reference reaction color pattern sample 900′ printed on the paper are imaged. When comparing within an image, the coordinate values of the colorimetric reaction region to be observed and the corresponding reference colorimetric pattern are calculated in the captured image, and the luminance value within the coordinate values is highlighted. 5) is presented on the display unit 111. FIG. As a result, since the user can simultaneously grasp the observation point of the colorimetric reaction area to be observed and the observation point of the reference colorimetric pattern corresponding to this colorimetric reaction area, the number of colorimetric reaction areas and reference colorimetric patterns Even when there are a large number of , it is possible to easily observe the color reaction of the colorimetric reaction region to be observed.

Also, depending on the type of inspection item, there are cases where the reaction times are close to each other in a plurality of inspection items. Therefore, when the reaction time has passed, the observation reaction region designating unit 108 stores the data of the partial image of the colorimetric reaction region of the inspection item for which the reaction time has passed, and the reaction region image storage control unit 110 stores the data storage unit 113 in the data storage unit 113. may be written to and stored in. Further, when capturing captured image data as a moving image, the captured image data written by the imaging unit 101 to the data storage unit 113 in time series is used to determine the inspection item at the time when the reaction time has passed from this captured image data. A configuration may be adopted in which the data of the partial image of the corresponding colorimetric reaction region is extracted and used. The observation reaction area designation unit 108 reads the data of the partial image of the colorimetric reaction area from the data storage unit 113, and transfers the read data of the partial image to the colorimetric reaction area for which the reaction time has elapsed on the display screen 111a of the display unit 111. position.

Then, on the display screen 111a of the display unit 111, the user selects a colorimetric reaction area to be observed from among the colorimetric reaction areas marked after the reaction time has elapsed, thereby selecting the selected colorimetric reaction area. The other colorimetric reaction areas are assumed to be the monochromatic display already described. Observation reaction area designating section 108 then outputs the test item for the selected colorimetric reaction area to reference reaction color pattern presentation section 109 .
As a result, the reference reaction color pattern presenting unit 109 marks the reference colorimetric pattern corresponding to the supplied inspection item.
With this configuration, the user can calmly observe test items with close reaction times in the desired order without rushing. Since the image of the color reaction is written and stored in the data storage unit 113, the color reaction of the inspection item can be observed as necessary.

Next, the color correction of each of the colorimetric reaction areas by the color correction patch will be described. In the above description, an example was described in which the analysis kit 900 and the reference reaction color pattern sample 900' were imaged so as to obtain the same image data. However, as in the case where the reference reaction color pattern specimen 900′ is first imaged and then the color reaction of each colorimetric reaction region of the inspection item in the analysis kit 900 is observed, the analysis kit 900, the reference reaction color pattern Each specimen 900′ may be captured as different captured image data. In this configuration, the captured image data of the analysis kit 900 and the captured image data of the reference reaction color pattern sample 900′ are displayed side by side on the display screen 111a of the display unit 111 in FIG.
In this case, if the imaging environments of the analysis kit 900 and the reference reaction color pattern sample 900′ are different, for example, if the illumination light is different, the colors in the captured image data of the analysis kit 900 and the reference reaction color pattern sample 900′ may differ. In contrast, it becomes impossible to accurately judge the inspection items.

Therefore, in order to accurately determine the inspection item, it is necessary to match the color of the captured image data of the analysis kit 900 with the color of the captured image data of the reference reaction color pattern specimen 900′ as described below.
The imaging control unit 103 calculates, for example, C _gt (R _gt , G _gt , B _gt ) as the color of the color correction patch pattern 909′ in the captured image data captured under a predetermined light source. In addition, the imaging control unit 103 determines that the color of the color correction patch area 909 in the captured image data captured under a light source different from that of the color correction patch pattern 909′ is C _in (R _in , G _in , B _in ). calculate. In this case, the following equation (1) holds between the tint C _gt and the tint C _in when the simplest conversion formula for color correction is applied as an example.

In this equation (1), as described above, _Cgt is the color of the color correction patch pattern 909' under the light source in which the captured image data of the reference reaction color pattern specimen 900' was captured. Written as (R _gt , G _gt , B _gt ). Also, C _in is the color of the color correction patch 909 under the light source in which the captured image data of the analysis kit 900 was captured, and is expressed as (R _in , G _in , B _in ) in terms of color components RGB.
Accordingly, the above formula (1) is represented by the following formula (2).

By using the reference reaction color pattern specimen 900′ and the three color correction patches with different hues in the analysis kit 900, the color correction patch hue in the captured image data of the reference reaction color pattern specimen 900′ and By obtaining three or more pairs of colors of color correction patches in the captured image data of the analysis kit 900, the matrix A in the equation (2) is obtained.
Here, the imaging control unit 103 obtains the color C _gt (R _gt , G _gt , B _gt ) and equation (2). Then, the imaging control unit 103 extracts the colors C _in (R _in , G _in , B _in ) of the three types of color correction patches from the captured image data of the analysis kit 900, and extracts the reference reaction color pattern sample 900′. Using the formula (2) corresponding to each of the three types of color correction patches 1001, 1002 and 1003 using the color C _gt (R _gt , G _gt , B _gt ) of the color correction patch, Matrix A for color conversion is calculated. The imaging control unit 103 uses the calculated matrix A to refer to the color of each pixel of the captured image data of the analysis kit 900 captured under a light source different from that of the reference reaction color pattern sample 900′ according to the formula (2). Convert to the tint of the reaction color pattern sample 900'.

As described above, by obtaining the matrix A and using the formula (2), the color of the captured image data of the reference reaction color pattern sample 900′ captured under an arbitrary light source can be obtained under different light sources. It is possible to convert to the color of the captured image data of the analysis kit 900 . As a result, the colorimetric reaction regions and the corresponding reference colorimetric patterns in the captured image data of each of the analysis kit 900 and the reference reaction color pattern sample 900′ captured under different light sources are captured under the same light source. It is possible to compare in the state of the light source unified as captured image data. That is, in the captured image data of each of the analysis kit 900 and the reference reaction color pattern sample 900′ captured under different light sources, in order to compare the colorimetric reaction regions and the reference colorimetric pattern, the analysis kit 900 and the reference colorimetric pattern are compared. It is possible to eliminate the influence of illumination (under the light source environment) from between captured image data of the reference reaction color pattern sample 900′, observe the color reaction of the test item with high accuracy, and perform color reaction detection processing. be able to.

FIG. 6 is a flowchart showing an operation example of color reaction observation assistance processing for a color reaction detection target using a simple test paper or a simple test drug in the color reaction observation assistance system of one embodiment of the present invention.
Step S1:
The imaging control unit 103 detects current imaging conditions, such as an observation angle and an exposure condition, of the color reaction region that is the color reaction detection target in the imaging unit 101 .

Step S2:
The imaging control unit 103 uses the analysis kit 900 and the reference reaction color as the quality of the image that enables comparison of the color reaction between the colorimetric reaction region and the reference colorimetric pattern for all the imaging conditions such as the exposure conditions. It is determined whether or not the imaging conditions are such that the captured image data of each pattern sample 900' can be captured.
At this time, the imaging control unit 103 sets the image quality of the image that enables comparison of the color reaction when the imaging conditions are such that the captured image data of each of the analysis kit 900 and the reference reaction color pattern sample 900' can be captured. , the process proceeds to step S3. On the other hand, the imaging control unit 103 sets the image quality of an image that enables comparison of the color reactions, if the imaging conditions are not such that the imaged image data of each of the analysis kit 900 and the reference reaction color pattern sample 900' can be imaged, the process to step S4.

Step S3:
The object detection unit 104 extracts the imaging position of each of the color reaction region 902 and the reference reaction color pattern specimen 900' in the captured image data. That is, the imaging control unit 103 obtains the three-dimensional shape of each of the coloration reaction region 902 and the reference reaction color pattern sample 900′ within the imaging range of the imaging unit 101. FIG. Then, the imaging control unit 103 stores the obtained three-dimensional shapes of the analysis kit 900 and the reference reaction color pattern specimen 900′, and the analysis kit 900 and the reference reaction color that have been written and stored in the data storage unit 113 in advance. The three-dimensional shape of each pattern sample 900′ is compared, and a color reaction region 902 within the imaging range of the imaging unit 101 is extracted.

Step S4:
The imaging control unit 103 displays unsatisfied imaging conditions on the display screen of the display unit 111, and suggests adjustment of the unsatisfied imaging conditions to the user.

Step S5:
The object detection unit 104 detects each of the coloration reaction region 902 and the reference reaction color pattern sample 900′ in the captured image data of the imaging unit 101, and the coloration reaction region in the prestored three-dimensional shape of the container of the analysis kit 900. 902, compare with each of the reference reaction color pattern specimens 900'. Then, the object detection unit 104 determines whether or not each of the entire color reaction region 902 and the entire reference reaction color pattern sample 900′ is included in the captured image data, that is, determines whether the color reaction region 902 is included in the observation region. It is determined whether or not the entire color reaction region 902 for observing the reaction and the entire reference reaction color pattern specimen 900' are included in the captured image data.
At this time, if the captured image data includes the entire color reaction region 902 and the entire reference reaction color pattern sample 900′, the object detection unit 104 advances the process to step S6. On the other hand, if the captured image data does not include the entire color reaction region 902 and the entire reference reaction color pattern sample 900′, the object detection unit 10 advances the process to step S7.

Step S6:
The object detection unit 104 causes the observation position identification unit 105 to perform estimation processing of the imaging direction, that is, the observation angle, and the observation position of the color reaction region 902 and the reference reaction color pattern sample 900′.
As a result, the observation position specifying unit 105 obtains the three-dimensional shape of each of the container of the analysis kit 900 and the reference reaction color pattern sample 900' obtained from the captured image data in the imaging range of the imaging unit 101, and the previously stored three-dimensional shape of the sample 900'. By comparing the three-dimensional shapes of the container of the analysis kit 900 and the reference reaction color pattern sample 900′ in the dimensional coordinate system, the observation angle of the coloration reaction region 902 and the reference reaction color pattern sample 900′ with respect to the imaging direction is estimated. do. Here, the object detection unit 104 obtains the imaging direction of the captured image data in which each of the analysis kit 900 and the reference reaction color pattern sample 900′ is captured by the imaging unit 101 by the above comparison. Then, the object detection unit 104 detects the surface to which the color reaction region 902 of the analysis kit 900 is attached in the three-dimensional coordinate system (either the top surface or the bottom surface of the analysis kit 900 to which the color reaction region 902 is attached). The angle formed by the normal line of the surface) and the imaging direction of the imaging unit 101 is obtained as the observation angle.

Step S7:
The object detection unit 104 displays on the display screen of the display unit 111 that the imaging position of the imaging unit 101 is adjusted so that the entire region of the color reaction region 902 is included in the imaging range of the imaging unit 101 . , suggests a change in the imaging position to the user.

Step S8:
The dropping detection unit 106 detects the initial color reaction color of the colorimetric reaction area in the captured image data captured first and the color reaction color of the colorimetric reaction area in the captured image data captured in time series thereafter. Find the difference value.
Then, the drop detection unit 106 determines whether or not the obtained difference value is equal to or greater than the drop threshold. At this time, if the obtained difference value is equal to or greater than the dropping threshold, the dropping detection unit 106 determines that dropping of the test solution has been detected, and outputs a detection signal to the elapsed time detection unit 107. to step S9. As a result, the elapsed time detection unit 107 starts measuring the elapsed time for detecting the reaction time.
On the other hand, if the obtained difference value is less than the dropping threshold value, the dropping detection unit 106 repeats the process of step S8 on the assumption that dropping of the test solution has not been detected.

Step S9:
The elapsed time detection unit 107 determines whether or not the counted elapsed time is longer than or equal to the reaction time of any inspection item.
At this time, when the elapsed time is equal to or longer than the reaction time of any test item, the elapsed time detection unit 107 detects a color reaction based on the test solution in the colorimetric reaction region of the test item within the color reaction region. A control signal indicating that the color observation time has come is output to the observation reaction area designating section 108 and the reference reaction color pattern presenting section 109 .

Step S10:
Then, each of the observation reaction region designating unit 108 and the reference reaction color pattern presenting unit 109 is supplied with the control signal including the information of the test item for which the reaction time has passed, the display screen of the display unit 111 In each of the color reaction region 902 and the reference reaction color pattern specimen 900′, markings are displayed for each of the colorimetric reaction region and the reference colorimetric pattern corresponding to the inspection item, and the color reaction is observed, that is, for the inspection item. Prompt the user to make a decision.

Step S11:
The elapsed time detection unit 107 detects the presence or absence of other test items for which the user has not yet observed, that is, for which the user has not prompted observation of the color reaction, other than the currently determined test item.
At this time, if there is another test item for which the observation of the color reaction is not prompted, that is, if there is a test item for which the reaction time is being detected, the elapsed time detection unit 107 advances the process to step S9. . On the other hand, the elapsed time detection unit 107 terminates the process when there is no other test item that prompts observation of the color reaction, that is, when there is no test item for which the reaction time is being detected.

FIG. 7 is a diagram for explaining another display in which the reference colorimetric part of the inspection item to be observed and the reference colorimetric pattern are associated with each other after the reaction time has elapsed.
In FIG. 7, the observation reaction area designation unit 108 displays each of the colorimetric reaction areas 903 to 908 on the display screen 111a of the display unit 111 in real-time imaged colors. Then, the reference reaction color pattern presenting unit 109 displays the image of the reference colorimetric pattern 905' corresponding to the inspection item in parallel with the image of the colorimetric reaction region 905 of the inspection item to be observed on the display screen 111a of the display unit 111. indicate.

This allows the user to simultaneously grasp the colorimetric reaction area 905 to be observed in the color reaction area 902 of the analysis kit 900 and the observation point in the reference colorimetric pattern 905' corresponding to this colorimetric reaction area 905. FIG.
Therefore, as in the case of FIG. 5, even if the number of colorimetric reaction areas and reference colorimetric patterns corresponding to the colorimetric reaction areas is large, the user can easily observe and inspect the colorimetric areas to be observed. Items can be judged.

The display unit 111 is a display device such as a liquid crystal display, and the image of the analysis kit 900 and the image of the reference reaction color pattern sample 900′ are displayed under the control of the observation reaction area designating unit 108 and the reference reaction color pattern presentation unit 109, respectively. display, marking, etc.
Alternatively, a printing device such as a printer may be configured to output a printed material in which each of the colorimetric reaction areas of the inspection item for which the reaction time has elapsed and the reference colorimetric pattern of this inspection item are printed.

<Second embodiment>
Next, a second embodiment of the invention will be described with reference to the drawings.
The second embodiment has the same configuration as the configuration example of the color reaction observation assistance system according to the first embodiment shown in FIG. Operations different from those of the first embodiment will be described below. In a second embodiment, reference colorimetric patterns 903′, 904′, 905′, 906′, . , 908′ are captured as reference image data, and are written and stored in the data storage unit 113 in advance.

With the configuration of the second embodiment, in observing the color reaction for each test item using the captured image data of the colorimetric reaction region to be observed, Even if the color correction patch pattern 909′ does not exist, the reference colorimetric pattern corresponding to the colorimetric reaction area for determining the inspection item is read from the data storage unit 113 and displayed side by side with the colorimetric reaction area to be observed. By displaying on the display screen of the unit 111, the user can easily observe the color reaction.

Further, in relation to the already explained formulas (1) and (2), when using the reference reaction color pattern sample 900′ captured with a standard light source and stored in the data storage unit 113, Since it becomes an environment, color conversion is necessary.
The imaging control unit 103 reads out the three types of color correction patches 1001′, 1002′, and 1003′ of the reference reaction color pattern sample 900′ from the data storage unit 113, and calculates the color of each of them as C _gt (R _gt , G _gt , B _gt ). The imaging control unit 103 also calculates C _in (R _in , G _in , B _in ) for the three types of color correction patches 1001, 1002, and 1003 in the color correction patch area 909 in the captured image data. . In this case, the following equation (1) holds between the tint C _gt and the tint C _in when the simplest conversion formula for color correction is applied as an example.

Then, the imaging control unit 103 sets the hue C _gt and the hue C _{in in} the formula (1), as described above, the hue C _gt is the reference reaction color pattern sample 900 captured under the standard light source. ', which is (R _gt , G _gt , B _gt ) when described in terms of color components RGB.
On the other hand, the tint C _in is the tint of each color correction patch in the color correction patch area 909 in the captured image data, and is (R _in , G _in , B _in ) when described in terms of color components RGB.

When displaying on the display screen 111a of the display unit 111, the color of each of the analysis kit 900 and the reference reaction color pattern sample 900' is displayed using three different color correction patches 1001, 1002, and 1003 and the color correction patch 1001. By using ', 1002', and 1003', the combination of the color of the reference reaction color pattern specimen 900' imaged with the standard light source and the color of the analysis kit 900 in the captured image data is three or more pairs. and the matrix A used in equation (2) is obtained.

Here, the imaging control unit 103 reads out the color C _gt (R _gt , G _gt , B _gt ) of the three types of color correction patch patterns 909 ′ and the formula (2) from the data storage unit 113 . Then, the imaging control unit 103 extracts the color C _in (R _in , G _in , B _in ) of the three types of color correction patches 909 from the captured image data, and extracts the color of the color correction patch pattern 909 ′. Using C _gt (R _gt , G _gt , B _gt ), the matrix A is calculated using equation (2) corresponding to each of the three types of color correction patches. The imaging control unit 103 uses the calculated matrix A to convert the color captured under a standard light source into the color of each pixel of the captured image data captured under an arbitrary light source according to equation (2). do.

As described above, by obtaining the matrix A and using the formula (2), the color captured under a standard light source can be converted into the color of the captured image data captured under an arbitrary light source. becomes possible. As a result, the observation result of the colorimetric reaction region and the corresponding reference colorimetric pattern can be compared under the same lighting condition at the time of imaging. This process eliminates the influence of the difference in illumination (under the light source environment) during observation of the colorimetric reaction region and during imaging of the reference colorimetric pattern, and enables highly accurate observation of the color reaction.

In addition, a program for realizing the functions of the color reaction observation assistance system 1 of the present invention shown in FIG. By executing the processing, a process for assisting observation of the color reaction in color reaction detection may be performed. It should be noted that the "computer system" referred to here includes hardware such as an OS and peripheral devices.
Also, the "computer system" includes a WWW system provided with a home page providing environment (or display environment). The term "computer-readable recording medium" refers to portable media such as flexible discs, magneto-optical discs, ROMs and CD-ROMs, and storage devices such as hard discs incorporated in computer systems. In addition, "computer-readable recording medium" means a volatile memory (RAM) inside a computer system that acts as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. , includes those that hold the program for a certain period of time.

Further, the above program may be transmitted from a computer system storing this program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in a transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Further, the program may be for realizing part of the functions described above. Further, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

DESCRIPTION OF SYMBOLS 1... Color reaction observation assistance system 101... Imaging part 101A... Imaging direction 102... Exposure control part 103... Imaging control part 104... Object detection part 105... Observation position specific part 106... Dropping detection part 107... Elapsed time detection part 108... Observation reaction area instruction unit 109 Reference reaction color pattern presentation unit 110 Reaction area image storage control unit 111 Display unit 112 Illumination unit 113 Data storage unit 400 Normal line 900 Analysis kit 900' Reference reaction color pattern sample 901 Observation target surface 902 Color reaction areas 903, 904, 905, 906, 907, 908 Colorimetric reaction areas 903', 904', 905', 906', 907', 908' Reference colorimetric pattern 1001 , 1002, 1003, 1001′, 1002′, 1003′, color correction patches

Claims (11)

In the colorimetric reaction area for each test item formed in the color reaction area of the analysis kit, a display that assists observation of the color reaction by the substance to be detected contained in the test solution dropped into the color reaction area. A color reaction observation auxiliary system,
an observation target plane detection unit that determines whether or not an observation target plane including each of the colorimetric reaction regions is included in the captured image supplied from the imaging device;
an observation position specifying unit for specifying the position of each of the colorimetric reaction regions on the observation target surface;
a dropping detection unit that detects that the test solution has been dropped onto each of the colorimetric reaction regions;
an elapsed time detection unit for detecting whether or not a reaction time preset for each of the colorimetric reaction regions has elapsed from the point of time when the dropping was performed;
a display unit;
an observation reaction area instructing unit that prompts observation by presenting a mark corresponding to the colorimetric reaction area for which the reaction time has elapsed on the image of the display unit ;
At the time when the reaction time has elapsed among the reference reaction color patterns for determining the color reaction color of the colorimetric reaction area for which the reaction time has elapsed, the reference colorimetric pattern of the inspection item corresponding to the reaction time and a reference reaction color pattern presentation unit that presents a mark on the image of the display unit . Color reaction area image storage control for writing and storing a colorimetric reaction area image, which is an image of a colorimetric reaction area in the captured image detected by the elapsed time detection unit that the reaction time has elapsed, in a data storage unit. further comprising
The observation reaction area designating unit reads out the colorimetric reaction area image from the data storage unit, and presents it at the position of the colorimetric reaction area on the observation target surface after the corresponding reaction time has elapsed. Item 2. The color reaction observation auxiliary system according to item 1. The reference reaction color pattern presentation unit
When the reference reaction color pattern is pre-written and stored in the data storage unit, when the observation reaction area instructing unit prompts the observation of the colorimetric reaction area, the imaging conditions of the captured image are made to correspond. 3. The coloration reaction observation assisting system according to claim 2 , wherein the reference reaction color pattern that has been color-calibrated is presented. When the observation target plane is not included in the captured image, the observation target plane detection unit prompts the imaging device to perform imaging so that the observation target plane is included in the captured image. 3. The color reaction observation assistance system according to claim 1 or 2. The dropping detection unit
2. Dropping of the sample solution onto each of the colorimetric reaction regions is detected from a change in color reaction color of each image of the colorimetric reaction regions in the captured image. 4. The color reaction observation assisting system according to any one of claims 3 to 4. The elapsed time detection unit
For each colorimetric reaction area, the elapsed time from when the test solution was dropped is measured, and whether or not the reaction time of the colorimetric reaction area has elapsed is detected. The color reaction observation assistance system according to any one of claims 1 to 4. The observation reaction area designation unit
6. The method according to any one of claims 1 to 5, wherein an image indicating the colorimetric reaction area for which the reaction time has elapsed in the coloration reaction area is displayed to encourage observation of the colorimetric reaction area. 1. The color reaction observation auxiliary system according to 1. The reference reaction color pattern presentation unit
When the observation reaction area instructing unit prompts observation of the colorimetric reaction area, observation is prompted in the color reaction specimen in which the reference reaction color pattern of the colorimetric reaction area of each of the inspection items is described. 7. The color reaction observation assisting system according to any one of claims 1 to 6, wherein the reference reaction color pattern corresponding to the colorimetric reaction area is designated. The analysis kit uses at least a simple test paper such as a pH test paper, a urine test paper, and an oxidation test paper as a medium for detecting the target substance to be detected by a color reaction of the target substance to be detected. The color reaction observation assisting system according to any one of claims 1 to 8, characterized in that In the colorimetric reaction area for each test item formed in the color reaction area of the analysis kit, a display that assists observation of the color reaction by the substance to be detected contained in the test solution dropped into the color reaction area. A method for assisting color reaction observation,
an observation target plane detection process in which an observation target plane detection unit determines whether or not an observation target plane including each of the colorimetric reaction regions is included in a captured image supplied from an imaging device;
an observation position specifying process for an observation position specifying unit to specify the position of each of the colorimetric reaction regions on the observation target surface;
a dropping detection step in which the dropping detection unit detects that the test solution has been dropped onto each of the colorimetric reaction regions;
an elapsed time detection process in which an elapsed time detection unit detects whether or not a reaction time preset for each of the colorimetric reaction regions has elapsed from the point of time when the dropping was performed;
an observation reaction area designation step in which an observation reaction area designation unit prompts observation by presenting a mark corresponding to the colorimetric reaction area for which the reaction time has elapsed on an image of the display unit ;
A reference reaction color pattern presenting unit provides a reference reaction color pattern for determining the color reaction color of the colorimetric reaction area for which the reaction time has passed, at the time when the reaction time has passed, corresponding to the reaction time. and a reference reaction color pattern presenting step of presenting a mark corresponding to the reference colorimetric pattern of the inspection item on the image of the display unit . In the colorimetric reaction area for each test item formed in the color reaction area of the analysis kit, a display that assists observation of the color reaction by the substance to be detected contained in the test solution dropped into the color reaction area. A program that causes a computer to execute the functions of the color reaction observation assistance system,
said computer,
observation target plane detection means for determining whether or not an observation target plane including each of the colorimetric reaction regions is included in a captured image supplied from an imaging device;
observation position specifying means for specifying the position of each of the colorimetric reaction regions on the observation target surface;
dropping detection means for detecting that the test solution has been dropped onto each of the colorimetric reaction regions;
Elapsed time detection means for detecting whether or not a reaction time preset for each of the colorimetric reaction regions has elapsed since the dropping was performed;
Observation reaction area instructing means for prompting observation by presenting a mark corresponding to the colorimetric reaction area for which the reaction time has elapsed on the image of the display unit;
At the time when the reaction time has elapsed among the reference reaction color patterns for determining the color reaction color of the colorimetric reaction area for which the reaction time has elapsed, the reference colorimetric pattern of the inspection item corresponding to the reaction time A program for functioning as reference reaction color pattern presenting means for presenting a mark on the image of the display unit .

Images