KR20240076250A - Colorimetric assay method using portable terminal - Google Patents

Abstract

The colorimetric analysis method of the present invention includes the steps of (a) acquiring an image of a sample sheet including a reference marker using a camera unit of a portable terminal device; (b) correcting distortion of the sample sheet image by reflecting the positional information of the reference marker in the image in the conversion module of the portable terminal device; (c) acquiring an image including a corrected sample sheet image and a color correction checker from the camera unit; (d) the conversion module correcting the color of the sample sheet using a color correction checker; (e) acquiring the sample color value of the corrected sample sheet from the sample analysis module of the portable terminal device; and (f) comparing the sample color value with a colorimetric data set pre-stored in the database of the portable terminal device and displaying the colorimetric analysis result through an output unit of the portable terminal device.

Description

Colorimetric analysis method using a portable terminal device {COLORIMETRIC ASSAY METHOD USING PORTABLE TERMINAL}

The present invention relates to a colorimetric analysis method using a portable terminal device. More specifically, the present invention relates to a colorimetric analysis method using a portable terminal device that can perform colorimetric analysis by improving object recognition using the camera of the portable terminal device.

In general, colorimetric analysis is a type of chemical analysis method that quantitatively evaluates a sample material by comparing the color of the sample and the color of a standard material. It can be used for the analysis of solids or gases, but is mainly used for the analysis of samples that are solutions. Colorimetric analysis results are usually compared with the naked eye, but in this case, there is a problem that the accuracy of the analysis results is low. Accurate analysis is possible when using a measuring instrument such as a photoelectric photometer, but the analysis cost increases and various colorimetric tests cannot be performed immediately. There is a problem with poor usability.

Recently, portable terminal devices have become popular, and after acquiring an image using the camera of the portable terminal device, various analyzes can be performed using the image. However, since images captured with a portable terminal device change depending on the placement of the light source, the composition of the camera, etc., information that can be used for actual colorimetric analysis must be obtained by correcting the captured image in order to utilize the captured image.

Therefore, in order to perform colorimetric analysis using a portable terminal device, it is essential to increase object recognition by correcting the captured image to obtain more accurate measurement values.

As background technology for the present invention, a skin condition measuring device using a mobile phone is disclosed in Korean Patent Publication No. 10-2017-0057479, but it does not include a process of correcting distorted color compared to the actual subject after acquiring the image.

The purpose of the present invention is to perform more accurate colorimetric analysis using a portable terminal device rather than an expensive colorimetric analysis device. Specifically, the accuracy and effectiveness of colorimetric analysis is effectively increased by allowing the object recognition enhancement process, which can correct the color difference between the image acquired using the camera unit of the portable terminal device and the actual subject, to be operated through the portable terminal device. It is in order to do so.

The above and other objects of the present invention can all be achieved by the present invention described below.

1. One aspect of the present invention relates to a colorimetric analysis method using a portable terminal device.

The colorimetric analysis method includes (a) acquiring an image of a sample sheet including a reference marker using a camera unit of a portable terminal device;

(b) correcting distortion of the sample sheet image by reflecting the positional information of the reference marker in the image in the conversion module of the portable terminal device;

(c) acquiring an image including a corrected sample sheet image and a color correction checker from the camera unit;

(d) the conversion module correcting the color of the sample sheet using a color correction checker;

(e) acquiring the sample color value of the corrected sample sheet from the sample analysis module of the portable terminal device; and

(f) comparing the sample color value with a colorimetric data set pre-stored in the database of the portable terminal device and displaying the colorimetric analysis result through an output unit of the portable terminal device.

2. In the first embodiment, the reference marker is an edge portion; It may include a binary bit pattern portion formed inside the edge portion.

3. In the above two embodiments, the border portion and the binary bit pattern portion may have different colors.

4. In any one of the embodiments of 1 to 3, step (a) is performed in the camera unit,

(a-1) acquiring an image from a preview screen captured by a camera of a portable terminal device;

(a-2) scanning the preview image and storing it in the database of the portable terminal device;

(a-3) recognizing a reference marker in the stored preview image; and

(a-4) If the number of recognized reference markers is less than n, returning to step (a-1);

(a-5) acquiring an image of a sample sheet containing a reference marker,

The n number may be the total number of reference markers arranged around the sample sheet.

5. In any one of the embodiments 1 to 4 above, the correction in step (b) is performed in the conversion module,

(b-1) recognizing the edge portion of the reference marker;

(b-2) recognizing and binarizing patterns arranged within the border;

(b-3) obtaining a unique ID of the reference marker through binarization; and

(b-4) After determining the outline of the reference marker and comparing the outline of each reference marker according to the unique ID to confirm the position and rotation angle of the reference marker, the image of the sample sheet placed on the same plane as the reference marker It may include a step of restoring distortion.

6. In any one of the embodiments 1 to 5 above, step (c) is performed in the camera unit,

(c-1) photographing a reference marker and a color correction checker; and

(c-2) checking whether the color correction checker is recognized between the reference markers, and if not, returning to step (c-1) above;

(c-3) when the color correction checker is recognized, storing the image of the corrected yaw strip and the color correction checker.

7. In any one of the embodiments 1 to 6 above, the color correction checker may include a color correction checker and a contrast correction checker in which a plurality of reference colors are arranged.

8. In the above 7 embodiments, step (d) is performed in the conversion module,

(d-1) correcting the brightness and saturation of the sample sheet by comparing it with the contrast correction checker; and

(d-2) compensating the color value of the sample sheet by comparing it with the color correction checker.

9. In the above 8 embodiments, the conversion module obtains the difference between the RGB value of the color correction checker stored in the database and the RGB value of the color correction checker on the image, and adds the difference to the RGB value of the reagent pad whose brightness-saturation has been corrected. In addition, the color value of the sample can be obtained.

10. In the above 9 embodiments, the sample analysis module may compare the RGB values of the colorimetric table stored in the data base with the color values of the sample sheet and output the RGB value with the smallest difference.

11. In any one of the embodiments 1 to 10, step (e) includes,

(e-1) forming a color analysis model by acquiring the sample color value from the extraction module of the portable terminal device; and

(e-2) generating a learning data set by labeling the color analysis model with shooting conditions in a learning module of the portable terminal device.

12. Another aspect of the present invention relates to a portable terminal device on which colorimetric analysis is performed.

The portable terminal device includes a camera unit that acquires images of the sample sheet and the reference marker;

A control unit that corrects sample sheet image distortion and color; and

It includes an output unit that outputs the sample color value.

Since the present invention can derive accurate colorimetric analysis results using a portable terminal device rather than an expensive colorimetric analysis device, the effectiveness of colorimetric analysis can be significantly increased compared to the visual detection method. The object recognition enhancement means is run in the form of an application within the portable terminal device, so that colorimetric analysis can be efficiently performed using the portable terminal device. Since images are acquired using the camera unit of a portable terminal device and colorimetric analysis of the color value of the sample is possible, it is possible to analyze not only urine but also various samples subject to colorimetric analysis, such as blood, poisons, drugs, hormones, and viruses. .

Figure 1 is a diagram schematically showing a portable terminal device for performing a colorimetric analysis method according to an embodiment of the present invention, a sample sheet, and a reference marker disposed around a vertex of the sample sheet.
Figure 2 is a diagram schematically showing a portable terminal device for performing a colorimetric analysis method according to an embodiment of the present invention, a sample sheet, and a reference marker disposed around the sample sheet.
Figure 3 is a diagram schematically showing a portable terminal device for performing a colorimetric analysis method according to an embodiment of the present invention, a sample sheet, a color correction checker, and a reference marker disposed around the sample sheet.
Figure 4 is a diagram schematically showing a portable terminal device for performing a colorimetric analysis method according to an embodiment of the present invention, a yaw strip as a sample sheet, a reference marker, and a color correction checker.
Figure 5 is a block diagram of a portable terminal device according to an embodiment of the present invention.
Figure 6 is a flowchart of a colorimetric inspection method according to one embodiment of the present invention.
Figure 7 shows an example of recognizing spatial information about the outline and XYZ axes when a reference marker is recognized as a preview image in a portable terminal device.
Figure 8 shows the arrangement of reference markers around the urine strip in the colorimetric test method according to one embodiment of the present invention.
FIG. 9 is a detailed flowchart of S100 of FIG. 6.
FIG. 10 is a detailed flowchart of S200 of FIG. 6.
Figure 11 is a preview image of a yaw strip, which is a sample sheet, after a reference marker is placed in the colorimetric analysis method according to one embodiment of the present invention.
Figure 12 shows a process for correcting image distortion of a reference marker in the colorimetric analysis method according to one embodiment of the present invention.
Figure 13 shows the process of correcting image distortion of the yaw strip, which is a sample sheet, after the reference marker is placed in the colorimetric analysis method according to one embodiment of the present invention.
FIG. 14 is a detailed flowchart of S300 of FIG. 6.
FIG. 15 is a detailed flowchart of S400 of FIG. 6.
Figure 16 compares images before and after color correction of the urine reagent pad of the urine strip, which is a sample sheet, in the colorimetric test method according to one embodiment of the present invention.
FIG. 17 is a detailed flowchart of S500 of FIG. 6.

Hereinafter, the present invention will be described in more detail with reference to the attached drawings. However, the following drawings are provided only to aid understanding of the present invention, and the present invention is not limited by the following drawings. In addition, the shape, size, ratio, angle, number, etc. disclosed in the drawings are illustrative and the present invention is not limited to the matters shown.

Like reference numerals refer to like elements throughout the specification. Additionally, in describing the present invention, if it is determined that a detailed description of related known technologies may unnecessarily obscure the gist of the present invention, the detailed description will be omitted.

When 'includes', 'has', 'consists of', etc. mentioned in this specification are used, other parts may be added unless 'only' is used. When a component is expressed in the singular, the plural is included unless specifically stated otherwise.

When interpreting a component, it is interpreted to include the margin of error even if there is no separate explicit description.

When the positional relationship between two parts is described as ‘on’, ‘on the top’, ‘on the bottom’, ‘next to’, etc., unless ‘immediately’ or ‘directly’ is used, there is no difference between the two parts. One or more different parts may be located.

Positional relationships such as 'upper', 'top', 'lower', 'lower', etc. are only written based on the drawings, and do not represent absolute positional relationships. In other words, depending on the observation position, the positions of 'top' and 'bottom' or 'top' and 'bottom' may change.

Hereinafter, a colorimetric inspection method according to an embodiment of the present invention will be described with reference to the drawings.

In the present invention, color is defined as the color of an object caused by a changing light source and includes hue, saturation, and brightness, and color refers to the unique color of an object under white light as a standard, expressed as RGB values.

Figure 1 schematically shows a portable terminal device 100, a sample sheet 200, and a reference marker 300 disposed around a vertex of the sample sheet 200 for performing a colorimetric analysis method according to an embodiment of the present invention. It is a drawing, and FIG. 2 shows a portable terminal device 100, a sample sheet 200, and a reference marker 300 disposed around the sample sheet 200 for performing a colorimetric analysis method according to an embodiment of the present invention. It is a schematic drawing, and FIG. 3 shows a portable terminal device 100, a sample sheet 200, a color correction checker 400, and the sample sheet 200 for performing a colorimetric analysis method according to an embodiment of the present invention. It is a diagram schematically showing the reference marker 300 arranged around, and FIG. 4 shows a portable terminal device 100 for performing a colorimetric analysis method according to an embodiment of the present invention, and a yaw strip (sample sheet 200). 240), a diagram schematically showing the reference marker 300 and the color correction checker 400, and FIG. 5 is a block diagram of a portable terminal device 100 according to an embodiment of the present invention.

Referring to Figures 1 to 5, the colorimetric analysis method is performed through the portable terminal device 100. Specifically, a reference marker 300 is placed around the sample sheet 200, where the color of the sample changes in response to a colorimetric analysis target sample, and a vertex of the sample sheet 200, or a reference marker is placed around the edge of the sample sheet 200. After arranging 300, an image of the sample sheet 200 may be acquired to correct spatial distortion and color correction of the image of the sample sheet 200.

The portable terminal device 100 includes a camera unit 110, a control unit 120, and an output unit 130.

The camera unit 110 can acquire images of the sample sheet 200 and the reference marker 300. The image may differ from the color and color of the actual sample sheet 200 due to the influence of shooting conditions, and errors may occur when directly comparing the image obtained from the camera unit 110 and the color of the colorimetric table with the naked eye. there is.

The control unit 120 includes an image reception module 121, a conversion module 122, a sample analysis module 123, a database 124, an extraction module 125, and a learning module 126. The control unit 120 may be an application processor (AP) or a central processing unit (CPU) within the portable terminal device 100.

The image receiving module 121 may receive the image acquired by the camera unit 110 and transmit it to the conversion module 122. Specifically, the image receiving module 121 may select a preview image in which the yaw strip 200 and the reference marker 300 are placed together and transmit it to the conversion module 122.

The conversion module 122 performs distortion and color correction on the acquired image and transmits it to the sample analysis module 123.

The sample analysis module 123 can compare the corrected image delivered from the conversion module 122 with the color of the colorimetric table stored in the database 124 and extract a colorimetric analysis result of the sample according to the sample color value. The sample analysis module 123 can transmit the colorimetric analysis results to the extraction module 125 and simultaneously transmit them to the output unit 130.

The database 124 can store or transmit images acquired by the camera unit 110, and can transmit RGB values of a pre-stored colorimetric data set to the specimen analysis module 123.

The output unit 130 may display the colorimetric analysis results through a display.

The extraction module 125 can extract the sample color value and store it in the database 124, and the sample color value stored in the database 124 is stored in the learning module 126, and the camera unit 110 The weight of the correction value of a new image acquired from the camera unit 110 can be set by repeatedly obtaining the difference in image correction values depending on the shooting conditions.

Figure 6 is a flowchart of a colorimetric analysis method according to one embodiment of the present invention.

Referring to FIG. 6, the colorimetric analysis method includes the steps of (a) acquiring an image of a sample sheet 200 including a reference marker 300 using the camera unit 110 of the portable terminal device 100; (b) correcting image distortion of the sample sheet 200 by reflecting the positional information of the reference marker 300 in the image in the conversion module 122 of the portable terminal device 100; (c) acquiring an image including a corrected sample sheet 200 image and a color correction checker 400 from the camera unit 110; (d) the conversion module 122 correcting the color of the sample sheet 200 using the color correction checker 400; (e) acquiring the sample color value of the corrected sample sheet 200 from the sample analysis module 123 of the portable terminal device 100; and (f) comparing the sample color value with a colorimetric data set pre-stored in the database 124 of the portable terminal device 100 and displaying the colorimetric analysis result through the output unit 130 of the portable terminal device 100. It includes;

First, an image of the sample sheet 200 including the reference marker 300 is acquired using the camera of the portable terminal device 100 (S100).

Before S100, a reference marker 300 may be placed around the sample sheet 200 where the sample has been absorbed, and the sample sheet 200 may be placed between the reference markers 300. Since the reference marker 300 is not connected or combined with the sample sheet 200 and is spatially separated, the sample sheet 200 can utilize various sample sheets used for existing colorimetric analysis, for example. For example, the sample sheet 200 may be a urine strip 230, a blood test sheet, or a colorimetric analysis test piece for measuring various chemical substances.

The sample sheet 200 is provided with a reagent pad 210, and the color of the reagent pad 210 can quantitatively change in proportion to the amount of substance in the sample subject to colorimetric analysis.

In one embodiment, the sample sheet 200 may be a yaw strip 230.

The color of the urine strip 230 may change when urine is applied and reacts with chemicals inside the urine strip 230. Specifically, the urine strip 230 is provided with a urine medicine pad 240, Chemicals contained in the urine medicine pad 240 may react chemically with substances in urine such as white blood cells, occult blood, nitrites, urine protein, biliary pigments, ketones, urine sugar, and urobilinogen, resulting in discoloration.

The yaw strip 230 may be square or rectangular. The conventional yaw strip 230 generally has a rectangular shape extending to a certain length, but the yaw strip 230 according to one embodiment of the present invention does not perform a colorimetric test by directly comparing it with a colorimetric table, but rather the yaw strip 230 ) After the reference marker (300; fiducial maker) is placed around the preview image captured with the camera of the portable terminal device 100, the position, rotation angle, and size of the yaw strip 230 are corrected and the yaw medicine pad Since an image with an accurately recognized edge can be obtained by facing the front (240), and the color can be compared with the color correction checker 400 and the color corrected to obtain an accurate color value, the yaw strip 230 has a rectangular shape. Additionally, it can be provided in a square shape.

In addition, the sample color value obtained through color correction can be converted to CIE Lab value after measuring the exact RGB value to form a data set.

The urine strip 230 is provided with a plurality of rectangular urine reagent pads 240 on which a sample reagent that changes color in response to urine is provided, and the urine reagent pads 240 are arranged in a row or in a matrix along the length direction. You can. For example, if the yaw strip 230 is a rectangle extending in the longitudinal direction, the yaw medicine pads 240 are arranged in a row within a rectangular space, and if the yaw strip 230 is provided in a square shape, The reagent pads 240 may be arranged in a matrix within a square space. Even if the shape of the urine strip 230 is distorted, it recognizes the shape of the urine medicine pad 240, corrects it, and then performs colorimetric analysis, so the shapes of the urine strip 230 and the medicine pad 240 can be deformed. It has advantages.

The plurality of reference markers 300 are arranged around the sample sheet 200.

FIG. 7 shows an example of recognizing the outline and spatial information about the In the colorimetric test method, it shows that a reference marker 300 is placed around the urine strip 230.

Referring to FIGS. 7 and 8, in one embodiment, a yaw strip 230 may be disposed between the reference markers 300. Specifically, it is preferable that four reference markers 300 are arranged near the vertices along the edge of the yaw strip 230. The reference marker 300 is placed to increase the possibility of recognizing the yaw strip 230 and the reference marker 300 at the same time, and the position of the reference marker 300 is determined to rotate the yaw strip 230. Distortion of space, such as angle, tilt, and distance from the portable terminal device 100, can be corrected.

Since the sample sheet 200 secures location and space information using the reference marker 300, the arrangement position is free, and the shape can be changed as long as posture estimation and projection transformation of the camera of the portable terminal device 100 are possible. It is not limited, and since the image is acquired by arranging four or more reference markers 300 along the edge of the sample sheet 200, it is also possible to have a polygonal shape.

In one embodiment, the reference marker 300 may include an edge portion 310 and a binary bit pattern portion 320 formed inside the edge portion 310.

The border portion 310 may be provided in black to recognize the outline of the reference marker 300, and the binary bit pattern portion 320 represents a unique ID of the reference marker 300, respectively. It is possible to recognize the position and distance of the reference marker 300, the distance from the camera unit 110, and the rotation angle.

FIG. 9 is a detailed flowchart of S100 of FIG. 6.

Referring to FIG. 9, the image acquisition of the sample sheet in S100 acquires an image from the preview screen captured by the camera unit 110 of the portable terminal device 100 (S110), and scans the preview image to obtain an image from the portable terminal device 100. ) in the database 124 (S120), recognize the reference marker 300 in the stored preview image (S130), and if the number of recognized reference markers 300 is less than n, return to S210 (S240), If the number of recognized reference markers 400 is n, an image of the sample sheet 200 including the reference marker 300 can be acquired (S150).

First, an image of the reference marker 300 and the sample sheet 200 arranged with the reference marker 300 disposed can be obtained through the camera unit 110 of the portable terminal device 100 (S110). .

The portable terminal device 100 has a camera unit 110 capable of acquiring images of the reference marker 300, sample sheet 200, and color correction checker 400, and specifically uses the camera module as a preview image. By acquiring an image of the sample sheet 200, temporarily storing it in the database 124 of the portable terminal device 100, and going through a preview image acquisition step, the user can finally obtain the sample sheet 200, which is subject to spatial distortion correction. You can select an image.

The preview image is scanned and stored in the storage medium of the portable terminal device 100 (S120).

Specifically, by storing an image of the sample sheet 200 including the reference marker 300, it can be determined whether the reference marker 300 and the sample sheet 200 are arranged together on the same plane.

The reference marker 300 is recognized in the saved preview image (S130).

In one embodiment, the reference marker 300 may be placed along the edge of the sample sheet 200, and for example, it is preferably placed at the vertex of the sample sheet 200. If the sample sheet 200 is rectangular, it can be placed at all four vertices.

Meanwhile, if the number of recognized reference markers 300 is less than n, the process returns to S110 and repeats the process of acquiring a preview image until all reference markers 300 are recognized (S140). Here, n is the total number of reference markers 300 arranged around the sample sheet 200. Afterwards, when all n reference markers 300 are recognized, an image of the yaw strip 230 including the reference markers 300 can be obtained and finally stored (S150).

The camera unit 110 arranges the sample sheet 200 between the placed reference markers 300, takes pictures together, and acquires an image including all the reference markers 300 and the sample sheet 200, and stores them in the database 124. ) so that image distortion of the sample sheet 200 can be corrected in the next step.

The conversion module 122 of the portable terminal device 100 reflects the position information of the reference marker 300 in the image to correct image distortion of the sample sheet 200 (S200).

Figure 10 is a detailed flow chart of S200 of Figure 6, and Figure 11 is a colorimetric analysis method according to an embodiment of the present invention, after the reference marker 300 is placed, the yaw strip 230, which is the sample sheet 200 This is a preview image.

Referring to Figures 10 and 11, the conversion module 122 performs image correction of the sample sheet 200 of S200. First, the conversion module 122 recognizes the border of the reference marker 300 (S210). A pattern placed within the border is recognized and binarized (S220), a unique ID of the reference marker 300 is obtained through binarization (S230), and then the outline of the reference marker 300 is determined, and each After comparing the outline of the reference marker 300 and confirming positional information such as the position and rotation angle of the reference marker 300, distortion of the image of the sample sheet 200 placed on the same plane as the reference marker 300 is corrected. It can be restored (S240).

Here, image distortion of the sample sheet 200 refers to the difference between the actual shape of the sample sheet 200 and the shape of the sample sheet 200 on the image after shooting. For example, the sample sheet 200 is formed by the yaw strip 230. ), the sample pad 240 of the urine strip 230 is square, the distance from the camera unit 110 during filming, the angle between the sample sheet 200 and the camera unit 110, and the urine strip 230 This means that the urine medicine pad 240 is recognized as a pressed diamond or a rotated square in the image due to the rotation of .

In S210, the reference marker 300 has an edge portion 310, and the edge portion 310 has a thickness of a certain level or more, so that the entire outline of the reference marker 300 can be secured.

In S220, the pattern disposed within the edge portion 310 is recognized and binarized.

Specifically, the pattern is displayed as a binary bit pattern portion 320, and when it is recognized by a camera and binarized, the unique ID of the reference marker 300 can be confirmed. Therefore, by comparing the distance to each reference marker 300, spatial information about the position, rotation angle, and distance from the camera unit 110 of any one reference marker 300 can be obtained.

Referring to FIG. 11, when the image of the yaw strip 230 on which the reference marker 300 is placed is recognized, image distortion occurs depending on the camera position, that is, the shooting angle, and it is necessary to measure the exact outline of the yaw strip 230. I can see that it is difficult.

Figure 12 shows a process for correcting image distortion of a reference marker in the colorimetric analysis method according to one embodiment of the present invention.

Referring to FIG. 12, in S240, the outline of the reference marker 300 is determined and the outline of each reference marker 300 according to the unique ID is compared to obtain spatial information such as the position and rotation angle of the reference marker 300. By checking, image distortion of the reference marker 300 can be corrected.

Figure 13 shows the process of correcting image distortion of the yaw strip 230, which is the sample sheet 200, after the reference marker 300 is placed in the colorimetric analysis method according to one embodiment of the present invention.

Referring to FIG. 13, when the image distortion of the reference marker 300 is corrected, the distortion of the image of the sample sheet 200 placed on the same plane as the reference marker 300 can be restored. For example, a preview image is obtained in which the yaw strip 230, a type of sample sheet 200, is rotated at a certain angle or tilted according to the angle of the camera unit 110, and the portable terminal device 100 When the conversion module 122 within the extract extracts the outline of the yaw strip 230 from the preview image and performs a projection transformation by reflecting the spatial information of the previously extracted reference marker 300, the reference marker 300 ) At the same time that the image distortion of the yaw strip 230 is corrected, it is possible to obtain an image taken by the camera from the vertical top rather than a tilted or rotated image, that is, an image with the yaw medicine pad 240 facing the front. You can. Specifically, a square can be recognized along the edge of the urine medicine pad 240, and the colors within the square can be recognized and stored.

An image including the corrected sample sheet 200 and the color correction checker 400 is acquired (S300).

FIG. 14 is a detailed flowchart of S300 of FIG. 6.

Referring to FIG. 14, the camera unit 110 performs step S300 and acquires an image by photographing the reference marker 300 and the color correction checker 400 (step S310). Afterwards, it is checked whether the color correction checker 400 is recognized between the reference marker 300, and if it is not recognized, the process returns to S310 (S320). Afterwards, when the color correction checker 400 is recognized together, the images of the corrected ㅅ sample sheet 200 and the color correction checker 400 can be saved (S330).

In S300, it is possible to check whether the color correction checker 400 is recognized in the image and save the image of the yaw strip 230, which is a sample sheet 200 with spatial distortion corrected, together with the color correction checker 400.

Next, the conversion module 122 corrects the color of the sample sheet 200 using the color correction checker 400 (S400).

FIG. 15 is a detailed flowchart of S400 of FIG. 6.

Referring to FIG. 15, the color correction of the sample sheet 200 in S400 first corrects the brightness and saturation of the sample sheet 200 by comparing it with the contrast correction checker 420 (S410).

In one specific example, the color correction checker 400 may include a color correction checker 410 and a contrast correction checker 420 in which a plurality of reference colors are arranged.

The color correction checker 400 is used for color calibration, and the color correction checker 410 may be provided as a board consisting of 4 × 6 color patches (Patch 411), The contrast correction checker 420 may be a board made of 1 × 6 patches. The front image of the sample sheet 200 with image distortion corrected is accurately compared with each patch of the color correction checker 400, so that the contrast and color recognition rate can be significantly improved, and brightness and saturation are prioritized. After correction, the color can be corrected.

First, the brightness and saturation of the sample sheet 200 are corrected by comparison with the brightness correction checker 420. For example, the brightness and saturation are corrected for the color of the reagent pad 210 of the sample sheet 200. Through this process, excessive exposure of light sources to the yaw strip 230 and distortion caused by shadows can be corrected, and in particular, white balancing of the reagent pad 210 can be adjusted. In the step of comparing with the contrast correction checker 420, the color value of the reagent pad 210 of the sample sheet 200 may be first corrected.

In S400, the accuracy of color correction and color correction effect can be improved by performing the contrast correction process and color correction process separately.

Referring to FIGS. 1 to 4, the border portion 310 and the binary bit pattern portion 320 of the reference marker 300 may have different colors.

If the reference marker 300 has an edge portion 310 and a binary bit pattern portion 320 of different colors, some of the color patches 411 of the color correction checker 410 can be replaced. For example, when the reference marker 300 is arranged at least four times, the color indicated by the reference marker 300 becomes the reference color of the color correction checker 410 and becomes the color patch of the color correction checker 410. (411) The number can be reduced.

It is also possible to increase the efficiency of the entire process of the colorimetric analysis method by increasing the number of reference markers 300 and simultaneously performing color correction compared to the color correction checker 410 in the image distortion correction step (S200).

In one specific example, the image captured in the conversion module 122 is called to extract the RGB value of the contrast correction checker 420, and the RGB value of the contrast correction checker 420 in the first printed state stored in the database 124 is extracted. By comparing the value with the RGB value of the brightness correction checker 420 on the image, if there is a difference in the RGB values, the brightness and saturation can be corrected by adding the difference value to the entire image.

The RGB values are very convenient because they can be directly extracted from the image of the reagent pad 210 and the color correction checker 400 of the sample sheet 200 obtained from the camera unit 110, and the conversion module 122 provides specific information. It is extracted as numerical R, G, and B values.

The color value with the brightness and saturation corrected is reflected in the image, and the color value of the sample sheet 200 is corrected by comparing it with the color correction checker 410 (S420).

Specifically, the conversion module 122 extracts the RGB value of the color correction checker 410 after the brightness and saturation of the image are corrected, and stores the color correction checker 410 in the first printed state stored in the database 124. If there is a difference between the RGB value of and the RGB value of the color correction checker 410 on the image, the difference value is calculated and the difference value is added to the entire captured image to correct the color value.

After the brightness and saturation of the color value of the reagent pad 210 of the reagent sheet 200 are corrected, the color value can be corrected by comparing it with the color correction checker 410.

Figure 16 compares images before and after color correction of the urine reagent pad 240 of the urine strip 230, which is the sample sheet 200, in the colorimetric inspection method according to one embodiment of the present invention.

Referring to FIG. 16, the image of the yaw strip 230 whose brightness and saturation have been corrected and whose contrast has been adjusted has its brightness corrected according to the presence of a light source or shadow, so that it has a color value close to the actual color, and finally, the color correction checker Compared to (410), it is corrected to have more accurate color values through color correction.

When the color value of the urine drug pad 240 of the urine strip 230 image is corrected, the image of the urine drug pad 240 is excluded from the influence of light source conditions or shadows, brightness and saturation are corrected, and color correction is performed. The color is restored, and an RGB value close to the sample color value shown by the actual urine drug pad 240 can be obtained.

Thereafter, the sample color value is acquired from the corrected sample sheet 200 in the sample analysis module 1230 of the portable terminal device 100 (S500).

The sample color value is a value close to the actual color of the sample sheet 200 and reagent pad 210 by excluding irregular conditions due to camera shooting conditions. Contrast, such as light source conditions and shadow effects, are corrected, and an accurate value is obtained through color correction. It can be converted to an RGB color value with , greatly improving the effectiveness of the colorimetric analysis method using a mobile terminal device.

In one embodiment, the color value of the reagent pad 210 of the reagent sheet 200 may be measured as an RGB value in the conversion module 122 and then converted to a CIE Lab value.

The color value of the reagent pad 210 of the reagent sheet 200 is converted to a CIE Lab value through the conversion module 122. Specifically, the conversion module 122 can call the Open CV image library stored in the database 124 and perform CIE Lab conversion on the RGB values.

The CIE Lab value is a coordinate value expressed as (L*, a*, b*) using space, where L* represents reflectance (brightness similar to human vision), and a* is a chromaticity diagram + a* represents the red direction, -a* represents the green direction, b* is the chromaticity diagram, +b* represents the yellow direction, and -b* represents the blue direction. The image captured by the camera unit 110 has distorted colors and colors, and the RGB values are extracted and converted to CIE Lab values after color correction by comparing them with the color correction checker 400. When converted to CIE Lab values, Since color conversion according to color distance within the colorimeter is easy, it is possible to more accurately determine the sample color value closest to the colorimetric data storing the CIE Lab value of the colorimetric table stored in the database 124.

FIG. 17 is a detailed flowchart of S500 of FIG. 6.

Referring to FIG. 17, S500 acquires the sample color value from the extraction module 125 of the portable terminal device 100 to form a color analysis model (S510), and labels the shooting conditions on the color analysis model. A learning data set can be created (S520).

The color analysis model is based on the color of the sample sheet 200 before color correction according to the type of the reagent pad 210 of the sample sheet 200, and the sample color represented by the reagent pad 210 of the sample sheet 200 recognized after color correction. Values can be included as conversion functions.

A learning data set can be created by labeling the color analysis model with shooting conditions using the camera unit 110 of the portable terminal device 100, data from the learning data set stored through repeated measurements can be added, and weights can be added to the data. In this case, it is possible to increase the accuracy of color measurement by assigning weight to the sample color value.

In the S500, the accuracy of measuring color values can be increased by assigning weights to the sample color values, and weights can be assigned to the sample color values after color correction according to shooting conditions, so a portable terminal device that performs a colorimetric test ( 100) The effectiveness of the sample color value can be increased regardless of the type.

The sample color value is compared with a colorimetric data set previously stored in the database 124 of the portable terminal device 100, and the colorimetric analysis result is displayed on the display of the portable terminal device (S600).

The sample color value is compared with a pre-stored colorimetric data set, the colorimetric data most similar to the colorimetric data is identified, and the sample analysis result according to the colorimetric data can be output through the output unit 130.

Specifically, the conversion module 122 in the portable terminal device 100 outputs a CIE Lab value after correcting the color of the sample sheet 200 and compares it with the CIE Lab value of a pre-stored colorimetric data set. At this time, when the preview image is acquired from the camera unit 110, the control unit 120 of the portable terminal device recognizes the image of the sample sheet 200 through the image reception module 121 and performs color correction in the conversion module 122. Thereafter, the sample analysis module 124 may sequentially compare the sample color value with the colorimetric data set value and output the sample analysis result to the output unit 130.

Another aspect of the present invention relates to a storage medium on which a colorimetric analysis method is performed.

The storage medium stores computer instructions therein, and specifically contains a computer program that performs the colorimetric analysis method step by step. The storage medium is not limited as long as it is readable by various computers, and includes volatile and non-volatile media, transitory and non-transitory media, removable and non-removable media, and embodiments of the present invention. It may be memory (RAM) built into the portable terminal device 100.

The colorimetric analysis method of the present invention can be performed on the portable terminal device 100, but can also be run on various devices capable of reading the storage medium.

Another aspect of the present invention relates to a portable terminal device 100.

The portable terminal device 100 includes a camera unit 110, a control unit 120, and an output unit 130.

Including the camera unit 110, the yaw strip 200, the reference marker 300, and the color correction checker 400 acquire an image and transmit it to the control unit 120 to perform image distortion and color correction. , the colorimetric test results can be read immediately through the output unit 130.

Therefore, the colorimetric analysis method according to the present invention uses a portable terminal device 100 rather than a standard color correction camera when performing a colorimetric test, but recognizes the image of the sample sheet 200 of the camera unit 110 built into the portable terminal device 100. Through an object recognition increase solution that improves the process, there is no image distortion depending on the type of portable terminal device 100 and object shooting conditions, and the color closest to the color of the reagent pad 210 of the actual sample sheet 200 is determined. The accuracy of the colorimetric analysis method can be effectively improved by comparing the colorimetric data stored in advance and outputting the quantitative analysis results of the specimen accordingly.

So far, the present invention has been examined focusing on the embodiments. A person skilled in the art to which the present invention pertains will understand that the present invention may be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from an illustrative rather than a restrictive perspective. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the equivalent scope should be construed as being included in the present invention.

100: portable terminal device 200: sample sheet
210: Reagent pad 220: Handle
230: Yossi Strip 240: Yossi Medicine Pad
250: Yostrip handle 300: Reference marker
310: border portion 320: binary bit pattern portion
400: Color correction checker 410: Color correction checker
411: Color patch 420: Contrast correction checker

Claims (12)

(a) acquiring an image of a sample sheet including a reference marker using a camera unit of a portable terminal device;
(b) correcting distortion of the sample sheet image by reflecting the positional information of the reference marker in the image in the conversion module of the portable terminal device;
(c) acquiring an image including a corrected sample sheet image and a color correction checker from the camera unit;
(d) the conversion module correcting the color of the sample sheet using a color correction checker;
(e) acquiring the sample color value of the corrected sample sheet from the sample analysis module of the portable terminal device; and
(f) comparing the sample color value with a colorimetric data set pre-stored in the database of the portable terminal device and displaying the colorimetric analysis result through an output unit of the portable terminal device; including,
Colorimetric analysis method.
The method of claim 1, wherein the reference marker includes an edge portion; A colorimetric analysis method comprising: a binary bit pattern portion formed inside the edge portion.
The colorimetric analysis method according to claim 2, wherein the border portion and the binary bit pattern portion have different colors.
The method of claim 1, wherein step (a) is performed in the camera unit,
(a-1) acquiring an image from a preview screen captured by a camera unit of a portable terminal device;
(a-2) scanning the preview image and storing it in the database of the portable terminal device;
(a-3) recognizing a reference marker in the stored preview image; and
(a-4) If the number of recognized reference markers is less than n, returning to step (a-1);
(a-5) acquiring an image of a sample sheet containing a reference marker,
The n number is the total number of reference markers arranged around the sample sheet.
The method of claim 1, wherein the correction in step (b) is performed in the conversion module,
(b-1) recognizing the edge portion of the reference marker;
(b-2) recognizing and binarizing patterns arranged within the border;
(b-3) obtaining a unique ID of the reference marker through binarization; and
(b-4) After determining the outline of the reference marker and comparing the outline of each reference marker according to the unique ID to confirm the position and rotation angle of the reference marker, the image of the sample sheet placed on the same plane as the reference marker A colorimetric analysis method comprising: restoring distortion.
The method of claim 1, wherein step (c) is performed in the camera unit,
(c-1) photographing a reference marker and a color correction checker; and
(c-2) checking whether the color correction checker is recognized between the reference markers, and if not, returning to step (c-1) above;
(c-3) storing the corrected sample sheet and the image of the color correction checker when the color correction checker is recognized.
The colorimetric analysis method according to claim 1, wherein the color correction checker includes a color correction checker and a contrast correction checker in which a plurality of reference colors are arranged.
The method of claim 7, wherein step (d) is performed in the conversion module,
(d-1) correcting the brightness and saturation of the sample sheet by comparing it with the contrast correction checker; and
(d-2) A colorimetric analysis method comprising: correcting the color value of the sample sheet by comparing it with a color correction checker.
The method of claim 8, wherein the conversion module calculates the difference between the RGB value of the color correction checker stored in the database and the RGB value of the color correction checker on the image, and adds the RGB value of the sample sheet with brightness-saturation corrected by the difference to the sample. A colorimetric analysis method that obtains color values.
The colorimetric analysis method according to claim 9, wherein the sample analysis module compares the RGB values of the colorimetric table stored in the data base with the color values of the sample sheet and outputs the RGB value with the smallest difference.
The method of claim 1, wherein step (e) is,
(e-1) forming a color analysis model by acquiring the sample color value from the extraction module of the portable terminal device; and
(e-2) generating a learning data set by labeling the color analysis model with shooting conditions in a learning module of a portable terminal device.
In a portable terminal device where the colorimetric inspection method of any one of claims 1 to 11 is performed,
A camera unit that acquires images of the sample sheet and reference marker;
A control unit that corrects sample sheet image distortion and color; and
An output unit that outputs the sample color value; including a
Portable terminal device.

Images