TWI693817B - Biomedical detection system and method thereof - Google Patents

Abstract

The biomedical detection system has a test strip plate, an image capture device, a database, and a processor. The test strip plate has a sample area and a color comparison area. The sample area is used to put onto the testing strip and it’s reaction color correspondingly. The image capturing device captures the image data of the test strip. A database stores a predetermined standard color value corresponding to the color comparison area and a plurality of contrast patches having different color values. The processor receives the image data to determine a difference color value between the predetermined standard color value and the comparison area in the image data, and compensates the color values of the contrast patches according to the difference value. The processor determines the color value of the sample block in the image data according to the compensated color values.

Description

Biomedical testing system and its operating method

The invention relates to a biomedical detection device and method, in particular to a biomedical detection device and method with a color correction function for early diagnosis of diseases.

In general, when performing health tests, blood, urine or other body fluids taken from the human body are often used in conjunction with corresponding test papers for in vitro testing to provide color display data for medical personnel to judge the health status of the testee.

After the test subject performs the test with the above test paper, the medical staff can directly observe the color of the test area with the naked eye to determine the health status of the test subject. However, because different medical personnel may have different interpretation results for the same color, the test results of the subjects often have different conclusions due to different interpretation personnel. Therefore, in order to avoid the differences caused by different human judgment standards, automatic instruments are often used for interpretation. However, when the test subject uses their test strips for testing at home, because there is no automatic testing instrument to assist, and the test subject's interpretation of color is different and does not have the test professional, therefore, the color rendering results are uploaded by taking pictures The method will be interpreted with the help of artificial intelligence in the cloud, which will be a feasible solution. However, the final display color is judged by the cloud detection instrument by uploading the photo When reading, due to the difference in the environment of the subject, the color of the upload cloud will be distorted due to the impact of the shooting ambient light on the color, resulting in inaccurate color judgment results of the testing instrument.

Therefore, how to obtain the correct color judgment result and then improve the detection accuracy has become the goal of pursuit.

An embodiment of the present case provides a biomedical testing system, which at least includes: a test paper tray with a local area and a color comparison block, wherein the sample area is used for placing a test paper of a subject and Corresponding to display its color; an image capturing device to capture an image data of the test paper tray; a database storing a standard color value of a pair of color blocks corresponding to the color comparison area, and a plurality of contrast color blocks, in which The contrast color blocks have different color values; a processor is coupled to the database for receiving the image data, and according to the preset standard color value in the database and the color of the color comparison area in the image data The value determines a difference value, wherein the processor compensates the color values of the contrast color blocks in the database according to the difference value, and determines the display of the sample area in the image data according to the compensated color values of the contrast color blocks The color value of the color.

According to an embodiment of the invention, the test strip is a urine test strip.

According to an embodiment of the invention, the image capturing device is a camera.

According to an embodiment of the present invention, the processor is disposed in a remote server, and the image capturing device uploads the image data through a wireless network connection via a communication device and the remote server.

Another embodiment of the present case provides a biomedical testing method. The method at least includes: arranging a sample area and a color comparison area on a test paper tray, wherein the sample area is used to place a subject’s Detect the test strip and display its color accordingly; store the predicted standard color of a color comparison area and a plurality of contrast color blocks in a database, where the contrast color blocks have different color values; use an image capture device to capture the test An image data of the test paper tray; sending the image data to a processor, wherein the processor determines a difference value according to the standard color value in the database and the color value of the color comparison area in the image data; according to the Difference value, the processor compensates the color values of the contrast color blocks in the database; and based on the compensated color values of the contrast color blocks, the processor determines the color value of the color displayed in the sample area in the image data .

According to an embodiment of the present invention, the standard color value includes standard brightness values of three primary colors of red, green, and blue (Cr0, Cg0, Cb0), where Cr0 is a standard brightness value of a red color, Cg0 is a standard brightness value of a green color, Cb0 The standard brightness value of the blue color.

According to an embodiment of the present invention, wherein the processor determines a difference value according to the standard color value in the database and the color value of the color comparison area in the image data, further including: the color in the image data Perform image processing on the color of the comparison area to obtain the brightness values of the three primary colors of red, green, and blue in the color comparison area (Crn, Cgn, Cbn), where Crn is the brightness value of the red color, and Cgn is the brightness value of the green color, Cbn Is the brightness value of the blue color; and the difference between the standard brightness values of the red, green and blue primary colors in the database and the red, green and blue primary color brightness values of the color comparison area in the captured image is calculated as the difference value ( △Cr,△Cg,△Cb), where △Cr=Cr0-Crn,△Cg=Cg0-Cgn,△Cb= Cb0-Cbn.

According to an embodiment of the present invention, according to the difference value, the processor compensates the color values of the contrast color blocks in the database, and further includes: performing image processing on the contrast color blocks to obtain each of the contrast colors Luminance values of the three primary colors of red, green, and blue (Cri, Cgi, Cbi), where i=1~N, N is the number of the contrasting color blocks; and the luminance values of the three primary colors of each of the contrasting color blocks Add the difference value as the compensated color value of the contrast color blocks (Cri+△Cr, Cgi+△Cg, Cbi+△Cb).

According to an embodiment of the present invention, wherein the processor determines the color value of the sample area in the image data according to the compensated color values of the contrast color blocks, and further includes: performing image processing on the sample area in the image data, To obtain the brightness values of the three primary colors of red, green and blue in the sample area (Crs, Cgs, Cbs), where Crs is the brightness value of the red color, Cgs is the brightness value of the green color, and Cbs is the brightness value of the blue color; The color values (Cri+△Cr, Cgi+△Cg, Cbi+△Cb) of some contrast color blocks after compensation and the color difference values (Cdi) of the brightness values (Crs, Cgs, Cbs) of the red, green, and blue colors in the sample area ; And select the contrast color block corresponding to the smallest of the difference values (Cdi) as the corresponding color value of the color displayed in the sample area, where

i=1~N, i refers to the number of contrast color blocks, N is the number of contrast color blocks.

According to an embodiment of the present invention, wherein the contrast color block corresponding to the smallest of the difference values (Cdi) is selected as the corresponding color value of the color displayed in the sample area, further comprising: converting the color difference values into 0-1 value for selection, where Target=min{Cdi/max(Cdi)}, Target is the selection The selected contrast color block.

Therefore, according to the technical content of this case, the embodiment of this case is to form an additional color comparison area on the test strip, and after uploading the image data of the test strip, by comparing the color comparison area in the image and the pre-stored database Set the difference value between the standard color values, perform color compensation on the contrast color blocks in the database, and determine which contrast color block in the database the color displayed in the sample area belongs to according to the color value after the contrast color block compensation, and determine detection accordingly index. Therefore, the problem of inaccurate judgment results due to distortion of the uploaded color can be solved.

100‧‧‧ Biomedical Testing System

102‧‧‧Image capture device

104‧‧‧ processor

106‧‧‧ Database

108‧‧‧Test paper tray

110‧‧‧ Standard brightness value data

112‧‧‧Server

1081‧‧‧Color comparison area

1082‧‧‧Sample area

1084-1086‧‧‧Contrast color block

201-207‧‧‧Step

Figure 1 is a biomedical testing system with a color correction function according to an embodiment of the present invention; Figure 2 is a schematic diagram of a test strip according to an embodiment of the present invention; and Figure 3 is a test strip according to an embodiment of the present invention Color calibration method.

The following will clearly illustrate the spirit of the case with diagrams and detailed descriptions. Anyone with ordinary knowledge in the technical field who understands the embodiments of the case will be able to change and modify the techniques taught in the case without departing from the case. Spirit and scope.

The terminology in this article is only for describing specific embodiments, and is not intended to be a limitation of this case. Singular forms such as "a", "this", "this", "this" and "the", as used herein, also include plural forms.

As used herein, "coupled" or "connected" can refer to two or more elements or devices making direct physical contact with each other, or indirectly making physical contact with each other, or can refer to two or more elements or devices making mutual contact Operation or action.

The terms "contains", "includes", "has", "contains", etc. used in this article are all open terms, which means including but not limited to.

As used herein, "and/or" includes any or all combinations of the things described.

Regarding the terms used in this article, unless otherwise noted, they usually have the ordinary meaning that each term is used in this field, in the content of this case, and in special content. Certain terms used to describe this case will be discussed below or elsewhere in this specification to provide additional guidance to those skilled in the art in the description of this case.

Referring to FIG. 1, it is a biomedical detection system with a color correction function according to an embodiment of the present invention. The biomedical testing system 100 includes an image capturing device 102, a processor 104, a database 106, and a testing paper tray 108.

The image capture device 102 is equipped with a lens formed by a charge coupled device (CCD), a complementary metal-oxide semiconductor (CMOS) element or other types of photosensitive elements, and can sense the lens entering the lens Light intensity to produce images. In the present embodiment, the image capturing device 102 is, for example, a digital camera, a digital video camera (Digital Video Camcorder, DVC), or is configured on a mobile phone, tablet computer, notebook computer, navigation device, driving schedule Cameras on electronic devices such as video recorders. The test paper tray has the same local area 1082 and a color comparison area 1081. A sample test paper is placed in the sample area and the corresponding color is displayed. The image capturing device 102 is used to photograph the test paper tray 108 and generate an image data. The test strip is, for example, a urine test card.

The processor 104 may be a computer or any arithmetic processor for receiving digital data, such as the image data of the image capturing device 102 as input, and depending on whether it is from a memory (on-die) or off-chip (off-die)) retrieved instructions to process data, and output the results of operations indicated by the instructions. And can execute a software or program to perform operations such as calculation and statistics. In this embodiment, the processor 104 is used to perform related image processing on the image data uploaded by the image capturing device 102. The processor 104 may be a processor of a local computer. Accordingly, the image capturing device 102 is directly electrically connected to the local computer, and the processor 104 of the local computer performs related image processing on the image data. In another implementation, the processor 104 may be a processor of a remote computer, such as a remote server, and accordingly, the image capturing device 102 may be connected to the remote server through a wireless network through a communication device After uploading the image data, the processor 104 of the remote server performs related image processing on the image data. In this embodiment, the processor 104 is a processor of the remote server 112, and the image capturing device 102 establishes a data network with the remote server through Wi-Fi®. The database 106 stores standard brightness value data 110 of the three primary colors of red, green and blue in the color comparison area and a comparison data. The comparison data may be a plurality of contrast color blocks 1084-1086. Among them, the contrast color blocks 1084-1086 are used to compare the color of the sample area 1082 of the test paper tray 108 to determine the index range of the test subject. It is worth noting that only three contrast color blocks 1084- are used in the illustration 1086 is One combination is an illustrative example, but in other embodiments, there may be multiple combinations of contrast color patches for comparison with different detection items. The database 106 is electrically connected to the processor 104, and the processor 104 can read the standard luminance value data 110 of the three primary colors of red, green, and blue in the database 106, and the red and green of the color comparison area 1081 uploaded by the image capturing device 102 And the brightness values of the three primary colors are compared to determine a difference value, where the difference value is the color difference caused by the ambient brightness.

Referring to FIG. 2, it is a schematic diagram of a test paper tray 108 according to an embodiment of the present invention. In this embodiment, the test paper tray 108 includes a color comparison area 1081 and a sample area 1082. The sample area 1082 is used for placing a test paper of the subject who has reacted to the color for testing. It is worth noting that in the second figure, only a single sample area 1082 is shown for single detection, but in other embodiments, multiple samples may be tested simultaneously. According to this, after the image capturing device 102 uploads the image data of the test paper tray 108, the processor 104 judges the index range of each test item by comparing the colors of the contrast color blocks 1084-1086 in the sample area 1082 and the database 106, It is used to find out whether there are related diseases in advance, so as to discover the health status of the subject in time. However, because the image capturing device 102 captures the image data of the test tray 108, the color of the sampled area 1082 will be distorted due to the influence of ambient light. Therefore, in this case, the color detection of the color comparison area 1081 is used. The value is compared with the standard brightness value data 110 in the database 106 to compensate the color of the contrast color blocks 1084-1086 in the database to avoid comparison errors due to color distortion in the sampled area 1082.

Please refer to FIG. 3, which is a color calibration method for detecting test paper according to an embodiment of the present invention. In the color calibration method 200, first in step 201, an image data of the test paper tray 108 is captured and detected. In one embodiment, the image The capturing device 102 captures and detects the test paper tray 108 to generate an image data, and transmits the image data to the remote server 112 for correction processing by the processor 104.

In step 202, an image processing is performed on the image data. In an embodiment, the processor 104 performs an image processing on the color blocks of the color comparison area 1081 of the image data and the color blocks of the sample area 1082 to obtain the color blocks of the color comparison area 1081 and the sample area 1082 color blocks Brightness values of the three primary colors of red, green and blue. Among them, the brightness value of the three colors of red, green, and blue in the color comparison area 1081 color block is (Crn, Cgn, Cbn), where Crn is the brightness value of the red color, Cgn is the brightness value of the green color, and Cbn is the blue color Brightness value. The brightness values of the three colors of red, green and blue in the sample area 1082 color block are (Crs, Cgs, Cbs), where Crs is the brightness value of the red color, Cgs is the brightness value of the green color, and Cbs is the brightness value of the blue color. The brightness values of the three primary colors of red, green, and blue can be represented by numbers as 256 levels from 0, 1, 2, ... to 255.

In step 203, the difference between the color value of the color comparison area 1081 and the standard brightness value data 110 stored in the database 106 is calculated. In one embodiment, the processor 104 calculates the brightness values (Crn, Cgn, Cbn) of the three colors of red, green, and blue of the color comparison area 1081 color block and the red, green, and blue of the standard brightness value data 110 stored in the database 106 The difference between the standard brightness values (Cr0, Cg0, Cb0) of the three primary colors of green and blue (△Cr, △Cg, △Cb), where Cr0 is the standard brightness value of the red color, Cg0 is the standard brightness value of the green color, Cb0 It is the standard brightness value of blue color, △Cr=Cr0-Crn, △Cg=Cg0-Cgn, △Cb=Cb0-Cbn.

In step 204, the color value of the contrast color block stored in the database is compensated according to the difference value. In one embodiment, the contrast color blocks stored in the database 106 by the processor 104 according to the difference values (△Cr, △Cg, △Cb) The brightness values (Cri, Cgi, Cbi) of the three colors of 1084-1086 red, green, and blue are compensated, i-1~N, N is the number of contrasting color blocks. In this embodiment, there are three contrast color blocks 1084-1086, so N=3, and (Cr1, Cg1, Cb1) are the brightness values of the red, green, and blue colors of the contrast color block 1084. (Cr2, Cg2, Cb2) are the brightness values of the red, green and blue colors of the contrast color block 1085. (Cr3, Cg3, Cb3) are the brightness values of the red, green, and blue colors of the contrast color block 1086. Accordingly, the brightness values of the red, green and blue colors of the contrast color block 1084 after compensation are (Cr1+△Cr, Cg1+△Cg, Cb1+△Cb); the brightness values of the red, green and blue colors of the contrast color block 1085 after compensation It is (Cr2+△Cr, Cg2+△Cg, Cb2+△Cb); the brightness values of the red, green and blue colors of the contrast color block 1086 after compensation are (Cr3+△Cr, Cg3+△Cg, Cb3+△Cb).

In step 205, the color difference (Cdi) values of the contrast color block and the sample area are compared. In one embodiment, the processor 104 calculates the compensated brightness values (Cri+△Cr, Cgi+△Cg, Cbi+△Cb) of the three contrast color blocks 1084-1086 red, green, and blue colors, and the sample area 1082 Color difference (Cdi) value among the brightness values (Crs, Cgs, Cbs) of three colors of red, green and blue. Among them, the color comparison formula is:

Among them, i-1~N, N is the number of contrast color blocks. In this embodiment, there are three contrast color blocks 1084-1086, so N=3. (Cr1+△Cr, Cg1+△Cg, Cb1+△Cb) are the compensated brightness values of the red, green and blue colors of the contrast color block 1084; (Cr2+△Cr, Cg2+△Cg, Cb2+△Cb) are the red color of the contrast color block 1085 , Green, and Blue colors after compensation; (Cr3+△Cr, Cg3+△Cg, Cb3+△Cb) is the compensation of the red, green, and blue colors of the contrast color block 1086 After the brightness value. (Crs, Cgs, Cbs) are the brightness values of the three colors of red, green and blue in the sample area 1082. Cd1 is the color difference value between the contrast color block 1084 and the sample area 1082. Cd2 is the color difference value between the contrast color block 1085 and the sample area 1082. Cd3 is the color difference value between the contrast color block 1086 and the sample area 1082.

Next, in step 206, the color difference value conversion is performed, and the color difference value is converted into a numerical value of 0-1 for comparison. In one embodiment, the color difference conversion formula is: Cdi=Cdi/max(Cdi), i=1~3

Finally, in step 207, the color of the sample area is determined, that is, the color difference between the color of the sample area and which contrast color block is the smallest, that is, the one with the smallest Cdi value, the system then determines the contrast color block with the closest color in the sample area. Accordingly, the system can determine the disease index value based on the determined contrast color block. In one embodiment, the decision formula is as follows: Target=min{Cdi/max(Cdi)}, i=1~3. Target is the determined contrast color block.

Based on the above, in this case, by forming an additional color comparison area color on the test paper tray, and after uploading the image data of the test paper tray, the color of the comparison area and the standard color value stored in the database The difference value is used to compensate the contrast color blocks in the database. The color of the sample area is corrected according to the compensated color values of the contrast color blocks, which can be used to determine which contrast color block is closest to and determine the detection index accordingly. According to this, since the contrast color block in this case will perform corresponding color compensation according to the color difference of the image data caused by the shooting environment, and then compare the compensated color value with the color of the sample area in the image data, it can solve the problem caused by the distortion of the uploaded color The problem of inaccurate judgment results.

Although the case is disclosed as above with examples, it is not used to limit the case. Anyone who is familiar with this skill can make various changes and retouching without departing from the spirit and scope of the case, so the scope of protection of the case should be attached The scope defined in the scope of patent application shall prevail.

100‧‧‧ Biomedical Testing System

102‧‧‧Image capture device

104‧‧‧ processor

106‧‧‧ Database

108‧‧‧Test paper tray

110‧‧‧ Standard brightness value data

112‧‧‧Server

1081‧‧‧Color comparison area

1082‧‧‧Sample area

1084-1086‧‧‧Contrast color block

Claims (8)

A biomedical testing system, at least including: a testing paper tray with a local area and a color comparison area, wherein the sample area is used to place a test paper of the test subject and correspondingly display its color; an image capture A device for capturing an image data of the test paper tray; a database storing a pair of standard color values corresponding to the color comparison area and a plurality of contrast color blocks, wherein the contrast color blocks have different color values; and a The processor is coupled to the database for receiving the image data, and compares the standard color value in the database and the color difference value of the color comparison area in the image data, wherein the processor is based on the difference value Compensate the color values of the contrast color blocks in the database, and determine the color values of the colors displayed in the sample area in the image data according to the compensated color values of the contrast color blocks, wherein the standard color values include red and green , The standard brightness values of the three primary colors of blue (Cr0, Cg0, Cb0), where Cr0 is the standard brightness value of the red color, Cg0 is the standard brightness value of the green color, and Cb0 is the standard brightness value of the blue color, in which the processor is based on the data The standard color value in the library and the color value of the color comparison area in the image data determine the difference value, and further includes the processor performing an image processing on the color of the color comparison area in the image data to obtain the The luminance values of the three primary colors of red, green, and blue in the color comparison area (Crn, Cgn, Cbn), where Crn is the luminance value of the red color, Cgn is the luminance value of the green color, and Cbn is the luminance value of the blue color; and the processor The difference between the standard brightness values of the three primary colors of red, green and blue and the brightness values of the three primary colors of red, green and blue of the color comparison area is calculated as the difference value (ΔCr, ΔCg, ΔCb), where, ΔCr=Cr0-Crn, ΔCg=Cg0-Cgn, ΔCb=Cb0-Cbn. The biomedical testing system according to claim 1, wherein the testing test paper is a urine testing test paper. The biomedical detection system according to claim 1, wherein the image capturing device is a camera. The biomedical inspection system according to claim 1, wherein the processor is set in a remote server, and the image capturing device uploads the image through a wireless network connection via a communication device and the remote server data. A biomedical testing method, the method at least includes: arranging at least a sample area and a color comparison area on a testing paper tray, wherein the sample area is used for placing a test paper of a subject and correspondingly displaying a color; Store a pair of standard color values corresponding to the color comparison area, and a plurality of contrast color blocks in a database, where the contrast color blocks have different color values; use an image capture device to capture an image of the test strip Data; send the image data to a processor, wherein the processor determines a difference value according to the standard color value in the database and the color value of the color comparison area in the image data; according to the difference value, the processing The processor compensates the color values of the contrast color blocks in the database; and according to the compensated color values of the contrast color blocks, the processor determines the shadow The color value of the color displayed in the sample area in the image data, where the standard color value includes the standard brightness values of the three primary colors of red, green, and blue (Cr0, Cg0, Cb0), where Cr0 is the standard brightness value of the red color, and Cg0 is green The standard brightness value of the color, Cb0 is the standard brightness value of the blue color, the processor determines the difference value according to the standard color value in the database and the color value of the color comparison area in the image data, further including: Perform an image processing on the colors of the color comparison area in the image data to obtain the luminance values of the three primary colors of red, green, and blue in the color comparison area (Crn, Cgn, Cbn), where Crn is the luminance value of the red color, Cgn Is the brightness value of the green color, and Cbn is the brightness value of the blue color; and the difference between the standard brightness values of the red, green, and blue primary colors and the brightness values of the red, green, and blue primary colors of the color comparison area is calculated as the Difference values (ΔCr, ΔCg, ΔCb), where ΔCr=Cr0-Crn, ΔCg=Cg0-Cgn, ΔCb=Cb0-Cbn. The biomedical detection method according to claim 5, wherein the processor compensates the color values of the contrast color blocks in the database according to the difference value, and further includes: performing an image processing on the contrast color blocks to Obtain the red, green, and blue primary luminance values (Cri, Cgi, Cbi) of each of the contrast color blocks, where i=1~N, N is the number of the contrast color blocks; and the red, The brightness values of the three primary colors of green and blue plus the difference value are used as the compensated color values (Cri+ΔCr, Cgi+ΔCg, Cbi+ΔCb) of the contrast color blocks. The biomedical detection method according to claim 6, wherein the processor determines the color value of the color displayed in the sample area in the image data according to the compensated color values of the contrast color blocks, and further includes: The image area of the sample area is subjected to an image processing to obtain the luminance values of the three primary colors of the sample area (Crs, Cgs, Cbs), where Crs is the luminance value of the red color, Cgs is the luminance value of the green color, and Cbs is The brightness value of the blue color; calculate the color value (Cri+ΔCr, Cgi+ΔCg, Cbi+ΔCb) of the contrast color blocks after compensation and the brightness value of the three colors of the sample area (Crs, Cgs, Cbs) the color difference value (Cdi); and select the contrast color block corresponding to the smallest of the difference values (Cdi) as the corresponding color value of the color displayed in the sample area, where

Among them, i=1~N, N is the number of these contrast color blocks. The biomedical detection method according to claim 7, wherein the contrast color block corresponding to the smallest of the difference values (Cdi) is selected as the corresponding color value of the color displayed in the sample area, and further includes: The difference value is converted into a value of 0-1 for selection, where Target=min{Cdi/max(Cdi)}, and Target is the selected contrast color block.

Images