KR20200111151A - Computer program and terminal providing urine test using colorimetric table - Google Patents

Abstract

An embodiment of the present disclosure discloses a computer program stored on a computer-readable storage medium. The computer program includes commands for a computer to perform the following operations. The operations may include: acquiring a preview image taken with a camera; recognizing a urine test kit in the preview image, the urine test kit including a colorimetric table and a reagent pad strip; acquiring the shape of each of colorimetric table cells included in the colorimetric table; recognizing the number of cells constituting the colorimetric table cells and corresponding to a preset shape; recognizing the position of each colorimetric table cell in the preview image in a case where a preset number or more of the cells correspond to the preset shape; and acquiring the color information of each reagent pad cell included in the reagent pad strip by using the colorimetric table in a case where the position of each colorimetric table cell corresponds to a preset position.

Description

Computer program and terminal that provides urine test using colorimetric table {COMPUTER PROGRAM AND TERMINAL PROVIDING URINE TEST USING COLORIMETRIC TABLE}

The present disclosure relates to a computer program and a terminal stored in a computer-readable storage medium, and more particularly, to a program and a terminal stored in a computer-readable storage medium that provides a urine test using a colorimetric table.

In general, most of the urine test strips used in the urine test are provided with a reagent pad that changes color when the test subject's urine touches. In addition, the urine test is a method of examining the health status of the test subject by comparing the degree of discoloration of the reagent pad with the reference color corresponding to the urine of the test subject. Urine testing conducted in this way requires a specialist or a separate urine test strip analysis device to analyze the urine test strip.

Therefore, it is difficult for the general public to personally test the urine test method using the urine test strip. In addition, in order to personally perform a urine test, a urine test strip analysis device must be provided, but since the price of the urine test strip analysis device is expensive, the general public cannot easily use it.

In order to solve this problem, a technique for analyzing test results by photographing a urine test strip has been developed. In other words, it is a method of colorimetric analysis of a photographed image by photographing a urine test strip and a reference color as an analysis standard together.

However, in this method, since the urine test strip to be photographed and the reference color are separated separately, the test result may be inaccurate due to the influence of surrounding lighting when photographing at the same time.

Accordingly, there may be a demand in the art for a urine test system capable of allowing a general person to easily conduct a urine test individually and to receive test results with higher accuracy.

Republic of Korea Utility Model Publication No. 20-0470398

The present disclosure has been devised in response to the above-described background technology, and an object of the present disclosure is to provide a computer program and a terminal stored in a computer-readable storage medium that provides a urine test using a colorimetric table.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present disclosure for solving the above-described problem, a computer program stored in a computer-readable storage medium is disclosed. The computer program includes instructions for causing a computer to perform the following operations, the operations including: obtaining a preview image photographed with a camera; Recognizing a urine test kit within the preview image, the urine test kit including a colorimetric table and a reagent pad strip; Acquiring a shape of each of a plurality of colorimetric cells included in the colorimetric table; Recognizing the number of cells corresponding to a preset shape among the plurality of colorimetric cells; Recognizing a location of each of the plurality of colorimetric cells in the preview image when the number of cells corresponding to the preset shape is greater than or equal to the preset number; And obtaining color information of each of the plurality of reagent pad cells included in the reagent pad strip by using the colorimetric table when the positions of each of the plurality of colorimetric cells correspond to a preset position. have.

In addition, the operations may include generating a checkup result corresponding to the color information by using health analysis data mapped to each of a plurality of colors pre-stored in a memory; And displaying the examination result.

Further, the operations may include transmitting the color information to an external server; Receiving information on a checkup result corresponding to the color information from the external server; And displaying information on the examination result.

In addition, the operation of acquiring a shape of each of the plurality of colorimetric cells included in the colorimetric table may include: recognizing an outline of each of the plurality of colorimetric cells; And acquiring a shape of each of the plurality of colorimetric cells based on an outline of each of the plurality of colorimetric cells.

In addition, the operation of recognizing the number of cells corresponding to a preset shape among the plurality of colorimetric cells may include recognizing a first horizontal length and a first vertical length of each of the plurality of colorimetric cells; Recognizing a second horizontal length and a second vertical length of the urine test kit included in the preview image; And recognizing the number of cells matching the preset shape using the first horizontal length, the second horizontal length, the first vertical length, and the second vertical length.

In addition, in the cell matching the preset shape, a ratio value between the first horizontal length and the first vertical length corresponds to a first ratio value stored in advance in a memory, and the first horizontal length is the second horizontal length It may be a cell corresponding to a value obtained by multiplying and a second ratio value previously stored in the memory.

In addition, for cells matching the preset shape, a ratio value between the first horizontal length and the first vertical length corresponds to a first ratio value stored in advance in a memory, and the first vertical length is the second vertical length It may be a cell corresponding to a value obtained by multiplying and a third ratio value previously stored in the memory.

In addition, in the cell matching the preset shape, a ratio value between the first horizontal length and the first vertical length corresponds to a first ratio value stored in advance in a memory, and the first horizontal length is the second horizontal length And a second ratio value pre-stored in the memory, and the first vertical length may correspond to a value obtained by multiplying the second vertical length and a third ratio value pre-stored in the memory.

In addition, the operation of recognizing the position of each of the plurality of colorimetric cells in the preview image may include: recognizing each of a first reference cell and a second reference cell among the plurality of colorimetric cells; And the plurality of colorimetric cells in the preview image based on the location of the first reference cell in the preview image, the location of the second reference cell in the preview image, and location information of colorimetric cells previously stored in the memory. Recognizing the location of each of the table cells; may include.

In addition, the operation of obtaining color information of each of the plurality of reagent pad cells included in the reagent pad strip using the colorimetric table may include recognizing the position of the reagent pad strip based on colorimetric information previously stored in a memory. action; And recognizing color information of each of the plurality of reagent pad cells when a preset second condition is satisfied.

In addition, the preset second condition is a first virtual line connecting a first colorimetric cell included in the colorimetric table and a second colorimetric cell located below the first colorimetric cell and the reagent pad strip. A second virtual line connecting the included first reagent pad cell and the second reagent pad cell is parallel and connects the first colorimetric cell and a third colorimetric cell located at the side of the first colorimetric cell. It may be satisfied if the first reagent pad cell is positioned on the third virtual line.

In addition, the operation of acquiring color information of each of the plurality of reagent pad cells included in the reagent pad strip by using the colorimetric table may include colorimetric analysis of each color of the plurality of reagent pad cells with the plurality of colorimetric cells. And acquiring the color information of each of the plurality of reagent pad cells.

In addition, the operation of obtaining the color information of each of the plurality of reagent pad cells by performing colorimetric analysis of the color information of each of the plurality of reagent pad cells with the plurality of colorimetric cells may include generating a colorimetric analysis model; And acquiring the color information of each of the plurality of reagent pad cells by calculating the color of each of the plurality of colorimetric cells and the plurality of reagent pad cells using the colorimetric analysis model.

In addition, the operation of generating the colorimetric analysis model includes learning by labeling the learning color data of the plurality of colorimetric cells corresponding to the input of the training data and the learning steady state color data of the plurality of colorimetric cells pre-stored in a memory. Generating data; And generating the colorimetric analysis model by learning the colorimetric analysis model including one or more network functions using a training data set including the training data.

In addition, the operation of generating the colorimetric analysis model by learning the colorimetric analysis model including one or more network functions by using the training data set including the training data includes the learning color data of at least one colorimetric analysis model. Inputting into an input node included in an input layer of a network function; Comparing the learning color data with the labeled learning steady state color data and the output of the colorimetric analysis model to derive an error; And a weight set in a link connecting each of the input node, the output layer, and the one or more hidden layers by propagating the error from the output layer of one or more network functions of the colorimetric analysis model to the input layer through one or more hidden layers. It may include an operation of updating.

In addition, the operation of acquiring the color information of each of the plurality of reagent pad cells by calculating the color of each of the plurality of colorimetric cells and the plurality of reagent pad cells using the colorimetric analysis model may include a plurality of color models. Generating a plurality of different color decision trees by combining at least two of the color models; And acquiring a plurality of color information corresponding to each of the plurality of reagent pad cells by using each of the plurality of color determination trees.

According to an embodiment of the present disclosure for solving the above-described problems, a terminal is disclosed that provides a urine test using a colorimetric table. The terminal includes: a camera unit for obtaining a preview image; And a controller that acquires color information of each of a plurality of reagent pad cells included in the reagent pad strip, based on the preview image.

In addition, the controller recognizes a urine test kit-the urine test kit includes a colorimetric table and a reagent pad strip-in the preview image, and obtains the shape of each of the plurality of colorimetric cells included in the colorimetric table. And, if the number of cells corresponding to a preset shape is recognized among the plurality of colorimetric cells, and the number of cells corresponding to the preset shape is greater than or equal to the preset number, the plurality of colorimetric cells in the preview image When each position is recognized and the position of each of the plurality of colorimetric cells corresponds to a preset position, color information of each of the plurality of reagent pad cells included in the reagent pad strip may be obtained using the colorimetric table. I can.

Technical solutions obtainable in the present disclosure are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the technical field to which the present disclosure belongs from the following description. It will be understandable.

The present disclosure may provide a program and a terminal stored in a computer-readable storage medium that provides a urine test using a colorimetric table.

The effects obtainable in the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those of ordinary skill in the art from the following description. .

Various aspects are now described with reference to the drawings, wherein like reference numbers are used collectively to refer to like elements. In the examples that follow, for illustrative purposes, a number of specific details are presented to provide a holistic understanding of one or more aspects. However, it will be apparent that such aspect(s) may be practiced without these specific details.
1 is a block diagram of a terminal providing a urine test using a colorimetric table according to some embodiments of the present disclosure.
2 is a flowchart illustrating an example of a method for a terminal to provide a urine test using a colorimetric table according to some embodiments of the present disclosure.
3 is a plan view of a urine test kit according to some embodiments of the present disclosure.
4 is a flowchart illustrating an example of a method of obtaining, by a terminal, shapes of cells having a shape of each of a plurality of colorimetric cells included in a colorimetric table, according to some embodiments of the present disclosure.
5 is a flowchart illustrating an example of a method of recognizing a location of each of a plurality of colorimetric cells in a preview image by a terminal according to some embodiments of the present disclosure.
6 is a flowchart illustrating an example of a method of obtaining color information of each of a plurality of reagent pad cells included in a reagent pad strip by a terminal using a colorimetric table according to some embodiments of the present disclosure.
7 is a flowchart illustrating another example of a method of acquiring color information of each of a plurality of reagent pad cells included in a reagent pad strip by a terminal using a colorimetric table according to some embodiments of the present disclosure.
8 is a diagram illustrating a color determination tree used when a terminal generates colorimetric analysis data according to some embodiments of the present disclosure.
9 is a schematic diagram illustrating a network function according to some embodiments of the present disclosure.
10 is a diagram for describing a method of generating a colorimetric analysis model according to some embodiments of the present disclosure.
11 is a perspective view of a urine test kit according to some embodiments of the present disclosure.
12 is a diagram for describing an example of an interface displayed on a terminal according to some embodiments of the present disclosure.
13 is a diagram illustrating another example of an interface displayed in a terminal according to some embodiments of the present disclosure.

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for illustrative purposes, a number of specific details are disclosed to aid in an overall understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that this aspect(s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in the principles of the various aspects may be used, and the descriptions described are intended to include all such aspects and their equivalents. Specifically, as used herein, "an embodiment", "example", "aspect", "example" and the like are not construed as having any aspect or design being better or advantageous than other aspects or designs. May not.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. In addition, in describing the embodiments disclosed in the present specification, when it is determined that detailed descriptions of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, detailed descriptions thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the present specification is not limited by the accompanying drawings.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements.

Although the first, second, etc. are used to describe various devices or components, it is a matter of course that these devices or components are not limited by these terms. These terms are only used to distinguish one device or component from another device or component. Therefore, it goes without saying that the first device or component mentioned below may be a second device or component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise or is not clear from the context, "X employs A or B" is intended to mean one of the natural inclusive substitutions. That is, X uses A; X uses B; Or, when X uses both A and B, “X uses A or B” can be applied to either of these cases. In addition, the term "and/or" as used herein should be understood to refer to and include all possible combinations of one or more of the listed related items.

In addition, the terms “information” and “data” as used herein may often be used interchangeably with each other.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. In addition, in describing the embodiments disclosed in the present specification, when it is determined that detailed descriptions of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, detailed descriptions thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the present specification is not limited by the accompanying drawings.

Although the first, second, etc. are used to describe various devices or components, it is a matter of course that these devices or components are not limited by these terms. These terms are only used to distinguish one device or component from another device or component. Therefore, it goes without saying that the first device or component mentioned below may be a second device or component within the spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which this disclosure belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it is directly connected to or may be connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

The suffixes "module" and "unit" for constituent elements used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have a distinct meaning or role by themselves.

When an element or layer is referred to as “on” or “on” of another element or layer, it is not only above the other element or layer, but also the other layer or other element in the middle. Includes all intervening cases. On the other hand, when a component is referred to as "directly on" or "directly on", it means that no other component or layer is interposed therebetween.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc., as shown in the figure It can be used to easily describe a component or a correlation with other components. Spatially relative terms should be understood as terms including different directions of the device during use or operation in addition to the directions shown in the drawings.

For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to the orientation.

Objects and effects of the present disclosure, and technical configurations for achieving them will become apparent with reference to embodiments described in detail later with reference to the accompanying drawings. In describing the present disclosure, when it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present disclosure and may vary according to the intention or custom of users or operators.

However, the present disclosure is not limited to the embodiments disclosed below, and may be implemented in various different forms. The present embodiments are provided only to make the present disclosure complete, and to completely inform the scope of the disclosure to those of ordinary skill in the art to which the present disclosure belongs, and the present disclosure is only defined by the scope of the claims. . Therefore, the definition should be made based on the contents throughout this specification.

1 is a block diagram of a terminal providing a urine test using a colorimetric table according to some embodiments of the present disclosure.

According to some embodiments of the present disclosure, the terminal 100 may include a camera unit 110, a display unit 120, a communication unit 130, a memory 140, and a control unit 150. However, since the above-described components are not essential for implementing the terminal 100, the terminal 100 may have more or fewer components than the components listed above. Here, each component may be composed of a separate chip, module or device, or may be included in a single device.

The terminal 100 according to some embodiments of the present disclosure may include a personal computer (PC), a notebook (note book), a mobile terminal, a smart phone, a tablet PC, and the like. In addition, all types of terminals equipped with a camera unit 110 capable of capturing an image may be included.

The terminal 100 may include one or a plurality of camera units 110 to input image information. The camera unit 110 processes an image frame such as a still image or a moving image obtained by an image sensor in the photographing mode. The processed image frame may be displayed on the display 120 or stored in the memory 140.

On the other hand, a plurality of camera units 110 provided in the terminal 100 may be arranged to form a matrix structure, and through the camera unit 110 constituting a matrix structure, various angles or focuses are provided to the terminal 100. A plurality of image information may be input. In addition, the plurality of camera units 110 may be arranged in a stereo structure so as to acquire a left image and a right image for implementing a stereoscopic image.

According to some embodiments of the present disclosure, the camera unit 110 may acquire a preview image for examination of a urine test. Specifically, the camera unit 110 may acquire a preview image including a colorimetric table and a urine test kit including a reagent pad strip.

A detailed description of the above-described camera unit 110 obtaining a preview image for examination of a urine test will be described in detail with reference to FIG. 12 below.

The controller 150 may be implemented to control the overall operation of the terminal 100. Also, the controller 150 may perform various operations and process data performed by the terminal 100. The controller 150 may drive an operating system (OS), an application, and a database manager for driving the terminal 100.

The control unit 150 includes a central processing unit (CPU), a co-processor, an arithmetic processing unit (APU), a graphic processing unit (GPU), and a digital signal processor ( It may be a Digital Signal Processor (DSP), an Application Processor (AP), and a Communication Processor (CP).

According to some embodiments of the present disclosure, the controller 150 may acquire the shape of each of a plurality of colorimetric cells included in a colorimetric table in a preview image. In addition, the control unit 150 may recognize the number of cells corresponding to a preset shape among the plurality of colorimetric cells. In addition, when the number of cells corresponding to the preset shape is greater than or equal to the preset number, the controller 150 may recognize the positions of each of the plurality of colorimetric cells in the preview image. In addition, when the positions of each of the plurality of colorimetric cells correspond to a preset position, the control unit 150 may obtain color information of each of the plurality of reagent pad cells included in the reagent pad strip by using the colorimetric table. .

According to some embodiments of the present disclosure, the control unit 150 may apply color information of each of a plurality of reagent pad cells included in the reagent pad strip obtained by the control unit 150 and a plurality of colors pre-stored in the memory 140. Using the mapped health analysis data, a checkup result corresponding to the color information may be generated. In this case, the display unit 120 may display information on the examination result.

The display unit 120 displays (outputs) information processed by the terminal 100. For example, the display 120 may display execution screen information of an application program driven in the terminal 100, or information on a user interface (UI) or a graphical user interface (GUI) according to the execution screen information.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display), a 3D display, and an e-ink display.

According to some embodiments of the present disclosure, the controller 150 may control the display 120 to display a result of a urine test generated by recognizing the color of the reagent pad strip. However, the present invention is not limited thereto, and the examination result may be information received by the controller 150 of the terminal 100 from an external server through the communication unit 130. Here, the examination result may mean information corresponding to each of a plurality of examination items that can be confirmed through a urine test.

Specifically, the control unit 150 may control the display unit 120 to display a list including examination results corresponding to a plurality of items.

A detailed description of how the above-described display unit 120 displays the examination result will be described in detail with reference to FIG. 13 below.

The communication unit 130 may include one or more modules that enable wireless communication between the terminal 100 and a wireless communication system, between the terminal 100 and another terminal 100, or between the terminal 100 and an external server. have. In addition, the communication unit 130 may include one or more modules that connect the terminal 100 to one or more networks.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet access A module for transmitting and receiving data according to at least one wireless Internet technology in a range including Internet technologies not listed above.

According to some embodiments of the present disclosure, the communication unit 130 may transmit color information of each of the plurality of reagent pad cells included in the reagent pad strip obtained by the controller 150 to an external server. In addition, the communication unit 130 may receive information on a checkup result corresponding to the color information from an external server. In this case, the display unit 120 may display information on the examination result.

The memory 140 stores data supporting various functions of the terminal 100. The memory 140 may store a number of application programs (application programs or applications) driven by the terminal 100, data for operation of the terminal 100, and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the terminal 100 from the time of shipment for basic functions of the terminal 100. Meanwhile, the application program may be stored in the memory 140, installed on the terminal 100, and driven by the control unit 150 to perform an operation (or function) of the terminal 100.

The memory 170 is a flash memory type, a hard disk type, a solid state disk type, an SDD type, a multimedia card micro type. ), card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The mobile terminal 100 may be operated in connection with a web storage that performs a storage function of the memory 170 over the Internet.

According to some embodiments of the present disclosure, the memory 140 may store health analysis data mapped to each of a plurality of colors that may appear on the reagent pad. Here, the health analysis data may include information on a health state corresponding to each of a plurality of colors that may appear on the reagent pad. For example, when the control unit 150 recognizes color information of a reagent pad using an RGB (Red, Green, Blue) model among color models, the controller 150 recognizes a color corresponding to each value of the R value, G value, and B value. In addition, health analysis data mapped to the color may be recognized.

In addition to the operation related to the application program, the control unit 150 generally controls the overall operation of the terminal 100. The controller 150 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 140.

In addition, the controller 150 may control at least some of the components discussed with reference to FIG. 1 in order to drive the application program stored in the memory 140. Further, the controller 150 may operate by combining at least two or more of the components included in the terminal 100 to drive the application program.

2 is a flowchart illustrating an example of a method for a terminal to provide a urine test using a colorimetric table according to some embodiments of the present disclosure. 3 is a plan view of a urine test kit according to some embodiments of the present disclosure. 4 is a flowchart illustrating an example of a method of obtaining, by a terminal, shapes of cells having a shape of each of a plurality of colorimetric cells included in a colorimetric table, according to some embodiments of the present disclosure. 5 is a flowchart illustrating an example of a method of recognizing a location of each of a plurality of colorimetric cells in a preview image by a terminal according to some embodiments of the present disclosure. 6 is a flowchart illustrating an example of a method of obtaining color information of each of a plurality of reagent pad cells included in a reagent pad strip by a terminal using a colorimetric table according to some embodiments of the present disclosure. 7 is a flowchart illustrating another example of a method of acquiring color information of each of a plurality of reagent pad cells included in a reagent pad strip by a terminal using a colorimetric table according to some embodiments of the present disclosure. 8 is a diagram illustrating a color determination tree used when a terminal generates colorimetric analysis data according to some embodiments of the present disclosure.

According to some embodiments of the present disclosure, the controller 150 of the terminal 100 may obtain a preview image captured from the camera unit 110 (S100).

Specifically, the controller 150 may acquire a preview image captured from the camera unit 110 based on the preview image capturing command. Here, the photographing command may be received through the preview image photographing interface.

For example, when receiving a selection input for an indicator related to a start of shooting included in the preview image shooting interface, the controller 150 may recognize that a shooting command has been received.

In addition, the controller 150 may recognize the urine test kit in the preview image (S200).

For example, the controller 150 may recognize an outline of an object in the captured preview image. In addition, the controller 150 may recognize whether the outline of the object is a shape previously stored in the memory 140. When the controller 150 recognizes that the outline of the object corresponds to a shape previously stored in the memory 140, the controller 150 may recognize the object included in the captured preview image as a urine test kit.

As another example, the controller 150 may recognize an outline of an object in the captured preview image. In addition, the controller 150 may recognize whether the shape and size of the object correspond to the shape and size previously stored in the memory 140. When the controller 150 recognizes that the outline of the object corresponds to the shape and size previously stored in the memory 140, the controller 150 may recognize the object included in the captured preview image as a urine test kit.

When recognizing the urine test kit in the preview image, the controller 150 may acquire the shape of each of the plurality of colorimetric cells included in the colorimetric table (S300).

For example, the controller 150 may recognize the outline of each of the plurality of colorimetric cells. In addition, the controller 150 may obtain a shape of each of the plurality of colorimetric cells based on the outlines of each of the plurality of colorimetric cells.

According to some embodiments of the present disclosure, the control unit 150 of the terminal 100 may recognize the number of cells corresponding to a preset shape among a plurality of colorimetric cells (S400). A method of recognizing the number of cells corresponding to a preset shape will be described below with reference to FIGS. 3 and 4.

Referring to FIG. 4, the controller 150 of the terminal 100 may recognize a first horizontal length W1 and a first vertical length H1 of each of a plurality of colorimetric cells (S410). In addition, the controller 150 may recognize the second horizontal length W2 and the second vertical length H2 of the urine test kit included in the preview image (S420).

Referring to FIG. 3, a first horizontal length W1 is the horizontal length of each colorimetric cell in the preview image. Further, the first vertical length H1 is the vertical length of each colorimetric cell in the preview image. Meanwhile, the second horizontal length W2 is the horizontal length of the colorimetric table 220 in the preview image. Further, the second vertical length H2 is the vertical length of the colorimetric table 220 in the preview image.

Referring back to FIG. 4, the controller 150 uses a first horizontal length W1, a second horizontal length W2, a first vertical length H1, and a second vertical length H2 to determine a preset shape. The number of cells that match with may be recognized (S430).

Specifically, at least one of a first ratio value, a second ratio value, and a third ratio value may be stored in the memory 140. In addition, the control unit 150 may recognize the number of cells matching a preset shape by using at least one of a first ratio value, a second ratio value, and a third ratio value. Here, the first ratio value may be a value related to a ratio between the first horizontal length W1 and the first vertical length H1, and the second ratio value is the first horizontal length W1 and the second horizontal length ( W2) may be a value related to the ratio between, and the third ratio value may be a value related to the ratio between the first vertical length H1 and the second vertical length H2.

According to some embodiments, the controller 150 may recognize whether the shape of each of the plurality of cells matches a preset shape by using the first ratio value, the first horizontal length, and the first vertical length.

For example, when the controller 150 recognizes that the first ratio value pre-stored in the memory 140 is 1, the first horizontal length W1 is 0.5 mm, and the first vertical length H1 is 0.5 mm , It can be recognized that the shape of the colorimetric table cell matches the preset shape.

More specifically, when it is recognized that the value obtained by multiplying the first ratio value of 1 by the first horizontal length W1 of 0.5 corresponds to the first vertical length H1 of 0.5, the colorimetric table cell It can be recognized that the shape matches the preset shape.

According to some other embodiments, the control unit 150 includes a ratio value between the first horizontal length W1 and the first vertical length H1 corresponding to a first ratio value stored in advance in the memory 140, and the second horizontal length When a value obtained by multiplying the length W2 by the second ratio value stored in advance in the memory 140 corresponds to the first horizontal length W1, it may be recognized that the shape of the colorimetric cell matches a preset shape.

For example, the control unit 150 recognizes that the first ratio value pre-stored in the memory 140 is 1, the first horizontal length W1 is 0.5mm, and the first vertical length H1 is 0.5mm, When it is recognized that the second ratio value is 0.01 and the second horizontal length W2 is 50 mm, it may be recognized that the shape of the colorimetric cell matches a preset shape.

In more detail, the controller 150 multiplies the first ratio value of 1 by the first horizontal length W1 of 0.5 corresponds to the first vertical length H1 of 0.5, and the second ratio value of 0.01 2 When it is recognized that a value multiplied by 50, which is the horizontal length W2, corresponds to 0.5, which is the first horizontal length W1, the shape of the colorimetric cell may be recognized as matching a preset shape.

According to still another exemplary embodiment, the controller 150 includes a ratio value between the first horizontal length W1 and the first vertical length H1 corresponding to a first ratio value previously stored in the memory 140, and the second When a value obtained by multiplying the vertical length H2 by a preset third ratio value corresponds to the first vertical length H1, it may be recognized that the shape of the colorimetric cell matches the preset shape.

For example, the control unit 150 recognizes that the first ratio value pre-stored in the memory 140 is 1, the first horizontal length W1 is 0.5mm, and the first vertical length H1 is 0.5mm, When it is recognized that the third ratio value is 0.01 and the second vertical length H2 is 50 mm, it may be recognized that the shape of the colorimetric cell matches the preset shape.

More specifically, the control unit 150 multiplies the first ratio value of 1 by the first horizontal length W1 of 0.5 corresponds to the first vertical length H1 of 0.5, and the third ratio value of 0.01 2 When it is recognized that the multiplication of the vertical length H2 by 50 corresponds to the first vertical length H1 of 0.5, the shape of the colorimetric cell may be recognized as matching a preset shape.

According to still another embodiment, the controller 150 includes a ratio value between the first horizontal length W1 and the first vertical length H1 corresponding to a first ratio value previously stored in the memory 140, and the second The value obtained by multiplying the horizontal length W2 by the second ratio value pre-stored in the memory 140 corresponds to the first horizontal length W1, and the second vertical length H2 multiplied by a preset third ratio value In the case of corresponding to the first vertical length H1, it may be recognized that the shape of the colorimetric table cell matches a preset shape.

For example, the control unit 150 recognizes that the first ratio value pre-stored in the memory 140 is 1, the first horizontal length W1 is 0.5mm, and the first vertical length H1 is 0.5mm, If the second ratio value is 0.01, the second horizontal length (W2) is recognized as 50mm, the third ratio value is 0.01, and the second vertical length (H2) is recognized as 50mm, the shape of the colorimetric cell is It can be recognized as matching the set shape.

In more detail, the controller 150 multiplies the first ratio value of 1 by the first horizontal length W1 of 0.5 corresponds to the first vertical length H1 of 0.5, and the second ratio value of 0.01 2 The value obtained by multiplying the horizontal length (W2) by 50 corresponds to the first horizontal length (W1) of 0.5, and the third ratio value of 0.01 multiplied by the second vertical length (H2) of 50 is the first vertical length (H1) If it is recognized that it corresponds to 0.5 of ), the shape of the colorimetric table cell can be recognized as matching the preset shape.

According to some embodiments of the present disclosure, when the number of cells corresponding to a preset shape is not more than a preset number (eg, 40) (S500, No), the controller 150 of the terminal 100 The camera unit 110 may be controlled to recapture the preview image. In this case, the control unit 150 may control the display unit 120 to display the guide text.

According to some other embodiments of the present disclosure, when the number of cells corresponding to a preset shape is not more than a value obtained by multiplying the number of all cells by a preset ratio value, the controller 150 of the terminal 100 displays a preview image. The camera unit 110 can be controlled to take a picture again.

For example, when the preset ratio value is 0.8 and the number of all cells is 55, the control unit 150 previews if it is not more than 44, which is a value obtained by multiplying the number of all cells by 55, which is a preset ratio, The camera unit 110 may be controlled to take an image again. That is, when the total number of cells is 55 and the number of cells corresponding to a preset shape is less than 44, the controller 150 may control the camera unit 110 to take a preview image again.

As described above, the controller 150 compares the number of cells corresponding to the preset shape with the preset number, and determines whether the camera unit 110 properly photographs the urine test kit included in the preview image. I can. Specifically, the control unit 150 compares the number of cells corresponding to the preset shape with the preset number, and displays a preview image so that the camera unit 110 can recognize a plurality of cells of the urine test kit included in the preview image. You can determine whether or not you have taken a picture.

Accordingly, the user can perform a urine test simply by photographing the urine test kit with a camera.

Meanwhile, referring again to FIG. 2, when the number of cells corresponding to a preset shape is greater than or equal to the preset number (S500, Yes), the control unit 150 of the terminal 100 may select a plurality of colorimetric cells in the preview image. Each location can be recognized (S600). A method of recognizing the positions of each of the plurality of colorimetric cells in the preview image will be described below with reference to FIGS. 3 and 5.

First, referring to FIG. 5, the control unit 150 of the terminal 100 may recognize each of the first reference cell 201 and the second reference cell 202 among a plurality of colorimetric cells (S610). Here, the first reference cell 201 and the second reference cell 202 may be cells positioned at a specific position among a plurality of colorimetric cells, or may be any cell among a plurality of colorimetric cells.

Based on the location of the first reference cell 201 in the preview image, the location of the second reference cell 202 in the preview image, and location information of colorimetric cells previously stored in the memory 140, The position of each of the plurality of colorimetric cells in the preview image may be recognized (S620). Here, the location information of the colorimetric cells may mean information corresponding to the reference cell and capable of recognizing the location of each of the plurality of cells. For example, the location information of colorimetric cells may include location information of cells located at the top, bottom, right, and left of the reference cell.

As an example, referring to FIG. 3, the control unit 150 may recognize a first reference cell 201 located at the rightmost of the top and a second reference cell 202 located at the leftmost of the bottom of a plurality of colorimetric cells. I can. In this case, the controller 150 may recognize the location of each of the plurality of cells located below or to the right of the first reference cell 201 based on the first reference cell 201. In addition, the controller 150 may recognize the location of each of the plurality of cells positioned above or to the left of the second reference cell 202 based on the second reference cell 202.

As another example, the control unit 150 selects at least two cells that can be compared with position information of the colorimetric cells pre-stored in the memory 140 among the plurality of colorimetric cells, the first reference cell 201 and the second reference cell 202. ) Can be determined. In addition, the control unit 150 uses the location information of the first and second reference cells 201 and 202 and the colorimetric cells pre-stored in the memory 140 to determine the first reference cell 201 and the second reference cell. The positions of all colorimetric cells including the reference cell 202 can be recognized.

Referring back to FIG. 2, the controller 150 of the terminal 100 may recognize whether the positions of each of the plurality of colorimetric cells correspond to a preset position (S700).

When the positions of each of the plurality of colorimetric cells do not correspond to a preset position (S700, No), the controller 150 may control the camera unit 110 to recapture the preview image. In this case, the control unit 150 may control the display unit 120 to display the guide text so that the positions of each of the plurality of colorimetric cells come to a preset position.

According to some embodiments of the present disclosure, when the position of each of the plurality of colorimetric cells corresponds to a preset position (S700, Yes), the control unit 150 of the terminal 100 uses the colorimetric table to apply the reagent pad strip. Color information of each of the included reagent pad cells may be obtained (S800). A method of acquiring color information of each of the plurality of reagent pad cells included in the reagent pad strip using the colorimetric table will be described below with reference to FIGS. 3 and 6.

Referring to FIG. 6, the controller 150 of the terminal 100 may recognize the position of the reagent pad strip based on colorimetric table information previously stored in the memory 140 (S810a). Here, the colorimetric table information stored in advance in the memory 140 may include information on the position of the reagent pad strip coupled to the colorimetric table. Accordingly, the controller 150 may recognize the position of the reagent pad strip coupled to the colorimetric table by using colorimetric information previously stored in the memory 140.

The controller 150 may recognize whether the second condition is satisfied. Here, the second condition may be a condition for checking whether the position of the reagent pad strip coupled to the colorimetric table exists at a preset position.

According to some embodiments of the present disclosure, the second condition includes a first colorimetric table cell 221 included in a colorimetric table and a second colorimetric table cell 222 positioned below the first colorimetric table cell 221. The connected first virtual line 231 and the second virtual line 232 connecting the first reagent pad cell 211 and the second reagent pad cell 212 included in the reagent pad strip 210 are parallel, , The first reagent pad on a third virtual line 233 connecting the first colorimetric cell 221 and the third colorimetric cell 223 positioned at the side of the first colorimetric cell 221 If the cell is located, it may be a condition that is satisfied. However, it is not limited thereto.

If the second condition is not satisfied, the controller 150 may control the camera unit 110 to take a preview image again. In this case, the control unit 150 may control the display unit 120 to display a guide text so that the positions of each of the plurality of reagent pad cells come to a preset position.

Meanwhile, when the second condition is satisfied, the controller 150 may recognize color information of each of the plurality of reagent pad cells (S820a).

According to some other embodiments of the present disclosure, when the positions of each of the plurality of colorimetric cells correspond to a preset position (S700, Yes), the control unit 150 of the terminal 100 uses the colorimetric table to Color information of each of the plurality of reagent pad cells included in the strip may be obtained (S800).

As an example, the controller 150 may colorimetrically analyze the color of each of the plurality of reagent pad cells with the plurality of colorimetric cells to obtain color information of each of the plurality of reagent pad cells. In this case, since color information of each of the plurality of reagent pad cells is obtained through colorimetric analysis with the colorimetric cells, a more accurate reagent regardless of the brightness of the environment in which the urine test kit is photographed or the camera state of the terminal 100, etc. Color information of each of the pad cells may be obtained.

Meanwhile, the controller 150 may generate a plurality of colorimetric analysis models when acquiring color information of each of the plurality of reagent pad cells, and obtain color information of each of the plurality of reagent pad cells by using the colorimetric analysis model. . This will be described below with reference to FIGS. 3, 7 and 8.

Referring to FIG. 7, the control unit 150 may generate a colorimetric analysis model including a plurality of different color determination trees generated by combining at least two or more color models among a plurality of color models (S810b).

Specifically, the controller 150 may generate a plurality of different color determination trees by combining at least two or more color models among the plurality of color models. In addition, the controller 150 may generate a colorimetric analysis model including a plurality of different color determination trees. Here, the plurality of color models are RGB (Red, Green, Blue) model, CMYK (Cyan, Magenta, Yellow, Black) model, HSV (Hue, Saturation, Value) model, HSL (Hue, Saturation, Lightness) model, It may be a Hue, Saturation, Intensity (HSI) model and a Hue, Saturation, Brightness (HSB) model.

More specifically, referring to FIG. 8, the control unit 150 combines at least two or more color models among a plurality of color models, and provides a first color determination tree 10a, a second color determination tree 10b, and a second color determination tree 10b. Each of the 3 color determination tree 10c and the fourth color determination tree 10d may be generated.

For example, the controller 150 may generate the first color determination tree 10a using an RGB model, a CMYK model, and an HSV model. The controller 150 may generate the second color determination tree 10b using the CMYK model, the HSV model, and the HSL model. The controller 150 may generate a third color determination tree 10c using the HSV model, the HSL model, and the HSI model. The controller 150 may generate a fourth color determination tree 10d using the HSL model, the HSI model, and the HSB model.

According to some embodiments of the present disclosure, the controller 150 is based on the color information of each of the plurality of colorimetric cells recognized through the colorimetric analysis model and the color of each of the plurality of colorimetric cells pre-stored in the memory 140. Thus, correction information can be generated. Specifically, the controller 150 may generate correction information including a difference value between a normal color of a specific cell stored in the memory 140 and a color recognized through a plurality of color determination trees through a colorimetric analysis model. .

Referring back to FIG. 7, the control unit 150 calculates color information of each of the plurality of colorimetric cells and color information of each of the plurality of reagent pad cells using a colorimetric analysis model, so that the color information of each of the plurality of reagent pad cells Can be obtained (S820b).

According to some embodiments, the controller 150 may obtain a plurality of predicted colors of each of a plurality of reagent pad cells through each of a plurality of different color determination trees. In addition, the control unit 150 may recognize a color most often output as the same color among the plurality of predicted colors of each of the plurality of reagent pad cells as the color of each of the plurality of reagent pad cells.

Specifically, referring to FIG. 8, the controller 150 may obtain a first predicted color 11 of a specific cell among a plurality of reagent pad cells through the first color determination tree 10a. Also, the controller 150 may obtain the second predicted color 12 of the specific cell through the second color determination tree 10b. Also, the controller 150 may obtain the third predicted color 13 of the specific cell through the third color determination tree 10c. Also, the control unit 150 may obtain the fourth predicted color 14 of the specific cell through the fourth color determination tree 10d. In addition, the control unit 150 may recognize the predicted color most output with the same color among the plurality of predicted colors 11, 12, 13, and 14 obtained through each of the plurality of color determination trees as the color of a specific cell. .

For example, the first prediction color 11 of a specific cell is yellow, the second prediction color 12 of a specific cell is yellow, the third prediction color 13 of a specific cell is orange, and 4 When the predicted color 14 is yellow, the control unit 150 may recognize yellow, which is most often output with the same color, as the color of a specific cell through the colorimetric analysis model. Accordingly, the controller 150 can more accurately recognize the color of a specific cell.

According to some other embodiments, the controller 150 may acquire color information of each of the plurality of reagent pad cells by using a plurality of predicted colors and correction information of each of the plurality of reagent pad cells.

Specifically, the control unit 150 may recognize a plurality of predicted colors for any one of the plurality of reagent pad cells using each of the plurality of color determination trees. In addition, the controller 150 may acquire color information of each of the plurality of reagent pad cells by adding or subtracting a difference value included in the correction information to the color most often output as the same color among the plurality of predicted colors.

Accordingly, the control unit 150 may obtain more accurate color information of each of the reagent pad cells, regardless of the brightness of the environment in which the urine test kit is photographed or the camera state of the terminal 100.

In this case, the controller 150 may generate a checkup result corresponding to color information of each of the obtained plurality of reagent pad cells by using health analysis data mapped to each of the plurality of colors pre-stored in the memory 140. have. In addition, the control unit 150 may control the display unit 120 to display the generated examination result.

However, the present invention is not limited thereto, and the controller 150 may control the communication unit 130 to transmit color information of each of the obtained reagent pad cells to an external server. In addition, the control unit 150 may receive information on the examination result from an external server through the communication unit 130. In this case, the control unit 150 may control the display unit 120 to display the received examination result.

Accordingly, the user may be provided with a result of the examination generated based on more accurate predicted color information.

The order of the steps of FIGS. 2 and 4 to 7 described above may be changed as necessary, and at least one or more steps may be omitted or added. In addition, the above-described steps are only examples of the present disclosure, and the scope of the present disclosure is not limited thereto.

9 is a schematic diagram illustrating a network function according to some embodiments of the present disclosure.

Throughout this specification, a computational model, a neural network, a network function, and a neural network may be used with the same meaning. A neural network may consist of a set of interconnected computational units, which may generally be referred to as “nodes”. These “nodes” may also be referred to as “neurons”. The neural network includes at least one or more nodes. Nodes (or neurons) constituting neural networks may be interconnected by one or more "links".

In a neural network, one or more nodes connected through a link may relatively form a relationship between an input node and an output node. The concepts of an input node and an output node are relative, and any node in an output node relationship with respect to one node may have an input node relationship in a relationship with another node, and vice versa. As described above, the relationship between the input node and the output node may be created around a link. An output node can be connected to one input node through a link, and vice versa.

In the relationship between the input node and the output node connected through one link, the value of the output node may be determined based on data input to the input node. Here, a node interconnecting the input node and the output node may have a weight. The weight may be variable and may be changed by a user or an algorithm in order for the neural network to perform a desired function. For example, when input nodes are interconnected to one output node by respective links, the output node is an output node based on values input to the input node connected to the output node and a weight set in the link corresponding to the input node. Value can be determined.

As described above, in a neural network, one or more nodes are interconnected through one or more links to form an input node and an output node relationship in the neural network. The characteristics of the neural network may be determined according to the number of nodes and links in the neural network, the association relationship between the nodes and the links, and a weight value assigned to each of the links. For example, when the same number of nodes and links exist, and two neural networks having different weight values between the links exist, the two neural networks may be recognized as being different from each other.

A neural network can be configured including one or more nodes. Some of the nodes constituting the neural network may configure one layer based on the distances from the initial input node. For example, a set of nodes with a distance n from the initial input node, n layers can be configured. The distance from the first input node may be defined by the minimum number of links that must be traversed to reach the node from the first input node. However, the definition of such a layer is arbitrary for explanation, and the order of the layer in the neural network may be defined in a different way than that described above. For example, the layer of nodes may be defined by the distance from the last output node.

The initial input node may mean one or more nodes to which data is directly input without going through a link in a relationship with other nodes among nodes in the neural network. Alternatively, in a relationship between nodes in a neural network network based on a link, it may mean nodes that do not have other input nodes connected by a link. Similarly, the final output node may mean one or more nodes that do not have an output node in a relationship with other nodes among nodes in the neural network. In addition, the hidden node may refer to nodes constituting a neural network other than the first input node and the last output node. In the neural network according to an embodiment of the present disclosure, the number of nodes in the input layer may be the same as the number of nodes in the output layer, and the number of nodes decreases and then increases again as the input layer proceeds to the hidden layer. I can. In addition, the neural network according to another embodiment of the present disclosure may be a neural network in which the number of nodes of an input layer is less than the number of nodes of an output layer, and the number of nodes decreases as the number of nodes progresses from the input layer to the hidden layer. have. In addition, the neural network according to another embodiment of the present disclosure may be a neural network in which the number of nodes of an input layer is greater than the number of nodes of an output layer, and the number of nodes increases as the number of nodes progresses from the input layer to the hidden layer. I can. A neural network according to another embodiment of the present disclosure may be a neural network in the form of a combination of the aforementioned neural networks.

A deep neural network (DNN) may mean a neural network including a plurality of hidden layers in addition to an input layer and an output layer. Deep neural networks can be used to identify potential structures in data. In other words, it is possible to grasp the potential structure of photos, texts, videos, voices, and music (e.g., what objects are in photos, what are the content and emotions of the text, what are the contents and emotions of the voice, etc.) . Deep neural networks include convolutional neural networks (CNNs), recurrentneural networks (RNNs), auto encoders, Generative Adversarial Networks (GANs), and restricted boltzmann machines (RBMs). machine), deep belief network (DBN), Q network, U network, Siam network, and the like. The foregoing description of the deep neural network is only an example, and the present disclosure is not limited thereto.

The neural network may be learned by at least one of supervised learning, unsupervised learning, and semi supervised learning. Learning of neural networks is to minimize output errors. In learning of a neural network, iteratively inputs training data to the neural network, calculates the output of the neural network for the training data and the error of the target, and reduces the error from the output layer of the neural network to the input layer. This is a process of updating the weight of each node of the neural network by backpropagation in the direction. In the case of teacher learning, learning data in which the correct answer is labeled in each learning data is used (ie, labeled learning data), and in the case of non-satellite learning, the correct answer may not be labeled in each learning data. That is, for example, in the case of teacher learning related to data classification, the learning data may be data in which a category is labeled with each learning data. Labeled training data is input to a neural network, and an error may be calculated by comparing an output (category) of the neural network with a label of the training data. As another example, in the case of comparative history learning regarding data classification, an error may be calculated by comparing the input training data with the neural network output. The calculated error is backpropagated in the neural network in the reverse direction (ie, from the output layer to the input layer), and the connection weight of each node of each layer of the neural network may be updated according to the backpropagation. The amount of change in the connection weight of each node to be updated may be determined according to a learning rate. The computation of the neural network for the input data and the backpropagation of the error can constitute a learning cycle (epoch). The learning rate may be applied differently according to the number of repetitions of the learning cycle of the neural network. For example, a high learning rate is used in the early stages of learning of a neural network, so that the neural network quickly secures a certain level of performance to increase efficiency, and a low learning rate can be used in the later stages of learning to increase accuracy.

In the learning of a neural network, in general, the training data may be a subset of actual data (that is, data to be processed using the learned neural network), and thus, errors in the training data decrease, but errors in the actual data occur. There may be increasing learning cycles. Overfitting is a phenomenon in which errors in actual data increase due to over-learning on learning data. For example, a neural network learning a cat by showing a yellow cat may not recognize that it is a cat when it sees a cat other than yellow, which may be a kind of overfitting. Overfitting can cause an increase in errors in machine learning algorithms. Various optimization methods can be used to prevent such overfitting. In order to prevent overfitting, methods such as increasing training data, regulation, or dropout in which some nodes of the network are omitted during the training process may be applied.

10 is a diagram for describing a method of generating a colorimetric analysis model according to some embodiments of the present disclosure.

A learning method in a colorimetric analysis model according to some embodiments of the present disclosure will be described.

The controller 150 may generate a colorimetric analysis model including one or more network functions 600. The network function 600 may include one input layer 630, one or more hidden layers 640 and 650, and one output layer 660. Here, the input layer 630 may include an input node 601. Each of the one or more hidden layers 640 and 650 may include one or more hidden nodes. The output layer 660 may include an output node 661. In addition, the input node 601 included in the input layer 630, one or more hidden nodes included in the hidden layers 640 and 650, and the output node 661 included in the output layer 660 are one of different layers. Each of these nodes and links may be connected. Also, a weight may be set for each link.

According to some embodiments of the present disclosure, when generating a colorimetric analysis model, the control unit 150 includes learning color data of a plurality of colorimetric cells corresponding to input of the learning data and a plurality of colorimetric data pre-stored in the memory 140. Learning data can be generated by labeling the learning steady state color data of the table cell. Also, the controller 150 may train a colorimetric analysis model including one or more network functions by using a training data set including training data. For example, the controller 150 may input learning color data to the network function 600 of the colorimetric analysis model. Each item of learning color data may be input to the input node 601 included in the input layer 630 of the network function 600 of the colorimetric analysis model. For example, an item value for at least one of color data of each of the plurality of colorimetric cells may be input to the input node 601.

According to some embodiments of the present disclosure, the controller 150 may input training color data to an input node included in an input layer of one or more network functions of a colorimetric analysis model. Also, the controller 150 may derive an error by comparing the learning color data and the labeled learning steady state color data and the output of the colorimetric analysis model. In addition, the control unit 150 may update the weight set for each link by propagating the derived error from the output layer of one or more network functions of the colorimetric analysis model to the input layer through one or more hidden layers.

The controller 150 calculates an item value input to the input node 601 included in the input layer 630 of the network function 600 with a weight set for a link connected to the input node and propagates it to the hidden layer. have. For example, the first hidden node 621 included in the hidden layer 1 640 may receive a value transmitted to the input node 601 and a value obtained by calculating the first weight 611. For example, the first hidden node 621 included in the hidden layer 1 640 may receive a value obtained by multiplying the value transmitted to the input node 601 by the first weight 611. The description of the above operation is only an example, and the present disclosure is not limited thereto.

The learning color data of the network function 600 may be propagated from the input layer 630 to the output layer 660 through the hidden layer 1 640 and the hidden layer 2 650. A network function based on an error between the color information (i.e., output) of each of the plurality of colorimetric cells, which is an output value from the output node 661 included in the output layer 660 and the learning steady state color data (i.e., correct answer) You can adjust the weight of 600.

The control unit 150 passes from the output layer 660 of the network function 500 to one or more hidden layers (for example, in the order of hidden layer 2 650 and then hidden layer 1 640) to the input layer 630. While propagating the error, the weights set for each link may be updated (eg, after adjusting the weight of W2(1,1) 631), the weight of W1(1,1) 611 may be adjusted.

According to some embodiments of the present disclosure, when a colorimetric analysis model is generated, the control unit 150 may input color data of each of a plurality of reagent pad cells to be measured into the generated colorimetric analysis model. In this case, the colorimetric analysis model may be learned in advance and output color information of each reagent pad cell based on a set weight. Accordingly, the controller 150 may acquire color information of each of the plurality of reagent pad cells, which is an output value of the colorimetric analysis model.

Specifically, the controller 150 may input each item value of items included in the color data of the reagent pad cell to an input node included in the input layer 630 of the network function 600. For example, the controller 150 may input color data of any one reagent pad cell (eg, a first reagent pad cell) among a plurality of reagent pad cells to the input node 601 of the input layer 630. I can. The control unit 150 weights the value input to the input layer 630 of the network function 600 (a first weight (W1(1,1) 611) in this example) and a second weight (W2(1,1)). ) (631))), and an output node 661 included in the output layer 660 through one or more hidden nodes (in this example, including the hidden layer 1 640 and the hidden layer 2 650). ). The controller 150 may recognize color information, which is an output value of the output node 661, as color information of the first reagent pad cell.

The description of the method of generating color information of each of the plurality of reagent pad cells described above is only an example, and the present disclosure is not limited thereto.

11 is an exploded perspective view of a urine test kit according to some embodiments of the present disclosure.

According to some embodiments of the present disclosure, the urine test kit 200 may include a reagent pad strip 210 and a colorimetric table 220.

Specifically, the reagent pad strip 210 of the urine test kit 200 may be coupled to a region of the colorimetric table 220.

One area of the colorimetric table 220 may include an inlet portion corresponding to the shape of the reagent pad strip 210 so as to facilitate coupling of the reagent pad strip 210. The reagent pad strip 210 may be combined with the colorimetric table 220 by being inserted into the inlet. The reagent pad strip 210 of the urine test kit 200 may be inserted into the inlet portion of the colorimetric table 220 to be firmly coupled to the colorimetric table 220.

Meanwhile, an indicator line may be displayed in one area of the colorimetric table 220 to facilitate coupling of the reagent pad strip 210.

12 is a diagram for describing an example of an interface displayed on a terminal according to some embodiments of the present disclosure.

Referring to FIG. 12A, the controller 150 of the terminal 100 may control the display 120 to display a preview image acquired from a camera on the preview image capturing interface 20. Here, the preview image capturing interface 20 may include a guide line 21. The user can adjust the position of the terminal 100 so that the urine test kit is located in a specific area (guide line), so that the urine test kit can be easily photographed.

According to some embodiments of the present disclosure, the controller 150 may recognize a motion of a preview image acquired from a camera. In this case, the control unit 150 may control the display unit 120 to display the first guide text 22 on the preview image capturing interface 20. As an example, the first guide text 22 may be text that can help in taking a preview image, such as "Please take a picture in a bright place where the shadow does not fall".

According to some embodiments of the present disclosure, the controller 150 may recognize that a urine test kit is included on a preview image obtained from a camera. In addition, the controller 150 may recognize whether the urine test kit included in the preview image is an appropriate size. Specifically, the controller 150 may compare the size of the urine test kit included in the preview image and the size of the guide line 21. In addition, when the size of the urine test kit included in the preview image is smaller than the size of the guide line 21, the controller 150 displays the second guide text 23 through the preview image photographing interface 20. The display unit 120 can be controlled. For example, the second guide text 23 may be a text useful for taking a preview image, such as "please take a camera a little closer".

Referring to FIG. 12B, as described above, the controller 150 may recognize the size of the urine test kit included in the preview image and compare it with the size of the guide line 21. In addition, when the size of the urine test kit matches the size of the guide line 21, the controller 150 may recognize whether the urine test kit is located within the guide line 21. In addition, when the urine test kit included in the preview image matches the size of the guide line 21 and the urine test kit is not located within the guide line 21, the preview image photographing interface The display unit 120 may be controlled to display the third guide text 24 through 20. As an example, the third guide text 24 may be text useful for photographing a preview image, such as “fit the outline of the color table”.

However, it is not limited to the above-described example, and the first guide text 22, the second guide text 23, and the third guide text 24 may be any text that guides the preview image to be properly photographed. I can.

Referring to FIG. 12C, the controller 150 may control the display unit 120 to display a plurality of guide cells 25 on a preview image captured through the preview image capture interface 20. . Accordingly, the user can intuitively recognize whether the urine test kit has been accurately captured on the captured preview image.

In addition, the control unit 150 may control the display unit 120 to display an indicator 26 that receives input of whether a preview image captured through the preview image capturing interface 20 is accurately captured. For example, one area of the indicator 26 may include text such as “Does the colorimetric table actually photographed match the white rectangle (guide cell)?”. In addition, the controller 150 may receive an input corresponding to confirmation or cancellation (re-photographing) from a user through the indicator 26.

The operation of controlling the display unit 120 so that the above-described control unit 150 displays the preview image capturing interface 20 and the configuration of the preview image capturing interface 20 are described as a detailed example to aid understanding of the present disclosure. However, the present disclosure is not limited thereto.

13 is a diagram illustrating another example of an interface that can be viewed in a terminal according to some embodiments of the present disclosure.

13 shows a checkup result interface 30 that can be displayed to the user after the user photographs a preview image.

According to some embodiments of the present disclosure, the control unit 150 uses health analysis data mapped to each of a plurality of color information pre-stored in the memory 140, and corresponds to the color of each of the obtained plurality of reagent pad cells. Can generate examination results. However, the present invention is not limited thereto, and the controller 150 may control the communication unit 130 to transmit color information of each of the obtained reagent pad cells to an external server. In addition, the control unit 150 may receive information on the examination result from an external server through the communication unit 130.

Meanwhile, the control unit 150 may control the display unit 120 to display the examination result generated by the control unit 150 or received from an external server.

Referring to FIG. 13A, the control unit 150 of the terminal 100 may control the display unit 120 to display the examination result interface 30.

Specifically, the control unit 150 may control the display unit 120 to display a plurality of examination items and a examination result graph corresponding to the plurality of examination items in the first area 32 of the examination result interface 30. have.

For example, in the first region 32 of the examination result interface 30, examination items such as glucose, bilirubin, ketone, blood, pH, protein, nitrite, urobilinogen, specific gravity and leukocytes, etc., and corresponding to each of the examination items Graphs may be included. Accordingly, the user can intuitively check the health status corresponding to the plurality of examination items.

In addition, the control unit 150 may control the display unit 120 to display an indicator 31 capable of confirming detailed information of each of a plurality of examination items in a region of the examination result interface 30.

13B illustrates a screen that can be displayed to the user when the user touches the indicator 31 of FIG. 13A.

According to some embodiments of the present disclosure, the controller 150 may control the display 120 to display a plurality of examination item indicators in the second area 33 of the examination result interface 30. The user can select one of the plurality of examination items and check the examination items he or she wants in detail.

Specifically, the control unit 150 may control the display unit 120 to display an indicator corresponding to each examination item in the second area 33 of the examination result interface 30. In addition, the controller 150 may receive a selection input of an indicator corresponding to each of the examination items. In this case, the controller 150 may control the display 120 to display health status information corresponding to the selected indicator on the third area 34 of the examination result interface 30.

For example, when receiving an input for selecting an indicator for glucose from among a plurality of indicators, the controller 150 may display health status information including detailed information about glucose on the third area 34. 120) can be controlled.

As another example, when receiving an input for selecting an indicator for blood from among a plurality of indicators, the controller 150 displays health status information including information indicating detailed blood test results on the third area 34. The display unit 120 can be controlled.

The operation of controlling the display unit 120 so that the above-described control unit 150 displays the examination result interface 30 and the configuration of the examination result interface 30 are only descriptions of a detailed example to aid understanding of the present disclosure, The present disclosure is not limited thereto.

The above-described embodiments can generally be implemented as computer-executable instructions that can be executed on one or more computers, and those skilled in the art know that the present disclosure can be implemented in combination with other program modules and/or as a combination of hardware and software. You know well.

In general, modules herein include routines, procedures, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Further, to those skilled in the art, the method of the present disclosure is not limited to single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, handheld computing devices, microprocessor-based or programmable household appliances, and the like (each of which It will be appreciated that it may be implemented with other computer system configurations, including one or more associated devices).

Computers according to the present disclosure typically include a variety of computer readable media. Computer-readable media can be any computer-readable media, including volatile and non-volatile media, transitory and non-transitory media, removable and non-transitory media. Includes removable media. By way of example, and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media.

Computer-readable storage media include volatile and nonvolatile media, transitory and non-transitory media, removable and non-removable media implemented in any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Includes the medium. Computer-readable storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage. Devices, or any other medium that can be accessed by a computer and used to store desired information.

Computer-readable transmission media typically implement computer-readable instructions, data structures, program modules, or other data on a modulated data signal such as a carrier wave or other transport mechanism. Includes all information transmission media. The term modulated data signal refers to a signal in which one or more of the characteristics of the signal is set or changed to encode information in the signal. By way of example, and not limitation, computer-readable transmission media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above-described media are also intended to be included within the scope of computer-readable transmission media.

A person of ordinary skill in the art of the present disclosure includes various exemplary logical blocks, modules, processors, means, circuits and algorithm steps described in connection with the embodiments disclosed herein, electronic hardware, (convenience). For the sake of clarity, it will be understood that it may be implemented by various types of program or design code or a combination of both (referred to herein as “software”). To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. A person of ordinary skill in the art of the present disclosure may implement the described functions in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term ""article of manufacture"" includes a computer program, carrier, or media accessible from any computer-readable device. For example, computer-readable storage media include magnetic storage devices (e.g., hard disks, floppy disks, magnetic strips, etc.), optical disks (e.g., CD, DVD, etc.), smart cards, and flash Memory devices (eg, EEPROMs, cards, sticks, key drives, etc.), but are not limited thereto. The term ""machine-readable medium"" includes, but is not limited to, wireless channels and various other media capable of storing, holding, and/or transmitting instruction(s) and/or data.

It is to be understood that the specific order or hierarchy of steps in the presented processes is an example of exemplary approaches. Based on the design priorities, it is to be understood that within the scope of the present disclosure a specific order or hierarchy of steps in processes may be rearranged.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be apparent to those of ordinary skill in the art, and general principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments presented herein, but is to be interpreted in the widest scope consistent with the principles and novel features presented herein.

Claims (17)

A computer program stored on a computer-readable storage medium, comprising:
The computer program includes instructions for causing a computer to perform the following operations, the operations:
Obtaining a preview image captured by the camera;
Recognizing a urine test kit within the preview image-the urine test kit includes a colorimetric table and a reagent pad strip;
Acquiring a shape of each of a plurality of colorimetric cells included in the colorimetric table;
Recognizing the number of cells corresponding to a preset shape among the plurality of colorimetric cells;
Recognizing a location of each of the plurality of colorimetric cells in the preview image when the number of cells corresponding to the preset shape is greater than or equal to the preset number; And
Acquiring color information of each of the plurality of reagent pad cells included in the reagent pad strip by using the colorimetric table when the positions of each of the plurality of colorimetric cells correspond to a preset position;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
Generating a checkup result corresponding to the color information by using health analysis data mapped to each of a plurality of colors pre-stored in a memory; And
Displaying the examination result;
Further comprising,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
Transmitting the color information to an external server;
Receiving information on a checkup result corresponding to the color information from the external server; And
Displaying information on the examination result;
Further comprising,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
The operation of obtaining a shape of each of the plurality of colorimetric cells included in the colorimetric table,
Recognizing an outline of each of the plurality of colorimetric cells; And
Obtaining a shape of each of the plurality of colorimetric cells based on an outline of each of the plurality of colorimetric cells;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
Recognizing the number of cells corresponding to a preset shape among the plurality of colorimetric cells,
Recognizing a first horizontal length and a first vertical length of each of the plurality of colorimetric cells;
Recognizing a second horizontal length and a second vertical length of the urine test kit included in the preview image; And
Recognizing the number of cells matching the preset shape using the first horizontal length, the second horizontal length, the first vertical length, and the second vertical length;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 5,
Cells matching the preset shape,
A ratio value between the first horizontal length and the first vertical length corresponds to a first ratio value pre-stored in a memory, and the first horizontal length multiplies the second horizontal length and a second ratio value pre-stored in the memory Which is the cell corresponding to the value,
A computer program stored on a computer-readable storage medium.
The method of claim 5,
Cells matching the preset shape,
A ratio value between the first horizontal length and the first vertical length corresponds to a first ratio value pre-stored in a memory, and the first vertical length multiplies the second vertical length and a third ratio value pre-stored in the memory Which is the cell corresponding to the value,
A computer program stored on a computer-readable storage medium.
The method of claim 5,
Cells matching the preset shape,
A ratio value between the first horizontal length and the first vertical length corresponds to a first ratio value pre-stored in a memory, and the first horizontal length multiplies the second horizontal length and a second ratio value pre-stored in the memory A cell corresponding to a value, and wherein the first vertical length is a value obtained by multiplying the second vertical length by a third ratio value previously stored in the memory,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
Recognizing the location of each of the plurality of colorimetric cells in the preview image,
Recognizing each of a first reference cell and a second reference cell among the plurality of colorimetric cells; And
Based on the location of the first reference cell in the preview image, the location of the second reference cell in the preview image, and location information of colorimetric cells pre-stored in the memory, the plurality of colorimetric tables in the preview image Recognizing the location of each of the cells;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
The operation of obtaining color information of each of the plurality of reagent pad cells included in the reagent pad strip using the colorimetric table,
Recognizing a position of the reagent pad strip based on colorimetric information previously stored in the memory; And
Recognizing color information of each of the plurality of reagent pad cells when a preset second condition is satisfied;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 10,
The preset second condition is,
A first virtual line connecting a first colorimetric cell included in the colorimetric table and a second colorimetric cell located below the first colorimetric cell, and a first reagent pad cell and a second included in the reagent pad strip The first reagent on a third virtual line connecting the second virtual line connecting the reagent pad cells is parallel, and connecting the first colorimetric cell and the third colorimetric cell located at the side of the first colorimetric cell. Is satisfied when the pad cell is located,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
The operation of obtaining color information of each of the plurality of reagent pad cells included in the reagent pad strip using the colorimetric table,
Performing colorimetric analysis of the color of each of the plurality of reagent pad cells with the plurality of colorimetric cells to obtain the color information of each of the plurality of reagent pad cells;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 12,
Colorimetric analysis of the color information of each of the plurality of reagent pad cells with the plurality of colorimetric cells to obtain the color information of each of the plurality of reagent pad cells,
Generating a colorimetric analysis model; And
Obtaining the color information of each of the plurality of reagent pad cells by calculating a color of each of the plurality of colorimetric cells and the plurality of reagent pad cells using the colorimetric analysis model;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 13,
The operation of generating the colorimetric analysis model,
Generating training data by labeling training color data of the plurality of colorimetric cells corresponding to an input of training data and learning steady state color data of the plurality of colorimetric cells pre-stored in a memory; And
Generating the colorimetric analysis model by learning the colorimetric analysis model including one or more network functions using a training data set including the training data;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 14,
The operation of generating the colorimetric analysis model by training the colorimetric analysis model including one or more network functions using a training data set including the training data,
Inputting the learning color data to an input node included in an input layer of one or more network functions of the colorimetric analysis model;
Comparing the learning color data with the labeled learning steady state color data and the output of the colorimetric analysis model to derive an error; And
By propagating the error from the output layer of one or more network functions of the colorimetric analysis model to the input layer through one or more hidden layers, a weight set for a link connecting each of the input node, the output layer, and the one or more hidden layers is obtained. Updating;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 13,
The operation of obtaining the color information of each of the plurality of reagent pad cells by calculating a color of each of the plurality of colorimetric cells and the plurality of reagent pad cells using the colorimetric analysis model,
Generating a plurality of different color determination trees by combining at least two or more of the plurality of color models; And
Acquiring a plurality of color information corresponding to each of the plurality of reagent pad cells by using each of the plurality of color determination trees;
Containing,
A computer program stored on a computer-readable storage medium.
As a terminal that provides a urine test using a colorimetric table,
A camera unit that acquires a preview image; And
A controller for acquiring color information of each of a plurality of reagent pad cells included in the reagent pad strip based on the preview image;
Including,
The control unit,
Recognizing a urine test kit-the urine test kit includes a colorimetric table and a reagent pad strip in the preview image,
Acquiring the shape of each of the plurality of colorimetric cells included in the colorimetric table,
Recognizing the number of cells corresponding to a preset shape among the plurality of colorimetric cells,
When the number of cells corresponding to the preset shape is greater than or equal to the preset number, the position of each of the plurality of colorimetric cells in the preview image is recognized, and
When the position of each of the plurality of colorimetric cells corresponds to a preset position, obtaining color information of each of the plurality of reagent pad cells included in the reagent pad strip using the colorimetric table,
A terminal that provides a urine test using a colorimetric table.

Images