KR20180086820A - Skin acidity estimating method using image - Google Patents

Abstract

A method for measuring skin acidity using an image includes the steps performed by a computer device: detecting a skin region of a subject in the image; extracting color data and texture data of the skin region; and determining the skin acidity by inputting at least one of the color data and the texture data to a first regression analysis function provided in advance using a relationship between the skin acidity and the at least one of the color data and the texture data. Accordingly, the present invention can easily measure the skin acidity using the image captured by a camera or a smartphone.

Description

[0001] SKIN ACIDITY ESTIMATING METHOD USING IMAGE [0002]

The present invention relates to a technique for measuring the acidity of skin using an image.

BACKGROUND ART [0002] Recently, as interest in skin beauty has increased, devices for diagnosing a user's skin condition through cosmetic-care products have been attracting attention. Meanwhile, a service for managing the skin condition data by a smart phone is also provided.

Korean Patent Publication No. 10-2015-0033938

Conventional techniques for measuring or managing skin conditions basically require a separate device to measure skin condition. The technique described below is intended to provide a method for measuring the pH of skin using an image.

A method for measuring skin acidity using an image includes the steps of: detecting a skin region of a subject in an image by a computer device; extracting color data and texture data of the skin region; And determining skin acidity by inputting at least one of the color data and the texture data to a first regression analysis function provided in advance using a relationship between at least one of the data and the skin acidity.

In another aspect, a method for measuring skin acidity using an image comprises the steps of: detecting a skin region of a subject in an image; extracting color data and texture data of the skin region from the computer device; And determining a first skin acidity by inputting at least one of the color data and the texture data into a first regression analysis function previously prepared using a relationship between at least one of the texture data and the skin acidity of the skin, Determining the second skin acidity by applying the first skin acidity to a second regression analysis function previously prepared using the relationship between the first skin acidity and the skin acidity.

The technique described below can easily measure the acidity of the skin using images captured by a camera or a smart device.

Fig. 1 shows an example of a configuration of an apparatus for measuring skin acidity using an image.
2 is an example of a flowchart for a method of measuring skin acidity using an image.
FIG. 3 shows an example of a process of preparing a regression analysis function.
FIG. 4 is an example of a process of measuring skin acidity according to the method of FIG.
FIG. 5 shows an example of a process for preparing an improved regression analysis function using the calculated skin acidity.
Figure 6 is an example of a process for producing improved skin acidity.

The following description is intended to illustrate and describe specific embodiments in the drawings, since various changes may be made and the embodiments may have various embodiments. However, it should be understood that the following description does not limit the specific embodiments, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the following description.

The terms first, second, A, B, etc., may be used to describe various components, but the components are not limited by the terms, but may be used to distinguish one component from another . For example, without departing from the scope of the following description, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

As used herein, the singular " include "should be understood to include a plurality of representations unless the context clearly dictates otherwise, and the terms" comprises & , Parts or combinations thereof, and does not preclude the presence or addition of one or more other features, integers, steps, components, components, or combinations thereof.

Before describing the drawings in detail, it is to be clarified that the division of constituent parts in this specification is merely a division by main functions of each constituent part. That is, two or more constituent parts to be described below may be combined into one constituent part, or one constituent part may be divided into two or more functions according to functions that are more subdivided. In addition, each of the constituent units described below may additionally perform some or all of the functions of other constituent units in addition to the main functions of the constituent units themselves, and that some of the main functions, And may be carried out in a dedicated manner.

Also, in performing a method or an operation method, each of the processes constituting the method may take place differently from the stated order unless clearly specified in the context. That is, each process may occur in the same order as described, may be performed substantially concurrently, or may be performed in the opposite order.

Fig. 1 shows an example of a configuration of an apparatus for measuring skin acidity using an image. FIG. 1 illustrates an example of detecting a face in an image including a user's face. Skin acidity refers to the content of acidic substances present in the skin.

1 (a) is an example of measuring skin acidity using a smart device 50 such as a smartphone. The user takes a face with the camera built in the smart device 50. The smart device 50 detects the face area from the source image and extracts the color data and texture data of the preset area. The smart device 50 measures skin acidity based on at least one of color data and texture data.

1 (a), the smart device 50 includes a camera 51, a storage device 52, a computing device 53, and an output device 54. The camera 51 acquires the source image. The arithmetic unit 53 extracts color data and texture data for the skin region included in the source image, and performs an operation for measuring the skin acidity from at least one of the color data and the texture data. The storage device 52 may temporarily store the source image. The storage device 52 may also store a regression analysis function used for skin pH measurement. The output device 54 can output the measured skin acidity.

1 (b) is an example of measuring skin acidity using a device such as a PC. The user shoots the face with the camera 81 connected to the computer 85. The computer 85 detects the face area from the source image and extracts the color data and texture data of the predetermined area. The computer 85 measures skin acidity based on at least one of color data and texture data.

1 (c) shows an example in which the server 95 located at a remote site measures skin acidity using an image acquired by the user terminal 91. The user takes a face with a camera built in the user terminal 91. The user terminal 91 transfers the photographed source image to the server 95 via the network. In this case, the user terminal 91 includes a communication module for data transmission. The server 95 detects the face area in the source image and extracts the color data and texture data of the predetermined area set in advance. The server 95 measures skin acidity based on at least one of the color data and the texture data. The server 95 may transmit the measured skin acidity to the user terminal 91.

In some cases, the user terminal 91 may detect the skin region from the source image and transmit it to the server 95. In this case, the server 95 extracts color data and texture data for a skin region, and measures skin acidity using at least one of color data and texture data. Alternatively, the user terminal 91 may detect the skin region in the source region and extract color and texture data for the skin region. The user terminal 91 may transmit color and texture data for the skin region to the server 95. The server 95 may measure skin acidity using at least one of color data and texture data.

2 is an example of a flow chart for a method 100 for measuring skin acidity using an image.

First, the camera acquires the source image (110). The source image includes a skin area of the user. The computer device detects the skin region in the source image captured by the camera (120). The algorithm by which the computer device detects the skin area can utilize various techniques known in the art.

The computer device extracts an average value of color data and texture data for the skin region (130). The computer device can extract color and texture data for the entire extracted skin area. The computer device may also extract color and texture data for a specific skin region from the acquired image. The computer device may continue to extract color data in successive images (consecutive frames).

Various values can be used for the color data. For example, (1) the color data may use at least one of an R value, a G value, and a B value based on the RGB color scheme. The color data may use an average value for at least one of R value, G value, and B value. (2) The computer device can convert the RGB color scheme to a different color scheme. For example, computer politics can convert the RGB color scheme to various color schemes such as YUV, HSV, YCbCr, YCgCo, and the like. The computer device can extract color data of at least one of chrominance components or luminance components of a specific color system. In this case, the color data may use one of the components that are less influenced by the surrounding environment (illumination, etc.). For example, in the case of YCbCr, at least one of Cb and Cr can be used. In the case of YCgCo, at least one of Cg and Co may be used. Further, one of the two chrominance components, which is more robust to the variation of the illuminance, can be used. For example, in the case of YCgCo, only Cg can be used. In this case, the computer device can extract the average value of the Cg color data of the skin region as color data. (3) Further, the color data may be a value obtained by combining weights applied to at least one color component in various color systems such as RGB, YUV, HSV, YCbCr, YCgCo, and the like. In the case of combining color components, the color data may be a value obtained by adding different weighted values depending on the color system and the type of color component.

Various kinds of texture data are used in image. Various measures such as contrast, angular second moment (ASM), entropy, dissimilarity, homogeneity, and direction are studied for the texture of the image.

The computer device calculates the acidity of the skin by applying the extracted color data and / or texture data to a regression analysis function provided in advance (140). The computer device can calculate the acidity of skin by applying at least one of color data and texture data to a regression analysis function.

Regression analysis is an analytical method that measures fit between two variables for continuous variables. Regression analysis calculates a function (formula) that calculates a specific value using predetermined sample data in advance. The regression function is expressed as an equation representing a regression line or a regression curve. The computer device extracts color data and texture data using images, and at the same time measures skin acidity for the same user using a skin acidity measuring device. This process is repeated to generate a plurality of data, and the computer device generates a regression analysis function that calculates the skin acidity from the color data and the texture data based on the generated plurality of data.

FIG. 3 shows an example of a process of preparing a regression analysis function. The process of preparing samples for color data and texture data will be described. The user shoots a face image of a person using a smart device or a general camera (a process). The computer apparatus detects a face region displayed in a square in the source image including the face image (step b). The computer device detects the skin area in the face area (step c). The computer device extracts the average value of the color data and the texture data in the skin area (step d). The extracted color data and texture data are stored in the color and texture data DB. Fig. 3 shows an example of detecting a part of the face area A as a sample. Unlike FIG. 3, the entire face region may be detected to extract color data and texture data. A computer device typically provides a plurality of samples for color and texture data.

A sample for the color data and texture data is prepared and the pH of the skin for the same user is measured by the pH meter (step e). Fig. 3 shows an example of measuring the acidity by an acidity meter in the area B corresponding to the area A The pH meter refers to a commercially available measuring instrument. The skin acidity measured by the pH meter is stored in the skin acid database. When the computer device extracts the first color data and texture data, it simultaneously measures the first pH with a pH meter. The computer device identifies the color data / texture data and the pH measured by the pH meter so that they can match each other. For example, the computer device may store the color data / texture data generated at the same time point and the acidity measured by the acidity meter in the same table or in the same order in different tables.

The computer device generates a regression analysis function using the skin acidity measured at the same time as any one of the color data and the texture data (step f), and stores the generated regression analysis function in the regression analysis DB. The computer device can generate a regression analysis function using a plurality of sample data. As described above, the regression analysis function means a regression line or a regression curve.

The computer device can derive a regression linear equation using the color and texture data DB and skin skin database for the same area. The regression linear equation is shown in Equation 1 below.

Where x is the value of the color or texture data in the specified color scheme. a and b are constants obtained by regression analysis. y represents the calculated skin acidity value. The results of applying the actual data may vary with the values of the constants a and b depending on the data used.

The regression curve is a curve obtained by representing a set of points on a correlation chart as a curve rather than a straight line. Regression curves show the relationship between two variables. The computer device can derive the regression curve equation using the color and texture data DB and the skin acid database. The regression curve equation is shown in Equation 2 below.

Where x is the value of the color or texture data in the specified color scheme. a, b, and c are constants obtained by regression analysis. y represents the calculated skin acidity value. The result of applying the actual data may vary in constant a, b or c depending on the data used.

As described above, the computer device may use at least one of color data and texture data. A regression analysis function should be provided according to the input data. For example, a regression analysis function may be needed for (1) a regression analysis function for color data, (2) a regression analysis function for texture data, and (3) a combination of color and texture data. Furthermore, when color data and texture data are used, a regression analysis function may be prepared by assigning different weights to each data. (4) or a first regression analysis function for the color data and a second regression analysis function for the texture data are separately generated, and the first value and the texture data, to which the color data is applied to the first regression analysis function, The final skin acidity may be determined by assigning different weights to the second value applied to the skin.

On the other hand, the computer device may generate a regression analysis function considering various variables. For example, it is possible to generate different regression analysis functions depending on the type of skin area (forehead, ball, jaw, etc.), hardware specifications of the camera, In this case, the user would have to go through a process of entering variables into the computer device.

FIG. 4 is an example of a process of measuring skin acidity according to the method of FIG.

The user shoots a face image of a person using a smart device or a general camera (a process). The computer apparatus detects a face region displayed in a square in the source image including the face image (step b). The computer device detects the skin area in the face area (step c). Fig. 4 shows an example in which the computer device detects a specific skin area A set in advance in the face area. Figure 4 illustrates an example in which a computer device detects a " ball " area.

If your computer device uses a color scheme other than RGB, you must perform a color scheme conversion. For example, if you use the YCgCo color scheme, the computer device converts the RGB color scheme of the skin region to the YCgCo color scheme.

The computer device extracts the average value of the color data and the texture data based on the skin area A (step d). For example, the computer device can extract color data from the average value of Co chrominance components in the YCgCo color system. Further, the computer device can extract the contrast value of the skin area A as texture data. The contrast value can be expressed as a flat (average) brightness value of the corresponding region. The match value is an example of texture data.

The computer device applies color data and / or texture data to a regression analysis function (e process). The regression analysis DB is prepared in advance through the process described in FIG. The computer device determines the final skin acidity as a result of the regression analysis function (step f).

The computer device can calculate a single result using the weighted average of the color data and the texture data in the process of calculating the skin acidity. Furthermore, the computer device can determine the acidity as a result of weighting the acidity calculated using the individual data. For example, the computer device can determine the acidity by 7.5506, which is the sum of the estimated skin pH 7.5222 through color R and the skin pH 7.5789 estimated through the homogeneity, respectively, with a weight of 5: 5.

FIG. 5 shows an example of a process for preparing an improved regression analysis function using the calculated skin acidity. The user shoots a face image of a person using a smart device or a general camera (a process). The computer apparatus detects a face region displayed in a square in the source image including the face image (step b). The computer device detects the skin area in the face area (step c). Fig. 5 shows an example in which the computer device detects a specific skin area A set in advance in the face area. Figure 5 shows an example in which a computer device detects a " ball " region. The computer device extracts the average value of the color data and the texture data based on the skin area A (step d). The computer device applies color data and / or texture data to a regression analysis function (e process). The regression analysis DB used in the e-process is prepared through the process described in Fig. The computer device calculates skin acidity in a regression analysis function (step f). An improved regression analysis function is generated using the calculated skin acidity and the skin acid database measured by the acidity meter (step g), and the generated improved regression analysis function is stored in the improved regression analysis DB. As described above, the regression analysis function means a regression line or a regression curve.

Figure 6 is an example of a process for producing improved skin acidity. The user shoots a face image of a person using a smart device or a general camera (a process). The computer apparatus detects a face region displayed in a square in the source image including the face image (step b). The computer device detects the skin area in the face area (step c). Fig. 6 shows an example in which the computer apparatus detects a specific skin area A preset in the face area. Figure 5 shows an example in which a computer device detects a " ball " region. The computer device extracts the average value of the color data and the texture data based on the skin area A (step d). The computer device applies color data and / or texture data to a regression analysis function (e process). The regression analysis DB used in the e-process is prepared through the process described in Fig. The computer device calculates skin acidity in a regression analysis function (step f).

Computer predicted skin acidity is applied to the improved regression analysis function (g process). The improved regression analysis DB used in the process g is prepared in the process of FIG. The computer device determines an ultimate skin acidity by calculating an improved skin acidity in an improved regression analysis function (step h).

The computer device can calculate a single result using the weighted average of the color data and the texture data in the process of calculating the skin acidity.

The computer device can derive a regression linear equation and a regression curve equation using the calculated skin acidity and skin acidity DB. The regression linear equation is as shown in Equation 1, where x is the calculated value of the skin acidity. a and b are constants obtained by regression analysis. y represents an improved skin acidity value. The results of applying the actual data may vary with the values of the constants a and b depending on the data used.

Regression curves can also be derived using the calculated skin acidity and skin acidity database. The regression curve equation is as shown in Equation 2, where x is the value of the calculated skin acidity. a, b, and c are constants obtained by regression analysis. y represents an improved skin acidity value. The result of applying the actual data may vary in constant a, b or c depending on the data used.

The present embodiment and drawings attached hereto are only a part of the technical idea included in the above-described technology, and it is easy for a person skilled in the art to easily understand the technical idea included in the description of the above- It will be appreciated that variations that may be deduced and specific embodiments are included within the scope of the foregoing description.

50: Smart devices
51: Camera
52: Storage device
53:
54: Output device
81: Camera
85: Computer
91: User terminal
95: Server

Claims (11)

Detecting a region of the subject's skin from the image;
The computer device extracting color data and texture data of the skin region; And
The computer device determines at least one of the color data and the texture data to a first regression analysis function provided in advance using the relationship between at least one of the color data and the texture data and the pH of the skin, Measuring skin acidity using images. The method according to claim 1,
Wherein the color data is at least one of a color system of at least one of RGB, HSV, YUV, YCgCo, and YCbCr. The method according to claim 1,
Wherein the texture data is data on at least one of contrast, angular second moment, entropy, dissimilarity, and homogeneity. The method according to claim 1,
Wherein the first regression analysis function uses at least one of an average value and texture data of color data of a skin region included in a source image of the subject and a skin acidity of the subject measured by a pH meter at the time of photographing the source image, A method for measuring skin acidity using images. The method according to claim 1,
Wherein the computer calculates a sum of values obtained by assigning different weights to a second skin acidity determined using at least one of the first skin acidity determined using at least one of the components of the color data and the components of the texture data, A method for measuring skin acidity using images. Detecting a region of the subject's skin from the image;
The computer device extracting color data and texture data of the skin region;
The computer device inputs at least one of the color data and the texture data to a first regression analysis function previously prepared using the relationship between at least one of the color data and the texture data and the pH of the skin, Determining; And
Wherein the computer device determines the second skin acidity by applying the first skin acidity to a second regression analysis function previously prepared using the relationship between the first skin acidity and the skin acidity, Method of measuring acidity. The method according to claim 6,
Wherein the color data is at least one of a color system of at least one of RGB, HSV, YUV, YCgCo, and YCbCr. The method according to claim 6,
Wherein the texture data is data on at least one of contrast, angular second moment, entropy, dissimilarity, and homogeneity. The method according to claim 6,
Wherein the first regression analysis function uses at least one of an average value and texture data of color data of a skin region included in a source image of the subject and a skin acidity of the subject measured by a pH meter at the time of photographing the source image, A method for measuring skin acidity using images. The method according to claim 6,
Wherein the second regression analysis function is performed using the relationship between the first skin acidity and the skin acidity of the subject measured by a pH meter at the time of photographing the source image. The method according to claim 6,
Wherein the computer apparatus calculates a first skin acidity by using a first skin acidity determined using at least one of the components of the color data and a second skin acidity determined using at least one of the components of the texture data, A method for measuring skin acidity using images that determine skin acidity.

Images