WO2020073392A1

WO2020073392A1 - Method, apparatus and mobile phone for evaluating skin, and computer device and storage medium

Info

Publication number: WO2020073392A1
Application number: PCT/CN2018/113858
Authority: WO
Inventors: 蔡义文; 李建星; 胡新成
Original assignee: 蔡义文
Priority date: 2018-10-08
Filing date: 2018-11-03
Publication date: 2020-04-16
Also published as: CN109363634A

Abstract

The present invention relates to the technical field of evaluations, and provides a method, apparatus and mobile phone for evaluating skin, and a computer device and a storage medium. The method comprises: sending an irradiation instruction to an illumination unit, the irradiation instruction being used for triggering the illumination unit to emit specific skin test light, and the skin test light being used to irradiate the skin of a subject; obtaining a skin image photographed by a photographing device, the skin image comprising an image of the skin of the subject when irradiated by the skin test light; and evaluating a skin state of the subject based on the skin image. According to the technical solution, the problem that skin evaluation is not convenient enough is solved. The illumination unit is controlled to emit the specific skin test light, and the skin state of the subject can be conveniently analyzed according to the skin image photographed under the specific light source.

Description

Skin evaluation method, device, mobile phone, computer equipment and storage medium

Technical field

The invention relates to the technical field of measurement and evaluation, in particular to a method, device, mobile phone, computer equipment and storage medium for skin evaluation.

Background technique

With the improvement of people's requirements for quality of life, people are paying more and more attention to the health of skin. At present, the skin condition is mainly detected by a skin tester. The skin tester is mainly used in beauty and medical treatment, including desktop, special for TV, special for computer, single function, and multi-functional comprehensive. The skin tester can measure human skin condition qualitatively and quantitatively. The beauty and medical industries have been actively developing related technologies to meet market demand. In the process of implementing the present invention, the inventor found that there are at least the following problems in the prior art: the skin tester has a high degree of specialization, requires special personnel to operate, and the subjects need to undergo strict training in advance, and can only be obtained by interpretation by professionals The skin condition of the examinee. This leads to inconvenient skin evaluation.

Summary of the invention

Based on this, the embodiments of the present invention provide skin evaluation methods, devices, mobile phones, computer equipment, and storage media, which can conveniently implement skin evaluation.

The contents of the embodiments of the present invention are as follows:

A skin evaluation method includes the following steps: sending an illumination instruction to an illumination unit; the illumination instruction is used to trigger the illumination unit to emit specific skin test light; the skin test light is used to illuminate a subject's skin; Acquire a skin image captured by the photographing device; the skin image includes an image of the skin of the subject when the skin test light is irradiated; and evaluate the skin state of the subject based on the skin image.

In one of the embodiments, the step of evaluating the skin state of the subject based on the skin image includes: comparing the skin image with a plurality of skin reference images, and determining the skin state according to the comparison result Parameters; evaluating the skin condition of the subject based on the skin condition parameters.

In one of the embodiments, the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes: comparing the first skin image with the plurality of skin color reference images Yes; determine the skin color reference image matching the first skin image according to the comparison result, and determine the skin color corresponding to the matching skin color reference image as the skin color of the subject's skin; the first skin The image includes the skin image when the subject's skin is illuminated with white light.

In one of the embodiments, the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes: performing the second skin image with the plurality of red blood filament reference images Comparison; according to the comparison result, a red blood capillary reference image matching the second skin image is determined, and the red blood capillary value corresponding to the matched red blood capillary reference image is determined as the red blood capillary of the subject's skin Value; the second skin image includes the skin image of the subject's skin when irradiated with infrared light.

In one of the embodiments, the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes: performing a third skin image with the plurality of porphyrin reference images Comparison; determining a porphyrin reference image matching the third skin image according to the comparison result, and determining the porphyrin value corresponding to the matching porphyrin reference image as the porphyrin of the subject's skin Value; the third skin image includes the skin image of the subject's skin when irradiated with ultraviolet light.

In one embodiment, after the step of determining the skin state parameter according to the comparison result, the method further includes: determining a candidate skin state parameter with the highest matching degree with the skin state parameter from the skin state database; the skin state The database contains candidate skin state parameters and a mapping table of candidate skin state parameters and cosmetic information; the corresponding cosmetic information is determined according to the candidate skin state parameter with the highest matching degree and the mapping table, and the cosmetic information is output through an output device .

In one of the embodiments, the step of evaluating the skin condition of the subject based on the skin image includes: determining the size and shape of the dark area in the skin image when irradiating white light; according to the size and shape Determine the skin morphology to which the dark area belongs; the skin morphology includes spots, pores, and wrinkles; and determine the skin condition of the subject according to the skin morphology of the dark area.

In one of the embodiments, before the step of sending the irradiation instruction to the lighting unit, the method further includes: acquiring a calibration image of the skin evaluation site of the subject collected by the photographing device, and comparing the calibration image with a predetermined reference frame Compare; when the deviation between the calibration image and the reference frame does not meet the preset conditions, output a deviation prompt; when the deviation meets the preset conditions, send an illumination instruction to the front lighting unit; The front lighting unit is set on the phone.

Correspondingly, an embodiment of the present invention provides a skin evaluation device, including: an instruction sending module, configured to send an illumination instruction to an illumination unit; the illumination instruction is used to trigger the illumination unit to emit specific skin test light; The skin test light is used to illuminate the skin of the subject; the skin image acquisition module is used to acquire the skin image captured by the photographing device; the skin image includes an image of the skin of the subject when the skin test light is irradiated; and, The skin condition evaluation module is used to evaluate the skin condition of the subject based on the skin image.

A skin evaluation mobile phone is also provided, including: an illumination unit, a photographing device, and a processing unit; the processing unit is used to send an illumination instruction to the illumination unit; and the illumination unit is used to emit specific skin test light according to the illumination instruction The skin test light is used to irradiate the skin of the subject; the photographing device is used to photograph the skin image of the skin of the subject when the skin test light is irradiated, and the skin image is sent to the process Unit; the processing unit is also used to evaluate the skin condition of the subject based on the skin image.

The skin evaluation method, device, and mobile phone described above control the lighting unit to emit specific skin test light, and can conveniently analyze the skin condition of the subject according to the skin image taken under the specific light source.

A computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented: sending an irradiation instruction to an illumination unit; the irradiation The instruction is used to trigger the lighting unit to emit specific skin test light; the skin test light is used to illuminate the skin of the subject; the skin image captured by the shooting device is acquired; the skin image includes the skin of the subject. An image of skin test light irradiation; assess the skin condition of the subject based on the skin image.

The above computer device controls the lighting unit to emit specific skin test light, and can conveniently analyze the skin condition of the subject according to the skin image taken under the specific light source.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented: sending an irradiation instruction to a lighting unit; the irradiation instruction is used to trigger the lighting unit to emit a specific skin Test light; the skin test light is used to irradiate the skin of the subject; the skin image captured by the photographing device is acquired; the skin image includes the image of the skin of the subject when the skin test light is irradiated; according to the skin The image assesses the skin condition of the subject.

The above-mentioned computer-readable storage medium controls the lighting unit to emit specific skin test light, and can conveniently analyze the skin state of the subject according to the skin image taken under the specific light source.

BRIEF DESCRIPTION

FIG. 1 is an application environment diagram of a skin evaluation method in an embodiment;

FIG. 2 is a schematic flowchart of a skin evaluation method in an embodiment;

FIG. 3 is a schematic flowchart of a skin evaluation method in another embodiment;

4 is a schematic flowchart of a skin evaluation method in still another embodiment;

FIG. 5 is a structural block diagram of a skin evaluation device in an embodiment;

FIG. 6 is a structural block diagram of a skin evaluation mobile phone in an embodiment.

detailed description

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not intended to limit the present invention.

The skin evaluation method provided in this application can be applied to the computer device shown in FIG. 1. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 1. The computer device includes a processor, memory, network interface, and database connected by a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database of the computer device is used to store data such as skin images, skin reference images, and reference frames. The network interface of the computer device is used to communicate with external terminals through a network connection. When the computer program is executed by the processor, a skin evaluation method is realized. The computer device may also be a smart terminal such as a mobile phone. The smart terminal emits skin test light to illuminate the skin of the subject, and then analyzes the skin state of the subject based on the skin image.

Those skilled in the art can understand that the structure shown in FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may Include more or less components than shown in the figure, or combine certain components, or have a different arrangement of components.

Embodiments of the present invention provide a skin evaluation method, device, mobile phone, computer equipment, and storage medium. The details are described below.

In one embodiment, as shown in FIG. 2, a skin evaluation method is provided. Taking this method applied to the processor side in FIG. 1 as an example for description, it includes the following steps:

S201. Send an illumination instruction to the illumination unit; the illumination instruction is used to trigger the illumination unit to emit specific skin test light; and the skin test light is used to illuminate the skin of the subject.

In this step, the processor sends an illumination instruction to the illumination unit, and the illumination unit emits specific skin test light according to the illumination instruction to illuminate the skin of the subject.

Among them, the illumination unit refers to a structure that can emit light and has an illumination function, and can refer to an illumination lamp, a flashlight, and the like. The lighting unit may be composed of a plurality of light bulbs, which can selectively emit skin test light (different light bulbs can emit the same or different skin test light). The lighting unit can be set on a skin tester, mobile phone, etc. When it is installed on a mobile phone, the lighting unit may refer to the front lighting unit or the rear lighting unit (for example, through a flash, etc.).

Skin test light refers to light that can illuminate the skin of the subject to make the skin more clearly show the skin state, which can be white light, infrared light, ultraviolet light, etc. The subject may refer to humans, animals, and the like. The skin of the subject may refer to the skin of the face, the skin of the hand, or the skin of other parts.

In addition, the irradiation instruction may include the category information of the skin test light. For example, if the irradiation instruction includes information to emit white light, the lighting unit emits white light after receiving the irradiation instruction.

S202: Acquire a skin image captured by a photographing device; the skin image includes an image of a subject's skin when the skin test light is irradiated.

In this step, when the skin test light illuminates the skin of the subject, the photographing device photographs the skin of the subject, obtains the corresponding skin image, and sends the skin image to the processor.

S203. Assess the skin condition of the subject based on the skin image.

Among them, the skin state refers to the state of the subject's skin, and the subject can objectively understand his skin condition according to the skin state. The skin condition may be skin color, red blood condition, porphyrin condition, pores, stains, wrinkles, moisture content, oiliness, etc.

In this embodiment, the lighting unit is controlled to emit specific skin test light, and the skin state of the subject can be conveniently analyzed according to the skin image taken under the specific light source, and the implementation process is simple.

In one embodiment, the step of sending an illumination instruction to the illumination unit includes: sending an illumination instruction to the front illumination unit; the front illumination unit is provided on the mobile phone.

The mobile phone in this embodiment includes a front lighting unit that can emit skin test light to illuminate the skin of the subject. The mobile phone may refer to a mobile phone currently in common use, and it may have a front lighting unit and a front camera. Other functions in the mobile phone, such as: surfing the Internet, making a call, connecting to WIFI, etc., can be used normally. When the skin is illuminated by the front lighting unit, the corresponding shooting device may refer to the front camera of the mobile phone. In addition, an adjustment button or touch button for adjusting the front lighting unit and the front camera can be set on the mobile phone, and the subject can adjust the shooting state during the skin evaluation according to their own conditions, such as setting the focal length and other shooting parameters when the camera scans.

The realization process of acquiring the skin image may be: the subject points the front of the mobile phone at his face and presses the trigger button of the front lighting unit; the front lighting unit emits a specific skin test light; the subject presses again before pressing When the adjustment button of the camera is set, the front camera takes a picture of the face of the subject, and the face image can be used as the skin image. Of course, the front lighting unit and the front camera can be triggered at the same time, that is, after the subject presses the "photograph skin" button, the front lighting unit emits skin test light to illuminate the subject's skin. The front camera takes a picture of the subject's skin.

The process of determining the skin condition of the subject may be as shown in FIG. 3, which includes the following steps: S301. Adjust the relative distance between the subject and the mobile phone to obtain a better shooting position. S302. The skin image of the subject's face is photographed by using the front lighting unit of the mobile phone and the camera. S303. Determine the skin condition of the subject according to the skin image obtained by shooting.

In addition, as shown in FIG. 3, the step of sending an irradiation instruction to the lighting unit further includes: acquiring a calibration image of the skin evaluation site of the subject collected by the photographing device, and comparing the calibration image with a predetermined reference frame Yes; when the deviation between the calibration image and the reference frame does not meet the preset conditions, a deviation prompt is output; when the deviation meets the preset conditions, an illumination instruction is sent to the front lighting unit; the front The lighting unit is set on the phone.

The purpose of the output deviation prompt is to prompt the subject to adjust the face position or angle to achieve a better shooting position. The preferred shooting position means that the positional deviation between the calibration image and the reference frame is less than the deviation threshold. The deviation threshold may be: the plane position deviation is 1 cm, and the inclination deviation is 5%. Performing shooting calibration during picture shooting can obtain a better shooting position, thereby ensuring accuracy and repeatability of the evaluation. At the same time, the output deviation prompt can be carried out by text, voice, picture, video.

The reference frame can be a frame of any selected face shape, and its role is to ensure that the picture clarity and shooting angle obtained by repeated repeated photographing are consistent, thereby ensuring the accuracy and repeatability of the evaluation, which is beneficial to the subsequent Picture analysis and data processing. On the other hand, when the skin image is taken, the positional calibration may not be performed, but the acquired skin image may be subjected to picture processing, so that the state of the compared skin image is more consistent.

Taking the skin evaluation part as a face as an example, the process of achieving a better shooting position may be: collecting a face image for calibration; comparing the collected face image for calibration with a preset reference face frame, on the mobile phone The position deviation is displayed on the screen, and then the subject adjusts the relative distance between the mobile phone and the face until the position deviation falls within the control range to achieve a better shooting position.

Traditional skin evaluation is mainly achieved through skin testers, such as the following skin testers: MPA10 multi-function skin tester from CK company in Germany. The host itself contains a grease test probe and nine skin test probe connection holes, which can be connected to up to nine The same or different skin test probes; American Visia skin analyzer, composed of a host computer and supporting computer, using multi-spectral photography to measure the skin surface and subcutaneous conditions, measuring the skin spots, wrinkles, texture, ultraviolet spots, pores, brown Spots, red areas, purple matter and other data. However, the current skin tester is too specialized and requires special personnel to operate. The test subject needs strict training in advance, and the data after the test needs to be interpreted by professionals to obtain the skin condition of the testee. In addition, although the skin tester provided by the prior art has been researched and tried in product miniaturization and portability, it still has the problems of poor performance, single function, and inconvenient carrying. Therefore, the skin tester provided by the prior art is difficult to popularize to ordinary consumers. On the other hand, mobile phones have become the world's most widely used integrated platform with functions such as communication, payment, photography, digital and graphic processing. Smart phones are an open carrier, and it is a trend to integrate various tools related to people's work and life into mobile phones.

In this embodiment, the skin test light is emitted through the front lighting unit of the mobile phone, and then the skin image of the subject is taken to determine the skin state of the subject. The mobile phone is for ordinary consumers. As long as the subject has a mobile phone with a front light unit, they can easily know their skin condition, which greatly facilitates people's understanding of their skin condition.

In one embodiment, the step of evaluating the skin state of the subject based on the skin image includes: comparing the skin image with a plurality of skin reference images, and determining skin state parameters according to the comparison result ; Evaluate the skin condition of the subject based on the skin condition parameters.

The skin reference image refers to a skin image corresponding to a certain skin state parameter (or skin state parameter range). Since the skin state may include multiple levels, the skin state parameters of these levels may correspond to different skin reference images. After acquiring the skin image, the skin image is compared with each skin reference image, and the skin state parameter corresponding to the closest skin reference image is the subject's skin state parameter.

In addition, the skin test light emitted by the mobile phone when acquiring the skin image and the skin reference image and the environmental conditions (external light, focal length, etc.) should be consistent to prevent environmental factors such as brightness from affecting the accuracy of the skin condition. After the skin reference image is taken, the focal length at the time of shooting can be stored in the mobile phone memory together with the skin reference image, so that it can be recalled when the skin image is acquired later.

When comparing the skin image with the skin reference image, the average value of the skin state parameter of each pixel in the skin image and the skin reference image can be determined separately, and the average value of the skin state parameters of the two can be compared; or a single pixel Comparison.

The corresponding relationship between the skin state parameter and the skin state can be determined in advance. When the skin state parameter of a certain subject is determined, the skin state information that can be easily understood by the subject can be determined according to the corresponding relationship.

In this embodiment, the skin state parameter corresponding to the acquired skin image is determined according to the skin reference image, and then the subject's skin state is evaluated according to the skin state parameter, and the subject's skin state can be accurately determined.

As shown in FIG. 4, after adjusting the relative position of the subject and the mobile phone to obtain a better shooting position (S401), the process of determining the skin state parameters based on the skin image is also included. Example implementation:

In one embodiment, the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes: comparing the first skin image with the plurality of skin color reference images; The comparison result determines a skin color reference image matching the first skin image, and determines the skin color corresponding to the matching skin color reference image as the skin color of the subject's skin; the first skin image includes The skin image of the test subject's skin when illuminated with white light.

As shown in FIG. 4, the specific implementation process of determining the skin color can be:

S402. The front light unit of the mobile phone emits white light to illuminate the face of the subject, and at the same time, the front camera is used to photograph the skin of the face of the subject and generate a corresponding first skin image. The first skin image is stored in the memory of the mobile phone.

S403. The front light unit of the mobile phone is used to emit white light to illuminate the faces of different volunteers with predetermined skin color from good to poor (the volunteers used for specific selection refer to the habits of the beauty industry), and at the same time use the front camera to take pictures of the volunteers' faces Image, and generate multiple skin color reference images (also called standard series images) with reference chroma. The skin color reference image divides the skin color under the white light into multiple standard partitions, and each standard partition has a certain range of reference skin color values. It should be understood that in order to ensure the accuracy of the subsequent determination of the skin color, the shooting is the same as the shooting conditions in step S402, that is, shooting is performed under the same environmental conditions and the same focal length.

S404. Compare and match the first skin image with the obtained multiple skin color reference images. During the comparison process, determine which standard partition skin color reference image the first skin image is closest to, that is, determine the color of the standard series of images The skin color reference image with the smallest degree difference value, and the corresponding nearest standard partition represents the skin color, that is, skin color.

In addition, the determination of the skin state parameters can be distinguished according to the individual situation, when distinguishing can be divided into men and women, age (for example: under 15 years old, 15 to 25 years old, 25 to 35 years old, 35 to 45 years old, 45 to 55 years old, 55 ~ 65 years old, over 65 years old), etc., each gender and age can correspond to different skin color reference images. Taking a 30-year-old female as a subject for example, a skin color reference image of a 25-35 year-old female can be found as the skin color reference image of the subject, and then the skin condition parameters can be determined. Of course, the determination of the skin state parameters may not be distinguished according to individual conditions.

Further, when the skin of the subject is irradiated with white light, the skin morphology of the dark area in the skin of the subject can be determined: the step of evaluating the skin condition of the subject based on the skin image includes: The size and shape of the dark area in the first skin image at the time; the skin morphology to which the dark area belongs is determined according to the size and shape (S405); the skin morphology includes spots, pores and wrinkles; according to the deep The skin morphology of the colored area determines the skin condition of the subject.

The dark area refers to an area with a higher color value (RGB value, etc.) than the surrounding area.

The realization process of determining the skin morphology may be: irradiating the skin of the subject with white light to determine the average focal length when the skin color is taken as the focal length to take a skin image, determine the number of pixels contained in each dark area in the skin image, and then The number of pixels in each dark area determines the size and shape of each dark area in the skin image. When the dark area is a block or point distribution: the diameter greater than 0.1mm is judged to be spots, and the judgment is less than or equal to 0.1mm as pores; when the dark area is elongated, it is judged to be wrinkles. Finally, the distribution of spots, pores and wrinkles were counted. Of course, you can also combine other information in the image to determine the skin shape to which the dark area belongs. For example, perform a frequency analysis on the skin image, and determine the area where the frequency is high and the distribution is elongated as wrinkles.

The shooting conditions for determining the morphology of the skin may be the same as the shooting conditions for determining the skin color, or may be different. In addition, the skin image used when determining the skin shape to which it belongs can also directly use the first skin image when determining the skin color.

In addition, when determining the skin condition, the subject may also irradiate other types of light than white light. The embodiment of the present invention does not limit the specific light, and the spots, pores and wrinkles of the subject can be determined.

In this embodiment, the mobile phone is controlled to emit white light, and the skin color of the subject is determined according to the obtained first skin image and the predetermined skin color reference image. The determination process is simple; the results obtained at the same time are intuitive.

In one embodiment, the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes: comparing the second skin image with the plurality of red blood streak reference images Yes; according to the comparison result, a red blood capillary reference image matching the second skin image is determined, and the red blood capillary value corresponding to the matching red blood capillary reference image is determined as the red blood capillary value of the subject's skin The second skin image includes the skin image of the subject's skin when irradiated with infrared light.

The infrared light may refer to infrared polarized light.

As shown in FIG. 4, the specific implementation process of determining the skin red blood value may be:

S406. The front light unit of the mobile phone emits infrared light to illuminate the face of the subject, and at the same time, the front camera is used to photograph the skin of the face of the subject and generate a corresponding second skin image. The second skin image is stored in the memory of the mobile phone.

S407. The front light unit of the mobile phone is used to emit infrared light to illuminate different volunteers 'faces from the best to the poor, and at the same time, the front camera is used to capture the images of the volunteers' faces to generate red blood capillaries with reference chromaticity. Reference image. The red blood capillary reference image limits the chromaticity of the skin under infrared light irradiation to multiple standard divisions, and each standard division has a range of reference red capillary values. It should be understood that, in order to ensure the accuracy of the subsequent determination of the skin redness value, the shooting process is the same as the shooting conditions in the above step S406.

S408. Match and match the second skin image and the red blood reference image. During the comparison, determine which standard partition of the red blood reference image is closest to the second skin image, and the closest standard partition represents the red blood value It is the red blood value of the subject's skin.

In this embodiment, the mobile phone is controlled to emit infrared light, and the red blood capillary value of the subject's skin is determined according to the obtained second skin image and the predetermined red blood capillary reference image. The determination process is simple; the results obtained at the same time are intuitive.

In one embodiment, the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes: comparing the third skin image with the plurality of porphyrin reference images Yes; determine the porphyrin reference image matching the third skin image according to the comparison result, and determine the porphyrin value corresponding to the matching porphyrin reference image as the porphyrin value of the subject's skin The third skin image includes the skin image of the subject's skin when irradiated with ultraviolet light.

As shown in FIG. 4, the specific implementation process of determining the skin porphyrin value may be:

S409. The front light unit of the mobile phone emits ultraviolet light to illuminate the face of the subject, and at the same time, the front camera is used to photograph the skin of the face of the subject and generate a corresponding third skin image. The third skin image is stored in the memory of the mobile phone.

S410. Using the front-light unit of the mobile phone to emit ultraviolet light to illuminate the faces of different volunteers with predetermined to poor porphyrin problems. At the same time, the front-facing camera is used to capture the volunteer images and generate a porphyrin reference image with chromaticity. . The porphyrin reference image defines the chromaticity of the skin under ultraviolet light irradiation into multiple standard divisions, and each standard division has a range of reference porphyrin values. It should be understood that, in order to ensure the accuracy when subsequently determining the skin porphyrin value, the shooting process is the same as the shooting conditions in step S409 described above.

S411. Compare and match the third skin image with the porphyrin reference image. During the comparison, determine which standard partition of the porphyrin reference image the third skin image is closest to, and the closest standard partition represents the porphyrin value. This is the porphyrin value of the subject's skin.

Then, step S412 of determining the skin state of the subject according to the skin state parameter is included.

In this embodiment, the mobile phone is controlled to emit ultraviolet light, and the porphyrin value of the subject's skin is determined based on the obtained third skin image and the predetermined porphyrin reference image. The determination process is simple; the results obtained at the same time are intuitive.

In one embodiment, after the step of determining the skin state parameter according to the comparison result, the method further includes: determining the candidate skin state parameter with the highest matching degree with the skin state parameter from the skin state database; the skin state database It contains candidate skin state parameters and a mapping table of candidate skin state parameters and cosmetic information; the corresponding cosmetic information is determined according to the candidate skin state parameter with the highest matching degree and the mapping table, and the cosmetic information is output through an output device.

Among them, the output device may be a mobile phone screen, a speaker, and so on. You can output cosmetic information through text, voice, and video.

In addition, the cosmetics may also include skin care products.

The skin state database can be established as follows: (1) Find male and female volunteers of different ages and skin types; perform skin tests on the volunteers to determine the value range of the skin state parameters corresponding to healthy skin and problem skin, so as to Summarize the value table of candidate skin state parameters. (2) Collect cosmetics on the market and classify them according to efficacy to get a cosmetics catalog. (3) Determine the mapping table of the candidate skin state parameters and the cosmetics catalog according to the efficacy of the cosmetics.

In addition, if no matching candidate skin condition parameters are found, general-purpose cosmetics can also be recommended to the subject.

In this embodiment, the cosmetics suitable for the subject are determined according to the skin state of the subject, the function of reasonably recommending cosmetics according to the skin state of the user is realized, and the user experience is improved.

In order to better understand the above method, an application example of the skin evaluation method of the present invention is elaborated below.

1. Use the front camera of the mobile phone to capture the face of the subject and collect the face image for calibration; then compare the collected face image for calibration with the preset reference frame to display the positional deviation of the two on the screen . The subject adjusted the relative distance or angle between the mobile phone and the face until the position deviation fell within the controllable range to obtain a better shooting position.

2. The front-illumination unit of the mobile phone emits specific skin test light to illuminate the face of the subject, and at the same time, the front-facing camera is used to capture the image of the face of the subject.

3. The processor of the mobile phone calls the skin image in the memory, and then calculates the skin condition parameters such as spots, wrinkles, skin color, pores, red blood count and porphyrin value of the subject's skin based on the analysis and calculation.

4. The processor determines the skin state of the subject based on the calculated skin state parameters.

5. The processor calls the standard skin state database in the memory, performs matching calculation with the subject's skin state parameters, and then recommends cosmetics for the subject according to the matching situation.

In this embodiment, the lighting unit is controlled to emit specific skin test light, which can conveniently analyze the skin condition of the subject according to the skin image taken under the specific light source, and then recommend suitable cosmetics for the subject, which are used by ordinary consumers Very convenient.

It should be noted that, for the convenience of description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the sequence of actions described because According to the invention, certain steps may be performed in other orders or simultaneously.

Based on the same idea as the skin evaluation method in the above embodiment, the present invention also provides a skin evaluation device, which can be used to execute the skin evaluation method. For ease of explanation, the structural schematic diagram of the embodiment of the skin evaluation device only shows the parts related to the embodiment of the present invention. Those skilled in the art can understand that the illustrated structure does not constitute a limitation to the device, and may include a comparison chart. Show more or fewer parts, or combine some parts, or arrange different parts.

As shown in FIG. 5, the skin evaluation device includes an instruction sending module 501, a skin image acquisition module 502, and a skin condition evaluation module 503, which are described in detail as follows:

The instruction sending module 501 is used to send an irradiation instruction to the lighting unit; the irradiation instruction is used to trigger the lighting unit to emit specific skin test light; and the skin test light is used to illuminate the skin of the subject.

The skin image acquisition module 502 is used to acquire a skin image captured by a photographing device; the skin image includes an image of a subject's skin when the skin test light is irradiated.

And, the skin condition evaluation module 503 is used to evaluate the skin condition of the subject based on the skin image.

In this embodiment, the lighting unit is controlled to emit specific skin test light, and the skin condition of the subject can be conveniently analyzed according to the skin image captured under the specific light source.

In one embodiment, the skin state evaluation module 503 includes: a state parameter determination sub-module for comparing the skin image with a plurality of skin reference images, and determining a skin state parameter according to the comparison result; a skin state determination sub The module is used for evaluating the skin state of the subject according to the skin state parameter.

In one embodiment, the state parameter determination sub-module is further used to compare the first skin image with multiple skin color reference images; determine the skin color reference image matching the first skin image according to the comparison result, The skin color corresponding to the matched skin color reference image is determined to be the skin color of the subject's skin; the first skin image includes the skin image of the subject's skin when irradiated with white light.

In one embodiment, the state parameter determination sub-module is also used to compare the second skin image with a plurality of red blood capillary reference images; according to the comparison result, a red blood capillary reference matching the second skin image is determined Image, the red blood capillary value corresponding to the matched red blood capillary reference image is determined as the red blood capillary value of the subject's skin; the second skin image includes the skin image of the subject's skin when the infrared light is irradiated.

In one embodiment, the state parameter determination sub-module is also used to compare the third skin image with multiple porphyrin reference images; and determine the porphyrin reference matching the third skin image according to the comparison result Image, the porphyrin value corresponding to the matched porphyrin reference image is determined as the porphyrin value of the subject's skin; the third skin image includes the skin image of the subject's skin when irradiated with ultraviolet light.

In one embodiment, the skin state evaluation module 503 further includes: a candidate parameter determination sub-module for determining the candidate skin state parameter with the highest matching degree with the skin state parameter from the skin state database; the skin state database Contains candidate skin state parameters and a mapping table of candidate skin state parameters and cosmetic information; a cosmetic information determination submodule is used to determine corresponding cosmetic information according to the candidate skin state parameter with the highest matching degree and the mapping table, by The output device outputs the cosmetic information.

In one embodiment, the skin state evaluation module 503 includes: a morphology determination sub-module for determining the size and shape of the dark area in the skin image when irradiating white light; a skin state determination sub-module for determining the size and The shape determines the skin morphology to which the dark area belongs; the skin morphology includes spots, pores, and wrinkles; the skin state determination submodule is used to determine the skin condition of the subject according to the skin morphology of the dark area.

In one embodiment, the method further includes: a comparison module for acquiring a calibration image of the skin evaluation part of the subject collected by the photographing device, and comparing the calibration image with a predetermined reference frame; a prompt module, It is used to output a deviation prompt when the deviation between the calibration image and the reference frame does not meet the preset condition; an illumination instruction sending module is used to send to the front lighting unit when the deviation meets the preset condition Irradiation instruction; the front lighting unit is set on the mobile phone.

In one embodiment, a skin evaluation mobile phone is also provided, including: an illumination unit, a photographing device, and a processing unit; the processing unit is used to send an illumination instruction to the illumination unit; and the illumination unit is used according to the illumination instruction Emit specific skin test light; the skin test light is used to irradiate the skin of the subject; the photographing device is used to photograph a skin image of the skin of the subject when the skin test light is irradiated, and the skin The image is sent to the processing unit; the processing unit is also used to evaluate the skin condition of the subject based on the skin image.

As shown in FIG. 6, the lighting unit in the skin evaluation mobile phone is a front lighting unit 602, and the shooting device is a front camera 603. In addition, the evaluation mobile phone may further include a storage unit 604 and a display unit 605.

The processing unit 601 is a core component, which can compare the collected face image for calibration with a preset reference face frame, and calculate the position deviation. The processing unit 601 may calculate the skin state parameter according to the skin image obtained by shooting, and determine the skin state of the subject according to the calculated skin state parameter. Specifically, the processing unit 601 compares the skin image captured by the camera with a predetermined skin reference image, acquires the chromaticity difference between the chromaticity of the skin image and the reference chromaticity of the standard image, and determines the skin color according to the chromaticity difference , Red blood count and porphyrin value. The processing unit 601 can obtain the image of each dark area in the skin image and the number of pixels included according to the focal length and the skin image when photographing the skin of the subject, calculate the size and shape of each dark area in the skin image, and further Determine whether the dark areas are spots, pores or wrinkles, and finally count the distribution of spots, pores and wrinkles respectively.

The front lighting unit 602 includes a plurality of light bulbs that emit light of different wavelengths, and can selectively emit white light, ultraviolet light, and infrared light for illuminating the face of the subject.

The front camera 603 is used to photograph the skin of the subject, and the photographing process can generate a skin image. This shooting operation can be completed by using the existing camera function of the camera.

The storage unit 604 is used to store the skin image generated by the front camera 603 and related parameters at the time of shooting, such as focal length, ambient light, and so on. On the other hand, the storage unit 604 also stores skin state parameters, candidate skin state parameters involved in determining the skin state, skin care suggestions corresponding to different skin states, skin state parameter value tables, cosmetic catalogs, spots / wrinkles / skin tone / Calculation results of pore / red blood count value / porphyrin value, relevant skin reference images, etc.

The display unit 605 is a necessary component of the mobile phone. In the present invention, it is used to output the calculated skin state parameters, candidate skin state parameters, skin states determined by comparison, and skin care suggestions. Pictures and text messages.

The evaluation mobile phone in this embodiment controls the front lighting unit to emit specific skin test light, which can conveniently analyze the skin state of the subject according to the skin image taken under the specific light source, and it is very convenient to use.

It should be noted that the skin evaluation device of the present invention and the mobile phone correspond to the skin evaluation method of the present invention one by one, and the technical features and beneficial effects described in the above embodiments of the skin evaluation method are applicable to the skin evaluation device 1. In the embodiment of the mobile phone, for specific content, please refer to the description in the method embodiment of the present invention.

In addition, in the embodiments of the skin evaluation device and the mobile phone in the above examples, the logical division of each module (unit) is only an example, and in actual applications, it can be based on needs, for example, due to the configuration requirements of the corresponding hardware or the convenience of software implementation Consider that the above function allocation is performed by different program modules, that is, the internal structure of the skin evaluation device and the mobile phone is divided into different program modules to complete all or part of the functions described above.

In one embodiment, a computer device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented: sending an illumination instruction to the lighting unit The irradiation instruction is used to trigger the lighting unit to emit specific skin test light; the skin test light is used to illuminate the skin of the subject; the skin image captured by the photographing device is acquired; the skin image includes the subject's An image of the skin when it is illuminated by the skin test light; the skin condition of the subject is evaluated based on the skin image.

In one embodiment, the processor also implements the following steps when executing the computer program: comparing the skin image with a plurality of skin reference images, determining the skin state parameter according to the comparison result; evaluating the skin state parameter according to the skin state parameter Subject's skin condition.

In one embodiment, the processor also implements the following steps when executing the computer program: comparing the first skin image with multiple skin color reference images; determining the skin color reference matching the first skin image according to the comparison result An image, the skin color corresponding to the matched skin color reference image is determined as the skin color of the subject's skin; the first skin image includes the skin image of the subject's skin when irradiated with white light.

In one embodiment, the processor further implements the following steps when executing the computer program: comparing the second skin image with a plurality of red blood reference images; determining a red color matching the second skin image according to the comparison result A blood capillary reference image, the red blood capillary value corresponding to the matched red blood capillary reference image is determined as the red blood capillary value of the subject's skin; the second skin image includes the skin of the subject's skin when irradiated with infrared light image.

In one embodiment, the processor also implements the following steps when executing the computer program: comparing the third skin image with a plurality of porphyrin reference images; determining the porphyry matching the third skin image according to the comparison result A porphyrin reference image, the porphyrin value corresponding to the matched porphyrin reference image is determined as the porphyrin value of the subject's skin; the third skin image includes the skin of the subject's skin when irradiated with ultraviolet light image.

In one embodiment, the processor also implements the following steps when executing the computer program: determining the candidate skin state parameter with the highest matching degree with the skin state parameter from the skin state database; the skin state database contains the candidate skin state A mapping table of parameters and candidate skin state parameters and cosmetic information; determining corresponding cosmetic information according to the candidate skin state parameter with the highest matching degree and the mapping table, and outputting the cosmetic information through an output device.

In one embodiment, the processor also implements the following steps when executing the computer program: determining the size and shape of the dark area in the skin image when illuminating white light; determining the skin shape to which the dark area belongs according to the size and shape; The skin morphology includes spots, pores, and wrinkles; the skin condition of the subject is determined according to the skin morphology of the dark area.

In one embodiment, the processor also implements the following steps when executing the computer program: acquiring a calibration image of the skin evaluation site of the subject collected by the photographing device, and comparing the calibration image with a predetermined reference frame; when When the deviation between the calibration image and the reference frame does not meet the preset conditions, a deviation prompt is output; when the deviation meets the preset conditions, an illumination instruction is sent to the front lighting unit; the front lighting unit settings On the phone.

In one embodiment, a computer-readable storage medium is provided on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: sending an irradiation instruction to an illumination unit; the irradiation instruction is used to trigger the The lighting unit emits specific skin test light; the skin test light is used to illuminate the skin of the subject; the skin image captured by the shooting device is acquired; the skin image includes the skin of the subject when the skin test light is irradiated Image; assess the skin condition of the subject based on the skin image.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: comparing the skin image with a plurality of skin reference images, determining the skin state parameter according to the comparison result; evaluating the skin state parameter according to the skin state parameter Describe the skin condition of the subject.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: comparing the first skin image with multiple skin color reference images; determining the skin color matching the first skin image according to the comparison result The reference image determines the skin color corresponding to the matching skin color reference image as the skin color of the subject's skin; the first skin image includes the skin image when the subject's skin is irradiated with white light.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: comparing the second skin image with a plurality of red blood filament reference images; determining, according to the comparison result, a match with the second skin image A red blood capillary reference image, the red blood capillary value corresponding to the matched red blood capillary reference image is determined as the red blood capillary value of the subject's skin; the second skin image includes when the subject's skin is illuminated with infrared light Skin image.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: comparing the third skin image with a plurality of porphyrin reference images; according to the comparison result, determining a match with the third skin image A porphyrin reference image, the porphyrin value corresponding to the matched porphyrin reference image is determined to be the porphyrin value of the subject's skin; the third skin image includes when the subject's skin is irradiated with ultraviolet light Skin image.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: the candidate skin state parameter with the highest matching degree with the skin state parameter is determined from the skin state database; the skin state database contains the candidate skin A mapping table of status parameters and candidate skin status parameters and cosmetic information; determining corresponding cosmetic information according to the candidate skin status parameter with the highest matching degree and the mapping table, and outputting the cosmetic information through an output device.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining the size and shape of the dark area in the skin image when illuminating white light; determining the skin shape to which the dark area belongs according to the size and shape The skin morphology includes spots, pores, and wrinkles; the skin condition of the subject is determined according to the skin morphology of the dark area.

In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: before the step of sending the illumination instruction to the illumination unit, the method further includes: acquiring a calibration image of the skin evaluation site of the subject collected by the photographing device, and Comparing the calibration image with a predetermined reference frame; when the deviation between the calibration image and the reference frame does not satisfy the preset condition, a deviation prompt is output; when the deviation meets the preset condition, Send an illumination instruction to the front lighting unit; the front lighting unit is set on the mobile phone.

A person of ordinary skill in the art may understand that all or part of the process in the method in the above embodiments may be completed by instructing relevant hardware through a computer program, and the program may be stored in a computer-readable storage medium as Independent product sales or use. More specific examples of computer-readable media (non-exhaustive list) include the following: electrical connections (electronic devices) with one or more wires, portable computer cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other appropriate if necessary Process to obtain the program electronically and then store it in computer memory.

It should be understood that each part of the present invention may be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: a logic gate circuit for implementing a logic function on a data signal Discrete logic circuits, dedicated integrated circuits with appropriate combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

The terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or (module) units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optional The ground also includes other steps or units inherent to these processes, methods, products, or equipment.

The technical features of the above-mentioned embodiments can be arbitrarily combined. To simplify the description, all possible combinations of the technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, All should be considered within the scope of this description.

The above-mentioned embodiment only expresses several embodiments of the present invention, and cannot be construed as limiting the patent scope of the present invention. It should be noted that, those of ordinary skill in the art, without departing from the concept of the present invention, can also make several modifications and improvements, which all fall within the protection scope of the present invention. Therefore, the protection scope of the invention patent shall be subject to the appended claims.

Claims

A skin evaluation method, which is characterized by the following steps:

Sending an irradiation instruction to the illumination unit; the irradiation instruction is used to trigger the illumination unit to emit specific skin test light; the skin test light is used to illuminate the skin of the subject;

Acquiring a skin image captured by a photographing device; the skin image includes an image of a subject's skin when the skin test light is irradiated;

The skin condition of the subject is evaluated based on the skin image.
The skin evaluation method according to claim 1, wherein the step of evaluating the skin condition of the subject based on the skin image includes:

Comparing the skin image with a plurality of skin reference images, and determining skin state parameters according to the comparison result;

The skin condition of the subject is evaluated based on the skin condition parameters.
The skin evaluation method according to claim 2, wherein the step of comparing the skin image with a plurality of skin reference images and determining the skin state parameter according to the comparison result includes:

Comparing the first skin image with a plurality of skin color reference images; determining the skin color reference image matching the first skin image according to the comparison result, and determining the skin color corresponding to the matching skin color reference image as the The skin color of the subject's skin; the first skin image includes the skin image of the subject's skin when irradiated with white light;

and / or,

Comparing the second skin image with a plurality of red blood capillary reference images; determining the red blood capillary reference image matching the second skin image according to the comparison result, and matching the red corresponding to the matching red blood capillary reference image The blood capillary value is determined as the red blood capillary value of the subject's skin; the second skin image includes the skin image of the subject's skin when irradiated with infrared light;

and / or,

Comparing the third skin image with multiple porphyrin reference images; determining the porphyrin reference image matching the third skin image according to the comparison result, and matching the porphyrin reference image corresponding to the porphyrin reference image The porphyrin value is determined as the porphyrin value of the subject's skin; the third skin image includes the skin image of the subject's skin when irradiated with ultraviolet light.
The skin evaluation method according to claim 2, wherein after the step of determining the skin state parameter according to the comparison result, further comprising:

Determine the candidate skin state parameter with the highest degree of matching with the skin state parameter from the skin state database; the skin state database contains the candidate skin state parameter and the mapping table of the candidate skin state parameter and cosmetic information;

The corresponding cosmetic information is determined according to the candidate skin state parameter with the highest matching degree and the mapping table, and the cosmetic information is output through the output device.
The skin evaluation method according to claim 1, wherein the step of evaluating the skin condition of the subject based on the skin image includes:

Determine the size and shape of dark areas in skin images when irradiated with white light;

Determine the skin morphology to which the dark area belongs according to the size and shape; the skin morphology includes spots, pores and wrinkles;

The skin condition of the subject is determined according to the skin morphology of the dark area.
The skin evaluation method according to any one of claims 1 to 5, wherein the step of sending an irradiation instruction to the lighting unit includes:

Acquiring a calibration image of the skin evaluation part of the subject collected by the shooting device, and comparing the calibration image with a predetermined reference frame;

When the deviation between the calibration image and the reference frame does not satisfy the preset condition, a deviation prompt is output;

When the deviation meets a preset condition, an illumination instruction is sent to the front lighting unit; the front lighting unit is set on the mobile phone.
A skin evaluation device, which is characterized by comprising:

An instruction sending module, used to send an irradiation instruction to the lighting unit; the irradiation instruction is used to trigger the lighting unit to emit specific skin test light; the skin test light is used to illuminate the skin of the subject;

A skin image acquisition module, configured to acquire a skin image captured by a photographing device; the skin image includes an image of a subject's skin when illuminated by the skin test light;

And, a skin condition evaluation module, configured to evaluate the skin condition of the subject based on the skin image.
A skin evaluation mobile phone, which is characterized by comprising: a lighting unit, a photographing device and a processing unit;

The processing unit is used to send an irradiation instruction to the lighting unit;

The lighting unit is used to emit specific skin test light according to the irradiation instruction; the skin test light is used to illuminate the skin of the subject;

The photographing device is used to photograph a skin image of the skin of the subject when the skin test light is irradiated, and send the skin image to the processing unit;

The processing unit is further configured to evaluate the skin condition of the subject based on the skin image.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the skin evaluation method according to any one of claims 1 to 6 is realized.
A computer device, including a memory, a processor, and a computer program stored on the memory and runable on the processor, characterized in that, when the processor executes the program, it is implemented as claimed in any one of claims 1 to 6. The skin evaluation method mentioned above.