CN111626127A

CN111626127A - User information acquisition method and device based on face image and computer equipment

Info

Publication number: CN111626127A
Application number: CN202010339948.5A
Authority: CN
Inventors: 杨铭轲
Original assignee: Individual
Current assignee: Individual
Priority date: 2020-04-26
Filing date: 2020-04-26
Publication date: 2020-09-04

Abstract

The application provides a user information obtaining method and device based on a face image and computer equipment. The images obtained by shooting the facial skin, cosmetics, subcutaneous blood vessels and other characteristics of the user under the irradiation of light rays with different wavelengths have different gray level expressions. Furthermore, the expression and skin condition of the face of the user during shooting can also represent the psychological state of the user. Therefore, by performing the corresponding analysis on each face image, the relevant information of the user can be acquired. In the acquisition process of the user information, the user only needs to analyze the shot image by changing the wavelength of the light, does not need to perform complicated operation, is convenient for the user to use daily, and realizes long-term recording and evaluation of the physiological information, the psychological information and the makeup information of the user.

Description

User information acquisition method and device based on face image and computer equipment

Technical Field

The present application relates to the field of image analysis technologies, and in particular, to a method and an apparatus for obtaining user information based on a face image, and a computer device.

Background

With the rapid development of society and the acceleration of life rhythm, the physiological and psychological health of human body gets more and more attention from society and individuals. The existing monitoring aiming at human physiological information is generally realized by a targeted instrument, such as a heart rate monitor; and for the evaluation of human psychological information, a scale test mode is generally adopted. Therefore, if various physiological information and psychological information of a human body need to be monitored simultaneously, a plurality of devices are needed for assistance, or the monitoring is carried out in professional places, which is very tedious and inconvenient for people to use in daily life.

Disclosure of Invention

The application mainly aims to provide a user information acquisition method and device based on a face image and computer equipment, and aims to overcome the defects that the existing method for monitoring human body physiological and psychological information is complex to operate and inconvenient to use in daily life.

In order to achieve the above object, the present application provides a method for obtaining user information based on a face image, including:

the method comprises the steps of obtaining a plurality of face images of a user, wherein the face images are images obtained by shooting the face of the user under the single irradiation of light rays with different wavelengths respectively, or images obtained by shooting the face of the user under the single irradiation of the light rays with the single wavelength, and the light rays completely cover the face of the user;

calling a corresponding analysis rule according to the type of user information required to be acquired, wherein the type of the user information comprises physiological information, psychological information or makeup information;

and analyzing the single or multiple face images according to the analysis rule to obtain corresponding user information.

Further, the light with different wavelengths includes ultraviolet light and red light, the ultraviolet light corresponds to the first face image, the red light corresponds to the second face image, and the step of analyzing the plurality of face images according to the analysis rule to obtain corresponding user information includes:

and comparing the gray scale of the first face image with the gray scale of the second face image by taking the second face image as a reference to obtain the skin information of the face of the user.

Further, the light with the single wavelength is green light, the green light corresponds to a third face image, and the step of acquiring a plurality of face images of the user includes:

respectively acquiring a plurality of third face images of the user under the irradiation of green light according to a first preset time interval;

the step of analyzing the plurality of face images according to the analysis rule to obtain corresponding user information includes:

sequentially carrying out gray level identification on each third face image according to the acquisition sequence of each third face image to obtain gray level change frequency;

and obtaining the heart rate information of the user according to the gray scale change frequency.

Further, the light with different wavelengths includes red light and infrared light, and the step of acquiring a plurality of face images of the user includes:

and respectively and alternately irradiating the face of the user by using the red light and the infrared light according to a preset frequency, and respectively acquiring a second face image corresponding to the red light and a fourth face image corresponding to the infrared light according to the preset frequency.

Further, the step of analyzing the plurality of face images according to the analysis rule to obtain corresponding user information includes:

respectively carrying out gray level analysis on the second image and the fourth image to obtain a first gray level corresponding to the second image and a second gray level corresponding to the fourth image;

obtaining the blood oxygen saturation of the user according to the ratio between the first gray scale and the second gray scale.

Further, the step of analyzing a single face image according to the analysis rule to obtain corresponding user information includes:

carrying out gray level analysis on the single face image to obtain a first distribution area of foundation on the left face of the user and a second distribution area on the right face of the user;

evaluating the symmetry degree of the first distribution area and the second distribution area to obtain the makeup information of the user.

Further, the step of acquiring a plurality of facial images of the user includes:

respectively acquiring a plurality of face images of the user according to a second preset time interval;

arranging the face images in an ascending order according to the acquisition time;

carrying out gray level analysis on each arranged face image to identify a black eye area in each face image;

and evaluating to obtain the psychological information of the user according to the change of each black eye area.

The application also provides a user information acquisition device based on the face image, which comprises:

the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a plurality of face images of a user, the face images are images obtained by shooting the face of the user under the single irradiation of light rays with different wavelengths respectively, or the face of the user is an image obtained by shooting the face of the user under the single irradiation of light rays with a single wavelength, and the light rays completely cover the face of the user;

the system comprises a calling module, a receiving module and a sending module, wherein the calling module is used for calling a corresponding analysis rule according to the type of user information required to be acquired, and the type of the user information comprises physiological information, psychological information or makeup information;

and the analysis module is used for analyzing the single or multiple face images according to the analysis rule to obtain corresponding user information.

Further, the light with different wavelengths includes ultraviolet light and red light, the ultraviolet light corresponds to the first face image, the red light corresponds to the second face image, and the analyzing module includes:

and the comparison unit is used for carrying out gray comparison on the first face image and the second face image by taking the second face image as a reference so as to obtain the skin information of the face of the user.

Further, the light with a single wavelength is green light, the green light corresponds to the third face image, and the obtaining module includes:

the first acquisition unit is used for respectively acquiring a plurality of third face images of the user under the irradiation of green light according to a first preset time interval;

the analysis module comprises:

the identification unit is used for sequentially carrying out gray level identification on each third face image according to the acquisition sequence of each third face image to obtain gray level change frequency;

and the first evaluation unit is used for obtaining the heart rate information of the user according to the gray scale change frequency.

Further, the light beams with different wavelengths include red light and infrared light, and the obtaining module includes:

and the second acquisition unit is used for respectively using the red light and the infrared light to alternately irradiate the face of the user according to a preset frequency, and respectively acquiring a second face image corresponding to the red light and a fourth face image corresponding to the infrared light according to the preset frequency.

Further, the parsing module includes:

the first analysis unit is used for respectively carrying out gray level analysis on the second image and the fourth image to obtain a first gray level corresponding to the second image and a second gray level corresponding to the fourth image;

a second evaluation unit for obtaining the blood oxygen saturation of the user according to a ratio between the first gray scale and the second gray scale.

Further, the parsing module includes:

the second analysis unit is used for carrying out gray level analysis on the single face image to obtain a first distribution area of foundation on the left face of the user and a second distribution area on the right face of the user;

and the third evaluation unit is used for evaluating the symmetry degree of the first distribution area and the second distribution area to obtain the makeup information of the user.

Further, the obtaining module includes:

the third acquisition unit is used for respectively acquiring a plurality of face images of the user according to a second preset time interval;

the analysis module comprises:

the arrangement unit is used for arranging the face images in an ascending order according to the acquisition time;

the third analysis unit is used for carrying out gray level analysis on the arranged face images and identifying black eye areas in the face images;

and the fourth evaluation unit is used for evaluating and obtaining the psychological information of the user according to the change of each black eye area.

The present application further provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any one of the above methods when executing the computer program.

The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method of any of the above.

According to the user information obtaining method and device based on the face image and the computer equipment, firstly, the face image of a user under the single irradiation of the light rays with different wavelengths or the face image under the single irradiation of the light rays with the single wavelength is obtained, wherein the light rays completely cover the face of the user. The images obtained by shooting the facial skin, cosmetics, subcutaneous blood vessels and other characteristics of the user under the irradiation of light rays with different wavelengths have different gray level expressions. Furthermore, the expression and skin condition of the face of the user during shooting can also represent the psychological state of the user. Therefore, by performing corresponding analysis on each face image, relevant information of the user, such as physiological information, psychological information, and makeup information of the user, can be acquired. In the acquisition process of the user information, the user only needs to analyze the shot image by changing the wavelength of the light, does not need to perform complicated operation, is convenient for the user to use daily, and realizes long-term recording and evaluation of the physiological information, the psychological information and the makeup information of the user.

Drawings

Fig. 1 is a schematic diagram illustrating a user information obtaining method based on a face image in an embodiment of the present application;

fig. 2 is a block diagram of an overall structure of a user information obtaining apparatus based on a face image according to an embodiment of the present application;

FIG. 3 is a block diagram illustrating the structure of a computer device according to an embodiment of the present application;

fig. 4 is an overall structural diagram of an intelligent mirror implementing a user information acquisition method based on a face image according to an embodiment of the present application.

The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

Referring to fig. 1, an embodiment of the present application provides a method for acquiring user information based on a face image, including:

s1, acquiring a plurality of face images of the user, wherein the face images are images of the face of the user which are respectively shot under the single irradiation of light rays with different wavelengths, or the face of the user which is shot under the single irradiation of the light rays with the single wavelength, and the light rays completely cover the face of the user;

s2, calling corresponding analysis rules according to the type of the user information required to be acquired, wherein the type of the user information comprises physiological information, psychological information or makeup information;

and S3, analyzing the single or multiple face images according to the analysis rule to obtain corresponding user information.

In this embodiment, the system obtains, through the shooting device 5, such as a camera, face images that are respectively obtained by shooting the face of the user under the single irradiation of light with different wavelengths, or face images that are obtained by shooting the face of the user under the single irradiation of light with a single wavelength, where the face images may be photos or videos. Wherein, the light is emitted by the lighting device 6, and the lighting device 6 can be one or more, and can convert and output light with different wavelengths, such as red light, infrared light, and the like. The light emitted by the lighting device 6 needs to completely cover the face of the user, so that the whole face image of the user, which is obtained by the shooting device 5, is irradiated by the light with the same wavelength and has the same comparison reference, thereby avoiding that the gray scale recognition of the face image in the follow-up process is caused to have errors due to different wavelengths of the light corresponding to different areas on the same face image, and the accuracy of the obtained user information is reduced. After the system obtains the face images, it is necessary to establish a corresponding relationship between each face image and the light with the corresponding wavelength, for example, if the face image a is obtained by shooting under the illumination of green light, the face image a and the green light are established a corresponding relationship. When the subsequent system analyzes each face image, the corresponding analysis rule is called according to the type of the user information required to be acquired, and different analysis rules correspondingly analyze the face images acquired by different wavelengths, so that different types of user information are obtained through evaluation.

Preferably, the method of the embodiment can perform single evaluation on the user, and can also perform long-term tracking evaluation on the user. Specifically, in a single evaluation, the system can obtain physiological information and makeup information of the user by analyzing, individually or synthetically, face images taken by the camera 5 under single irradiation of light rays of different wavelengths, respectively, or face images taken by the face of the user under single irradiation of light rays of a single wavelength. For example, the light includes ultraviolet light and red light, wherein the ultraviolet light corresponds to the first face image and the red light corresponds to the second face image. The system respectively performs gray level analysis on the first face image and the second face image, and performs gray level comparison on the first face image and the second face image by taking the second face image as a reference, so that skin information of the face of the user, such as the number of black spots (compared with the gray level of normal skin, the gray level of a black spot area is larger) can be identified; make-up information of the user can be recognized, such as the application condition of the sunscreen (compared with the gray scale of normal skin, the gray scale of the area where the sunscreen is applied is larger, and the distributed area has continuity and is a whole continuous area).

In long-term tracking evaluation, the system identifies the user identity through a face recognition technology and establishes archive management for the user. Preferably, in the embodiment of performing long-term tracking evaluation for the user, the lighting device 6 and the shooting device 5 are arranged at positions where the user regularly appears, such as a toilet mirror and a dresser mirror, and the user basically goes to the toilet to comb and wash the mirror after getting up every day, so that the user can be ensured to acquire the face image of the user in the same time period every day. Specifically, when the lighting device 6 and the shooting device 5 are installed on a mirror of a washroom, a user can perform appearance arrangement in front of the mirror when washing in the morning every day, at the moment, the lighting device 6 outputs light rays, so that the light rays of the face of the user are uniformly distributed, and then the image of the face of the user is obtained through the shooting device 5. The system can identify the distribution situation of facial folds from the facial image of the user by using an image identification technology, and then the growth change and the mental change of the user can be analyzed according to the shooting frequency once a day and the change of the distribution situation of the facial folds of the user according to the shooting sequence. When the psychological pressure of the user is high and the mind is not good, the growth trend of the facial folds is increased, a threshold value of the growth trend is arranged in the system, and when the growth trend of the facial folds of the user is larger than the threshold value, the psychological pressure of the user in the period can be deduced to be larger, so that the psychological information of the user can be obtained.

Referring to fig. 4, the user information acquiring method based on the face image of the present embodiment is implemented by an intelligent mirror, which includes a mirror body 4, a photographing device 5, a lighting device 6, and a processing chip 7. Specifically, the mirror body 4 is installed in a toilet or a makeup room of a user, and the photographing device 5 and the lighting device 6 are provided on the mirror body 4. The user usually combs with the mirror body 4 facing the toilet or makes up with the mirror body 4 facing the toilet after getting up in the morning. Therefore, the photographing device 5 and the lighting device 6 are arranged on the mirror body 4 in the toilet or the makeup room, on one hand, the face image of the user can be regularly obtained (the time change of the user getting up and washing every day is not too large), and the processing chip 7 correspondingly analyzes the face image of the user in the same time period every day, so that the obtained psychological information, physiological information or makeup information of the user has higher accuracy. On the other hand, the user is in the most initial state of the body of the user when getting up and washing, the obtained face image of the user is relatively less influenced by external factors corresponding to the physiological information or psychological information of the user obtained after analysis (for example, the analyzed physiological information or information of the user is probably influenced by the work of the user when the face image of the user is obtained after working for one day), and the accuracy is high. In addition, when the user faces the mirror body 4, the user can face the mirror body 4 independently, the light emitted by the lighting device 6 can be guaranteed to completely cover the face of the user, the shooting device 5 can acquire the face image of the front face of the user, and the mirror is high in convenience.

Preferably, the lighting devices 6 are arranged in pairs, and each lighting device 6 is symmetrically arranged on the mirror body 4 in pairs.

Preferably, the outer contour of the mirror body 4 is rectangular.

The lighting devices 6 are arranged in pairs, i.e. at least one pair of lighting devices 6. Wherein, each lighting device 6 is arranged on the mirror body 4 in bilateral symmetry between two. The lighting device 6 is arranged in a bilateral symmetry mode, on one hand, the light rays emitted can be guaranteed to completely cover the face of the user, on the other hand, the light rays of the left face and the right face of the user can be guaranteed to be distributed symmetrically and uniformly, and the resolution accuracy of the follow-up processing chip 7 on the obtained face image is improved. Preferably, the outer contour of the mirror body 4 is rectangular, so that the paired lighting devices 6 can be conveniently positioned when being installed, and the paired lighting devices 6 are symmetrically installed at the top corners of the mirror body 4 in the left-right direction, so that a better irradiation effect can be obtained.

Furthermore, the intelligent mirror also comprises a display device 8, and the display device 8 is connected with the processing chip 7 and arranged on the mirror body 4;

the display device 8 is used for displaying the analysis result of the processing chip 7.

Preferably, the display device 8 is an OLED screen.

The intelligent mirror further comprises a display device 8, and the display device 8 is connected with the processing chip 7 and arranged on the mirror body 4. After the processing chip 7 analyzes the face image, it can obtain the physiological information, information or makeup information of the user (for example, score the makeup of the user), and then display the information of the user through the display device 8, so that the user can intuitively obtain the relevant information of the user. Preferably, the display device 8 is an OLED screen, which has a low overall weight and is easy to mount on the mirror body 4.

Further, the intelligent mirror comprises a mirror frame 9;

the mirror frame 9 surrounds the edge of the mirror body 4;

display device 8 is disposed in the middle region of the top of frame 9.

The intelligent mirror comprises a mirror frame 9, wherein the mirror frame 9 surrounds the edge of the mirror body 4, and the mirror body 4 can be protected. The display device 8 is arranged in the middle area of the top of the spectacle frame 9, so that a user can conveniently watch information on the display device 8, and the effect of transmitting the information by the display device 8 is improved.

Furthermore, the intelligent mirror also comprises an alarm device 10, wherein the alarm device 10 is connected with the processing chip 7 and is arranged on the mirror body 4;

the alarm device 10 is used to output alarm information.

Preferably, the alarm device 10 is an alarm bell or an alarm lamp.

The smart mirror further comprises an alarm device 10, which alarm device 10 may be an alarm lamp (which indicates an alarm by flashing) or an alarm bell (which indicates an alarm by ringing). The alarm device 10 is arranged on the mirror body 4 and is connected with the processing chip 7. The threshold is set in the internal database of the processing chip 7, and when the physiological information or the psychological information of the user is obtained through analysis, the physiological information or the psychological information of the user is compared with the set threshold (for example, the current heart rate of the user is compared with a preset heart rate threshold), so that the physiological information or the psychological information of the user is evaluated. If the physiological or psychological health condition of the user is poor (for example, the current heart rate of the user exceeds a preset heart rate threshold value), the processing chip 7 controls the alarm device 10 to output alarm information, so as to warn the user.

In this embodiment, after analyzing the physiological information, psychological information or makeup information of the user, the system can output the user information to the display device 8 for the user to know. Or sending the feedback information to a receiving terminal preset by a user, such as a mobile phone, for recording, so as to form long-term feedback.

Further, the light with different wavelengths includes ultraviolet light and red light, the ultraviolet light corresponds to the first face image, the red light corresponds to the second face image, and the analyzing is performed on the plurality of face images according to the analyzing rule to obtain corresponding user information, including:

s301, taking the second face image as a reference, and carrying out gray scale comparison on the first face image and the second face image to obtain skin information of the face of the user.

In this embodiment, the light emitted by the lighting device is ultraviolet light and red light, wherein the user face image obtained by the shooting device 5 in the environment of ultraviolet light irradiation is a first face image, and the user face image obtained by the shooting device in the environment of red light irradiation is a second face image. After the system obtains the first face image and the second face image, the first face image is associated with ultraviolet light, and the second face image is associated with red light, so that the face image of the user can be correspondingly analyzed according to different wavelengths of the light. The system respectively carries out gray level analysis on the first face image and the second face image, the gray levels corresponding to the shielded area and the black spot area of the face skin of the user face of the first face image are larger in the image obtained by shooting under ultraviolet light irradiation, and the shielded area and the black spot area of the face skin can be visually presented as black. And the second face image shot under the irradiation of the red light can only show the color of the skin on the surface of the user and cannot show black spots on the skin. Therefore, the system takes the second face image as a reference, the first face image and the second face image are subjected to gray scale comparison, in the same area of the user face image, if the first face image has a spot area with larger gray scale, the system can evaluate the spot area as a black spot, so as to identify the number of the black spots on the user face, and further evaluate the skin condition of the user face. Similarly, if the first face image has a continuous area with a larger gray scale, such as a block area, in the same area of the face image of the user, the user may apply skin care products, such as sunscreen cream, to the continuous area, so as to identify the makeup area of the face of the user, and then evaluate the makeup information of the user.

Further, the light is green light, the green light corresponds to a third face image, the light with a single wavelength is green light, the green light corresponds to the third face image, and the step of obtaining the plurality of face images of the user includes:

s101, respectively acquiring a plurality of third face images of the user under the irradiation of green light according to a first preset time interval;

s302, carrying out gray level identification on each third face image in sequence according to the acquisition sequence of each third face image to obtain gray level change frequency;

and S303, obtaining the heart rate information of the user according to the gray scale change frequency.

In this embodiment, the light with a single wavelength emitted by the lighting device 6 is green light, and the system needs to continuously shoot in the process of acquiring the user image through the shooting device 5. If the photographing device 5 is a camera, the photographing device 5 needs to perform rapid photographing to obtain a plurality of images of the user's face to realize continuous photographing of the user's face. If the shooting device 5 is a camera, the user face image can be continuously shot under the irradiation of green light, and when a subsequent system carries out gray level recognition on the user face image, the video of the user face image can be split into one single frame and analyzed according to the sequence of shooting time. Specifically, the shooting device 5 respectively obtains a plurality of third face images of the user under the green light illumination according to a first preset time interval, for example, if a third face image is shot every 0.1 second, the first preset time interval is 0.1S. After obtaining the third face image, the system associates the third face image with the green light. When the user is beating, the facial skin will reflect the green light with different intensity. The system can obtain the gray change frequency of each third face image by carrying out gray recognition on a plurality of continuous third face images (the gray value of the image is inversely related to the intensity of the reflected light, and the gray value of the image is small when the intensity of the reflected light is large, or vice versa). The change frequency of the gray scale analyzed by the system is actually the heartbeat frequency of the user, for example, the gray scale of the third face image changes once every 1 second, that is, the change frequency of the gray scale is 1 second, correspondingly, the heartbeat frequency of the user is 1 second, and the heart rate is 60 times/min. Therefore, the system can directly obtain the heart rate information of the user according to the gray scale change frequency.

and S102, respectively using the red light and the infrared light to alternately irradiate the face of the user according to a preset frequency, and respectively obtaining a second face image corresponding to the red light and a fourth face image corresponding to the infrared light according to the preset frequency.

In this embodiment, the light with different wavelengths is red light and infrared light, preferably, the frequency band of the red light is 660nm, and the frequency band of the infrared light is 880 nm. When the lighting device 6 emits red light and infrared light, the red light and the infrared light are required to be alternately emitted according to a preset frequency to irradiate the face of the user. And while the lighting device 6 emits light, the shooting device 5 shoots the face of the user according to the preset frequency of red light and infrared light conversion, so that a second face image of the user under each red light irradiation and a fourth face image of the user under each infrared light irradiation are obtained. When the system obtains a second face image, establishing a corresponding relation between the second face image and the red light; when the fourth face image is obtained, the fourth face image and the infrared light are in a corresponding relation, so that the situation that light rays with different wavelengths are mixed with the corresponding face image of the user when the blood oxygen saturation degree of the user is evaluated subsequently is avoided.

s304, respectively carrying out gray level analysis on the second image and the fourth image to obtain a first gray level corresponding to the second image and a second gray level corresponding to the fourth image;

and S305, obtaining the blood oxygen saturation of the user according to the ratio of the first gray scale and the second gray scale.

In this embodiment, the system performs corresponding analysis on the second image and the fourth image according to the detection principle of the blood oxygen saturation level of the human body in the prior art, so as to evaluate and obtain the blood oxygen saturation level of the user. The human blood comprises oxyhemoglobin and hemoglobin, wherein the oxyhemoglobin has a small absorption capacity on 660nm red light and a large absorption capacity on 880nm infrared light; hemoglobin absorbs more 660nm red light and less 880nm infrared light. In the prior art, a detector can determine the oxygenation degree of hemoglobin by measuring the ratio of infrared absorption amount to red absorption amount by a spectrophotometry, so as to obtain the blood oxygen saturation of a human body. As can be seen from the above, when the amount of light absorption is large, the intensity of the reflected light is low, that is, the gray scale value of the corresponding image is large. Therefore, the system analyzes the second image and the fourth image respectively, so as to obtain the gray value corresponding to the second image: the first gray scale, and the gray scale value corresponding to the fourth image: a second gray scale. The system determines the ratio of the infrared light absorption amount to the red light absorption amount according to the ratio between the first gray scale and the second gray scale, thereby estimating the blood oxygen saturation of the user.

s306, carrying out gray level analysis on the single face image to obtain a first distribution area of foundation on the left face of the user and a second distribution area on the right face of the user;

s307, evaluating the symmetry degree of the first distribution area and the second distribution area to obtain the makeup information of the user.

In this embodiment, the system performs gray scale recognition on a single face image, and defines an area where the left face of the user is coated with the foundation as a first distribution area, and defines an area where the right face of the user is coated with the foundation as a second distribution area. Then, gray comparison is carried out on the first distribution area and the second distribution area respectively, and the symmetry degree of the first distribution area and the second distribution area is evaluated, for example, whether the gray values of the symmetric areas are the same or not is judged, so that whether foundation is uniformly coated or not is judged; or whether the overall outer contours of the first distribution area and the second distribution area are symmetrical or not is judged, so that whether the face is completely coated with the foundation is judged, and the makeup information of the user is obtained through evaluation. Furthermore, the system can also compare the face image after the user makes up with the face image when the user is in plain color, so as to identify whether the skin defects such as black spots are completely covered after the user makes up, and further make-up information of the user is obtained.

s103, respectively acquiring a plurality of face images of the user according to a second preset time interval;

s308, arranging the face images in an ascending order according to the acquisition time;

s309, carrying out gray level analysis on each arranged face image, and identifying a black eye area in each face image;

and S3010, evaluating and obtaining psychological information of the user according to the change of each black eye area.

In this embodiment, the photographing device 5 and the lighting device 6 are installed on a toilet mirror in a washroom or a toilet mirror in a room to obtain regular face images of a user. The shooting device 5 obtains the face image of the user at a second preset time interval, wherein the second preset time interval is preferably 24h, namely the shooting device shoots one piece a day, and the shooting time points are the same every day so as to ensure the regularity of the shooting time, and then transmits the face image of the user to the system. The system performs ascending arrangement according to the acquisition time of each face image so as to evaluate the mental state of the user according to the sequence of the time. After the system obtains a plurality of user face images and sorts the face images according to the rule, gray level recognition is carried out on each face image, and therefore the black eye area in each face image is obtained. Because the face images are arranged in sequence according to the acquisition time, the system can correspondingly evaluate and obtain the psychological information of the user according to the change of the black eye area. For example, as time increases, the system recognizes that the black eye area gradually increases, and then the system may determine that the user has poor sleep and is under greater mental stress during the period of time; and if the black eye area is gradually reduced along with the increase of the time, the system can evaluate that the sleep quality of the user in the time is better and the mental stress is less.

The method for acquiring user information based on a face image includes acquiring a face image of a user under single irradiation of light rays with different wavelengths or a face image under single irradiation of light rays with a single wavelength, where the light rays completely cover the face of the user. The images obtained by shooting the facial skin, cosmetics, subcutaneous blood vessels and other characteristics of the user under the irradiation of light rays with different wavelengths have different gray level expressions. Furthermore, the expression and skin condition of the face of the user during shooting can also represent the psychological state of the user. Therefore, by performing corresponding analysis on each face image, relevant information of the user, such as physiological information, psychological information, and makeup information of the user, can be acquired. In the acquisition process of the user information, the user only needs to analyze the shot image by changing the wavelength of the light, does not need to perform complicated operation, is convenient for the user to use daily, and realizes long-term recording and evaluation of the physiological information, the psychological information and the makeup information of the user.

Referring to fig. 2, an embodiment of the present application further provides a user information obtaining apparatus based on a face image, including:

the system comprises an acquisition module 1, a display module and a processing module, wherein the acquisition module 1 is used for acquiring a plurality of face images of a user, the face images are images obtained by shooting the face of the user under the single irradiation of light rays with different wavelengths respectively, or the face of the user is an image obtained by shooting the face of the user under the single irradiation of light rays with a single wavelength, and the light rays completely cover the face of the user;

the calling module 2 is used for calling corresponding analysis rules according to the types of the user information required to be acquired, wherein the types of the user information comprise physiological information, psychological information or makeup information;

and the analysis module 3 is used for analyzing the single or multiple face images according to the analysis rule to obtain corresponding user information.

Further, the light with different wavelengths includes ultraviolet light and red light, the ultraviolet light corresponds to the first face image, the red light corresponds to the second face image, and the analyzing module 3 includes:

Further, the light with a single wavelength is green light, the green light corresponds to the third face image, and the obtaining module 1 includes:

the analysis module 3 includes:

Further, the light beams with different wavelengths include red light and infrared light, and the obtaining module 1 includes:

Further, the parsing module 3 includes:

Further, the obtaining module 1 includes:

the analysis module 3 includes:

The user information obtaining apparatus based on a human face image provided by this embodiment first obtains a face image of a user under single irradiation of light rays with different wavelengths or a face image under irradiation of light rays with a single wavelength, where the light rays completely cover the face of the user. The images obtained by shooting the facial skin, cosmetics, subcutaneous blood vessels and other characteristics of the user under the irradiation of light rays with different wavelengths have different gray level expressions. Furthermore, the expression and skin condition of the face of the user during shooting can also represent the psychological state of the user. Therefore, by performing corresponding analysis on each face image, relevant information of the user, such as physiological information, psychological information, and makeup information of the user, can be acquired. In the acquisition process of the user information, the user only needs to analyze the shot image by changing the wavelength of the light, does not need to perform complicated operation, is convenient for the user to use daily, and realizes long-term recording and evaluation of the physiological information, the psychological information and the makeup information of the user.

Referring to fig. 3, a computer device, which may be a server and whose internal structure may be as shown in fig. 3, is also provided in the embodiment of the present application. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the computer designed processor is used to provide computational and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing data such as analysis rules and the like. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method for user information acquisition based on a face image.

The processor executes the steps of the user information acquisition method based on the face image:

An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for obtaining user information based on a face image, and specifically includes:

It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by hardware associated with instructions of a computer program, which may be stored on a non-volatile computer-readable storage medium, and when executed, may include processes of the above embodiments of the methods. Any reference to memory, storage, database, or other medium provided herein and used in the examples may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double-rate SDRAM (SSRSDRAM), Enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, apparatus, article, or method that includes the element.

The above description is only for the preferred embodiment of the present application and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are intended to be included within the scope of the present application.

Claims

1. A user information acquisition method based on a face image is characterized by comprising the following steps:

2. The method according to claim 1, wherein the light beams with different wavelengths include ultraviolet light and red light, the ultraviolet light corresponds to a first face image, the red light corresponds to a second face image, and the step of analyzing the plurality of face images according to the analysis rule to obtain corresponding user information includes:

3. The method for acquiring user information based on a facial image of a user according to claim 1, wherein the light with a single wavelength is green light, the green light corresponds to a third facial image, and the step of acquiring the plurality of facial images of the user includes:

4. The method for acquiring user information based on a human face image according to claim 1, wherein the light beams with different wavelengths include red light and infrared light, and the step of acquiring the plurality of face images of the user includes:

5. The method for acquiring user information based on facial images according to claim 4, wherein the step of analyzing a plurality of facial images according to the analysis rule to obtain corresponding user information comprises:

6. The method for acquiring user information based on a facial image according to claim 1, wherein the step of analyzing a single facial image according to the analysis rule to obtain corresponding user information comprises:

7. The method for acquiring user information based on a face image according to claim 1, wherein the step of acquiring a plurality of face images of the user comprises:

8. A user information acquisition device based on a face image is characterized by comprising:

9. A computer device comprising a memory and a processor, the memory having stored therein a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.