WO2021197186A1 - 辅助化妆方法、终端设备、存储介质及程序产品 - Google Patents

辅助化妆方法、终端设备、存储介质及程序产品 Download PDF

Info

Publication number
WO2021197186A1
WO2021197186A1 PCT/CN2021/082920 CN2021082920W WO2021197186A1 WO 2021197186 A1 WO2021197186 A1 WO 2021197186A1 CN 2021082920 W CN2021082920 W CN 2021082920W WO 2021197186 A1 WO2021197186 A1 WO 2021197186A1
Authority
WO
WIPO (PCT)
Prior art keywords
makeup
contour
area
user
face image
Prior art date
Application number
PCT/CN2021/082920
Other languages
English (en)
French (fr)
Inventor
邹韬
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US17/916,378 priority Critical patent/US20230154083A1/en
Priority to EP21781902.8A priority patent/EP4116923A4/en
Publication of WO2021197186A1 publication Critical patent/WO2021197186A1/zh

Links

Images

Classifications

    • G06T3/04—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Definitions

  • This application belongs to the field of communication technology, and in particular relates to an auxiliary makeup method, terminal device, storage medium, and program product.
  • Make-up is the use of cosmetics and tools, and the use of rules and techniques to render, paint, and organize the face, five senses and other parts of the human body to enhance the three-dimensional impression, adjust the shape and color, conceal defects, and express the spirit, so as to beautify the visual experience the goal of. Makeup looks different in different environments, seasons, and occasions.
  • the user usually puts on makeup in front of the mirror, for example, draws eyebrows, draws eyeshadow, applies lipstick, blush, etc., and modifies and perfects them according to the makeup effect.
  • makeup itself involves many steps and processing skills, it is difficult for novice makeup users to apply makeup even if compared to the video tutorial or the image after makeup (that is, the image of the completed makeup) in the actual operation process. Make the same or similar makeup. There is currently no effective solution to assist users in applying makeup.
  • This application provides an auxiliary makeup method, terminal device, storage medium, and program product, which can solve the problem that there is no effective solution to assist users in applying makeup and cannot provide users with makeup references.
  • this application provides an auxiliary makeup method, including:
  • the makeup area corresponding to the makeup contour is identified from the face image, and the makeup contour is adaptively superimposed and displayed on the makeup area corresponding to the makeup contour to assist the user in putting on makeup.
  • the user refers to a user who needs makeup.
  • the face image can be a plain image before makeup, or an image collected during the makeup process.
  • the target makeup effect image is the image after makeup.
  • the target makeup effect picture may be a makeup effect picture for the entire face, and the target makeup effect picture may come from a beauty magazine, or it may be a makeup effect picture obtained by the user on the street.
  • the terminal device can use image recognition technology or related image processing algorithms to extract the corresponding makeup contour from the target makeup effect map, and can also obtain the makeup contour corresponding to the target makeup effect map from the server.
  • the terminal device can enlarge or reduce the makeup contour according to actual needs to match the user's facial features (for example, eyebrow shape, eye shape, mouth shape, and face shape).
  • the terminal device can also provide a corresponding entry for the user to edit the makeup outline or adjust the size and position of the makeup outline.
  • the terminal device can dynamically obtain the user's face image in real time, obtain the makeup contour corresponding to the target makeup rendering that the user selects, or recommend the target to the user based on the user's face image using artificial intelligence technology and face recognition technology Make-up renderings, and obtain the makeup contours corresponding to the target makeup renderings; superimpose the makeup contours corresponding to the target makeup renderings to the corresponding makeup area in the user's face image, so that the user can make makeup according to the makeup contours.
  • the auxiliary makeup method of makeup contour can provide users with effective makeup reference during the makeup process and improve the user's makeup technique so that the user can draw makeup that is close to or the same as the target makeup effect map.
  • the target makeup effect diagram is a makeup effect diagram selected by the user.
  • the mobile phone can obtain the makeup contour corresponding to the makeup effect diagram manually selected by the user from the user interface, or obtain the makeup contour corresponding to the target makeup effect diagram based on the voice message input by the user.
  • the user can manually select the desired target makeup effect map from the user interface according to actual needs, and the terminal device detects the target makeup effect map selected by the user and obtains the makeup contour corresponding to the target makeup effect map.
  • the makeup effect map displayed in the user interface is obtained from the server after the terminal device detects that the user selects the target makeup type.
  • the target makeup effect map is a makeup effect map recommended by the terminal device based on the face image and using artificial intelligence technology.
  • the number of makeup renderings that the terminal device intelligently recommends to the user can be one or at least two, and there is no limitation here.
  • the terminal device can use artificial intelligence technology to intelligently recommend makeup renderings to users.
  • the adaptively superimposing and displaying the makeup contour after the makeup area corresponding to the makeup contour further includes:
  • the makeup contour is controlled to move adaptively following the face image.
  • the adaptively superimposing and displaying the makeup contour after the makeup area corresponding to the makeup contour further includes:
  • the makeup corresponding to each of the makeup contours is evaluated to obtain a makeup evaluation result.
  • the user in order to enable the user to draw a makeup that is the same or similar to the makeup effect map more accurately, the user can compare any makeup contour to the makeup process, or when the makeup is completed, the terminal device can compare the user's face image
  • the makeup effect is evaluated to determine whether the current makeup is consistent with the makeup in the target makeup rendering, so as to evaluate the accuracy of the user’s makeup, and solve the problem that the current makeup application does not evaluate the makeup effect of the user’s face image. Can not provide further correction tips.
  • the method further includes:
  • a correction reminder message can be output to prompt the user to correct the makeup.
  • the method further includes:
  • the adaptively superimposing and displaying the makeup contour after the makeup area corresponding to the makeup contour further includes:
  • the makeup guide information may be used to describe the color information corresponding to the makeup contour in the target makeup effect graph.
  • the makeup guidance information corresponding to the target makeup effect map can help the user draw makeup that is the same or similar to the makeup effect map.
  • the evaluating the makeup corresponding to each makeup contour includes: detecting whether the makeup of each makeup area in the face image exceeds the makeup contour, Wherein, when the makeup of any one of the makeup areas exceeds the contour of the makeup, it means that the makeup corresponding to the makeup area does not match the makeup in the target makeup rendering.
  • the terminal device can determine whether the makeup drawn by the user is consistent with the makeup in the makeup rendering by detecting whether the makeup of each makeup area in the face image exceeds the contour of the makeup, so as to evaluate the accuracy of the user's makeup.
  • the evaluating the makeup corresponding to each of the makeup contours further includes: detecting whether the actual color in each of the makeup contours in the face image is It is consistent with the preset color in each makeup contour of the target makeup effect diagram, wherein, when the makeup of any one of the makeup areas exceeds the makeup contour, or the actual color in any of the makeup contours is the same as the preset When the colors do not match, it means that the makeup corresponding to the makeup area does not match the makeup in the target makeup rendering.
  • the terminal device can detect whether the actual color in the makeup contour matches the preset color corresponding to each makeup contour in the makeup rendering, so as to determine whether the makeup drawn by the user matches the makeup in the makeup rendering. Evaluation of the accuracy of user makeup.
  • the detecting whether the makeup of each makeup area in the face image exceeds the contour of the makeup includes:
  • the terminal device can determine whether the actual color outside the makeup contour and the preset color corresponding to each makeup contour outside the makeup effect diagram by comparing the actual color information and preset color information corresponding to the makeup contour of the same makeup area Matching can improve the accuracy of the judgment result.
  • the acquisition of the face image The actual color information outside the makeup contour of each makeup area, including:
  • the actual contour area includes the makeup contour
  • the contour determination area is the actual contour area after the actual contour area is enlarged according to a preset ratio get
  • the outputting correction reminder information based on the makeup evaluation result includes: marking a target area in the face image with a striking color, the target area being the same as the The makeup area that does not match the makeup in the target makeup rendering.
  • the terminal device can mark the makeup outline when it detects that the makeup drawn by the user exceeds the makeup outline, and when it detects that the actual color of any area within the makeup outline does not match the corresponding preset color, it marks the area Makeup color to remind the user to correct, realize real-time guidance, real-time evaluation and reminder during the makeup process, so that the user can correct in time, so that the user can draw the same makeup as the makeup effect picture as much as possible.
  • the makeup contour includes at least one of an eyebrow makeup contour, an eye shadow contour, a blush contour, and a lip makeup contour.
  • the eye shadow contour and/or blush contour includes multiple regions.
  • the makeup area corresponding to the eyebrow makeup contour is the eyebrow area in the user's face image.
  • the makeup area corresponding to the eye shadow contour may be the eye shadow area, and the eye shadow area may be the position of the eyelid in the user's face image.
  • the makeup area corresponding to the lip makeup contour is the area where the lips are located in the user's face image, and the makeup area corresponding to the blush contour can be the cheek area in the user's face image or the area where the cheek bones are located.
  • the makeup area corresponding to the blush contour can be a circle or an oval centered on the highest part of the cheekbones (when smiling, the place where the cheekbones are raised) is the center.
  • the present application provides an auxiliary makeup device, which can be applied to a terminal device, and the auxiliary makeup device includes:
  • the display unit is used to display the user's face image collected by the camera;
  • the acquiring unit is used to acquire the makeup contour corresponding to the target makeup rendering
  • the auxiliary makeup unit is used to identify the makeup area corresponding to the makeup contour from the face image, and adaptively superimpose and display the makeup contour on the makeup area corresponding to the makeup contour to assist the user in applying makeup.
  • the target makeup effect diagram is a makeup effect diagram selected by the user.
  • the target makeup effect map is a makeup effect map recommended by the auxiliary makeup device based on the face image and using artificial intelligence technology.
  • the auxiliary makeup device may further include:
  • a detecting unit configured to detect the movement of the face image after the auxiliary makeup unit adaptively superimposes and displays the makeup contour on the makeup area corresponding to the makeup contour;
  • the makeup contour adjustment unit is used to control the makeup contour to move adaptively following the face image.
  • the auxiliary makeup device may further include:
  • the makeup evaluation unit is configured to perform, based on the face image, on each makeup corresponding to the makeup contour after the auxiliary makeup unit superimposes and displays the makeup contour adaptively on the makeup area corresponding to the makeup contour Evaluation to obtain the makeup evaluation result.
  • the auxiliary makeup device may further include:
  • the reminder unit is configured to output correction reminder information based on the makeup evaluation result when the makeup evaluation result indicates that the makeup corresponding to any makeup area in the face image does not match the makeup in the target makeup rendering.
  • the reminding unit is specifically configured to mark a target area in the face image with a striking color, and the target area is the same as the makeup in the target makeup rendering. Inconsistent makeup area.
  • the obtaining unit may be further configured to: obtain makeup guide information corresponding to the target makeup effect map;
  • the auxiliary makeup unit adaptively superimposes and displays the makeup contour on the makeup area corresponding to the makeup contour, it can also be used to display or voice broadcast the makeup guidance information.
  • the makeup evaluation unit may include:
  • the first evaluation unit is used to detect whether the makeup of each makeup area in the face image exceeds the makeup contour, wherein, when the makeup of any makeup area exceeds the makeup contour, it indicates the makeup area The corresponding makeup does not match the makeup in the target makeup rendering.
  • the makeup evaluation unit may further include:
  • the second evaluation unit is configured to detect whether the actual color in each makeup contour in the face image matches the preset color in each makeup contour of the target makeup effect diagram, wherein, when any When the makeup of the makeup area exceeds the makeup contour, or the actual color in any of the makeup contours does not match the preset color, it means that the makeup corresponding to the makeup area does not match the makeup in the target makeup rendering.
  • the first evaluation unit is specifically configured to:
  • the first evaluation unit is further configured to:
  • the actual contour area includes the makeup contour
  • the contour determination area is the actual contour area after the actual contour area is enlarged according to a preset ratio get
  • the makeup contour includes at least one of an eyebrow makeup contour, an eye shadow contour, a blush contour, and a lip makeup contour.
  • the eye shadow contour and/or blush contour includes multiple regions.
  • the makeup effect map displayed in the user interface is obtained from the server after the terminal device detects that the user selects the target makeup type.
  • the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor.
  • the terminal device executes the auxiliary makeup method in any one of the possible implementations of the first aspect.
  • the present application provides a computer-readable storage medium that stores a computer program that, when executed by a processor, causes the terminal device to perform any of the above-mentioned aspects of the first aspect. A possible realization of the auxiliary makeup method.
  • the present application provides a computer program product that, when the computer program product runs on a terminal device, causes the terminal device to execute the auxiliary makeup method of any one of the possible implementations of the first aspect.
  • the embodiment of the present application has the beneficial effect that by acquiring the user’s face image in real time, the makeup contour corresponding to the target makeup effect diagram is obtained, and the makeup contour corresponding to the target makeup effect diagram is superimposed and displayed on the user’s person.
  • the corresponding makeup area in the face image so that the user can make up according to the contour of the makeup.
  • This auxiliary makeup method based on makeup contours can provide users with an effective makeup reference during the makeup process, and improve the user's makeup skills so that the user can draw makeup that is close to or the same as the target makeup effect map.
  • Fig. 1 is a schematic diagram of an auxiliary makeup system provided by an embodiment of the present application
  • FIG. 2 is an interaction diagram of an auxiliary makeup method provided by an embodiment of the present application
  • 3A-3D are diagrams of a user interface provided by an embodiment of the present application.
  • FIG. 3E is a schematic diagram of facial feature points of a user provided by an embodiment of the present application.
  • 3F is a schematic diagram of a face shape provided by an embodiment of the present application.
  • FIG. 3G is a schematic diagram of an eye shape provided by an embodiment of the present application.
  • FIG. 3H is an image that superimposes and displays the contour of the eyebrows provided by an embodiment of the present application.
  • FIG. 3I is an enlarged image of the area where the contours of the eyebrows are superimposed and displayed in FIG. 3H;
  • FIG. 4 is an example diagram of assisting a user in makeup provided by an embodiment of the present application.
  • FIG. 5A is a schematic diagram of an image superimposing and displaying makeup contours provided by an embodiment of the present application.
  • FIG. 5B is a schematic diagram of an image superimposed to display the contour of an eye shadow provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of an image superimposing and displaying makeup contours provided by another embodiment of the present application.
  • Fig. 7 is a schematic structural diagram of an auxiliary makeup device provided by an embodiment of the present application.
  • the term “if” can be construed as “when” or “once” or “in response to determination” or “in response to detecting “.
  • the phrase “if determined” or “if detected [described condition or event]” can be interpreted as meaning “once determined” or “in response to determination” or “once detected [described condition or event]” depending on the context ]” or “in response to detection of [condition or event described]”.
  • Descriptive auxiliary makeup the user clicks on the preset link or option in the mobile App to call up a page, and uses text or a combination of graphics and text on the page to describe the makeup steps and skills.
  • the user refers to the makeup steps displayed on the page And techniques for makeup. Since the mobile phone needs a separate page to display the makeup steps and skills, the mobile phone cannot display the user's image collected by the camera and the content on the page at the same time on the display screen. Therefore, during the makeup process, the user is viewing his own image, Cannot refer to the makeup steps and techniques shown on this page.
  • Contrastive auxiliary makeup When the user needs makeup, he can select the desired makeup image through the mobile phone App, and the user performs makeup based on the displayed makeup image. For example, the user interface (UI) of the mobile phone App displays the user's face image collected by the camera. If the mobile phone detects that the user selects the eyebrow makeup image (for example, the one-word eyebrow), then the eyebrow makeup image It is displayed near the eyebrows in the face image of the user so that the user draws the eyebrows against the displayed eyebrow makeup image.
  • the above-mentioned auxiliary makeup method mainly has the following problems:
  • the existing makeup steps and skills are integrated into the mobile App to facilitate users' reference. This method is not very instructive in the user's makeup process. Users can only determine where they should start makeup and where they should be embodied based on their feelings. It cannot effectively improve the user's makeup skills, and it has no effect on the user's makeup. Any improvement is still not good for poorly painted makeup. In addition, since the mobile phone cannot display the user's image and the makeup steps and skills on the page at the same time, the user needs to exit the page when viewing his own image during the makeup process, and it is inconvenient to switch pages back and forth.
  • contrast-assisted makeup the user compares the makeup image to perform makeup. This is a static imitation makeup. The user can only determine where to start the makeup based on the feeling, and where to specify the makeup, etc., and cannot detail the makeup process. It is difficult for users to draw makeup in the image after makeup, and it is still difficult to draw makeup that is not well drawn.
  • auxiliary makeup method cannot provide users with makeup reference.
  • users can only determine where they should start makeup and where they should be embodied according to their feelings. Good makeup is still not good enough, and users still can’t draw satisfactory makeup.
  • the embodiment of the present application provides an auxiliary makeup method.
  • the makeup contour corresponding to the makeup effect diagram is superimposed and displayed on the corresponding makeup area in the user's face image, so that the user can make makeup according to the makeup contour.
  • the auxiliary makeup method based on makeup contour can provide the user with an effective makeup reference during the makeup process and improve the user's makeup technique so that the user can draw makeup that is close to or the same as the makeup effect map selected by the user.
  • Fig. 1 is a schematic diagram of an auxiliary makeup system provided by an embodiment of the present application.
  • a terminal device 100 and a server 200 are included, and the terminal device 100 and the server 200 can communicate with each other.
  • the terminal device 100 includes, but is not limited to, a mobile phone.
  • An App that can assist makeup such as a mirror App, is installed in the terminal device 100.
  • the server 200 stores makeup template information, which is used to provide related services such as downloading makeup template information for apps that can implement makeup assistance. For example, a service of downloading makeup renderings in makeup template information is provided.
  • the terminal device 100 may include a processor 110, a memory 120, an antenna 1, an antenna 2, a mobile communication module 130, a wireless communication module 140, an audio module 150, a speaker 150A, a receiver 150B, a microphone 150C, and a touch screen 160, camera 170 and so on.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100.
  • the terminal device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
  • the controller may obtain an instruction triggered by a user to manipulate an App for assisting makeup installed in the terminal device 100, and execute the instruction, so as to provide the user with a service of assisting makeup.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the storage 110 may store makeup template information downloaded from the server 200 by the terminal device 100.
  • the wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 130, the wireless communication module 140, the modem processor, and the baseband processor.
  • the terminal device 100 can access the Internet through wireless communication technology, communicate with the server 200, and download makeup template information from the server 200.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 130 may provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the terminal device 100.
  • the wireless communication module 140 may provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks) applied to the terminal device 100.
  • WLAN wireless local area networks
  • the terminal device 100 can access the Internet through the wireless communication module 140 and communicate with the server 200.
  • the antenna 1 of the terminal device 100 is coupled with the mobile communication module 130, and the antenna 2 is coupled with the wireless communication module 140, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology.
  • the terminal device 100 may communicate with the network and the server 200 through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), WLAN, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • CDMA code division multiple access
  • WCDMA broadband Code division multiple access
  • TD-SCDMA time-division code division multiple access
  • LTE long term evolution
  • WLAN wireless local area network
  • the terminal device 100 implements a display function through a GPU, a touch screen 160, and an application processor.
  • the GPU is a microprocessor for image processing
  • the touch screen 160 is used to display images, videos, and the like.
  • the touch display screen 160 includes a display panel.
  • the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the terminal device 100 may include one or N touch display screens 160, and N is a positive integer greater than one.
  • the touch display screen 160 can be used to display the user's facial image collected by the camera 170, to display the makeup renderings and makeup outlines included in the makeup template information downloaded from the server 200, and to display the The makeup contour is superimposed on the user's facial image, etc.
  • the terminal device 100 can implement a shooting function through an ISP, a camera 170, a video codec, a GPU, a touch screen 160, and an application processor. Wherein, when the user opens the App for assisting makeup in the terminal device 100, the terminal device 100 may collect the user's facial image through 170.
  • the ISP is used to process the data fed back by the camera 170. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 170.
  • the camera 170 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the terminal device 100 may include 1 or N cameras 170, and N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, and so on.
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • applications such as intelligent cognition of the terminal device 100 can be implemented, such as image recognition, face recognition, voice recognition, text understanding, and so on.
  • the memory 120 may be used to store computer executable program code, where the executable program code includes instructions.
  • the memory 120 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the storage data area can store data (such as audio data, phone book, makeup template information, etc.) created during the use of the terminal device 100.
  • the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • the processor 110 executes various functional applications and data processing of the terminal device 100 by running instructions stored in the memory 120 and/or instructions stored in a memory provided in the processor. For example, perform functions and data processing related to auxiliary makeup.
  • the terminal device 100 can implement audio functions through an audio module 150, a speaker 150A, a receiver 150B, a microphone 150C, and an application processor. For example, music playback, recording, etc. For another example, when the user performs makeup through an App with a makeup assist function, the terminal device 100 may also broadcast makeup instruction information, correction prompt information, etc. through the audio module 150.
  • the audio module 150 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 150 can also be used to encode and decode audio signals.
  • the audio module 150 may be disposed in the processor 110, or part of the functional modules of the audio module 150 may be disposed in the processor 110.
  • the speaker 150A also called “speaker” is used to convert audio electrical signals into sound signals.
  • the terminal device 100 can listen to music, voice prompt information, or listen to a hands-free call through the speaker 150A.
  • the receiver 150B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the terminal device 100 answers a call or voice message, it can receive the voice by bringing the receiver 150B close to the human ear.
  • the microphone 150C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the terminal device 100 may be provided with at least one microphone 150C.
  • the terminal device 100 may be provided with two microphones 150C, which can implement noise reduction functions in addition to collecting sound signals.
  • the terminal device 100 may also be provided with three, four or more microphones 150C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the server 200 may be a physical server or a cloud server, or a cluster, which is not limited here.
  • the server 200 may include a processor 210, a memory 220, a communication module 230, and a database 240.
  • the memory 220 may be used to store computer executable program codes.
  • the executable program codes include instructions.
  • the processor 210 executes functions and data processing related to auxiliary makeup by running the instructions stored in the memory 220.
  • the server 200 can communicate with the terminal device 100 through the communication module 230 to provide related services for the App that can assist makeup.
  • the database 240 may be used to store data. For example, it may be used to store a makeup template library, which may include multiple makeup template information.
  • the database 240 exists in the server 200; in some embodiments, the database 240 may also exist in other devices, and the server 200 may obtain the makeup template library from the databases of other devices, thereby Obtain makeup template information in the makeup template library; alternatively, the server 200 may also obtain makeup template information in the makeup template library from a database of other devices.
  • FIG. 2 is an interactive diagram of an auxiliary makeup method provided by an embodiment of the present application.
  • the auxiliary makeup method can be applied to the terminal device as shown in FIG. 1, and the terminal device includes, but is not limited to, a mobile phone.
  • the auxiliary makeup method in this embodiment can assist the user in drawing eyebrows, eye shadow, blush, lipstick, etc.
  • the following is a detailed description taking the terminal device as a mobile phone and assisting the user in drawing eyebrows as an example.
  • the auxiliary makeup method includes the following steps:
  • the server saves makeup template information, and the makeup template information includes at least a makeup effect map and a makeup outline.
  • the server may store makeup template information in the makeup template library of the database.
  • the makeup template information can be set by the administrator, or can be generated by the server based on the makeup renderings uploaded by the terminal device, and there is no restriction here.
  • the makeup effect pictures uploaded by the terminal device can come from beauty magazines or can be taken by users, for example, makeup effect pictures taken by the user while watching a video or TV series, makeup effect pictures taken by the user on the street, etc.
  • the makeup template information at least includes makeup renderings and makeup contours.
  • the method for generating makeup template information based on the makeup renderings uploaded by the terminal device may be: the server obtains the makeup renderings uploaded by the terminal device, and recognizes the eyes, eyebrows, mouth and other parts of the makeup renderings based on face recognition technology, and extracts the eyes. , Eyebrows, mouth and other parts of the makeup effect map corresponding to the makeup contour, the makeup effect map and its corresponding makeup contour are associated and saved to obtain makeup template information.
  • the makeup rendering is an image of the face after makeup.
  • the makeup effect image is an image of the entire sample face with makeup, or an image of a partial area of the sample face with makeup.
  • the makeup effect picture can be classified by style, such as daily makeup, holiday makeup (for example, Christmas makeup, Halloween makeup), party makeup, and the like.
  • the makeup effect diagram can also be a makeup effect diagram corresponding to different styles that the administrator can set for different facial features.
  • the makeup effect picture can be an image of a partial area of the sample portrait, it is classified according to the makeup type.
  • the makeup effect picture can be divided into eyebrow makeup effect picture, eye shadow makeup effect picture, lip makeup effect picture or blush effect picture according to makeup type.
  • the makeup renderings of each makeup type can be divided into multiple types according to makeup styles, that is to say, different makeup types can also include different makeup styles.
  • eyebrow makeup styles can include "one-word eyebrows” and “flat eyebrows”. ", "Liu Ye Mei” and so on.
  • the eyebrow makeup effect diagram may include the "one-word eyebrow” effect diagram, the "flat eyebrow” effect diagram, and the "willow leaf eyebrow” effect diagram.
  • the makeup contour is a reference line or reference area set for different makeup types.
  • the contour of the eyebrow makeup may be: the contour of the eyebrow drawn by the arc of the eyebrow corresponding to the style of the eyebrow makeup.
  • the eye shadow contour can be: the eye in the sample face image, the area where the eye shadow needs to be drawn by the reference line.
  • the blush contour may be: the area in the sample face image that needs to be blush drawn by reference lines.
  • the contour of the lip makeup may be: taking the shape of the lips in the sample face image, the area that needs to be painted with lipstick drawn by reference lines. It should be noted that the eye shadow contour and blush contour may include multiple regions.
  • a makeup effect picture when the makeup effect picture is for a certain part of the face, a makeup effect picture corresponds to a makeup contour; when the makeup effect picture is for multiple parts of the user or the entire face, a makeup effect picture corresponds to Multiple different makeup contours, for example, one makeup rendering can correspond to eyebrow makeup contour, eye shadow contour, lip makeup contour, blush contour, etc.
  • the eyebrow makeup contour includes a left eyebrow makeup contour and a right eyebrow makeup contour
  • the eye shadow contour may include a left eye shadow contour and a right eye shadow contour.
  • the makeup template information may also include makeup instruction information. Both the makeup contour and the makeup guide information are associated with the makeup effect image.
  • the makeup guidance information corresponding to the makeup effect diagram is used to guide the user to draw the makeup corresponding to the makeup effect diagram.
  • the makeup guidance information of the makeup effect diagram may include color information corresponding to makeup contours, and may also include makeup tools and cosmetics information.
  • the makeup guide information corresponding to the eyebrow makeup effect picture may include color information (for example, dark black, brown) used to describe the eyebrow makeup in the eyebrow makeup effect picture, and may also include thrush makeup.
  • Required makeup tool information and cosmetics information can be displayed in text form, can also be displayed in the form of a combination of graphics and text, and can also be broadcast by voice, which is not limited here.
  • the makeup guide information corresponding to each of the eye shadow contour and the blush contour also includes color information corresponding to each region.
  • the terminal device displays the user's face image collected by the camera.
  • the App can be an App for assisting makeup, or an existing App that adds an assistive makeup function, such as a camera app and an image processing app.
  • the App can be downloaded and installed by the user, or it can be a preset App in the terminal device.
  • the user refers to a user who needs makeup.
  • the face image can be a plain image before makeup, or an image collected during the makeup process.
  • the terminal device has a built-in camera
  • the user's face image is collected by the built-in camera.
  • the face image can be collected by the built-in front camera.
  • the face image of the user who needs makeup can be collected through the rear camera.
  • the terminal device obtains a makeup contour corresponding to the target makeup effect map.
  • the target makeup effect image may be a makeup effect image selected by the user, or a makeup effect image that the terminal device intelligently recommends to the user based on the user's face image using artificial intelligence technology. It should be noted that the mobile phone can obtain the makeup contour corresponding to the makeup effect diagram manually selected by the user from the user interface, or obtain the makeup contour corresponding to the target makeup effect diagram based on the voice message input by the user.
  • the makeup effect picture is a post-makeup image.
  • the makeup effect picture can be obtained from the local database of the terminal device.
  • the makeup template information can be downloaded from the server and the downloaded one can be obtained.
  • the makeup contour corresponding to the makeup rendering can be downloaded from the server.
  • the terminal device may also use image recognition technology or related image processing algorithms to extract makeup contours from the makeup effect map.
  • the terminal device can download the makeup contour corresponding to the makeup rendering from the makeup template library of the server, and save it for the next selection.
  • the terminal device may display corresponding options in the user interface that displays the user's face image, for example, "intelligent recommended makeup effect” and “user selected makeup effect”, so that the user can select “intelligent recommended makeup effect” "Picture” or "the user selects the makeup effect picture”.
  • the terminal device can obtain the target makeup effect map according to the options selected by the user, and obtain the makeup contour corresponding to the target makeup effect map.
  • the terminal can use artificial intelligence technology to recommend the target makeup effect map to the user, and obtain the makeup contour corresponding to the target makeup effect map.
  • the number of makeup effect pictures that the terminal device intelligently recommends to the user may be one or at least two, and there is no limitation here.
  • the terminal device can obtain and display the makeup renderings according to the options selected by the user, so that the user can select the desired target makeup renderings.
  • the terminal device can detect the target makeup selected by the user In the effect picture, the makeup contour corresponding to the target makeup effect picture is obtained.
  • FIGS. 3A to 3D When the user needs makeup, the user can click on the App with the auxiliary makeup function in FIG. 3A, for example, the mirror App.
  • the mobile phone starts the Mirror App, obtains the user's face image collected by the built-in camera of the mobile phone, and displays the user interface (UI) as shown in Figure 3B, so that the user can select "intelligent recommended makeup rendering" or "user Choose makeup renderings".
  • UI user interface
  • the mobile phone can display a UI interface as shown in Figure 3C to display the types of makeup available for the user to select.
  • the selectable makeup types may include eyebrow makeup, eye shadow makeup, face makeup, overall makeup for the entire face, and the like.
  • the mobile phone detects that the user selects "eyebrow makeup”
  • it can obtain the target makeup template information corresponding to the "eyebrow makeup” from the local database for storing makeup template information.
  • the mobile phone does not find the target makeup template information in the local database, it can send request information including the target makeup type to the server to download the target makeup template information from the server, so as to obtain the target makeup renderings contained in the target makeup template information.
  • the mobile phone finds the target makeup template information in the local database, it does not need to download the target makeup template information from the server.
  • the mobile phone When the mobile phone obtains the target makeup template information corresponding to "eyebrow makeup", it can display the UI interface as shown in Figure 3D to display the eyebrow makeup renderings contained in the target makeup template information corresponding to "eyebrow makeup” for the user Select the desired target eyebrow makeup renderings.
  • the mobile phone detects that the user selects the "one-shaped eyebrow” in Figure 3D, it acquires the makeup contour corresponding to the "one-shaped eyebrow”.
  • the mobile phone can display a UI interface as shown in Figure 3C to display the types of makeup available for the user to select.
  • the mobile phone can use face recognition technology to find the target face image with the highest similarity to the acquired user's face image from the face database, and compare the face image with The preset correspondence between the eyebrow makeup template information, obtain the target eyebrow makeup template information corresponding to the target face image, and display the target eyebrow makeup effect diagram contained in the target eyebrow makeup template information, so as to realize the intelligent recommendation of eyebrow makeup to the user Effect picture.
  • the user's face image can be sent to the server, so that after receiving the user's face image, the server can follow the preset between the face image and makeup template information For the corresponding relationship, the target makeup template information corresponding to the face image of the user displayed in S101 is obtained from the database.
  • the mobile phone when the mobile phone detects that the user selects the "smart recommended makeup effect map", it can also use the face recognition technology to recommend the target makeup effect corresponding to the overall makeup for the entire face based on the user's face image And obtain the makeup contour corresponding to the target makeup effect diagram.
  • the mobile phone recommends to the user the target makeup effect map corresponding to the overall makeup of the entire face, and obtains the makeup contour corresponding to the target makeup effect map.
  • Analyze and identify the user's facial feature points as shown in Figure 3E, identify the user's 68 facial feature points, and determine the user's facial contour and the user's eyes, mouth, nose, and eyebrows based on the user's facial feature points
  • the shape of the user's facial features is determined, and based on the preset correspondence between the preset facial features and the makeup effect map, a makeup effect map that matches the user's facial features is obtained.
  • the facial features of the user include but are not limited to the user's face shape, eye shape, eyebrow shape, etc.
  • the face shape is determined based on the facial contour in the face image, and the face shape may include, but is not limited to, a melon face, a round face, and a Chinese character face as shown in FIG. 3F.
  • the eye shape is determined according to the shape of the eye, and the eye shape includes, but is not limited to, peach eye, willow eye, almond eye, and red phoenix eye as shown in FIG. 3G.
  • the terminal device may also download and save makeup guidance information corresponding to the target makeup effect drawing from the server.
  • the makeup guide information can be used to describe the color information corresponding to each makeup contour in the target makeup effect map.
  • the makeup guide information corresponding to the contour of the eyebrow makeup is used to describe: the color of the end of the eyebrow is lighter than the color of the eyebrow.
  • the contour of the eyebrow makeup can be divided into two regions, and the peak of the eyebrow can be located at the junction of the two regions.
  • the makeup guide information corresponding to the contour of the eyebrow makeup is used to describe: the color ratio of the region including the beginning of the eyebrows is more than the region including the end of the eyebrows The color is deep.
  • the terminal device uses facial recognition technology to analyze the user’s facial image, recognize the user’s facial feature points, for example, the 68 facial feature points shown in Figure 3E, and identify the user based on the recognized facial feature points Face contours, eyebrows, eyes, mouth, nose, cheeks, etc. in the human face image. Then, the makeup area corresponding to the makeup contour is determined according to the makeup contour, and then the makeup contour is superimposed on the makeup area corresponding to each makeup contour, and the face image with the superimposed makeup contour is displayed, so that the user can compare the face with the superimposed makeup contour Applying makeup to the image, at this time the user is equivalent to applying makeup to the image presented in the mirror. For example, use corresponding cosmetics to stroke the face according to the superimposed makeup contour or fill in different colors in the makeup contour.
  • the terminal device can enlarge or reduce the makeup contour according to actual needs to match the user's facial features (for example, eyebrow shape, eye shape, mouth shape, and face shape).
  • the terminal device can also provide a corresponding entry for the user to edit the makeup outline or adjust the size and position of the makeup outline.
  • the makeup area corresponding to the contour of the eyebrow makeup is the eyebrow area in the user's face image.
  • the makeup area corresponding to the eye shadow contour may be the eye shadow area, and the eye shadow area may be the position of the eyelid in the user's face image.
  • the makeup area corresponding to the lip makeup contour is the area where the lips are located in the user's face image, and the makeup area corresponding to the blush contour can be the cheek area in the user's face image or the area where the cheek bones are located.
  • the makeup area corresponding to the blush contour can be a circle or an oval centered on the highest part of the cheekbones (when smiling, the place where the cheekbones are raised) is the center.
  • the terminal device first recognizes the eyebrow area in the user's face image by using face recognition technology, and recognizes the brow and tail of the eyebrow in the eyebrow area, Then, based on the position of the eyebrows and the end of the eyebrows in the user's face image, the contour of the eyebrow makeup corresponding to the "one-word eyebrow” is adaptively superimposed and displayed in the area where the eyebrows are in the user's face image, and the eyebrows are superimposed
  • the rendering of the contour to the user's face image is shown in Figure 3H.
  • the terminal device After the terminal device superimposes the eyebrow contour to the area where the eyebrows of the user's face image are located, it can also zoom in and display the area where the eyebrow contours are superimposed, as shown in FIG. Makeup, for example, using eyebrow pencil or powder to stroke the contour of the eyebrow makeup, and to paint within the contour of the eyebrow makeup.
  • the terminal device can fix the brow in the eyebrow makeup contour to the position of the brow in the user's face image, fix the brow tail in the eyebrow makeup contour to the position of the brow tail in the user's face image, or fix the eyebrow
  • the end of the eyebrow in the makeup outline is fixed at the position where the extension line of the end of the eyebrow in the user's face image is located.
  • the method for recognizing the brows and the tails of the eyebrows in the user's face image is specifically as follows: the terminal device can determine a straight line based on the first position where the corner of the eye is located and the second position where the nose wing is located, and recognize the intersection of the straight line and the eyebrows as the brow ; Determine a straight line based on the third position where the tail of the eye is located and the second position where the wing of the nose is located, and identify the intersection of the straight line and the eyebrows as the tail of the eyebrow.
  • the terminal device when it detects that the user is drawing eyebrow makeup, it can voice broadcast the makeup guidance information corresponding to the contour of the eyebrow makeup. Or, the makeup guide information corresponding to the eyebrow makeup is displayed in the user interface. When it is detected that the user has finished drawing the eyebrow makeup, the makeup guide information corresponding to the eyebrow makeup is hidden.
  • the terminal device can obtain the user's face image, obtain the makeup contour corresponding to the target makeup effect image selected by the user, or recommend the target makeup effect image to the user based on the user's face image using artificial intelligence technology and face recognition technology , And obtain the makeup contour corresponding to the target makeup effect diagram; superimpose the makeup contour corresponding to the target makeup effect diagram on the corresponding makeup area in the user's face image, so that the user can make makeup according to the makeup contour.
  • the auxiliary makeup method can provide users with an effective makeup reference during the makeup process, and improve the user's makeup skills, so that the user can draw makeup that is close to or the same as the makeup effect map selected by the user.
  • the face image displayed by the terminal will move with the movement of the user's face.
  • the user cannot accurately apply makeup according to the makeup contour in the corresponding makeup area.
  • S104 it may also include S105: detecting the movement of the user's face image, and controlling the makeup contour to move adaptively following the face image.
  • the mobile phone can control the makeup contour superimposed on the facial image to follow the user's facial image to adaptively move, so as to ensure that the makeup contour is always superimposed and displayed in the corresponding makeup area.
  • the mobile terminal uses face recognition technology and face tracking technology to detect whether the face image has changed after superimposing and displaying the makeup contour on the corresponding makeup area in the user's face image. Specifically, it is possible to compare whether the position of the same facial feature point has changed in the facial images acquired at two adjacent moments to determine whether the user's facial image has changed. Among them, when the position of the same facial feature point is different in the facial images acquired at two adjacent moments, the user's facial image changes, and the facial image has moved; when the position of the same facial feature point is At the same time, the user's face image has not changed, and the face image has not moved.
  • the terminal device When the terminal device confirms the movement of the user's face image, it re-determines the makeup area corresponding to the makeup contour according to the method in S104, and superimposes each makeup contour to the makeup area corresponding to each makeup contour.
  • the mobile phone uses face recognition technology to detect that a certain feature point of the facial feature points 37-46 in Figure 3E in the face image of the user is located at a different location at the first moment than at the second moment.
  • the eyebrow area is re-identified, and the contour of the eyebrow makeup corresponding to the "one-word eyebrow” is superimposed and displayed on the re-identified eyebrow area.
  • the terminal device can apply makeup to the user’s face image.
  • the effect is evaluated to determine whether the current makeup is consistent with the makeup in the target makeup effect map determined in S103, so as to solve the problem that the current makeup application does not evaluate the makeup effect of the user's face image and cannot provide correction prompts.
  • S104 or S105 S106 to S107 may also be included.
  • the terminal device can automatically start makeup evaluation when the user is putting on makeup, or it can start makeup evaluation when it detects that the user triggers a makeup evaluation request through the user interface of the App. For example, the terminal device starts makeup evaluation when it detects that the user clicks the "evaluation correction button" displayed on the user interface of the App.
  • the terminal device obtains the user's face image during the makeup process, and detects whether the makeup of each makeup area in the face image exceeds the makeup contour, and can also detect whether the actual color in each makeup contour matches each of the target makeup renderings.
  • the corresponding preset colors in the makeup contour match.
  • the current makeup is consistent with the makeup in the target makeup rendering.
  • the terminal device can evaluate the makeup based on the makeup.
  • the corresponding prompt information is output, and/or the plan is modified for the user to modify.
  • the method of detecting whether the makeup of each makeup area in the face image exceeds the makeup contour can be: obtaining the actual color information outside the makeup contour of each makeup area in the user's face image, and obtaining the makeup contour outside the target makeup effect picture
  • the preset color information compares the actual color information and the preset color information outside the contour of the same makeup. When the actual color information and the preset color information outside the same makeup contour match, the makeup of the makeup area in the face image does not exceed the makeup contour; when the actual color information outside the same makeup contour and the preset color information do not match, The makeup of the makeup area in the face image exceeds the contour of the makeup.
  • the actual color information and the preset color information may be specific color values or a range of color values, and the color values are usually represented by three primary colors (RGB) values.
  • RGB primary colors
  • the preset color information outside the same makeup contour is a specific color value range
  • the actual color value or the actual color value range outside the same makeup contour belongs to the preset color value range
  • the actual color information outside the makeup contour is considered And the preset color information is consistent; otherwise, it is considered that the actual color information outside the makeup contour and the preset color information are not consistent.
  • the actual color value or the actual color value range outside the same makeup contour is determined by the actual color value of each pixel outside the makeup contour.
  • obtaining the actual color information outside the makeup contour of each makeup area in the face image may be specifically: determining the actual contour area and the contour determination area corresponding to each makeup contour, and the actual contour area includes the makeup contour ,
  • the contour judgment area is obtained after the actual contour area is enlarged according to the preset ratio.
  • the color of the area other than the actual contour area in the contour determination area corresponding to each makeup contour is taken as the actual color outside the makeup contour.
  • FIG. 4 is an example diagram for assisting a user in makeup provided in an embodiment of the present application.
  • Figure 4 shows the actual contour area and contour determination area corresponding to the eyebrow makeup contour.
  • the area in the contour determination area excluding the actual contour area is the actual skin color area of the currently acquired face image, and the color corresponding to the actual skin color area is It is the actual color outside the contour of the eyebrow makeup.
  • the method of detecting whether the color in each makeup contour matches the color corresponding to each makeup contour of the target makeup rendering can be specifically: obtaining the actual color information in the makeup contour of each makeup area in the face image, and obtaining the target makeup
  • the preset color information in the makeup contour in the renderings compares the actual color information and the preset color information in the same makeup contour to determine whether the actual color information and the preset color information in the same makeup contour match.
  • the method for judging whether the actual color information in the makeup contour and the preset color information are consistent is the same as the method for judging whether the actual color information outside the makeup contour and the preset color information are consistent with each other, and will not be repeated here.
  • the mobile phone detects whether the eyebrow drawn by the user exceeds the eyebrow makeup displayed by the superimposed eyebrow through the preset RGB value in the contour of the eyebrow makeup corresponding to the "one-word eyebrow” and the actual RGB value of the eyebrow area. Contour, it can also detect whether the color in the contour of the eyebrow makeup matches the eyebrow color corresponding to the "one-word eyebrow” selected by the user.
  • the mobile phone When the mobile phone detects that the eyebrows drawn by the user exceed the contour of the eyebrow makeup, or the actual color of the eyebrow makeup drawn by the user is different from the preset color corresponding to the "one-word eyebrow”, the mobile phone outputs corresponding prompt information and a modification plan to prompt the user to modify the eyebrow makeup , To ensure that the eyebrow shape drawn by the user is "one-word eyebrow”, and the color of the eyebrow makeup drawn is the same as the preset color, so as to avoid the situation that the eyebrow makeup drawn by the user is too thick, too long, or inconsistent with the eyebrow shape.
  • the position information of the pixels that exceed the contour of the eyebrow makeup can be further determined (the position information can be pixel coordinates), and further according to the position information of the pixels that exceed the contour of the eyebrow makeup Determine whether the eyebrows drawn by the user are too long, too thick, and the drawn eyebrow peaks are too high or too low, so as to output the corresponding reminder information according to the specific situation.
  • the position information can be pixel coordinates
  • the position information of the pixels that exceed the contour of the eyebrow makeup Determine whether the eyebrows drawn by the user are too long, too thick, and the drawn eyebrow peaks are too high or too low, so as to output the corresponding reminder information according to the specific situation.
  • the end point of the eyebrow makeup outline can be marked with a conspicuous color to remind the user that the drawn eyebrow is too long.
  • the voice reminds the user that the eyebrows drawn are too long.
  • the color of the pixels around the eyebrow makeup contour superimposed in the face image is darker than the color of the pixels on the periphery of the eyebrows (such as the forehead)
  • the contour of the eyebrow makeup the voice reminds the user that the eyebrows are too thick.
  • the eyebrow peak drawn by the user is too high, and the eyebrow peak of the eyebrow makeup contour can be marked with a striking color (the eyebrow peak refers to the highest point of the eyebrow).
  • the distance between the highest point of the eyebrow drawn by the user (that is, the highest point in the contour of the eyebrow makeup) and the highest point of the contour of the eyebrow makeup is greater than the preset distance threshold, it is determined The peak of the eyebrow drawn by the user is too low. You can mark the peak of the eyebrow drawn by the user with a bold color.
  • the terminal device can also compare whether the first arc corresponding to the contour of the eyebrow makeup is the same or approximately the same as the second arc corresponding to the eyebrow drawn by the user.
  • the first arc is the same as the second arc Or when they are approximately the same, it is determined that the shape of the eyebrows drawn by the user matches the shape of the eyebrows in the eyebrow makeup rendering.
  • the eyebrow drawn by the user does not exceed the contour of the eyebrow makeup, and the actual color in the contour of the eyebrow makeup matches the preset color corresponding to the contour of the eyebrow makeup, it is determined that the eyebrow makeup drawn by the user is consistent with the eyebrow makeup in the eyebrow makeup rendering.
  • the first radian and the second radian are approximately the same, meaning that the radian difference between the two is within a preset error range.
  • the terminal device obtains the face image of the user during the makeup process, and recognizes the colors inside and outside the makeup outline superimposed on the face image, thereby detecting whether the makeup drawn by the user exceeds the makeup outline, and detecting the content in the makeup outline. Whether the actual color is consistent with the preset color corresponding to each makeup contour in the makeup rendering, so as to determine whether the makeup drawn by the user is consistent with the makeup in the target makeup rendering, so as to evaluate the accuracy of the user's makeup.
  • the terminal device can also mark the makeup outline when it detects that the makeup drawn by the user exceeds the makeup outline, and when it detects that the actual color of any area within the makeup outline does not match the corresponding preset color, it marks the makeup color of the area with Remind users to make corrections, realizing real-time guidance, real-time evaluation and reminders during the makeup process, so that users can make timely corrections, so that users can draw as much makeup as possible as the makeup renderings.
  • the method of assisting the user in drawing lip makeup, blush makeup, and eye shadow makeup and the method of assisting the user in drawing eyebrows, except for superimposing and displaying the makeup corresponding to the target makeup rendering on the user's face image
  • the outline method is slightly different, and the other implementation processes are similar.
  • the method of superimposing and displaying the makeup contour corresponding to the target makeup rendering on the user's face image is as follows:
  • the terminal device When the terminal device obtains that the makeup contour corresponding to the target lip makeup rendering is a lip makeup contour, it can use the feature point corresponding to the left corner of the user's face image and the feature point corresponding to the right corner of the face image as the reference point , Superimpose the lip makeup contour to the position of the mouth in the face image, so that the user can use lipstick or lip gloss to stroke the lip makeup contour and paint the lip makeup contour against the face image after the lip makeup contour is superimposed.
  • the terminal device When the terminal device obtains that the makeup contour corresponding to the target eye shadow rendering is the eye shadow contour, when drawing the eye shadow, the upper eyelid needs to be smudged from the root of the eyelashes to a position 1 to 2 mm beyond the double eyelid fold, and the lower eyelid needs to be smudged upwards.
  • the terminal device can determine the makeup area corresponding to the eye shadow contour (ie, the eye shadow area) according to the position of the eyelashes and the position of the double eyelid folds, and superimpose the eye shadow contour on the makeup area corresponding to the eye shadow contour , So that the user can apply eye shadow within the eye shadow contour against the face image after the eye shadow contour is superimposed.
  • the terminal device can use the highest point of the cheek and cheekbones in the face image as the center point, and superimpose the blush contour on the basis of the center point.
  • the center point of the blush contour is located at the highest point of the cheeks and cheekbones of the face image, so that the user can use a brush to draw blush within the blush contour against the face image after the blush contour is superimposed.
  • the blush contour corresponding to the target blush effect map may include one blush area or at least two blush areas.
  • the blush contour superimposed on the user's face image includes 5 blush regions.
  • the makeup guide information corresponding to the blush contour can be used to describe: the blush color corresponding to each blush area included in the blush contour.
  • the blush contour can also include a middle area and at least one outer area.
  • the makeup guide information corresponding to the blush contour can be used to describe: the blush color in the middle area is darker than the blush in the outer area; the makeup guide corresponding to the blush contour Information can also be used to describe: the blush color corresponding to the middle area and the blush color corresponding to the outer area.
  • the eye shadow contour corresponding to the target eye shadow effect map may include multiple eye shadow regions.
  • the terminal device After the terminal device obtains the makeup guidance information corresponding to the eye shadow effect diagram, when the terminal device displays the obtained eye shadow contour, it may also display the makeup guidance information corresponding to the target eye shadow effect diagram near the eye shadow contour.
  • the terminal device may superimpose the obtained eye shadow contour and display it on the user's eye area.
  • the eye shadow contour includes 4 areas, and the displayed makeup guide information is the eye shadow tray.
  • Schematic diagram, the schematic diagram of the eyeshadow tray marks the eye shadow color corresponding to each area in each eye shadow contour.
  • the eye shadow contour can also include 3 areas.
  • the makeup guide information corresponding to the eye shadow contour is used to describe: from the corner of the eye to the end of the eye, the color of the eye shadow gradually darkens, and the eye shadow color in the area where the corner of the eye is located is the lightest.
  • the eye shadow is the darkest in the area where the end of the eye is located.
  • the makeup guide information corresponding to the eye shadow outline is used to describe: the color of the eye shadow gradually becomes lighter from bottom to top, that is, the area closest to the eyelashes has the darkest color and the one that is the farthest from the eyelashes.
  • the eyeshadow color is the lightest in the area.
  • the makeup guide information corresponding to the eye shadow contour is used to describe: the color number corresponding to each eye shadow area.
  • the makeup guide information corresponding to the contour of the eye shadow may describe the color system to which the eye shadow color belongs and the color number corresponding to each area in a combination of graphics and text.
  • the color numbers corresponding to the three regions included in the eye shadow contour may be light brown, brown, and brown, respectively.
  • the makeup guide information corresponding to the contour of the right eye shadow shown in FIG. 3 may be that the colors of the eye shadow area are light brown, brown, and brown in order from left to right.
  • the eye shadow contour is divided into 3 regions or 4 regions, in other embodiments it can be divided into 2 regions or more regions, which can be specifically set according to the actual situation, and there is no limitation here. .
  • the terminal device needs to detect whether the color information in each area of each makeup contour matches the color corresponding to each area of each makeup contour in the makeup effect map.
  • the colors in the makeup contour are consistent with the colors corresponding to the makeup contour in the makeup rendering.
  • the actual color of any area of a certain makeup contour does not match the preset color
  • the actual color of the makeup contour does not match the color corresponding to the makeup contour in the makeup rendering.
  • the method of outputting the correction reminder information based on the makeup evaluation result can be specifically as follows: when the makeup of any makeup area exceeds the corresponding makeup contour, the makeup contour or a certain part of the makeup contour can be marked with a color to remind The user corrects the makeup corresponding to the makeup contour.
  • the area can be marked with a conspicuous color.
  • the terminal device can also use voice to remind the user which position is beyond the contour of the makeup, and remind the user that the actual color of the area does not match the preset color.
  • the terminal device outputs the correction reminder information, the user continuously corrects based on the correction reminder information, so that the corrected makeup gradually approaches the makeup in the makeup rendering, and finally draws the same makeup as the makeup in the makeup rendering.
  • the terminal device performs makeup evaluation when assisting the user to draw eye shadow makeup and blush makeup and how to give correction reminders based on the makeup evaluation result:
  • the terminal device detects based on the user's face image Whether the eye shadow drawn by the user in the eye shadow area exceeds the eye shadow contour that is superimposed and displayed, it can also detect whether the color of the eye shadow drawn by the user matches the color corresponding to the eye shadow contour.
  • the user can be reminded by voice, or the eye shadow outline can be marked with eye-catching colors, and the position information of the pixel points beyond the eye shadow outline can be determined, and based on this The position information of the pixel point is marked with eye-shadow contours near the pixel point in eye-catching colors, which is convenient for the user to correct.
  • the eye shadow makeup rendering shows the preset color of each area
  • the terminal device can display the face Compare the image of the first area of the eye shadow contour superimposed on the image with the image of the first area in the eye shadow makeup effect diagram to determine the actual color of the first area of the eye shadow contour in the face image and the first area in the eye shadow makeup effect diagram Whether the preset colors of the area are the same. According to the same method, it is determined whether the actual color and the preset color respectively corresponding to the second area and the third area are the same. When the actual color of any pixel in the first area of the eye shadow contour is different from the preset color corresponding to the first area, the pixel is marked with a striking color for the user to modify.
  • the terminal device can also obtain the actual RGB value of each area of the eye shadow contour in the face image, and obtain the RGB preset value or the RGB preset range of each area in the eye shadow makeup rendering, respectively, and the actual RGB corresponding to each area The value is compared with the RGB preset value or RGB preset range corresponding to each area to determine whether the actual RGB value corresponding to each area is the same as the corresponding RGB preset value, or whether the actual RGB value corresponding to each area Belongs to its corresponding RGB preset range.
  • the actual RGB value of each area of the eye shadow contour is the same as its corresponding RGB preset value, or the actual RGB value of each area of the eye shadow contour belongs to their corresponding RGB preset range, the actual color in the eye shadow contour is considered to be the same as the preset value.
  • the color match that is, the color of the eye shadow drawn by the user matches the color corresponding to the contour of the eye shadow.
  • the terminal device detects whether the eye shadow drawn by the user in the blush area exceeds the outline of the blush displayed on the basis of the user's face image, and can also detect whether the color of the blush drawn by the user is the same as the blush The color corresponding to the outline matches.
  • the specific detection method of the blush area is similar to the detection method of the eye shadow area, and will not be repeated here.
  • each makeup contour in this embodiment can be set according to actual conditions, and each makeup contour can also be divided into multiple regions according to actual needs, and there is no limitation here.
  • the makeup contour corresponding to the target makeup effect picture may include eyebrow makeup contour, eye shadow contour, and blush contour
  • the target makeup effect picture corresponds to
  • the image after the makeup contour is adaptively superimposed on the user's face image can be shown in FIG. 6 to assist the user in drawing the overall makeup.
  • the method of assisting the user in drawing overall makeup is similar to assisting the user in drawing eyebrow makeup, drawing eye shadow makeup, drawing blush makeup, etc.
  • the terminal device obtains the face image of the user during the makeup process, and recognizes the colors inside and outside the makeup contour superimposed in the face image, thereby detecting whether the makeup drawn by the user exceeds the makeup contour, and detecting the actual makeup contour. Whether the color matches the preset color corresponding to each makeup contour in the makeup rendering, so as to determine whether the makeup drawn by the user is consistent with the makeup in the makeup rendering, so as to realize the evaluation of the accuracy of the user's makeup.
  • the terminal device can also mark the makeup outline when it detects that the makeup drawn by the user exceeds the makeup outline, and when it detects that the actual color of any area within the makeup outline does not match the corresponding preset color, it marks the makeup color of the area with Remind users to make corrections, realizing real-time guidance, real-time evaluation and reminders during the makeup process, so that users can make timely corrections, so that users can draw the same makeup as the makeup renderings as much as possible.
  • FIG. 7 shows a structural block diagram of an auxiliary makeup device provided in an embodiment of the present application. For ease of description, only the parts related to the embodiment of the present application are shown.
  • the auxiliary makeup device includes:
  • the display unit 710 is configured to display the user's face image collected by the camera;
  • the obtaining unit 720 is configured to obtain the makeup contour corresponding to the target makeup effect map
  • the auxiliary makeup unit 730 is configured to identify the makeup area corresponding to the makeup contour from the face image, and adaptively superimpose and display the makeup contour on the makeup area corresponding to the makeup contour to assist the user in putting on makeup .
  • the target makeup effect diagram is a makeup effect diagram selected by the user.
  • the target makeup effect map is a makeup effect map recommended by the auxiliary makeup device based on the face image and using artificial intelligence technology.
  • the auxiliary makeup device may further include:
  • a detecting unit configured to detect the movement of the face image after the auxiliary makeup unit adaptively superimposes and displays the makeup contour on the makeup area corresponding to the makeup contour;
  • the makeup contour adjustment unit is used to control the makeup contour to move adaptively following the face image.
  • the auxiliary makeup device may further include:
  • the makeup evaluation unit is configured to perform, based on the face image, on each makeup corresponding to the makeup contour after the auxiliary makeup unit superimposes and displays the makeup contour adaptively on the makeup area corresponding to the makeup contour Evaluation to obtain the makeup evaluation result.
  • the auxiliary makeup device may further include:
  • the reminder unit is configured to output correction reminder information based on the makeup evaluation result when the makeup evaluation result indicates that the makeup corresponding to any makeup area in the face image does not match the makeup in the target makeup rendering.
  • the reminding unit is specifically configured to mark a target area with a striking color in the face image, the target area being a makeup area that does not match the makeup in the target makeup rendering .
  • the acquiring unit may be further configured to: acquire makeup guide information corresponding to the target makeup effect map;
  • the auxiliary makeup unit adaptively superimposes and displays the makeup contour on the makeup area corresponding to the makeup contour, it can also be used to display or voice broadcast the makeup guidance information.
  • the makeup evaluation unit may include:
  • the first evaluation unit is used to detect whether the makeup of each makeup area in the face image exceeds the makeup contour, wherein, when the makeup of any makeup area exceeds the makeup contour, it indicates the makeup area The corresponding makeup does not match the makeup in the target makeup rendering.
  • the makeup evaluation unit may further include:
  • the second evaluation unit is configured to detect whether the actual color in each makeup contour in the face image matches the preset color in each makeup contour of the target makeup effect diagram, wherein, when any When the makeup of the makeup area exceeds the makeup contour, or the actual color in any of the makeup contours does not match the preset color, it means that the makeup corresponding to the makeup area does not match the makeup in the target makeup rendering.
  • the first evaluation unit is specifically configured to:
  • the first evaluation unit is further configured to:
  • the actual contour area includes the makeup contour
  • the contour determination area is the actual contour area after the actual contour area is enlarged according to a preset ratio get
  • the makeup contour includes at least one of eyebrow makeup contour, eye shadow contour, blush contour, and lip makeup contour.
  • the eye shadow contour and/or blush contour includes multiple regions.
  • the makeup effect map displayed in the user interface is obtained from the server after the terminal device detects that the user selects the target makeup type.
  • the auxiliary makeup device may be a terminal device, or a chip in the terminal device, or a functional module integrated in the terminal device.
  • the chip or the functional module may be located in a control center (for example, a console) of the terminal device, and the terminal device is controlled to implement the auxiliary makeup method provided in this application.
  • the embodiment of the present application also provides a terminal device.
  • the terminal device includes: at least one processor, a memory, and a computer program stored in the memory and running on the at least one processor, and the processor executes The computer program causes the terminal device to execute the steps in any of the foregoing embodiments of the auxiliary makeup method.
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, causes the terminal device to execute each of the above-mentioned auxiliary makeup method embodiments Steps in.
  • the embodiments of the present application provide a computer program product.
  • the computer program product runs on a mobile terminal, the mobile terminal executes the steps in the above-mentioned various auxiliary makeup method embodiments.
  • the computer-readable medium includes a computer storage medium and a communication medium, where the communication medium includes any medium that facilitates the transfer of a computer program from one place to another.
  • a computer storage medium may be any available medium that can be accessed by a computer.
  • the computer-readable medium may at least include: any entity or device capable of carrying computer program code to the photographing device/terminal device, recording medium, computer memory, read-only memory (ROM), random access memory (Random Access Memory, RAM), electric carrier signal, telecommunications signal and software distribution medium.
  • ROM read-only memory
  • RAM random access memory
  • electric carrier signal telecommunications signal and software distribution medium.
  • U disk mobile hard disk, floppy disk or CD-ROM, etc.
  • computer-readable media cannot be electrical carrier signals and telecommunication signals.

Abstract

本申请适用于通信技术领域，提供了辅助化妆方法、终端设备、存储介质及程序产品方法，该方法包括：显示摄像头采集的用户的人脸图像；获取目标妆容效果图对应的妆容轮廓；从所述人脸图像中识别所述妆容轮廓对应的化妆区域，将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域，以便用户照着妆容轮廓进行化妆。这种基于妆容轮廓的辅助化妆方式，可以在用户化妆过程中给用户提供有效的化妆参考，提高用户的化妆技术，以便用户能够画出与目标妆容效果图接近或相同的妆容。

Description

辅助化妆方法、终端设备、存储介质及程序产品
本申请要求于2020年04月01日提交国家知识产权局、申请号为202010251470.0、申请名称为“辅助化妆方法、终端设备、存储介质及程序产品”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请本申请属于通信技术领域，尤其涉及一种辅助化妆方法、终端设备、存储介质及程序产品。
背景技术
化妆是运用化妆品和工具，采取合乎规则的步骤和技巧，对人体的面部、五官及其他部位进行渲染、描画、整理，增强立体印象，调整形色，掩饰缺陷，表现神采，从而达到美化视觉感受的目的。不同的环境、季节以及不同的场合，妆容也会有所不同。
用户通常是对着镜子化妆，例如，画眉毛、画眼影、涂唇膏、腮红等，并根据上妆效果进行修饰和完善。由于化妆本身涉及较多步骤和处理技巧，对于化妆新手来说，在实际操作过程中，即使比着视频教程化妆或者比着妆后图像(即已完成化妆的图像)进行化妆，也很难画出相同或相近的妆容。目前没有有效的方案辅助用户化妆。
发明内容
本申请提供了一种辅助化妆方法、终端设备、存储介质及程序产品，可以解决目前没有有效的方案辅助用户化妆，无法给用户提供化妆参考的问题。
第一方面，本申请提供了一种辅助化妆方法方法，包括：
显示摄像头采集的用户的人脸图像；
获取目标妆容效果图对应的妆容轮廓；
从所述人脸图像中识别所述妆容轮廓对应的化妆区域，将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域，用于辅助所述用户化妆。
需要说明的是，用户是指需要化妆的用户。人脸图像可以是化妆前的素颜图像，也可以是在化妆过程中采集的图像。目标妆容效果图为妆后图像。目标妆容效果图可以是针对整个脸部的妆容效果图，目标妆容效果图可以来自美妆杂志，也可以是用户街拍得到的妆容效果图。终端设备可以采用图像识别技术或相关的图像处理算法从目标妆容效果图中提取出相应的妆容轮廓，还可以从服务器中获取目标妆容效果图对应的妆容轮廓。
可以理解的是，在叠加轮廓的过程中，终端设备可以根据实际需要放大或缩小妆容轮廓，以与用户的五官特点(例如，眉形、眼型、嘴型、脸型)相匹配。终端设备还可以提供相应的入口供用户编辑妆容轮廓或调整妆容轮廓的大小及位置。
本方案中，终端设备可以实时动态获取用户的人脸图像，获取用户选中的目标妆容效果图对应的妆容轮廓，或基于用户的人脸图像，利用人工智能技术以及人脸识别技术向用户推荐目标妆容效果图，并获取目标妆容效果图对应的妆容轮廓；将目标妆容效果图对应的妆容轮廓叠加显示于用户的人脸图像中相应的化妆区域，以便用户照着妆容轮廓进行化妆，这种基于妆容轮廓的辅助化妆方式，可以在用户化妆过程中给用户提供有效的化妆参考，提高用户的化妆技术，以便用户能够画出与目标妆容效果图接近或相同的妆容。
在第一方面的一种可能的实现方式中，所述目标妆容效果图为所述用户选择的妆容效果图。
需要说明的是，手机可以获取用户从用户界面中手动选择的妆容效果图所对应的妆容轮廓，也可以基于用户输入的语音消息获取目标妆容效果图对应的妆容轮廓。
在本方案中，用户可以根据实际需要从用户界面中手动选择需要的目标妆容效果图，终端设备在检测到用户选中的目标妆容效果图，获取目标妆容效果图对应的妆容轮廓。
在第一方面的一种可能的实现方式中，所述用户界面中显示的妆容效果图是终端设备在检测到用户选中目标妆容类型之后，从服务器中获取得到。
在第一方面的一种可能的实现方式中，所述目标妆容效果图为终端设备基于所述人脸图像、利用人工智能技术推荐的妆容效果图。
终端设备向用户智能推荐妆容效果图的数量可以为一个，也可以为至少两个，此处不做限制。
在方案中，终端设备可以利用人工智能技术向用户智能推荐妆容效果图。
在第一方面的一种可能的实现方式中，所述将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还包括：
检测到所述人脸图像移动；
控制所述妆容轮廓跟随所述人脸图像适应性移动。
在本方案中，由于用户在化妆过程中，脸部位置可能会发生变化，当用户的脸部移动时，终端显示的人脸图像会随着用户的脸部的移动而移动，以使得妆容轮廓始终叠加显示于相应的化妆区域，可以避免用户因转动头部而导致妆容轮廓与相应的化妆区域处于不同位置，从而导致用户无法准确地在相应的化妆区域按妆容轮廓进行化妆的问题。
在第一方面的一种可能的实现方式中，所述将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还包括：
基于所述人脸图像，对每个所述妆容轮廓对应的妆容进行评估，得到妆容评估结果。
本方案中，为了使用户更准确地画出与妆容效果图相同或相近的妆容，用户对照着任意妆容轮廓进行化妆的过程中，或者在化妆完毕时，终端设备可以对用户的人脸图像中的妆容效果进行评估，以判断当前的妆容是否与目标妆容效果图中的妆容相符，以实现对用户化妆准确性的评估，解决当前的美妆应用对用户的人脸图像的化妆效果没有评估，无法进一步提供修正提示的问题。
在第一方面的一种可能的实现方式中，所述得到妆容评估结果之后，还包括：
当所述人脸图像中任意化妆区域对应的妆容与所述目标妆容效果图中的妆容不符时，基于所述妆容评估结果输出修正提醒信息。
本方案中，在人脸图像中任意化妆区域对应的妆容与所述目标妆容效果图中的妆容不符时，可以输出修正提醒信息，以提示用户修正妆容。
在第一方面的一种可能的实现方式中，所述显示摄像头采集的用户的人脸图像之后，还包括：
获取所述目标妆容效果图对应的化妆指导信息；
相应的，所述将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还包括：
显示或语音播报所述化妆指导信息。
示例性的，所述化妆指导信息可以用于描述所述目标妆容效果图中的妆容轮廓对应的颜色信息。
在本方案中，目标妆容效果图对应的化妆指导信息，可以帮助用户画出与妆容效果图相同或更相近的妆容。
在第一方面的一种可能的实现方式中，所述对每个所述妆容轮廓对应的妆容进行评估，包括：检测所述人脸图像中每个化妆区域的妆容是否超出所述妆容轮廓，其中，当任一所述化妆区域的妆容超出所述妆容轮廓时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
本方案中，终端设备可以通过检测人脸图像中每个化妆区域的妆容是否超出妆容轮廓，来确定用户画的妆容是否与妆容效果图中的妆容相符，以实现对用户化妆准确性的评估。
在第一方面的一种可能的实现方式中，所述对每个所述妆容轮廓对应的妆容进行评估，还包括：检测所述人脸图像中的每个所述妆容轮廓内的实际颜色是否与所述目标妆容效果图的每个妆容轮廓内的预设颜色相符，其中，当任一所述化妆区域的妆容超出所述妆容轮廓，或任一所述妆容轮廓内的实际颜色与预设颜色不符时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
在本方案中，终端设备可以通过检测妆容轮廓内的实际颜色与妆容效果图中各妆容轮廓对应的预设颜色是否相符，从而确定用户画的妆容是否与妆容效果图中的妆容相符，以实现对用户化妆准确性的评估。
在第一方面的一种可能的实现方式中，所述检测所述人脸图像中每个化妆区域的妆容是否超出所述妆容轮廓，包括：
获取所述人脸图像中的每个化妆区域的妆容轮廓外的实际颜色信息，以及获取所述目标妆容效果图中的每个妆容轮廓外的预设颜色信息；
当任一所述化妆区域的妆容轮廓外对应的实际颜色与预设颜色不同时，该化妆区域的妆容超出所述妆容轮廓。
本方案中，终端设备可以通过比较同一化妆区域的妆容轮廓外对应的实际颜色信息以及预设颜色信息，来判断妆容轮廓外的实际颜色与妆容效果图中各妆容轮廓外对应的预设颜色是否相符，可以提高判断结果的准确性。
在第一方面的一种可能的实现方式中，为了更准确地检测妆容轮廓外的实际颜色与妆容效果图中各妆容轮廓外对应的预设颜色是否相符，所述获取所述人脸图像中的每个化妆区域的妆容轮廓外的实际颜色信息，包括：
确定所述人脸图像中的每个所述妆容轮廓对应的轮廓实际区域和轮廓判定区域，所述轮廓实际区域包括妆容轮廓，所述轮廓判定区域是所述轮廓实际区域按预设比例放大之后得到；
获取每个所述妆容轮廓对应的轮廓判定区域中除轮廓实际区域之外的区域的颜色，得到所述妆容轮廓外的实际颜色。
在第一方面的一种可能的实现方式中，所述基于所述妆容评估结果输出修正提醒信息，包括：在所述人脸图像中用醒目颜色标记目标区域，所述目标区域为与所述目标妆容效果图中的妆容不符的化妆区域。
在本方案中，终端设备可以在检测到用户画的妆容超出妆容轮廓时标记该妆容轮廓，在检测到妆容轮廓内的任一区域的实际颜色与相应的预设颜色不符时，标记该区域的妆容颜色，以提醒用户修正，实现了在化妆过程中进行实时指导、实时评估和提醒，以便用户及时修正，使用户尽可能画出与妆容效果图相同的妆容。
在第一方面的一种可能的实现方式中，所述妆容轮廓包括眉妆轮廓、眼影轮廓、腮红轮廓以及唇妆轮廓中的至少一种。
在第一方面的一种可能的实现方式中，所述眼影轮廓和/或腮红轮廓包括多个区域。
示例性的，眉妆轮廓对应的化妆区域为用户的人脸图像中的眉毛区域。眼影轮廓对应的化妆区域可以为眼影区域，眼影区域可以为用户的人脸图像中眼睑所在的位置。唇妆轮廓对应的化妆区域为用户的人脸图像中嘴唇所在的区域，腮红轮廓对应的化妆区域可以为用户的人脸图像中的脸颊区域，也可以为面颊颧骨所在的区域。腮红轮廓对应的化妆区域可以以颧骨最高处(微笑时，以颧骨凸起的地方为中心)为中心的圆形或椭圆形。
第二方面，本申请提供了一种辅助化妆装置，辅助化妆装置可以应用于终端设备，辅助化妆装置包括：
显示单元，用于显示摄像头采集的用户的人脸图像；
获取单元，用于获取目标妆容效果图对应的妆容轮廓；
辅助化妆单元，用于从所述人脸图像中识别所述妆容轮廓对应的化妆区域，将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域，用于辅助所述用户化妆。
在第二方面的一种可能的实现方式中，所述目标妆容效果图为所述用户选择的妆容效果图。
在第二方面的一种可能的实现方式中，所述目标妆容效果图为辅助化妆装置基于所述人脸图像、利用人工智能技术推荐的妆容效果图。
在第二方面的一种可能的实现方式中，辅助化妆装置还可以包括：
检测单元，用于在所述辅助化妆单元将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，检测到所述人脸图像移动；
妆容轮廓调整单元，用于控制所述妆容轮廓跟随所述人脸图像适应性移动。
在第二方面的一种可能的实现方式中，辅助化妆装置还可以包括：
妆容评估单元，用于在所述辅助化妆单元将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，基于所述人脸图像，对每个所述妆容轮廓对应的妆容进行评估，得到妆容评估结果。
在第二方面的一种可能的实现方式中，辅助化妆装置还可以包括：
提醒单元，用于当所述妆容评估结果表示所述人脸图像中任意化妆区域对应的妆容与所述目标妆容效果图中的妆容不符时，基于所述妆容评估结果输出修正提醒信息。
在第二方面的一种可能的实现方式中，所述提醒单元具体用于：在所述人脸图像中用醒目颜色标记目标区域，所述目标区域为与所述目标妆容效果图中的妆容不符的化妆区域。
在第二方面的一种可能的实现方式中，所述获取单元还可以用于：获取所述目标妆容效果图对应的化妆指导信息；
相应的，所述辅助化妆单元在将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还可以用于：显示或语音播报所述化妆指导信息。
在第二方面的一种可能的实现方式中，所述妆容评估单元可以包括：
第一评估单元，用于检测所述人脸图像中每个化妆区域的妆容是否超出所述妆容轮廓，其中，当任一所述化妆区域的妆容超出所述妆容轮廓时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
在第二方面的一种可能的实现方式中，所述妆容评估单元还可以包括：
第二评估单元，用于检测所述人脸图像中的每个所述妆容轮廓内的实际颜色是否与所述目标妆容效果图的每个妆容轮廓内的预设颜色相符，其中，当任一所述化妆区域的妆容超出所述妆容轮廓，或任一所述妆容轮廓内的实际颜色与预设颜色不符时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
在第二方面的一种可能的实现方式中，所述第一评估单元具体用于：
获取所述人脸图像中的每个化妆区域的妆容轮廓外的实际颜色信息，以及获取所述目标妆容效果图中的每个妆容轮廓外的预设颜色信息；
当任一所述化妆区域的妆容轮廓外对应的实际颜色与预设颜色不同时，该化妆区域的妆容超出所述妆容轮廓。
在第二方面的一种可能的实现方式中，所述第一评估单元还用于：
确定所述人脸图像中的每个所述妆容轮廓对应的轮廓实际区域和轮廓判定区域，所述轮廓实际区域包括妆容轮廓，所述轮廓判定区域是所述轮廓实际区域按预设比例放大之后得到；
获取每个所述妆容轮廓对应的轮廓判定区域中除轮廓实际区域之外的区域的颜色，得到所述妆容轮廓外的实际颜色。
在第二方面的一种可能的实现方式中，所述妆容轮廓包括眉妆轮廓、眼影轮廓、腮红轮廓以及唇妆轮廓中的至少一种。
在第二方面的一种可能的实现方式中，所述眼影轮廓和/或腮红轮廓包括多个区域。
在第二方面的一种可能的实现方式中，所述用户界面中显示的妆容效果图是终端设备在检测到用户选中目标妆容类型之后，从服务器中获取得到。
第三方面，本申请提供了一种终端设备，包括存储器、处理器以及存储在所述存 储器中并可在所述处理器上运行的计算机程序，所述处理器执行所述计算机程序时使所述终端设备执行上述第一方面的任一种可能的实现方式的辅助化妆方法。第四方面，本申请提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时使得使所述终端设备执行上述第一方面的任一种可能的实现方式的辅助化妆方法。
第五方面，本申请提供了一种计算机程序产品，当所述计算机程序产品在终端设备上运行时，使得所述终端设备执行上述第一方面的任一种可能的实现方式的辅助化妆方法。
可以理解的是，上述第二方面至第五方面的有益效果可以参见上述第一方面中的相关描述，在此不再赘述。
本申请实施例与现有技术相比存在的有益效果是：通过实时获取用户的人脸图像，获取目标妆容效果图对应的妆容轮廓，将目标妆容效果图对应的妆容轮廓叠加显示于用户的人脸图像中相应的化妆区域，以便用户照着妆容轮廓进行化妆。这种基于妆容轮廓的辅助化妆方式，可以在用户化妆过程中给用户提供有效的化妆参考，提高用户的化妆技术，以便用户能够画出与目标妆容效果图接近或相同的妆容。
附图说明
图1是本申请一实施例提供的一种辅助化妆系统的示意图；
图2是本申请一实施例提供的一种辅助化妆方法的交互图；
图3A-图3D是本申请一实施例提供的一种用户界面图；
图3E是本申请一实施例提供的用户的脸部特征点的示意图；
图3F是本申请一实施例提供的脸型的示意图；
图3G是本申请一实施例提供的眼型的示意图；
图3H是本申请一实施例提供的一种叠加显示眉毛轮廓的图像；
图3I是针对图3H中叠加显示眉毛轮廓的区域进行放大后的图像；
图4是本申请一实施例提供的一种辅助用户化妆的示例图；
图5A是本申请一实施例提供的叠加显示妆容轮廓的图像的示意图；
图5B是本申请一实施例提供的叠加显示眼影轮廓的图像的示意图；
图6是本申请另一实施例提供的叠加显示妆容轮廓的图像的示意图；
图7是本申请实施例提供的辅助化妆装置的结构示意图。
具体实施方式
以下描述中，为了说明而不是为了限定，提出了诸如特定系统结构、技术之类的具体细节，以便透彻理解本申请实施例。然而，本领域的技术人员应当清楚，在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中，省略对众所周知的系统、装置、电路以及方法的详细说明，以免不必要的细节妨碍本申请的描述。
应当理解，当在本申请说明书和所附权利要求书中使用时，术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在，但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。
还应当理解，在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合，并且包括这些组合。
如在本申请说明书和所附权利要求书中所使用的那样，术语“如果”可以依据上下文被解释为“当...时”或“一旦”或“响应于确定”或“响应于检测到”。类似地，短语“如果确定”或“如果检测到[所描述条件或事件]”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦检测到[所描述条件或事件]”或“响应于检测到[所描述条件或事件]”。
另外，在本申请说明书和所附权利要求书的描述中，术语“第一”、“第二”、“第三”等仅用于区分描述，而不能理解为指示或暗示相对重要性。
在本申请说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
在日常生活中，用户可以通过终端设备，比如手机，内安装的美妆类的应用程序(Application，App)辅助化妆，主要包括以下方式：
1、描述式辅助化妆：用户通过点击手机App中的预设链接或选项调出一个页面，并在该页面中使用文字或图文结合的方式描述化妆步骤和技巧，用户参照页面显示的化妆步骤和技巧进行化妆。由于手机需要一个单独的页面显示化妆步骤和技巧，手机在显示屏上无法同时显示由摄像头采集的用户的图像以及该页面中的内容，因此，在化妆过程中，用户在查看自己的图像时，无法参考该页面显示的化妆步骤和技巧。
2、对照式辅助化妆：用户在需要化妆时，通过手机App选择需要的妆后图像，用户对照着显示的妆后图像进行化妆。例如，在该手机App的用户界面(User Interface，UI)中显示由摄像头采集到的用户的脸部图像，手机如果检测到用户选中眉妆图像(比如，一字眉)，那么将眉妆图像显示于用户的脸部图像中的眉毛附近，以便用户对照着显示的眉妆图像画眉毛。上述辅助化妆的方法主要存在以下问题：
1、对于描述式辅助化妆，是将现有的化妆步骤和技巧集成在手机App中，以方便用户查阅。这种方式在用户化妆过程中指导性不强，用户只能依据感觉来确定应该从什么位置开始化妆，以及具体化到什么位置等，无法有效提升用户的化妆技术，对用户的化妆结果也没有任何提升，对于画不好的妆容依旧画不好。另外，由于手机无法同时显示用户的图像以及该页面中的化妆步骤和技巧，因此，用户在化妆过程中，在查看自己的图像时，需要退出该页面，来回切换页面不方便。
2、对于对照式辅助化妆，用户对照妆后图像进行化妆，这属于静态模仿化妆，用户只能依据感觉来确定应该从什么位置开始化妆，以及具体化到什么位置等，无法对化妆过程进行详细的指导，用户很难画出妆后图像中的妆容，对于画不好的妆容依旧画不好。
综上所述，上述辅助化妆的方法无法给用户提供化妆参考，用户在采用上述方法 进行化妆时，只能依据感觉来确定应该从什么位置开始化妆，以及具体化到什么位置等，对于画不好的妆容依旧画不好，用户还是无法画出较满意的妆容。
为了解决上述问题，本申请实施例提供了一种辅助化妆方法，通过妆容效果图对应的妆容轮廓叠加显示于用户的人脸图像中相应的化妆区域，以便用户照着妆容轮廓进行化妆，这种基于妆容轮廓式的辅助化妆方式，可以在用户化妆过程中给用户提供有效的化妆参考，提高用户的化妆技术，以便用户能够画出与用户选择的妆容效果图接近或相同的妆容。为了使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请的辅助化妆方法的具体实现方式作进一步地详细描述。
参见图1，图1是本申请一实施例提供的一种辅助化妆系统的示意图。在图1所示的系统示意图中，包括终端设备100以及服务器200，终端设备100与服务器200之间可以相互通信。终端设备100包括但不限于手机。终端设备100内安装了可以实现辅助化妆的App，例如镜子App。服务器200中保存有妆容模板信息，用于为可以实现辅助化妆的App提供下载妆容模板信息等相关的服务。例如，提供下载妆容模板信息中的妆容效果图的服务。
如图1所示，终端设备100可以包括处理器110，存储器120，天线1，天线2，移动通信模块130，无线通信模块140，音频模块150，扬声器150A，受话器150B，麦克风150C，触摸显示屏160，摄像头170等。
可以理解的是，本申请实施例示意的结构并不构成对终端设备100的具体限定。在本申请另一些实施例中，终端设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。例如，控制器可以获取用户操控终端设备100中安装的用于辅助化妆的App所触发的指令，并执行该指令，从而为用户提供辅助化妆的服务。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。例如，存储器110中可以存储终端设备100从服务器200中下载的妆容模板信息。
终端设备100的无线通信功能可以通过天线1，天线2，移动通信模块130，无线通信模块140，调制解调处理器以及基带处理器等实现。其中，终端设备100可以通过无线通信技术接入互联网，与服务器200进行通信，从服务器200中下载化妆模板信息。
天线1和天线2用于发射和接收电磁波信号。终端设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块130可以提供应用在终端设备100上的包括2G/3G/4G/5G等无线通信的解决方案。
无线通信模块140可以提供应用在终端设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，等无线通信的解决方案。终端设备100可以通过无线通信模块140接入互联网，与服务器200进行通信。
在一些实施例中，终端设备100的天线1和移动通信模块130耦合，天线2和无线通信模块140耦合，使得终端设备100可以通过无线通信技术与网络以及其他设备通信。例如，终端设备100可以通过无线通信技术与网络以及服务器200进行通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，WLAN等。终端设备100通过GPU，触摸显示屏160，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接触摸显示屏160和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
触摸显示屏160用于显示图像，视频等。触摸显示屏160包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，终端设备100可以包括1个或N个触摸显示屏160，N为大于1的正整数。例如，触摸显示屏160可以用于显示通过摄像头170采集到的用户的脸部图像，用于显示从服务器200中下载的妆容模板信息中所包括的妆容效果图、妆容轮廓，以及用于显示将妆容轮廓叠加至用户的脸部图像之后得到的图像等。
终端设备100可以通过ISP，摄像头170，视频编解码器，GPU，触摸显示屏160以及应用处理器等实现拍摄功能。其中，用户开启终端设备100内的用于辅助化妆的App时，终端设备100可以通过170采集用户的脸部图像。
ISP用于处理摄像头170反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头170中。
摄像头170用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，终端设备100可以包括1个或N个摄像头170，N为大于1的正整数。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当终端设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。终端设备100可以支持一种或多种视频编解码器。这样，终端设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现终端设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
存储器120可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。存储器120可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储终端设备100使用过程中所创建的数据(比如音频数据，电话本，化妆模板信息等)等。此外，存储器120可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。处理器110通过运行存储在存储器120的指令，和/或存储在设置于处理器中的存储器的指令，执行终端设备100的各种功能应用以及数据处理。例如，执行与辅助化妆相关的功能和数据处理。
终端设备100可以通过音频模块150，扬声器150A，受话器150B，麦克风150C，以及应用处理器等实现音频功能。例如音乐播放，录音等。再例如，在用户通过具有辅助化妆功能的App进行化妆时，终端设备100还可以通过音频模块150播报化妆指导信息、修正提示信息等。
音频模块150用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块150还可以用于对音频信号编码和解码。在一些实施例中，音频模块150可以设置于处理器110中，或将音频模块150的部分功能模块设置于处理器110中。
扬声器150A，也称“喇叭”，用于将音频电信号转换为声音信号。终端设备100可以通过扬声器150A收听音乐、语音提示信息，或收听免提通话。
受话器150B，也称“听筒”，用于将音频电信号转换成声音信号。当终端设备100接听电话或语音信息时，可以通过将受话器150B靠近人耳接听语音。
麦克风150C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。当拨 打电话或发送语音信息时，用户可以通过人嘴靠近麦克风150C发声，将声音信号输入到麦克风150C。终端设备100可以设置至少一个麦克风150C。在另一些实施例中，终端设备100可以设置两个麦克风150C，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，终端设备100还可以设置三个，四个或更多麦克风150C，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。
如图1所示，服务器200可以是物理服务器或者云服务器，也可以是一个集群，在此不做限定。服务器200可以包括处理器210，存储器220，通信模块230以及数据库240。存储器220可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令，处理器210通过运行存储在存储器220的指令，执行与辅助化妆相关的功能和数据处理。服务器200可以通过通信模块230与终端设备100进行通信，为可实现辅助化妆的App提供相关的服务。数据库240可以用于存储数据，例如，可以用于存储妆容模板库，妆容模板库中可以包括多个妆容模板信息。需要说明的是，在本实施例中，数据库240存在于服务器200中；在一些实施例中，数据库240也可以存在于其他设备中，服务器200可以从其他设备的数据库中获取妆容模板库，从而获取妆容模板库中的妆容模板信息；或者，服务器200也可以从其他设备的数据库中获取妆容模板库中的妆容模板信息。
在介绍了辅助化妆系统之后，下面将结合图2详细介绍辅助用户化妆的具体实现过程。请一并参见图2，图2是本申请一实施例提供的一种辅助化妆方法的交互图。本实施例中，辅助化妆方法可以应用于如图1所示的终端设备，终端设备包括但不限于手机。本实施例中的辅助化妆方法可以辅助用户画眉毛、眼影、腮红、口红等，下面以终端设备为手机、辅助用户画眉毛为例进行详细说明。该辅助化妆方法包括以下步骤：
S101、服务器保存妆容模板信息，妆容模板信息至少包括妆容效果图以及妆容轮廓。
服务器可以将妆容模板信息存储至数据库的妆容模板库。妆容模板信息可以由管理员设置，也可以由服务器基于终端设备上传的妆容效果图生成，此处不做限制。终端设备上传的妆容效果图可以来自美妆杂志、也可以由用户拍摄得到，例如，用户在观看视频、电视剧时所拍摄的妆容效果图，用户街拍的妆容效果图等。妆容模板信息至少包括妆容效果图以及妆容轮廓。
基于终端设备上传的妆容效果图生成妆容模板信息的方法可以为：服务器获取终端设备上传的妆容效果图，基于人脸识别技术识别出妆容效果图中的眼睛、眉毛、嘴巴等部位，并提取眼睛、眉毛、嘴巴等部位的妆容效果图各自对应的妆容轮廓，将妆容效果图及其对应的妆容轮廓关联保存，得到妆容模板信息。
妆容效果图是化妆后的人脸图像。妆容效果图是对样本人脸整体化妆后的图像，或者是对样本人脸的部分区域化妆后的图像。当妆容效果图是对样本人脸整体化妆后的图像时，妆容效果图可以按风格分类，例如日常妆、节日妆(比如，圣诞妆、万圣节妆)、宴会妆等。妆容效果图还可以是管理员还可以针对不同的五官特点设置的不同风格所对应的妆容效果图。
当妆容效果图可以是对样本人像的部分区域化妆后的图像时，按妆容类型进行分 类。例如唇妆、眉妆、眼影妆、腮红妆等。妆容效果图可以按妆容类型分为眉妆效果图、眼影妆效果图、唇妆效果图或腮红效果图。每种妆容类型的妆容效果图可以按妆容样式分为多种，也就是说，对于不同的妆容类型还可以包括不同的妆容样式，例如，眉妆样式可以包括“一字眉”、“平眉”、“柳叶眉”等。相应的，眉妆效果图可以包括“一字眉”效果图、“平眉”效果图、“柳叶眉”效果图。
妆容轮廓是指针对不同的妆容类型设置的参考线或参考区域。例如，眉妆轮廓可以为：以眉妆样式对应的眉毛弧度绘制得到的眉毛轮廓，眉毛轮廓包括眉毛的眉头、眉峰、眉尾，眉妆轮廓用于方便用户对着眉妆轮廓描绘眉毛。眼影轮廓可以为：在样本人脸图像中的眼部，通过参考线绘制的需要画眼影的区域。腮红轮廓可以为：在样本人脸图像中的脸部通过参考线绘制的需要打腮红的区域。唇妆轮廓可以为：以样本人脸图像中的嘴唇的形状，通过参考线绘制的需要涂口红的区域。需要说明的是，眼影轮廓、腮红轮廓，可以包括多个区域。
可以理解的是，当妆容效果图是针对脸部的某个部位时，一个妆容效果图对应一个妆容轮廓；当妆容效果图是针对用户的多个部位或整个脸部时，一个妆容效果图对应多个不同的妆容轮廓，例如，一个妆容效果图可以对应眉妆轮廓、眼影轮廓、唇妆轮廓以及腮红轮廓等。眉妆轮廓包括左眉妆轮廓以及右眉妆轮廓，眼影轮廓可以包括左眼影轮廓以及右眼影轮廓。
可选的，妆容模板信息还可以包括化妆指导信息。妆容轮廓以及化妆指导信息均与妆容效果图像关联。
妆容效果图对应的化妆指导信息用于指导用户画出妆容效果图对应的妆容，妆容效果图的化妆指导信息可以包括妆容轮廓对应的颜色信息，还可以包括化妆工具和化妆品的信息等。例如，妆容效果图为眉妆效果图时，眉妆效果图对应的化妆指导信息可以包括用于描述眉妆效果图中眉妆的颜色信息(例如，深黑、棕色)，还可以包括画眉妆需要的化妆工具信息和化妆品信息。妆容效果图对应的化妆指导信息可以以文字形式进行显示，也可以以图文结合的形式进行显示，还可以通过语音播报，此处不做限制。
可以理解的是，当眼影轮廓以及腮红轮廓，包括多个区域时，眼影轮廓以及腮红轮廓各自对应的化妆指导信息还包括每个区域对应的颜色信息。
S102、终端设备显示摄像头采集的用户的人脸图像。
用户点击终端设备内具有辅助化妆功能的App的图标，终端设备启动该App，启动摄像头采集用户的人脸图像，并在相应的用户界面上显示采集到的人脸图像。该App可以是用于辅助化妆的App，也可以是增加了辅助化妆功能的已有的App，例如，拍照App、图像处理类App。该App可以是用户下载并安装的，也可以是终端设备内预置的App。
在本实施例中，用户是指需要化妆的用户。人脸图像可以是化妆前的素颜图像，也可以是在化妆过程中采集的图像。通常情况下，化完底妆彩之后，还需要化眼妆(画眉毛、画眼影等)、上腮红、涂口红等，因此，在化妆过程中采集的图像也可以是用户化完底妆之后的图像，用户化完底妆之后的图像是指用户在基础护肤之后，涂完隔离、粉底液、定妆粉之后的图像。
终端设备内置有摄像头时，用户的人脸图像由内置的摄像头采集。当用户自己化妆时，该人脸图像可通过内置的前置摄像头采集。当为别人化妆时，可以通过后置摄像头采集需要化妆的用户的人脸图像。
当与终端设备连接有外置的摄像头时，用户的人脸图像可以由该外置的摄像头采集。S103、终端设备获取目标妆容效果图对应的妆容轮廓。
目标妆容效果图可以是用户选择的妆容效果图，也可以是终端设备基于用户的人脸图像，利用人工智能技术向用户智能推荐的妆容效果图。需要说明的是，手机可以获取用户从用户界面中手动选择的妆容效果图所对应的妆容轮廓，也可以基于用户输入的语音消息获取目标妆容效果图对应的妆容轮廓。
其中，妆容效果图为妆后图像，妆容效果图可以是从终端设备的本地数据库中获取的，当终端设备的本地数据库不存在妆容效果图时，可以从服务器下载妆容模板信息，并获取下载的妆容模板信息中所包括的妆容效果图。需要说明的是，妆容效果图对应的妆容轮廓可以从服务器中下载。终端设备也可以采用图像识别技术或相关的图像处理算法从妆容效果图中提取出妆容轮廓。当用户首次选用某个妆容效果图时，终端设备可以从服务器的妆容模板库中下载该妆容效果图对应的妆容轮廓，并将其保存，以便下次选用。
具体的，终端设备可以在显示用户的人脸图像的用户界面中，显示相应的选项，例如，“智能推荐妆容效果图”和“用户选择妆容效果图”，以便用户从中选择“智能推荐妆容效果图”或“用户选择妆容效果图”。之后，终端设备可以根据用户选中的选项获取目标妆容效果图，并获取目标妆容效果图对应的妆容轮廓。
其中，当用户选中“智能推荐妆容效果图”时，终端可以利用人工智能技术向用户推荐目标妆容效果图，并获取目标妆容效果图对应的妆容轮廓。其中，终端设备向用户智能推荐妆容效果图的数量可以为一个，也可以为至少两个，此处不做限制。
当用户选中“用户选择妆容效果图”时，终端设备可以根据用户选中的选项获取并显示妆容效果图，以便用户从中自行选择需要的目标妆容效果图，终端设备可以在检测到用户选中的目标妆容效果图时，获取目标妆容效果图对应的妆容轮廓。
下面结合附图详细说明终端设备获取目标妆容效果图的具体实现方式。
示例性的，请一并参见图3A～图3D，当用户需要化妆时，用户可以点击如图3A中具有辅助化妆功能的App，例如，镜子App。手机启动镜子App，获取通过手机内置的摄像头采集的用户的人脸图像，并显示如图3B所示的用户界面(User Interface，UI)，以便用户从中选择“智能推荐妆容效果图”或“用户选择妆容效果图”。
如果手机检测到用户选中“用户选择妆容效果图”这一选项，那么，手机可以显示如图3C的UI界面，以显示可供用户选择的妆容类型。其中，可选择的妆容类型可以包括眉妆、眼影妆、脸妆、针对整个脸部的整体妆等。手机在检测到用户选中“眉妆”时，可以从用于保存妆容模板信息的本地数据库，获取“眉妆”对应的目标妆容模板信息。手机在本地数据库没有查找到目标妆容模板信息时，可以向服务器发送包含目标妆容类型的请求信息，以从服务器下载目标妆容模板信息，从而获取目标妆容模板信息包含的目标妆容效果图。手机在本地数据库查找到目标妆容模板信息时，不需要再从服务器中下载目标妆容模板信息。
手机在获取到“眉妆”对应的目标妆容模板信息时，可以显示如图3D所示的UI界面，以显示“眉妆”对应的目标妆容模板信息中所包含的眉妆效果图，以便用户从中选中需要的目标眉妆效果图。手机在检测到用户选中如图3D中的“一字眉”时，获取“一字眉”对应的妆容轮廓。
如果手机检测到用户选中“智能推荐妆容效果图”，那么，手机可以显示如图3C的UI界面，以显示可供用户选择的妆容类型。手机在检测到用户选中“眉妆”时，手机可以利用人脸识别技术，从人脸数据库中查找与获取到的用户的人脸图像相似度最高的目标人脸图像，并根据人脸图像与眉妆模板信息之间的预设对应关系，获取与目标人脸图像相对应的目标眉妆模板信息，显示目标眉妆模板信息中包含的目标眉妆效果图，从而实现向用户智能推荐眉妆效果图。当从本地数据库未获取到目标妆容模板信息时，可以发送用户的人脸图像至服务器，以使得服务器在接收到用户的人脸图像之后，可以根据人脸图像与妆容模板信息之间的预设对应关系，从数据库中，获取与S101中所显示的用户的人脸图像相对应的目标妆容模板信息。
需要说明的是，手机在检测到用户选中“智能推荐妆容效果图”时，还可以基于用户的人脸图像，利用人脸识别技术向用户推荐针对整个脸部的整体妆所对应的目标妆容效果图，并获取目标妆容效果图对应的妆容轮廓。
其中，手机向用户推荐针对整个脸部的整体妆所对应的目标妆容效果图，并获取目标妆容效果图对应的妆容轮廓的具体实现方式可以为：采用人脸识别技术对用户的人脸图像进行分析，识别用户的脸部特征点，如图3E所示，识别用户的68个脸部特征点，并根据用户的脸部特征点确定用户的脸部轮廓以及用户的眼睛、嘴巴、鼻子、眉毛等的形状，从而确定用户的五官特点，基于预设的五官特点与妆容效果图之间的预设对应关系，获取与用户的五官特点相匹配的妆容效果图。用户的五官特征包括但不限于用户的脸型、眼型、眉毛形状等。脸型基于人脸图像中的脸部轮廓确定，脸型可以包括但不限于如图3F所示的瓜子脸、圆脸、国字脸。眼型是根据眼睛形状确定，眼型包括但不限于如图3G所示的桃花眼、柳叶眼、杏眼、丹凤眼。
可选地，为了便于用户画出与妆容效果图相同或更相近的妆容，终端设备还可以从服务器下载并保存目标妆容效果图对应的化妆指导信息。化妆指导信息可以用于描述目标妆容效果图中每个妆容轮廓对应的颜色信息。例如，眉妆轮廓对应的化妆指导信息用于描述：眉尾的颜色比眉头的颜色较浅。
需要说明的是，眉妆轮廓可以划分为两个区域，眉峰可以位于两个区域的交界处，眉妆轮廓对应的化妆指导信息用于描述：包括眉毛起点的区域的颜色比包括眉毛终点的区域的颜色深。
S104、从所述人脸图像中识别所述妆容轮廓对应的化妆区域，并将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域，用于辅助所述用户化妆。
终端设备采用人脸识别技术对用户的人脸图像进行分析，识别用户的脸部特征点，例如，图3E所示的68个脸部特征点，并基于识别出的脸部特征点识别出用户的人脸图像中的脸部轮廓、眉毛、眼睛、嘴巴、鼻子、脸颊等。之后，根据妆容轮廓确定妆容轮廓对应的化妆区域，之后将妆容轮廓叠加至每个妆容轮廓对应的化妆区域，并显示叠加妆容轮廓后的人脸图像，以便用户对照着叠加妆容轮廓后的人脸图像进行化妆， 此时用户相当于对着镜子呈现的图像进行化妆。例如，采用相应的化妆品按叠加后的妆容轮廓在脸部描边或在妆容轮廓内填入不同的颜色。
可以理解的是，在叠加轮廓的过程中，终端设备可以根据实际需要放大或缩小妆容轮廓，以与用户的五官特点(例如，眉形、眼型、嘴型、脸型)相匹配。终端设备还可以提供相应的入口供用户编辑妆容轮廓或调整妆容轮廓的大小及位置。
其中，眉妆轮廓对应的化妆区域为用户的人脸图像中的眉毛区域。眼影轮廓对应的化妆区域可以为眼影区域，眼影区域可以为用户的人脸图像中眼睑所在的位置。唇妆轮廓对应的化妆区域为用户的人脸图像中嘴唇所在的区域，腮红轮廓对应的化妆区域可以为用户的人脸图像中的脸颊区域，也可以为面颊颧骨所在的区域。腮红轮廓对应的化妆区域可以以颧骨最高处(微笑时，以颧骨凸起的地方为中心)为中心的圆形或椭圆形。
示例性的，在S103中获取到的妆容轮廓为眉妆轮廓时，终端设备采用人脸识别技术先识别出用户的人脸图像中眉毛区域，并识别出眉毛区域中眉毛的眉头、眉尾，之后，基于用户的人脸图像中的眉头所在的位置、眉尾所在的位置，将“一字眉”对应的眉妆轮廓适应性叠加显示于用户的人脸图像中眉毛所在的区域，叠加眉毛轮廓至用户的人脸图像的效果图如图3H所示。终端设备在将叠加眉毛轮廓至用户的人脸图像的眉毛所在区域之后，还可以如图3I所示，放大显示叠加眉毛轮廓后的区域，以便用户对着叠加眉妆轮廓后的人脸图像画眉妆，例如，采用眉笔或眉粉按眉妆轮廓描边，以及在眉妆轮廓内上色。其中，终端设备可以将眉妆轮廓中的眉头固定于用户的人脸图像中眉头所在的位置，将眉妆轮廓中的眉尾固定于用户的人脸图像中眉尾所在的位置，或者将眉妆轮廓中的眉尾固定于用户的人脸图像中眉尾的延长线所在的位置。
识别出用户的人脸图像中的眉头、眉尾的方法具体为：终端设备可以基于眼角所在的第一位置、鼻翼所在的第二位置，确定一条直线，将该直线与眉毛的交点识别为眉头；基于眼尾所在的第三位置以及鼻翼所在的第二位置确定一条直线，并将该直线与眉毛的交点识别为眉尾。
需要说明的是，终端设备检测到用户在画眉妆时，可以语音播报眉妆轮廓对应的化妆指导信息。或者，在用户界面中显示眉妆对应的化妆指导信息。在检测到用户画完眉妆时，隐藏眉妆对应的化妆指导信息。
上述方案，终端设备可以获取用户的人脸图像，获取用户选中的目标妆容效果图对应的妆容轮廓，或基于用户的人脸图像，采用人工智能技术以及人脸识别技术向用户推荐目标妆容效果图，并获取目标妆容效果图对应的妆容轮廓；将目标妆容效果图对应的妆容轮廓叠加显示于用户的人脸图像中相应的化妆区域，以便用户照着妆容轮廓进行化妆，这种基于妆容轮廓式的辅助化妆方式，可以在用户化妆过程中给用户提供有效的化妆参考，提高用户的化妆技术，以便用户能够画出与用户选择的妆容效果图接近或相同的妆容。
可选的，由于用户在化妆过程中，脸部位置可能会发生变化，当用户的脸部移动时，终端显示的人脸图像会随着用户的脸部的移动而移动。为了避免用户因转动头部而导致妆容轮廓与相应的化妆区域处于不同位置，从而导致用户无法准确地在相应的化妆区域按妆容轮廓进行化妆的问题。在S104之后，还可以包括S105：检测到用户 的人脸图像移动，控制所述妆容轮廓跟随所述人脸图像适应性移动。
当检测到用户的人脸图像移动时，手机可以控制叠加显示于人脸图像的妆容轮廓跟随着用户的人脸图像适应性移动，以保证妆容轮廓始终叠加显示于相应的化妆区域。
具体的，移动终端在将妆容轮廓叠加显示于用户的人脸图像中相应的化妆区域之后，采用人脸识别技术以及人脸跟踪技术检测人脸图像是否发生变化。具体的，可以对比相邻两个时刻获取到的人脸图像中，同一个脸部特征点的位置是否发生改变，来判断用户的人脸图像是否发生变化。其中，当相邻两个时刻获取到的人脸图像中，同一个脸部特征点的位置不同时，用户的人脸图像发生变化，人脸图像已移动；当同一个脸部特征点的位置相同时，用户的人脸图像没有发生变化，人脸图像未移动。终端设备在确认用户的人脸图像移动时，按照S104中的方法重新确定妆容轮廓对应的化妆区域，并将每个妆容轮廓叠加至每个妆容轮廓对应的化妆区域，具体请参阅S104中的相关描述，此处不赘述。例如，手机通过人脸识别技术检测到用户的人脸图像中如图3E中脸部特征点37～46中的某个特征点在第一时刻所处的位置与第二时刻所处的位置不同时，判定用户的人脸图像的位置发生变更，此时，重新识别眉毛区域，并将“一字眉”对应的眉妆轮廓叠加显示于重识别的眉毛区域。
可选的，为了使用户更准确地画出与妆容效果图相同的妆容，用户对照着任意妆容轮廓进行化妆的过程中，或者在化妆完毕时，终端设备可以对用户的人脸图像中的妆容效果进行评估，以判断当前的妆容是否与S103中确定的目标妆容效果图中的妆容相符，以解决当前的美妆应用对用户的人脸图像的化妆效果没有评估，无法提供修正提示的问题。具体的，在S104或S105之后，还可以包括S106～S107。
S106、基于用户的人脸图像，对每个妆容轮廓对应的妆容进行评估，得到妆容评估结果。
S107、当人脸图像中任意化妆区域对应的妆容与目标妆容效果图中的妆容不符时，还可以基于妆容评估结果输出修正提醒信息。
终端设备可以在用户化妆的过程中自动启动妆容评估，也可以在检测到用户通过该App的用户界面触发妆容评估请求时启动妆容评估。例如，终端设备在检测到用户点击显示于该App的用户界面的“评估修正按钮”时启动妆容评估。
终端设备获取用户在化妆过程中的人脸图像，并检测人脸图像中每个化妆区域的妆容是否超出妆容轮廓，还可以检测每个妆容轮廓内的实际颜色是否与目标妆容效果图的每个妆容轮廓内对应的预设颜色相符。当检测到用户画的妆容均未超过妆容轮廓，且妆容轮廓内的实际颜色与预设颜色相符时，认为当前的妆容与目标妆容效果图中的妆容相符。当检测到用户画的妆容超出任一妆容轮廓，或任一妆容轮廓内的实际颜色与预设颜色不相符时，认为当前的妆容与目标妆容效果图中的妆容不符，终端设备可以基于妆容评估结果输出相应的提示信息，和/或，修改方案，以便用户修改。通过不断地修正妆容可逐步逼近目标妆容效果图中的妆容。
检测人脸图像中每个化妆区域的妆容是否超出妆容轮廓的方法可以为：获取用户的人脸图像中各个化妆区域的妆容轮廓外的实际颜色信息，以及获取目标妆容效果图中妆容轮廓外的预设颜色信息，分别比较同一个妆容轮廓外的实际颜色信息以及预设颜色信息。当同一个妆容轮廓外的实际颜色信息以及预设颜色信息相符时，人脸图像 中该化妆区域的妆容未超出妆容轮廓；当同一个妆容轮廓外的实际颜色信息以及预设颜色信息不符时，人脸图像中该化妆区域的妆容超出妆容轮廓。
实际颜色信息以及预设颜色信息可以是具体的颜色值，也可以是颜色值范围，颜色值通常用三基色(RGB)值表示。当同一个妆容轮廓外的预设颜色信息是具体的颜色值时，如果实际颜色值以及预设颜色值相同，那么该妆容轮廓外的实际颜色信息以及预设颜色信息相符；如果实际颜色值以及预设颜色值不同，那么该妆容轮廓外的实际颜色信息以及预设颜色信息不符。
当同一个妆容轮廓外的预设颜色信息是具体的颜色值范围时，如果同一个妆容轮廓外的实际颜色值或实际颜色值范围属于预设颜色值范围，认为该妆容轮廓外的实际颜色信息以及预设颜色信息相符；否则，认为该妆容轮廓外的实际颜色信息以及预设颜色信息不符。同一个妆容轮廓外的实际颜色值或实际颜色值范围由妆容轮廓外的各像素点的实际颜色值确定。
在一种可能的实现方式中，获取人脸图像中各个化妆区域的妆容轮廓外的实际颜色信息可以具体为：确定每个妆容轮廓对应的轮廓实际区域和轮廓判定区域，轮廓实际区域包括妆容轮廓，轮廓判定区域是轮廓实际区域按预设比例放大之后得到。将每个妆容轮廓对应的轮廓判定区域中除轮廓实际区域之外的区域的颜色作为该妆容轮廓外的实际颜色。
例如，请一并参见图4，图4是本申请一实施例中提供的一种辅助用户化妆的示例图。图4示出了眉妆轮廓对应的轮廓实际区域和轮廓判定区域，轮廓判定区域中除轮廓实际区域之外的区域为当前获取到的人脸图像的实际肤色区域，实际肤色区域对应的颜色即为眉妆轮廓外的实际颜色。
检测每个妆容轮廓内的颜色是否与目标妆容效果图的每个妆容轮廓对应的颜色相符的方法可以具体为：获取人脸图像中各个化妆区域的妆容轮廓内的实际颜色信息，以及获取目标妆容效果图中妆容轮廓内的预设颜色信息，分别比较同一个妆容轮廓内的实际颜色信息以及预设颜色信息，以判断同一个妆容轮廓内的实际颜色信息以及预设颜色信息是否相符。判断妆容轮廓内的实际颜色信息以及预设颜色信息是否相符的方法，与前文中判断妆容轮廓外的实际颜色信息以及预设颜色信息是否相符的方法相同，此处不赘述。
下面结合具体的应用场景说明终端设备如何进行妆容评估以及如何基于妆容评估结果给出修正提醒：
示例性的，用户在画眉妆的过程中，手机通过“一字眉”对应的眉妆轮廓内的RGB预设值以及眉毛区域的RGB实际值，检测用户画的眉毛是否超出叠加显示的眉妆轮廓，还可以检测眉妆轮廓内的颜色是否为用户选择的“一字眉”对应的眉毛颜色相符。手机在检测到用户画的眉毛超出眉妆轮廓，或者用户画的眉妆的实际颜色与“一字眉”对应的预设颜色不同时，输出相应提示信息以及修改方案，以提示用户修改眉妆，保证用户画出的眉型为“一字眉”，并且画的眉妆的颜色与预设颜色相同，避免用户画的眉妆过浓、过长或眉型不符的情况发生。
其中，当用户画的眉毛超出眉妆轮廓时，还可以进一步确定超出眉妆轮廓的像素点的位置信息(该位置信息可以为像素坐标)，从而进一步根据超出眉妆轮廓的像素 点的位置信息判断用户绘制的眉毛是否存在过长、过粗、绘制的眉峰过高或过低等问题，以根据具体情况输出相应的提醒信息。比如，当用户画的眉毛超过眉妆轮廓的终点时，判定用户画的眉毛超出眉毛过长，此时可以用显目颜色标记眉妆轮廓的终点，以提醒用户绘制的眉毛过长，还可以语音提醒用户画的眉毛过长。当检测到叠加显示于人脸图像中的眉妆轮廓周围的像素点的颜色比眉毛外围(例如额头)的像素点的颜色深时，判定用户绘制的眉毛过粗，可以用显目颜色标记整个眉妆轮廓，语音提醒用户画的眉毛过粗。当检测到用户画的眉毛的最高点超出眉妆轮廓时，判定用户画的眉峰过高，可以用醒目颜色标记眉妆轮廓的眉峰(眉峰是指眉毛的最高点)。当检测到用户画的眉毛在眉妆轮廓内，且用户画的眉毛的最高点(即眉妆轮廓内的最高点)与眉妆轮廓的最高点之间的距离大于预设距离阈值时，判定用户画的眉峰过低，可以用醒目颜色标记用户画的眉峰。
当用户画的眉毛未超出眉妆轮廓时，终端设备还可以比较眉妆轮廓对应的第一弧度与用户画的眉毛对应的第二弧度是否相同或近似相同，当第一弧度和第二弧度相同或近似相同时，判定用户画的眉毛的形状与眉妆效果图中的眉毛的形状相符。当用户画的眉毛未超出眉妆轮廓，且眉妆轮廓内的实际颜色与眉妆轮廓对应的预设颜色相符时，判定用户画的眉妆与眉妆效果图中的眉妆相符。第一弧度和第二弧度近似相同是指两者之间的弧度差值在预设的误差范围内。
上述方案，终端设备获取用户在化妆过程中的人脸图像，并对该人脸图像中叠加的妆容轮廓内外的颜色进行识别，从而检测用户画的妆容是否超出妆容轮廓，以及检测妆容轮廓内的实际颜色与妆容效果图中各妆容轮廓对应的预设颜色是否相符，从而确定用户画的妆容是否与目标妆容效果图中的妆容相符，以实现对用户化妆准确性的评估。
终端设备还可以在检测到用户画的妆容超出妆容轮廓时标记该妆容轮廓，在检测到妆容轮廓内的任一区域的实际颜色与相应的预设颜色不符时，标记该区域的妆容颜色，以提醒用户修正，实现了在化妆过程中进行实时指导、实时评估和提醒，以便用户及时修正，使用户尽可能画出与妆容效果图相同的妆容。
上文以辅助用户画眉妆为例详细介绍了辅助用户化妆的具体实现过程，下面介绍辅助用户画唇妆、画腮红妆以及眼影妆的方法。
需要说明的是，本申请实施例中，辅助用户画唇妆、腮红妆以及眼影妆的方法，与辅助用户画眉毛的方法，除了在用户的人脸图像上叠加显示目标妆容效果图对应的妆容轮廓的方法稍有差异之外，其他实现过程均类似，类似地方请具体请参见辅助用户画眉毛的相关描述，此处不赘述。
在辅助用户画唇妆、腮红妆以及眼影妆时，在用户的人脸图像上叠加显示目标妆容效果图对应的妆容轮廓的方法如下：
终端设备在获取到目标唇妆效果图对应的妆容轮廓为唇妆轮廓时，可以将用户的人脸图像中左嘴角对应的特征点、以及将人脸图像中右嘴角对应的特征点作为基准点，将唇妆轮廓叠加至人脸图像中嘴巴所在的位置，以便用户对着叠加唇妆轮廓后的人脸图像，采用口红或唇彩按唇妆轮廓描边，以及在唇妆轮廓内上色。
终端设备在获取到目标眼影效果图对应的妆容轮廓为眼影轮廓时，由于在画眼影 时需要在上眼睑从睫毛根部开始向上晕染至超出双眼皮褶皱1～2毫米的位置，以及需要在下眼睑从睫毛根部开始向下晕染，因此，终端设备可以根据睫毛所在位置以及双眼皮褶皱出的位置确定眼影轮廓对应的化妆区域(即眼影区域)，并将眼影轮廓叠加至眼影轮廓对应的化妆区域，以便用户对着叠加眼影轮廓后的人脸图像，在眼影轮廓内涂眼影。
终端设备在获取到目标腮红效果图对应的妆容轮廓为腮红轮廓时，终端设备可以将人脸图像中面颊颧骨的最高处作为中心点，以该中心点为基准将腮红轮廓叠加至人脸图像中，使得腮红轮廓的中心点位于人脸图像面颊颧骨的最高处，以便用户对着叠加腮红轮廓后的人脸图像，用刷子在腮红轮廓内画腮红。
需要说明的是，目标腮红效果图对应的腮红轮廓可以包括一个腮红区域，也可以包括至少两个腮红区域。例如，如图5A所示，叠加至用户的人脸图像上的腮红轮廓包括5个腮红区域。腮红轮廓对应的化妆指导信息可以用于描述：腮红轮廓包括的各个腮红区域对应的腮红颜色。腮红轮廓也可以包括一个中间区域和至少一个外围区域，腮红轮廓对应的化妆指导信息可以用于描述：中间区域的腮红颜色比外围区域的腮红颜色深；腮红轮廓对应的化妆指导信息还可以用于描述：中间区域对应的腮红颜色以及外围区域对应的腮红颜色。
需要说明的是，目标眼影效果图对应的眼影轮廓可以包括多个眼影区域。终端设备在获取到眼影效果图对应的化妆指导信息后，终端设备在显示获取到的眼影轮廓时，还可以在眼影轮廓附近显示目标眼影效果图对应的化妆指导信息。
例如，在一种可能的实现方式中，如图5B所示，终端设备可以将获取到的眼影轮廓叠加显示于用户的眼部区域，眼影轮廓包括4个区域，显示的化妆指导信息为眼影盘示意图，眼影盘示意图中标记了每个眼影轮廓中每个区域对应的眼影颜色。
在另一种可能的实现方式中，眼影轮廓也可以包括3个区域，眼影轮廓对应的化妆指导信息用于描述：从眼角到眼尾，眼影颜色逐渐加深，眼角所在区域的眼影颜色最浅，眼尾所在区域的眼影颜色最深。当这3个区域由2条水平线段划分得到时，眼影轮廓对应的化妆指导信息用于描述：从下到上眼影颜色逐渐变浅，即距离睫毛最近的区域眼影颜色最深，距离睫毛最远的区域眼影颜色最浅。眼影轮廓对应的化妆指导信息用于描述：每个眼影区域对应的色号。眼影轮廓对应的化妆指导信息可以以图文结合的方式描述眼影颜色所属的色系，以及每个区域对应的色号。例如，当眼影颜色所属的色系为大地色系时，眼影轮廓包括的3个区域对应的色号可以分别为浅棕色、棕色以及褐色。例如，如图3所示的右眼影轮廓对应的化妆指导信息可以是，眼影区域的颜色从左到右依次为浅棕色、棕色以及褐色。
可以理解的是，在本实施例中眼影轮廓划分为3个区域或4个区域，在其他实施例中可以划分为2个区域或更多区域，具体可根据实际情况设置，此处不做限制。
需要说明的是，当目标妆容效果图对应的妆容轮廓包括多个区域时，本申请中辅助用户画眼影妆和画腮红妆的方法与辅助用户画眉妆，在S106中对妆容轮廓对应的妆容进行评估时，终端设备需要检测每个妆容轮廓的各个区域内的颜色信息是否分别与妆容效果图的每个妆容轮廓的各个区域对应的颜色相符。当某个妆容轮廓的所有区域的实际颜色与预设颜色均相符时，该妆容轮廓内的颜色与妆容效果图中的该妆容轮廓 对应的颜色相符。当某个妆容轮廓的任意区域的实际颜色与预设颜色不符时，该妆容轮廓的实际颜色与妆容效果图中的该妆容轮廓对应的颜色不符。
在S107中，基于妆容评估结果输出修正提醒信息的方法可以具体为：当任意化妆区域的妆容超出相对应的妆容轮廓时，可以用颜色标记该妆容轮廓或该化妆轮廓的某个部分，以提示用户修正该妆容轮廓对应的妆容。当任意妆容轮廓内的任意区域的实际颜色与妆容效果图的妆容轮廓对应的预设颜色不符时，可以用显目颜色标记该区域。终端设备还可以通过语音提醒用户哪个位置超出妆容轮廓，以及提醒用户哪个区域的实际颜色与预设颜色不符。终端设备输出修正提醒信息之后，用户基于该修正提醒信息不断修正，以使修正后的妆容逐步逼近妆容效果图中的妆容，最终画出与妆容效果图中的妆容相同的妆容。
下面详细说明终端设备在辅助用户画眼影妆和画腮红妆时，如何进行妆容评估以及如何基于妆容评估结果给出修正提醒：当化妆区域为眼影区域时，终端设备基于用户的人脸图像，检测用户在眼影区域画的眼影是否超出叠加显示的眼影轮廓，还可以检测用户画的眼影的颜色是否与眼影轮廓对应的颜色相符。当在人脸图像中检测到用户画的眼影超出显示的眼影轮廓时，可以通过语音提醒用户，也可以用醒目颜色标记眼影轮廓，还可以确定超出眼影轮廓的像素点的位置信息，并基于该像素点的位置信息用醒目颜色标记靠近该像素点附近的眼影轮廓，方便用户修正。
其中，假设眼影轮廓包括3个区域，第一区域对应浅棕色、第二区域对应棕色、第三区域对应褐色，眼影妆容效果图中显示有每个区域的预设颜色，终端设备可以将人脸图像中叠加显示的眼影轮廓的第一区域的图像与眼影妆容效果图中第一区域的图像进行比较，从而确定人脸图像中眼影轮廓的第一区域的实际颜色与眼影妆容效果图中第一区域的预设颜色是否相同。按照同样的方法分别确定第二区域和第三区域分别对应的实际颜色和预设颜色是否相同。当眼影轮廓的第一区域中的任意像素点的实际颜色与第一区域对应的预设颜色不同时，用醒目颜色标记该像素点，以便用户修改。
终端设备还可以获取人脸图像中眼影轮廓的每个区域的RGB实际值，以及获取眼影妆容效果图中每个区域的RGB预设值或RGB预设范围，分别将每个区域对应的RGB实际值与每个区域对应的RGB预设值或RGB预设范围进行比较，从而确定每个区域对应的RGB实际值是否与其对应的RGB预设值相同，或者确定每个区域对应的RGB实际值是否属于其对应的RGB预设范围。当眼影轮廓的每个区域的RGB实际值与其对应的RGB预设值相同，或者眼影轮廓的每个区域的RGB实际值属于各自对应的RGB预设范围时，认为眼影轮廓内的实际颜色与预设颜色相符，即用户画的眼影的颜色与眼影轮廓对应的颜色相符。
当化妆区域为腮红区域时，终端设备基于用户的人脸图像，检测用户在腮红区域画的眼影是否超出叠加显示的腮红轮廓，还可以检测用户画的腮红的颜色是否与腮红轮廓对应的颜色相符。腮红区域的具体检测方法与眼影区域的检测方法类似，此处不赘述。
可以理解的是，在本实施例中各妆容轮廓的形状可根据实际情况设置，还可以根据实际需要将各妆容轮廓划分为多个区域，此处不做限制。
需要说明的是，终端设备在获取到针对用户的整个脸部的目标妆容效果图时，目 标妆容效果图对应的妆容轮廓可以包括眉妆轮廓、眼影轮廓以及腮红轮廓，将目标妆容效果图对应的妆容轮廓适应性叠加至用户的人脸图像之后的图像，可以如图6所示，以辅助用户画整体妆。辅助用户画整体妆的方法与辅助用户画眉妆、画眼影妆、画腮红妆等方法类似，具体实现过程请参阅前文相关的描述，此处不赘述。
上述方案，终端设备获取用户在化妆过程中的人脸图像，并该人脸图像中叠加的妆容轮廓内外的颜色进行识别，从而检测用户画的妆容是否超出妆容轮廓，以及检测妆容轮廓内的实际颜色与妆容效果图中各妆容轮廓对应的预设颜色是否相符，从而确定用户画的妆容是否与妆容效果图中的妆容相符，以实现对用户化妆准确性的评估。
终端设备还可以在检测到用户画的妆容超出妆容轮廓时标记该妆容轮廓，在检测到妆容轮廓内的任一区域的实际颜色与相应的预设颜色不符时，标记该区域的妆容颜色，以提醒用户修正，实现了在化妆过程中进行实时指导、实时评估和提醒，以便用户及时修正，使用户尽可能画出与妆容效果图相同的妆容。
应理解，上述实施例中各步骤的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
对应于上文实施例所述的辅助化妆方法，图7示出了本申请实施例提供的辅助化妆装置的结构框图，为了便于说明，仅示出了与本申请实施例相关的部分。
参照图7，该辅助化妆装置包括：
显示单元710，用于显示摄像头采集的用户的人脸图像；
获取单元720，用于获取目标妆容效果图对应的妆容轮廓；
辅助化妆单元730，用于从所述人脸图像中识别所述妆容轮廓对应的化妆区域，将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域，用于辅助所述用户化妆。
在一种可能的实现方式中，所述目标妆容效果图为所述用户选择的妆容效果图。
在一种可能的实现方式中，所述目标妆容效果图为辅助化妆装置基于所述人脸图像、利用人工智能技术推荐的妆容效果图。
在一种可能的实现方式中，辅助化妆装置还可以包括：
检测单元，用于在所述辅助化妆单元将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，检测到所述人脸图像移动；
妆容轮廓调整单元，用于控制所述妆容轮廓跟随所述人脸图像适应性移动。
在一种可能的实现方式中，辅助化妆装置还可以包括：
妆容评估单元，用于在所述辅助化妆单元将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，基于所述人脸图像，对每个所述妆容轮廓对应的妆容进行评估，得到妆容评估结果。
在一种可能的实现方式中，辅助化妆装置还可以包括：
提醒单元，用于当所述妆容评估结果表示所述人脸图像中任意化妆区域对应的妆容与所述目标妆容效果图中的妆容不符时，基于所述妆容评估结果输出修正提醒信息。
在一种可能的实现方式中，所述提醒单元具体用于：在所述人脸图像中用醒目颜色标记目标区域，所述目标区域为与所述目标妆容效果图中的妆容不符的化妆区域。
在一种可能的实现方式中，所述获取单元还可以用于：获取所述目标妆容效果图对应的化妆指导信息；
相应的，所述辅助化妆单元在将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还可以用于：显示或语音播报所述化妆指导信息。
在一种可能的实现方式中，所述妆容评估单元可以包括：
第一评估单元，用于检测所述人脸图像中每个化妆区域的妆容是否超出所述妆容轮廓，其中，当任一所述化妆区域的妆容超出所述妆容轮廓时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
在一种可能的实现方式中，所述妆容评估单元还可以包括：
第二评估单元，用于检测所述人脸图像中的每个所述妆容轮廓内的实际颜色是否与所述目标妆容效果图的每个妆容轮廓内的预设颜色相符，其中，当任一所述化妆区域的妆容超出所述妆容轮廓，或任一所述妆容轮廓内的实际颜色与预设颜色不符时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
在一种可能的实现方式中，所述第一评估单元具体用于：
获取所述人脸图像中的每个化妆区域的妆容轮廓外的实际颜色信息，以及获取所述目标妆容效果图中的每个妆容轮廓外的预设颜色信息；
当任一所述化妆区域的妆容轮廓外对应的实际颜色与预设颜色不同时，该化妆区域的妆容超出所述妆容轮廓。
在一种可能的实现方式中，所述第一评估单元还用于：
确定所述人脸图像中的每个所述妆容轮廓对应的轮廓实际区域和轮廓判定区域，所述轮廓实际区域包括妆容轮廓，所述轮廓判定区域是所述轮廓实际区域按预设比例放大之后得到；
获取每个所述妆容轮廓对应的轮廓判定区域中除轮廓实际区域之外的区域的颜色，得到所述妆容轮廓外的实际颜色。
在一种可能的实现方式中，所述妆容轮廓包括眉妆轮廓、眼影轮廓、腮红轮廓以及唇妆轮廓中的至少一种。
在一种可能的实现方式中，所述眼影轮廓和/或腮红轮廓包括多个区域。
在一种可能的实现方式中，所述用户界面中显示的妆容效果图是终端设备在检测到用户选中目标妆容类型之后，从服务器中获取得到。
在本实施例中，该辅助化妆装置可以是终端设备，或者是终端设备中的芯片，或者是集成在终端设备中的功能模块。其中，该芯片或者该功能模块可以位于终端设备的控制中心(例如，控制台)，控制终端设备实现本申请提供的辅助化妆方法。
需要说明的是，上述装置/单元之间的信息交互、执行过程等内容，由于与上述辅助化妆方法实施例基于同一构思，其具体功能及带来的技术效果，具体可参见辅助化妆方法实施例部分，此处不再赘述。
所属领域的技术人员可以清楚地了解到，为了描述的方便和简洁，仅以上述各功能单元、模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能单元、模块完成，即将所述装置的内部结构划分成不同的功能单元或模块，以完成以上描述的全部或者部分功能。实施例中的各功能单元、模块可以集成在一个 处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中，上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。另外，各功能单元、模块的具体名称也只是为了便于相互区分，并不用于限制本申请的保护范围。上述系统中单元、模块的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
本申请实施例还提供了一种终端设备，该终端设备包括：至少一个处理器、存储器以及存储在所述存储器中并可在所述至少一个处理器上运行的计算机程序，所述处理器执行所述计算机程序时使得使所述终端设备执行上述任意各个辅助化妆方法实施例中的步骤。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时使得使所述终端设备执行上述各个辅助化妆方法实施例中的步骤。
本申请实施例提供了一种计算机程序产品，当计算机程序产品在移动终端上运行时，使得移动终端执行时执行上述各个辅助化妆方法实施例中的步骤。
需要说明的是，本申请的各实施方式可以任意进行组合，以实现不同的技术效果。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到本申请可以用硬件实现，或固件实现，或它们的组合方式来实现。当使用软件实现时，可以将上述功能存储在计算机可读介质中或作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质，其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。计算机存储介质可以是计算机能够存取的任何可用介质。所述计算机可读介质至少可以包括：能够将计算机程序代码携带到拍照装置/终端设备的任何实体或装置、记录介质、计算机存储器、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、电载波信号、电信信号以及软件分发介质。例如U盘、移动硬盘、磁碟或者光盘等。在某些司法管辖区，根据立法和专利实践，计算机可读介质不可以是电载波信号和电信信号。
在上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述或记载的部分，可以参见其它实施例的相关描述。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
以上所述实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围，均应包含在本申请的保护范围之内。

Claims (18)

  1. 一种辅助化妆方法，其特征在于，包括：
    显示摄像头采集的用户的人脸图像；
    获取目标妆容效果图对应的妆容轮廓；
    从所述人脸图像中识别所述妆容轮廓对应的化妆区域，将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域，用于辅助所述用户化妆。
  2. 如权利要求1所述的辅助化妆方法，其特征在于，所述目标妆容效果图为所述用户选择的妆容效果图。
  3. 如权利要求1所述的辅助化妆方法，其特征在于，所述目标妆容效果图为终端设备基于所述人脸图像、利用人工智能技术推荐的妆容效果图。
  4. 如权利要求1-3任一项所述的辅助化妆方法，其特征在于，所述将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还包括：
    检测到所述人脸图像移动；
    控制所述妆容轮廓跟随所述人脸图像适应性移动。
  5. 如权利要求1-4任一项所述的辅助化妆方法，其特征在于，所述将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还包括：
    基于所述人脸图像，对每个所述妆容轮廓对应的妆容进行评估，得到妆容评估结果。
  6. 如权利要求5所述的辅助化妆方法，其特征在于，所述得到妆容评估结果之后，还包括：
    当所述人脸图像中任意化妆区域对应的妆容与所述目标妆容效果图中的妆容不符时，基于所述妆容评估结果输出修正提醒信息。
  7. 如权利要求1-6任一项所述的辅助化妆方法，其特征在于，所述显示摄像头采集的用户的人脸图像之后，还包括：
    获取所述目标妆容效果图对应的化妆指导信息；
    相应的，所述将所述妆容轮廓适应性叠加显示于所述妆容轮廓对应的化妆区域之后，还包括：
    显示或语音播报所述化妆指导信息。
  8. 如权利要求5所述的辅助化妆方法，其特征在于，所述对每个所述妆容轮廓对应的妆容进行评估，包括：
    检测所述人脸图像中每个化妆区域的妆容是否超出所述妆容轮廓，其中，当任一所述化妆区域的妆容超出所述妆容轮廓时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
  9. 如权利要求8所述的辅助化妆方法，其特征在于，所述对每个所述妆容轮廓对应的妆容进行评估，还包括：
    检测所述人脸图像中的每个所述妆容轮廓内的实际颜色是否与所述目标妆容效果图的每个妆容轮廓内的预设颜色相符，其中，当任一所述化妆区域的妆容超出所述妆容轮廓，或任一所述妆容轮廓内的实际颜色与预设颜色不符时，表示所述化妆区域对应的妆容与所述目标妆容效果图中的妆容不符。
  10. 如权利要求8所述的辅助化妆方法，其特征在于，所述检测所述人脸图像中每个化妆区域的妆容是否超出所述妆容轮廓，包括：
    获取所述人脸图像中的每个化妆区域的妆容轮廓外的实际颜色信息，以及获取所述目标妆容效果图中的每个妆容轮廓外的预设颜色信息；
    当任一所述化妆区域的妆容轮廓外对应的实际颜色与预设颜色不同时，该化妆区域的妆容超出所述妆容轮廓。
  11. 如权利要求10所述的辅助化妆方法，其特征在于，所述获取所述人脸图像中的每个化妆区域的妆容轮廓外的实际颜色信息，包括：
    确定所述人脸图像中的每个所述妆容轮廓对应的轮廓实际区域和轮廓判定区域，所述轮廓实际区域包括妆容轮廓，所述轮廓判定区域是所述轮廓实际区域按预设比例放大之后得到；
    获取每个所述妆容轮廓对应的轮廓判定区域中除轮廓实际区域之外的区域的颜色，得到所述妆容轮廓外的实际颜色。
  12. 如权利要求6所述的辅助化妆方法，其特征在于，所述基于所述妆容评估结果输出修正提醒信息，包括：
    在所述人脸图像中用醒目颜色标记目标区域，所述目标区域为与所述目标妆容效果图中的妆容不符的化妆区域。
  13. 如权利要求1所述的辅助化妆方法，其特征在于，所述妆容轮廓包括眉妆轮廓、眼影轮廓、腮红轮廓以及唇妆轮廓中的至少一种。
  14. 如权利要求13所述的辅助化妆方法，其特征在于，所述眼影轮廓和/或腮红轮廓包括多个区域。
  15. 如权利要求2所述的辅助化妆方法，其特征在于，所述用户界面中显示的妆容效果图是终端设备在检测到用户选中目标妆容类型之后，从服务器中获取得到。
  16. 一种终端设备，包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序，其特征在于，所述处理器执行所述计算机程序时使得所述终端设备执行如权利要求1至15任一项所述的辅助化妆方法。
  17. 一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，其特征在于，所述计算机程序被处理器执行时使得终端设备执行如权利要求1至15任一项所述的辅助化妆方法。
  18. 一种计算机程序产品，其特征在于，当所述计算机程序产品在终端设备上运行时，所述终端设备执行如权利要求1至15任一项所述的辅助化妆方法。
PCT/CN2021/082920 2020-04-01 2021-03-25 辅助化妆方法、终端设备、存储介质及程序产品 WO2021197186A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/916,378 US20230154083A1 (en) 2020-04-01 2021-03-25 Method for Assisting Makeup, Terminal Device, Storage Medium, and Program Product
EP21781902.8A EP4116923A4 (en) 2020-04-01 2021-03-25 AUXILIARY MAKEUP METHOD, TERMINAL DEVICE, STORAGE MEDIA AND PROGRAM PRODUCT

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010251470.0 2020-04-01
CN202010251470.0A CN113496459A (zh) 2020-04-01 2020-04-01 辅助化妆方法、终端设备、存储介质及程序产品

Publications (1)

Publication Number Publication Date
WO2021197186A1 true WO2021197186A1 (zh) 2021-10-07

Family

ID=77927712

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/082920 WO2021197186A1 (zh) 2020-04-01 2021-03-25 辅助化妆方法、终端设备、存储介质及程序产品

Country Status (4)

Country Link
US (1) US20230154083A1 (zh)
EP (1) EP4116923A4 (zh)
CN (1) CN113496459A (zh)
WO (1) WO2021197186A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20230147649A (ko) * 2021-02-23 2023-10-23 베이징 센스타임 테크놀로지 디벨롭먼트 컴퍼니 리미티드 이미지 처리 방법, 장치, 전자 기기 및 기억 매체
CN116486054B (zh) * 2023-06-25 2023-09-12 四川易景智能终端有限公司 一种ar虚拟美妆镜及其工作方法
CN117315165B (zh) * 2023-11-28 2024-03-12 成都白泽智汇科技有限公司 一种基于显示界面的化妆智能辅助显示方法
CN117495664B (zh) * 2023-12-25 2024-04-09 成都白泽智汇科技有限公司 一种智能辅助化妆系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101350102A (zh) * 2008-08-29 2009-01-21 北京中星微电子有限公司 一种化妆辅助方法及系统
CN102708575A (zh) * 2012-05-17 2012-10-03 彭强 基于人脸特征区域识别的生活化妆容设计方法及系统
CN104205162A (zh) * 2013-02-01 2014-12-10 松下电器产业株式会社 化妆辅助装置、化妆辅助方法、以及化妆辅助程序
JP2016081441A (ja) * 2014-10-22 2016-05-16 パナソニックＩｐマネジメント株式会社 美容支援装置、美容支援システムおよび美容支援方法
CN105787981A (zh) * 2016-02-25 2016-07-20 上海斐讯数据通信技术有限公司 移动终端辅助化妆的方法及系统
CN107361564A (zh) * 2017-07-17 2017-11-21 深圳前海维度新科有限公司 可自动虚拟上妆的智能镜系统
CN107463936A (zh) * 2016-06-02 2017-12-12 宗经投资股份有限公司 自动脸部化妆方法
CN108765268A (zh) * 2018-05-28 2018-11-06 京东方科技集团股份有限公司 一种辅助化妆方法、装置及智能镜

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100477745C (zh) * 2002-08-09 2009-04-08 夏普株式会社 图像合成装置和图象合成方法
EP2335576B8 (en) * 2005-08-12 2020-04-15 TCMS Transparent Beauty LLC System and method for applying a reflectance modifying agent to improve the visual attractiveness of human skin
EP3039990B1 (en) * 2013-08-30 2019-07-24 Panasonic Intellectual Property Management Co., Ltd. Makeup assistance device, makeup assistance system, makeup assistance method, and makeup assistance program
US10083345B2 (en) * 2015-05-05 2018-09-25 Myongsu Choe Makeup supporting methods for creating and applying a makeup guide content to makeup user's face on a real-time basis
TWI573093B (zh) * 2016-06-14 2017-03-01 Asustek Comp Inc 建立虛擬彩妝資料的方法、具備建立虛擬彩妝資料之方法的電子裝置以及其非暫態電腦可讀取記錄媒體
WO2018079255A1 (ja) * 2016-10-24 2018-05-03 パナソニックＩｐマネジメント株式会社 画像処理装置、画像処理方法、および画像処理プログラム
CN110121280A (zh) * 2017-02-28 2019-08-13 松下知识产权经营株式会社 化妆模拟装置、方法以及非瞬时性存储介质
JP6677221B2 (ja) * 2017-06-06 2020-04-08 カシオ計算機株式会社 画像処理装置、画像処理方法及びプログラム
EP3652701A4 (en) * 2017-07-13 2021-11-03 Shiseido Company, Limited VIRTUAL FACE MAKEUP REMOVAL, FAST FACE RECOGNITION AND LANDMARK TRACKING
CN109427078A (zh) * 2017-08-24 2019-03-05 丽宝大数据股份有限公司 身体信息分析装置及其唇妆分析方法
CN109508581A (zh) * 2017-09-15 2019-03-22 丽宝大数据股份有限公司 身体信息分析装置及其腮红分析方法
CN109712065A (zh) * 2017-10-25 2019-05-03 丽宝大数据股份有限公司 身体信息分析装置及其脸形模拟方法
CN109063671A (zh) * 2018-08-20 2018-12-21 三星电子（中国）研发中心 用于智能化妆的方法及装置
EP3628187A1 (en) * 2018-09-26 2020-04-01 Chanel Parfums Beauté Method for simulating the rendering of a make-up product on a body area
US11178956B1 (en) * 2018-10-29 2021-11-23 Andrew Lawrence Prout System, method and mobile application for cosmetic and skin analysis
US11069094B1 (en) * 2019-05-13 2021-07-20 Facebook, Inc. Generating realistic makeup in a digital video stream

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101350102A (zh) * 2008-08-29 2009-01-21 北京中星微电子有限公司 一种化妆辅助方法及系统
CN102708575A (zh) * 2012-05-17 2012-10-03 彭强 基于人脸特征区域识别的生活化妆容设计方法及系统
CN104205162A (zh) * 2013-02-01 2014-12-10 松下电器产业株式会社 化妆辅助装置、化妆辅助方法、以及化妆辅助程序
JP2016081441A (ja) * 2014-10-22 2016-05-16 パナソニックＩｐマネジメント株式会社 美容支援装置、美容支援システムおよび美容支援方法
CN105787981A (zh) * 2016-02-25 2016-07-20 上海斐讯数据通信技术有限公司 移动终端辅助化妆的方法及系统
CN107463936A (zh) * 2016-06-02 2017-12-12 宗经投资股份有限公司 自动脸部化妆方法
CN107361564A (zh) * 2017-07-17 2017-11-21 深圳前海维度新科有限公司 可自动虚拟上妆的智能镜系统
CN108765268A (zh) * 2018-05-28 2018-11-06 京东方科技集团股份有限公司 一种辅助化妆方法、装置及智能镜

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of EP4116923A4
TANG WEN , XU TONGLU: "Design of Smart Makeup Mirror Using Face Recognition Technology", ART EDUCATION, no. 16, 5 August 2018 (2018-08-05), pages 116 - 117, XP055854806, ISSN: 1002-8900 *

Also Published As

Publication number Publication date
EP4116923A1 (en) 2023-01-11
US20230154083A1 (en) 2023-05-18
CN113496459A (zh) 2021-10-12
EP4116923A4 (en) 2023-08-16

Similar Documents

Publication Publication Date Title
WO2021197186A1 (zh) 辅助化妆方法、终端设备、存储介质及程序产品
CN108229278B (zh) 人脸图像处理方法、装置和电子设备
EP3582187B1 (en) Face image processing method and apparatus
US6502583B1 (en) Method of correcting face image, makeup simulation method, makeup method makeup supporting device and foundation transfer film
WO2012056743A1 (ja) 画像処理装置、画像処理方法、および制御プログラム
US20100189357A1 (en) Method and device for the virtual simulation of a sequence of video images
WO2022179025A1 (zh) 图像处理方法及装置、电子设备和存储介质
US20220180485A1 (en) Image Processing Method and Electronic Device
CN104599297B (zh) 一种对人脸自动上腮红的图像处理方法
CN113723385B (zh) 视频处理方法及装置、神经网络的训练方法及装置
CN113965694B (zh) 录像方法、电子设备及计算机可读存储介质
US11776187B2 (en) Digital makeup artist
US11961169B2 (en) Digital makeup artist
CN110866139A (zh) 一种化妆处理方法、装置及设备
CN113850726A (zh) 图像变换方法和装置
CN113453027B (zh) 直播视频、虚拟上妆的图像处理方法、装置及电子设备
CN113344837A (zh) 人脸图像处理方法及装置、计算机可读存储介质、终端
CN108833772A (zh) 基于深度相机的拍照引导系统及方法
KR101507410B1 (ko) 모바일 단말의 라이브 메이크업 촬영 방법 및 장치
CN113610723B (zh) 图像处理方法及相关装置
CN110298904A (zh) 一种信息处理方法及装置
CN114998115A (zh) 图像美化处理方法、装置及电子设备
WO2021155666A1 (zh) 用于生成图像的方法和装置
CN114021022A (zh) 一种妆容信息获取方法、装置、车辆及存储介质
CN112488965A (zh) 一种图像处理方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21781902

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021781902

Country of ref document: EP

Effective date: 20221006

NENP Non-entry into the national phase

Ref country code: DE