WO2022001882A1

WO2022001882A1 - Information prompting method and terminal device

Info

Publication number: WO2022001882A1
Application number: PCT/CN2021/102440
Authority: WO
Inventors: 董辰; 卢曰万; 赵琳; 陈宜欣; 郜文美; 杨帆
Original assignee: 华为技术有限公司
Priority date: 2020-06-28
Filing date: 2021-06-25
Publication date: 2022-01-06
Also published as: CN113850724A

Abstract

An information prompting method and a terminal device, which relate to the technical field of terminals. The method comprises: after a terminal device determines a target makeup part, acquiring an image of the target makeup part of a user, and displaying, in a first display area, the acquired image of the target makeup part; the terminal device determining a target reference model image of the target makeup part, and displaying the target reference model image in a second display area; and the terminal device determining, according to the image of the target makeup part and the target reference model image, makeup guidance information for guiding the user to apply makeup to the target makeup part, and prompting the user for the makeup guidance information. Therefore, by means of the method, a terminal device can provide accurate makeup guidance information to a user according to the condition of a target makeup part of the user, so that the user modifies the target makeup part thereof, such that not only can the user's own target makeup part be effectively beautified, but the user experience can also be improved.

Description

Information prompting method and terminal device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application filed on June 28, 2020 with the application number 202010595130.X and the application name "An information prompting method and terminal device", the entire contents of which are incorporated by reference in in this application.

technical field

The present application relates to the field of terminal technologies, and in particular, to an information prompting method and a terminal device.

Background technique

With the improvement of people's quality of life, good appearance plays an increasingly important role in daily life and work. Therefore, more and more users begin to improve their appearance through skin care, makeup, eyebrow trimming and other means. Among them, there are many intelligent software for beauty and makeup, through which users can adjust or make up photos containing human faces, so as to beautify the faces in the photos. However, these intelligent software cannot realize the beautification of real faces.

SUMMARY OF THE INVENTION

The present application provides an information prompting method and a terminal device, which are used to instruct a user to make makeup, so as to beautify a real person.

In a first aspect, an embodiment of the present invention provides an information prompting method, which is suitable for a terminal device with a makeup guidance function. The method includes the following steps:

After determining the target makeup part, the terminal device acquires the image of the user's target makeup part, and displays the acquired image of the target makeup part in the first display area of the display screen; then the terminal device determines the target makeup part The target reference model image of the part is displayed, and the target reference model image is displayed in the second display area of the display screen; secondly, the terminal device displays the image of the target makeup part according to the first display area. and the target reference model image displayed in the second display area to determine makeup instruction information for instructing the user to apply makeup to the target makeup part displayed in the first display area; finally, the terminal device prompts the user to Makeup instructions.

Through this method, the terminal device can generate makeup guidance information according to the target makeup part in the user image and the target part in the target reference model image, and prompt the user. The user can perform a makeup operation on the target makeup part of himself step by step according to the makeup guide information displayed by the terminal device, so as to ensure that the user's modified state of the target makeup part of himself and the target reference model image are in the image. The target sites are basically the same.

In a possible design, before the terminal device determines the target makeup part, the terminal device also needs to receive a first instruction from the user, and then start the makeup guide function according to the first instruction; finally, the terminal device The target makeup site is determined after the makeup guidance function is activated.

Through this design, before the terminal device determines the user image of the target makeup part from the image collected by the camera, the terminal device should also receive the user's instruction, and according to the user's instruction, first start the makeup guidance function of the terminal device , so as to carry out makeup guidance in the interface of the makeup guidance function; and, determine the target makeup part that the user needs to modify, so that the terminal device can guide the user in the makeup guidance interface of the target makeup part in a targeted manner. The target makeup part of the user is modified, so as to effectively beautify the target makeup part of the user.

In a possible design, when the terminal device determines the target makeup site, the terminal device may display multiple makeup sites on the display screen, and apply makeup on one of the displayed multiple makeup sites When the part is selected, the selected makeup part is determined as the target makeup part; or the terminal device displays a face image on the display screen, and a part in the displayed face image is When selected, the selected part is determined as the target makeup part.

Through this design, the user can use any of the methods to determine the target makeup part in the display screen, so that the user's experience can be improved.

In a possible design, the terminal device may further acquire a makeup effect image, where the makeup effect image is obtained after the user performs makeup on the target makeup part displayed in the first display area according to the makeup guide information. image, the terminal device may also display the acquired makeup effect image in the third display area of the display screen.

Through this design, the terminal device displays the makeup effect image in the third display area of the display screen, so that the user can clearly view the overall modification of the target makeup part in real time, and the user experience is improved.

In a possible design, when the terminal device determines the target reference model image of the target makeup part, the terminal device may receive a second instruction for instructing the terminal device to automatically select a reference model image, and then according to The second instruction determines the target reference model image from among the stored multiple reference model images corresponding to the target makeup part; or the terminal device may also receive the first instruction for instructing the user to manually select the reference model image. three instructions, and then display the stored multiple reference model images corresponding to the target makeup part in the second display area, and determine the selected reference model image among the displayed multiple reference model images as the target reference model image.

Through this design, the terminal device can not only match the most similar target reference model image for the target makeup part of the user, so as to automatically determine the target reference model image for the user; the terminal device can also determine the target reference model image according to the user's own choice. The target reference model image, thereby improving the user experience.

In a possible design, the terminal device determines the similarity between the image of the target makeup part displayed in the first display area and the image of the target reference model displayed in the second display area; Then, the terminal device determines similarity information according to the similarity; finally, the terminal device prompts the user for the similarity information.

Through this design, the terminal device automatically calculates the similarity between the user's target makeup part and the target makeup part in the target reference model image, and prompts the user with the similarity information. Therefore, the terminal device can intuitively inform the user of the proximity of the modified target makeup part and the target makeup part in the target reference model image, so that the user can know the modified target makeup part according to the similarity information Whether there are improvements to ensure the user experience.

In a possible design, when the terminal device prompts the user with the makeup guide information, the terminal device may display the makeup guide information in the first display area; or the terminal device may also The makeup instruction information is played by voice.

Through this design, the terminal device can intuitively inform the user of the makeup instruction information in a display mode, and can also play the makeup instruction information to the user in a voice manner. This flexible prompt method can not only ensure that the user can accurately After receiving the makeup instruction information, the user's experience can also be improved.

In a possible design, the makeup instruction information may include at least one of the following: grooming tools, grooming positions, grooming directions, and precautions during grooming. Through this method, the user can know the specific modification tool, modification position, modification direction, and any at least one of the precautions in the modification process, so that the user can modify his own target makeup part according to the specific prompt information to ensure that the user The accurate modification of the target makeup part of the user also avoids unnecessary mistakes that may occur in the modification process for the user.

In a second aspect, an embodiment of the present application further provides a terminal device, including a display screen, one or more processors, and one or more memories; wherein, the one or more memories store one or more computer programs and data, the one or more computer programs include instructions that, when executed by the one or more processors, cause the terminal device to perform the method provided in the first aspect of the present application.

In a third aspect, an embodiment of the present application further provides a computer storage medium, where a software program is stored in the storage medium, and when the software program is read and executed by one or more processors, the first aspect or any one of them can be implemented method provided by a design.

In a fourth aspect, embodiments of the present application further provide a computer program product including instructions, which, when run on a computer, enables the computer to execute the method provided by the first aspect or any one of the designs.

In a fifth aspect, an embodiment of the present application provides a chip system, where the chip system includes a processor for supporting a terminal device to implement the functions involved in the first aspect above. In a possible design, the chip system further includes a memory for storing necessary program instructions and data of the terminal device. The chip system may be composed of chips, or may include chips and other discrete devices.

In a sixth aspect, an embodiment of the present application further provides an interface on a terminal device, wherein the terminal device has a display screen, a memory, and a processor, and the processor is configured to execute a computer program stored in the memory , the graphical user interface includes an interface displayed when the terminal device executes the method of the first aspect.

Description of drawings

FIG. 1 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a software structure of a terminal device according to an embodiment of the present invention;

3 is a flowchart of a method for prompting information provided by the present invention;

4A is a terminal device for makeup guidance provided by an embodiment of the present invention;

FIG. 4B is another terminal device for makeup guidance provided by an embodiment of the present invention;

5A is a schematic diagram of an initialization interface of a makeup guide provided by an embodiment of the present invention;

5B is a schematic diagram of an initialization interface of a makeup guide provided by an embodiment of the present invention;

5C is a schematic diagram of an initial display interface of an eyebrow makeup guide provided by an embodiment of the present invention;

5D is a schematic diagram of a display interface for selecting target eyebrows according to an embodiment of the present invention;

5E is a schematic diagram of another display interface for selecting target eyebrows provided by an embodiment of the present invention;

5F is a schematic diagram of a completed display interface for eyebrow makeup guidance provided by an embodiment of the present invention;

5G is a schematic diagram of a display interface for eyebrow trimming guidance information provided by an embodiment of the present invention;

5H is a schematic diagram of a display interface for eyebrow drawing guidance information provided by an embodiment of the present invention;

5I is a schematic diagram of an eyebrow drawing instruction information display interface provided by an embodiment of the present invention;

5J is a schematic diagram of an eyebrow makeup guide completion display interface provided by an embodiment of the present invention;

6A is a schematic diagram of a display interface of a lip makeup guide provided by an embodiment of the present invention;

6B is a schematic diagram of a display interface for selecting a target lip according to an embodiment of the present invention;

6C is a schematic diagram of another display interface for selecting a target lip according to an embodiment of the present invention;

6D is a schematic diagram of a complete display interface of a lip makeup guide provided by an embodiment of the present invention;

6E is a schematic diagram of a display interface for lip makeup guidance information provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of a terminal device device for information prompting according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a terminal device for information prompting according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

Hereinafter, some terms in the embodiments of the present application will be explained, so as to facilitate the understanding of those skilled in the art.

1) The terminal equipment involved in the embodiments of the present application may also be called user equipment (UE), for example, smart phones, tablet computers, smart mirrors, smart home equipment and other smart devices with cameras and display screens. equipment, etc. Various applications (application, app for short) with a function of guiding makeup can be installed in the terminal device.

2) The multiple involved in the embodiments of the present application refers to greater than or equal to two.

In addition, it should be understood that in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing the description, and should not be understood as indicating or implying relative importance, nor should it be understood as indicating or implied order.

The embodiment of the present application provides an information prompting method, which is applicable to a terminal device. FIG. 1 shows a schematic diagram of the hardware structure of a possible terminal device. Referring to FIG. 1 , the terminal device 100 may include: a processor 110 , an internal memory 121 , an external memory interface 122 , a camera 130 , a display screen 140 , a sensor module 150 , an audio module 160 , a speaker 161 , a receiver 162 , and a microphone 163 , earphone interface 164, subscriber identification module (SIM) card interface 171, universal serial bus (USB) interface 172, charging management module 180, power management module 181, battery 182, mobile communication module 191 and wireless communication module 192 and other components.

Those skilled in the art can understand that the structure of the terminal device shown in FIG. 1 does not constitute a limitation on the terminal device, and the terminal device provided in this embodiment of the present application may include more or less components than those shown in the figure, or a combination of certain components may be included. some components, or a different arrangement of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Each component of the terminal device 100 will be specifically introduced below with reference to FIG. 1 :

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a video codec, digital signal processing A digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. During specific implementation, different processing units may be independent devices, or may be integrated in one or more devices.

In some embodiments, a buffer may also be provided in the processor 110 for storing programs and/or data. It should be noted that the programs in the embodiments of the present application may also be referred to as program instructions, computer programs, code instructions, instructions, etc., which are not limited thereto. For example, the buffer in the processor 110 may be a cache memory. The buffer may be used to store programs and/or data that have just been used, generated, or recycled by the processor 110 . If the processor 110 needs to use the program and/or data, it can be called directly from the buffer. It helps to reduce the time for the processor 110 to acquire programs or data, thereby improving the efficiency of the system.

Internal memory 121 may be used to store programs and/or data. In some embodiments, the internal memory 121 includes a stored program area and a stored data area. The program storage area may be used to store an operating system (such as an operating system such as Android, IOS, etc.), a program required for at least one function (such as a makeup instruction function), and the like. The storage data area may be used to store data created, preset and/or acquired during the use of the terminal device 100 (such as a reference face model image, an image received through a network), and the like. For example, the processor 110 may cause the terminal device 100 to execute a corresponding method by calling programs and/or data stored in the internal memory 121, thereby implementing one or more functions. For example, the processor 110 invokes certain programs and/or data in the internal memory, so that the terminal device 100 executes the makeup guidance method provided in the embodiments of the present application, and automatically detects the face position or automatically matches the target by using the video tracking technology. Reference part images, etc., do not require manual operation by the user, which helps to improve the user experience. Wherein, the internal memory 121 may adopt a high-speed random access memory, and/or a non-volatile memory, or the like. For example, the non-volatile memory may include at least one of one or more magnetic disk storage devices, flash memory devices, and/or universal flash storage (UFS), among others.

The external memory interface 122 can be used to connect an external memory card (eg, a Micro SD card), so as to expand the storage capacity of the terminal device 100 . The external memory card communicates with the processor 110 through the external memory interface 122 to realize the data storage function. For example, the terminal device 100 may save the collected user images and other contents in an external memory card through the external memory interface 122 .

The camera 130 can be used to capture moving and still images, etc., to realize the shooting function of the terminal device 100 . Typically, the camera 130 includes a lens and an image sensor. Among them, the optical image generated by the object through the lens is projected onto the image sensor, and then converted into an electrical signal for subsequent processing. Illustratively, the image sensor may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. It should be noted that, in this embodiment of the present application, the terminal device 100 may include one or more cameras 130 , which is not limited.

The display screen 140 may include a display panel. The display screen 140 is the display system of the terminal device 100, and is used for presenting an interface and realizing human-computer interaction. For example, the display screen 140 can be used to display the information input by the user or the information provided to the user and various menus of the terminal device 100 , in addition, the display screen can also be used to display the picture captured by the camera 130 .

Optionally, the display panel may adopt a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode. (active-matrix organic light emitting diode, AMOLED), flexible light emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (quantum dot light emitting diodes, QLED) and so on. For example, the terminal device 100 may implement a display function through a GPU, a display screen 140, an application processor, and the like.

Sensor module 150 may include one or more sensors. For example, touch sensor 150A, pressure sensor 150B, and the like. In other embodiments, the sensor module 150 may further include a gyroscope, an acceleration sensor, a fingerprint sensor, an ambient light sensor, a distance sensor, a proximity light sensor, a bone conduction sensor, a temperature sensor, a positioning sensor (eg, a global positioning system). system, GPS) sensor), etc., which are not limited.

The touch sensor 150A may also be referred to as a "touch panel" and may be used to collect user touch operations on or near it (such as the user using a finger, a stylus, etc., any suitable object or accessory on the touch sensor 150A or at any location). operation near the touch sensor 150A described above), and drive the corresponding connection device according to the preset program. Optionally, the touch sensor 150A may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch sensor 150A can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.

When the touch sensor 150A is disposed on the display screen 140, the touch sensor 150A and the display screen 140 form a touch screen, which may also be referred to as a "touch screen". The touch sensor 150A is used to detect a touch operation on or near it. The touch sensor 150A can transmit the detected touch operation to the application processor to determine the type of touch event, so that the terminal device 100 can provide visual output related to the touch operation and the like through the display screen 140 . For example, the terminal device 100 may perform interface switching in response to detecting a touch operation on or near the touch device 150A, and display the switched interface on the display screen 140 . In other embodiments, the touch sensor 150A may also be disposed on the surface of the terminal device 100 , which is different from the position where the display screen 140 is located.

The pressure sensor 150B is used to sense pressure signals, and can convert the pressure signals into electrical signals. For example, the pressure sensor 150B may be disposed on the display screen 140 . Among them, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions.

The terminal device 100 may implement audio functions through an audio module 160, a speaker 161, a receiver 162, a microphone 163, an earphone interface 164, an application processor, and the like. For example, audio playback function, voice recording function, etc.

The audio module 160 may be used to perform digital-to-analog conversion and/or analog-to-digital conversion on audio data, and may also be used to encode and/or decode audio data. For example, the audio module 160 may be provided in the processor 110 , or some functional modules of the audio module 160 may be provided in the processor 110 .

The speaker 161, also called "speaker", is used to convert audio data into sound and play the sound. For example, the terminal device 100 may receive the user's voice instruction through the speaker 161, or send out a voice prompt or the like.

The receiver 162, also referred to as an "earpiece", is used to convert audio data into sound and to play back the sound. For example, when the terminal device 100 answers a call, it can be answered by placing the receiver 162 close to the human ear.

The microphone 163, also called "microphone" or "microphone", is used to collect sound (eg, ambient sound, including sounds made by people, sounds made by equipment, etc.), and convert the sound into audio electrical data. When the user makes a sound through the human mouth close to the microphone 163, the microphone 163 collects the sound made by the user. It should be noted that the terminal device 100 may be provided with at least one microphone 163 . For example, two microphones 163 are provided in the terminal device 100, which can implement a noise reduction function in addition to collecting sound. For another example, three, four or more microphones 163 may be provided in the terminal device 100, so that on the basis of sound collection and noise reduction, sound source identification or directional recording functions can also be implemented.

The earphone jack 164 is used to connect wired earphones. The earphone interface 164 may be a USB interface 170, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface, etc. .

The SIM card interface 171 is used to connect a SIM card. The SIM card can be contacted and separated from the terminal device 100 by inserting the SIM card interface 171 or pulling it out from the SIM card interface 115 . The terminal device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.

The USB interface 172 is an interface that conforms to the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 172 can be used to connect a charger to charge the terminal device 100, and can also be used to transmit data between the terminal device 100 and peripheral devices. It can also be used to connect headphones to play sound through the headphones. Exemplarily, the USB interface 172 can be used to connect other terminal devices, such as AR devices, computers, and the like, in addition to the headphone interface 164 .

The charging management module 180 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 180 may receive charging input from the wired charger through the USB interface 170 . In some wireless charging embodiments, the charging management module 180 may receive wireless charging input through the wireless charging coil of the terminal device 100 . While the charging management module 180 charges the battery 182 , the terminal device 100 can also be powered by the power management module 180 .

The power management module 181 is used for connecting the battery 182 , the charging management module 180 and the processor 110 . The power management module 181 receives input from the battery 182 and/or the charging management module 180, and supplies power to the processor 110, the internal memory 121, the camera 130, the display screen 140, and the like. The power management module 181 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In some other embodiments, the power management module 181 may also be provided in the processor 110 . In other embodiments, the power management module 181 and the charging management module 180 may also be provided in the same device.

The mobile communication module 191 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the terminal device 100 . The mobile communication module 191 may include a filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.

The wireless communication module 192 is mainly used to communicate with other devices through wireless communication standards or protocols. Described wireless communication standard or agreement, including but not limited to global system of mobile communication (global system of mobile communication, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA) ), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), etc. Exemplarily, the wireless communication module 192 may include, but is not limited to, at least one or a combination of: an RF circuit, a WiFi module, and a Bluetooth module. The physical communication interface is used to realize the physical connection between the terminal device 100 and other devices. For example, the physical communication interface and the communication interface of the other device are connected through a cable to realize the terminal device 100 and other devices. data transfer between. The wireless communication module 192 may be one or more devices integrating at least one communication processing module.

In some embodiments, the antenna 1 of the terminal device 100 is coupled with the mobile communication module 191, and the antenna 2 is coupled with the wireless communication module 192, so that the terminal device 100 can communicate with other devices. Specifically, the mobile communication module 191 can communicate with other devices through the antenna 1 , and the wireless communication module 191 can communicate with other devices through the antenna 2 .

FIG. 2 shows a software structural block diagram of a terminal device provided by an embodiment of the present application. As shown in FIG. 2 , the software structure of the terminal device may be a layered architecture, for example, the software may be divided into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer (framework, FWK), an Android runtime (Android runtime) and system libraries, and a kernel layer.

The application layer can include a series of applications. As shown in Figure 2, the application layer may include settings, phone, gallery, LED lights, and third-party applications, among others. Among them, third-party applications can include navigation, music, video, smart mirrors, etc.

The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer can include some predefined functions. As shown in Figure 2, the application framework layer may include: window manager, content provider, view system, telephony manager, resource manager, notification manager, and so on.

Window manager, which provides window manager service for windows. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.

Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. An interface can consist of one or more controls. For example, the interface including the SMS notification icon may include controls for displaying text and controls for displaying pictures.

The telephony manager is used to provide the communication function of the terminal device. For example, the management of call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localization strings, icons, images, layout files, etc.

The Android runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system. Among them, the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of the Android system. The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.

A system library can include multiple functional modules. For example: display module, template matching module, image matching module, makeup instruction module, media libraries, image processing libraries, etc.

The display module is used for displaying on the display screen after receiving the image display instruction, so that the user can see it intuitively, thereby realizing human-computer interaction. For example, the display module displays the reference model image stored by the terminal device through the display screen, or the user image detected from the image collected by the camera device; for example, the display module displays the makeup guidance interface through the display screen, including: menu and makeup guidance information, etc.

The template matching module is used for matching the stored reference model images of multiple target makeup parts to obtain a target reference model image that is most similar to the user image containing the user's target makeup parts.

The image matching module is used for matching the user image and the target reference model image to obtain a matching result, and the matching result is used to determine the similarity information of the two and determine the makeup guide information.

The makeup guidance module is used for determining makeup guidance information according to the matching result of the image matching module.

The media library supports playback and recording of audio and video in multiple formats, and supports opening of still images in multiple formats. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The kernel layer is the layer between hardware and software. The kernel layer at least includes display drivers, sensor drivers, camera drivers, audio drivers, etc., which are used to drive the hardware in the hardware layer.

The hardware layer can include various sensors, displays, cameras, etc.

As shown in FIG. 3 , it is a flowchart of an information prompting method provided by an embodiment of the present application. The methods provided in the embodiments of the present application may be, but are not limited to, applicable to the hardware architecture of the terminal device 100 shown in FIG. 1 and the software architecture of the terminal device shown in FIG. 2 . As shown in Figure 3, the process of the method includes:

S301: The processor in the terminal device determines a target makeup part, acquires an image of the user's target makeup part through a camera device, and controls a first display area of the display screen to display the acquired image of the target makeup part.

The camera device may be a camera built in the terminal device, or may be an external camera device that establishes a communication connection with the terminal device, which is not limited in this application. In addition, when the camera is an external camera, the processor needs to receive the image collected by the camera through a mobile communication module or a wireless communication module.

Specifically, the processor may use a video tracking technology to ensure that the image captured by the camera device includes the image of the target makeup part.

In this embodiment of the present application, the processor may start the makeup guide function according to the first instruction when receiving the first instruction of the user; then, the processor determines the target makeup part according to the user's selection, or When the makeup guide function is only for the target makeup part, the processor may directly determine the target makeup part according to the makeup guide function.

In an actual application, after the terminal device starts the makeup guidance function, the processor determines the target makeup part according to the user's selection, including: the processor displays a plurality of makeup parts on the display screen, and When one of the displayed makeup parts is selected by the user, the selected makeup part is determined as the target makeup part; or the processor displays a face image on the display screen, and When a part in the displayed face image is selected by the user, the selected part is determined as the target makeup part.

Optionally, the terminal device may also display a makeup effect image through a third display area of the display screen, where the makeup effect image is all the makeup effect images displayed by the user on the first display area according to the makeup guide information. The image after makeup is applied to the target makeup site.

S302: The processor determines a target reference model image of the target makeup part, and displays the target reference model image in the second display area of the display screen.

In this embodiment of the present application, the processor may, but is not limited to, determine the target reference model image of the target makeup part in the following two ways:

Manner 1: the processor receives a second instruction, the second instruction is used to instruct to automatically select a reference model image; the processor stores a plurality of reference models corresponding to the target makeup part according to the second instruction In the image, the target reference model image is determined.

Exemplarily, after the processor determines the target makeup part, the processor automatically matches the target makeup part with the target parts in the multiple reference model images stored in the internal memory according to the second instruction received. , determining a reference model image that best matches the image of the target makeup part from the plurality of reference model images, and using the best matching reference model image as the target reference model image.

Manner 2: the processor receives a third instruction, the third instruction is used to instruct to manually select a reference model image; the processor displays a plurality of stored references corresponding to the target makeup part through the second display area The model image, the reference model image selected by the user among the displayed multiple reference model images is determined as the target reference model image.

Exemplarily, after the processor determines the target makeup part, after the processor receives the third instruction, the display screen displays the reference model images of the plurality of target makeup parts stored in the internal memory, The user may manually select any one of the reference model images from the plurality of reference model images displayed in the second display area of the display screen, and the processor may use the reference model image manually selected by the user as the target reference model image. .

Optionally, the processor determines the similarity between the image of the target makeup part displayed in the first display area and the image of the target reference model displayed in the second display area; and then the The processor determines similarity information according to the similarity; finally, the processor displays the similarity information on the display screen, and/or plays the voice containing the similarity information through the speaker, so as to It is implemented to prompt the similarity information and the like to the user.

Specifically, the processor can calculate the target makeup part of the user and the target makeup part in the target reference model image in real time according to the image of the user's target makeup part and the target reference model image The similarity is obtained, and the similarity score is obtained, and the similarity score is displayed on the display screen to prompt the similarity information and the like to the user.

Exemplarily, the processor may, but is not limited to, calculate the similarity score between the target makeup part of the user and the target makeup part in the target reference model image by the following method:

a1: the processor calculates the color similarity according to the color of the target makeup part of the user and the color of the target makeup part in the target reference model image;

a2: the processor calculates the shape similarity according to the shape of the target makeup part of the user and the shape of the target makeup part in the target reference model image;

a3: The processor calculates the similarity score according to the color similarity and the shape similarity. For example, the terminal device calculates the weighted sum of color similarity and shape similarity to obtain the similarity score, where the weight of color similarity may be 10%, and the weight of shape similarity may be 90%.

S303: The processor determines makeup instruction information according to the image of the target makeup part displayed in the first display area of the display screen and the target reference model image displayed in the second display area of the display screen, The makeup instruction information is used to instruct the user to apply makeup to the target makeup part displayed in the first display area.

Optionally, the makeup instruction information includes at least one of the following items: modification tools, modification positions, modification directions, and precautions during modification.

Exemplarily, the processor may execute S303 after receiving the makeup instruction instruction from the user. For example, after the processor determines the target reference model image in S302, the instruction button is displayed on the display screen; when After the user clicks the opening guide button, S303 is executed.

S304: The terminal device prompts the user with the makeup guide information.

Optionally, the terminal device displays the makeup guide information in the first display area of the display screen, and/or plays a voice containing the makeup guide information through the speaker to prompt the user.

Exemplarily, at the position of the target makeup part in the image of the target makeup part displayed in the first display area, a beauty-shaped frame of the target makeup part in the image of the target reference model is displayed to enhance the contrast.

In another example, the makeup guidance information may be directly displayed around the target makeup site in the image of the target makeup site, or the display screen further includes a display area for displaying the makeup guidance information. After the processor generates the makeup instruction information, the makeup instruction information is displayed in the display area.

In the embodiment of the present application, the user performs each step of makeup according to the makeup instruction information prompted by the terminal device; the terminal device collects the user image modified by the user in real time through the camera device, and updates the display to the display Then, the terminal device updates the makeup effect image displayed on the display screen in S301 and the score displayed on the display screen in S302, and continues to generate the next makeup guide information according to the updated user image and the target reference model image prompt to the user.

Optionally, after the processor determines that the display screen shows that the similarity score of the target makeup part in the user image and the target reference model image is 100, or the processor receives the end of the user. After the instruction is given, or after the processor determines that the user does not operate for more than a set period of time, the makeup guide function is turned off.

The embodiment of the present application provides an information prompting method. In this method, firstly, after determining the target makeup part, the terminal device acquires the image of the user's target makeup part, and displays the collected image of the target makeup part in the first display area of the display screen; then, the terminal device Determine the target reference model image of the target makeup part, and display the target reference model image in the second display area of the display screen; finally, the terminal device can be based on the user's target makeup image and target reference model image, determine the makeup guide information, and present the makeup guide information to the user. Therefore, through this method, the terminal device can determine specific makeup instruction information for the user according to the actual situation of the user's own target makeup site, and prompt the user with makeup instruction information in a flexible manner, so that the user can make makeup according to the makeup instruction information. The guidance information modifies one's own target makeup parts step by step, so that not only can the user's own target makeup parts be effectively beautified, but also the user's use experience can be improved.

Based on the information prompting method provided by the above embodiments, the present application also provides an example of eyebrow makeup guidance. Optionally, the terminal device involved in this example may be the smart mirror shown in FIG. 4A (for example, Amiro smart makeup mirror, Tmall Elf Queen, etc.), or the smart phone shown in FIG. 4B with the makeup guidance function installed. , it should be noted that the terminal device includes a camera (the front camera shown in FIG. 4A or 4B ), or the terminal device can be connected to an external camera device. The following only takes the smartphone as shown in FIG. 4B as an example, and the specific flow of the example will be described with reference to FIGS. 5A to 5J .

b1: The terminal device receives an instruction for starting the makeup guidance function from the user, and starts the makeup guidance function of the terminal device according to the instruction. Wherein, after the terminal device starts the makeup guidance function, an initialization interface of makeup guidance is displayed on the display screen.

Optionally, the terminal device can directly open a makeup guide application according to the user's instruction, thereby starting the makeup guide function; or the terminal device can open an application (for example, a smart mirror application, a camera application, etc.) Then, activate the makeup guide function in the application. For example, as shown in FIG. 4B , when the terminal device opens the smart mirror application, the main interface of the smart mirror is displayed, and when the user clicks the makeup guidance function button, the terminal device can open the makeup guidance function in the application.

Exemplarily, two menus of gender and makeup parts may be displayed in the initialization interface, as shown in FIG. 5A . The user can select the gender of the user object who needs makeup guidance according to actual needs. The user can select the target makeup parts that need makeup guidance, such as eyes, eyebrows, nose, lips, cheeks, etc., according to the makeup part menu.

For another example, the initialization interface can also display a gender menu and an image of a face model displaying multiple makeup parts. As shown in FIG. 5B, the user can click the gender menu to select the gender of the user object, and then the face model can be displayed on the face model. Select the target makeup parts that need makeup guidance in the image.

In this embodiment, the user selects the gender of the user object as female as an example.

b2: The terminal device obtains the gender and the target makeup part input by the user in the initialization interface, then displays the makeup guide interface of the target makeup part on the display screen, and turns on the camera above the terminal device, and collects data through the camera image. The following description will be given by taking the eyebrows as the target makeup site selected by the user as an example.

Taking the initialization interface shown in FIG. 5A as an example, the user can click on the makeup parts menu displayed on the display screen through a finger, a stylus or an input device, and then select the eyebrows among the multiple makeup parts displayed, so that the terminal device receives the After this operation, the target makeup site can be determined to be the eyebrows.

Taking the initialization interface shown in FIG. 5B as an example again, the user can click on the eyebrows in the face model image on the display screen, so that the terminal device can determine that the target makeup part is the eyebrows after receiving the operation.

Exemplarily, the eyebrow makeup guidance interface is shown in FIG. 5C , and the makeup guidance interface at least includes the following parts: a first display area for displaying the user’s eyebrows collected by the camera, and a first display area for displaying the target eyebrows as a reference for makeup guidance. Second display area. Optionally, in order to facilitate the user to view the overall makeup effect in real time, the makeup guidance interface may further include a third display area for displaying the overall makeup effect. In addition, in order to intuitively display the degree of similarity between the user's eyebrows and the target eyebrows for the user, the makeup guidance interface may further include a fourth display area for displaying the real-time scores of the user's eyebrows after makeup.

Since the target eyebrows can be automatically matched by the terminal device or the user can select two schemes, therefore, in the eyebrow makeup guidance interface shown in FIG. 5C , two buttons are displayed in the second display area—the automatic matching button and the manual selection button.

Wherein, when the user selects the automatic matching button, the terminal device can match the collected eyebrows of the user with multiple stored reference eyebrow models, and then select the reference eyebrow model most similar to the user's eyebrows among the multiple reference eyebrow models as the Target eyebrows.

When the user selects the manual selection button, the terminal device may display multiple reference eyebrow models stored in the second display area or on the display screen for the user to select. After the user selects a certain reference eyebrow model, the reference The eyebrow model serves as the target eyebrow.

b3: After the terminal device detects the user's eyebrows in the image collected by the camera, the terminal device displays the user's eyebrows in the first display area in the eyebrow makeup guidance interface, as shown in FIG. 5C .

Optionally, after detecting the user's eyebrows, the terminal device may use a video tracking technology to continuously, real-time and stably display the user's eyebrows in the first display area.

In addition, in order to facilitate the user to view the overall makeup effect in real time, the terminal device may display the overall makeup effect in the third display area. Wherein, the image of the overall makeup effect may be the face in the picture collected by the camera; or include the user's eyebrows displayed in real time in the first display area and the virtual eyebrows obtained by horizontally flipping the user's eyebrows; or include the camera A pair of user eyebrows in the captured picture, as shown in Figure 5C.

b4: The terminal device determines the target eyebrow, and displays the target eyebrow in the second display area in the eyebrow makeup guidance interface.

Exemplarily, the target eyebrows can be determined by means of automatic matching. That is, in the eyebrow makeup guidance interface shown in FIG. 5C, when the user clicks the automatic matching button, the terminal device matches the user's eyebrows detected in real time with the stored multiple reference eyebrow models, and then matches the multiple reference eyebrow models in the multiple reference eyebrow models. The reference eyebrow model most similar to the user's eyebrow is selected as the target eyebrow.

In another example, the target eyebrows may be determined by manual selection. That is, in the eyebrow makeup guidance interface shown in FIG. 5C , when the user clicks the manual selection button, the terminal device can display a plurality of pictures of reference eyebrow models in the second display area, as shown in FIG. 5D . The user can view all the pictures of the reference eyebrow model through the sliding operation, and select the reference eyebrow model as the target eyebrow by clicking on any picture of the reference eyebrow model.

Alternatively, when the user clicks the manual selection button, the terminal device may jump to a new target eyebrow selection interface, in which only pictures of the multiple reference eyebrow models are displayed, as shown in FIG. 5E . The user can select the reference eyebrow model as the target eyebrow by clicking on any picture of the reference eyebrow model and by clicking the OK button. After the user selects the target eyebrow, the user returns to the eyebrow makeup guide interface through the return button.

Exemplarily, the eyebrow makeup guide interface displaying the target eyebrow in the second display area may be as shown in FIG. 5F .

Optionally, the terminal device may perform a similarity calculation in real time according to the user's eyebrows displayed in the first display area and the target eyebrows displayed in the second display area to obtain a similarity score, and calculate the similarity. The score is displayed in the fourth display area in the eyebrow makeup guidance interface, as shown in FIG. 5F .

Exemplarily, the terminal device may calculate the similarity score between the user's eyebrows and the target eyebrows by, but not limited to, the following methods:

The terminal device calculates the color similarity according to the color of the user's eyebrows and the color of the target eyebrows;

The terminal device calculates the shape similarity according to the shape of the user's eyebrows and the shape of the target eyebrows;

The terminal device calculates the similarity score according to the color similarity and the shape similarity. For example, the terminal device calculates the weighted sum of color similarity and shape similarity to obtain the similarity score, where the weight of color similarity may be 10%, and the weight of shape similarity may be 90%.

b5: The terminal device generates makeup guide information according to the user's eyebrows displayed in the first display area and the target eyebrows displayed in the second display area, and sends the makeup guide information to the user by voice and/or display. prompt.

Exemplarily, the terminal device may execute b5 after receiving the user's makeup instruction instruction. For example, after b4 determines the target eyebrow, the terminal device displays a makeup button, as shown in FIG. 5F ; when the user clicks the makeup button, execute b5.

Exemplarily, the terminal device may display the beauty-shaped frame of the target eyebrow at the position of the user's eyebrow in the first display area to enhance the contrast, as shown in FIG. 5G .

Optionally, the makeup instruction information may include, but is not limited to, at least one or a combination of the following: modification tools, modification positions, modification directions, and precautions during modification. For example, the tools may include: eyebrow knife, eyebrow pencil, eyebrow brush, eyebrow trimmer. If the tool contains an eyebrow pencil or eyebrow brush, it also contains information such as the color of the eyebrow pencil or the color of the eyebrow powder.

Exemplarily, the makeup guide information may be directly displayed around the user's eyebrows in the first display area, as shown in FIG. 5G . For another example, the eyebrow makeup guidance interface further includes a fifth display area for displaying makeup guidance information. After the terminal device generates the makeup guidance information, the makeup guidance is displayed in the fifth display area. information.

b6: The terminal device collects the user's modified eyebrows in real time through the camera, and updates and displays them in the first display area; then the terminal device updates the image and score of the overall makeup effect, and according to the updated user's eyebrows And the target eyebrow continues to generate the next makeup guide information to prompt the user, as shown in FIG. 5H and FIG. 5I . For the above process, reference may be made to the description of the above steps, which will not be repeated here.

Optionally, in the eyebrow makeup guidance interface, the user performs each step of makeup according to the makeup guidance information displayed in the first display area, and the first display area is updated and displayed in real time and detected from the images collected by the camera. The eyebrows of the user are updated, and the score displayed in the fourth display area of the makeup guidance interface is updated in real time, and the score displayed in the fourth display area increases with each step of makeup by the user.

Exemplarily, as shown in FIG. 5H , in the eyebrow makeup guidance interface, the first display area displays makeup guidance information for eyebrow trimming—please use an eyebrow knife to trim the eyebrows beyond the boundary, and the user can watch the first section of the eyebrow makeup guidance interface. A display area displays makeup instruction information for eyebrow trimming, or repairs one's own eyebrows by hearing the voice of the terminal device playing the makeup instruction information.

In each step of repairing the user's eyebrows, the terminal device captures the image of the user's eyebrows in real time through the camera, updates and displays the makeup eyebrows in the first display area in real time, and updates the score in the fourth display area in real time. Optionally, the whole eyebrow is updated and displayed in real time in the third display area. As shown in Figure 5I.

Exemplarily, as shown in FIG. 5H , in the eyebrow makeup guidance interface, the first display area displays makeup guidance information for thrushes—please use an eyebrow pencil to draw eyebrow peaks and eyebrow tails, and the user can watch the first page of the eyebrow makeup guidance interface. A display area displays the makeup instruction information of the thrush, or hears the voice of the terminal device playing the makeup instruction information, and processes the own eyebrows.

At each step of the user's drawing of the eyebrow peak and eyebrow tail, the terminal device captures the image of the user's eyebrows in real time through the camera, and updates and displays the makeup eyebrows in the first display area in real time, and updates the score in the fourth display area in real time. Optionally, the whole eyebrow is updated and displayed in real time in the third display area. As shown in Figure 5H.

Exemplarily, as shown in FIG. 5I , in the eyebrow makeup guidance interface, the first display area displays makeup guidance information for thrushes—please continue to draw the eyebrows with an eyebrow pencil, and the user can watch the first display of the eyebrow makeup guidance interface. The makeup guidance information of the thrush is displayed in the area, or the terminal device plays the voice of the makeup guidance information, and the eyebrows are processed.

For each step of the user drawing his own eyebrows, the terminal device collects the image of the user's eyebrows in real time through the camera, and updates and displays the makeup eyebrows in the first display area in real time, and updates the score in real time in the fourth display area. The three display areas update and display the entire eyebrows in real time until the first display area no longer displays makeup guide information. As shown in Figure 5J.

b7: After the terminal device determines that the score of the user's eyebrows in the eyebrow makeup guidance interface is 100, or after the terminal device receives the user's end instruction, or after the user does not operate the terminal device for a set period of time to close the eyebrow makeup guide interface.

In this embodiment, after the user enables the makeup guidance function of the terminal device, the terminal device determines the eyebrows as the target makeup site, collects the image of the user's eyebrows through the camera, and displays it in the first display area of the eyebrow makeup guidance interface The collected image of the eyebrows; then, in the second display area of the eyebrow makeup interface, display the target eyebrows automatically matched by the terminal device for the user, or display the target eyebrows selected by the user in the second display area; and, The similarity score between the user's eyebrows and the target eyebrows is also displayed in the eyebrow makeup guidance interface, so that the user can intuitively understand the degree of difference between his own eyebrows and the target eyebrows. In the eyebrow makeup guidance interface The overall makeup effect can also be displayed in the user interface, so that the user can view the overall effect after makeup, so as to ensure the symmetry and integrity of the eyebrows after makeup by the user; finally, makeup guidance information and/or makeup guidance information are displayed in the eyebrow makeup guidance interface. Or prompt the user through voice playback, so that the user can modify his eyebrows after receiving the makeup instruction information, which can not only effectively beautify the user's own eyebrows, but also improve the user's use experience.

Based on the information prompting method shown in FIG. 3 , the present application also provides an example of lip makeup instruction. Same as the above example of eyebrow makeup instruction, this example continues to take the smartphone shown in FIG. 4B as an example for description, and the specific process of this example is described below with reference to FIGS. 6A-6E .

c1: Referring to the specific implementation of step b1 in the embodiment of instructing eyebrow drawing, the terminal device directly opens the makeup guidance application according to the user instruction, and a makeup guidance initialization interface is displayed on the display screen of the terminal device. As shown in Figure 5A.

Exemplarily, the user may determine the gender of the user object who needs makeup instruction according to actual needs. The user can specifically select the target makeup parts that need makeup guidance, such as eyebrows, eyes, nose, lips, etc., through the makeup parts menu in the makeup guidance interface or the face model image.

c2: The terminal device obtains the gender and the target makeup part input by the user in the initialization interface, then displays the makeup guide interface of the target makeup part on the display screen, and turns on the camera above the terminal device, and collects data through the camera image. The following description will be given by taking the target makeup part selected by the user as the lips as an example.

Referring to the specific implementation of step b2 in the above example of eyebrow makeup instruction, in the initialization interface shown in FIG. 5A or 5B, the terminal device may determine that the target makeup part is the lips.

c3: After the terminal device detects the user's lips in the image collected by the camera, the terminal device displays the user's lips in the first display area in the lip makeup guidance interface, as shown in FIG. 6A .

Optionally, after detecting the user's lips, the terminal device may use a video tracking technology to continuously, real-time and stably display the user's lips in the first display area.

In addition, in order to facilitate the user to view the overall makeup effect in real time, the terminal device may display the overall makeup effect in the third display area. Wherein, the image of the overall makeup effect may be the face in the picture collected by the camera; or the user's lips displayed in real time in the first display area, and the parts associated with it, as shown in FIG. 6A , including the user's lips and the user nose.

c4: The terminal device determines a target lip, and displays the target lip in the second display area in the lip makeup guidance interface.

Similar to the above eyebrow makeup example, the terminal device can also select the target lips through two methods of automatic matching and manual selection.

For example, in the lip makeup guidance interface shown in FIG. 6A, after the user selects the automatic matching button, the terminal device can select the reference lip model most similar to the user's lips from among the saved reference lip models as the target lip .

For another example, when the user clicks the manual selection button, the terminal device may display a plurality of pictures of the reference lip model in the second display area, as shown in FIG. 6B . The user can view all the pictures of the reference lip model by sliding operation, and select the reference lip model as the target lip by clicking on any picture of the reference lip model.

Alternatively, when the user clicks the manual selection button, the terminal device may jump to a new target lip selection interface, where only pictures of the multiple reference lip models are displayed, as shown in FIG. 6C . The user can select the reference lip model as the target lip by clicking on any picture of the reference lip model and clicking the OK button. After the user selects the lips, the user returns to the lip makeup guide interface through the return button.

Exemplarily, the lip makeup guide interface displaying the target lip in the second display area may be as shown in FIG. 6D .

Optionally, with reference to the similarity calculation method in step b4 in the above-mentioned embodiment of guiding eyebrow drawing, the terminal device may, according to the user's lips displayed in the first display area and the target lips displayed in the second display area, The similarity is calculated in real time, and the similarity score is obtained, and the similarity score is displayed in the fourth display area in the lip makeup guidance interface, as shown in FIG. 6D .

c5: The terminal device generates makeup instruction information according to the user's lips displayed in the first display area and the target lips displayed in the second display area, and sends the makeup instruction information to the user by voice and/or display. prompt.

Exemplarily, with reference to the specific implementation of step b5 in the above-mentioned embodiment of instructing eyebrow drawing, the terminal device may display the beauty-shaped border of the target lip at the position of the user's lips in the first display area of the lip makeup instruction interface, so as to For enhanced contrast, see Figure 6E.

Exemplarily, the makeup guide information may be directly displayed around the user's lips in the first display area, as shown in FIG. 6E . For another example, the lip makeup guidance interface further includes a fifth display area for displaying makeup guidance information, and after the terminal device generates the makeup guidance information, the makeup guidance is displayed in the fifth display area information.

c6: The terminal device captures the user's modified lips in real time through the camera, and updates and displays them in the first display area; then the terminal device updates the image and score of the overall makeup effect, and according to the updated user's lips And the lips continue to generate the next makeup guide information to prompt the user. For the above process, reference may be made to the description of the above steps, which will not be repeated here.

c7: After the terminal device determines that the score of the user's lips in the lip makeup guidance interface is 100, or after the terminal device receives the user's end instruction, or after the user does not operate the terminal device for a set period of time to close the lip makeup guide interface.

In this embodiment, after the user turns on the makeup guidance function of the terminal device, the terminal device determines the lips as the target makeup part, captures an image including the user's lips through a camera, and displays it in the first display area of the lip makeup interface an image of the user's lips; then, the terminal device displays the target lips automatically matched by the user in the second display area of the lip makeup interface, or displays the target lips manually selected by the user in the second display area; and , the lip makeup guidance interface also displays the similarity score between the user's lips and the target lips, so that the user can intuitively understand the degree of difference between his own lips and the target eyebrows, in the lip makeup guidance interface The overall makeup effect can also be displayed in the user interface, so that the user can view the overall makeup effect after makeup, so as to ensure the integrity and symmetry of the user's lips after makeup. Finally, by displaying makeup instruction information in the lip makeup instruction interface and/or prompting the user through voice playback, so that the user can modify his own lips after receiving the makeup instruction information, which is not only effective It beautifies the user's own lips and improves the user's experience.

In the above embodiments provided by the present application, the methods provided by the embodiments of the present application have been introduced from the perspective of a terminal device as an execution subject. In order to implement the functions in the methods provided by the above embodiments of the present application, the terminal device may include hardware structures and/or software modules, and implement the above functions in the form of hardware structures, software modules, or hardware structures plus software modules. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

Based on the same concept, FIG. 7 shows a terminal device 700 according to an embodiment of the present application, where the terminal device can execute the methods in the above embodiments and examples. As shown in FIG. 7 , the terminal device 700 includes: a display unit 701 , a processing unit 702 , and a prompt unit 703 . The terminal device 700 may further include a camera and a communication unit. The function of each unit is described below.

The camera device is used to collect images of the current environment.

The communication unit is used to communicate with other devices. For example, when the terminal device 700 does not contain a camera, the terminal device 700 may receive images sent by an external camera through the communication unit.

The display unit 701 is used for displaying an interface.

The processing unit 702 is configured to determine the target makeup part, control the camera to collect the image of the target makeup part of the user, and control the display unit 701 to display the collected image of the target makeup part; determine the target makeup and control the display unit 701 to display the target reference model image; and determine makeup guide information according to the image of the target makeup part and the target reference model image displayed by the display unit 701 ; the makeup instruction information is used to instruct the user to apply makeup to the target makeup part displayed by the display unit 701;

The prompting unit 703 is used for prompting the makeup guide information to the user.

In an implementation manner, the processing unit 702 is further configured to: before determining the target makeup part, receive a first instruction, where the first instruction is used to instruct the terminal device to start a makeup guidance function; The first instruction activates the makeup guide function.

In an implementation manner, when the processing unit 702 determines the target makeup part, it is specifically configured to:

Controlling the display unit 701 to display a plurality of makeup parts, and when one of the displayed makeup parts is selected, determine the selected makeup part as the target makeup part; or

The display unit 701 is controlled to display a face image, and when a part in the displayed face image is selected, the selected part is determined as the target makeup part.

In an implementation manner, the processing unit 702 is further configured to: control the display unit 701 to display a makeup effect image, where the makeup effect image is all displayed on the display unit by the user according to the makeup guide information. The image after makeup is applied to the target makeup site.

In an implementation manner, when determining the target reference model image of the target makeup part, the processing unit 702 is specifically configured to: receive a second instruction, where the second instruction is used to instruct to automatically select a reference model image; The second instruction determines the target reference model image from among the stored multiple reference model images corresponding to the target makeup part; or

receiving a third instruction, the third instruction is used to instruct manual selection of a reference model image; controlling the display unit 701 to display a plurality of stored reference model images corresponding to the target makeup part; The selected reference model image is determined as the target reference model image.

In an implementation manner, the processing unit 702 is further configured to: determine that the image of the target makeup part displayed on the display unit 701 is similar to the image of the target reference model displayed on the display unit 701 degree; according to the similarity, determine similarity information;

The prompting unit 703 is further configured to prompt the similarity information to the user.

In an implementation manner, when the prompting unit 703 prompts the user with the makeup guidance information, it is specifically configured to: display the makeup guidance information through the display unit 701; or play the makeup guidance information by voice .

In an implementation manner, the makeup guide information includes at least one of the following items: grooming tools, grooming positions, grooming directions, and precautions during grooming.

Based on the same concept, FIG. 8 shows a terminal device 800 provided by an embodiment of the present application. The terminal device can execute the methods in the above embodiments and examples, and has the functions of the terminal device 700 shown in FIG. 7 . Referring to FIG. 8 , the terminal device 800 includes: a processor 801 , a memory 802 , a display screen 803 , and a transceiver 804 .

The processor 801 is interconnected with the memory 802 , the display screen 803 and the transceiver 804 . Optionally, the processor 801, the memory 802, the display screen 803 and the transceiver 804 can be connected to each other through a bus; the bus can be a peripheral component interconnect (PCI) bus or an extended industry standard structure. (extended industry standard architecture, EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in FIG. 8, but it does not mean that there is only one bus or one type of bus.

Optionally, the terminal device may further include a camera 805 , and the processor 801 may collect an image of the scene where the user is currently located through the camera 805 in the terminal device 800 .

The transceiver 804 is used to communicate and interact with other devices. For example, when the terminal device 800 collects the image of the scene where the user is currently located by using an external camera, the terminal device 800 acquires the image of the scene where the user is currently located by the external camera device through the transceiver 804 . Optionally, the transceiver 804 may be a Bluetooth module, a WiFi module, an RF circuit, or the like.

The processor 801 is configured to implement the methods provided by the foregoing embodiments and examples. For details, reference may be made to the descriptions in the foregoing embodiments, which will not be repeated here.

The display screen 803 is used to display a user interface.

Optionally, the terminal device 800 may further include an audio circuit 806 for receiving and sending voice signals.

The memory 802 is used to store program instructions and data (for example, a reference model image of a makeup part) and the like. Specifically, the program instructions may include program code, which includes instructions for computer operation. The memory 802 may include random access memory (RAM), and may also include non-volatile memory (non-volatile memory), such as at least one disk storage. The processor 801 executes the program stored in the memory 802, and implements the above functions through the above components, thereby finally implementing the methods provided by the above embodiments.

Based on the above embodiments, the embodiments of the present application further provide a computer program, which when the computer program runs on a computer, causes the computer to execute the methods provided by the above embodiments.

Based on the above embodiments, the embodiments of the present application further provide a computer storage medium, where a computer program is stored in the computer storage medium, and when the computer program is executed by a computer, the computer executes the methods provided by the above embodiments.

Based on the above embodiments, an embodiment of the present application further provides a chip, where the chip is used to read a computer program stored in a memory to implement the methods provided by the above embodiments.

Based on the above embodiments, the embodiments of the present application provide a chip system, where the chip system includes a processor for supporting a computer apparatus to implement the functions involved in the terminal device in the methods provided by the above embodiments. In a possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. The chip system may be composed of chips, or may include chips and other discrete devices.

To sum up, the embodiments of the present application provide an information prompting method and a terminal device. In this solution, after the terminal device determines the target makeup part, the image of the user's target makeup part is collected by the camera device, and the image is displayed on the display. The collected image of the target makeup part is displayed in the first display area of the screen; the terminal device determines the target reference model image of the target makeup part, and displays the target reference model image in the second display area of the display screen; The image of the target makeup part and the target reference model image are described, and the makeup guide information for instructing the user to perform makeup treatment on the target makeup part is determined. Therefore, through this technical solution, the terminal device can flexibly provide the user with accurate makeup guidance information according to the situation of the user's own target makeup site, so that the user can modify their own target makeup site according to the makeup guidance information, not only can It can effectively beautify the user's own target makeup parts, and can also improve the user's use experience.

From the description of the above embodiments, those skilled in the art can clearly understand that the embodiments of the present application may be implemented by hardware, firmware, or a combination thereof. When implemented in software, the functions described above may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage medium can be any available medium that a computer can access. Taking this as an example but not limited to: the computer readable medium may include RAM, ROM, electrically erasable programmable read only memory (EEPROM), compact disc read-Only memory (CD- ROM) or other optical disk storage, magnetic disk storage media, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and that can be accessed by a computer. also. Any connection can be appropriately made into a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, Then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, wireless, and microwave are included in the fusing of the pertinent medium. As used in the embodiments of the present application, disks and discs include compact discs (CDs), laser discs, optical discs, digital video discs (DVDs), floppy disks, and Blu-ray discs, wherein Disks usually reproduce data magnetically, while discs use lasers to reproduce data optically. Combinations of the above should also be included within the scope of computer-readable media.

In a word, the above descriptions are merely examples of the present application, and are not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included within the protection scope of this application.

Claims

An information prompting method, characterized in that the method comprises:

The terminal device determines the target makeup part, acquires the image of the target makeup part of the user, and displays the acquired image of the target makeup part in the first display area of the display screen;

The terminal device determines a target reference model image of the target makeup part, and displays the target reference model image in the second display area of the display screen;

The terminal device determines makeup guidance information according to the image of the target makeup part displayed in the first display area and the target reference model image displayed in the second display area, and the makeup guidance information is used for guidance The user applies makeup to the target makeup part displayed in the first display area;

The terminal device prompts the user with the makeup instruction information.
The method according to claim 1, wherein before the terminal device determines the target makeup part, the method further comprises:

The terminal device receives a first instruction, where the first instruction is used to instruct the terminal device to activate a makeup guide function;

The terminal device starts the makeup guide function according to the first instruction.
The method according to claim 1 or 2, wherein determining the target makeup part by the terminal device comprises:

The terminal device displays a plurality of makeup parts on the display screen, and when one of the displayed makeup parts is selected, determines the selected makeup part as the target makeup part; or

The terminal device displays a face image on the display screen, and when a part in the displayed face image is selected, determines the selected part as the target makeup part.
The method according to any one of claims 1-3, wherein the method further comprises:

The terminal device displays a makeup effect image in the third display area of the display screen, where the makeup effect image is the target makeup part displayed in the first display area by the user according to the makeup guide information. Image after makeup.
The method according to any one of claims 1-4, wherein the terminal device determines the target reference model image of the target makeup part, comprising:

The terminal device receives a second instruction, where the second instruction is used to instruct the automatic selection of a reference model image; the terminal device stores a plurality of reference model images corresponding to the target makeup part according to the second instruction, determining the target reference model image; or

The terminal device receives a third instruction, where the third instruction is used to instruct to manually select a reference model image; the terminal device displays a plurality of stored reference model images corresponding to the target makeup part in the second display area ; the terminal device determines the selected reference model image among the displayed multiple reference model images as the target reference model image.
The method according to any one of claims 1-5, wherein the method further comprises:

The terminal device determines the similarity between the image of the target makeup part displayed in the first display area and the image of the target reference model displayed in the second display area;

The terminal device determines similarity information according to the similarity;

The terminal device prompts the similarity information to the user.
The method according to any one of claims 1-6, wherein the terminal device prompts the user for the makeup instruction information, comprising:

The terminal device displays the makeup guide information in the first display area; or

The terminal device plays the makeup guide information by voice.
The method according to any one of claims 1 to 7, wherein the makeup instruction information includes at least one of the following: a modification tool, modification position, modification direction, and precautions during modification.
A terminal device, characterized in that it includes a display screen, one or more processors, and one or more memories;

the one or more memories store one or more computer programs including instructions;

The one or more processors, configured to execute the instructions, implement the following steps:

determining a target makeup part, acquiring an image of the user's target makeup part, and displaying the acquired image of the target makeup part in the first display area of the display screen;

determining a target reference model image of the target makeup part, and displaying the target reference model image in the second display area of the display screen;

Makeup guidance information is determined according to the image of the target makeup part displayed in the first display area and the target reference model image displayed in the second display area, and the makeup guidance information is used to instruct the user on the Putting makeup on the target makeup part displayed in the first display area;

The makeup instruction information is presented to the user.
The terminal device of claim 9, wherein the one or more processors are further configured to:

Before determining the target makeup site, receive a first instruction, where the first instruction is used to instruct the terminal device to activate a makeup guidance function;

The makeup guide function is activated according to the first instruction.
The terminal device according to claim 9 or 10, wherein the one or more processors, when determining the target makeup part, are specifically configured to:

Controlling the display unit to display a plurality of makeup parts, and when one of the displayed makeup parts is selected, determining the selected makeup part as the target makeup part; or

The display unit is controlled to display a face image, and when a part in the displayed face image is selected, the selected part is determined as the target makeup part.
The terminal device according to any one of claims 9-11, wherein the one or more processors are further configured to:

A makeup effect image is displayed in the third display area of the display screen, and the makeup effect image is an image after the user applies makeup to the target makeup part displayed in the first display area according to the makeup guide information .
The terminal device according to any one of claims 9-12, wherein when determining the target reference model image of the target makeup part, the one or more processors are specifically configured to:

receiving a second instruction, where the second instruction is used to instruct the automatic selection of a reference model image; according to the second instruction, the target reference model image is determined from the stored multiple reference model images corresponding to the target makeup part; or

Receiving a third instruction, the third instruction is used to instruct manual selection of a reference model image; controlling the display unit to display a plurality of stored reference model images corresponding to the target makeup part; The selected reference model image is determined as the target reference model image.
The terminal device according to any one of claims 9-13, wherein the one or more processors are further configured to:

determining the similarity between the image of the target makeup part displayed in the first display area and the image of the target reference model displayed in the second display area;

According to the similarity, determine similarity information;

The similarity information is prompted to the user.
The terminal device according to any one of claims 9-14, wherein the one or more processors, when prompting the user with the makeup guide information, are specifically configured to:

displaying the makeup instruction information in the first display area; or

The makeup instruction information is played by voice through a speaker.
The terminal device according to any one of claims 9-15, wherein the makeup guide information includes at least one of the following items: a modification tool, modification position, modification direction, and precautions during modification.
A computer storage medium, characterized in that, a computer program is stored in the computer storage medium, and when the computer program runs on a terminal device, the terminal device is made to execute the execution of any one of claims 1-8. Methods.