CN111325746A

CN111325746A - Skin detection method and electronic equipment

Info

Publication number: CN111325746A
Application number: CN202010183269.3A
Authority: CN
Inventors: 沈浚哲; 刘旭东
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-03-16
Filing date: 2020-03-16
Publication date: 2020-06-23
Also published as: WO2021185210A1

Abstract

The embodiment of the invention provides a skin detection method and electronic equipment, which are applied to the technical field of communication and are used for solving the problems of complex operation and long time consumption when the electronic equipment detects the skin of a user. The method comprises the following steps: acquiring a face image of a shooting object under the condition that the electronic equipment unlocks or shoots the face, calling a skin detection function, and carrying out skin detection on the face image to obtain a skin detection result; and displaying the skin detection result. The embodiment of the invention is applied to the camera to acquire the human face image scene.

Description

Skin detection method and electronic equipment

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a skin detection method and electronic equipment.

Background

With the development of electronic device technology, the frequency of using electronic devices by users is higher and higher, and the frequency of using various applications on electronic devices by users is also higher and higher. For example, the user detects his or her skin quality using an application having a skin quality detection function. Skin type detection is performed on a user, and a face image of the user needs to be acquired.

In the related art, when the electronic device performs skin quality detection, a user needs to enter an interface of a skin detection application program, a photographing function of the electronic device is started by clicking a control button on the application program to acquire a facial image of the user, and then the application program performs skin detection on the acquired facial image.

However, the skin detection method is not only complicated in operation, but also long in time consumption and poor in man-machine interaction performance.

Disclosure of Invention

The embodiment of the invention provides a skin detection method and electronic equipment, and aims to solve the problems of complex operation and long time consumption when the electronic equipment detects the skin of a user.

In order to solve the technical problem, the invention is realized as follows:

in a first aspect, an embodiment of the present invention provides a skin condition detection method, including: acquiring a face image of a shooting object under the condition that the electronic equipment unlocks the face or shoots the face, and calling a skin detection function; performing skin detection on the face image to obtain a skin detection result; and displaying the skin detection result.

In a second aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes an acquisition module, a calling module, a detection module, and a display module; the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring a face image of a shooting object under the condition that the electronic equipment unlocks the face or shoots the face; the calling module is used for calling a skin detection function; the detection module is used for carrying out skin detection on the facial image acquired by the acquisition module to obtain a skin detection result; and the display module is used for displaying the skin detection result obtained by the detection module.

In a third aspect, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a computer program stored on the memory and executable on the processor, and when executed by the processor, the electronic device implements the steps of the skin detection method according to the first aspect.

In a fourth aspect, the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the skin detection method according to the first aspect.

In the embodiment of the invention, when the electronic equipment unlocks or shoots the face, the electronic equipment acquires the face image of the user and calls the skin detection function to carry out the skin detection on the face image, so that the electronic equipment can directly trigger the electronic equipment to use the currently acquired face image of the user to carry out the skin detection under the condition that the user does not sense when any application program calls the shooting function of the electronic equipment or the electronic equipment unlocks, the skin detection process is simplified, and the power consumption of the electronic equipment can be reduced.

Drawings

Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of a skin detection method according to an embodiment of the present invention;

fig. 3 is a schematic view of an interface applied by a skin detection method according to an embodiment of the present invention;

fig. 4 is a second schematic diagram of an interface applied in a skin detection method according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 6 is a second schematic structural diagram of an electronic device according to an embodiment of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that "/" in this context means "or", for example, A/B may mean A or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone.

It should be noted that "a plurality" herein means two or more than two.

It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

It should be noted that, for the convenience of clearly describing the technical solutions of the embodiments of the present invention, in the embodiments of the present invention, words such as "first" and "second" are used to distinguish the same items or similar items with substantially the same functions or actions, and those skilled in the art can understand that the words such as "first" and "second" do not limit the quantity and execution order. For example, the first predetermined condition and the second predetermined condition are for distinguishing different predetermined conditions, and are not for describing a specific order of the predetermined conditions.

In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

The electronic device in the embodiment of the invention can be a mobile terminal device and can also be a non-mobile terminal device. The mobile terminal device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc.; the non-mobile terminal device may be a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, or the like; the embodiments of the present invention are not particularly limited.

The execution subject of the skin detection method provided in the embodiment of the present invention may be the electronic device (including a mobile terminal device and a non-mobile terminal device), or may also be a functional module and/or a functional entity capable of implementing the skin detection method in the electronic device, which may be determined specifically according to actual use requirements, and the embodiment of the present invention is not limited. The following takes an electronic device as an example to exemplarily describe the skin detection method provided by the embodiment of the present invention.

The electronic device in the embodiment of the present invention may be a terminal device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present invention are not limited in particular.

The following describes a software environment to which the skin detection method provided by the embodiment of the present invention is applied, by taking an android operating system as an example.

Fig. 1 is a schematic diagram of an architecture of a possible android operating system according to an embodiment of the present invention. In fig. 1, the architecture of the android operating system includes 4 layers, which are respectively: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).

The application program layer comprises various application programs (including system application programs and third-party application programs) in an android operating system.

The application framework layer is a framework of the application, and a developer can develop some applications based on the application framework layer under the condition of complying with the development principle of the framework of the application.

The system runtime layer includes libraries (also called system libraries) and android operating system runtime environments. The library mainly provides various resources required by the android operating system. The android operating system running environment is used for providing a software environment for the android operating system.

The kernel layer is an operating system layer of an android operating system and belongs to the bottommost layer of an android operating system software layer. The kernel layer provides kernel system services and hardware-related drivers for the android operating system based on the Linux kernel.

Taking an android operating system as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the skin detection method provided in the embodiment of the present invention based on the system architecture of the android operating system shown in fig. 1, so that the skin detection method may operate based on the android operating system shown in fig. 1. Namely, the processor or the electronic device can implement the skin detection method provided by the embodiment of the invention by running the software program in the android operating system.

The skin detection method provided by the embodiment of the invention can be applied to a scene of face unlocking or a scene of shooting of the electronic equipment.

For example, in a scenario of performing face unlocking on an electronic device, when a user wants to know the skin quality of the user, in the related art, the user needs to open a web page capable of performing skin quality detection on the electronic device using a browser, or open an application having a skin quality detection function, and upload or capture a facial image of the user by clicking a control button on the web page or the application, and then the web page or the application performs skin quality detection on the user by using the facial image of the user, and generates a detection result. However, both of the above two methods require manual participation of the user, and the overall process is cumbersome and time-consuming.

To solve the problem, in the technical solution provided in the embodiment of the present invention, when the electronic device performs face unlocking or shooting, the electronic device may acquire a face image of a user, then call a skin detection function of a target application program in the background to perform skin detection on the face image, and display a skin detection result in a negative one-screen page of the electronic device, so that it is not necessary to open a web page or an application program to shoot or upload the face image, and when the user wants to know the skin quality of the user, the user can directly view the skin detection result in the negative one-screen page of the electronic device. Therefore, the method and the device can realize the whole-process user no-perception of the facial image acquisition and the skin detection of the user, improve the skin detection efficiency, save the time of the user and reduce the energy consumption of the electronic equipment during the skin detection.

The skin detection method according to the embodiment of the present invention will be described below with reference to the accompanying drawings.

As shown in fig. 2, a method for detecting skin conditions according to an embodiment of the present invention may include the following steps 201 to 202:

step 201, in the case that the electronic device unlocks the face or shoots the face, the electronic device collects a face image of a shooting object, and calls a skin detection function to perform skin detection on the face image to obtain a skin detection result.

For example, the skin detection function may be a system-integrated skin detection function of the electronic device, or may be a function in a target application installed in the electronic device.

Step 202, the electronic device displays the skin detection result.

For example, the electronic device in the embodiment of the present invention performs a facial unlocking scenario, which may include at least the following two scenarios:

scene 1:

in scenario 1, the electronic device may capture a facial image of the user through the camera when the user uses the facial unlock function to unlock the screen. When the electronic equipment starts the face unlocking function, the electronic equipment starts the camera to collect the face image of the user, and the face image is compared with the face feature of the user stored in the electronic equipment according to the face feature in the face image. Therefore, the electronic equipment in the embodiment of the invention can directly borrow the facial image of the user acquired by the electronic equipment when the screen is unlocked to detect the skin quality without opening an application program or a webpage.

Scene 2:

in scenario 2, the electronic device may capture a facial image of the user through the camera when the user uses the facial unlock function to open a certain function (e.g., face payment verification) of a certain application. Similar to the principle in the scenario 1, when the electronic device acquires the face image of the user for payment verification, the electronic device may directly borrow the face image of the user acquired by the electronic device during payment verification for skin detection without opening an application or a web page.

Illustratively, the shooting scenes in the embodiment of the present invention may include the following scene 3:

scene 3:

in scenario 3, the electronic device may capture an image of the face of the user through the camera while the user is taking a picture using the camera function of the electronic device. Taking the example that the user uses the electronic device to perform self-timer shooting, when the user uses the electronic device to perform self-timer shooting, the electronic device may store a face image shot by the user and perform skin detection on the user by using the face image. Or, when detecting that the shooting preview picture contains a human face, the electronic device can automatically acquire the current preview picture, acquire the face image of the user, and perform skin detection by using the face image.

In this way, when the user uses the shooting function of the electronic device, the electronic device can complete the face image acquisition of the user without the perception of the user and perform skin detection on the face image.

For example, taking the electronic device to perform face unlocking as an example, when the electronic device performs face unlocking, the electronic device may collect a face image of a photographic subject when the face is unlocked, or collect the face image of the photographic subject after the face is successfully unlocked. Taking the electronic device for shooting as an example, when the electronic device shoots a person, the electronic device may collect a face image of the shooting object before shooting, or may directly use the shot image as the face image of the user for skin detection after shooting.

For example, when the electronic device executes step 201, the electronic device may perform skin detection on the facial image when a predetermined trigger condition is satisfied.

In an example, the predetermined trigger condition may be that an unlocking function of the electronic device triggers execution, for example, after the electronic device is successfully unlocked, the skin detection process is triggered.

In another example, the predetermined trigger condition may be that another application installed in the electronic device triggers execution when a shooting function of the electronic device is called.

In another example, the predetermined trigger condition may be that the electronic device monitors whether there is a new image including a person in the album application in real time, and when the electronic device detects that there is a new image including a person in the album application, the electronic device triggers the skin detection function to be executed.

For example, the electronic device triggers the execution of the skin detection function by monitoring whether there is a new image including a person in the album application in real time. When an application program in the electronic equipment calls a shooting function of the electronic equipment to shoot, a shot image is usually generated in an album, so that the electronic equipment can detect whether a new image is added in the album application, and when the new image is detected and a person is contained in the image, the skin detection function is triggered to perform skin detection on the image.

For example, taking the skin quality detection function as a skin quality detection function of a target application in the electronic device as an example, after the electronic device acquires a facial image of a user, the electronic device may call a skin quality detection function interface provided by the target application, and perform skin quality detection by using the facial image. The target application program may be an application program with a skin detection function built in the electronic device system, or may be a third-party application program installed in the electronic device.

Illustratively, the skin detection function interface may also be provided by a system of the electronic device.

For example, the target application may be a background service that is run by the electronic device in real time, or may be an application that is started in the background when the electronic device calls the skin detection function of the target application.

For example, some functions (for example, skin detection functions) provided by the application installed in the electronic device may be opened to other applications through an interface, and the other applications installed in the electronic device may call the interface to implement corresponding functions.

For example, taking as an example that the application 1 installed in the electronic apparatus provides a skin-type detection function interface, the input of the interface is a face image of the user, and the output is a skin-type detection result generated using the face image. When the electronic device performs face unlocking, the face image of the user is acquired, the electronic device may call the skin detection function interface of the application program 1, use the acquired face image as an input of the interface, and obtain a skin detection result generated by the application program 1 according to the face image.

For example, the skin detection result may include: a description of the skin quality of the user and the results of the analysis of the skin quality of the user. Wherein the skin quality description may include at least one of: skin, complexion, number of acne, presence of wrinkles, presence of dark circles under the eyes, blackhead, etc. Wherein, the analysis result may include: for example, the skin quality description shows that the user has a dark eye, so that the electronic device can draw the conclusion that the user is not sleeping enough and has a habit of staying up all night, and can prompt the user to reduce staying up all night and pay attention to rest in the improvement suggestion.

For example, as shown in fig. 3, the display interface is an interface for displaying a skin detection result obtained after the electronic device performs skin detection on the acquired face image of the user. Fig. 3 includes a skin test result interface 30, where the skin test result interface 30 includes an analysis report 31, a last skin test result query button 32, a next skin test result query button 33 (if the currently displayed skin test result is the latest skin test result, the button 33 is in an unavailable state), and a recommended product button 34.

The analysis report 31 is used for displaying the skin quality parameters (including skin quality, skin color, acne number, wrinkles, dark eye circles and blackheads) of the user and the analysis result obtained according to the skin quality parameters, so that the user can know from the analysis report 31 that the skin detection result shows that the user has dark eye circles and has yellow skin color, and according to the result, the situation that the user may stay up to night recently or have insufficient sleep can be obtained, and the user is reminded to ensure sleep and reasonably eat.

The button 32 is used to display the skin test report generated before the current skin test report, so that the user can inquire the skin test report before the current skin test report by clicking the button to know the past skin quality of the user.

The button 33 is used to display the skin test report generated after the current skin test report, so that the user can switch to the next or latest skin test report by clicking the button.

The recommended product button 34 is used to display a reasonable skin care product or food, etc. recommended according to the analysis result after the user clicks, so that the user can click the button to know the product and food suitable for his/her current skin.

Illustratively, the electronic device may further make a comparative analysis result according to the historical skin detection result. For example, if the user has a black eye displayed in the previous skin detection result and does not have a black eye in the current skin detection result, the electronic device accordingly obtains that the user has reduced staying up night, increases the rest time, and can prompt the user to keep a good living habit in the skin detection result.

Optionally, in the embodiment of the present invention, the accuracy of the skin detection result depends on a high-quality face image, and therefore, in order to improve the accuracy of the skin detection result of the user by the electronic device, the electronic device may perform skin detection on the face image of the user when the second predetermined condition is satisfied.

Illustratively, the electronic device performs skin detection on the captured face image of the user when the shooting condition of the electronic device does not satisfy any of the following conditions.

Condition 1:

in the condition 1, the electronic device is in a dark environment, and the face image of the user collected at this time is not clear enough, and the skin color of the user cannot be accurately recognized, so that the face image of the user collected by the electronic device in the dark environment cannot be used as the face image for skin detection.

Condition 2:

in the condition 2, the face image of the user acquired by the electronic device is not complete enough, and at this time, the electronic device performs skin detection on the face image under the condition that the face image is not complete enough, which may cause a deviation of the result. For example, a user may have a pox at the chin due to staying overnight over shift, and the facial image at the chin of the user is not collected due to incompleteness of the facial image, so that the system may consider that the skin quality of the user is good, and thus a detection result that allows the user to pay attention to rest may not be obtained.

Condition 3:

in the condition 3, when the user uses the electronic device to perform self-timer shooting, the beautifying function is turned on, and at this time, the facial image of the user collected by the electronic device cannot truly reflect the skin quality of the user due to beautification, so that the facial image of the user collected by the electronic device when the beautifying function is turned on cannot be used as the facial image for skin detection.

In this way, the electronic device can obtain an accurate skin detection result from the face image of the user acquired under the condition that the condition is met, and provide a correct and reasonable suggestion for the user.

Optionally, in the embodiment of the present invention, taking the skin quality detection function as a skin quality detection function of a target application in an electronic device as an example, in order to make a user more intuitively see a skin quality detection result generated by the electronic device, the electronic device may display the generated skin quality detection result at an obvious position.

For example, if the desktop of the electronic device includes a negative screen page, the step 202 may include the following steps 202 a:

step 202a, the electronic device displays the skin detection result on a negative screen page.

Illustratively, the negative one-screen page is: among the plurality of desktop pages of the electronic device, a page displaying an application icon is distinguished, the page may display information of a corresponding application in the form of a shortcut label or a card, and the negative one-screen page is usually the leftmost page among the plurality of desktop pages of the electronic device.

For example, as shown in fig. 4, the display content of the electronic device on the negative one-screen page is shown, where fig. 4 includes a negative one-screen page 40 of the electronic device and a skin detection result card 41 generated at 23:00 by the electronic device. After the electronic device captures the facial image of the user, the skin detection result is generated at 23:00 from the facial image and is displayed on the negative one-screen page 40 of the electronic device in the form of a card (41 in fig. 4). Since the electronic device recognizes that the user currently has a dark eye circle and the skin color is waxy yellow from the collected facial image of the user, the user is prompted to respond in the skin detection report card 41, and is reminded to take a rest and eat more vitamin C-rich food. Meanwhile, the electronic device may also alert the user to sleep early to ensure adequate sleep when it detects that the user is still using the electronic device very late (e.g., 23: 00).

For example, when the user wants to query the historical skin-type detection results, the electronic device may receive a gesture input of a card (e.g., the skin-type detection report card 41 in fig. 4) on which the user displays the skin-type detection results on the negative one-screen page, and the electronic device displays a target interface of the target application in response to the gesture input. The target interface comprises a current skin detection result of the user and a historical skin detection result.

For example, the historical skin detection result and the corresponding facial image of the user may also be saved in an album of the electronic device in the form of a picture, and the user may view the picture in the album.

Therefore, the electronic equipment displays the skin detection result on the negative one-screen page of the electronic equipment, and a user can conveniently and directly check the skin detection result under the condition that the interface of the target application program is not opened. Meanwhile, when the user wants to inquire the historical skin detection result, the user can jump to the target application to inquire the historical skin detection result by clicking the card.

Alternatively, in the embodiment of the present invention, in order to prevent the electronic apparatus from performing skin detection on users other than the user of the electronic apparatus, causing unnecessary waste of system resources, and generating excessive useless skin detection results, the electronic apparatus may perform skin detection on the acquired face image when the first predetermined condition is satisfied.

Illustratively, the step 201 may include the following steps 201 a:

step 201a, if the electronic device is successfully unlocked, the electronic device calls a skin detection function.

And under the condition that the face of the electronic equipment is unlocked, if the electronic equipment is successfully unlocked, calling a skin detection function.

Therefore, when the electronic equipment is successfully unlocked, the user is the user of the electronic equipment, and unnecessary resource waste of the electronic equipment can be avoided only by performing skin detection on the acquired facial image, so that the power consumption of the electronic equipment is reduced.

Optionally, in the embodiment of the present invention, for example, the skin quality detection function is a skin quality detection function of a target application program in an electronic device, in an operation process of the target application program, the electronic device may directly call the skin quality detection function of the target application program in a background in a scene of face unlocking or shooting.

For example, in step 201, the electronic device invokes the skin condition detection function, which may include the following steps 201 b:

step 201b, in the running process of the target application program, if the electronic device displays the interface of the first application program, after acquiring the facial image of the shooting object, the background calls the skin detection function of the target application program.

For example, after the electronic device acquires the face image of the photographic subject, the target application runs in the background and before the skin detection function of the target application is called in the background.

For example, the first application program may be a photographing application of the electronic device, and may also be another application program capable of invoking a photographing function of the electronic device.

For example, taking the first application program as a chat application as an example, when the user uses the chat application to make a video call with another person or take a self-portrait photo and issue the self-portrait photo to a friend circle, the electronic device triggers the skin detection process to perform skin detection on the acquired facial image of the user.

Illustratively, since the user cannot perceive the skin detection process, in order to prevent privacy leakage of the user, the facial image only includes the face of the user and does not include other parts of the body of the user.

For example, when the electronic device starts a camera for shooting in an application other than the target application, if it is detected that a face image exists in the current shooting preview picture, the face image of the person in the shooting preview picture is acquired. If the acquired face image is the face image of the user of the electronic device, skin detection is performed on the face image.

Therefore, when other application programs call the shooting function of the electronic equipment, the electronic equipment can detect the skin of the user under the condition that the user does not sense the skin, so that the skin detection process is simplified, and the waiting time of the user is saved.

Optionally, in an embodiment of the present invention, the skin detection function is a skin detection function of the target application. The user can not only inquire the skin detection result of the user through the card which is displayed with the skin detection result on the negative screen page of the electronic equipment, but also inquire the skin detection result in the target application program.

For example, before the step 202, the embodiment of the present invention may further include the following steps 202a1 and 202a 2:

step 202a1, the electronic device displays the interface of the target application program.

Step 202a2, the electronic device receives a first input from a user on the interface.

Illustratively, the step 202 may include the following steps 202a 3:

step 202a3, in response to the first input, the electronic device presents a skin detection result of the user on the interface.

Therefore, the user can not only inquire the skin detection result through the card on the negative screen page of the electronic device, but also inquire the skin detection result on the interface of the target application program.

According to the skin detection method provided by the embodiment of the invention, the electronic equipment can acquire the facial image of the user when any application program calls the shooting function of the electronic equipment or the electronic equipment is unlocked by acquiring the facial image of the user when the electronic equipment unlocks or shoots the face, and calling the skin detection function to detect the skin of the facial image, so that the skin detection can be performed on the user under the condition that the user does not sense the skin. The detection result is displayed on a negative screen page of the electronic equipment, so that a user can conveniently inquire the skin detection result without entering a target application program interface. The prompt information contained in the skin detection result can also remind the user to adopt a proper method to improve the skin. Therefore, the skin detection method provided in real time not only simplifies the skin detection process and brings more humanized experience to users, but also can reduce the power consumption of the electronic equipment.

In the embodiment of the present invention, the skin condition detection methods shown in the above-mentioned method drawings are all exemplarily described with reference to one drawing in the embodiment of the present invention. In specific implementation, the skin detection method shown in each method drawing can also be implemented by combining any other drawing which can be combined and is illustrated in the above embodiments, and details are not described here.

Fig. 5 is a schematic diagram of a possible structure of an electronic device according to an embodiment of the present invention, and as shown in fig. 5, the electronic device 600 includes: the system comprises a collection module 601, a calling module 602, a detection module 603 and a display module 604, wherein:

the capturing module 601 is configured to capture a face image of a shooting object when the electronic device 600 performs face unlocking or shooting.

And an invoking module 602, configured to invoke a skin detection function.

The detecting module 603 is configured to perform skin detection on the face image acquired by the acquiring module 601 to obtain a skin detection result.

A display module 604, configured to display the skin detection result obtained by the detection module 603.

Optionally, the invoking module 602 is specifically configured to, under the condition that the electronic device 600 performs facial unlocking, invoke a skin detection function if the unlocking is successful.

Optionally, the desktop of the electronic device 600 further includes a negative one-screen page; the display module 604 is specifically configured to display the skin detection result on a negative one-screen page.

Optionally, the invoking module 602 is specifically configured to, in the running process of the target application, invoke the skin detection function of the target application in the background after acquiring the facial image of the photographic subject if the electronic device 600 displays the interface of the first application.

Optionally, the electronic device 600 further comprises: a display module 605 and a receiving module 606; wherein the skin detection function is a skin detection function of a target application; a display module 605, configured to display an interface of a target application; a receiving module 606, configured to receive a first input of a user on an interface displayed by the display module 605; the presenting module 604 is specifically configured to present the skin detection result on the interface in response to the first input received by the receiving module 606.

It should be noted that, as shown in fig. 5, modules that are necessarily included in the electronic device 600 are illustrated by solid line boxes, such as a calling module 602, a detecting module 603, and a presenting module 604; modules that may or may not be included in the electronic device 600 are illustrated with dashed boxes as a display module 605 and a receiving module 606.

According to the electronic equipment provided by the embodiment of the invention, through the mode that the facial image of the user is collected and the skin detection function is called to carry out the skin detection on the facial image when the electronic equipment carries out the facial unlocking or shooting, the electronic equipment can acquire the facial image of the user when any application program calls the shooting function of the electronic equipment or the electronic equipment carries out the unlocking, so that the skin detection can be carried out on the user under the condition that the user does not sense. The detection result is displayed on a negative screen page of the electronic equipment, so that a user can conveniently inquire the skin detection result without entering a target application program interface. The prompt information contained in the skin detection result can also remind the user to adopt a proper method to improve the skin. Therefore, the skin detection method provided in real time not only simplifies the skin detection process and brings more humanized experience to users, but also can reduce the power consumption of the electronic equipment.

The electronic device provided by the embodiment of the present invention can implement each process implemented by the electronic device in the above method embodiments, and is not described herein again to avoid repetition.

Fig. 6 is a schematic diagram of a hardware structure of an electronic device 100 for implementing various embodiments of the present invention, where the electronic device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, power supply 111, and camera assembly 112. Those skilled in the art will appreciate that the configuration of electronic device 100 shown in fig. 6 does not constitute a limitation of the electronic device, and that electronic device 100 may include more or fewer components than shown, or combine certain components, or a different arrangement of components. The camera assembly 112 includes a camera. In the embodiment of the present invention, the electronic device 100 includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal device, a wearable device, a pedometer, and the like.

The camera assembly 112 is used for acquiring a facial image of a shooting object under the condition that the electronic equipment is unlocked or shoots a face; and the processor 110 is configured to invoke a skin detection function after the camera assembly 112 acquires the face image of the photographic subject, and perform skin detection on the face image to obtain a skin detection result.

A display unit 106, configured to display the skin detection result obtained by the processing unit 110.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.

The electronic device 100 provides wireless broadband internet access to the user via the network module 102, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the electronic apparatus 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.

The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.

The electronic device 100 also includes at least one sensor 105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the electronic device 100 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus 100. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 6, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the electronic device 100, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the electronic device 100, and is not limited herein.

The interface unit 108 is an interface for connecting an external device to the electronic apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 100 or may be used to transmit data between the electronic apparatus 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the electronic device 100, connects various parts of the entire electronic device 100 using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the electronic device 100. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The electronic device 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

In addition, the electronic device 100 includes some functional modules that are not shown, and are not described in detail herein.

Optionally, an embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor 110, where the computer program, when executed by the processor, implements each process of the above-mentioned skin quality detection method embodiment, and can achieve the same technical effect, and details are not repeated here to avoid repetition.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned skin quality detection method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling an electronic device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A skin detection method applied to an electronic device, the method comprising:

acquiring a face image of a shooting object under the condition that the electronic equipment unlocks or shoots a face, calling a skin detection function, and carrying out skin detection on the face image to obtain a skin detection result;

and displaying the skin detection result.

2. The method of claim 1, wherein in the event that the electronic device is face unlocked, said invoking a skin detection function comprises:

and if the unlocking is successful, calling a skin detection function.

3. The method of claim 2, wherein the desktop of the electronic device comprises a negative one-screen page;

the displaying the skin detection result comprises:

and displaying the skin detection result on the negative one-screen page.

4. The method of claim 1, wherein invoking a skin-type detection function comprises:

in the running process of a target application program, if the electronic equipment displays an interface of a first application program, after the facial image of the shooting object is collected, a background calls a skin detection function of the target application program.

5. The method of claim 1, wherein the skin detection function is a skin detection function of a target application; before said presenting said skin test result, said method further comprises:

displaying an interface of the target application program;

receiving a first input of a user on the interface;

the displaying the skin detection result comprises:

in response to the first input, presenting the skin detection result on the interface.

6. The electronic equipment is characterized by comprising an acquisition module, a calling module, a detection module and a display module;

the acquisition module is used for acquiring a facial image of a shooting object under the condition that the electronic equipment unlocks the face or shoots the face;

the calling module is used for calling a skin detection function;

the detection module is used for carrying out skin detection on the facial image acquired by the acquisition module to obtain a skin detection result;

the display module is used for displaying the skin detection result obtained by the detection module.

7. The electronic device of claim 6,

the calling module is specifically configured to, under the condition that the electronic device performs facial unlocking, call a skin detection function if the electronic device succeeds in unlocking.

8. The electronic device of claim 7, wherein a desktop of the electronic device comprises a negative one-screen page;

the display module is specifically configured to display the skin detection result on the negative one-screen page.

9. The electronic device of claim 6,

the calling module is specifically configured to, in the running process of a target application program, call a skin detection function of the target application program in a background after acquiring the facial image of the photographic subject if the electronic device displays the interface of the first application program.

10. The electronic device of claim 6, further comprising: a display module and a receiving module; the skin detection function is a skin detection function of a target application program;

the display module is used for displaying the interface of the target application program;

the receiving module is used for receiving a first input of a user on the interface displayed by the display module;

the display module is specifically configured to display the skin detection result on the interface in response to the first input received by the receiving module.

11. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the skin condition detection method according to any one of claims 1 to 5.