CN109819114B

CN109819114B - Screen locking processing method and device, electronic equipment and storage medium

Info

Publication number: CN109819114B
Application number: CN201910126612.8A
Authority: CN
Inventors: 许雷; 彭彬绪; 张帆; 于志兴; 黄頔
Original assignee: Beijing Sensetime Technology Development Co Ltd
Current assignee: Beijing Sensetime Technology Development Co Ltd
Priority date: 2019-02-20
Filing date: 2019-02-20
Publication date: 2021-11-30
Anticipated expiration: 2039-02-20
Also published as: CN109819114A

Abstract

The embodiment of the invention discloses a screen locking processing method and device, electronic equipment and a storage medium. The method comprises the following steps: forbidding a screen locking function of a screen locking component, wherein the screen locking component is a functional component for executing the screen locking function in an operating system of the electronic equipment; if the screen locking condition is met, sending a screen locking instruction to a face screen locking application installed in the electronic equipment; replacing a screen locking component with the face screen locking application to execute the screen locking operation of the electronic equipment; and if the unlocking condition is met, the face screen locking application triggers the face image acquisition module to acquire a face image and executes face unlocking operation according to the acquired face image.

Description

Screen locking processing method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of information technologies, and in particular, to a method and an apparatus for processing a lock screen, an electronic device, and a storage medium.

Background

With the development of electronic technology, electronic devices have become more powerful, for example, electronic devices are used for network payment, electronic devices are used for social contact and/or work, and thus, a great amount of confidential information exists in electronic devices, and electronic devices can perform various security operations related to security problems. Therefore, in order to improve the use safety of the electronic device and the safety of information stored in the electronic device, many safety technologies, such as a screen lock of the electronic device, are introduced. The existing unlocking mode of the lock screen comprises the following steps: fingerprint unlocking, graph unlocking, password unlocking, face unlocking and other unlocking modes. But face unlocking is generally only applicable to newer devices and cannot be used by old devices.

Disclosure of Invention

Embodiments of the present invention are intended to provide a method and an apparatus for processing screen lock, an electronic device and a storage medium,

the technical scheme of the invention is realized as follows:

a screen locking processing method comprises the following steps:

forbidding a screen locking function of a screen locking component, wherein the screen locking component is a functional component for executing the screen locking function in an operating system of the electronic equipment;

if the screen locking condition is met, sending a screen locking instruction to a face screen locking application installed in the electronic equipment;

replacing a screen locking component with the face screen locking application to execute the screen locking operation of the electronic equipment;

and/or

And if the unlocking condition is met, the face screen locking application triggers the face image acquisition module to acquire a face image and executes face unlocking operation according to the acquired face image.

Based on the above scheme, if the unlocking condition is satisfied, the face lock screen application triggers the face image acquisition module to acquire the face image and executes the face unlocking operation according to the acquired face image, including:

carrying out face detection on the face image to obtain a first detection characteristic;

determining whether the face verification passes according to the matching result of the first detection feature and a preset feature;

and if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application and displays a system interface covered by the screen locking interface or other applications of application interfaces of other applications.

Based on the above scheme, the method further comprises:

if the specified characteristics are not successfully detected in the currently acquired face image, outputting a first prompt;

and after the first prompt is output, the face screen locking application controls the face image acquisition module to acquire the face image again.

Based on the scheme, the first prompt is used for prompting the adjustment of the acquisition object and the relative position between the human face image acquisition module.

Based on the above scheme, the method further comprises:

the face screen locking application outputs a second prompt on a screen locking interface;

the face image acquisition module acquires a plurality of face images;

determining whether the change rule of the preset part of the acquisition object is matched with the prompting content of the second prompt or not according to the plurality of face images;

if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application, and the method comprises the following steps:

and if the face verification is passed and the change rule is matched with the prompt content, closing a screen locking interface provided by the face screen locking application.

Based on the above scheme, the method further comprises:

and if the face verification fails or the change rule is not matched with the prompt content, the face screen locking application maintains the display of the screen locking interface.

Based on the above scheme, the method further comprises:

installing the face screen locking application in the electronic equipment based on the installation package;

after the face screen locking application is installed, a prohibition request for prohibiting the screen locking component is sent to the operating system;

the screen locking function of the screen locking component is forbidden, and the screen locking function comprises the following steps:

and after the operating system receives the prohibition request, prohibiting the screen locking function of the screen locking component.

Based on the above scheme, after the operating system receives the prohibition request, prohibiting the screen locking function of the screen locking component, including:

after a prohibition request is received, displaying prompt information for prohibiting the screen locking assembly;

detecting a user operation acting on the prompt message;

and if the user operation confirms that the screen locking function of the screen locking assembly is forbidden, the screen locking function of the screen locking assembly is forbidden.

Based on the above scheme, the method further comprises:

and in the process of collecting the face image or unlocking the face, displaying promotion information in at least partial area of the face unlocking interface.

Based on the above scheme, the method further comprises:

acquiring second detection characteristics based on the face image detection, and identifying the identity information of the acquired object;

and determining the popularization information in which the acquisition object is interested based on identity information, wherein the number of the second detection features is less than the number of features required to be detected for unlocking the human face.

A lock screen processing apparatus comprising:

the device comprises a forbidding module, a screen locking module and a display module, wherein the forbidding module is used for forbidding the screen locking function of a screen locking component, and the screen locking component is a functional component for executing the screen locking function in an operating system of the electronic equipment;

the sending module is used for sending a screen locking instruction to a face screen locking application installed in the electronic equipment if the screen locking condition is met;

the execution module is used for replacing a screen locking component with the face screen locking application and executing the screen locking operation of the electronic equipment; and/or the unlocking module is used for triggering the face image acquisition module to acquire the face image and executing face unlocking operation according to the acquired face image if the unlocking condition is met.

Based on the scheme, the unlocking module is specifically used for carrying out face detection on the face image to obtain a first detection characteristic; determining whether the face verification passes according to the matching result of the first detection feature and a preset feature; and if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application and displays a system interface covered by the screen locking interface or other applications of application interfaces of other applications.

Based on the above scheme, the apparatus further comprises:

the first output module is used for outputting a first prompt if the specified characteristics are not successfully detected in the currently acquired face image;

and the first acquisition module is used for controlling the face image acquisition module to acquire the face image again by the face screen locking application after the first prompt is output.

Based on the above scheme, wherein the first prompt is used for prompting the adjustment of the acquisition object and the relative position between the acquisition object and the face image acquisition module.

Based on the above scheme, the apparatus further comprises:

the second output module is used for outputting a second prompt by the face screen locking application in a screen locking interface;

the second acquisition module is used for acquiring a plurality of face images by the face image acquisition module;

the matching module is used for determining whether the change rule of the preset part of the acquired object is matched with the prompting content of the second prompt or not according to the plurality of face images;

the unlocking module is specifically used for closing a screen locking interface provided by the human face screen locking application if the human face passes the verification and the change rule is matched with the prompt content.

Based on the above scheme, the apparatus further comprises:

and the maintaining module is used for maintaining the display of the screen locking interface by the face screen locking application if the face verification fails or the change rule is not matched with the prompt content.

Based on the above scheme, the apparatus further comprises:

the downloading module is used for downloading the installation package of the face screen locking application;

the installation module is used for installing the face screen locking application in the electronic equipment based on the installation package;

the request module is used for sending a prohibition request for prohibiting the screen locking component to the operating system after the face screen locking application is installed;

the prohibiting module is specifically configured to prohibit a screen locking function of the screen locking component after the operating system receives the prohibition request.

Based on the scheme, the prohibition module is specifically configured to display a prompt message for prohibiting the screen locking component after receiving a prohibition request; detecting a user operation acting on the prompt message; and if the user operation confirms that the screen locking function of the screen locking assembly is forbidden, the screen locking function of the screen locking assembly is forbidden.

Based on the above scheme, the apparatus further comprises:

and the display module is used for displaying promotion information in at least part of area of the face unlocking interface in the process of acquiring the face image or unlocking the face.

Based on the above scheme, the apparatus further comprises:

the identification module is used for acquiring second detection characteristics based on the face image detection and identifying the identity information of the acquired object;

and the determining module is used for determining the popularization information in which the acquisition object is interested based on the identity information, wherein the number of the second detection features is less than the number of the features required to be detected for unlocking the human face.

An electronic device, comprising:

an image acquisition module;

a memory;

and the processor is connected with the image processing module and the memory and is used for controlling the image acquisition of the image acquisition module by executing the computer executable instruction stored in the memory and realizing the screen locking processing method provided by any one of the technical schemes.

A computer storage medium having stored thereon computer-executable instructions; after the computer executable instruction is executed by the processor, the screen locking processing method provided by any one of the above technical schemes can be realized.

According to the technical scheme provided by the embodiment of the invention, the screen locking function of a screen locking component of an operating system or the default installation of the screen locking component of equipment before delivery can be replaced by the face screen locking application, so that the screen locking and face unlocking of the electronic equipment can be carried out by using the face screen locking application; so, even if do not have the electronic equipment of people's face lock screen ability itself, through the installation people's face lock screen application also can realize lock screen and people's face unblock to increase and richened electronic equipment's ability, promoted electronic equipment's intelligence and user's equipment and used experience.

Drawings

Fig. 1 is a schematic flow chart of a screen locking processing method according to an embodiment of the present invention;

fig. 2 is a schematic view of a face unlocking operation of the face screen locking application according to the embodiment of the present invention;

fig. 3 is a schematic flowchart of another screen locking processing method according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a screen locking processing apparatus according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solution of the present invention is further described in detail with reference to the drawings and the specific embodiments of the specification.

As shown in fig. 1, the present embodiment provides a screen locking processing method, including:

step S110: forbidding a screen locking function of a screen locking component, wherein the screen locking component is a functional component for executing the screen locking function in an operating system of the electronic equipment;

step S120: if the screen locking condition is met, sending a screen locking instruction to a face screen locking application installed in the electronic equipment;

step S130: replacing a screen locking component with the face screen locking application to execute the screen locking operation of the electronic equipment; and/or, step S140: and if the unlocking condition is met, the face screen locking application triggers the face image acquisition module to acquire a face image and executes face unlocking operation according to the acquired face image.

The screen locking processing method provided by the embodiment can be applied to various electronic devices, for example, terminal devices such as a mobile phone, a tablet computer, a wearable device, or a vehicle-mounted device.

The operating system of the electronic device is provided with a screen locking component with a screen locking function, and the screen locking component can be a Software Development Kit (SDK) of the operating system or a screen locking component installed by default of the operating system. In summary, the screen locking function disabled in step S110 may be an original screen locking function of the electronic device. Here, the disabling of the lock screen function of the lock screen assembly may include: and when the screen locking function is deactivated, the screen locking assembly does not perform screen locking and unlocking processing on the electronic equipment any more. Deactivating the lock screen function herein includes, but is not limited to, deactivating the lock screen function or disabling the lock screen function.

In this embodiment, a screen locking process of the electronic device is performed by using a human face screen locking application instead of a screen locking component. The face screen locking application here may be: the electronic device downloads a screen locking application which is specially used for locking the screen of the electronic device from a server (for example, an application mall server), and the face screen locking application is an application which utilizes a face recognition technology to unlock the screen.

The face screen locking application is installed in a running environment built by an operating system of the electronic equipment, but is independent of the operating system. And the face screen locking application performs information interaction with the face screen locking application through an Application Programming Interface (API) which is opened to the outside by an operating system.

For example, in some embodiments, if the screen locking component that is provided by the operating system itself or installed by default is at least partially embedded in the kernel space of the operating system, an operation signal of the screen locking operation or the unlocking operation detected by a sensor or a key connected to the operating system may be directly obtained, where the operation signal may be a basic input/output signal (GPIO) or the like detected by the sensor, and thus, signals of various sensors detected by the operating system are not transmitted to the screen locking component through an external API. In still other embodiments, the screen locking component may be a data interaction with the operating system through an internal API within the operating system (an API that is not open to the outside). Such an internal API is an API that cannot be used by an application newly installed in an electronic device by a user if the electronic device has no specific authority after shipment.

The screen locking component is installed in the operating system when leaving a factory, and the manufacturer has the specific authority and can obtain the relevant information of the internal API, so that the relevant information of the internal API can be associated with the screen locking component based on the known relevant information of the internal API when the screen locking component is installed, and the screen locking component can complete information interaction with the operating system through the internal API.

In some embodiments, the operating system further provides external APIs that are open to the outside, and these external APIs can be used for data interaction with other applications when the user installs these applications in the electronic device. For example, in this embodiment, the human face screen locking application performs data interaction with the operating system through the API that is open to the outside by the operating system. And the human face screen locking application can perform data interaction with the operating system through the external API through the operating system.

In other embodiments, the screen locking application may further perform information interaction with the operating system through an API inside the operating system based on the specific permission.

For example, when the screen locking application is installed, the application server of the screen locking application obtains the specific permission of the electronic device through information interaction with the device platform of the electronic device, so that in the installation process of the screen locking application, the related information of the internal API can be requested to the operating system of the electronic device based on the permission information of the specific permission obtained from the application server, and the association between the internal API and the application server is established, so that information interaction is performed between the internal API and the operating system in the subsequent screen locking and unlocking processes. Further, the internal API may be an internal API used by a lock screen component native within the operating system. Further, during the installation process of the screen locking application, the relevant information of the internal API of the screen locking component for communicating with the operating system is obtained based on the specific authority (e.g., root authority), and the relevant information of the internal API is added to the registry of the screen locking component, so that information interaction can be performed with the operating system through the relevant information of the internal API. In addition, the screen locking application can also request the operating system to modify the registry of the screen locking component and delete the relevant information of the internal API in the registry of the screen locking component, and as the relevant information of the internal API in the registry of the screen locking component is deleted, the screen locking component cannot perform information interaction with the operating system, which is equivalent to deactivating the screen locking component, so that the screen locking application can be naturally used for replacing the screen locking component to perform screen locking and unlocking of the equipment. The above is merely an example, and the specific implementation process is not limited to the above example.

In this embodiment, the face screen locking application is an application program available for downloading and installation; therefore, even if the old mobile phone is used, the user can download and install the face screen locking application, and the face screen locking processing is realized based on the original hardware resources of the old electronic equipment (for example, the old mobile phone). For example, a monocular camera of an old electronic device is used for acquiring a planar face image. The monocular camera here is one kind of face image acquisition module, and this face image acquisition module still can be for two mesh cameras etc. generally can be the leading camera of electronic equipment such as cell-phone. The front camera can be a camera which is positioned on the same surface of the electronic equipment with the display surface of the screen.

In summary, in this embodiment, if an electronic device does not originally have a face screen locking function, but after the face screen locking application is installed, the electronic device can have the face screen locking function. For example, the original screen locking functions correspond to unlocking modes including but not limited to slide unlocking, fingerprint unlocking, graphic unlocking and/or password unlocking. The sliding unlocking includes but is not limited to: performing sliding unlocking according to a sliding track displayed by the electronic equipment; the image unlocking includes but is not limited to displaying a plurality of touch points, and obtaining a sliding image formed by sliding operation connecting the touch points for unlocking.

In this embodiment, the condition of satisfying the lock screen includes at least one of the following:

the user operation is not detected within a first preset time length, and the screen locking condition is determined to be met;

and if the voice call or the multimedia information playing is not carried out within the second preset time length and the user operation is not detected, determining that the screen locking condition is met. The first preset time length is the same as or different from the second preset time length;

a screen locking operation input by the user, for example, a screen locking operation applied to a specific key of the electronic device, is detected.

And when the screen locking condition is met, determining that screen locking is required. If the screen locking condition is met, the screen of the electronic equipment needs to be locked, so that the touch screen of the electronic equipment can only detect the operation related to the screen locking operation, and other operations are shielded. For example, the human face lock screen generates and displays a lock screen interface, and the lock screen interface covers a system interface provided by the operating system or an application interface provided by other applications, so that other interfaces are covered and a user can only observe the lock screen interface; if the operations such as sliding and clicking of the touch screen are detected to be irrelevant to screen unlocking, the operations are shielded by the electronic equipment.

For example, detecting a touch operation acting on a screen locking interface, determining a touch coordinate of the touch operation, and reporting the touch coordinate to a face screen locking application; the face screen locking application determines whether the touch coordinates are preset unlocking operation or not, and if the touch coordinates are not the preset unlocking operation, the screen locking state of the electronic equipment is maintained; and if the unlocking operation is the preset unlocking operation, unlocking the screen, closing the screen locking interface by the face screen locking application, and displaying a system interface of an operating system or an application interface of other applications covered or hidden by the screen locking interface. The system interface may include: the desktop of the operating system may be an interface on which application icons of various applications are displayed.

For another example, an internal motion sensor of the electronic device is used to detect a motion trajectory of the electronic device, and the motion trajectory is matched with a predetermined trajectory corresponding to the unlocking condition, and if the matching is successful, the unlocking condition is considered to be satisfied.

For another example, a relative distance between a human body and the electronic device is detected by an infrared sensor and a distance sensor in the electronic device, and if the relative distance is less than a distance threshold, it is considered that the unlock condition is satisfied.

In summary, there are many ways to determine whether the current state of the electronic device satisfies the unlocking condition, and the specific implementation is not limited to any one of the above.

In some embodiments, if the screen locking condition is met and the screen turn-off condition is met, the screen of the electronic device is controlled to turn off, and the electronic device is switched from the first operating state to the second operating state. And the power consumption of the electronic equipment in the second working state is lower than that in the first working state.

In some embodiments, when the electronic device is in the first operating state, the function of the electronic device that is turned on is redundant with the function of the electronic device in the second operating state. For example, in the second operating state, only the function related to the screen unlocking can be started, and in the first operating state, the electronic device can start other functions besides the screen unlocking function, such as a positioning function and the like.

In still other embodiments, the operating frequency of the electronic device (e.g., the main frequency of a Central Processing Unit (CPU)) is higher when the electronic device is in the first operating state than when the electronic device is in the second operating state.

In some further embodiments, the number of applications that are maintained in operation when the electronic device is in the first operating state is greater than the number of applications that are maintained in operation when the electronic device is in the second operating state. For example, in the second operating state, the electronic device may only maintain the operating state of the face lock screen application, and in the first operating state, the electronic device may maintain the operating states of one or more applications other than the face lock screen application. If the number of running applications is larger, the energy consumption is larger.

In summary, the first operating state is a high energy consumption state, and the second operating state is a low energy consumption state.

If the unlocking condition is met in the step S140, the face screen locking application triggers the image acquisition module to acquire a face image, and performs a face unlocking operation according to the acquired face image, at this time, since the screen locking function of the screen locking component is prohibited, the face screen locking application replaces the screen locking component to perform a screen locking process of the electronic device, so that the face screen locking application controls the face image acquisition module to trigger the face image acquisition module to acquire the face image, and performs a screen locking verification.

It is worth noting that: in this embodiment, the unlocking of the screen locking application is not limited to the unlocking of the screen locking of the electronic device by the screen locking application. For example, the electronic device may be locked with the screen locking component and unlocked with a screen locking application of the electronic device. Therefore, one of the steps S130 and S140 may be performed.

In this embodiment, after the face lock screen application is installed, the authorization to use the face image acquisition module needs to be obtained, and an information transmission channel between the face lock screen application and the face image acquisition module can be established, so that if the face lock screen application finds that an unlocking condition is met, an acquisition instruction can be sent to the face image acquisition module through the information transmission channel; and after the face image acquisition module receives the acquisition instruction, the face image acquisition module starts face image acquisition operation. If the electronic equipment is in a second working state at present, and the face image acquisition module is possibly in a dormant state, the acquisition instruction can also be used as a wake-up instruction of the face image acquisition module at this moment; and the face image acquisition module automatically enters a face image acquisition state after being awakened, and starts to acquire the face image.

In some embodiments, the information transmission channel may include: the API directly connected between the face image acquisition module and the face screen locking application establishes a special channel between the face image acquisition module and the face screen locking application, and the special channel can be used for interacting any information between the face image acquisition module and the face screen locking application, such as the acquisition instruction and the face image acquired by the face image acquisition module.

In other embodiments, instructions or data formed by the face lock screen application and middleware run by a processing chip of the face image acquisition module may all perform information interaction through a system bus of an electronic device, and if an address of the face image acquisition module is written into the face lock screen application, it may also be considered that an information transmission channel between the face lock screen application and the face image acquisition module is established.

The unlocking condition being satisfied includes at least one of:

detecting an unlocking operation acting on an unlocking key, for example, a pressing operation acting on a home key or a side key of the electronic device;

for example, a motion sensor is installed in the electronic device, and may detect a motion trajectory of the electronic device, and if the motion trajectory is a motion trajectory for a user to trigger unlocking, which is set by the user, the unlocking condition may be satisfied.

When the operating system of the electronic equipment in the second working state detects the unlocking operation and can be considered to meet the unlocking condition, a trigger message can be generated and sent to the face screen locking application through an external API (application program interface), and thus the face screen locking application knows that the unlocking condition is met currently; and sending an acquisition instruction to a face image acquisition module based on the trigger message.

The executing, by the face lock screen application, a face unlock operation according to the acquired face image may include:

and the face screen locking application identifies the face in the face image, and if the face is identified to be used for screen unlocking, the screen is unlocked. In summary, there are various ways of unlocking the human face, which are not limited to this.

If the electronic equipment is in a screen-off state before unlocking, the electronic equipment can lighten the screen while meeting the unlocking condition. Further, if the electronic device is in the second working state before being unlocked, the electronic device may be switched to the first working state when an unlocking condition is satisfied or after the face is unlocked.

In some embodiments, as shown in fig. 2, the step S140 may include:

step S141: carrying out face detection on the face image to obtain a first detection characteristic;

step S142: determining whether the face verification passes according to the matching result of the first detection feature and a preset feature;

step S143: and if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application and displays a system interface covered by the screen locking interface or an application interface of other applications.

Specifically, the step S143 may include: if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application; after the lock screen interface is closed, the operating system provides a system interface display below the lock screen interface or an application interface display provided by other applications.

For example, face features are extracted from the face image using various face recognition models, which may be deep learning models and/or machine learning models, and the extracted features are referred to herein as first detection features.

The first detected feature includes, but is not limited to, facial features that may include at least one of:

the shape characteristics of the five sense organs;

distribution characteristics between the five sense organs, e.g., the spacing between the eyebrows and eyes, the spacing between the nose and lips, etc.;

contour features of the face, e.g., facial shape;

the size characteristics of the five sense organs, for example, the size of the eye.

In summary, the facial features may be various types of facial features that characterize the identity of a legitimate user.

The detection of the facial features may include:

detecting key points of the face;

determining the facial features based on the facial keypoints.

For example, the key points of the two eyes are detected, and the relative position between the two eyes is determined based on the key points of the two eyes, wherein the relative position is one of the human face features.

Matching the first detection characteristic with a preset characteristic to obtain a matching result; and determining whether the face verification is passed or not based on the matching result. For example, whether the face verification is passed or not is determined according to the matching degree corresponding to the matching result, for example, the face verification can be considered to be passed when the matching degree reaches a preset threshold value, otherwise, the face verification can be considered to be different.

For example, M first detection features are extracted from the face image, then the M first detection features are respectively matched with N preset features, if S first detection features are successfully matched with the N preset features, it is determined that the face verification is passed, otherwise, the face verification is considered to be different. The N and M may be positive integers, for example, the values of N and M may be equal or different.

In some embodiments, because the face image acquisition makes the acquired face image unclear due to the acquisition environment, the movement of the electronic device, or the movement of the acquisition object, or due to the problem of the acquisition angle, when the face features of some acquisition objects are no longer within the acquisition angle of the face image acquisition module, the face image is not directly discarded, but face recognition is continuously performed based on the face image, N first detection features are not acquired through the face recognition, only M first detection features smaller than N are acquired, and if M is greater than a certain number threshold, the face verification is started, on one hand, the number of times of failure in unlocking can be reduced, and on the other hand, the problem of low efficiency in face unlocking caused by repeated detection can be reduced. The number threshold may be N/2, etc.

In the process of continuing to perform face recognition, in order to further reduce time delay, the face screen locking application may synchronously control the face image acquisition device to continue to acquire face images. If the previous face image is not subjected to face verification, the prompt information of face unlocking failure is not directly output, and the face verification is carried out by using the currently acquired face image. In this embodiment, as long as the collected face image satisfying the predetermined definition condition and within the predetermined viewing angle does not pass the face verification, the prompt information of the face result failure is output.

If the face verification passes, the face screen locking application closes the screen locking interface of the face screen locking application, so that the display screen does not continue to display the screen locking interface, but a system interface provided by an operating system displays a system interface, and the system interface here may include: a desktop or system message display interface of the operating system.

The other application may be any other application besides the face lock screen application, for example, an application interface of a video playing application, an audio playing application, a social application, a payment application, or a shopping application.

The other applications may be applications corresponding to application interfaces displayed last and seen by a user before the electronic device enters the screen locking state.

In order to realize seamless docking, namely once the screen locking interface is closed, switching of a display screen to a system interface or an application interface of other applications is completed under the condition that a user cannot perceive the display screen, when the electronic equipment meets an unlocking condition, the electronic equipment extracts cache data before entering a screen locking state, and the system interface or the application interface is built according to the cache data. For example, the cache data may be system running state data, desktop data, or application running state data of a system stored before a screen locking state of a specific register of the electronic device is entered, and the data may be used to quickly establish the system interface or the application interface, so that the screen locking interface is closed and the system interface or the application interface covered by the screen locking interface is displayed.

Of course, in some cases, the face detection may also detect M first detected features greater than N.

In some embodiments, the method further comprises:

The first prompt can be a prompt for prompting to acquire the face image again or a prompt for prompting to perform unlocking verification of the screen again. For example, in some embodiments, the first prompt is used to prompt the acquisition object to adjust the relative position with the facial image acquisition module.

In order to realize face unlocking, an ideal face image is a front face image, but a side face image is probably acquired currently, a first prompt is output, and the first prompt can be used for prompting a user to adjust the relative position between the face of the user and an image acquisition module, so that the face of the user is positioned in a positive acquisition visual angle of the image acquisition module. The positive collecting view angle may be a view angle with a vertical line between the collections of the image collecting module at a preset angle, for example, 30 degrees or 45 degrees respectively from top to bottom and from left to right.

And if the face image is collected again, carrying out face unlocking based on the collected face image again.

In some embodiments, if the designated features are not completely acquired from the newly acquired face image, in combination with the features extracted from the previously acquired image, it is determined whether a set of first detection features extracted from P face images adjacently acquired from the same acquisition object includes all the designated features, and if so, the acquisition and output of the first prompt may not be continued.

The first prompt may include: first prompt content instructing a user to turn, lower or raise his head; may also include: second prompt content that instructs the user in which direction to adjust the head.

In some embodiments, the method further comprises:

the face image acquisition module acquires a plurality of face images;

the step S140 may include: and if the face verification is passed and the change rule is matched with the prompt content, closing a screen locking interface provided by the face screen locking application.

In order to reduce the possibility that an illegal user unlocks through a face by using a stolen photo, in the embodiment, living body verification can be performed.

For example, the image acquisition module is controlled to continuously acquire a plurality of face images. And outputting a second prompt at the unlocking interface, wherein the second prompt can inform the user how to adjust the facial expression or the action. For example, the lips of the user are indicated to change according to a certain rule, the eyes and/or eyebrows of the user are indicated to change according to a certain rule, and the like, for example, a certain change rule of opening the eyes first and then closing the eyes, and then, for example, opening the mouth first and then closing the mouth.

Therefore, whether the change rule of the expression of the specific organ or the whole face is matched with the specific rule of the prompt or not is extracted from the plurality of face images which are continuously collected, if the change rule is consistent with the specific rule of the prompt, the change rule can be considered to be matched with the prompt content, otherwise, the change rule can be considered not to be matched, and therefore the safety of the electronic equipment is improved.

It should be noted that the screen locking processing method provided by the present embodiment may only include one of step S130 and step S140 during one screen locking process. For example, a screen lock process is performed, the method may include only step S130; if the face of the screen is unlocked, the method may include: step S140.

In some embodiments, the method further comprises:

If the display of the screen locking interface is maintained by the face screen locking application, on one hand, the verification that the current unlocking is not passed is prompted to the user, on the other hand, the face screen locking verification can be continuously carried out on the screen locking interface by the user conveniently, and the display of the screen locking interface is not triggered by the user through unlocking operation.

In some embodiments, the number of times of face verification failure at this time is counted, and if the number of times of verification failure reaches the maximum number, the electronic device is forcibly turned off or the electronic device is controlled to be turned off, or prompt information is sent to other devices bound to the electronic device, where the prompt information may be used to prompt an illegal user that the illegal user may try to unlock the electronic device.

In some embodiments, if the number of times of the verification failure reaches the maximum number of times, the positioning information of the electronic device is acquired, and the positioning information is sent to other devices bound to the electronic device, so that a user can conveniently track the lost electronic device.

In some embodiments, as shown in fig. 3, the method further comprises:

step S201: downloading an installation package of the face screen locking application;

step S202: installing the face screen locking application in the electronic equipment based on the installation package;

step S203: after the face screen locking application is installed, a prohibition request for prohibiting the screen locking component is sent to the operating system;

the step S110 may include the step S111: and after the operating system receives the prohibition request, prohibiting the screen locking function of the screen locking component.

Thus, by disabling the sending of the request, the operating system may be launched to disable the original screen lock function. In this embodiment, the disable request may cause the operating system to disable the original lock screen function.

For example, various electronic devices such as a mobile phone or a tablet computer download the installation package from an application store based on a user instruction, and the electronic device automatically installs the face screen locking application based on the installation package. If the face screen locking application is installed, the system interface of the electronic device, for example, the desktop can see the identifier of the face screen locking application. Here, the identification of the face lock screen application includes: an application icon for a face lock screen application, and the like.

In some embodiments, the method further comprises:

after the face lock screen application is installed, displaying a face unlocking verification interface;

and prompting the acquisition of the verification face of the face unlocking on the face unlocking verification interface.

For example, the prompt information acquired in multiple angles is output on the face verification interface, so that a user can adjust the relative position between the face and a camera (for example, a monocular camera) according to the prompt information, and thus, the camera acquires images in multiple angles for extracting the preset features. Therefore, when the screen is unlocked by subsequently utilizing the face screen locking application, even if the acquired face image is not completely in a positive angle, the acquired face image can be used for being matched with the preset features extracted from the pre-acquired matched image, so that the phenomenon that the image is repeatedly acquired and matched in the face unlocking process is reduced, and the speed and the accuracy of face unlocking are accelerated.

The multi-angle acquisition may include:

swinging the face left and right in the standing direction;

the motion of nodding and lowering the head with the shoulder as the axis center point;

the left face angle that the left pendulum formed, the right face angle that the right pendulum formed, the angle of bowing around, the head angle of pitching around, it forms the angle of pitching up to pitch up the head to and neither the head nor the positive face angle of yaw up, can form 5 collection angles altogether. And respectively collecting a plurality of images for the 5 angles, and selecting the image with the highest definition and/or the image which can extract the human face features from the images as a matching image or extracting preset features.

And acquiring a plurality of images from each angle, and extracting an image meeting the verification condition from the acquired images to be used as a matching image for subsequent face unlocking, or extracting preset features for face unlocking.

And if the user does not want to use the face screen locking application any more, the electronic equipment can also unload the face screen locking application based on the unloading indication of the user.

The method further comprises the following steps:

if the unloading instruction of the face screen locking application is detected, unloading the face screen locking application from the electronic equipment;

displaying a prompt for forbidding release of the screen locking function of the screen locking component;

and if the confirmation operation of prohibiting the cancellation prompt is detected, canceling the prohibition of the screen locking function of the screen locking assembly so as to recover the screen locking function of the screen locking assembly.

In some embodiments, if the lock screen assembly is preceded by the lock screen verification information, for example, a swipe gesture and/or a fingerprint, the lock screen verification information of the lock screen assembly is activated at the same time.

In other embodiments, the method further comprises: the setting interface of the screen locking verification information of the screen locking assembly is displayed, the screen locking verification information of the screen locking assembly is set in a rewriting mode, the problem that a user cannot unlock due to forgetting is solved through resetting, and meanwhile the user can be prompted to replace the screen locking verification information in time so as to further improve the safety of the electronic equipment.

However, in this embodiment, in order to improve user experience, after the operating system receives the prohibition request, the operation system prohibits the screen locking function of the screen locking component, which includes:

detecting a user operation acting on the prompt message;

Therefore, the operating system displays the prompt information based on the prohibition request, and if the confirmation instruction that the user determines to prohibit the original screen locking function based on the prompt information is detected, the operating system prohibits the original screen locking function and sets the screen locking function of the face screen locking application to be in the permission state.

Further, the face screen locking application also sends a necessary authorization request to the operating system, where the authorization request may include: and allowing the face screen locking application to use the authorization request of the image acquisition module.

If the operating system receives the user confirmation operation of the prohibition request, the operating system directly opens the use authority of the image acquisition module to the face screen locking application based on the authorization request, so that the face screen locking application can use the image acquisition module. Specifically, the operating system configures the use authority and informs the address of the image acquisition module to the face screen locking application. Therefore, the human face screen locking application can establish a data interaction information transmission channel with the image acquisition module.

In some embodiments, the method further comprises:

In this embodiment, the promotion information may be: various information actively pushed by the server, such as various commercials and/or charitable advertisements.

The promotion information is not limited to advertisements, and may further include: an interesting small video or picture etc. that the user sees is required.

Therefore, if the image acquisition process and the face unlocking process are carried out, the user can wait based on the information without generating bad user experience because the information displayed on the screen is boring, and the user experience is improved.

In some embodiments, the electronic device knows the identity information of the legal user through face acquisition and the like, and the promotion information can be directly selected by the electronic device according to the identity information of the legal user, so that the promotion information is displayed according to the identity information of the legal user, and the promotion information interested by the legal user can be selected for display due to the fact that the identity information of the legal user is known in advance; thereby further enhancing the user experience.

In some embodiments, the method further comprises:

If one electronic device has a plurality of legal users, the identity information of the current legal user may need to be confirmed in advance, at this time, a second detection feature is further obtained based on the acquired face image, the identity information of the acquired object can be rapidly determined based on the second detection feature, the interest preference of the acquired object can be obtained after the identity information is obtained, and therefore popularization information interesting to the user can be selected for display.

In this embodiment, the number of the second detection features is less than the number of the first detection features, and in the case of statistical data, since the number of the second detection features is less, the detection and matching rate of the second detection features is higher than the rate of completing the detection and matching of the first detection features.

In this embodiment, the second detection feature may be a subset of the first detection feature, so that the detection and matching result of the second detection feature may be directly used as a component of the detection and matching of the first detection feature, thereby reducing the detection and matching operation of the features.

In still other embodiments, at least a portion of the second detected feature is a feature not included in the first detected feature.

The second detected features may also be various types of face features, and the detailed description of the face features may refer to the foregoing embodiments.

The promotion information can be currently downloaded from a server side, or can be downloaded in advance and cached in the electronic equipment.

In this embodiment, the promotion information may be displayed on the entire lock screen interface, or may be displayed only in a partial area of the lock screen interface.

For example, the lock screen interface is divided into a first area and a second area; and information such as input bits for sliding unlocking or password unlocking is displayed in the first area. The second area is different from the first area, and the second area displays the promotion information.

As shown in fig. 4, the present embodiment provides a lock screen processing apparatus, including:

a forbidding module 110, configured to forbid a screen locking function of a screen locking component, where the screen locking component is a functional component that executes the screen locking function in an operating system of the electronic device;

a sending module 120, configured to send a screen locking instruction to a face screen locking application installed in the electronic device if a screen locking condition is met;

the execution module 130 is configured to execute the screen locking operation of the electronic device by using the face screen locking application to replace a screen locking component; and/or the unlocking module 140 is configured to trigger the face image acquisition module to acquire a face image and execute a face unlocking operation according to the acquired face image if the unlocking condition is met.

In some embodiments, the unlocking module 140 is specifically configured to perform face detection on the face image to obtain a first detection feature; determining whether the face verification passes according to the matching result of the first detection feature and a preset feature; and if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application and displays a system interface covered by the screen locking interface or an application interface of other applications.

In some embodiments, the apparatus further comprises:

In some embodiments, the first prompt is used for prompting an acquisition object to adjust a relative position between the acquisition object and the facial image acquisition module.

In some embodiments, the apparatus further comprises:

the unlocking module 140 is specifically configured to close a screen locking interface provided by the human face screen locking application if the human face passes the verification and the change rule is matched with the prompt content.

In some embodiments, the apparatus further comprises:

the prohibiting module 110 is specifically configured to prohibit the screen locking function of the screen locking component after the operating system receives the prohibition request.

In some embodiments, the prohibition module 110 is specifically configured to display a prompt message for prohibiting the screen locking component after receiving the prohibition request; detecting a user operation acting on the prompt message; and if the user operation confirms that the screen locking function of the screen locking assembly is forbidden, the screen locking function of the screen locking assembly is forbidden.

In some embodiments, the apparatus further comprises:

Several specific examples are provided below in connection with any of the embodiments described above:

example 1:

for the situation that the old mobile phone does not have the face unlocking function, the old mobile phone without the face unlocking function can also use the face unlocking function through the face unlocking app. The mobile phone with the app can be installed on a mobile phone without a face unlocking function through the face unlocking app, so that the face unlocking function of the mobile phone with the app can be realized only through the front camera.

The multi-angle face gathers 5 directions (face, face is down, face is raised, turn face left, turn face right) altogether, and there are 4 dimension values in every direction:

score (Score): collecting face characteristic value scores;

rotation (Roll): the face front rotation dimension value;

swing (Yaw): the face rotates left and right by a dimension value;

dotting (Pitch): the human face head-up nodding dimension value.

In the data collection process, a camera can collect a plurality of images quickly, the face characteristic value is determined to be a correct characteristic value when the numerical value of the face characteristic value is over 0.9, and the image with the highest score is selected as the base library image in the direction. The dimensional values in all directions are in the range of-10 to 10 of the reference value.

The higher the numerical value of the face characteristic value is, the higher the matching degree of the face characteristic value on the currently acquired and set ground library picture is.

The following are the reference values for the determination:

face correction:

roll is b1, the right turn data of the face is positive, and the left turn data is negative;

c1, if the head is lowered, the value of the pitch is 10, and the value of the head-up pitch is-10; (ii) a

Specifically, face-up and head-down:

roll＝a，

yaw＝b1，

pitch c 2; c2 is different from c 1;

face-up and head-up:

roll＝a，

yaw＝b1，

pitch＝c3。

face turning to the left:

roll＝a，

yaw＝-b2，

pitch＝c1。

turning the face to the right:

roll＝a，

raw-b 3, b3 is different from b1 and b 2;

pitch＝c1。

in this example, because the roll is a roll in which the face faces the camera, and the neck is bent to make the face lean against or away from the shoulder, the camera can still completely collect the face, so that the roll value can be obtained by assignment without detection; for example, a, a may take any value.

In some embodiments, the electronic device may also detect the angle value by image analysis, and assign the detected angle value to the roll.

In some cases, b1, b2, and b3 may be 3 fixed values, the center axis of yaw, yaw being b1 if the current face is not yawed left-right, b2 if it is yawed left, and b3 if it is yawed right.

In another case, b1 is a fixed value and b2 and b3 are values that are dynamically determined over a range of values based on the amplitude of the side-to-side wobble. For example, b2 and b3 can range from-10 to 10, b1 can be fixed at 0, b2 can range from-10 to 0, and b3 can range from 0 to 10.

In some cases, c1, c2, and c3 may be 3 fixed values, the central axis of head raising and head lowering, yaw is c1 if the current face is not head raised and head lowering, yaw is c2 if head lowering, and yaw is c3 if head raising.

In another case, c1 is a fixed value and c2 and c3 are values dynamically determined over a range of values based on the magnitude of the head-up heads-down. For example, c2 and c3 may range from-10 to 10, and c1 may be fixed to 0, then c2 may range from-10 to 0, and c3 may range from 0 to 10.

As shown in fig. 5, the present embodiment provides an electronic device, including:

an image acquisition module;

a memory;

and the processor is connected with the image processing module and the memory, and is used for controlling the image acquisition of the image acquisition module by executing the computer executable instructions stored in the memory and implementing the screen locking processing method provided by any of the foregoing embodiments, for example, one or more of the methods shown in fig. 1 to 3.

The image acquisition module can include various cameras, such as a monocular camera, for example, and a front camera of a mobile phone. The image acquisition module can acquire various images, such as the human face image.

The memory can be various types of memories, such as random access memory, read only memory, flash memory, and the like. The memory may be used for information storage, e.g., storing computer-executable instructions, etc. The computer-executable instructions may be various program instructions, such as object program instructions and/or source program instructions, and the like.

The processor may be various types of processors, such as a central processing unit, a microprocessor, a digital signal processor, a programmable array, a digital signal processor, an application specific integrated circuit, or an image processor, among others.

The processor may be connected to the memory via a bus. The bus may be an integrated circuit bus or the like.

In some embodiments, the terminal device may further include: a communication interface, which may include: a network interface, e.g., a local area network interface, a transceiver antenna, etc. The communication interface is also connected with the processor and can be used for information transceiving.

In some embodiments, the terminal device further comprises a human-computer interaction interface, for example, the human-computer interaction interface may comprise various input and output devices, such as a keyboard, a touch screen, and the like.

The embodiment of the application provides a computer storage medium, wherein computer executable codes are stored in the computer storage medium; the computer executable code, when executed, can implement the lock screen processing method provided by one or more of the foregoing technical solutions, for example, one or more of the methods shown in fig. 1 to 3.

The storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. The storage medium may be a non-transitory storage medium.

An embodiment of the present application provides a computer program product comprising computer executable instructions; the computer-executable instructions, when executed, enable any of the foregoing implementations to provide a lock screen processing method, e.g., one or more of the methods shown in fig. 1-3.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. A screen locking processing method is characterized by comprising the following steps:

installing a face screen locking application in the electronic equipment based on the installation package;

after the face screen locking application is installed, a prohibition request for prohibiting screen locking components is sent to an operating system;

after the operating system receives the prohibition request, prohibiting a screen locking function of the screen locking component; the screen locking component is a functional component which executes the screen locking function in an operating system of the electronic equipment;

if the screen locking condition is met, sending a screen locking instruction to the face screen locking application installed in the electronic equipment;

replacing the screen locking component with the face screen locking application to execute the screen locking operation of the electronic equipment;

if the unlocking condition is met, the face screen locking application sends an acquisition instruction to a face image acquisition module, triggers the face image acquisition module to acquire a face image and executes face unlocking operation according to the acquired face image; the unlocking condition being satisfied includes at least one of: detecting an unlocking operation acting on an unlocking key and/or detecting that the electronic equipment moves according to a preset track.

2. The method of claim 1, wherein if the unlocking condition is satisfied, the face screen locking application triggers a face image acquisition module to acquire a face image and performs a face unlocking operation according to the acquired face image, comprising:

3. The method of claim 2, further comprising:

4. The method of claim 3, wherein the first prompt is used to prompt the acquisition object to adjust the relative position with the facial image acquisition module.

5. The method of claim 4, further comprising:

the face image acquisition module acquires a plurality of face images;

6. The method of claim 5, further comprising:

7. The method of claim 1, wherein after the operating system receives the disable request, disabling a lock screen function of the lock screen component comprises:

detecting a user operation acting on the prompt message;

8. The method according to any one of claims 1 to 7, further comprising:

and in the process of collecting the face image or unlocking the face, displaying popularization information in at least partial area of a face unlocking interface.

9. The method of claim 8, further comprising:

acquiring a second detection characteristic based on the face image detection, and identifying the identity information of the collected object;

10. A screen lock processing apparatus, comprising:

the request module is used for sending a prohibition request for prohibiting the screen locking component to an operating system after the face screen locking application is installed;

the forbidding module is used for forbidding the screen locking function of the screen locking component after the operating system receives the forbidding request; the screen locking component is a functional component which executes the screen locking function in an operating system of the electronic equipment;

the sending module is used for sending a screen locking instruction to the face screen locking application installed in the electronic equipment if the screen locking condition is met;

the execution module is used for replacing the screen locking component with the face screen locking application and executing the screen locking operation of the electronic equipment;

the unlocking module is used for sending an acquisition instruction to the face image acquisition module by the face screen locking application if an unlocking condition is met, triggering the face image acquisition module to acquire a face image and executing face unlocking operation according to the acquired face image; the unlocking condition being satisfied includes at least one of: detecting an unlocking operation acting on an unlocking key and/or detecting that the electronic equipment moves according to a preset track.

11. The apparatus according to claim 10, wherein the unlocking module is specifically configured to perform face detection on the face image to obtain a first detection feature; determining whether the face verification passes according to the matching result of the first detection feature and a preset feature; and if the face verification passes, the face screen locking application closes a screen locking interface provided by the face screen locking application and displays a system interface covered by the screen locking interface or other applications of application interfaces of other applications.

12. The apparatus of claim 11, further comprising:

13. The apparatus of claim 12, wherein the first prompt is used to prompt the acquisition object to adjust the relative position with the facial image acquisition module.

14. The apparatus of claim 13, further comprising:

15. The apparatus of claim 14, further comprising:

16. The apparatus of any one of claims 10 to 15, further comprising:

and the downloading module is used for downloading the installation package of the face screen locking application.

17. The device according to claim 16, wherein the prohibition module is specifically configured to display a prompt to prohibit the screen locking component after receiving the prohibition request; detecting a user operation acting on the prompt message; and if the user operation confirms that the screen locking function of the screen locking assembly is forbidden, the screen locking function of the screen locking assembly is forbidden.

18. The apparatus of any one of claims 13 to 15, further comprising:

and the display module is used for displaying popularization information in at least part of area of the face unlocking interface in the process of acquiring the face image or unlocking the face.

19. The apparatus of claim 18, further comprising:

20. An electronic device, comprising:

an image acquisition module;

a memory;

a processor connected with the image processing module and the memory, for controlling the image acquisition of the image acquisition module by executing the computer executable instructions stored on the memory, and implementing the method provided by any one of claims 1 to 9.

21. A computer storage medium having stored thereon computer-executable instructions; the computer-executable instructions, when executed by a processor, are capable of implementing the method as provided by any one of claims 1 to 9.