CN110069913B - Face unlocking method, mobile terminal and computer readable storage medium - Google Patents

Face unlocking method, mobile terminal and computer readable storage medium Download PDF

Info

Publication number
CN110069913B
CN110069913B CN201910290391.8A CN201910290391A CN110069913B CN 110069913 B CN110069913 B CN 110069913B CN 201910290391 A CN201910290391 A CN 201910290391A CN 110069913 B CN110069913 B CN 110069913B
Authority
CN
China
Prior art keywords
face
electronic device
unlocking
mobile terminal
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910290391.8A
Other languages
Chinese (zh)
Other versions
CN110069913A (en
Inventor
唐辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201910290391.8A priority Critical patent/CN110069913B/en
Publication of CN110069913A publication Critical patent/CN110069913A/en
Application granted granted Critical
Publication of CN110069913B publication Critical patent/CN110069913B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Abstract

The application provides a face unlocking method, which is applied to a mobile terminal and comprises the following steps: when the mobile terminal is detected to have unlocking operation, judging whether the mobile terminal is connected with an electronic device with a camera function or not; when the mobile terminal is connected with an electronic device with a camera function, starting a camera of the electronic device to detect a human face; carrying out face recognition on the detected face, and judging whether the detected face is matched with a preset unlocking face or not; and when the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal. The application also provides a mobile terminal and a computer readable storage medium. In this way, face detection with a camera of an electronic device connected to a mobile terminal can be achieved, thereby enabling unlocking of the screen lock of the mobile terminal.

Description

Face unlocking method, mobile terminal and computer readable storage medium
Technical Field
The present disclosure relates to the field of mobile communications technologies, and in particular, to a face unlocking method, a mobile terminal, and a computer readable storage medium.
Background
Along with the rapid development of communication technology, the requirements of users on the appearance design and the personalized design of the mobile terminal are higher and higher, so that the mobile terminal is convenient to operate and can meet the display requirement of a large screen. Under the above-mentioned demand, a full-screen or double-screen mobile terminal has been developed. In order to realize that the main screen is a full screen, the full screen or the double-screen main screen is not provided with a camera, and only the auxiliary screen is provided with the camera.
Therefore, for the mobile terminal with the full screen or the double-sided screen, the function of face unlocking cannot be used when the main screen is used for unlocking, and the mobile terminal can only be unlocked in other unlocking modes, so that the user experience is affected.
Disclosure of Invention
The main objective of the present application is to provide a face unlocking method, a mobile terminal and a computer readable storage medium, which aim to perform face detection through a camera of an electronic device connected to the mobile terminal, so as to release a screen lock of the mobile terminal.
In order to achieve the above object, the present application provides a face unlocking method, which is applied to a mobile terminal, and the face unlocking method includes: when the mobile terminal is detected to have unlocking operation, judging whether the mobile terminal is connected with an electronic device with a camera function or not; when the mobile terminal is connected with an electronic device with a camera function, starting a camera of the electronic device to detect a human face; carrying out face recognition on the detected face, and judging whether the detected face is matched with a preset unlocking face or not; and when the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal.
Optionally, after the step of determining whether the mobile terminal is connected to the electronic device with the camera function, the method further includes: and when the mobile terminal is not connected with the electronic device with the camera function, starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
Optionally, when the mobile terminal is connected with an electronic device with a camera function, a step of starting a camera of the electronic device to detect a face includes: judging whether a camera of the electronic device faces to the face direction of a user or not; and when the camera of the electronic device faces to the face direction of the user, starting the camera of the electronic device to detect the face.
Optionally, before the step of determining whether the camera of the electronic device faces the face of the user, the method further includes: and prompting the user to rotate the camera of the electronic device to face orientation of the user.
Optionally, the step of recognizing the detected face and judging whether the detected face is matched with the preset unlocking face includes: acquiring the characteristic information of the detected face and the characteristic information of the preset unlocking face; comparing the detected characteristic information of the face with the characteristic information of the preset unlocking face to obtain a matching value; when the matching value is larger than or equal to a preset value, determining that the detected face is successfully matched with the preset unlocking face; and when the matching value is smaller than the preset value, determining that the detected face and the preset unlocking face are failed to be matched.
Optionally, the face unlocking method further includes: when the detected face fails to be matched with a preset unlocking face, monitoring and judging whether the time length after the matching failure exceeds a preset time length; and if the time length after the matching failure exceeds the preset time length, closing the camera of the electronic device.
Optionally, the face unlocking method further includes: and when the detected face fails to be matched with a preset unlocking face, displaying that the mobile terminal fails to be unlocked, and starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
Optionally, after the step of releasing the screen lock of the mobile terminal, the method further includes: and closing the camera of the electronic device.
The application also provides a mobile terminal, which comprises: a touch screen; a processor;
and the memory is connected with the processor and contains a control instruction, and when the processor reads the control instruction, the mobile terminal is controlled to realize the face unlocking method.
The present application also provides a computer-readable storage medium having one or more programs executed by one or more processors to implement the above-described face unlocking method.
According to the face unlocking method, the mobile terminal and the computer readable storage medium, when the mobile terminal is detected to have unlocking operation, whether the mobile terminal is connected with the electronic device with the camera function is judged, when the mobile terminal is connected with the electronic device with the camera function, the camera of the electronic device is started, face detection is conducted, whether the detected face is matched with a preset unlocking face is judged through face recognition, and when the detected face is matched with the preset unlocking face, screen lock of the mobile terminal is released, so that the face detection can be conducted through the camera of the electronic device, the unlocking operation is conducted on a screen of the mobile terminal, and user experience is improved.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
FIG. 1 is a schematic diagram of an alternative hardware architecture of a mobile terminal implementing various embodiments of the present application;
FIG. 2 is a schematic diagram of a communication network system of the mobile terminal shown in FIG. 1;
fig. 3 is a flowchart of a face unlocking method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
The realization, functional characteristics and advantages of the present application will be further described with reference to the embodiments, referring to the attached drawings.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present invention, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.
The terminal may be implemented in various forms. For example, the terminals described in the present invention may include mobile terminals such as cell phones, tablet computers, notebook computers, palm computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, wearable devices, smart bracelets, pedometers, and fixed terminals such as digital TVs, desktop computers, and the like.
The following description will be given taking a mobile terminal as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for a moving purpose.
Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention, the mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the mobile terminal structure shown in fig. 1 is not limiting of the mobile terminal and that the mobile terminal may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
The various components of the mobile terminal 100 are described in detail below in conjunction with fig. 1:
the radio frequency unit 101 may be used for receiving and transmitting signals during the information receiving or communication process, specifically, after receiving downlink information of the base station, processing the downlink information by the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System ofMobile communication, global System for Mobile communications), GPRS (General Packet Radio Service ), CDMA2000 (Code Division Multiple Access, CDMA 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division Duplex Long term evolution), and TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division Duplex Long term evolution), etc.
WiFi belongs to a short-distance wireless transmission technology, and a mobile terminal can help a user to send and receive e-mails, browse web pages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 102, it is understood that it does not belong to the necessary constitution of a mobile terminal, and can be omitted entirely as required within a range that does not change the essence of the invention.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the mobile terminal 100. The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.
The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the mobile terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the gesture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; as for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured in the mobile phone, the detailed description thereof will be omitted.
The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the mobile terminal. In particular, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 110, and can receive and execute commands sent from the processor 110. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.
Further, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The mobile terminal 100 may further include a power source 111 (e.g., a battery) for supplying power to the respective components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described herein.
In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based will be described below.
Referring to fig. 2, fig. 2 is a schematic diagram of a communication network system according to an embodiment of the present invention, where the communication network system is an LTE system of a general mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an e-UTRAN (Evolved UMTS Terrestrial Radio Access Network ) 202, an epc (Evolved Packet Core, evolved packet core) 203, and an IP service 204 of an operator that are sequentially connected in communication.
Specifically, the UE201 may be the terminal 100 described above, and will not be described herein.
The E-UTRAN202 includes eNodeB2021 and other eNodeB2022, etc. The eNodeB2021 may be connected with other eNodeB2022 by a backhaul (e.g., an X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide access from the UE201 to the EPC 203.
EPC203 may include MME (Mobility Management Entity ) 2031, hss (Home Subscriber Server, home subscriber server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, pgw (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function, policy and tariff function entity) 2036, and so on. The MME2031 is a control node that handles signaling between the UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location registers (not shown) and to hold user specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034 and PGW2035 may provide IP address allocation and other functions for UE201, PCRF2036 is a policy and charging control policy decision point for traffic data flows and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).
IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem ), or other IP services, etc.
Although the LTE system is described above as an example, it should be understood by those skilled in the art that the present invention is not limited to LTE systems, but may be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.
Based on the above mobile terminal hardware structure and the communication network system, various embodiments of the method of the present invention are provided.
Fig. 3 is a flowchart of an embodiment of a face unlocking method provided in the present application. Once triggered by a user, the process in this embodiment automatically operates through the mobile terminal, where each step may be performed sequentially as shown in the flowchart, or may be performed simultaneously according to a plurality of steps in actual situations, which is not limited herein. The face unlocking method provided by the application comprises the following steps:
step S310, when detecting that the mobile terminal 100 has an unlocking operation, judging whether the mobile terminal 100 is connected with an electronic device with a camera function;
step S330, when the mobile terminal 100 is connected with an electronic device having a camera function, turning on a camera of the electronic device to perform face detection;
Step S350, carrying out face recognition on the detected face, and judging whether the detected face is matched with a preset unlocking face or not;
step S370, when the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal 100.
Through the above embodiment, the face detection may be performed by using the camera of the electronic device, so as to perform an unlocking operation on the screen of the mobile terminal 100, thereby improving user experience.
The above steps will be specifically described with reference to specific embodiments.
In step S310, when it is detected that the mobile terminal 100 has an unlock operation, it is determined whether the mobile terminal 100 is connected to an electronic device having a camera function.
Specifically, the electronic device may be a wearable electronic device with a camera function, such as a bracelet, a watch, or the like. The mobile terminal 100 may be configured with a dual screen, i.e., including a main screen and a sub screen. The main screen (front screen) is a full screen, and the main screen has no camera. The sub screen (back screen) is configured with a camera, so that when the mobile terminal 100 is unlocked using the main screen, the face unlocking function cannot be achieved using the camera of the sub screen to release the screen lock of the mobile terminal 100, and at this time, the mobile terminal 100 can achieve the face unlocking function by using an electronic device connected with the function of the camera. In other embodiments, the mobile terminal 100 may be configured as a single-sided screen, and the single-sided screen is a full-sided screen, and when the mobile terminal 100 is unlocked by using the single-sided screen, the mobile terminal 100 may also implement a function of face unlocking by using an electronic device with a camera function connected thereto.
In this embodiment, taking an example that the mobile terminal 100 is configured with a dual-sided screen, after the mobile terminal system is locked, a user is required to input a password and/or a fingerprint to unlock, and only if the unlocking is successful, the mobile terminal 100 can be accessed and used. Generally, when the mobile terminal 100 locks a screen, the two-sided screen is not displayed at all, and is in a black screen state. When the user shakes the mobile phone or presses the home key or presses the start key, the main screen of the mobile terminal 100 is awakened, and then an operation instruction for unlocking the mobile terminal 100 is triggered, namely, the mobile terminal 100 has an unlocking operation.
In this embodiment, after step S310, the method may further include:
in step S3101, when the mobile terminal 100 is not connected to an electronic device with a camera function, a standby unlocking mode is started, where the standby unlocking mode at least includes fingerprint unlocking and/or password unlocking.
Specifically, when the mobile terminal 100 is not connected with an electronic device having a camera function, the mobile terminal 100 cannot smoothly realize a face unlocking function, and a standby unlocking mode can be started, so that a user can unlock the mobile terminal more quickly, and the situation that the user with authority cannot normally use the mobile terminal is avoided. The standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking. The fingerprint unlocking is an application of fingerprint identification, is also a human body biological characteristic identification technology, and has the same function as face unlocking, and can uniquely judge the identity of a user. The password unlock is the same as the existing entry of multiple numbers and/or letter combinations.
In step S330, when the mobile terminal 100 is connected to an electronic device with a camera function, a camera of the electronic device is turned on to perform face detection.
Specifically, when the mobile terminal 100 is connected to an electronic device having a camera function, a camera of the electronic device is turned on, and face detection can be performed through the camera of the electronic device. It can be appreciated that, in the process of using the camera of the electronic device to perform face detection, a user may use the electronic device in a situation that light is dark at night, and if face detection is performed at this time, accuracy may be reduced. Therefore, after the camera of the electronic device is turned on, the brightness of the light around the electronic device can be detected by the camera of the electronic device. When the brightness of the light around the electronic device is lower than the preset brightness, the night shooting mode is automatically started to perform face detection, so that the accuracy of face detection when the light is darker is improved. The preset light brightness may be a preset minimum light brightness capable of normally using the face detection function of the electronic device before the electronic device leaves the factory. In this embodiment, step S330 may be implemented by the following steps:
Step S3301, judging whether a camera of the electronic device faces to the face direction of a user;
in step S3303, when the camera of the electronic device faces the face of the user, the camera of the electronic device is turned on to perform face detection. It should be noted that, step S330 may be determined by other methods, which is not limited in particular.
Specifically, in step S3301, it may be determined whether the camera of the electronic device is oriented toward the face of the user through a gravity sensor on the electronic device. In general, the orientation of the camera of the electronic device is the orientation of the screen of the electronic device. In general, when a user uses the electronic device, the inclination angle of the camera of the electronic device is between 0 ℃ and 90 ℃, and on the other hand, when the user uses the electronic device, the relative position of the face of the user and the electronic device can be different due to the height of the user and the wearing position of the electronic device. Therefore, before judging whether the camera of the electronic device faces the face direction of the user, the face direction of the user can be set in advance. In step S3303, when the camera of the electronic device faces to a preset face orientation of the user, the camera of the electronic device is turned on to perform face detection. Only when a user directs the camera of the electronic device to face, the camera of the electronic device is started to detect the face, so that the electric quantity of the electronic device is saved, and the intelligent degree of the electronic device is improved. In the present embodiment, after step S3301, it may further include:
In step S33011, the user is prompted to rotate the camera of the electronic device to face orientation towards the user.
Specifically, when the face orientation of the user is set, the user may be prompted to rotate the camera of the electronic device to face towards the face orientation of the user, for example, the user is prompted to rotate the camera of the electronic device from a position facing horizontally upwards to a position facing vertically towards the user through sound or text information, so that the gravity sensor can conveniently judge the face orientation.
In step S350, face recognition is performed on the detected face, and it is determined whether the detected face matches with a preset unlocking face.
Specifically, face recognition is a biological recognition technology for performing identity recognition based on facial feature information of a person, and a camera of the electronic device is used for collecting a face image or video stream containing the user, automatically detecting and tracking the face in the image, and further performing a series of related technologies of face recognition on the detected face, which are commonly called face recognition, face recognition and face recognition. A human face is one of the biological features of a human body, and its uniqueness determines the uniqueness of an identity, that is, the facial features of each person are different, so that different people can be distinguished. In this embodiment, step S350 may be implemented as follows:
Step S3501, acquiring the feature information of the detected face and the feature information of the preset unlocking face;
step S3503, comparing the detected feature information of the face with the feature information of the preset unlocking face to obtain a matching value;
step S3505, when the matching value is greater than or equal to a preset value, determining that the detected face is successfully matched with the preset unlocking face;
step S3507, when the matching value is smaller than the preset value, determining that the detected face fails to match with the preset unlocking face.
Specifically, in step S3501, face detection is performed by the camera of the electronic device, and a face image including a user is collected to obtain feature information of the detected face. The face image, the head image, and the face image are mutually replaced words, and are images including feature information of the user, such as a face contour and facial features. The preset unlocking face is a face of a user who can release the screen lock of the mobile terminal 100. One or more unlocking face images for matching the acquired face images can be preset, wherein the unlocking face images are images containing characteristic information of the preset unlocking face, such as facial contours and facial features, namely the preset unlocking face images. And acquiring the unlocking face image and acquiring the characteristic information of the preset unlocking face. In step S3503, the detected feature information of the face is compared with the feature information of the preset unlocked face to obtain a matching value. In this embodiment, the preset value may be preset, where the preset value may be 70% and 90% different, and a higher preset value indicates a higher matching degree requirement, and a lower preset value indicates a lower matching degree requirement. Because the real-time acquisition of the face image is easily affected by environmental factors, if the face image cannot be consistent with the shooting environment of the preset face image and the preset value is set higher, face recognition failure is easily caused. Meanwhile, the facial outline and the five sense organs of people are easy to crack, if the preset value is set to be low, other people can use the mobile terminal easily, and the basic requirement of protecting user information cannot be met, so that the preset value is set according to actual needs. In step S3505 and step S3507, when the matching value is greater than or equal to a preset value, matching is successful; and when the matching value is smaller than the preset value, the matching fails. In the present embodiment, after step S3507, it may further include:
Step S35071, when the detected face fails to match with the preset unlocking face, monitoring and judging whether the duration after the matching failure exceeds the preset duration;
and step 35073, if the duration after the matching failure exceeds the preset duration, closing the camera of the electronic device.
Specifically, in step S35071, when the detected face fails to match with the preset unlocked face, the duration after the matching fails is monitored, and the duration after the matching fails is compared with the preset duration, so as to determine whether the duration after the matching fails exceeds the preset duration. The preset duration may be preset, and the preset duration may be 5s or 10 s. In step S35073, if the duration after the matching failure exceeds the preset duration, the camera of the electronic device is turned off, that is, when the duration after the matching failure does not exceed the preset duration, the camera of the electronic device is in an on state consistently. It can be understood that the longer the preset duration is, the longer the camera of the electronic device is turned on after the matching fails, and the shorter the preset duration is, the shorter the camera of the electronic device is turned on after the matching fails. On the one hand, after the detected face fails to match with the preset unlocking face, if the preset duration is longer, face detection can be performed for multiple times, and face recognition and matching analysis can be performed. On the other hand, if the preset duration is shorter, the electric quantity of the electronic device can be saved, so that the preset duration can be set according to actual needs.
In the present embodiment, after step S3507, it may further include:
and step S35075, when the detected face fails to match with a preset unlocking face, displaying that the mobile terminal fails to unlock, and starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
In step S370, when the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal.
Specifically, when the detected face is matched with the preset unlocking face, the electronic device transmits a matching result to the mobile terminal 100, the mobile terminal 100 receives the matching result and releases the screen lock of the mobile terminal 100, so that automatic unlocking of the screen lock of the mobile terminal 100 is achieved, and when the mobile terminal 100 cannot use the camera of the mobile terminal 100 to achieve the face unlocking function to release the screen lock of the mobile terminal 100, the mobile terminal 100 can use the camera of the electronic device to perform face detection so as to achieve the face unlocking function. In this embodiment, after step S370, it may further include:
Step S3701, closing the camera of the electronic device.
Specifically, after the screen lock of the mobile terminal is released, the camera of the electronic device is closed, so that the electric quantity of the electronic device is saved. In this embodiment, when the duration after the matching is successful exceeds the preset duration, the camera of the electronic device may be turned off.
According to the embodiment, when the mobile terminal is detected to have unlocking operation, whether the mobile terminal is connected with the electronic device with the camera function is judged, when the mobile terminal is connected with the electronic device with the camera function, the camera of the electronic device is started, so that face detection is performed, whether the detected face is matched with the preset unlocking face is judged by performing face recognition on the detected face, and when the detected face is matched with the preset unlocking face, the screen lock of the mobile terminal is released, so that the face detection can be performed through using the camera of the electronic device, the unlocking operation is performed on the screen of the mobile terminal, and the user experience is improved.
Fig. 4 is a schematic structural diagram of a mobile terminal 100 according to an embodiment of the present application, where the mobile terminal 100 includes: a touch panel 1071; a processor 110; the memory 109 is connected to the processor 110, and the memory 109 contains control instructions, which when read by the processor 110, control the mobile terminal 100 to implement the following steps:
When the mobile terminal is detected to have unlocking operation, judging whether the mobile terminal is connected with an electronic device with a camera function or not; when the mobile terminal is connected with an electronic device with a camera function, starting a camera of the electronic device to detect a human face; carrying out face recognition on the detected face, and judging whether the detected face is matched with a preset unlocking face or not; and when the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal.
Optionally, after the step of determining whether the mobile terminal is connected to the electronic device with the camera function, the method further includes: and when the mobile terminal is not connected with the electronic device with the camera function, starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
Optionally, when the mobile terminal is connected with an electronic device with a camera function, a step of starting a camera of the electronic device to detect a face includes: judging whether a camera of the electronic device faces to the face direction of a user or not; and when the camera of the electronic device faces to the face direction of the user, starting the camera of the electronic device to detect the face.
Optionally, before the step of determining whether the camera of the electronic device faces the face of the user, the method further includes: and prompting the user to rotate the camera of the electronic device to face orientation of the user.
Optionally, the step of recognizing the detected face and judging whether the detected face is matched with the preset unlocking face includes: acquiring the characteristic information of the detected face and the characteristic information of the preset unlocking face; comparing the detected characteristic information of the face with the characteristic information of the preset unlocking face to obtain a matching value; when the matching value is larger than or equal to a preset value, determining that the detected face is successfully matched with the preset unlocking face; and when the matching value is smaller than the preset value, determining that the detected face and the preset unlocking face are failed to be matched.
Optionally, the face unlocking method further includes: when the detected face fails to be matched with a preset unlocking face, monitoring and judging whether the time length after the matching failure exceeds a preset time length; and if the time length after the matching failure exceeds the preset time length, closing the camera of the electronic device.
Optionally, the face unlocking method further includes: and when the detected face fails to be matched with a preset unlocking face, displaying that the mobile terminal fails to be unlocked, and starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
Optionally, after the step of releasing the screen lock of the mobile terminal, the method further includes: and closing the camera of the electronic device.
Through the mobile terminal, when the mobile terminal is detected to have unlocking operation, whether the mobile terminal is connected with the electronic device with the camera function is judged, when the mobile terminal is connected with the electronic device with the camera function, the camera of the electronic device is started, so that face detection is performed, whether the detected face is matched with a preset unlocking face is judged by performing face recognition on the detected face, and when the detected face is matched with the preset unlocking face, the screen lock of the mobile terminal is released, so that the face detection can be performed through using the camera of the electronic device, the unlocking operation is performed on the screen of the mobile terminal, and the user experience is improved.
The embodiments also provide a computer-readable storage medium having one or more programs executed by one or more processors to implement the steps of:
when the mobile terminal is detected to have unlocking operation, judging whether the mobile terminal is connected with an electronic device with a camera function or not; when the mobile terminal is connected with an electronic device with a camera function, starting a camera of the electronic device to detect a human face; carrying out face recognition on the detected face, and judging whether the detected face is matched with a preset unlocking face or not; and when the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal.
Optionally, after the step of determining whether the mobile terminal is connected to the electronic device with the camera function, the method further includes: and when the mobile terminal is not connected with the electronic device with the camera function, starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
Optionally, when the mobile terminal is connected with an electronic device with a camera function, a step of starting a camera of the electronic device to detect a face includes: judging whether a camera of the electronic device faces to the face direction of a user or not; and when the camera of the electronic device faces to the face direction of the user, starting the camera of the electronic device to detect the face.
Optionally, before the step of determining whether the camera of the electronic device faces the face of the user, the method further includes: and prompting the user to rotate the camera of the electronic device to face orientation of the user.
Optionally, the step of recognizing the detected face and judging whether the detected face is matched with the preset unlocking face includes: acquiring the characteristic information of the detected face and the characteristic information of the preset unlocking face; comparing the detected characteristic information of the face with the characteristic information of the preset unlocking face to obtain a matching value; when the matching value is larger than or equal to a preset value, determining that the detected face is successfully matched with the preset unlocking face; and when the matching value is smaller than the preset value, determining that the detected face and the preset unlocking face are failed to be matched.
Optionally, the face unlocking method further includes: when the detected face fails to be matched with a preset unlocking face, monitoring and judging whether the time length after the matching failure exceeds a preset time length; and if the time length after the matching failure exceeds the preset time length, closing the camera of the electronic device.
Optionally, the face unlocking method further includes: and when the detected face fails to be matched with a preset unlocking face, displaying that the mobile terminal fails to be unlocked, and starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking.
Optionally, after the step of releasing the screen lock of the mobile terminal, the method further includes: and closing the camera of the electronic device.
Through the computer readable storage medium, when the mobile terminal is detected to have unlocking operation, whether the mobile terminal is connected with an electronic device with a camera function is judged, when the mobile terminal is connected with the electronic device with the camera function, the camera of the electronic device is started, so that face detection is performed, whether the detected face is matched with a preset unlocking face is judged through face recognition on the detected face, and when the detected face is matched with the preset unlocking face, the screen lock of the mobile terminal is released, so that the face detection can be performed through using the camera of the electronic device, the unlocking operation is performed on the screen of the mobile terminal, and the user experience is improved.
Embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium here stores one or more programs. Wherein the computer readable storage medium may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid state disk; the memory may also comprise a combination of the above types of memories.
The corresponding technical features in the above embodiments can be used mutually without causing contradiction between schemes or incapacitation.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including several instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the protection of the claims, which fall within the protection of the present application.

Claims (3)

1. A face unlocking method is characterized in that the face unlocking method is applied to a mobile terminal,
wherein,
the mobile terminal is configured with a double-sided screen and comprises a main screen and a secondary screen, wherein the main screen is a full-sided screen, the main screen is not provided with a camera, the secondary screen is provided with a camera, when the mobile terminal is unlocked by using the main screen, the camera of the secondary screen cannot be used for realizing a face unlocking function so as to release a screen lock of the mobile terminal, and when the mobile terminal is unlocked by using the camera of the secondary screen, the mobile terminal is connected with an electronic device with the camera function so as to realize the face unlocking function;
the face unlocking method comprises the following steps:
when the mobile terminal is detected to have unlocking operation, judging whether the mobile terminal is connected with an electronic device with a camera function or not;
when the mobile terminal is connected with an electronic device with a camera function, starting a camera of the electronic device to detect a human face;
carrying out face recognition on the detected face, and judging whether the detected face is matched with a preset unlocking face or not; and
When the detected face is matched with the preset unlocking face, unlocking the screen lock of the mobile terminal;
After the step of judging whether the mobile terminal is connected with the electronic device with the camera function, the method further comprises the following steps:
when the mobile terminal is not connected with the electronic device with the camera function, starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking;
when the mobile terminal is connected with an electronic device with a camera function, starting a camera of the electronic device to detect a human face, including:
when the camera of the electronic device is started, detecting the brightness of light rays around the electronic device through the camera of the electronic device;
when the brightness of the light around the electronic device is detected to be lower than the preset brightness, starting a night shooting mode to perform face detection;
judging whether a camera of the electronic device faces to the face direction of a user or not; and
When the camera of the electronic device faces to the face direction of the user, starting the camera of the electronic device to detect the face;
before the step of determining whether the camera of the electronic device faces the face of the user, the method further includes:
Prompting the user to rotate a camera of the electronic device to face orientation towards the user;
the step of recognizing the face detected and judging whether the face detected is matched with the preset unlocking face comprises the following steps:
acquiring the characteristic information of the detected face and the characteristic information of the preset unlocking face;
comparing the detected characteristic information of the face with the characteristic information of the preset unlocking face to obtain a matching value;
when the matching value is larger than or equal to a preset value, determining that the detected face is successfully matched with the preset unlocking face; and
When the matching value is smaller than the preset value, determining that the detected face fails to match with the preset unlocking face;
the face unlocking method further comprises the following steps:
when the detected face fails to be matched with a preset unlocking face, monitoring and judging whether the time length after the matching failure exceeds a preset time length; and
If the time length after the matching failure exceeds the preset time length, closing a camera of the electronic device; the longer the preset duration is, the longer the time for opening the camera of the electronic device after the matching failure is determined, and the shorter the preset duration is, the shorter the time for opening the camera of the electronic device after the matching failure is determined; when the detected face fails to be matched with the preset unlocking face, if the longer preset duration is set, face detection is carried out for multiple times, and face recognition and matching analysis are carried out; or if the preset time length is shorter, saving the electric quantity of the electronic device;
Wherein,
setting the face orientation of a user in advance, and starting the camera of the electronic device to detect the face when the camera of the electronic device faces the preset face orientation of the user;
when the face orientation of the user is set, prompting the user to rotate the camera of the electronic device to the face orientation facing the user, including prompting the user to rotate the camera of the electronic device from a position facing horizontally upwards to a position facing vertically to the user through sound or text information;
the face unlocking method further comprises the following steps:
when the detected face fails to match with a preset unlocking face, displaying that the mobile terminal fails to unlock, and starting a standby unlocking mode, wherein the standby unlocking mode at least comprises fingerprint unlocking and/or password unlocking;
after the step of releasing the screen lock of the mobile terminal, the method further comprises the following steps:
and closing the camera of the electronic device.
2. A mobile terminal, the mobile terminal comprising:
a touch screen;
a processor;
and the memory is connected with the processor and contains control instructions, and when the processor reads the control instructions, the mobile terminal is controlled to realize the face unlocking method of claim 1.
3. A computer readable storage medium having one or more programs for execution by one or more processors to implement the face unlocking method of claim 1.
CN201910290391.8A 2019-04-11 2019-04-11 Face unlocking method, mobile terminal and computer readable storage medium Active CN110069913B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910290391.8A CN110069913B (en) 2019-04-11 2019-04-11 Face unlocking method, mobile terminal and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910290391.8A CN110069913B (en) 2019-04-11 2019-04-11 Face unlocking method, mobile terminal and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN110069913A CN110069913A (en) 2019-07-30
CN110069913B true CN110069913B (en) 2024-03-19

Family

ID=67367411

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910290391.8A Active CN110069913B (en) 2019-04-11 2019-04-11 Face unlocking method, mobile terminal and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110069913B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114578998A (en) * 2022-03-23 2022-06-03 深圳传音控股股份有限公司 Touch processing method, intelligent terminal and computer readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103647587A (en) * 2013-12-30 2014-03-19 华为终端有限公司 Method and system for unlocking mobile terminal, mobile terminal and wearable electronic device
CN104899498A (en) * 2015-06-26 2015-09-09 广东欧珀移动通信有限公司 Wearable device based mobile terminal unlocking method and mobile terminal unlocking device
CN105635093A (en) * 2015-05-28 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Access method, wearable intelligent device, authentication method and terminal
JP2017033271A (en) * 2015-07-31 2017-02-09 パナソニックIpマネジメント株式会社 User authentication method of wearable camera
CN108629169A (en) * 2018-03-22 2018-10-09 广东小天才科技有限公司 Unlocking method, device, smartwatch and the storage medium of smartwatch
CN108830061A (en) * 2018-05-25 2018-11-16 努比亚技术有限公司 Terminal unlock method, mobile terminal and readable storage medium storing program for executing based on recognition of face
CN109086584A (en) * 2018-06-30 2018-12-25 深圳市捷仕朗智能科技有限公司 Data processing method, device, computer equipment and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101645087B1 (en) * 2014-07-10 2016-08-02 아이리텍 잉크 High security set using hand attached-type wearable device for iris recognition with wearing detection sensor and control method of the same set

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103647587A (en) * 2013-12-30 2014-03-19 华为终端有限公司 Method and system for unlocking mobile terminal, mobile terminal and wearable electronic device
CN105635093A (en) * 2015-05-28 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Access method, wearable intelligent device, authentication method and terminal
CN104899498A (en) * 2015-06-26 2015-09-09 广东欧珀移动通信有限公司 Wearable device based mobile terminal unlocking method and mobile terminal unlocking device
JP2017033271A (en) * 2015-07-31 2017-02-09 パナソニックIpマネジメント株式会社 User authentication method of wearable camera
CN108629169A (en) * 2018-03-22 2018-10-09 广东小天才科技有限公司 Unlocking method, device, smartwatch and the storage medium of smartwatch
CN108830061A (en) * 2018-05-25 2018-11-16 努比亚技术有限公司 Terminal unlock method, mobile terminal and readable storage medium storing program for executing based on recognition of face
CN109086584A (en) * 2018-06-30 2018-12-25 深圳市捷仕朗智能科技有限公司 Data processing method, device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN110069913A (en) 2019-07-30

Similar Documents

Publication Publication Date Title
CN109618316B (en) Network sharing method, mobile terminal and storage medium
CN109348067B (en) Method for adjusting screen display brightness, mobile terminal and computer readable storage medium
CN109086582B (en) Fingerprint authentication method, terminal and computer readable storage medium
CN108512625B (en) Anti-interference method for camera, mobile terminal and storage medium
CN110035176B (en) Brightness adjusting method of mobile terminal, mobile terminal and storage medium
CN107566734B (en) Intelligent control method, terminal and computer readable storage medium for portrait photographing
CN108197554B (en) Camera starting method, mobile terminal and computer readable storage medium
CN109256151B (en) Call voice regulation and control method and device, mobile terminal and readable storage medium
CN109195213B (en) Mobile terminal screen control method, mobile terminal and computer readable storage medium
CN109890022B (en) Data transmission control method, mobile terminal and computer readable storage medium
CN108958936B (en) Application program switching method, mobile terminal and computer readable storage medium
WO2023284209A1 (en) Unlocking method, mobile terminal, and storage medium
CN110052024B (en) Game vibration adjusting method, adjusting device, mobile terminal and storage medium
CN110638437A (en) Control method based on heart rate monitoring, terminal, wearable device and storage medium
CN107885987B (en) Unlocking method, terminal and computer readable storage medium
CN108234751B (en) Automatic danger detection method, mobile terminal and computer readable storage medium
CN110875979A (en) Contextual model control method, terminal and computer readable storage medium
CN111443818B (en) Screen brightness regulation and control method, equipment and computer readable storage medium
CN110069913B (en) Face unlocking method, mobile terminal and computer readable storage medium
CN112489647A (en) Voice assistant control method, mobile terminal and storage medium
CN109711198B (en) Application management method, mobile terminal and storage medium
CN110334559B (en) Code scanning identification method, terminal and computer readable storage medium
CN108876387B (en) Payment verification method, payment verification equipment and computer-readable storage medium
CN110087013B (en) Video chat method, mobile terminal and computer readable storage medium
CN115277922A (en) Processing method, intelligent terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant