CN111625799A - Processing method and device based on face unlocking - Google Patents

Processing method and device based on face unlocking Download PDF

Info

Publication number
CN111625799A
CN111625799A CN202010501405.9A CN202010501405A CN111625799A CN 111625799 A CN111625799 A CN 111625799A CN 202010501405 A CN202010501405 A CN 202010501405A CN 111625799 A CN111625799 A CN 111625799A
Authority
CN
China
Prior art keywords
user
unlocking
terminal equipment
expression
intention
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010501405.9A
Other languages
Chinese (zh)
Inventor
刘娟
谷楠楠
韩尚直
贾佩基
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN202010501405.9A priority Critical patent/CN111625799A/en
Publication of CN111625799A publication Critical patent/CN111625799A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition

Abstract

The application discloses a processing method and a processing device based on face unlocking. The expression of the user can reflect whether the user has the unlocking intention, so that after the terminal equipment acquires the face image, the expression of the user can be identified according to the face image, whether the user has the unlocking intention is determined according to the expression of the user, and the terminal equipment does not trigger the unlocking operation under the condition that the terminal equipment determines that the user does not have the unlocking intention. Therefore, the terminal equipment can determine the expression of the user according to the face image, determine whether the user has the unlocking intention according to the expression of the user, and does not trigger the unlocking operation when the user does not have the unlocking intention. Therefore, when the user is in a passive state, unlocking operation cannot be realized through face recognition, and potential safety hazards are reduced.

Description

Processing method and device based on face unlocking
Technical Field
The present application relates to the field of computers, and in particular, to a processing method and apparatus based on face unlocking.
Background
With the development of intelligent terminals and face recognition technologies, the face recognition technology can be applied to screen unlocking of intelligent terminals such as smart phones, and is called face unlocking for short.
Although the 'face unlocking' is convenient to use, certain potential safety hazards exist, for example, when the user intelligent terminal is robbed, the user is coerced or other passive conditions exist, as long as the face of the user is aligned with the camera of the intelligent terminal, the screen of the intelligent terminal can be unlocked.
Therefore, a solution to solve the above problems is urgently needed.
Disclosure of Invention
The technical problem to be solved by the application is how to avoid potential safety hazards caused by passive face unlocking, and a processing method and a device based on face unlocking are provided.
In a first aspect, an embodiment of the present application provides a processing method based on face unlocking, where the method includes:
the method comprises the steps that terminal equipment obtains a face image of a user;
the terminal equipment identifies the expression of the user according to the face image;
determining whether the user has unlocking intention according to the expression;
and when the terminal equipment determines that the user does not have the unlocking intention, the terminal equipment does not trigger the unlocking operation.
Optionally, the method further includes:
under the condition that the user is determined to have the unlocking intention, the terminal equipment acquires voice data;
the terminal equipment determines whether the user is in a passive state or not according to the voice data;
and the terminal equipment does not trigger unlocking operation when determining that the user is in the passive state.
Optionally, the method further includes:
and freezing an account corresponding to the target application program running on the terminal equipment.
Optionally, if the terminal device is in an unlocked state, the method further includes:
and the terminal equipment executes screen locking operation.
Optionally, the method further includes:
and when the terminal equipment determines that the user is not in the passive state, triggering unlocking operation.
In a second aspect, an embodiment of the present application provides a processing apparatus based on human face unlocking, where the apparatus includes:
the first acquisition unit is used for acquiring a face image of a user;
the recognition unit is used for recognizing the expression of the user according to the face image;
the first determining unit is used for determining whether the user has unlocking intention according to the expression;
the first execution unit is used for not triggering the unlocking operation when the user is determined not to have the unlocking intention.
Optionally, the apparatus further comprises:
the second acquisition unit is used for acquiring voice data under the condition that the user is determined to have the unlocking intention;
a second determining unit, configured to determine whether the user is in a passive state according to the voice data;
and the second execution unit is used for not triggering the unlocking operation when the user is determined to be in the passive state.
Optionally, the apparatus further comprises:
and the freezing unit is used for freezing the account corresponding to the target application program operated on the terminal equipment.
Optionally, if the terminal device is in an unlocked state, the apparatus further includes:
and the third execution unit is used for executing screen locking operation.
Optionally, the apparatus further comprises:
and the fourth execution unit is used for triggering unlocking operation when the user is determined not to be in the passive state.
Compared with the prior art, the embodiment of the application has the following advantages:
the embodiment of the application provides a processing method based on face unlocking, which can be executed by a terminal device, and particularly, the terminal device can acquire a face image of a user. The expression of the user can reflect whether the user has the unlocking intention, so that after the terminal equipment acquires the face image, the expression of the user can be identified according to the face image, whether the user has the unlocking intention is determined according to the expression of the user, and the terminal equipment does not trigger the unlocking operation under the condition that the terminal equipment determines that the user does not have the unlocking intention. Therefore, in the embodiment of the application, the terminal device can determine the expression of the user according to the face image, determine whether the user has the unlocking intention according to the expression of the user, and not trigger the unlocking operation when the user does not have the unlocking intention. Therefore, when the user is in a passive state, unlocking operation cannot be realized through face recognition, and potential safety hazards are reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flow chart of a processing method based on face unlocking according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a voice data processing method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a processing device based on face unlocking according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The inventor of the application finds that in the prior art, "face unlocking" is convenient to use, but certain potential safety hazards exist, for example, when a user intelligent terminal is robbed, a user is coerced, or other passive conditions exist, as long as the face of the user is aligned with a camera of the intelligent terminal, the screen of the intelligent terminal can be unlocked.
In order to solve the above problem, an embodiment of the present application provides a processing method based on face unlocking, and the method can make a user in a passive state unable to implement unlocking operation through face recognition, thereby reducing potential safety hazards.
Various non-limiting embodiments of the present application are described in detail below with reference to the accompanying drawings.
Exemplary method
Referring to fig. 1, the figure is a schematic flowchart of a processing method based on face unlocking according to an embodiment of the present application. The processing method based on face unlocking provided by the embodiment of the application can be executed by terminal equipment, wherein the terminal equipment includes but is not limited to smart devices such as smart phones and tablet computers.
The method provided by the embodiment of the application can comprise the following steps S101-S104.
S101: the terminal equipment acquires a face image of a user.
In the embodiment of the application, the terminal device can shoot the face image of the user by using the camera, so that the face image of the user is obtained. The user referred to herein refers to a legitimate user of the terminal device. Specifically, the terminal device may pre-store a face image of a valid user, so that the terminal device may determine that the user in the currently-photographed face image is the valid user of the terminal device according to the pre-stored face image.
S102: and the terminal equipment determines the expression of the user according to the facial image.
S103: and determining whether the user has unlocking intention according to the expression.
In the embodiment of the present application, it is considered that in practical applications, once a user is in a passive state, for example, a state of being coerced or the like. Illicit persons who coerce the user may force the user to unlock with a human face. In this case, a certain property loss may be caused to the user. The expression of the user when the unlocking is actively triggered and the expression of the user in a coerced state are considered to have a certain difference. In other words, the expression of the user may reflect whether the user has an unlocking intention. Therefore, in the embodiment of the application, the expression of the user can be recognized according to the facial image, and whether the user has the unlocking intention or not is further determined according to the determined expression.
In this embodiment of the application, in a specific implementation of S102, the terminal device may determine the expression of the user according to a pre-stored expression library, for example. Specifically, the expression library may include a plurality of facial images and expressions corresponding to the facial images. The terminal device may match the facial image acquired in S101 with an expression library, thereby determining the expression of the user.
After the expression of the user is determined, the terminal device may determine whether the user has the unlocking intention according to the corresponding relationship between the expression and the unlocking intention, for example. The correspondence between expressions and intentions can be understood in conjunction with table 1 below.
TABLE 1
Expression of facial expressions Intention to unlock
Smile (smile) Having an intention of unlocking
Frown Without intention of unlocking
It should be noted that table 1 is shown only for convenience of understanding, and does not limit the embodiments of the present application. The expressions mentioned in the embodiment of the present application are not limited to "smile" and "frown" shown in table 1, and description thereof is not given here for other expressions.
S104: and the terminal equipment does not trigger unlocking operation when determining that the user does not have the unlocking intention.
In the embodiment of the application, when the terminal device determines that the user does not have the unlocking intention, the unlocking operation is not triggered. Therefore, when the user is in a passive state, unlocking operation cannot be realized through face recognition, and potential safety hazards are reduced.
In an implementation manner of the embodiment of the present application, it is considered that in practical application, although a user is in a passive state, the user cannot recognize the user through an expression of the user. For example, an illicit person forces the user to maintain a normal expression. When the user is in a passive state, for example, a duress state, the communication content between the user and illegal persons of the duress user can show that the user is in the passive state. In view of this, in some embodiments, the terminal device may also perform the steps shown in fig. 2. Fig. 2 is a flowchart illustrating a voice data processing method according to an embodiment of the present application. The method shown in fig. 2 can be implemented by the following steps S201 to S203.
S201: and under the condition that the user is determined to have the unlocking intention, the terminal equipment acquires voice data.
The user has the unlocking intention, which means that the user is determined to have the unlocking intention through the expression of the user. The terminal equipment can acquire the voice data through a voice acquisition device on the terminal equipment.
S202: and the terminal equipment determines whether the user is in a passive state or not according to the voice data.
In the embodiment of the application, after the terminal device acquires the voice data, semantic analysis can be performed on the voice data, so as to determine whether the user is in a passive state. Specifically, the terminal device may first convert the voice data into a text, then perform word segmentation processing on the text, and determine the semantics of the voice data according to a plurality of word segments obtained by word segmentation. After determining the semantics of the voice data, it may be determined whether the user is in a passive state. For example, the voice data is: and if not, the user is determined to be in a coerced state after voice analysis is carried out on the voice data.
S203: and the terminal equipment does not trigger unlocking operation when determining that the user is in the passive state.
The problem that potential safety hazards are brought when the terminal equipment is unlocked by face unlocking due to the fact that a user is forced is solved. In the embodiment of the application, when it is determined that the user is in the passive state through the voice data, the unlocking operation may not be triggered. Correspondingly, if the user is determined not to be in the passive state through the voice data, the unlocking operation is triggered.
In one implementation manner of the embodiment of the present application, it is considered that in practical applications, a user may be forced to use the mobile terminal. For this situation, when "determining that the user does not have the unlocking intention using S101 to S103" or "determining that the user is in the passive state using S201 to S202", the screen locking operation may be performed, so as to avoid a corresponding loss to the user due to an illegal person operating the terminal device.
In one implementation of the embodiment of the application, it is considered that some applications, such as mobile banking, which can perform property transactions, may be run on the terminal device. For convenience of description, these applications will be referred to as "target applications". In order to ensure the property security of the user, after determining that the user does not have the unlocking intention by using S101-S103, the account corresponding to the target application program can be frozen. Or when the user is determined to be in the passive state by using S201-S202, the account corresponding to the target application program is frozen. By adopting the method, illegal personnel can be prevented from operating the account, and property loss is brought to the user. It should be noted that, the account corresponding to the target application mentioned herein refers to an account operated by the user through the target application, for example, a certain bank card of the user.
Exemplary device
Based on the method provided by the above embodiment, the embodiment of the present application further provides an apparatus, which is described below with reference to the accompanying drawings.
Referring to fig. 3, the figure is a schematic structural diagram of a processing device based on face unlocking in an embodiment of the present application.
The apparatus 300 shown in fig. 3 may specifically include, for example: a first acquisition unit 301, a recognition unit 302, a first determination unit 303 and an execution unit 304.
The first acquiring unit 301 is used for acquiring a face image of a user;
the recognition unit 302 is configured to recognize an expression of the user according to the facial image;
the first determining unit 303 is configured to determine whether the user has an unlocking intention according to the expression;
the first execution unit 304 is configured to not trigger an unlocking operation when it is determined that the user does not have an unlocking intention.
Optionally, the apparatus further comprises:
the second acquisition unit is used for acquiring voice data under the condition that the user is determined to have the unlocking intention;
a second determining unit, configured to determine whether the user is in a passive state according to the voice data;
and the second execution unit is used for not triggering the unlocking operation when the user is determined to be in the passive state.
Optionally, the apparatus further comprises:
and the freezing unit is used for freezing the account corresponding to the target application program operated on the terminal equipment.
Optionally, if the terminal device is in an unlocked state, the apparatus further includes:
and the third execution unit is used for executing screen locking operation.
Optionally, the apparatus further comprises:
and the fourth execution unit is used for triggering unlocking operation when the user is determined not to be in the passive state.
Since the apparatus 300 is an apparatus corresponding to the method provided in the above method embodiment, and the specific implementation of each unit of the apparatus 300 is the same as that of the above method embodiment, for the specific implementation of each unit of the apparatus 300, reference may be made to the description part of the above method embodiment, and details are not repeated here.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice in the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the attached claims
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (10)

1. A processing method based on face unlocking is characterized by comprising the following steps:
the method comprises the steps that terminal equipment obtains a face image of a user;
the terminal equipment identifies the expression of the user according to the face image;
determining whether the user has unlocking intention according to the expression;
and when the terminal equipment determines that the user does not have the unlocking intention, the terminal equipment does not trigger the unlocking operation.
2. The method of claim 1, further comprising:
under the condition that the user is determined to have the unlocking intention, the terminal equipment acquires voice data;
the terminal equipment determines whether the user is in a passive state or not according to the voice data;
and the terminal equipment does not trigger unlocking operation when determining that the user is in the passive state.
3. The method according to claim 1 or 2, characterized in that the method further comprises:
and freezing an account corresponding to the target application program running on the terminal equipment.
4. The method according to any one of claims 1 to 3, wherein if the terminal device is in the unlocked state, the method further comprises:
and the terminal equipment executes screen locking operation.
5. The method of claim 2, further comprising:
and when the terminal equipment determines that the user is not in the passive state, triggering unlocking operation.
6. A processing device based on human face unlocking is characterized in that the processing device is applied to terminal equipment, and the device comprises:
the first acquisition unit is used for acquiring a face image of a user;
the recognition unit is used for recognizing the expression of the user according to the face image;
the first determining unit is used for determining whether the user has unlocking intention according to the expression;
the first execution unit is used for not triggering the unlocking operation when the user is determined not to have the unlocking intention.
7. The apparatus of claim 6, further comprising:
the second acquisition unit is used for acquiring voice data under the condition that the user is determined to have the unlocking intention;
a second determining unit, configured to determine whether the user is in a passive state according to the voice data;
and the second execution unit is used for not triggering the unlocking operation when the user is determined to be in the passive state.
8. The apparatus of claim 6 or 7, further comprising:
and the freezing unit is used for freezing the account corresponding to the target application program operated on the terminal equipment.
9. The apparatus according to any one of claims 6-8, wherein if the terminal device is in the unlocked state, the apparatus further comprises:
and the third execution unit is used for executing screen locking operation.
10. The apparatus of claim 7, further comprising:
and the fourth execution unit is used for triggering unlocking operation when the user is determined not to be in the passive state.
CN202010501405.9A 2020-06-04 2020-06-04 Processing method and device based on face unlocking Pending CN111625799A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010501405.9A CN111625799A (en) 2020-06-04 2020-06-04 Processing method and device based on face unlocking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010501405.9A CN111625799A (en) 2020-06-04 2020-06-04 Processing method and device based on face unlocking

Publications (1)

Publication Number Publication Date
CN111625799A true CN111625799A (en) 2020-09-04

Family

ID=72260251

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010501405.9A Pending CN111625799A (en) 2020-06-04 2020-06-04 Processing method and device based on face unlocking

Country Status (1)

Country Link
CN (1) CN111625799A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105082150A (en) * 2015-08-25 2015-11-25 国家康复辅具研究中心 Robot man-machine interaction method based on user mood and intension recognition
CN205621018U (en) * 2016-02-26 2016-10-05 陈进民 Cell -phone cell convolutional neural network accelerator
US20170372056A1 (en) * 2016-06-28 2017-12-28 Paypal, Inc. Visual data processing of response images for authentication
CN109472608A (en) * 2018-10-16 2019-03-15 深圳壹账通智能科技有限公司 Business confirmation method and terminal device based on Emotion identification

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105082150A (en) * 2015-08-25 2015-11-25 国家康复辅具研究中心 Robot man-machine interaction method based on user mood and intension recognition
CN205621018U (en) * 2016-02-26 2016-10-05 陈进民 Cell -phone cell convolutional neural network accelerator
US20170372056A1 (en) * 2016-06-28 2017-12-28 Paypal, Inc. Visual data processing of response images for authentication
CN109472608A (en) * 2018-10-16 2019-03-15 深圳壹账通智能科技有限公司 Business confirmation method and terminal device based on Emotion identification

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
郝耀华 郝特达: "《宝贝,手机》", 31 July 2014, 北京测绘出版社 *

Similar Documents

Publication Publication Date Title
CN105447454B (en) Fingerprint template improving method, device and terminal device
US8340366B2 (en) Face recognition system
US9262614B2 (en) Image processing device, image processing method, and storage medium storing image processing program
US8121359B2 (en) Fingerprint identification system and method of an electronic device
CN102930436A (en) Mobile payment method and device
EP2677495A1 (en) Biometric authentication device, biometric authentication method, and computer program for biometric authentication
US10282627B2 (en) Method and apparatus for processing handwriting data
KR20190122206A (en) Identification methods and devices, electronic devices, computer programs and storage media
EP2701096A2 (en) Image processing device and image processing method
CN107368722A (en) Verification method, computer-readable recording medium, the mobile terminal of biometric image
US20090316960A1 (en) Mobile electronic device security protecting system and method
US10936706B2 (en) Biometric authentication
CN111625799A (en) Processing method and device based on face unlocking
CN108985035B (en) Control method and device for user operation authority, storage medium and electronic equipment
CN107992733B (en) Intelligent terminal and safety unlocking method thereof
CN108063665B (en) Communication method and terminal device
Akhtar et al. Multitrait Selfie: Low-Cost Multimodal Smartphone User Authentication
US10867022B2 (en) Method and apparatus for providing authentication using voice and facial data
KR20180093294A (en) Method and Device for Authenticating using Pressure Information
JP7260145B2 (en) Authentication device, authentication terminal, authentication method, program and recording medium
CN113705428A (en) Living body detection method and apparatus, electronic device, and computer-readable storage medium
CN111813475A (en) Dynamic information display method based on negative one-screen combination with face recognition
CN112417429A (en) Security verification method and device, electronic equipment and storage medium
WO2022270114A1 (en) Method for preventing unauthorized access to information device or communication device
CN102087714A (en) Image identification logon system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200904

RJ01 Rejection of invention patent application after publication