CN109165588B - Face expression recognition encryption unlocking device and method - Google Patents

Face expression recognition encryption unlocking device and method Download PDF

Info

Publication number
CN109165588B
CN109165588B CN201810915955.8A CN201810915955A CN109165588B CN 109165588 B CN109165588 B CN 109165588B CN 201810915955 A CN201810915955 A CN 201810915955A CN 109165588 B CN109165588 B CN 109165588B
Authority
CN
China
Prior art keywords
area
unlocking
facial
central processing
processing module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810915955.8A
Other languages
Chinese (zh)
Other versions
CN109165588A (en
Inventor
韩超
翟蒙锁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anhui Polytechnic University
Original Assignee
Anhui Polytechnic University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anhui Polytechnic University filed Critical Anhui Polytechnic University
Priority to CN201810915955.8A priority Critical patent/CN109165588B/en
Publication of CN109165588A publication Critical patent/CN109165588A/en
Application granted granted Critical
Publication of CN109165588B publication Critical patent/CN109165588B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Collating Specific Patterns (AREA)
  • Lock And Its Accessories (AREA)

Abstract

The invention discloses a device and a method for encrypting and unlocking facial expression recognition, belonging to the technical field of image processing and mode recognition. According to the invention, different characters are associated by collecting different expressions of the face, so that a dynamic password depending on the face expression is formed, the potential safety hazard problem of unlocking by video disguising the face is solved, the dynamic password is displayed by the display screen when the face expression is identified, then the identification sequence of the alphabetic expression input by related personnel is different every time, and the safety is obviously improved.

Description

Face expression recognition encryption unlocking device and method
Technical Field
The invention relates to the technical field of image processing and pattern recognition, in particular to a device and a method for encrypting and unlocking facial expression recognition.
Background
With the progress of science and technology, more and more people face the identity confirmation problems of private offices, personal intelligent strongboxes, computer users login and authorized transaction systems and the like. The safe, reliable and convenient identity authentication method and device not only can effectively protect the safety of personal property and information, but also bring more convenience and benefits to the daily life of people. However, how to accurately identify the identity of an individual remains a key issue in the information age. Existing unlocking methods typically use face recognition unlocking or digital password unlocking. The digital password is easy to crack, single face recognition can also realize unlocking by video disguising the face, and even if the face recognition or the digital password is used in a mixed way, the safety is not obviously improved. If someone obtains the face picture and the digital password at the same time, unlocking can be performed. In some highly confidential places, passwords may be broken and may cause significant losses.
Disclosure of Invention
According to the defects of the prior art, the technical problem to be solved by the invention is to provide a device and a method for recognizing, encrypting and unlocking facial expressions, wherein different characters are associated with different expressions of the faces to form dynamic passwords depending on the facial expressions, so that the potential safety hazard problem of unlocking by video camouflage of the faces is solved, the dynamic passwords are displayed on a display screen when the facial expressions are recognized each time, then the recognition sequence of the alphabetic expressions input by related personnel is different each time, and the safety is obviously improved.
In order to solve the technical problems, the invention adopts the technical scheme that: the utility model provides a facial expression discernment encryption unlocking device, the surface of device is equipped with image acquisition district, display area and keyboard district, and set up the image preprocessing module in the device, face detection module, expression recognition module and central processing module, the display area is located between image acquisition district and the keyboard district, image preprocessing module and central processing module are connected to face detection module, expression recognition module is connected to image preprocessing module's output, expression recognition module, central processing module is all connected to image acquisition district and keyboard district, the display area is connected to central processing module's output, the keyboard district is equipped with the character that corresponds different facial expressions. And a light source is arranged on the side edge of the image acquisition area and works according to an image acquisition instruction. The keyboard area is provided with a letter area, a setting button, a 0 button and a confirming button.
The facial expression recognition encryption unlocking device is provided with a method for using facial expression recognition encryption unlocking, characters in a facial expression associated character area are input by utilizing buttons of a keyboard area and an image acquisition area, facial expression encryption is completed, when unlocking is performed, a dynamic character password is displayed in a display area, facial image information is sequentially acquired in the image acquisition area, whether the acquired facial image information and the dynamic character password are consistent or not is judged by a central processing module, an unlocking result is displayed in the display area, and unlocking verification work is completed.
The method comprises an encryption method and an unlocking method, wherein the encryption method in the face expression encryption is as follows: the user presses a 'setting' key, after the user inputs a management password for confirmation, different facial expressions corresponding to characters are sequentially input through the reminding of the display area, the facial expressions and the different characters of the character area are transmitted to the central processing module for storage, the facial expressions and the different characters of the character area are associated until the facial expression recognition corresponding to all letters of the character area is completed, the 'confirming' key is pressed, and the facial expression recognition encryption is completed. The unlocking method during unlocking comprises the following steps: pressing a 'confirm' key, generating a dynamic password by the central processing module, displaying the dynamic password and prompting a user to look ahead on the display, acquiring face image information through the front-looking image acquisition area, comparing the acquired face image information with the internally stored face image information by the central processing module in sequence, and displaying a comparison result in sequence below the dynamic password of the display area.
The invention has the advantages that the expression of each letter of the letter code can be freely set, only a party knows the expression corresponding to each letter, even if the party obtains the face of the party or obtains the letter code, the expression corresponding to the letter is not known, the unlocking cannot be carried out, the display screen displays the dynamic code when the face expression recognition is carried out every time, then the relevant personnel input the letter expression recognition sequence every time, and the safety is obviously improved.
Drawings
The contents of the drawings and the reference numerals in the drawings are briefly described as follows:
FIG. 1 is a schematic structural diagram of a facial expression recognition encryption unlocking device according to the present invention;
fig. 2 is a flowchart of a procedure of a facial expression recognition encryption unlocking device;
fig. 3 is a schematic diagram of facial expression encryption.
Detailed Description
The following description of the embodiments with reference to the drawings is provided to describe the embodiments of the present invention, and the embodiments of the present invention, such as the shapes and configurations of the components, the mutual positions and connection relationships of the components, the functions and working principles of the components, the manufacturing processes and the operation and use methods, etc., will be further described in detail to help those skilled in the art to more completely, accurately and deeply understand the inventive concept and technical solutions of the present invention.
A facial expression recognition, encryption and unlocking device is shown in figures 1-2, an image acquisition area, a display area and a keyboard area are arranged on the outer surface of the device, an image preprocessing module, a face detection module, an expression recognition module and a central processing module are arranged in the device, the display area is located between the image acquisition area and the keyboard area, the face detection module is connected with the image preprocessing module and the central processing module, the output end of the image preprocessing module is connected with the expression recognition module, the image acquisition area and the keyboard area are connected with the central processing module, the output end of the central processing module is connected with the display area, and the keyboard area is provided with characters corresponding to different facial expressions.
And a light source is arranged on the side edge of the image acquisition area and works according to an image acquisition instruction. The keyboard area is provided with a letter area, a setting button, a 0 button and a confirming button. The keyboard area is mainly divided into three rows, the first row is H, S, W, and the second row is A, D, F; the third row is set, 0 or definite; the "set" key length is pressed as "cancel" function, and S,0, a and F also correspond to up, down, left, and right functions of the direction key, respectively.
A face expression recognition encryption unlocking device is internally provided with a face expression recognition encryption unlocking method; the method comprises the steps that characters of a facial expression associated character area are input by utilizing buttons of a keyboard area and an image acquisition area, the encryption of the facial expression is completed, when the facial expression is unlocked, a dynamic character password is displayed in a display area, facial image information is sequentially acquired by the image acquisition area, whether the acquired facial image information and the dynamic character password are consistent or not is judged by a central processing module, an unlocking result is displayed in the display area, and unlocking verification work is completed.
The encryption method comprises the following steps: the user presses a 'setting' key, after the user inputs a management password for confirmation, different facial expressions corresponding to characters are sequentially input through the reminding of the display area, the facial expressions and the different characters of the character area are transmitted to the central processing module for storage, the facial expressions and the different characters of the character area are associated until the facial expression recognition corresponding to all letters of the character area is completed, the 'confirming' key is pressed, and the facial expression recognition encryption is completed.
As shown in fig. 3, the specific content is: the user presses a 'setting' key and inputs a management password for confirmation, a display screen is arranged in a display area, the display screen displays 'please see the camera to input H expressions', the user inputs H facial expression images through an image acquisition area, the expressions are any facial expressions based on 6 basic expressions (Happy, Sad, surprised Wonder, Angry, disgust and Fear) of facial expression codes, any facial expression can be used, 6 basic expressions with larger characteristic difference are preferred in the text, the image acquisition area is filled with light and the obtained images are transmitted to an image preprocessing module, the facial expression images are processed by the image preprocessing module and transmitted to a face detection module and an expression recognition module to execute face characteristic extraction and expression characteristic extraction, the processed face identity characteristics and expression characteristics are transmitted to a central processing module, the central processing module stores the face identity characteristics to a storage module, and the expression characteristics are associated to be H expressions, and the output module displays H expression image entry completion through the display screen. Then pressing a 'confirm' key, displaying 'please look at the camera to input an S expression' on a display screen, inputting an S facial expression image by a user through an image acquisition area, wherein the expression is any facial expression based on 6 basic expressions (Happy, Sad, surprised Wonder, Angry, disgust disposted and Fear) of facial expression codes, and repeating the steps until the facial expression recognition corresponding to all letters is completed, pressing the 'confirm' key, and completing the encryption of the facial expression recognition.
The unlocking method during unlocking comprises the following steps: pressing a 'confirm' key, generating a dynamic password by the central processing module, displaying the dynamic password and prompting a user to look ahead on the display, acquiring face image information through the front-looking image acquisition area, comparing the acquired face image information with the internally stored face image information by the central processing module in sequence, and displaying a comparison result in sequence below the dynamic password of the display area.
The concrete contents are as follows: pressing a 'confirm' key, generating a dynamic password by a central processing module, displaying the dynamic password and prompting a user to look ahead at a camera on a display, inputting a face image by the user through a front-looking image acquisition area, supplementing light in the image acquisition area and acquiring the image and transmitting the image to an image preprocessing module, processing the face image by the image preprocessing module, transmitting the face image to a face detection module and an expression recognition module to perform face feature extraction and face expression feature extraction, transmitting the processed face identity feature and expression feature to the central processing module, comparing the face identity feature with the face identity feature of a storage module by the central processing module, and if the storage module contains the face identity, displaying letters corresponding to the face expression feature below the dynamic password on the display screen, wherein the displayed letters are invisible and are represented by a 'check mark'; and (2) the user looks at the image acquisition area again for recognition, and by analogy, after the facial expressions corresponding to all dynamic password letters are recognized all the time, the lower part of the dynamic password on the display shows that the digits are the same as the dynamic password. Then pressing a 'confirm' key, so that the processing module detects the password displayed on the display, compares the password with the dynamic password, and completes unlocking if the password is consistent with the dynamic password; if not, the display displays 'password error, re-authentication'.
According to the encryption unlocking method, each letter can be set with the expression corresponding to the meaning, memory is not needed, and the problems that a digital password is easy to forget and the like are solved. The expression of each letter can also be freely set, the problems that a digital password is easy to crack, unlocking can be realized by video camouflage of the face through single face recognition and the like are solved, even if an opposite side obtains the face of a person concerned or obtains the letter password, the expression corresponding to the letter is unknown, unlocking cannot be realized, a display screen displays a dynamic password when face expression recognition is carried out every time, then relevant personnel input letter expression recognition sequences every time, and safety is remarkably improved.
The invention has been described above with reference to the accompanying drawings, it is obvious that the invention is not limited to the specific implementation in the above-described manner, and it is within the scope of the invention to apply the inventive concept and solution to other applications without substantial modification. The protection scope of the present invention shall be subject to the protection scope defined by the claims.

Claims (5)

1. A facial expression recognition, encryption and unlocking device is characterized in that an image acquisition area, a display area and a keyboard area are arranged on the outer surface of the device, and an image preprocessing module, a face detection module, an expression recognition module and a central processing module are arranged in the device, wherein the display area is positioned between the image acquisition area and the keyboard area, the face detection module is connected with the image preprocessing module and the central processing module, the output end of the image preprocessing module is connected with the expression recognition module, the image acquisition area and the keyboard area are all connected with the central processing module, the output end of the central processing module is connected with the display area, and the keyboard area is provided with characters corresponding to different facial expressions;
inputting characters of the facial expression associated character area by utilizing buttons of the keyboard area and the image acquisition area, completing encryption of the facial expression, displaying a dynamic character password in the display area during unlocking, sequentially acquiring facial image information in the image acquisition area, judging whether the acquired facial image information and the dynamic character password are consistent by the central processing module, displaying an unlocking result in the display area, and completing unlocking verification work;
the characters corresponding to the facial expression features are displayed below the dynamic password on the display screen, the displayed characters are invisible after verification and are represented by the square root, and the comparison results are sequentially displayed below the dynamic password in the display area.
2. The device for recognizing, encrypting and unlocking facial expressions according to claim 1 is characterized in that a light source is arranged on the side of the image acquisition area and works according to an image acquisition instruction.
3. The device for recognizing, encrypting and unlocking a facial expression as claimed in claim 1, wherein the keyboard region is provided with a letter region, a setting button, a 0 button and a decision button.
4. The device for recognizing, encrypting and unlocking facial expressions according to claim 1 is characterized in that the encryption method in the encryption of the facial expressions is as follows: the user presses a 'setting' key, after the user inputs a management password for confirmation, different facial expressions corresponding to characters are sequentially input through the reminding of the display area, the facial expressions and the different characters of the character area are transmitted to the central processing module for storage, the facial expressions and the different characters of the character area are associated until the facial expression recognition corresponding to all letters of the character area is completed, the 'confirming' key is pressed, and the facial expression recognition encryption is completed.
5. The device for recognizing, encrypting and unlocking facial expressions according to claim 1 is characterized in that the unlocking method during unlocking is as follows: pressing a 'confirm' key, generating a dynamic password by the central processing module, displaying the dynamic password and prompting a user to look ahead on the display, acquiring face image information through the front-looking image acquisition area, comparing the acquired face image information with the internally stored face image information by the central processing module in sequence, and displaying a comparison result in sequence below the dynamic password of the display area.
CN201810915955.8A 2018-08-13 2018-08-13 Face expression recognition encryption unlocking device and method Expired - Fee Related CN109165588B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810915955.8A CN109165588B (en) 2018-08-13 2018-08-13 Face expression recognition encryption unlocking device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810915955.8A CN109165588B (en) 2018-08-13 2018-08-13 Face expression recognition encryption unlocking device and method

Publications (2)

Publication Number Publication Date
CN109165588A CN109165588A (en) 2019-01-08
CN109165588B true CN109165588B (en) 2021-10-15

Family

ID=64895673

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810915955.8A Expired - Fee Related CN109165588B (en) 2018-08-13 2018-08-13 Face expression recognition encryption unlocking device and method

Country Status (1)

Country Link
CN (1) CN109165588B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111104923A (en) * 2019-12-30 2020-05-05 北京字节跳动网络技术有限公司 Face recognition method and device
CN113536262A (en) * 2020-09-03 2021-10-22 腾讯科技(深圳)有限公司 Unlocking method and device based on facial expression, computer equipment and storage medium
CN113553978A (en) * 2021-07-30 2021-10-26 陕西科技大学 Face recognition device and recognition method for user-defined strategy

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103778360A (en) * 2012-10-26 2014-05-07 华为技术有限公司 Face unlocking method and device based on motion analysis
CN102946481A (en) * 2012-11-13 2013-02-27 广东欧珀移动通信有限公司 Method and system for unlocking human face expression
TW201504839A (en) * 2013-07-19 2015-02-01 Quanta Comp Inc Portable electronic apparatus and interactive human face login method
CN104683302A (en) * 2013-11-29 2015-06-03 国际商业机器公司 Authentication method, authentication device, terminal equipment, authentication server and system
CN104700007B (en) * 2015-03-18 2017-08-04 詹万泉 A kind of setting of gesture impression password and application process
US10210320B2 (en) * 2016-09-21 2019-02-19 Lextron Systems, Inc. System and method for secure 5-D user identification
CN106503620A (en) * 2016-09-26 2017-03-15 深圳奥比中光科技有限公司 Numerical ciphers input method and its system based on gesture

Also Published As

Publication number Publication date
CN109165588A (en) 2019-01-08

Similar Documents

Publication Publication Date Title
US10671716B2 (en) User authentication method and system using variable keypad and biometric identification
CN109165588B (en) Face expression recognition encryption unlocking device and method
US10592653B2 (en) Encoding methods and systems
US20090293119A1 (en) User authentication method and system and password management system
CN105760817A (en) Method and device for recognizing, authenticating, unlocking and encrypting storage space by using human face
CA3115834A1 (en) Biocrypt digital wallet
CN104809375A (en) Mobile terminal unlocking method and device
CN103886237A (en) Control method and system for electronic device with fingerprint sensor and touch screen
CN104239770A (en) Method and system for enabling mobile terminal to enter application program under standby state
JP2014211838A (en) Biometric authentication apparatus, biometric authentication system, and biometric authentication method
US10601822B2 (en) Multifactor authentication device
Prasad et al. A study on multifactor authentication model using fingerprint hash code, password and OTP
CN106534479A (en) Cell phone password protection system based on implicit code identification and implicit conversion
CN104915590A (en) Human face recognition system and method applied to computer encryption
CN104680047A (en) Method and device for electronic authentication
CN101790165A (en) Mobile phone finger print identifier and use method
CN108780476A (en) Method for verifying personnel identity
JPH03288954A (en) User certifying method
CN106484704A (en) A kind of image processing method and device
CN112182556A (en) Pressure dimension test system for intelligent unlocking
Patil et al. A graphical password using token, biometric, knowledge based authentication system for mobile devices
CN104702414A (en) Identity authentication method based on fingerprint information
CN202077040U (en) Dynamic password token device and system
CN113704748A (en) Password verification method based on drawing
JP4146273B2 (en) Electronic document approval system, approval method, and program used in this system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20211015