CN110032924A - Recognition of face biopsy method, terminal device, storage medium and electronic equipment - Google Patents
Recognition of face biopsy method, terminal device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN110032924A CN110032924A CN201910130729.3A CN201910130729A CN110032924A CN 110032924 A CN110032924 A CN 110032924A CN 201910130729 A CN201910130729 A CN 201910130729A CN 110032924 A CN110032924 A CN 110032924A
- Authority
- CN
- China
- Prior art keywords
- identifying code
- face
- code
- recognition
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000001574 biopsy Methods 0.000 title claims abstract description 25
- 238000012795 verification Methods 0.000 claims abstract description 106
- 238000001514 detection method Methods 0.000 claims abstract description 57
- 238000001727 in vivo Methods 0.000 claims abstract description 48
- 230000001815 facial effect Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 18
- 238000013461 design Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 230000009471 action Effects 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 229910001507 metal halide Inorganic materials 0.000 description 3
- 150000005309 metal halides Chemical class 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000005086 pumping Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 238000005242 forging Methods 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 229910052738 indium Inorganic materials 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/24—Speech recognition using non-acoustical features
- G10L15/25—Speech recognition using non-acoustical features using position of the lips, movement of the lips or face analysis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
- G10L17/24—Interactive procedures; Man-machine interfaces the user being prompted to utter a password or a predefined phrase
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
- H04L9/3226—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using a predetermined code, e.g. password, passphrase or PIN
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Signal Processing (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of recognition of face biopsy method, terminal device, storage medium and electronic equipment.Recognition of face biopsy method provided by the invention, after face information that include: in determining accessed image to be detected include, generate simultaneously displaying target identifying code, then the video information that target user reads aloud the target verification code is recorded, identification identifying code is determined further according to the video information, and judge whether the identification identifying code is identical as the target verification code, if the determination result is YES, it is determined that the recognition of face In vivo detection of target user passes through.Recognition of face biopsy method provided by the invention carries out In vivo detection by way of reading aloud target verification code, greatly optimizes user experience.
Description
Technical field
The present invention relates to technical field of computer vision more particularly to a kind of recognition of face biopsy method, terminal to set
Standby, storage medium and electronic equipment.
Background technique
With the continuous development of biological identification technology and artificial intelligence technology, biometrics identification technology has tended to be mature,
And be that the biological characteristic for preventing malicious person from forging and stealing other people is used for authentication, biological recognition system need to usually have living body
Detection function, that is, judge whether the biological characteristic submitted comes from lived individual.
In the prior art, In vivo detection is the method that object real physiological feature is determined in some authentication scenes.
In face recognition application, In vivo detection can be by blinking, opening one's mouth, shake the head, put first-class combinative movement, by using face key
The technologies such as point location and face tracking to ensure that user is true living body, rather than use the modes such as photo or reproduction video
Carry out malicious attack.
But for current In vivo detection technology, need that user is required to cooperate to carry out a series of specified face actions, this
The unnatural facial behavior verification mode of kind can especially make in public these face actions to user with constriction,
It is easy to cause to perplex to user.
Summary of the invention
The present invention provides a kind of recognition of face biopsy method, terminal device, storage medium and electronic equipment, so that
When carrying out In vivo detection, unnatural facial behavior verification mode perplexs user to brought by user.
In a first aspect, the present invention provides a kind of recognition of face biopsy method, comprising:
It include generation and displaying target identifying code after face information in determining accessed image to be detected；
Record the video information that target user reads aloud the target verification code；
Identification identifying code is determined according to the video information, and judges the identification identifying code and the target verification code phase
It is whether identical；
If the determination result is YES, it is determined that the recognition of face In vivo detection of the target user passes through.
It is described that identification identifying code is determined according to the video information in a kind of possible design, and judge the identification
Whether identifying code and the target verification code are identical, comprising:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Judge whether the first identification identifying code and the target verification code are identical.
It is described that identification identifying code is determined according to the video information in a kind of possible design, and judge the identification
Whether identifying code and the target verification code are identical, comprising:
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
Judge whether the second identification identifying code and the target verification code are identical.
It is described to judge whether the identification identifying code is identical as the target verification code in a kind of possible design, and
Judge whether the identification identifying code and the target verification code are identical, comprising:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
Judge whether the first identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the second identification identifying code is identical as the target verification code；Alternatively,
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
Judge whether the second identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the first identification identifying code is identical as the target verification code.
In a kind of possible design, it is described in determining image to be detected for getting include face information after,
Generate simultaneously displaying target identifying code, comprising:
Video to be detected is obtained, the video to be detected includes the complete facial information of the target user；
The target verification code is generated at random, and by the target verification code simultaneous display on the video to be detected.
In a kind of possible design, after the recognition of face In vivo detection for determining the target user passes through, also wrap
It includes:
The human face image information in the video information is extracted, and recognition of face is carried out according to the human face image information.
Second aspect, the present invention also provides a kind of terminal devices, comprising:
Face determining module, for determining that in accessed image to be detected include face information；
Identifying code generation module, for generating target verification code；
Identifying code display module, for showing the target verification code；
Video record module reads aloud the video information of the target verification code for recording target user；
Identifying code determining module, for determining identification identifying code according to the video information；
Identifying code contrast module, for judging whether the identification identifying code is mutually identical as the target verification code；
As a result determining module, for determining the target when the identification identifying code is identical as the target verification code
The recognition of face In vivo detection of user passes through.
In a kind of possible design, the identifying code determining module is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
The identifying code contrast module, is specifically used for:
Judge whether the first identification identifying code and the target verification code are identical.
In a kind of possible design, the identifying code determining module is specifically used for:
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
The identifying code contrast module, is specifically used for:
Judge whether the second identification identifying code and the target verification code are identical.
In a kind of possible design, the identifying code determining module is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
The identifying code contrast module, is specifically used for:
Judge whether the first identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the second identification identifying code and the target verification code are identical；Or
The identifying code determining module, is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
The identifying code contrast module, is specifically used for:
Judge whether the second identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the first identification identifying code and the target verification code are identical.
In a kind of possible design, the face determining module is specifically used for:
Video to be detected is obtained, the video to be detected includes the complete facial information of the target user；
The identifying code generation module 202, is specifically used for:
The target verification code is generated at random, and by the target verification code simultaneous display on the video to be detected.
In a kind of possible design, the terminal device, further includes:
Face recognition module 208, for extracting the human face image information in the video information, and according to the face figure
As information carries out recognition of face.
The third aspect, the present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, the journey
Any one possible recognition of face biopsy method in first aspect is realized when sequence is executed by processor.
Fourth aspect, the present invention also provides a kind of electronic equipment, comprising:
Camera, processor, memory and display；
The camera and the display are connected with the processor respectively；
The camera, for obtaining the video information of target user face；
The memory, for storing the executable instruction of the processor；
The display, for showing the video information and target verification code；
Wherein, the processor is configured to execute any possibility in first aspect via the executable instruction is executed
Recognition of face biopsy method.
A kind of recognition of face biopsy method, terminal device, storage medium and electronic equipment provided by the invention, in work
When physical examination survey is triggered, by generating simultaneously displaying target identifying code, and obtains target user and read aloud shown target verification code
Video information is determining identification identifying code according to the video information got, finally, by comparing target verification code and identification
Identifying code determines whether testing result is living body, so as to avoid user carries out living body by the unnatural mode made eyes
The embarrassment of detection, and In vivo detection is carried out using more natural mode, user experience is greatly optimized, face knowledge is conducive to
The promotion and application of other technology.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without any creative labor, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the application scenario diagram of recognition of face biopsy method shown according to an exemplary embodiment；
Fig. 2 is the flow chart of recognition of face biopsy method shown according to an exemplary embodiment；
Fig. 3 is the exemplary method flowchart that identification identifying code is determined according to video information；
Fig. 4 is the another exemplary method flow diagram that identification identifying code is determined according to video information；
Fig. 5 is another exemplary method flowchart that identification identifying code is determined according to video information；
Fig. 6 is the structural schematic diagram of terminal device shown according to an exemplary embodiment；
Fig. 7 is the structural schematic diagram of the terminal device shown according to another exemplary embodiment；
Fig. 8 is the structural schematic diagram of electronic equipment shown according to an exemplary embodiment.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Fig. 1 is the application scenario diagram of recognition of face biopsy method shown according to an exemplary embodiment.Such as Fig. 1 institute
Show, recognition of face biopsy method provided in this embodiment can be applied to terminal device, which can be intelligence
Mobile phone, tablet computer, personal computer etc. have the electronic equipment of image acquisition, data processing and display function.
And the method that In vivo detection determines object real physiological feature in some authentication scenes, in face recognition application
In, In vivo detection is used for before carrying out recognition of face, verifies whether user is true living body operation.So as to effectively resist
Photo changes face, mask, blocks and the common attack means such as screen reproduction, so that user be helped to screen fraud, ensures
The interests of user.Such as it rents in bank securities, banking and insurance business, people's livelihood social security, online education, auto metal halide lamp, house, shared clothes
The scenes such as business, news media, block chain, it is sometimes desirable to user carry out remote human face identification to confirm identity information, at this point, into
Before row recognition of face, carrying out In vivo detection then is the key step for ensureing user account safety and improving recognition of face precision
Suddenly.
With continued reference to Fig. 1, below using terminal device as smart phone, and application scenarios are chosen for payment scene, are lifted
Example explanation:
When user needs to carry out recognition of face payment, smart phone can first call front camera, at this point, user needs
Face is moved integrally to the image pickup scope of front camera, so that smart phone can get the complete face of user
Portion's information.Then human face detection tech is utilized, detects the face of user in video, when successfully being detected user's face, i.e.,
Start recorded video, and generate random targets identifying code, is shown on video, and require user's bright reading target verification in order
Code.After user runs through target verification code, video record is completed.At this point, reading aloud first with speech recognition technology user
Identifying code is identified that recognition result is identification identifying code, then examines whether identification identifying code matches with target verification code.
Also, lip reading identification technology is utilized, detects the movement of user's lip, recognition result is identification identifying code, same to examine identification
Whether identifying code matches with target verification code.It, can be with if whether being matched with target verification code above by identification identifying code
Think that In vivo detection result is living body.In addition, in order to carry out In vivo detection from various dimensions, to further improve detection
Accuracy, video In vivo detection technology can also be utilized, pumping frame carried out to the video of recording, and living body inspection is carried out to video frame
It surveys.When speech recognition, lip reading identification and video In vivo detection pass through, i.e., the In vivo detection of user is passed through, otherwise, then used
Family In vivo detection does not pass through.
Fig. 2 is the flow chart of recognition of face biopsy method shown according to an exemplary embodiment.As shown in Fig. 2,
Recognition of face biopsy method provided in this embodiment, comprising:
Step 101 includes generation and displaying target after face information in determining accessed image to be detected
Identifying code.
Specifically, it rents in bank securities, banking and insurance business, people's livelihood social security, online education, auto metal halide lamp, house, shared clothes
In the scenes such as business, news media, block chain, before user needs to carry out recognition of face, require first to carry out In vivo detection, therefore,
It, just first can In vivo detection trigger action in triggering terminal equipment when triggering carries out recognition of face.For example, in payment scene
In, it, will In vivo detection in first triggering terminal equipment when user has confirmed payment amount, needs to carry out recognition of face payment
Related command, and on the display interface of terminal device prompts user to carry out corresponding operating to come the phase that inputs In vivo detection
Close parameter.
Once In vivo detection trigger action is triggered, then terminal device will be in response to In vivo detection trigger action, when true
It include to generate simultaneously displaying target identifying code after face information in fixed accessed image to be detected.The target is tested
Code is demonstrate,proved, any combination of text, letter, number and conventional sign is can be, it is not carried out specifically in the present embodiment
It limits.And be that living body verifying is carried out by way of reading aloud target verification code to further prompt user, it can also be in target
Increase the printed words for being similar to " please read aloud " before identifying code, to carry out text prompt.
Step 102 records the video information that target user reads aloud target verification code.
Specifically, can start to record the view that target user reads aloud target verification code by the front camera of intelligent terminal
Frequency information.Wherein, it is worth explanatorily, in the video information, needing to guarantee to get clear, complete target user face
Portion's information.For user, user needs usually camera, and guarantees that the face of oneself is entirely located in the image pickup scope of camera.
In a kind of possible design, in order to shorten the length of institute's recorded video information as far as possible, it can be triggered by setting
The beginning condition of recording judges whether there is face letter in the image pickup scope of camera for example, human face detection tech can be first passed through
Breath just starts recorded video if there is face information, if can't detect face information, is merely resting on camera acquisition
The stage of image information is recording always the video data not comprising face information to effectively avoid, thus to subsequent
Analysis increase calculation amount, and waste memory space.
Further, it is also possible to the termination condition for stopping recording be arranged, for example, it may be judging mesh by speech detection technology
User is bright for mark when running through the target verification code, then can stop recording, specifically, can be and work as in recorded video not
When detecting that the time of voice is more than a preset threshold, it may be considered that target user has read aloud the target verification code that is over.
With continued reference to Fig. 1, in payment scene, when target user has confirmed payment amount, need to carry out recognition of face branch
Fu Shi, target user can either adjust the camera position of terminal device first by adjusting facial positions, so that
The face of target user is located in restriction frame shown in display screen, at this point, recognizing restriction by human face detection tech
There is face information in frame, then start recorded video, and the target verification code that Overlapping display is randomly generated in video, such as
" 123456 ", and in order to remind user to need to read aloud the target verification code, then can be further shown as " it please read aloud:
123456".After the completion of recording,
Step 103 determines identification identifying code according to video information.
After getting target user and reading aloud the video information of target verification code, it can be determined and be identified according to video information
Identifying code is worth explanatorily, then can be identified by way of speech recognition by extracting the voice messaging in video information
The identifying code that user is read aloud out, and will identify that the identifying code come as identification identifying code, further, it is also possible to know by lip reading
Other technology identifies the identifying code that user is read aloud from video information, and will identify that the identifying code come as identification verifying
Code.It is worth explanatorily, in the present embodiment, does not determine that the concrete mode of identification identifying code limits to according to video information
It is fixed, only it need to guarantee finally to can recognize that the identifying code that target user is read aloud by video information.
Step 104 judges identify whether identifying code and target verification code are identical.If the determination result is YES, it thens follow the steps
105, if judging result be it is no, process terminates.
According to video information determine identification identifying code after, by judge identification identifying code whether with target verification code phase
Together, to determine whether vivo identification passes through according to judging result.
Step 105 determines testing result.
Specifically, detection knot is determined according to comparison identification identifying code and the whether identical judging result of target verification code
Fruit.
In above-mentioned payment scene, the determining identification verifying of video that target verification code is recorded is read aloud by analyzing user
Code is worth explanatorily, and where there is a variety of situations:
Situation one, target verification code are shown correctly, and the bright read error of user.Such as target verification code is " 123456 ", and
User is bright to be read as " 123457 ", then at this point, the identification identifying code identified is " 123457 ", with target verification code
" 123456 " are different, then the recognition of face In vivo detection failure of target user；
Situation two, target verification code are shown correctly, and user reads aloud correctly.Such as target verification code is " 123456 ", and
What user read aloud is also " 123456 ", then at this point, the identification identifying code identified is " 123456 ", with target verification code
" 123456 " are identical, then the recognition of face In vivo detection success of target user；
Situation three, target verification code are shown correctly, and user reads aloud correctly.Such as target verification code is " 123456 ", and
What user read aloud is also " 123456 ", then at this point, the identification identifying code identified is " 123457 ", with target verification code
" 123456 " are different, then the recognition of face In vivo detection failure of target user.
In the present embodiment, when In vivo detection is triggered, by generating simultaneously displaying target identifying code, and target use is obtained
The video information of shown target verification code is read aloud at family, and identification identifying code is being determined according to the video information got, finally,
Determine whether testing result is living body by comparing target verification code and identification identifying code, so as to avoid user by squeezing eyebrow
The unnatural mode for doing eye carries out the embarrassment of In vivo detection, and carries out In vivo detection using more natural mode, significantly excellent
Change user experience, is conducive to the promotion and application of face recognition technology.
After In vivo detection success, continue to extract the human face image information in video information, and believed according to facial image
Breath carry out recognition of face, thus complete bank securities, banking and insurance business, people's livelihood social security, online education, auto metal halide lamp, house rent,
The corresponding face recognition operation of the scenes such as shared service, news media, block chain, if recognition of face passes through, after can carrying out
Continuous operation.It is worth explanatorily, for specifically face recognition technology, in the present embodiment without specifically limiting.
The voice messaging of target verification code is read aloud due in video information, containing target user, therefore, in order into
Living things feature recognition reliability is improved to one step, Application on Voiceprint Recognition can also be carried out to voice messaging by way of Application on Voiceprint Recognition,
And compared with the vocal print of pre-set user, to be confirmed whether to pass through a variety of biometrics identification technologies by authentication
Combination, substantially increase accuracy, safety and the reliability of the authentication in types of applications scene.
In addition, Fig. 3 is the exemplary method flowchart for determining identification identifying code according to video information.As shown in figure 3, right
According to video information determine identification identifying code concrete mode may include: in a kind of possible embodiment
Voice messaging in step 10311, extraction video information.
Step 10312 carries out speech recognition to voice messaging to determine that the first identification identifying code, identification identifying code include the
One identification identifying code.
In addition, Fig. 4 is the another exemplary method flow diagram for determining identification identifying code according to video information.As shown in figure 4,
For determining that the concrete mode for identifying identifying code may include: in alternatively possible embodiment according to video information
Step 10321, the lip movement information for extracting target user in video information.
Specifically, sub-frame processing first first can be carried out to video information.Then, by every frame image after acquisition framing
Lip position, to form the lip movement information of target user, as subsequent lip reading identification input parameter.
Step 10322 carries out lip reading identification to lip movement information to determine the second identification identifying code, and identification identifying code is also
Including the second identification identifying code.
In the present embodiment, by extracting the lip movement information of target user in video information, skill is identified in conjunction with lip reading
Art determines the second identification identifying code, it is compared with target verification code, determines In vivo detection result validity.Further, it is also possible to
Lip motion is compared using lip movement information combination video In vivo detection technology, living body inspection directly also may be implemented
It surveys.
Fig. 5 is another exemplary method flowchart that identification identifying code is determined according to video information.As shown in figure 5, another
In a kind of mode in the cards, identification identifying code is determined according to video information in the present embodiment, may include:
Voice messaging in step 10331, extraction video information.
Step 10332 carries out speech recognition to voice messaging to determine that the first identification identifying code, identification identifying code include the
One identification identifying code.
Step 10333, the lip movement information for extracting target user in video information.
Specifically, sub-frame processing first first can be carried out to video information.Then, by every frame image after acquisition framing
Lip position, to form the lip movement information of target user, as subsequent lip reading identification input parameter.
Step 10334 carries out lip reading identification to lip movement information to determine the second identification identifying code, and identification identifying code is also
Including the second identification identifying code.
In the present embodiment, by extracting the lip movement information of target user in video information, skill is identified in conjunction with lip reading
Art determines the second identification identifying code, it is compared with target verification code, determines In vivo detection result validity.Further, it is also possible to
Lip motion is compared using lip movement information combination video In vivo detection technology, living body inspection directly also may be implemented
It surveys.
In the present embodiment, it can also first judge whether the first identification identifying code come out by speech recognition is tested with target
It is identical to demonstrate,prove code, if the determination result is YES, then continues to judge whether the second identification identifying code is identical as target verification code, and true
After whether fixed second identification identifying code is identical as target verification code, it can also continue to using video In vivo detection technology, to record
The video information of system carries out pumping frame, and carries out In vivo detection to video frame.When speech recognition, lip reading identification and video In vivo detection
When passing through, i.e., the In vivo detection of user is passed through, otherwise, then user's In vivo detection does not pass through, to realize various dimensions people
Face In vivo detection substantially increases accuracy, safety and the reliability of the face In vivo detection in types of applications scene.
Further, it is also possible to be first judge to identify by lip reading second identification identifying code whether with target verification code phase
Together, if the determination result is YES, then continue to judge the first identification identifying code come out by speech recognition whether with target verification code
It is identical, and after determining whether the first identification identifying code identical as target verification code, it can also continue to utilize video living body
Detection technique carries out pumping frame to the video information of recording, and carries out In vivo detection to video frame.
Fig. 6 is the structural schematic diagram of terminal device shown according to an exemplary embodiment.As shown in fig. 6, the present embodiment
A kind of terminal device is provided, comprising:
Face determining module 201, for determining that in accessed image to be detected include face information；
Identifying code generation module 202, for generating target verification code；
Identifying code display module 203, for showing the target verification code；
Video record module 204 reads aloud the video information of the target verification code for recording target user；
Identifying code determining module 205, for determining identification identifying code according to the video information；
Identifying code contrast module 206, for judging whether the identification identifying code is mutually identical as the target verification code；
As a result determining module 207, for determining the mesh when the identification identifying code is identical as the target verification code
The recognition of face In vivo detection of mark user passes through.
In a kind of possible design, the identifying code determining module 205 is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
The identifying code contrast module 206, is specifically used for:
Judge whether the first identification identifying code and the target verification code are identical.
In a kind of possible design, the identifying code determining module 205 is specifically used for:
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
The identifying code contrast module 206, is specifically used for:
Judge whether the second identification identifying code and the target verification code are identical.
In a kind of possible design, the identifying code determining module 205 is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
The identifying code contrast module 206, is specifically used for:
Judge whether the first identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the second identification identifying code and the target verification code are identical；Or
The identifying code determining module 205, is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
The identifying code contrast module 206, is specifically used for:
Judge whether the second identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the first identification identifying code and the target verification code are identical.
In a kind of possible design, the face determining module 201 is specifically used for:
Video to be detected is obtained, the video to be detected includes the complete facial information of the target user；
The identifying code generation module 202, is specifically used for:
The target verification code is generated at random, and by the target verification code simultaneous display on the video to be detected.
On the basis of embodiment shown in Fig. 6, Fig. 7 is the structure of the terminal device shown according to another exemplary embodiment
Schematic diagram.As shown in fig. 7, terminal device provided in this embodiment, further includes:
Face recognition module 208, for extracting the human face image information in the video information, and according to the face figure
As information carries out recognition of face.
It is worth explanatorily, the terminal device in Fig. 6 and embodiment illustrated in fig. 7, can be used for executing real shown in above-mentioned Fig. 2-Fig. 5
The method in example is applied, specific implementation is similar with technical effect, is not discussed here.
The present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, and the program is processed
Device realizes the technical solution of any one of aforementioned embodiment of the method when executing, it is similar that the realization principle and technical effect are similar, herein no longer
It repeats.
Fig. 8 is the structural schematic diagram of electronic equipment shown according to an exemplary embodiment.If Fig. 8 shows, the present embodiment is mentioned
The electronic equipment of confession, comprising:
Camera 301, processor 302, memory 303 and display 304；
The camera 301 and the display 304 are connected with the processor 302 respectively；
The camera 301, for obtaining the video information of target user face；
The memory 303, for storing the executable instruction of the processor；
The display 304, for showing the video information and target verification code；
Wherein, the processor 302 is configured to execute any one of aforementioned method reality via the executable instruction is executed
Technical solution described in example is applied, it is similar that the realization principle and technical effect are similar, and details are not described herein again.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or part of or all technical features are carried out etc.
With replacement；And these modifications or substitutions, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution
Range.
Claims (10)
1. a kind of recognition of face biopsy method characterized by comprising
It include generation and displaying target identifying code after face information in determining accessed image to be detected；
Record the video information that target user reads aloud the target verification code；
Identification identifying code is determined according to the video information, and judges whether are the identification identifying code and target verification code phase
It is identical；
If the determination result is YES, it is determined that the recognition of face In vivo detection of the target user passes through.
2. recognition of face biopsy method according to claim 1, which is characterized in that described according to the video information
It determines identification identifying code, and judges whether the identification identifying code and the target verification code are identical, comprising:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Judge whether the first identification identifying code and the target verification code are identical.
3. recognition of face biopsy method according to claim 1, which is characterized in that described according to the video information
It determines identification identifying code, and judges whether the identification identifying code and the target verification code are identical, comprising:
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
Judge whether the second identification identifying code and the target verification code are identical.
4. recognition of face biopsy method according to claim 1, which is characterized in that the judgement identification verifying
Whether code is identical as the target verification code, and judges whether the identification identifying code and the target verification code are identical, comprising:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
Judge whether the first identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the second identification identifying code and the target verification code are identical；Alternatively,
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
Extract the lip movement information of target user described in the video information；
Lip reading identification is carried out to the lip movement information to determine the second identification identifying code；
Judge whether the second identification identifying code is identical as the target verification code；
If the determination result is YES, then judge whether the first identification identifying code and the target verification code are identical.
5. recognition of face biopsy method described in any one of -4 according to claim 1, which is characterized in that described true
It surely include to generate simultaneously displaying target identifying code after face information in the image to be detected got, comprising:
Video to be detected is obtained, the video to be detected includes the complete facial information of the target user；
The target verification code is generated at random, and by the target verification code simultaneous display on the video to be detected.
6. recognition of face biopsy method according to claim 5, which is characterized in that determining the target user's
After recognition of face In vivo detection passes through, further includes:
The human face image information in the video information is extracted, and recognition of face is carried out according to the human face image information.
7. a kind of terminal device characterized by comprising
Face determining module, for determining that in accessed image to be detected include face information；
Identifying code generation module, for generating target verification code；
Identifying code display module, for showing the target verification code；
Video record module reads aloud the video information of the target verification code for recording target user；
Identifying code determining module, for determining identification identifying code according to the video information；
Identifying code contrast module, for judging whether the identification identifying code is mutually identical as the target verification code；
As a result determining module, for determining the target user when the identification identifying code is identical as the target verification code
Recognition of face In vivo detection pass through.
8. terminal device according to claim 7, which is characterized in that the identifying code determining module is specifically used for:
Extract the voice messaging in the video information；
Speech recognition is carried out to the voice messaging to determine the first identification identifying code；
The identifying code contrast module, is specifically used for:
Judge whether the first identification identifying code and the target verification code are identical.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor
Recognition of face biopsy method described in any one of claims 1-6 is realized when row.
10. a kind of electronic equipment characterized by comprising
Camera, processor, memory and display；
The camera and the display are connected with the processor respectively；
The camera, for obtaining the video information of target user face；
The memory, for storing the executable instruction of the processor；
The display, for showing the video information and target verification code；
Wherein, the processor is configured to require 1-6 described in any item via executing the executable instruction and carry out perform claim
Recognition of face biopsy method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910130729.3A CN110032924A (en) | 2019-02-21 | 2019-02-21 | Recognition of face biopsy method, terminal device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910130729.3A CN110032924A (en) | 2019-02-21 | 2019-02-21 | Recognition of face biopsy method, terminal device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110032924A true CN110032924A (en) | 2019-07-19 |
Family
ID=67234968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910130729.3A Pending CN110032924A (en) | 2019-02-21 | 2019-02-21 | Recognition of face biopsy method, terminal device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110032924A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110738159A (en) * | 2019-10-11 | 2020-01-31 | 中国建设银行股份有限公司 | Online shareholder guild method and device for changing actual control persons of enterprises |
| CN110991253A (en) * | 2019-11-08 | 2020-04-10 | 中国联合网络通信集团有限公司 | Block chain-based face digital identity recognition method and device |
| CN111079791A (en) * | 2019-11-18 | 2020-04-28 | 京东数字科技控股有限公司 | Face recognition method, face recognition device and computer-readable storage medium |
| CN111402096A (en) * | 2020-04-03 | 2020-07-10 | 广州云从鼎望科技有限公司 | Online teaching quality management method, system, equipment and medium |
| CN111667835A (en) * | 2020-06-01 | 2020-09-15 | 马上消费金融股份有限公司 | Voice recognition method, living body detection method, model training method and device |
| CN111784498A (en) * | 2020-06-22 | 2020-10-16 | 北京海益同展信息科技有限公司 | Identity authentication method and device, electronic equipment and storage medium |
| CN112215081A (en) * | 2020-09-16 | 2021-01-12 | 湖南三湘银行股份有限公司 | Video checking method and device based on AI algorithm |
| CN112560554A (en) * | 2019-09-25 | 2021-03-26 | 北京中关村科金技术有限公司 | Lip language-based living body detection method, device and storage medium |
| CN112911180A (en) * | 2021-01-28 | 2021-06-04 | 中国建设银行股份有限公司 | Video recording method and device, electronic equipment and readable storage medium |
| CN113255529A (en) * | 2021-05-28 | 2021-08-13 | 支付宝(杭州)信息技术有限公司 | Biological feature identification method, device and equipment |
| CN113743160A (en) * | 2020-05-29 | 2021-12-03 | 北京中关村科金技术有限公司 | Method, apparatus and storage medium for biopsy |
| CN113781050A (en) * | 2021-09-03 | 2021-12-10 | 中国银行股份有限公司 | Biological password verification method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104376250A (en) * | 2014-12-03 | 2015-02-25 | 优化科技（苏州）有限公司 | Real person living body identity verification method based on sound-type image feature |
| CN104834900A (en) * | 2015-04-15 | 2015-08-12 | 常州飞寻视讯信息科技有限公司 | Method and system for vivo detection in combination with acoustic image signal |
| CN105740682A (en) * | 2016-01-12 | 2016-07-06 | 黑河学院 | Computer system as well as identification method and system of user thereof |
| CN106572049A (en) * | 2015-10-09 | 2017-04-19 | 腾讯科技（深圳）有限公司 | Identity verifying apparatus and method |
| CN107623660A (en) * | 2016-07-15 | 2018-01-23 | 上海进欣信息科技有限公司 | A kind of mobile phone user identification system |
| CN109039650A (en) * | 2018-08-08 | 2018-12-18 | 朱俊 | A kind of method and its system merging the online information trustship of biological feature encryption technology |
-
2019
- 2019-02-21 CN CN201910130729.3A patent/CN110032924A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104376250A (en) * | 2014-12-03 | 2015-02-25 | 优化科技（苏州）有限公司 | Real person living body identity verification method based on sound-type image feature |
| CN104834900A (en) * | 2015-04-15 | 2015-08-12 | 常州飞寻视讯信息科技有限公司 | Method and system for vivo detection in combination with acoustic image signal |
| CN106572049A (en) * | 2015-10-09 | 2017-04-19 | 腾讯科技（深圳）有限公司 | Identity verifying apparatus and method |
| CN105740682A (en) * | 2016-01-12 | 2016-07-06 | 黑河学院 | Computer system as well as identification method and system of user thereof |
| CN107623660A (en) * | 2016-07-15 | 2018-01-23 | 上海进欣信息科技有限公司 | A kind of mobile phone user identification system |
| CN109039650A (en) * | 2018-08-08 | 2018-12-18 | 朱俊 | A kind of method and its system merging the online information trustship of biological feature encryption technology |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112560554A (en) * | 2019-09-25 | 2021-03-26 | 北京中关村科金技术有限公司 | Lip language-based living body detection method, device and storage medium |
| CN110738159A (en) * | 2019-10-11 | 2020-01-31 | 中国建设银行股份有限公司 | Online shareholder guild method and device for changing actual control persons of enterprises |
| CN110991253A (en) * | 2019-11-08 | 2020-04-10 | 中国联合网络通信集团有限公司 | Block chain-based face digital identity recognition method and device |
| CN110991253B (en) * | 2019-11-08 | 2023-04-28 | 中国联合网络通信集团有限公司 | Face digital identity recognition method and device based on blockchain |
| CN111079791A (en) * | 2019-11-18 | 2020-04-28 | 京东数字科技控股有限公司 | Face recognition method, face recognition device and computer-readable storage medium |
| CN111402096A (en) * | 2020-04-03 | 2020-07-10 | 广州云从鼎望科技有限公司 | Online teaching quality management method, system, equipment and medium |
| CN113743160A (en) * | 2020-05-29 | 2021-12-03 | 北京中关村科金技术有限公司 | Method, apparatus and storage medium for biopsy |
| CN111667835A (en) * | 2020-06-01 | 2020-09-15 | 马上消费金融股份有限公司 | Voice recognition method, living body detection method, model training method and device |
| CN111784498A (en) * | 2020-06-22 | 2020-10-16 | 北京海益同展信息科技有限公司 | Identity authentication method and device, electronic equipment and storage medium |
| CN112215081A (en) * | 2020-09-16 | 2021-01-12 | 湖南三湘银行股份有限公司 | Video checking method and device based on AI algorithm |
| CN112911180A (en) * | 2021-01-28 | 2021-06-04 | 中国建设银行股份有限公司 | Video recording method and device, electronic equipment and readable storage medium |
| CN113255529A (en) * | 2021-05-28 | 2021-08-13 | 支付宝(杭州)信息技术有限公司 | Biological feature identification method, device and equipment |
| CN113781050A (en) * | 2021-09-03 | 2021-12-10 | 中国银行股份有限公司 | Biological password verification method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110032924A (en) | Recognition of face biopsy method, terminal device, storage medium and electronic equipment | |
| US11663307B2 (en) | RtCaptcha: a real-time captcha based liveness detection system | |
| CN112328999B (en) | Double-recording quality inspection method and device, server and storage medium | |
| CN109769099B (en) | Method and device for detecting abnormality of call person | |
| EP3807792B1 (en) | Authenticating an identity of a person | |
| CN106850648B (en) | Identity verification method, client and service platform | |
| CN113366487A (en) | Operation determination method and device based on expression group and electronic equipment | |
| TW201907330A (en) | Method, device, device and data processing method for identity authentication | |
| US20190026606A1 (en) | To-be-detected information generating method and apparatus, living body detecting method and apparatus, device and storage medium | |
| CN108920640B (en) | Context obtaining method and device based on voice interaction | |
| CN108197586A (en) | Recognition algorithms and device | |
| JP7412496B2 (en) | Living body (liveness) detection verification method, living body detection verification system, recording medium, and training method for living body detection verification system | |
| CN113780212A (en) | User identity verification method, device, equipment and storage medium | |
| CN109005104A (en) | A kind of instant communicating method, device, server and storage medium | |
| CN111027400A (en) | Living body detection method and device | |
| CN114677634A (en) | Surface label identification method and device, electronic equipment and storage medium | |
| CN111046804A (en) | Living body detection method, living body detection device, electronic equipment and readable storage medium | |
| CN110516426A (en) | Identity identifying method, certification terminal, device and readable storage medium storing program for executing | |
| US11893098B2 (en) | Authenticating a user subvocalizing a displayed text | |
| Marutotamtama et al. | Face Recognition and Face Spoofing Detector for Attendance System | |
| KR102579610B1 (en) | Apparatus for Detecting ATM Abnormal Behavior and Driving Method Thereof | |
| CN115761857A (en) | Face verification method and device | |
| Dixit et al. | SIFRS: Spoof Invariant Facial Recognition System (A Helping Hand for Visual Impaired People) | |
| CN115984927A (en) | Living body detection method and device, electronic equipment and storage medium | |
| CN115457665A (en) | Living body detection method, living body detection apparatus, living body detection device, storage medium, and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |