CN108595928A - Information processing method, device and the terminal device of recognition of face - Google Patents
Information processing method, device and the terminal device of recognition of face Download PDFInfo
- Publication number
- CN108595928A CN108595928A CN201810327407.3A CN201810327407A CN108595928A CN 108595928 A CN108595928 A CN 108595928A CN 201810327407 A CN201810327407 A CN 201810327407A CN 108595928 A CN108595928 A CN 108595928A
- Authority
- CN
- China
- Prior art keywords
- face
- performing environment
- application program
- recognition process
- micro
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Image Processing (AREA)
- Collating Specific Patterns (AREA)
Abstract
This application discloses a kind of information processing method of recognition of face, device and terminal devices, wherein method includes：Obtain the attribute information for the application program for calling recognition of face；Judge whether face recognition process needs to execute at credible performing environment TEE according to attribute information；If face recognition process needs are executed at credible performing environment TEE, controls application program and enter credible performing environment TEE patterns, and the step of serially executing face recognition process at credible performing environment TEE；If face recognition process controls application program and enters common performing environment REE patterns, and the step of executing face recognition process parallel at common performing environment REE without being executed at credible performing environment TEE.Information processing method, device and the terminal device of the recognition of face of the embodiment of the present application can ensure the information security under the higher scene of security requirement, and can realize the quick response under the relatively not high scene of security requirement.
Description
Technical field
This application involves technical field of information processing more particularly to a kind of information processing method of recognition of face, device and
Terminal device.
Background technology
With being constantly progressive for science and technology, the application of biological identification technology is also more and more extensive, especially recognition of face, extensively
It is general to be applied to the scenes such as authentication, mobile payment, simulation dynamic expression.For example, user needs to log in a security application journey
When sequence (financing APP), face identification functions can be opened by the application program, the face information of user be obtained, with the people to prestore
Face information comparison.If compared unanimously, certification passes through, and user logins successfully.And how to improve such as authentication, mobile branch
The safety for paying equal operations, reduces the risk that the information of user is stolen, it has also become the problem of urgent need to resolve.
Apply for content
The application provides a kind of information processing method of recognition of face, device and terminal device, can ensure that safety is wanted
The information security under higher scene is sought, and can realize the quick response under the relatively not high scene of security requirement.
The embodiment of the present application provides a kind of information processing method of recognition of face, including：
Obtain the attribute information for the application program for calling recognition of face；
Judge whether face recognition process needs to execute at credible performing environment TEE according to the attribute information；
If the face recognition process needs are executed at the credible performing environment TEE, control described using journey
Sequence enters credible performing environment TEE patterns, and serially executes the face recognition process at the credible performing environment TEE
Step；
If the face recognition process controls described using journey without being executed at the credible performing environment TEE
Sequence enters common performing environment REE patterns, and executes the step of the face recognition process parallel at common performing environment REE
Suddenly.
Optionally, the attribute information of the application program includes the security level of the application program.
Optionally, the face recognition process includes detection face step, obtains face element step, face In vivo detection
Step and recognition of face step.
Optionally, the detection face step, including：
Emit infrared light to object；
The infrared image of the object is passed through in capture；
The infrared image is sent to micro-control unit MCU, and using the micro-control unit MCU to the infrared figure
As being handled, to obtain infrared picture data；And
The infrared picture data is supplied to the application program by preset interface, so that the application call
The infrared picture data.
Optionally, the acquisition face element step, including：
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to described visible
Light image is handled, to obtain visible images data；And
The visible images data are supplied to the application program by preset interface, so that the application program tune
With the visible images data.
Optionally, the face In vivo detection step, including：
Emit infrared light and the structure light to object；
Infrared image and the structure light image of the capture by the object；
The infrared image and the structure light image are sent to micro-control unit MCU, and utilize the microcontroller list
First MCU handles the infrared image and the structure light image, to obtain infrared picture data and the depth of field data；
And
The infrared picture data and the depth of field data are supplied to the application program by preset interface, so that institute
State infrared picture data described in application call and the depth of field data.
Optionally, the recognition of face step, including：
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to described visible
Light image is handled, to obtain face characteristic data；And
The face characteristic data are supplied to the application program by preset interface, so that the application call
The face characteristic data.
Optionally, it is calculated using the micro-control unit MCU and obtains the corresponding depth of field data of the object, including：
Demodulate the corresponding phase information of deformation position pixel in the structure light image；
Convert the phase information to elevation information；
The corresponding depth of field data of the object is determined according to the elevation information.
Optionally, the preset interface is to meet the bus interface of preset standard, including MIPI bus interface, I2C are synchronized
Serial bus interface, spi bus interface.
Another embodiment of the application provides a kind of information processing unit of recognition of face, including：
Acquisition module, the attribute information for obtaining the application program for calling recognition of face；
Judgment module, for judging whether face recognition process needs in credible performing environment according to the attribute information
It is executed under TEE；
Processing module is controlled if needing to execute at the credible performing environment TEE for the face recognition process
It makes the application program and enters credible performing environment TEE patterns, and the people is serially executed at the credible performing environment TEE
The step of face identification process, if the face recognition process controls institute without being executed at the credible performing environment TEE
It states application program and enters common performing environment REE patterns, and the recognition of face is executed parallel at common performing environment REE
The step of journey.
Optionally, the attribute information of the application program includes the security level of the application program.
Optionally, the face recognition process includes detection face step, obtains face element step, face In vivo detection
Step and recognition of face step.
Optionally, the processing module, is specifically used for：
Emit infrared light to object；
The infrared image of the object is passed through in capture；
The infrared image is sent to micro-control unit MCU, and using the micro-control unit MCU to the infrared figure
As being handled, to obtain infrared picture data；And
The infrared picture data is supplied to the application program by preset interface, so that the application call
The infrared picture data.
Optionally, the processing module, is specifically used for
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to described visible
Light image is handled, to obtain visible images data；And
The visible images data are supplied to the application program by preset interface, so that the application program tune
With the visible images data.
Optionally, the processing module, is specifically used for
Emit infrared light and the structure light to object；
Infrared image and the structure light image of the capture by the object；
The infrared image and the structure light image are sent to micro-control unit MCU, and utilize the microcontroller list
First MCU handles the infrared image and the structure light image, to obtain infrared picture data and the depth of field data；
And
The infrared picture data and the depth of field data are supplied to the application program by preset interface, so that institute
State infrared picture data described in application call and the depth of field data.
Optionally, the processing module, is specifically used for
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to described visible
Light image is handled, to obtain face characteristic data；And
The face characteristic data are supplied to the application program by preset interface, so that the application call
The face characteristic data.
Optionally, the processing module, is specifically used for
Demodulate the corresponding phase information of deformation position pixel in the structure light image；
Convert the phase information to elevation information；
The corresponding depth of field data of the object is determined according to the elevation information.
Optionally, the preset interface is to meet the bus interface of preset standard, including MIPI bus interface, I2C are synchronized
Serial bus interface, spi bus interface.
The another embodiment of the application provides a kind of terminal device, including Laser video camera head, floodlight, visible image capturing head,
Color-changing lamp, micro-control unit MCU and processor, wherein the processor is used for：
Obtain the attribute information for the application program for calling recognition of face；
Judge whether face recognition process needs to execute at credible performing environment TEE according to the attribute information；
If the face recognition process needs are executed at the credible performing environment TEE, control described using journey
Sequence enters credible performing environment TEE patterns, and serially executes the face recognition process at the credible performing environment TEE
Step；
If the face recognition process controls described using journey without being executed at the credible performing environment TEE
Sequence enters common performing environment REE patterns, and executes the step of the face recognition process parallel at common performing environment REE
Suddenly.
The application a further embodiment provides a kind of non-transitorycomputer readable storage medium, is stored thereon with computer journey
Sequence, when which is executed by processor at the information of recognition of face of the realization as described in the application first aspect embodiment
Reason method.
Technical solution provided by the embodiments of the present application can include the following benefits：
The attribute information of the application program of recognition of face is called by acquisition, and judges that face is known according to the attribute information
Whether other process needs to execute at credible performing environment TEE, if the face recognition process is needed in the credible execution
It is executed under environment TEE, then controls the application program and enter credible performing environment TEE patterns, and in the credible performing environment
The step of face recognition process is serially executed under TEE, if the face recognition process is not necessarily in the credible execution ring
It is executed under the TEE of border, then controls the application program and enter common performing environment REE patterns, and at common performing environment REE simultaneously
Row executes the step of face recognition process, can ensure the information security under the higher scene of security requirement, and can
Realize the quick response under the relatively not high scene of security requirement.
The additional aspect of the application and advantage will be set forth in part in the description, and will partly become from the following description
It obtains obviously, or recognized by the practice of the application.
Description of the drawings
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, wherein：
Fig. 1 is the flow chart according to the information processing method of the recognition of face of the application one embodiment；
Fig. 2 is the flow chart according to the detection face step of the application one embodiment；
Fig. 3 is the flow chart according to the acquisition face element step of the application one embodiment；
Fig. 4 is the flow chart according to the face In vivo detection step of the application one embodiment；
Fig. 5 is the schematic diagram of a scenario according to the structural light measurement of the application one embodiment；
Fig. 6 is the flow chart according to the recognition of face step of the application one embodiment；
Fig. 7 is the structure diagram according to the information processing unit of the recognition of face of the application one embodiment；
Fig. 8 is the structure diagram according to the terminal device of the application one embodiment；
Fig. 9 is the structural schematic diagram according to the terminal device of the application one embodiment.
Specific implementation mode
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the application, and should not be understood as the limitation to the application.
Below with reference to the accompanying drawings the information processing method, device and terminal device of the recognition of face of the embodiment of the present application are described.
Fig. 1 is the flow chart according to the information processing method of the recognition of face of the application one embodiment.
As shown in Figure 1, the information processing method of the recognition of face includes：
S101 obtains the attribute information for the application program for calling recognition of face.
Currently, recognition of face has been widely applied in each scene, such as authentication scene, mobile payment scene, mould
Quasi- dynamic expression scene, video conference scene etc..Above-mentioned scene is by calling the hardware devices such as camera, to people
Face is identified, to realize the function of response.Wherein, some scenes are higher to the security requirement of operation, such as identity is recognized
Demonstrate,prove scene, mobile payment scene etc..Some scenes are not relatively high to the security requirement of operation, such as simulation dynamic expression scene,
Video conference scene etc..For this purpose, the application proposes a kind of information processing method of recognition of face, it can either ensure security requirement
Information security under higher scene, and can realize the quick response under the relatively not high scene of security requirement.
In one embodiment of the application, the attribute information for the application program for calling recognition of face can be obtained first.Its
In, the attribute information of application program may include the security level of application program.Such as：Bank's class application program, payment class application
Program, authentication class application program security level be height；The security level of common camera shooting class application program etc. is low.
S102 judges whether face recognition process needs to execute at credible performing environment TEE according to attribute information.
In one embodiment of the application, if the security level of application program is height, face recognition process needs
It is executed at TEE (credible performing environment, Trust Execution Environment)；If the security level of application program
To be low, then face recognition process is then not necessarily to execute at TEE, only need to be in REE (common performing environment, Rich Execution
Environment it is executed under).Such as user needs to open when paying using application programs such as wechat, Alipays
Face is identified in camera, is compared with the face to prestore, if comparison result is consistent, is proved to be successful, is propped up
Pay operation.Due to being related to the information etc. of personal payment, it is likely to result in the personal property loss of user, therefore, it is necessary in TEE
Lower execution, to ensure safety.And simulate under dynamic expression scene, opening camera is identified face, only to face
Expression carry out trace trap, then simulate various interesting dynamic expressions, enhancing is interesting, therefore need to only be held at REE
Row.
S103, if face recognition process needs are executed at credible performing environment TEE, controlling application program entrance can
Believe performing environment TEE patterns, and the step of serially executing face recognition process at credible performing environment TEE.
Wherein, face recognition process may include detecting face step, obtain face element step, face In vivo detection step
And recognition of face step.Due to the security feature of TEE, above-mentioned steps serially execute successively at TEE.And in REE
Under, to the of less demanding of safety, can execute parallel.Wherein, detection face step is referred to by calling floodlight
Emit infrared light, infrared image is received by Laser video camera head, the process of face is determined whether using infrared image.Obtain face
Element step is shot to face using visible image capturing head, and face brightness, face shooting angle etc. and figure are obtained
The process of the relevant feature of image quality amount.Face In vivo detection step is then to combine infrared light and structure light, is sent out by floodlight
Infrared light is penetrated, color-changing lamp emitting structural light receives infrared image and structure light image, then to above-mentioned figure by Laser video camera head
As being analyzed, obtains such as face dermatoglyph feature, establishes human face three-dimensional model, multiframe face behavioral characteristics, to carry out
In vivo detection.Recognition of face step is shot to face using visible image capturing head, and such as eyes size, nose are obtained
In features such as location information, the eyebrow length of face, to carry out recognition of face.
In the present embodiment, above-mentioned steps in serial execution, do not limit its and execute sequence.It can also be according to using journey
The practical situations of sequence, are arbitrarily combined above-mentioned steps, realize corresponding function.If face pays scene, people is only needed
Face In vivo detection step combination recognition of face step, without face element step.It should be understood that above-mentioned scene is only to show
Example, is not intended as the restriction to technical solution.
S104, if face recognition process without being executed at credible performing environment TEE, control application program enter it is general
Logical performing environment REE patterns, and the step of executing face recognition process parallel at common performing environment REE.
In one embodiment of the application, at REE, face recognition process is to the of less demanding of safety, therefore, can
With the step of executing face recognition process parallel, to improve the execution speed of face recognition process.
Detection face step in face recognition process is explained in detail below, obtains face element step, the inspection of face live body
Survey step and recognition of face step.
As shown in Fig. 2, detection face step, including：
S201 emits infrared light to object.
Specifically, infrared light can be emitted by floodlight.
The infrared image of object is passed through in S202, capture.
By the capture of Laser video camera head by the infrared image of object.
Infrared image is sent to micro-control unit MCU, and is carried out to infrared image using micro-control unit MCU by S203
Processing, to obtain infrared picture data.
It is most of to be all based on the invasion of application program side due to hacker's behavior, therefore infrared image is sent to MCU,
Infrared image is handled by the MCU of hardware, original data is prevented to be intercepted in application program side, can be effectively improved
The safety of data.
Infrared picture data is supplied to application program by S204 by preset interface, so that the infrared figure of application call
As data.
In the present embodiment, the detection of face can be realized using application call infrared picture data.
Wherein, preset interface be meet the bus interface of preset standard, including MIPI (mobile industry processor interface,
Mobile Industry Processor Interface) bus interface, I2C synchronous serial bus interface, spi bus interface.
As shown in figure 3, face element step is obtained, including：
S301 shoots the visible images of object.
Specifically, the visible images of object can be shot by visible image capturing head.
S302, it will be seen that light image is sent to micro-control unit MCU, and using micro-control unit MCU to visible images
It is handled, to obtain visible images data.
Due to hacker's behavior, most of invasions for being all based on application program side, therefore will be seen that light image is sent to
MCU is handled visible images by the MCU of hardware, and original data is prevented to be intercepted in application program side, can be effective
Improve the safety of data in ground.
S303, it will be seen that light image data are supplied to application program by preset interface, so that application call is visible
Light image data.
In the present embodiment, face element can be extracted using application call visible images data, such as obtain face
Brightness, face shooting angle etc. and the relevant feature of picture quality, in this, as the data basis of next step operation.
As shown in figure 4, face In vivo detection step, including：
S401 emits infrared light and structure light to object.
In one embodiment of the application, using the PWM modulation generating structure light in MCU, emitted by color-changing lamp
Structure light, and infrared light is emitted to object by floodlight (infrared transmitter).
The infrared image and structure light image of object are passed through in S402, capture.
In one embodiment of the application, it can be captured by object by Laser video camera head (infrared light receiver)
Infrared image and structure light image.
Infrared image and structure light image are sent to micro-control unit MCU, and utilize MCU pairs of micro-control unit by S403
Infrared image and structure light image are handled, to obtain infrared picture data and depth of field data.
Specifically, infrared image and structure light image are handled using the depth engine in MCU, it is infrared to obtain
Image data and depth of field data.
Infrared picture data and depth of field data are supplied to application program by S404 by preset interface, so that application program
Infrared picture data and depth of field data is called to carry out safety verification.
In one embodiment of the application, generating structure light is modulated using MCU, passes through color-changing lamp (structured light projection
Equipment) to object emitting structural light.Assuming that current scene is authentication scene, then object can be the face of user.
Structure light is after being irradiated to object, and due to the style characteristic of object, structure light can deform upon, by acquiring above structure
Optical information can obtain a structure light image with object profile and depth.
Wherein, the type of structure light may include, laser stripe, Gray code, sine streak or, non-homogeneous speckle etc..
Its concrete principle is illustrated by taking a kind of widely used fringe projection technology as an example, wherein bar shaped projects skill below
Art belongs to sensu lato area-structure light.
When using face structured light projection, as shown in figure 5, generating sine streak by MCU, which is led to
Color-changing lamp (structured light projection equipment) projection is crossed to object, the bending journey that striped is modulated by object is shot using Laser video camera head
Degree, demodulates the curved stripes and obtains phase, then convert phase to the height of the whole audience.
It should be understood that in practical applications, according to the difference of concrete application scene, employed in the embodiment of the present application
Structure light other than above-mentioned striped, can also be any other pattern.
After this, structure light image can be sent to micro-control unit MCU, and obtained using micro-control unit MCU calculating
Obtain the corresponding depth of field data of object.In order to further improve the security, structure light image can be sent to MCU, in hardware
Structure light image is handled in MCU, is handled compared to application program is transmitted directly to, data operation within hardware,
Hacker can not obtain original data, therefore safer.Specifically, using deformation position in MCU demodulation structure light images
The corresponding phase information of pixel, then converts phase information to elevation information, finally determines object pair according to elevation information
The depth of field data answered.Finally, depth of field data is provided to application program by preset interface, so that application call depth of field number
According to.Such as：The data informations such as profile, the height of face are calculated in structure light image based on face.Above-mentioned data information is
Through being calculated in MCU, application program need to only call above-mentioned data information, carry out aspect ratio pair with the data to prestore, you can realize
Authentication.If the verification passes, user can obtain the permission of the application program, be carried out further to application program
Operation.For example, establishing human face three-dimensional model using structure light, the three-dimensional feature of face is obtained, in conjunction with infrared picture data or more
Frame face behavioral characteristics etc. carry out In vivo detection, and the face for detecting current shooting is live body, and nonplanar photo.
As shown in fig. 6, recognition of face step, including：
S601 shoots the visible images of object.
S602, it will be seen that light image is sent to micro-control unit MCU, and using micro-control unit MCU to visible images
It is handled, to obtain face characteristic data.
Due to hacker's behavior, most of invasions for being all based on application program side, therefore will be seen that light image is sent to
MCU is handled visible images by the MCU of hardware, and original data is prevented to be intercepted in application program side, can be effective
Improve the safety of data in ground.
Wherein, face characteristic data may include eyes size, nose face location information, eyebrow length etc..
Face characteristic data are supplied to application program by S603 by preset interface, so that application call face is special
Levy data.
In the present embodiment, recognition of face can be carried out using application call visible images data.
The information processing method of the recognition of face of the embodiment of the present application calls the application program of recognition of face by acquisition
Attribute information, and judge whether face recognition process needs to execute at credible performing environment TEE according to attribute information, if people
Face identification process needs are executed at credible performing environment TEE, then control application program and enter credible performing environment TEE patterns,
And the step of serially executing face recognition process at credible performing environment TEE, if face recognition process credible without holding
It is executed under row environment TEE, then controls application program and enter common performing environment REE patterns, and at common performing environment REE simultaneously
Row executes the step of face recognition process, can ensure the information security under the higher scene of security requirement, and can realize
Quick response under the relatively not high scene of security requirement.
In order to realize that above-described embodiment, the application also proposed a kind of information processing unit of recognition of face, Fig. 7 is basis
The structure diagram of the information processing unit of the recognition of face of the application one embodiment, as shown in fig. 7, the device includes obtaining mould
Block 710, judgment module 720 and processing module 730.
Wherein, acquisition module 710, the attribute information for obtaining the application program for calling recognition of face.
Judgment module 720, for judging whether face recognition process needs in credible performing environment TEE according to attribute information
Lower execution.
Processing module 730, if needing to execute at credible performing environment TEE for face recognition process, control is answered
Enter credible performing environment TEE patterns with program, and serially executes the step of face recognition process at credible performing environment TEE
Suddenly, if face recognition process controls application program and enter common performing environment without being executed at credible performing environment TEE
REE patterns, and the step of executing face recognition process parallel at common performing environment REE.
It should be noted that the explanation of the aforementioned information processing method to recognition of face, is also applied for the application reality
Apply the information processing unit of the recognition of face of example, unpub details in the embodiment of the present application, details are not described herein.
The information processing unit of the recognition of face of the embodiment of the present application calls the application program of recognition of face by acquisition
Attribute information, and judge whether face recognition process needs to execute at credible performing environment TEE according to attribute information, if people
Face identification process needs are executed at credible performing environment TEE, then control application program and enter credible performing environment TEE patterns,
And the step of serially executing face recognition process at credible performing environment TEE, if face recognition process credible without holding
It is executed under row environment TEE, then controls application program and enter common performing environment REE patterns, and at common performing environment REE simultaneously
Row executes the step of face recognition process, can ensure the information security under the higher scene of security requirement, and can realize
Quick response under the relatively not high scene of security requirement.
In order to realize that above-described embodiment, the application also proposed a kind of terminal device.
As shown in figure 8, terminal device 800 include Laser video camera head 810, it is floodlight 820, visible image capturing head 830, radium-shine
Lamp 840, micro-control unit MCU850 and processor 860.Laser video camera head 810, floodlight 820, visible image capturing head 830,
Color-changing lamp 840 is connected with MCU850 respectively.MCU850 is connected with processor 860.
Processor 860 is specifically used for executing following steps：
S101 ' obtains the attribute information for the application program for calling recognition of face.
In one embodiment of the application, the attribute information for the application program for calling recognition of face can be obtained first.Its
In, the attribute information of application program may include the security level of application program.Such as：Bank's class application program, payment class application
Program, authentication class application program security level be height；The security level of common camera shooting class application program etc. is low.
S102 ' judges whether face recognition process needs to execute at credible performing environment TEE according to attribute information.
In one embodiment of the application, if the security level of application program is height, face recognition process needs
It is executed at TEE (credible performing environment, Trust Execution Environment)；If the security level of application program
To be low, then face recognition process is then not necessarily to execute at TEE, only need to be in REE (common performing environment, Rich Execution
Environment it is executed under).Such as user needs to open when paying using application programs such as wechat, Alipays
Face is identified in camera, is compared with the face to prestore, if comparison result is consistent, is proved to be successful, is propped up
Pay operation.Due to being related to the information etc. of personal payment, it is likely to result in the personal property loss of user, therefore, it is necessary in TEE
Lower execution, to ensure safety.And simulate under dynamic expression scene, opening camera is identified face, only to face
Expression carry out trace trap, then simulate various interesting dynamic expressions, enhancing is interesting, therefore need to only be held at REE
Row.
S103 ' controls application program entrance if face recognition process needs are executed at credible performing environment TEE
Credible performing environment TEE patterns, and the step of serially executing face recognition process at credible performing environment TEE.
Wherein, face recognition process may include detecting face step, obtain face element step, face In vivo detection step
And recognition of face step.Due to the security feature of TEE, above-mentioned steps serially execute successively at TEE.And in REE
Under, to the of less demanding of safety, can execute parallel.Wherein, detection face step is referred to by calling floodlight
Emit infrared light, infrared image is received by Laser video camera head, the process of face is determined whether using infrared image.Obtain face
Element step is shot to face using visible image capturing head, and face brightness, face shooting angle etc. and figure are obtained
The process of the relevant feature of image quality amount.Face In vivo detection step is then to combine infrared light and structure light, is sent out by floodlight
Infrared light is penetrated, color-changing lamp emitting structural light receives infrared image and structure light image, then to above-mentioned figure by Laser video camera head
As being analyzed, obtains such as face dermatoglyph feature, establishes human face three-dimensional model, multiframe face behavioral characteristics, to carry out
In vivo detection.Recognition of face step is shot to face using visible image capturing head, and such as eyes size, nose are obtained
In features such as location information, the eyebrow length of face, to carry out recognition of face.
In the present embodiment, above-mentioned steps in serial execution, do not limit its and execute sequence.It can also be according to using journey
The practical situations of sequence, are arbitrarily combined above-mentioned steps, realize corresponding function.If face pays scene, people is only needed
Face In vivo detection step combination recognition of face step, without face element step.It should be understood that above-mentioned scene is only to show
Example, is not intended as the restriction to technical solution.
S104 ', if face recognition process controls application program entrance without being executed at credible performing environment TEE
Common performing environment REE patterns, and the step of executing face recognition process parallel at common performing environment REE.
In one embodiment of the application, at REE, face recognition process is to the of less demanding of safety, therefore, can
With the step of executing face recognition process parallel.
The terminal device of the embodiment of the present application calls the attribute information of the application program of recognition of face, and root by acquisition
Judge whether face recognition process needs to execute at credible performing environment TEE according to attribute information, if face recognition process needs
It to be executed at credible performing environment TEE, then control application program and enter credible performing environment TEE patterns, and in credible execution
The step of face recognition process is serially executed under environment TEE, if face recognition process at credible performing environment TEE without holding
Row then controls application program and enters common performing environment REE patterns, and executes face knowledge parallel at common performing environment REE
The step of other process, can ensure the information security under the higher scene of security requirement, and can realize security requirement phase
To the quick response under not high scene.
As shown in figure 9, the terminal device 900 of the application embodiment includes one or more processors 910, memory
920 and one or more programs 901.Wherein one or more programs 901 are stored in memory 920, and are configured to
It is executed by one or more processors 910.Program 901 includes the recognition of face for executing above-mentioned any one embodiment
The instruction of information processing method.
For example, program 901 includes the instruction of the information processing method of the recognition of face for executing following steps：
S101 ' obtains the attribute information for the application program for calling recognition of face.
S102 ' judges whether face recognition process needs to execute at credible performing environment TEE according to attribute information.
S103 ' controls application program entrance if face recognition process needs are executed at credible performing environment TEE
Credible performing environment TEE patterns, and the step of serially executing face recognition process at credible performing environment TEE.
S104 ', if face recognition process controls application program entrance without being executed at credible performing environment TEE
Common performing environment REE patterns, and the step of executing face recognition process parallel at common performing environment REE.
To realize that above-described embodiment, the application also propose a kind of non-transitorycomputer readable storage medium, store thereon
There is computer program, which is characterized in that the letter of the recognition of face of first aspect embodiment is realized when the program is executed by processor
Cease processing method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiments or example.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discuss suitable
Sequence, include according to involved function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be by the application
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (system of such as computer based system including processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicating, propagating or passing
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that can on it the paper of print routine or other suitable be situated between
Matter, because can be for example by carrying out optical scanner to paper or other media, then into edlin, interpretation or when necessary with other
Suitable method is handled electronically to obtain program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or combination thereof.Above-mentioned
In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be executed with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step that above-described embodiment method carries
Suddenly be that relevant hardware can be instructed to complete by program, program can be stored in a kind of computer readable storage medium
In, which includes the steps that one or a combination set of embodiment of the method when being executed.
In addition, each functional unit in each embodiment of the application can be integrated in a processing module, it can also
That each unit physically exists alone, can also two or more units be integrated in a module.Above-mentioned integrated mould
The form that hardware had both may be used in block is realized, can also be realized in the form of software function module.If integrated module with
The form of software function module realizes and when sold or used as an independent product, can also be stored in one it is computer-readable
It takes in storage medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application
System, those skilled in the art can be changed above-described embodiment, change, replace and become within the scope of application
Type.
Claims (20)
1. a kind of information processing method of recognition of face, which is characterized in that include the following steps：
Obtain the attribute information for the application program for calling recognition of face；
Judge whether face recognition process needs to execute at credible performing environment TEE according to the attribute information；
If face recognition process needs are executed at the credible performing environment TEE, control the application program into
Enter credible performing environment TEE patterns, and serially executes the step of the face recognition process at the credible performing environment TEE
Suddenly；
If the face recognition process without being executed at the credible performing environment TEE, control the application program into
Enter common performing environment REE patterns, and the step of executing the face recognition process parallel at common performing environment REE.
2. the method as described in claim 1, which is characterized in that the attribute information of the application program includes the application program
Security level.
3. the method as described in claim 1, which is characterized in that the face recognition process includes detection face step, obtains
Face element step, face In vivo detection step and recognition of face step.
4. method as claimed in claim 3, which is characterized in that the detection face step, including：
Emit infrared light to object；
The infrared image of the object is passed through in capture；
The infrared image is sent to micro-control unit MCU, and using the micro-control unit MCU to the infrared image into
Row processing, to obtain infrared picture data；And
The infrared picture data is supplied to the application program by preset interface, so that described in the application call
Infrared picture data.
5. method as claimed in claim 3, which is characterized in that the acquisition face element step, including：
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to the visible light figure
As being handled, to obtain visible images data；And
The visible images data are supplied to the application program by preset interface, so that application call institute
State visible images data.
6. method as claimed in claim 3, which is characterized in that the face In vivo detection step, including：
Emit infrared light and the structure light to object；
Infrared image and the structure light image of the capture by the object；
The infrared image and the structure light image are sent to micro-control unit MCU, and utilize the micro-control unit MCU
The infrared image and the structure light image are handled, to obtain infrared picture data and the depth of field data；And
The infrared picture data and the depth of field data are supplied to the application program by preset interface, so that described answer
The infrared picture data described in routine call and the depth of field data.
7. method as claimed in claim 3, which is characterized in that the recognition of face step, including：
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to the visible light figure
As being handled, to obtain face characteristic data；And
The face characteristic data are supplied to the application program by preset interface, so that described in the application call
Face characteristic data.
8. method as claimed in claim 6, which is characterized in that calculated using the micro-control unit MCU and obtain described be shot
The corresponding depth of field data of object, including：
Demodulate the corresponding phase information of deformation position pixel in the structure light image；
Convert the phase information to elevation information；
The corresponding depth of field data of the object is determined according to the elevation information.
9. such as claim 4 to 7 any one of them method, which is characterized in that the preset interface is to meet preset standard
Bus interface, including MIPI bus interface, I2C synchronous serial bus interface, spi bus interface.
10. a kind of information processing unit of recognition of face, which is characterized in that including：
Acquisition module, the attribute information for obtaining the application program for calling recognition of face；
Judgment module, for judging whether face recognition process needs at credible performing environment TEE according to the attribute information
It executes；
Processing module controls institute if needing to execute at the credible performing environment TEE for the face recognition process
It states application program and enters credible performing environment TEE patterns, and serially execute the face at the credible performing environment TEE and know
The step of other process, if the face recognition process without being executed at the credible performing environment TEE, is answered described in control
Enter common performing environment REE patterns with program, and the face recognition process is executed parallel at common performing environment REE
Step.
11. device as claimed in claim 10, which is characterized in that the attribute information of the application program includes described using journey
The security level of sequence.
12. device as claimed in claim 10, which is characterized in that the face recognition process includes detection face step, obtains
Take face element step, face In vivo detection step and recognition of face step.
13. device as claimed in claim 12, which is characterized in that the processing module is specifically used for：
Emit infrared light to object；
The infrared image of the object is passed through in capture；
The infrared image is sent to micro-control unit MCU, and using the micro-control unit MCU to the infrared image into
Row processing, to obtain infrared picture data；And
The infrared picture data is supplied to the application program by preset interface, so that described in the application call
Infrared picture data.
14. device as claimed in claim 12, which is characterized in that the processing module is specifically used for
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to the visible light figure
As being handled, to obtain visible images data；And
The visible images data are supplied to the application program by preset interface, so that application call institute
State visible images data.
15. device as claimed in claim 12, which is characterized in that the processing module is specifically used for
Emit infrared light and the structure light to object；
Infrared image and the structure light image of the capture by the object；
The infrared image and the structure light image are sent to micro-control unit MCU, and utilize the micro-control unit MCU
The infrared image and the structure light image are handled, to obtain infrared picture data and the depth of field data；And
The infrared picture data and the depth of field data are supplied to the application program by preset interface, so that described answer
The infrared picture data described in routine call and the depth of field data.
16. device as claimed in claim 12, which is characterized in that the processing module is specifically used for
Shoot the visible images of object；
The visible images are sent to micro-control unit MCU, and using the micro-control unit MCU to the visible light figure
As being handled, to obtain face characteristic data；And
The face characteristic data are supplied to the application program by preset interface, so that described in the application call
Face characteristic data.
17. device as claimed in claim 15, which is characterized in that the processing module is specifically used for
Demodulate the corresponding phase information of deformation position pixel in the structure light image；
Convert the phase information to elevation information；
The corresponding depth of field data of the object is determined according to the elevation information.
18. such as claim 13 to 16 any one of them device, which is characterized in that the preset interface is to meet preset standard
Bus interface, including MIPI bus interface, I2C synchronous serial bus interface, spi bus interface.
19. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, which is characterized in that the program
The information processing method such as claim 1-9 any one of them recognitions of face is realized when being executed by processor.
20. a kind of terminal device, which is characterized in that including Laser video camera head, floodlight, visible image capturing head, color-changing lamp, micro-control
Unit MCU and processor processed, wherein the processor is used for：
Obtain the attribute information for the application program for calling recognition of face；
Judge whether face recognition process needs to execute at credible performing environment TEE according to the attribute information；
If face recognition process needs are executed at the credible performing environment TEE, control the application program into
Enter credible performing environment TEE patterns, and serially executes the step of the face recognition process at the credible performing environment TEE
Suddenly；
If the face recognition process without being executed at the credible performing environment TEE, control the application program into
Enter common performing environment REE patterns, and the step of executing the face recognition process parallel at common performing environment REE.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810327407.3A CN108595928A (en) | 2018-04-12 | 2018-04-12 | Information processing method, device and the terminal device of recognition of face |
| PCT/CN2019/081743 WO2019196793A1 (en) | 2018-04-12 | 2019-04-08 | Image processing method and apparatus, and electronic device and computer-readable storage medium |
| EP19784964.9A EP3633546A4 (en) | 2018-04-12 | 2019-04-08 | Image processing method and apparatus, and electronic device and computer-readable storage medium |
| US16/742,378 US11170204B2 (en) | 2018-04-12 | 2020-01-14 | Data processing method, electronic device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810327407.3A CN108595928A (en) | 2018-04-12 | 2018-04-12 | Information processing method, device and the terminal device of recognition of face |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108595928A true CN108595928A (en) | 2018-09-28 |
Family
ID=63621936
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810327407.3A Pending CN108595928A (en) | 2018-04-12 | 2018-04-12 | Information processing method, device and the terminal device of recognition of face |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108595928A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109635539A (en) * | 2018-10-30 | 2019-04-16 | 华为技术有限公司 | A kind of face identification method and electronic equipment |
| CN110335303A (en) * | 2019-06-24 | 2019-10-15 | Oppo广东移动通信有限公司 | Image processing method and device and storage medium |
| WO2019196669A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Laser-based security verification method and apparatus, and terminal device |
| WO2019196793A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Image processing method and apparatus, and electronic device and computer-readable storage medium |
| CN113192237A (en) * | 2020-01-10 | 2021-07-30 | 阿里巴巴集团控股有限公司 | Internet of things equipment supporting TEE and REE and method for realizing communication between TEE and REE |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005057472A1 (en) * | 2003-12-12 | 2005-06-23 | Authenmetric Co., Ltd | A face recognition method and system of getting face images |
| CN106548077A (en) * | 2016-10-19 | 2017-03-29 | 沈阳微可信科技有限公司 | Communication system and electronic equipment |
| CN106845285A (en) * | 2016-12-28 | 2017-06-13 | 北京握奇智能科技有限公司 | A kind of TEE systems coordinate to realize the method and terminal device of service with REE systems |
| CN107169483A (en) * | 2017-07-12 | 2017-09-15 | 深圳奥比中光科技有限公司 | Tasks carrying based on recognition of face |
-
2018
- 2018-04-12 CN CN201810327407.3A patent/CN108595928A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005057472A1 (en) * | 2003-12-12 | 2005-06-23 | Authenmetric Co., Ltd | A face recognition method and system of getting face images |
| CN106548077A (en) * | 2016-10-19 | 2017-03-29 | 沈阳微可信科技有限公司 | Communication system and electronic equipment |
| CN106845285A (en) * | 2016-12-28 | 2017-06-13 | 北京握奇智能科技有限公司 | A kind of TEE systems coordinate to realize the method and terminal device of service with REE systems |
| CN107169483A (en) * | 2017-07-12 | 2017-09-15 | 深圳奥比中光科技有限公司 | Tasks carrying based on recognition of face |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019196669A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Laser-based security verification method and apparatus, and terminal device |
| WO2019196793A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Image processing method and apparatus, and electronic device and computer-readable storage medium |
| US11170204B2 (en) | 2018-04-12 | 2021-11-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Data processing method, electronic device and computer-readable storage medium |
| CN109635539A (en) * | 2018-10-30 | 2019-04-16 | 华为技术有限公司 | A kind of face identification method and electronic equipment |
| CN110335303A (en) * | 2019-06-24 | 2019-10-15 | Oppo广东移动通信有限公司 | Image processing method and device and storage medium |
| CN113192237A (en) * | 2020-01-10 | 2021-07-30 | 阿里巴巴集团控股有限公司 | Internet of things equipment supporting TEE and REE and method for realizing communication between TEE and REE |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108595928A (en) | Information processing method, device and the terminal device of recognition of face | |
| US10685215B2 (en) | Method and apparatus for recognizing face | |
| US9805501B2 (en) | Image rendering method and apparatus | |
| CN103383723B (en) | Method and system for spoof detection for biometric authentication | |
| CN107368730A (en) | Unlock verification method and device | |
| CN107277053A (en) | Auth method, device and mobile terminal | |
| WO2021175014A1 (en) | Focus tracking method and related devices | |
| CN113205057B (en) | Face living body detection method, device, equipment and storage medium | |
| CN107707839A (en) | Image processing method and device | |
| CN107493428A (en) | Filming control method and device | |
| US20200279101A1 (en) | Face verification method and apparatus, server and readable storage medium | |
| US11989975B2 (en) | Iris authentication device, iris authentication method, and recording medium | |
| CN109325460B (en) | A kind of face identification method, optical center scaling method and terminal | |
| CN109086694A (en) | A kind of face identification system and method | |
| CN107895110A (en) | Unlocking method, device and the mobile terminal of terminal device | |
| CN108694389A (en) | Safe verification method based on preposition dual camera and electronic equipment | |
| CN108564032A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN108052813A (en) | Unlocking method, device and the mobile terminal of terminal device | |
| CN108564033A (en) | Safe verification method, device based on structure light and terminal device | |
| WO2021046773A1 (en) | Facial anti-counterfeiting detection method and apparatus, chip, electronic device and computer-readable medium | |
| CN107592491A (en) | Video communication background display methods and device | |
| CN107613239A (en) | Video communication background display methods and device | |
| US11170204B2 (en) | Data processing method, electronic device and computer-readable storage medium | |
| CN210691314U (en) | Access control system and login device based on in vivo detection | |
| CN108171205A (en) | For identifying the method and apparatus of face |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180928 |