CN108573170A - Information processing method and device, electronic equipment, computer readable storage medium - Google Patents
Information processing method and device, electronic equipment, computer readable storage medium Download PDFInfo
- Publication number
- CN108573170A CN108573170A CN201810326603.9A CN201810326603A CN108573170A CN 108573170 A CN108573170 A CN 108573170A CN 201810326603 A CN201810326603 A CN 201810326603A CN 108573170 A CN108573170 A CN 108573170A
- Authority
- CN
- China
- Prior art keywords
- image
- processing units
- depth
- target
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Bioethics (AREA)
- Computer Hardware Design (AREA)
- Databases & Information Systems (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
This application involves a kind of information processing method, device, electronic equipment and computer readable storage mediums.The image capture instruction that second processing unit is sent is received if this method includes first processing units, controlling camera module according to described image acquisition instructions acquires target image；The first image is obtained according to the target image；Described first image is sent to secure processing units, and by the secure processing units described first image is handled to obtain handling result, the handling result is sent to the second processing unit.Target image is handled jointly by first processing units and secure processing units, improves data processing speed.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of information processing method, device, electronic equipment, meter
Calculation machine readable storage medium storing program for executing.
Background technology
With the development of electronic equipment and face recognition technology, more and more electronic equipments can support face unlock, people
The functions such as face payment.Under normal conditions, it in order to ensure userspersonal information's safety, safety of payment etc. in electronic equipment, needs really
Protect the human face data safety of acquisition.
Invention content
A kind of information processing method of the embodiment of the present application offer, device, electronic equipment, computer readable storage medium, can
To improve the speed of data processing.
A kind of information processing method, including：
If first processing units receive the image capture instruction of second processing unit transmission, referred to according to described image acquisition
Control camera module is enabled to acquire target image；
The first image is obtained according to the target image；
Described first image is sent to secure processing units, and by the secure processing units to described first image
Processing obtains handling result, and the handling result is sent to the second processing unit.
A kind of information processing unit, including：
Acquisition module, if receive the image capture instruction of second processing unit transmission for first processing units, root
Target image is acquired according to described image acquisition instructions control camera module；
Processing module, for obtaining the first image according to the target image；
Transmission module for described first image to be sent to secure processing units, and passes through the secure processing units
Described first image is handled to obtain handling result, the handling result is sent to the second processing unit.
A kind of electronic equipment, including：First processing units, second processing unit, secure processing units and camera module,
The first processing units are connected with the second processing unit, secure processing units and camera module respectively, the safety
Processing unit is connected with the second processing unit；
The first processing units are used to receive the image capture instruction that the second processing unit is sent, according to described
Image capture instruction controls camera module and acquires target image, and obtains the first image according to the target image, will be described
First image is sent to secure processing units；
The secure processing units are used to be handled described first image to obtain handling result, and the processing is tied
Fruit is sent to the second processing unit.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
The step of information processing method is realized when row.
Information processing method and device, electronic equipment, computer readable storage medium in the embodiment of the present application, according to figure
After acquiring target image as acquisition instructions, by first processing units and secure processing units jointly to target image at
Reason, improves data processing speed.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Fig. 1 is the applied environment figure of information processing method in one embodiment；
Fig. 2 is the internal structure schematic diagram of electronic equipment in one embodiment；
Fig. 3 is the flow chart of information processing method in one embodiment；
Fig. 4 is the flow chart of information processing method in another embodiment；
Fig. 5 is the flow chart of information processing method in another embodiment；
Fig. 6 is the architecture diagram of information processing method in one embodiment；
Fig. 7 is the structure diagram of information processing unit in one embodiment.
Specific implementation mode
It is with reference to the accompanying drawings and embodiments, right in order to make the object, technical solution and advantage of the application be more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and
It is not used in restriction the application.
It is appreciated that term " first " used in this application, " second " etc. can be used to describe herein various elements,
But these elements should not be limited by these terms.These terms are only used to distinguish first element and another element.Citing comes
It says, in the case where not departing from scope of the present application, first processing units can be known as to second processing unit, and similarly,
Second processing unit can be known as first processing units.First processing units and second processing unit both processing unit,
But it is not same processing unit.
Fig. 1 is the application scenario diagram of information processing method in one embodiment.As shown in Figure 1, the application environment includes
Electronic equipment 100.Electronic equipment 100 may be received in the image capture instruction under credible running environment, pass through camera module
The target speckle image of the infrared image and structured light of user's face is acquired, and passes through first processing units and safe handling
Unit handles infrared image and target speckle image, obtains infrared image and depth image.Electronic equipment 100 can be intelligence
Energy mobile phone, tablet computer, personal digital assistant, Wearable etc..It is carried out by first processing units and secure processing units
Processing improves processing speed, and data handling procedure is in security context, it is ensured that the safety of data.
Fig. 2 is the internal structure block diagram of electronic equipment in one embodiment.As shown in Fig. 2, electronic equipment 200 may include taking the photograph
As head mould group 210, first processing units 220, second processing unit 230 and secure processing units 240 etc..First processing units
220 are respectively connected with camera module 210, second processing unit 230 and secure processing units 240.
Camera module 210 may include the first image acquisition device, first projector, the second image acquisition device and the second projection
Device.First image acquisition device, first projector and second projector are connected with first processing units 220 respectively.Second image is adopted
Storage can be connected with first processing units 220 or second processor 230.First image acquisition device can be Laser video camera head 212.The
One projector can be floodlight 214.Second image acquisition device can be RGB (Red/Green/Blue, red green blue color pattern)
Camera 216.Second projector can be color-changing lamp 218.Laser video camera head 212 and RGB cameras 216 may each comprise lens and figure
As elements such as sensors.Imaging sensor is generally complementary metal oxide semiconductor (Complementary Metal Oxide
Semiconductor, abbreviation CMOS) or charge coupling device (charge coupled device, abbreviation CCD).Laser video camera
The surface of imaging sensor in first 212 is by setting with the one-to-one optical filter of each pixel to realize to different wave length light
Intensity extraction so that Laser video camera head 212 can collect the black light image of different wave length.The filter plate can be permitted
Perhaps the consistent wavelength for the light that the optical wavelength passed through is sent out with color-changing lamp 218, may be, for example, infrared light, ultraviolet light etc..RGB cameras
216 may be used Bayer filter to obtain the intensity signal of three channels (R/G/B) respectively, acquire the cromogram of target object
Picture.Floodlight 214 can be laser diode, LED etc..The emission wavelength of floodlight 214 is identical as the wavelength of color-changing lamp 218.The
Two projectors may include light source, lens and structured light patterns generator, wherein light source can be surface-emission laser, vertical cavity
Face laser (Vertical Cavity Surface Emitting Laser, abbreviation VCSEL) array, structured light patterns generator
It can be frosted glass, diffraction optical element (Diffractive Optical Elements, abbreviation DOE) or both combination.
First processing units 220 can be MCU (Microcontroller Unit, micro-control unit).MCU may include PWM
(Pulse Width Modulation, pulse width modulation) 222, SPI/I2C (Serial Peripheral Interface/
Inter-Integrated Circuit, Serial Peripheral Interface (SPI)/bidirectional two-line synchronous serial interface) 224, RAM (Random
Access Memory, random access memory) 226 and Depth Engine (depth engine) 228.MCU can be controlled by PWM
Floodlight 214 is synchronous with Laser video camera head 212, and floodlight 214 sends out floodlight and is irradiated to target object, passes through Laser video camera head
212 collect floodlight image, if floodlight 214 sends out infrared light, collect infrared image.MCU controls radium by PWM
Shot-light 218 is synchronous with Laser video camera head 212, and 218 projective structure light pattern of color-changing lamp is to target object, by Laser video camera head 212
Collect target speckle image.
In one embodiment, color-changing lamp 218 can project knot in the reference planes away from electronic equipment known distance in advance
The structure light pattern pattern of speckle particle (carry) as referring to speckle image after being acquired by Laser video camera head 212, and is saved in the
It in the memory of one processing unit 220, can also be saved in the memory of second processing unit 230, peace can also be saved in
In the memory of full processing unit 240.The memory is nonvolatile memory.
Second processing unit 230 can be CPU processor.It is included in TEE (Trusted in second processing unit 230
Execution environment, credible running environment) under the CPU core that runs and in REE (Rich Execution
Environment, natural running environment) under the CPU core that runs.TEE and REE is ARM modules (Advanced RISC
Machines, Advanced Reduced Instruction Set processor) operational mode.Under normal conditions, the higher behaviour of safety in electronic equipment
Make behavior needs to execute at TEE, other operation behaviors can then be executed at REE.In the embodiment of the present application, when second processing list
The face information that member 230 receives application program obtains request, such as when application program needs face information to be unlocked, apply
When program needs face information to be paid, the CPU core that is run at TEE can by SECURE SPI/I2C buses 250 to
SPI/I2C interfaces 224 send image capture instruction in first processing units 220, and can emit impulse wave control by PWM222
Floodlight 214 is opened in camera module 210 opens to acquire color-changing lamp 218 in infrared image, control camera module 210
Acquire target speckle image.Collected infrared image and depth image can be sent to the first processing list by camera module 210
Depth Engine238 processing in member 220.Depth engine 238 can be by the target speckle image of acquisition and with reference to speckle pattern
It is right as being calculated with target speckle image and the anaglyph with reference to the offset information of corresponding points in speckle image
Anaglyph is handled to obtain depth image.First processing units 220 can be connect anaglyph by mobile Industry Processor
Mouth (Mobile Industry Processor Interface, abbreviation MIPI) is sent to secure processing units 240 and is handled
Obtain depth image.
First processing units 220 carry out recognition of face according to the infrared image got, and detecting in above-mentioned infrared image is
It is no that whether there are faces and the face detected to be matched with the face of storage；If recognition of face passes through, further according to above-mentioned infrared
Image and depth image carry out In vivo detection, detect above-mentioned face and whether there is bioactivity.In one embodiment, first
Processing unit 220 can first carry out In vivo detection and carry out recognition of face again, or simultaneously after getting infrared image and depth image
Carry out recognition of face and In vivo detection.Recognition of face by and the face that detects there are bioactivity, first processing units
220 can will be sent to secure processing units 240 to the average information of above-mentioned infrared image and depth image.Secure processing units
240 the average information of infrared image and depth image are calculated the depth information of face, and depth information is sent under TEE
CPU core.
Secure processing units 240 can be independent processor, or using hardware and soft in second processing unit 230
The safety zone that the mode of part isolation is formed, such as second processing unit 230 can be multi-core processor, will a wherein core processor
It is secure processing units to delimit, for calculating the depth information of face, infrared image and the stored infrared image of acquisition
Matching, the depth image of acquisition and stored range image registration etc..Secure processing units 240 can carry out data parallel
Processing or serial process.
Fig. 3 is the flow chart of information processing method in one embodiment.As shown in figure 3, a kind of information processing method, can transport
Row is on the electronic equipment of Fig. 1 or Fig. 2, including step 302 is to step 306.Wherein：
Step 302, if first processing units receive the image capture instruction of second processing unit transmission, according to the figure
As acquisition instructions control camera module acquires target image.
Specifically, first processing units 220 are the processors for handling data, may be, for example, MCU processor.Pass through control
First processing units 220 processed are output and input, and can allow 220 safe handling data of first processing units.Second processing unit 230
It is the processor for handling data, may be, for example, CPU processor.
CPU has 2 kinds of operational modes in electronic equipment：TEE and REE, wherein TEE is credible running environment, and REE is nature
Running environment.Under normal conditions, CPU is operated under REE, but when electronic equipment needs to obtain the higher data of security level,
Such as electronic equipment need obtain human face data when, CPU can be switched to TEE by REE.It, can when CPU is monokaryon in electronic equipment
Above-mentioned monokaryon is directly switched to TEE by REE；When CPU is multinuclear in electronic equipment, electronic equipment is by a kernel by REE
It is switched to TEE, other kernels still operate in REE.Target image refers to according to camera to target object acquired image,
It may include at least one of infrared image and target speckle image.
After second processing unit 230 receives the information for needing human face data of application program side transmission, by CPU one
A kernel is switched to TEE by REE, and image capture instruction is sent to the first processing list by the CPU core being switched under TEE
Member, it is ensured that the instruction of first processing units input is safe.When first processing units receive above-mentioned image capture instruction
When, first processing units 220 can control floodlight 214 in camera module 210 to open to acquire infrared image, control camera
Color-changing lamp 218, which is opened, in module 210 carrys out sampling depth image.Above-mentioned floodlight 214 is a kind of to all the winds uniform irradiation
Point light source, the light of above-mentioned floodlight transmitting can be infrared light, and electronic equipment can acquire face and obtain infrared image.Above-mentioned radium
The laser that shot-light 218 is sent out can carry out diffraction by lens and DOE and generate the pattern with speckle particle, pass through the figure with speckle particle
Case projects target object, and by target object each point, difference generates deviating for speckle pattern at a distance from electronic equipment, and laser is taken the photograph
As first 212 pairs of target objects are acquired to obtain target speckle image.Laser video camera head 212 passes the target speckle image of acquisition
Give first processing units 220.
Step 304, the first image is obtained according to the target image.
Specifically, target image may include at least one of infrared image and target speckle image.First processing units pair
The infrared image of acquisition carries out processing and infrared intermediate image can be obtained, and is handled the target speckle image of acquisition and is included
Target speckle image and the anaglyph of the offset information of corresponding points in reference speckle image or the depth with depth information
Spend image etc..First image may include one or more in infrared intermediate image, anaglyph, depth image etc..
Step 306, described first image is sent to secure processing units, and by the secure processing units to described
First image procossing obtains handling result, and the handling result is sent to the second processing unit.
Specifically, after the first image is sent to secure processing units 240 by first processing units 220, by safe handling list
First 240 pair of first image is handled to obtain corresponding handling result, such as is handled anaglyph to obtain depth image,
Infrared image and depth image are sent to second processing unit 230 to store.Second processing unit 230 can be at credible fortune
Under row environment or untrusted running environment, when preserving data under credible running environment, it is ensured that the safety of data.
Information processing method in the present embodiment, first processing units 220 are sent by receiving second processing unit 230
Image capture instruction, control camera module acquire target image, the first image is obtained further according to target image, by first
Image is sent to secure processing units and is handled, can be by first processing units and secure processing units by the target image of acquisition
It is common to carry out data processing, improve the speed of data processing.
In one embodiment, which further includes：If first processing units receive second processing unit
The image capture instruction sent under credible running environment controls camera module according to the image capture instruction and acquires target figure
Picture.In this way, acquisition instructions and data handling procedure carry out in a secure environment, it is ensured that the safety of data.
In one embodiment, target image includes target speckle image, described to obtain first according to the target image
Image includes：It obtains and refers to speckle image, it is described to carry reference depth information with reference to speckle image；Speckle image is referred to by described
It is matched with the target speckle image, obtains matching result；Described first image is obtained according to the matching result, it is described
First image is with the target speckle image and the disparity map with reference to the offset information of corresponding points in speckle image
Picture.
Specifically, depth information is depth value.By each point in target speckle image, centered on the point (x, y), choosing
A default size block of pixels, such as 31pixel*31pixel sizes are selected, the block to match is searched on reference to speckle pattern, is counted
It calculates in the transversal displacement with reference to the coordinate and (x, y) coordinate of matched point on speckle pattern, offset to the right is just, to deviate to the left
It is denoted as negative, calculated offset, which is brought into formula (1), can obtain the depth value of point (x, y), calculate the depth each put successively
Angle value can obtain the depth image with the depth information of each point in target speckle image.First processing units can also be asked
The transversal displacement for taking each point is obtained with target speckle image and the parallax with reference to the offset of corresponding points in speckle image
Image.
In one embodiment, target image includes target speckle image, described to obtain first according to the target image
Image includes：It obtains and refers to speckle image, it is described to carry reference depth information with reference to speckle image；Speckle image is referred to by described
It is matched with the target speckle image, obtains matching result；Institute is obtained according to the reference depth information and matching result
The first image is stated, described first image is the depth map with depth information.
Specifically, first processing units 220 or secure processing units 240 by target speckle image with reference to speckle image into
The calculating of line displacement amount can calculate the corresponding spatial point of each pixel in target speckle image according to offset and be set apart from electronics
The depth value Z of the first standby collectorD, calculation formula is as follows：
Wherein, L is the distance between the first collector and second projector, and f is the coke of lens in the first image acquisition device
Away from Z0The depth value of first collector of the reference planes apart from electronic equipment when for reference to speckle image acquisition, P is target speckle
Image and the offset with reference to corresponding points in speckle image.P can be by target speckle image and corresponding points in reference speckle image
The actual range that the amount of pixels of offset is multiplied by a pixel obtains.When the distance between target object and the first collector are more than
When the distance between reference planes and the first collector, P is negative value, when the distance between target object and the first collector are less than
When the distance between reference planes and the first collector, P is positive value.
First processing units 220 calculate target speckle image with reference to speckle image, can obtain carrying offset
The anaglyph of information.Secure processing units 240 carry out that depth map is calculated according to the anaglyph with offset information
Picture.Wherein, anaglyph is an intermediate image.
Specifically, by each point in target speckle image, centered on the point (x, y), selection one is default size of
Plain block, such as 31pixel*31pixel sizes search for the block to match on reference to speckle pattern, calculate on reference to speckle pattern
The transversal displacement of the coordinate and (x, y) coordinate of matched point, to the right offset are that just, offset to the left is denoted as negative, calculating
Offset bring formula (1) into and can obtain the depth value of point (x, y), calculate the depth value each put successively, band can be obtained
There is the depth image of the depth information of each point in target speckle image.
In one embodiment, target image includes infrared image, and described information processing method further includes：According to infrared figure
As carrying out recognition of face；When described first image is anaglyph, by the secure processing units according to first figure
As obtaining corresponding depth image, In vivo detection is carried out according to the infrared image and depth image；When described first image is
When depth image, In vivo detection is carried out according to the infrared image and the first image by the secure processing units.
It, can be by target speckle image and red after camera module 210 collects above-mentioned infrared image and target speckle image
Outer image passes to first processing units 220.Above-mentioned first processing units 220 are receiving above-mentioned infrared image and depth image
Afterwards, Face datection can be carried out to above-mentioned infrared image and depth image.Wherein, first processing units 220 according to infrared image into
Row Face datection includes：Whether first processing units 220 carry out recognition of face to infrared image, detect in above-mentioned infrared image and deposit
In face, if there are faces, then there will be face matched with the face stored in electronic equipment, if successful match,
Recognition of face passes through, that is, the face detected is consistent with the face of storage.First processing units 220 can also according to infrared image and
Depth image carries out In vivo detection.Wherein, first processing units 220 carry out In vivo detection according to infrared image and depth image
Including：First processing units 220 detect whether that there are faces according to infrared image, and first processing units 220 are according to depth image
Whether the existing face of detection has depth information.If there are faces present in face and infrared image in depth in infrared image
Spending has depth information in image, then can determine that above-mentioned face has bioactivity.Further, first processing units 220 are gone back
Artificial intelligence model can be used, intelligent recognition is carried out to above-mentioned infrared image and depth image, obtains the line of the face detected
Reason can determine that whether face has bioactivity according to the texture of above-mentioned face.Above-mentioned first processing units 220 are to infrared figure
As carrying out recognition of face, carrying out the sequencing interchangeable of In vivo detection to infrared image and depth image, i.e., the first processing is single
Member 220 can advanced row recognition of face carry out In vivo detection again, first processing units 220 also can first carry out In vivo detection again into pedestrian
Face identifies.In addition, can also be carried out by secure processing units 240 recognition of face and In vivo detection or first processing units 220 into
Row recognition of face, secure processing units 240 carry out In vivo detection or first processing units 220 carry out In vivo detection, safe place
It manages unit 240 and carries out recognition of face, it is without being limited thereto.
First processing units 220 or secure processing units 240 carry out In vivo detection according to infrared image and depth image
Method includes：Continuous multiple frames infrared image and depth image are obtained, is according to above-mentioned infrared image and depth image detection face
It is no to have corresponding depth information, if face has corresponding depth information, then examined by continuous multiple frames infrared image and depth image
Survey whether face changes, such as whether face blinks, swings, opens one's mouth.If detecting face, there are corresponding depth informations
And face changes, then there are bioactivity, then Face datection to pass through for face.Above-mentioned first processing units 220 are carrying out face
When detection, In vivo detection, or In vivo detection are no longer carried out not if not by no longer carrying out recognition of face if recognition of face.
Method in the embodiment of the present application can by carrying out recognition of face and In vivo detection to infrared image and depth image
Judge whether the face detected is true man, improves the accuracy of Face datection.
In one embodiment, first processing units 220 also can directly to infrared image and target speckle image at
Reason, obtains the depth information of face, then the depth information of the infrared image of acquisition, target speckle image and face is sent to peace
Full processing unit 240.
In one embodiment, control camera module 210 acquires infrared image and depth image includes：Camera module
The time interval acquired between infrared image and depth image is less than first threshold.
Electronic equipment acquires infrared image and the mode of depth image includes：Electronic equipment opens floodlight 214, by swashing
Light video camera head 212 acquires infrared image；Electronic equipment opens color-changing lamp 218, passes through 212 sampling depth image of Laser video camera head.
Electronic equipment in order to ensure the accuracy of collected data, therefore is acquired when acquiring above-mentioned infrared image and depth image
Time interval between infrared image and depth image is the smaller the better.
Camera module acquires infrared image and the method for depth image includes：
(1) floodlight lamp controller and radium-shine lamp controller is respectively set, first processing units are separately connected by two-way PWM
Floodlight lamp controller and radium-shine lamp controller can when first processing units need to control floodlight unlatching or color-changing lamp unlatching
Emit impulse wave control floodlight unlatching to floodlight lamp controller by PWM or emit impulse wave to radium-shine lamp controller and controls radium
Shot-light is opened, and emits impulse wave to two controllers respectively by PWM to control between acquisition infrared image and depth image
Time interval.
(2) controller is set and is controlled by the connections of PWM all the way for controlling floodlight and color-changing lamp, first processing units
Device processed, when first processing units need to control, floodlight is opened or when color-changing lamp is opened, first processing units are by PWM to control
Device emits impulse wave to open floodlight or color-changing lamp, and second processing unit 230 controls cutting between floodlight and color-changing lamp
It changes.It is realized between acquisition infrared image and depth image by controlling the time interval switched between floodlight and color-changing lamp
Time interval is less than first threshold.Above-mentioned first threshold can be value set by user or the value of electronic equipment setting, such as 1 milli
Second.
Method in the embodiment of the present application, the time interval between collected infrared image and depth image are less than the first threshold
Value, it is ensured that the consistency of collected infrared image and depth image, avoid between infrared image and depth image exist compared with
Big error improves the accuracy to data processing.
In one embodiment, as shown in figure 4, described information processing method further includes：
Step 402, the data acquisition request for receiving application program obtains the security level of application program.
Specifically, second processing unit receives the data acquisition request that application program is initiated, then obtains the application program
Security level.Application program refers to installing on an electronic device, provides the program of a certain service.It can set in advance on an electronic device
Set the security level of application program.For example, the security level of unlock class application program, payment class application program etc. is high.It is not awarded
The security level for weighing the application program of certification is low, such as to third party application etc. that image is handled.
Step 404, precision grade corresponding with the security level is searched.
Specifically, the precision grade that different security levels corresponds to different images is pre-set.According to application program
Security level finds corresponding precision grade.
Step 406, according to the precision of precision grade percentage regulation image, the depth image after adjustment is sent to using journey
Sequence.
Specifically, second processing unit, can be according to application program after getting the corresponding security level of application program
Security level adjusts the precision of above-mentioned depth image.Wherein, the precision of depth image and the security level of application program are proportional
The security level of relationship, i.e. application program is higher, and the precision of depth image is higher；The security level of application program is lower, depth
The precision of image is lower.Second processing unit is after the precision to depth image is adjusted, then by the depth image after adjustment
It is sent to application program.
The security level of application program can be pre-set by system, and the form of white list can be used, and difference is respectively set and answers
With the security level of program.Such as the security level height of the first application program of the U.S. face processing of offer of mandate can be set, it does not award
The security level of second application program of the U.S. face processing of offer of power is low.
The depth image for providing different accuracy rank in the embodiment of the present application according to the security level of application program, can be effective
Controlling depth image data ensures the safety of depth image data, and depth image data etc. is avoided to be obtained by unauthorized applications.
In one embodiment, include at least one of following methods according to the precision of precision grade percentage regulation image：
(1) according to the resolution ratio of precision grade percentage regulation image；
(2) number at the target speckle image midpoint of camera module acquisition is adjusted according to precision grade.
When the precision of 230 percentage regulation image of second processing unit, the resolution ratio of above-mentioned depth image can adjust.Work as depth
The then high resolution of depth image when the precision of image is high；When the precision of depth image is low, then the resolution ratio of depth image is low.
The resolution ratio of above-mentioned adjustment image can be realized by adjusting number of pixels in image.Second processing unit 230 also can be by subtracting
The number at the target speckle image midpoint of few camera module acquisition carrys out the precision of percentage regulation image.When in target speckle image
Point is more, and the precision of depth image is higher；When target speckle image midpoint is less, the precision of depth image is relatively low.
Method in the embodiment of the present application, according to the security level of application program come the precision of percentage regulation image so that no
The depth image that different accuracy can be obtained with the application program of security level reduces the lower application program leakage of security level
The risk of data improves the safety of data.
In one embodiment, as shown in figure 5, above- mentioned information processing method further includes：
Step 502, the data acquisition request for receiving application program obtains the security level of application program.
Step 504, corresponding data transmission channel is chosen according to security level, data transmission channel include escape way and
Common passageway.
Step 506, depth image is sent to by application program by the corresponding data transmission channel of security level.
Second processing unit 230 can recognize that above application program after receiving the data acquisition request of application program
Security level.When data are transferred to application program by second processing unit 230, escape way and Common passageway can be set, it is above-mentioned
The security level of escape way is higher, and the security level of Common passageway is relatively low.It, can be to data when data are transmitted in escape way
It is encrypted.Can corresponding data transmission channel be set to the application program of different security levels in electronic equipment.Wherein, safety
The high application program of rank corresponds to escape way, and the low application program of security level corresponds to Common passageway.For example, payment class application
Escape way can be used in the data transmission of program, and Common passageway can be used in image class application call data transmission.Second processing
Depth image is passed through corresponding data by unit 230 after the corresponding data transmission channel of security level for obtaining application program
Transmission channel is sent to application program so that application program handles above-mentioned depth image.
In one embodiment, described information processing method further includes：When the first processing units are received in
The image capture instruction that second processing unit under one running environment is sent according to the checking request of application program, according to the figure
As acquisition instructions control the camera module acquisition infrared image and target speckle image；It is obtained according to the target speckle image
Depth image is taken, the depth image of the infrared image of the acquisition and acquisition is sent to the secure processing units, the peace
The infrared image of the acquisition is compared by full processing unit with stored infrared image, by the depth image of the acquisition
It is compared, is verified as a result, the verification result is sent to described in the first operation with stored depth image
Second processing unit under environment；It is right that the verification result by data security transmission channel is sent to application program institute
The server answered.
Specifically, the checking request of application program can be the request for needing to carry out face verification.The application program can be solution
The application of lock class, payment class application etc. need the application program of verification result.Verification result is to be verified or authentication failed.Verification
By referring to that infrared image progress face verification passes through, and depth image carries out In vivo detection and passes through.Authentication failed refers to infrared
Image or depth image authentication failed.First running environment can be credible running environment.
Verification result is used and is encrypted to obtain encryption text with the scheduled key of application program by second processing unit 230
Part will encrypt file and be sent to by data security transmission channel server corresponding to application program.Such as Alipay application,
Encryption file is then sent to the server corresponding to Alipay.
In the embodiment of the present application, infrared image and target speckle image are acquired according to the checking request of application program, according to
Infrared image carries out recognition of face verification, carries out In vivo detection according to depth image, transmits verification result to application program, allow
Server corresponding to application program judges whether to execute the operation being verified according to verification result.
Fig. 6 is the software architecture schematic diagram of information processing method in one embodiment.As shown in fig. 6, the software architecture packet
Include application layer 610, operating system 620 and credible running environment 630.Wherein, the module in credible running environment 630 includes
Security service module 634.Hardware layer includes floodlight ＆ color-changing lamps 631, infrared camera 632, micro-control unit 633 etc..Micro-control
Unit 633 processed can output and input the safety of guarantee data by controlling it.Micro-control unit 633 can be by controlling floodlight ＆
Color-changing lamp 631 and infrared camera 632 acquire safe infrared image and target speckle image, then by infrared image and target
Speckle image transmission is transferred in the security service module 634 of credible running environment 630.It include bursting tube in operating system 630
Manage module 621, face management module 622, webcam driver 623 and camera frame 624；Comprising using journey in application layer 610
Sequence 611.Application program 611 can initiate image capture instruction, and electronic equipment can drive floodlight ＆ radium by image capture instruction
Shot-light 631 and infrared camera 632 work.For example, paid, unlocked by acquiring face, the operations such as U.S. face when,
Application program can initiate the image capture instruction of acquisition facial image.Camera get infrared image and target speckle image it
Afterwards, it can judge that the image currently obtained is for security application operation or non-security application operating according to image capture instruction.
It, can be by escape way by the infrared image of acquisition and target speckle when the depth image of acquisition is for security application operation
Image is sent to micro-control unit 633, and micro-control unit 633 is calculated further according to target speckle image with reference to speckle image
Disparity map is obtained, depth image is calculated further according to disparity map, and the depth image being calculated and infrared image are sent
To security service module 634.It is understood that the process of depth map is calculated according to target speckle image to pacify
It is carried out in full service module 634.Security service module 634 can will be sent to safety management module to infrared image and depth image
621.Usually, different application programs 611 has corresponding safety management module 621, safety management module 621 can be by depth
Image and infrared image are sent to corresponding face management module 622.Face management module 622 can be according to infrared image and depth
Image carries out the processing such as Face datection, identification, verification, then handling result is sent to the application program 611 on upper layer, application program
611 carry out security application operation further according to handling result.When the depth image of acquisition is for U.S. face, AR (Augmented
Reality, augmented reality) etc. it is non-security in application, infrared camera 632 acquire infrared image and target speckle image
Can webcam driver 623 be directly sent to by non-security channel, webcam driver 623 can be calculated according to target speckle pattern
Disparity map, and depth map is calculated according to disparity map.Infrared image and depth image can be sent to by webcam driver 623
Camera frame 624, then face management module 622 or application program 611 are sent to by camera frame 624.Wherein, safety is logical
The switching in road and non-security channel is completed by micro-control unit 633.
It should be understood that although each step in the flow chart of Fig. 3, Fig. 4, Fig. 5 is shown successively according to the instruction of arrow
Show, but these steps are not the inevitable sequence indicated according to arrow to be executed successively.Unless expressly state otherwise herein, this
There is no stringent sequences to limit for the execution of a little steps, these steps can execute in other order.Moreover, Fig. 3, Fig. 4 and
At least part step in Fig. 5 may include that either these sub-steps of multiple stages or stage be not necessarily for multiple sub-steps
It is so to execute completion in synchronization, but can execute at different times, these sub-steps or stage execute sequence
Also it is not necessarily and carries out successively, but can be with other steps either sub-step of other steps or at least part in stage
It executes in turn or alternately.
Fig. 7 is the structure diagram of the information processing unit of one embodiment.As shown in fig. 7, a kind of information processing unit 700
Including acquisition module 710, processing module 720 and transmission module 730.
If acquisition module 710 receives the image capture instruction of second processing unit transmission for first processing units,
Camera module, which is controlled, according to described image acquisition instructions acquires target image；
Processing module 720 is used to obtain the first image according to the target image.
Transmission module 730 is used to described first image being sent to secure processing units, and passes through the safe handling list
Member handles described first image to obtain handling result, and the handling result is sent under first running environment
Second processing unit.
In one embodiment, which includes target speckle image, and the processing module 720 is additionally operable to obtain ginseng
Speckle image is examined, it is described to carry reference depth information with reference to speckle image；By the reference speckle image and the target speckle
Image is matched, and matching result is obtained；Obtain described first image according to the matching result, described first image be with
The target speckle image and the anaglyph with reference to the offset information of corresponding points in speckle image.
In one embodiment, which includes target speckle image, and processing module 720 is additionally operable to obtain with reference to scattered
Spot image, it is described to carry reference depth information with reference to speckle image；By the reference speckle image and the target speckle image
It is matched, obtains matching result；Described first image is obtained according to the reference depth information and matching result, described first
Image is the depth image with depth information.
In one embodiment, processing module 720 is additionally operable to carry out recognition of face according to infrared image；When first figure
When as being anaglyph, corresponding depth image is obtained according to described first image by the secure processing units, according to institute
It states infrared image and depth image carries out In vivo detection；When described first image is depth image, pass through the safe handling
Unit carries out In vivo detection according to the infrared image and the first image.
In one embodiment, processing module 720 is additionally operable to receive the data acquisition request of application program, described in acquisition
The security level of application program；Search precision grade corresponding with the security level；According to the precision grade percentage regulation
Depth image after adjustment is sent to the application program by the precision of image.
In one embodiment, processing module 720 is additionally operable to the resolution ratio according to the precision grade percentage regulation image；
Or, adjusting the number at the target speckle image midpoint of the camera module acquisition according to the precision grade.
In one embodiment, processing module 720 is additionally operable to receive the data acquisition request of application program, described in acquisition
The security level of application program；Corresponding data transmission channel is determined according to the security level；Described first image is passed through
Corresponding data transmission channel is sent to the application program.
In one embodiment, processing module 720 is additionally operable to receive in the first operation when the first processing units
The image capture instruction that second processing unit under environment is sent according to the checking request of application program, acquires according to described image
Instruction controls the camera module acquisition infrared image and target speckle image；Depth is obtained according to the target speckle image
The depth image of the infrared image of the acquisition and acquisition is sent to the secure processing units, the safe handling by image
The infrared image of the acquisition is compared by unit with stored infrared image, by the depth image of the acquisition with deposited
The depth image of storage is compared, and is verified as a result, the verification result is sent to described under the first running environment
Second processing unit；The verification result is sent to by data security transmission channel to the clothes corresponding to the application program
Business device.
The division of modules is only used for for example, in other embodiments, can will believe in above- mentioned information processing unit
Breath processing unit is divided into different modules as required, to complete all or part of function of above- mentioned information processing unit.
The embodiment of the present application also provides a kind of computer readable storage mediums.One or more is executable comprising computer
The non-volatile computer readable storage medium storing program for executing of instruction, when the computer executable instructions are executed by one or more processors
When so that the step of the processor execution information processing method.
The embodiment of the present application also provides a kind of computer program products.A kind of computer program product including instruction,
When run on a computer so that computer execution information processing method.
The embodiment of the present application also provides a kind of electronic equipment.The internal structure of the electronic equipment is as shown in Figure 2.The electronics
Equipment includes camera module 210, first processing units 220, second processing unit 230 and secure processing units 240.At first
Reason unit 220 is respectively connected with camera module 210, second processing unit 230 and secure processing units 240.Safe handling list
Member 240 is connected with second processing unit 230.
First processing units 220 are used to receive the image capture instruction of the transmission of second processing unit 230, according to the figure
As the acquisition instructions control acquisition target image of camera module 210, and the first image is obtained according to the target image, it will be described
First image is sent to secure processing units 240.
Secure processing units 240 are used to be handled described first image to obtain handling result, and the processing is tied
Fruit is sent to second processing unit 220.
Specifically, first processing units 220 can be microprocessor, and second processing unit 230 can be central processing unit, safety
Processing unit 240 can be independent embeded processor or can be second processing unit 230 multi-core processor in divide
The single core processor etc. of safety, can concurrently or sequentially be handled data.Second processing unit 230 is in the first running environment
Under to data carry out serial process.First running environment refers to TEE environment.Second processing unit 230 can also be under REE environment
Data are handled.First processing units 220 calculate target speckle image with reference to speckle image, can be carried
The anaglyph of offset information.Secure processing units 240 are calculated according to the anaglyph with offset information
Depth image.
Electronic equipment in the embodiment of the present application, first processing units 220 are sent by receiving second processing unit 230
Image capture instruction, control camera module 210 acquire target image, obtain the first image further according to target image, will
First image is sent to secure processing units and is handled, can be by first processing units 220 and safety by the target image of acquisition
Processing unit 240 carries out data processing jointly, improves the speed of data processing.
In one embodiment, first processing units 220 can receive second processing unit 230 under credible running environment
The image capture instruction of transmission controls camera module 210 according to the image capture instruction and acquires target image.In this way, acquisition
Instruction and data handling procedure carry out in a secure environment, it is ensured that the safety of data.
In one embodiment, the camera module 210 includes be respectively connected with the first processing units 220
One projector, second projector and the first image acquisition device.
First processing units 220 are additionally operable to control first projector transmitting infrared light and second projector transmitting
Structured light patterns；Described first image collector is for acquiring infrared image and target speckle image, and by the infrared figure of acquisition
Picture and target speckle image are sent to the first processing units.
First image acquisition device can be Laser video camera head.First projector can be floodlight.Second projector can be radium-shine
Lamp.Color-changing lamp may include light source, lens and structured light patterns generator.First image acquisition device and second projector are located at same
In one plane.
In one embodiment, target image includes target speckle image；First processing units 220 are additionally operable to obtain reference
Speckle image, it is described to carry reference depth information with reference to speckle image, by the reference speckle image and the target speckle pattern
As being matched, obtain matching result, described first image obtained according to the matching result, described first image be band
State the anaglyph of target speckle image and the offset information with reference to speckle image corresponding points.
In one embodiment, target image includes target speckle image；First processing units 220 are additionally operable to obtain reference
Speckle image, it is described to carry reference depth information with reference to speckle image, by the reference speckle image and the target speckle pattern
As being matched, matching result is obtained, and described first image is obtained according to the reference depth information and matching result, institute
It is the depth image with depth information to state the first image.
In one embodiment, control camera module acquisition infrared image and depth image include：Camera module is adopted
The time interval collected between infrared image and depth image is less than first threshold.
Electronic equipment acquires infrared image and the mode of depth image includes：Electronic equipment opens floodlight 214, by swashing
Light video camera head 212 acquires infrared image；Electronic equipment opens color-changing lamp 218, passes through 212 sampling depth image of Laser video camera head.
Electronic equipment in order to ensure the accuracy of collected data, therefore is acquired when acquiring above-mentioned infrared image and depth image
Time interval between infrared image and depth image is the smaller the better.
In one embodiment, electronic equipment may also include the first projector controller and the second projector controller, the
One processing unit is separately connected the first projector controller and the second projector controller by two-way PWM, when the first processing is single
When member needs to control the unlatching of first projector or the unlatching of second projector, arteries and veins can be emitted to the first projector controller by PWM
Rush wave control floodlight open or to the second projector controller transmitting impulse wave control color-changing lamp open, by PWM respectively to
Two controllers emit impulse waves to control the time interval between acquisition infrared image and depth image.
In one embodiment, electronic equipment may include a controller, by the controller control first projector and
Second projector, first processing units are by the connection controllers of PWM all the way, when first processing units need to control first projector
When unlatching or second projector are opened, first processing units emit impulse wave to open first projector by PWM to controller
Or second projector, second processing unit control the switching between first projector and second projector.Pass through control first
The time interval switched between the projector and second projector come realize acquisition infrared image and depth image between time between
Every less than first threshold.Above-mentioned first threshold can be value set by user or the value of electronic equipment setting, such as 1 millisecond.
In one embodiment, the secure processing units 240 are additionally operable to carry out recognition of face according to the infrared image；
When described first image is anaglyph, the secure processing units obtain corresponding according to described first image
Depth image carries out In vivo detection according to the infrared image and depth image；
When described first image is depth image, the secure processing units are according to the infrared image and the first image
Carry out In vivo detection.
In one embodiment, the second processing unit 230 is additionally operable to receive the data acquisition request of application program,
The security level of the application program is obtained, searches precision grade corresponding with the security level, and according to the precision
Depth image after adjustment is sent to the application program by the precision of rank adjusting depth image.
In one embodiment, the second processing unit 230 is additionally operable to adjust the depth according to the precision grade
The resolution ratio of image.
In one embodiment, the second processing unit 230 is additionally operable to adjust the camera shooting according to the precision grade
The number at the target speckle image midpoint that head mould group 210 acquires.
In one embodiment, the second processing unit 230 is additionally operable to receive the data acquisition request of application program,
The security level for obtaining the application program determines corresponding data transmission channel according to the security level, and will be described
First image is sent to the application program by corresponding data transmission channel.
In one embodiment, the first processing units 220 are additionally operable to receive under the first running environment
The image capture instruction that two processing units 230 are sent according to the checking request of application program, according to described image acquisition instructions control
It makes the camera module 210 and acquires infrared image and target speckle image, depth map is obtained according to the target speckle image
The depth image of the infrared image of the acquisition and acquisition is sent to the secure processing units 240 by picture；
The secure processing units 240 are additionally operable to compare the infrared image of the acquisition and stored infrared image
Compared with the depth image of the acquisition is compared with stored depth image, is verified as a result, by the verification result
It is sent to the second processing unit 230 under the first running environment；
The verification result is sent to described using journey by the second processing unit 230 by data security transmission channel
Server corresponding to sequence.
Used in this application may include to any reference of memory, storage, database or other media is non-volatile
And/or volatile memory.Suitable nonvolatile memory may include read-only memory (ROM), programming ROM (PROM),
Electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include arbitrary access
Memory (RAM), it is used as external cache.By way of illustration and not limitation, RAM is available in many forms, such as
It is static RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDR SDRAM), enhanced
SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM).
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
Cannot the limitation to the application the scope of the claims therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the guarantor of the application
Protect range.Therefore, the protection domain of the application patent should be determined by the appended claims.
Claims (19)
1. a kind of information processing method, which is characterized in that including：
If first processing units receive the image capture instruction of second processing unit transmission, according to described image acquisition instructions control
Camera module processed acquires target image；
The first image is obtained according to the target image；
Described first image is sent to secure processing units, and by the secure processing units to described first image processing
Handling result is obtained, the handling result is sent to the second processing unit.
2. according to the method described in claim 1, it is characterized in that, the target image includes target speckle image；
It is described to include according to the target image the first image of acquisition：
It obtains and refers to speckle image, it is described to carry reference depth information with reference to speckle image；
It is matched described with the target speckle image with reference to speckle image, obtains matching result；
Obtain described first image according to the matching result, described first image be with the target speckle image with it is described
With reference to the anaglyph of the offset information of corresponding points in speckle image.
3. according to the method described in claim 1, it is characterized in that, the target image includes target speckle image；
It is described to include according to the target image the first image of acquisition：
It obtains and refers to speckle image, it is described to carry reference depth information with reference to speckle image；
It is matched described with the target speckle image with reference to speckle image, obtains matching result；
Described first image is obtained according to the reference depth information and matching result, described first image is with depth information
Depth image.
4. according to the method in claim 2 or 3, which is characterized in that the target image further includes infrared image；The side
Method further includes：
Recognition of face is carried out according to the infrared image；
It is corresponding according to described first image acquisition by the secure processing units when described first image is anaglyph
Depth image carries out In vivo detection according to the infrared image and depth image；
When described first image is depth image, by the secure processing units according to the infrared image and the first image
Carry out In vivo detection.
5. according to the method described in claim 1, it is characterized in that, the method further includes：
The data acquisition request for receiving application program obtains the security level of the application program；
Search precision grade corresponding with the security level；
According to the precision of the precision grade percentage regulation image, the depth image after adjustment is sent to the application program.
6. according to the method described in claim 5, it is characterized in that, the essence according to the precision grade percentage regulation image
Degree includes：
According to the resolution ratio of the precision grade percentage regulation image；
Or, adjusting the number at the target speckle image midpoint of the camera module acquisition according to the precision grade.
7. according to the method described in claim 1, it is characterized in that, the method further includes：
The data acquisition request for receiving application program obtains the security level of the application program；
Corresponding data transmission channel is determined according to the security level；
Described first image is sent to the application program by corresponding data transmission channel.
8. according to the method described in claim 1, it is characterized in that, the method further includes：
When the first processing units receive second processing unit the testing according to application program under the first running environment
The image capture instruction that card request is sent, according to described image acquisition instructions control camera module acquisition infrared image and
Target speckle image；
Depth image is obtained according to the target speckle image, the infrared image of the acquisition and the depth image of acquisition are sent
To the secure processing units, the secure processing units carry out the infrared image of the acquisition and stored infrared image
Compare, the depth image of the acquisition is compared with stored depth image, is verified as a result, the verification is tied
Fruit is sent to the second processing unit under the first running environment；
The verification result is sent to by data security transmission channel to the server corresponding to the application program.
9. a kind of information processing unit, which is characterized in that including：
Acquisition module, if receive the image capture instruction of second processing unit transmission for first processing units, according to institute
State image capture instruction control camera module acquisition target image；
Processing module, for obtaining the first image according to the target image；
Transmission module, for described first image to be sent to secure processing units, and by the secure processing units to institute
It states the first image procossing and obtains handling result, the handling result is sent to the second processing unit.
10. a kind of electronic equipment, which is characterized in that including：First processing units, second processing unit, secure processing units and
Camera module, the first processing units respectively with the second processing unit, secure processing units and camera module phase
Even, the secure processing units are connected with the second processing unit；
The first processing units are used to receive the image capture instruction that the second processing unit is sent, according to described image
Acquisition instructions control camera module and acquire target image, and obtain the first image according to the target image, by described first
Image is sent to the secure processing units；
The secure processing units send out the handling result for being handled described first image to obtain handling result
Give the second processing unit.
11. electronic equipment according to claim 10, which is characterized in that the camera module include with described first at
First projector, second projector and the first image acquisition device that reason unit is respectively connected with；
The first processing units are additionally operable to control first projector transmitting infrared light and second projector emitter junction
Structure light pattern；Described first image collector is for acquiring infrared image and target speckle image, and by the infrared image of acquisition
It is sent to the first processing units with target speckle image.
12. electronic equipment according to claim 11, which is characterized in that the first processing units are additionally operable to obtain reference
Speckle image, it is described to carry reference depth information with reference to speckle image, by the reference speckle image and the target speckle pattern
As being matched, obtain matching result, described first image obtained according to the matching result, described first image be band
State the anaglyph of target speckle image and the offset information with reference to speckle image corresponding points.
13. electronic equipment according to claim 11, which is characterized in that the first processing units are additionally operable to obtain reference
Speckle image, it is described to carry reference depth information with reference to speckle image, by the reference speckle image and the target speckle pattern
As being matched, matching result is obtained, and described first image is obtained according to the reference depth information and matching result, institute
It is the depth image with depth information to state the first image.
14. electronic equipment according to claim 12 or 13, which is characterized in that the secure processing units are additionally operable to basis
The infrared image carries out recognition of face；
When described first image is anaglyph, the secure processing units obtain corresponding depth according to described first image
Image carries out In vivo detection according to the infrared image and depth image；
When described first image is depth image, the secure processing units are carried out according to the infrared image and the first image
In vivo detection.
15. electronic equipment according to claim 10, which is characterized in that the second processing unit, which is additionally operable to receive, answers
With the data acquisition request of program, the security level of the application program is obtained, searches precision corresponding with the security level
Rank, and according to the precision of the precision grade percentage regulation image, the depth image after adjustment is sent to the application
Program.
16. electronic equipment according to claim 15, which is characterized in that the second processing unit is additionally operable to according to
Precision grade adjusts the resolution ratio of the depth image；
Or, the second processing unit is additionally operable to adjust the target of the camera module acquisition according to the precision grade
The number at speckle image midpoint.
17. electronic equipment according to claim 10, which is characterized in that the second processing unit, which is additionally operable to receive, answers
With the data acquisition request of program, the security level of the application program is obtained, corresponding number is determined according to the security level
The application program is sent to by corresponding data transmission channel according to transmission channel, and by described first image.
18. electronic equipment according to claim 10, which is characterized in that the first processing units are additionally operable to receive everywhere
The image capture instruction that second processing unit under the first running environment is sent according to the checking request of application program, according to institute
It states image capture instruction and controls the camera module acquisition infrared image and target speckle image, according to the target speckle pattern
As obtaining depth image, the depth image of the infrared image of the acquisition and acquisition is sent to the secure processing units；
The secure processing units are additionally operable to the infrared image of the acquisition being compared with stored infrared image, by institute
The depth image for stating acquisition is compared with stored depth image, is verified as a result, the verification result is sent to
The second processing unit being under the first running environment；
It is right that the verification result is sent to application program institute by the second processing unit by data security transmission channel
The server answered.
19. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
It is realized such as the step of method described in any item of the claim 1 to 8 when being executed by processor.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810326603.9A CN108573170B (en) | 2018-04-12 | 2018-04-12 | Information processing method and device, electronic equipment and computer readable storage medium |
| PCT/CN2019/080428 WO2019196683A1 (en) | 2018-04-12 | 2019-03-29 | Method and device for image processing, computer-readable storage medium, and electronic device |
| EP19784735.3A EP3654243A4 (en) | 2018-04-12 | 2019-03-29 | Method and device for image processing, computer-readable storage medium, and electronic device |
| US16/740,914 US11256903B2 (en) | 2018-04-12 | 2020-01-13 | Image processing method, image processing device, computer readable storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810326603.9A CN108573170B (en) | 2018-04-12 | 2018-04-12 | Information processing method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108573170A true CN108573170A (en) | 2018-09-25 |
| CN108573170B CN108573170B (en) | 2020-06-12 |
Family
ID=63574804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810326603.9A Active CN108573170B (en) | 2018-04-12 | 2018-04-12 | Information processing method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108573170B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108696682A (en) * | 2018-04-28 | 2018-10-23 | Oppo广东移动通信有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
| CN108711054A (en) * | 2018-04-28 | 2018-10-26 | Oppo广东移动通信有限公司 | Image processing method, device, computer readable storage medium and electronic equipment |
| WO2019196683A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Method and device for image processing, computer-readable storage medium, and electronic device |
| WO2019205889A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Image processing method, apparatus, computer-readable storage medium, and electronic device |
| WO2019206129A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Data processing method, apparatus, electronic device, and computer-readable storage medium |
| CN111699678A (en) * | 2019-01-16 | 2020-09-22 | 深圳市汇顶科技股份有限公司 | Anti-spoof facial ID sensing using two cameras |
| CN112215113A (en) * | 2020-09-30 | 2021-01-12 | 张成林 | Face recognition method and device |
| CN113014782A (en) * | 2021-03-19 | 2021-06-22 | 展讯通信（上海）有限公司 | Image data processing method and device, camera equipment, terminal and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105373924A (en) * | 2015-10-10 | 2016-03-02 | 北京思比科微电子技术股份有限公司 | System facing terminal equipment and providing safety payment function |
| CN106200891A (en) * | 2015-05-08 | 2016-12-07 | 阿里巴巴集团控股有限公司 | The display method of user interface, Apparatus and system |
| CN106682522A (en) * | 2016-11-29 | 2017-05-17 | 大唐微电子技术有限公司 | Fingerprint encryption device and implementation method thereof |
| CN107292283A (en) * | 2017-07-12 | 2017-10-24 | 深圳奥比中光科技有限公司 | Mix face identification method |
| CN107341481A (en) * | 2017-07-12 | 2017-11-10 | 深圳奥比中光科技有限公司 | It is identified using structure light image |
| WO2018051336A1 (en) * | 2016-09-18 | 2018-03-22 | Yeda Research And Development Co. Ltd. | Systems and methods for generating 3d images based on fluorescent illumination |
-
2018
- 2018-04-12 CN CN201810326603.9A patent/CN108573170B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106200891A (en) * | 2015-05-08 | 2016-12-07 | 阿里巴巴集团控股有限公司 | The display method of user interface, Apparatus and system |
| CN105373924A (en) * | 2015-10-10 | 2016-03-02 | 北京思比科微电子技术股份有限公司 | System facing terminal equipment and providing safety payment function |
| WO2018051336A1 (en) * | 2016-09-18 | 2018-03-22 | Yeda Research And Development Co. Ltd. | Systems and methods for generating 3d images based on fluorescent illumination |
| CN106682522A (en) * | 2016-11-29 | 2017-05-17 | 大唐微电子技术有限公司 | Fingerprint encryption device and implementation method thereof |
| CN107292283A (en) * | 2017-07-12 | 2017-10-24 | 深圳奥比中光科技有限公司 | Mix face identification method |
| CN107341481A (en) * | 2017-07-12 | 2017-11-10 | 深圳奥比中光科技有限公司 | It is identified using structure light image |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019196683A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Method and device for image processing, computer-readable storage medium, and electronic device |
| US11256903B2 (en) | 2018-04-12 | 2022-02-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, image processing device, computer readable storage medium and electronic device |
| US11050918B2 (en) | 2018-04-28 | 2021-06-29 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for performing image processing, and computer readable storage medium |
| WO2019205889A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Image processing method, apparatus, computer-readable storage medium, and electronic device |
| WO2019206129A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Data processing method, apparatus, electronic device, and computer-readable storage medium |
| EP3644261A4 (en) * | 2018-04-28 | 2020-07-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, apparatus, computer-readable storage medium, and electronic device |
| CN108696682A (en) * | 2018-04-28 | 2018-10-23 | Oppo广东移动通信有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
| CN108711054A (en) * | 2018-04-28 | 2018-10-26 | Oppo广东移动通信有限公司 | Image processing method, device, computer readable storage medium and electronic equipment |
| US11308636B2 (en) | 2018-04-28 | 2022-04-19 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method, apparatus, and computer-readable storage medium for obtaining a target image |
| CN111699678A (en) * | 2019-01-16 | 2020-09-22 | 深圳市汇顶科技股份有限公司 | Anti-spoof facial ID sensing using two cameras |
| US11367314B2 (en) | 2019-01-16 | 2022-06-21 | Shenzhen GOODIX Technology Co., Ltd. | Anti-spoofing face ID sensing based on retro-reflection |
| US11403884B2 (en) | 2019-01-16 | 2022-08-02 | Shenzhen GOODIX Technology Co., Ltd. | Anti-spoofing face ID sensing |
| CN112215113A (en) * | 2020-09-30 | 2021-01-12 | 张成林 | Face recognition method and device |
| CN113014782A (en) * | 2021-03-19 | 2021-06-22 | 展讯通信（上海）有限公司 | Image data processing method and device, camera equipment, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108573170B (en) | 2020-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108573170A (en) | Information processing method and device, electronic equipment, computer readable storage medium | |
| CN108668078B (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108764052A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108769509B (en) | Control method, apparatus, electronic equipment and the storage medium of camera | |
| CN108804895A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108805024A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108549867B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment | |
| US11256903B2 (en) | Image processing method, image processing device, computer readable storage medium and electronic device | |
| CN108419017B (en) | Control method, apparatus, electronic equipment and the computer readable storage medium of shooting | |
| CN108830141A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108564032A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN108711054A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108696682B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| WO2019206020A1 (en) | Image processing method, apparatus, computer-readable storage medium, and electronic device | |
| CN110971836B (en) | Method and device for controlling shooting, electronic equipment and computer-readable storage medium | |
| CN108921903A (en) | Camera calibration method, device, computer readable storage medium and electronic equipment | |
| CN109040746B (en) | Camera calibration method and apparatus, electronic equipment, computer readable storage medium | |
| CN108764053A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108985255A (en) | Data processing method, device, computer readable storage medium and electronic equipment | |
| CN109040745A (en) | Camera method for self-calibrating and device, electronic equipment, computer storage medium | |
| CN108924421A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108846310A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| US11170204B2 (en) | Data processing method, electronic device and computer-readable storage medium | |
| CN108833885A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108881712B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |