CN108564032A - Image processing method, device, electronic equipment and computer readable storage medium - Google Patents
Image processing method, device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN108564032A CN108564032A CN201810327216.7A CN201810327216A CN108564032A CN 108564032 A CN108564032 A CN 108564032A CN 201810327216 A CN201810327216 A CN 201810327216A CN 108564032 A CN108564032 A CN 108564032A
- Authority
- CN
- China
- Prior art keywords
- image
- face
- correction
- processing unit
- target image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/40—Spoof detection, e.g. liveness detection
- G06V40/45—Detection of the body part being alive
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
Abstract
A kind of image processing method of the embodiment of the present application offer, device, electronic equipment and computer readable storage medium.The above method includes：If first processing units receive the image capture instruction of second processing unit transmission, controls camera module according to described image acquisition instructions and acquire target image；The target image is corrected, target image after being corrected；Target image after the correction is sent to the second processing unit, depth information at least one of of the target image for Face datection and acquisition face after the correction.The above method improves treatment effeciency of the second processing unit to image.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of image processing method, device, electronic equipment and meter
Calculation machine readable storage medium storing program for executing.
Background technology
With the rapid development of intelligent electronic device and structured light technique, structured light technique answering on intelligent electronic device
With more and more common.The infrared image that electronic equipment can be obtained according to structure light carries out recognition of face, In vivo detection and acquisition
The depth information etc. of face, and then support face unlock in electronic equipment, face payment, face 3D U.S.s face, made according to face
The operations such as expression packet.
Invention content
A kind of image processing method of the embodiment of the present application offer, device, electronic equipment and computer readable storage medium, can
To improve the efficiency of data processing.
A kind of image processing method, including：
If first processing units receive the image capture instruction of second processing unit transmission, referred to according to described image acquisition
Control camera module is enabled to acquire target image；
The target image is corrected, target image after being corrected；
Target image after the correction is sent to the second processing unit, target image is used for face after the correction
Detection and at least one of the depth information for obtaining face.
A kind of image processing apparatus, including：
Acquisition module, if receiving the image capture instruction of second processing unit transmission for first processing units, according to
Described image acquisition instructions control camera module and acquire target image；
Correction module, for being corrected to the target image, target image after being corrected；
Sending module, for target image after the correction to be sent to the second processing unit, mesh after the correction
Depth information at least one of of the logo image for Face datection and acquisition face.
A kind of electronic equipment, including：First processing units, second processing unit and camera module, first processing
Unit is separately connected the second processing unit and camera module；
The first processing units are used to receive the image capture instruction sent in second processing unit, according to the figure
As acquisition instructions control camera module acquires target image；
The first processing units are additionally operable to be corrected the target image, target image after being corrected；
The first processing units are additionally operable to target image after the correction being sent to described in second processing unit；
The second processing unit is used to carry out Face datection according to target image after the correction and obtains the depth of face
Spend at least one of information.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
Following steps are realized when row：
If first processing units receive the image capture instruction of second processing unit transmission, referred to according to described image acquisition
Control camera module is enabled to acquire target image；
The target image is corrected, target image after being corrected；
Target image after the correction is sent to the second processing unit, target image is used for face after the correction
Detection and at least one of the depth information for obtaining face.
Method, apparatus, electronic equipment and computer readable storage medium in the embodiment of the present application, by second processing list
Connect first processing units between member and camera module, above-mentioned first processing units can to image that camera module obtains into
Row pretreatment, then image after pretreatment is sent to second processing unit, it improves second processing unit and the processing of image is imitated
Rate.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Fig. 1 is the application scenario diagram of image processing method in one embodiment；
Fig. 2 is the flow chart of image processing method in one embodiment；
Fig. 3 is the flow chart of image processing method in another embodiment；
Fig. 4 is the flow chart of image processing method in another embodiment；
Fig. 5 is the flow chart of image processing method in another embodiment；
Fig. 6 is the software architecture schematic diagram that image processing method is realized in one embodiment；
Fig. 7 is the structure diagram of image processing apparatus in one embodiment；
Fig. 8 is the structure diagram of image processing apparatus in another embodiment；
Fig. 9 is the structure diagram of image processing apparatus in another embodiment.
Specific implementation mode
It is with reference to the accompanying drawings and embodiments, right in order to make the object, technical solution and advantage of the application be more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and
It is not used in restriction the application.
Fig. 1 is the application scenario diagram of image processing method in one embodiment.As shown in Figure 1, electronic equipment 10 may include
Camera module 110, second processing unit 120, first processing units 130.Above-mentioned second processing unit 120 can be CPU
(Central Processing Unit, central processing unit) module.Above-mentioned first processing units 130 can be MCU
(Microcontroller Unit, micro-control unit) module 130 etc..Wherein, first processing units 130 are connected to second processing
Between unit 120 and camera module 110, above-mentioned first processing units 130 can control Laser video camera head in camera module 110
112, floodlight 114 and color-changing lamp 118, above-mentioned second processing unit 120 can control RGB (Red/ in camera module 110
Green/Blue, red green blue color pattern) camera 116.
Camera module 110 includes Laser video camera head 112, floodlight 114, RGB cameras 116 and color-changing lamp 118.On
It is infrared camera to state Laser video camera head 112, for obtaining infrared image.Above-mentioned floodlight 114 is the face that can emit infrared light
Light source；Above-mentioned color-changing lamp 118 is that the point light source of laser can occur and be with figuratum point light source.Wherein, when floodlight 114 is sent out
When penetrating area source, Laser video camera head 112 can obtain infrared image according to the light being reflected back.When color-changing lamp 118 emits point light source
When, Laser video camera head 112 can obtain speckle image according to the light being reflected back.Above-mentioned speckle image is that color-changing lamp 118 emits
The image that pattern deforms upon after being reflected with figuratum point light source.
Second processing unit 120 may include in TEE (Trusted execution environment, credible operation ring
Border) CPU core that runs under environment and under REE (Rich Execution Environment, natural running environment) environment
The CPU core of operation.Wherein, TEE environment and REE environment are ARM modules (Advanced RISC Machines, advanced essence
Simple instruction set processor) operational mode.Wherein, the security level of TEE environment is higher, has in second processing unit 120 and only
It can simultaneously be operated under TEE environment there are one CPU core.Under normal conditions, the higher operation of 10 medium security level of electronic equipment
Behavior needs to execute in the CPU core under TEE environment, and the lower operation behavior of security level can be in the CPU under REE environment
It is executed in core.
First processing units 130 include PWM (Pulse Width Modulation, pulse width modulation) module 132,
SPI/I2C (Serial Peripheral Interface/Inter-Integrated Circuit, Serial Peripheral Interface (SPI)/bis-
To two-wire system synchronous serial interface) interface 134, RAM (Random Access Memory, random access memory) module 136
With depth engine 138.Above-mentioned PWM module 132 can emit pulse to camera module, control floodlight 114 or color-changing lamp 118 is opened
It opens so that Laser video camera head 112 can collect infrared image or speckle image.Above-mentioned SPI/I2C interfaces 134 are for receiving second
The image capture instruction that processing unit 120 is sent.Above-mentioned depth engine 138 can handle speckle image to obtain depth parallax
Figure.
When second processing unit 120 receives the data acquisition request of application program, for example, when application program need into
When the unlock of pedestrian's face, face payment, image can be sent to first processing units 130 by operating in the CPU core under TEE environment
Acquisition instructions.After first processing units 130 receive image capture instruction, impulse wave control can be emitted by PWM module 132
Floodlight 114 is opened and acquires infrared image, control camera module 110 by Laser video camera head 112 in camera module 110
Middle color-changing lamp 118 is opened and acquires speckle image by Laser video camera head 112.Camera module 110 can will be collected infrared
Image and speckle image are sent to first processing units 130.First processing units 130 can be at the infrared image that receives
Reason obtains infrared disparity map；The speckle image received is handled to obtain speckle disparity map or depth parallax figure.Wherein,
It refers to carrying out school to infrared image or speckle image that one processing unit 130 carries out processing to above-mentioned infrared image and speckle image
Just, influence of the inside and outside parameter to image in camera module 110 is removed.Wherein, first processing units 130 can be set to different
The image of pattern, different mode output is different.When first processing units 130 are set as speckle chart-pattern, first processing units
130 pairs of speckle image processings obtain speckle disparity map, and target speckle image can be obtained according to above-mentioned speckle disparity map；At first
When reason unit 130 is set as depth chart-pattern, first processing units 130 obtain depth parallax figure to speckle image processing, according to
Depth image can be obtained in above-mentioned depth parallax figure, and above-mentioned depth image refers to the image with depth information.First processing units
130 can be sent to above-mentioned infrared disparity map and speckle disparity map second processing unit 120, and first processing units 130 can also incite somebody to action
Above-mentioned infrared disparity map and depth parallax figure are sent to second processing unit 120.Second processing unit 120 can be according to above-mentioned infrared
Disparity map obtains Infrared Targets image, obtains depth image according to above-mentioned depth parallax figure.Further, second processing unit
120 can detect according to Infrared Targets image, depth image to carry out recognition of face, face matching, In vivo detection and acquisition
Face depth information.
Communicated between first processing units 130 and second processing unit 120 is by fixed safe interface, to ensure
The safety of transmission data.As shown in Figure 1, the data that second processing unit 120 is sent to first processing units 130 are to pass through
SECURE SPI/I2C 140, the data that first processing units 130 are sent to second processing unit 120 are to pass through SECURE
MIPI (Mobile Industry Processor Interface, mobile industry processor interface) 150.
In one embodiment, first processing units 130 can also be obtained according to above-mentioned infrared disparity map Infrared Targets image,
Above-mentioned depth parallax figure, which calculates, obtains depth image, then above-mentioned Infrared Targets image, depth image are sent to second processing list
Member 120.
In one embodiment, first processing units 130 can carry out face according to above-mentioned Infrared Targets image, depth image
Identification, face matching, In vivo detection and the depth information for obtaining the face detected.Wherein, first processing units 130 will be schemed
Refer to that first processing units 130 send an image in second processing unit 120 and are in as being sent to second processing unit 120
CPU core under TEE environment.
Electronic equipment can be mobile phone, tablet computer, personal digital assistant or wearable device etc. in the embodiment of the present application.
Fig. 2 is the flow chart of image processing method in one embodiment.As shown in Fig. 2, a kind of image processing method, packet
It includes：
Step 202, if first processing units receive the image capture instruction sent in second processing unit, according to figure
As acquisition instructions control camera module acquires target image.
Above-mentioned first processing units refer to the processor for handling data, such as MCU module 130 in Fig. 1.Above-mentioned second
Processing unit refers to the processor for handling data, such as CPU module 120 in Fig. 1.Above-mentioned first processing units are connected to
Between two processing units and camera module, camera module can be controlled according to the instruction of first processing units.Second processing list
Member may operate under the first running environment, be sent out when first processing units receive the second processing unit under the first running environment
When the image capture instruction sent, target image can be acquired according to the image capture instruction control camera module received.First
Running environment refers to the higher running environment of security level, such as TEE running environment.Optionally, further include in electronic equipment
Two running environment, above-mentioned second running environment refer to the lower running environment of security level, such as REE running environment.Above-mentioned mesh
Logo image includes infrared image and speckle image.
When application program needs to obtain face depth information in electronic equipment, can be obtained to second processing unit transmission data
Request, above-mentioned data acquisition request is taken to may include face depth information acquisition instruction, RGB image acquisition instructions etc..At second
When reason unit receives above-mentioned data acquisition request, if detecting, above-mentioned data acquisition request includes that face depth information obtains
Current second processing unit, then be switched under the first running environment, pass through second processing unit under the first running environment by instruction
Image capture instruction is sent to first processing units.Above-mentioned image capture instruction may include acquiring infrared image, speckle image.It can
Selection of land, above-mentioned image capture instruction may also include acquisition RGB image.
When first processing units receive above-mentioned image capture instruction, first processing units can control in camera module
Floodlight is opened and acquires color-changing lamp unlatching in infrared image, control camera module by Laser video camera head and taken the photograph by laser
As head acquires speckle image.Wherein, first processing units by emitting pulse, to control, open or color-changing lamp is opened by floodlight.On
It is infrared light to state floodlight transmitting, and above-mentioned color-changing lamp transmitting is laser.Above-mentioned color-changing lamp transmitting laser can be by structure optical mode
Collimating mirror and DOE (Diffractive Optical Elements, diffraction optical element) diffraction element carry out diffraction, radium in group
Shot-light again launches the image that diffraction is formed, and Laser video camera head generates speckle image according to the light being reflected back.
Step 204, target image is corrected, target image after being corrected.
Laser video camera head can send above-mentioned infrared image and speckle image after getting infrared image and speckle image
To first processing units, first processing units can be corrected above-mentioned infrared image and speckle image respectively, after obtaining correction
Speckle image after infrared image and correction..Wherein, first processing units carry out school respectively to above-mentioned infrared image and speckle image
Just referring to inside and outside parameter in the above-mentioned infrared image of correction and speckle image, such as Laser video camera head deflection angle, Laser video camera head
Deng.The infrared image after it can be corrected after being corrected to above-mentioned infrared image, infrared image is infrared parallax after above-mentioned correction
Figure；Speckle image can be speckle disparity map or depth parallax figure after above-mentioned correction.Above-mentioned disparity map is to indicate to regard with standard picture
The image of difference can obtain standard picture according to parallax value in above-mentioned disparity map, and above-mentioned standard image corrected inside and outside parameter
Image afterwards.For example, Infrared Targets image can be obtained according to above-mentioned infrared disparity map, can be used for obtaining according to above-mentioned speckle disparity map
Target speckle image can be used for obtaining depth image according to above-mentioned depth parallax figure.Above-mentioned Infrared Targets image refers in correction
Infrared image after outer parameter, above-mentioned target speckle image are speckle images after correction inside and outside parameter, and above-mentioned depth image is correction
The image of depth information is carried after inside and outside parameter.
Wherein, first processing units can be at different operational modes, to the place of speckle image under different operational modes
Reason mode is different.When first processing units are set as depth chart-pattern, first processing units obtain depth to speckle image processing
Spend disparity map；When first processing units are set as speckle chart-pattern, first processing units obtain speckle to speckle image processing
Target speckle image can be obtained according to above-mentioned speckle disparity map in disparity map.
Step 206, target image after correction is sent to second processing unit, target image is used for Face datection after correction
With at least one of the depth information for obtaining face.
Speckle image after infrared image after above-mentioned correction and correction can be sent in the first operation by first processing units
Second processing unit under environment.For example, infrared disparity map and depth parallax figure are sent in TEE environment by first processing units
Lower second processing unit；Or infrared disparity map and speckle disparity map are sent to and are run under TEE environment by first processing units
Second processing unit.Wherein, communication port is escape way when being communicated between first processing units and second processing unit.
For example, it is by SECURE SPI/I2C, at first that image capture instruction is sent to first processing units by second processing unit
It is by SECURE MIPI that reason unit, which sends an image to second processing unit,.Above-mentioned first processing units only in first
Second processing unit under running environment carries out data interaction, it can be ensured that the safety of data interaction.
Infrared image and speckle image after correction are sent in the first operation after first processing units are by above-mentioned correction
After second processing unit under environment, second processing unit can obtain Infrared Targets image according to infrared image after above-mentioned correction,
Target speckle image or depth image are obtained according to speckle image after above-mentioned correction.Second processing unit can be according to above-mentioned infrared figure
Picture and depth image carry out Face datection, and above-mentioned Face datection may include recognition of face, face matching and In vivo detection.Above-mentioned people
Face identification refers to that whether there is face in identification image, and above-mentioned face matching refers to carrying out face in image and the face to prestore
Matching, above-mentioned In vivo detection refer to that whether face has bioactivity in detection image.When detecting in image there are face and
When face has bioactivity, second processing unit can also obtain the face detected according to above-mentioned infrared image and depth image
Depth information.
Second processing unit can believe the depth of above-mentioned face after the depth information for getting the above-mentioned face detected
Breath is sent to application program.Above application program can carry out face unlock, face branch according to the depth information of the face received
It pays, face 3D U.S.s face, three-dimensional modeling etc..
Under normal conditions, when second processing unit is run in the first running environment in electronic equipment, processing speed is past
Toward limited, data processing it is less efficient.By taking electronic equipment CPU core as an example, while the CPU core under TEE environment has
And only there are one, i.e., be only at data there are one CPU core under TEE environment, therefore handle the less efficient of data.
Method in the embodiment of the present application, it is single by connecting the first processing between second processing unit and camera module
Member, the image that above-mentioned first processing units can obtain camera module pre-processes, then image after pretreatment is sent to
Second processing unit improves the treatment effeciency of second processing unit.
In one embodiment, target image includes infrared image and speckle image after correction after correction after correction；According to
The method of target image progress Face datection includes after correction：
Recognition of face is carried out according to infrared image after correction, detects whether that there are the first faces.If there are the first face, root
Depth image is obtained according to speckle image after correction.In vivo detection is carried out according to infrared image after correction and depth image.
Second processing unit, can be according to above-mentioned school after receiving above-mentioned correction after infrared image and correction after speckle image
Infrared image obtains Infrared Targets image after just, then carries out recognition of face to Infrared Targets image, detects above-mentioned Infrared Targets figure
It whether there is the first face as in.Above-mentioned first face is the face existing for Infrared Targets image.When above-mentioned Infrared Targets figure
There are when the first face as in, second processing unit can obtain depth image by speckle image after correction, i.e., regarded by depth
Difference figure obtains depth image, and In vivo detection is carried out according to above-mentioned depth image.Wherein, live body inspection is carried out according to above-mentioned depth image
Survey includes：Human face region corresponding with the first human face region is searched in depth image, detects above-mentioned and the first human face region pair
Whether the human face region answered has depth information, and whether above-mentioned depth information meets the three-dimensional rule of face.If above-mentioned depth image
In human face region corresponding with the first human face region have a depth information, and above-mentioned depth information meets the three-dimensional rule of face, then the
One face has bioactivity.Above-mentioned face solid rule is the rule with face three-dimensional depth information.Optionally, at second
Reason unit also can be used artificial intelligence model and carry out artificial intelligence identification to above-mentioned Infrared Targets image and depth image, obtain the
The texture on one face surface, detect the direction of above-mentioned texture, the density of texture, texture width etc. whether meet face rule,
If meeting face rule, judge that the first face has bioactivity.
In one embodiment, before speckle image obtains depth image after according to correction, the above method further includes：
First face is matched with the second face, determines the first face and the second face successful match；Second face
It is stored face.
In detecting Infrared Targets image there are the first face after, second processing unit can also be by the first face and second
Face is matched.Above-mentioned second face is stored face.For example, the face of electronic equipment owner.Wherein, above-mentioned second
Face can be the face of electronic equipment side storage or the face of server side storage.Second processing unit can by it is above-mentioned with
First face of the second face successful match is as target face.After by above-mentioned first face and the second face successful match,
Whether second processing unit obtains depth image again, had according to above-mentioned Infrared Targets image and depth image detection target face
Bioactivity.When detecting that above-mentioned target face has bioactivity, then the depth information of above-mentioned target face is obtained, and will
The depth information of above-mentioned target face is sent to application program.
Optionally, after getting the first face, second processing unit can carry out In vivo detection to the first face, in detection
State whether the first face has bioactivity.When detecting that the first face has bioactivity, then will be biologically active
First face is matched with the second face, obtains the target face of successful match.Above-mentioned target is obtained further according to depth image
The depth information of face, and the depth information of above-mentioned target face is sent to application program.
When the data acquisition request that second processing unit receives, it can be identified according to above-mentioned data acquisition request and apply journey
Sequence is the depth information of the depth information or target face that only need face.For example, when needing the depth information of face to be used for 3D
When U.S. face, second processing unit only needs the depth information for recognizing face being sent to application program, without identify whether for
Target face.When needing the depth information of face for face unlock, second processing unit also needs to examine after identifying face
Survey whether the above-mentioned face identified is target face, when the above-mentioned face identified is target face, then by target face
Depth information be sent to application program.
Method in the embodiment of the present application, second processing unit pass through recognition of face, face matching and In vivo detection
It can determine target face, be conducive to the depth information of quick obtaining target face.
In one embodiment, controlling camera module acquisition target image according to image capture instruction includes：
Camera module, which is controlled, according to image capture instruction acquires infrared image.Camera is controlled according to image capture instruction
Module acquires speckle image.Wherein, acquire infrared image the first moment and acquire speckle image the second moment between when
Between interval be less than first threshold.
First processing units can control infrared lamp in camera module to open and acquire infrared image by Laser video camera head,
Color-changing lamp is opened and acquires speckle image by Laser video camera head in the also controllable camera module of first processing units.To ensure
Above-mentioned infrared image is consistent with the image content of speckle image, camera module acquire the first moment of above-mentioned infrared image with
The time interval acquired between the second moment of speckle image should be less than first threshold.For example, the first moment and the second moment it
Between time interval be less than 5 milliseconds.
Wherein, the method for first processing units control camera module acquisition infrared image and speckle image includes：
(1) floodlight lamp controller is set in camera module and radium-shine lamp controller, first processing units passes through two-way
PWM is separately connected floodlight lamp controller and radium-shine lamp controller, when first processing units need to control floodlight unlatching, can lead to
PWM all the way is crossed to open to floodlight lamp controller transmitting impulse wave control floodlight；When first processing units need to control color-changing lamp
When unlatching, impulse wave can be emitted to radium-shine lamp controller by another way PWM and control color-changing lamp unlatching.First processing units can lead to
It crosses control two-way PWM and made for the first moment to the time interval of floodlight lamp controller and radium-shine lamp controller transmitting impulse wave respectively
Time interval between the second moment is less than first threshold.
(2) controller is set in camera module for controlling floodlight and color-changing lamp, first processing units are logical
PWM connections above controller all the way is crossed, it, can be by above-mentioned PWM to general when first processing units are needed to control floodlight and be opened
Light lamp controller emits impulse wave control floodlight and opens；When first processing units need to control color-changing lamp unlatching, can control
Above-mentioned PWM switchings are simultaneously opened to radium-shine lamp controller transmitting impulse wave control color-changing lamp.First processing units are above-mentioned by controlling
The time interval of PWM switchings makes the time interval between the first moment and the second moment be less than first threshold.
Method in the embodiment of the present application, the time interval between collected infrared image and speckle image are less than the first threshold
Value, it is ensured that collected infrared image is consistent with speckle image, avoids between infrared image and speckle image that there are larger
Error, improve the accuracy to data processing.
In one embodiment, target image includes infrared image and speckle image；It is taken the photograph according to image capture instruction control
As head mould group acquisition target image includes：
Obtain timestamp in image capture instruction.Determine the time between the first moment and timestamp of acquisition infrared image
Interval is less than second threshold.Determine that the time interval between the second moment and timestamp of acquisition speckle image is less than third threshold
Value.
Further include timestamp in the image capture instruction that second processing unit receives.Above-mentioned timestamp can be application program
At the time of transmission data obtains request.Second processing unit can refer to Image Acquisition after receiving above-mentioned image capture instruction
Order is sent to first processing units, and first processing units control camera module according to above-mentioned image capture instruction and acquire infrared figure
Picture and speckle image.Wherein, it when first processing units control above-mentioned camera module acquisition infrared image and speckle image, needs
Determine the time interval between the first moment and timestamp of acquisition infrared image be less than second threshold, acquisition speckle image the
Time interval between two moment and timestamp is less than third threshold value.Above-mentioned second threshold can be identical value or different value, for example,
3 seconds, 5 seconds etc..
When the time interval between the first moment and timestamp that second processing unit acquires infrared image is less than the second threshold
When time interval between value, or the second moment and timestamp of acquisition speckle image is less than third threshold value, second processing unit
Illegal command can be returned to first processing units, above-mentioned illegal command can be returned to transmission data acquisition and asked by first processing units
The application program asked so that application program retransmits data acquisition request.
Method in the embodiment of the present application, the first moment and time in image capture instruction that infrared image is acquired by control
Between time in second moment of time interval, control acquisition speckle image between stamp and image capture instruction between timestamp
Every, it can be ensured that the infrared image of acquisition and the timeliness of speckle image.
In one embodiment, a kind of image processing method includes：
Step 302, if first processing units receive the image capture instruction sent in second processing unit, according to figure
As acquisition instructions control camera module acquires target image.
Step 304, target image is corrected, target image after being corrected.
Step 306, target image after correction is sent to second processing unit, target image is used for Face datection after correction
With at least one of the depth information for obtaining face.
Step 308, if image capture instruction includes acquisition visible images, camera is controlled according to image capture instruction
Module acquires infrared image and visible images simultaneously.
When in image capture instruction further including acquisition visible images, second processing unit can control in camera module
RGB cameras acquire visible images.Wherein, first processing units control Laser video camera head acquisition infrared image and speckle pattern
Picture, second processing unit control RGB cameras and acquire visible images.It, can be in above-mentioned laser to ensure to acquire the consistent of image
Timing synchronization line is added between camera and RGB cameras so that camera module can acquire above-mentioned infrared image and can simultaneously
Light-exposed image.
Method in the embodiment of the present application acquires infrared image and visible images simultaneously by controlling camera module, makes
The infrared image that must be acquired is consistent with visible images, improves the accuracy of image procossing.
In one embodiment, a kind of image processing method includes：
Step 402, if first processing units receive the image capture instruction sent in second processing unit, according to figure
As acquisition instructions control camera module acquires target image.
Step 404, target image is corrected, target image after being corrected.
Step 406, target image after correction is sent to second processing unit, target image is used for Face datection after correction
With at least one of the depth information for obtaining face.
Step 408, if receiving the data acquisition request of application program, the security level of application program is obtained.
Step 410, precision grade corresponding with security level is searched.
Step 412, according to the precision of precision grade percentage regulation image, the depth image after adjustment is sent to using journey
Sequence.
If second processing unit receives the data acquisition request of application program, the safety level of above application program can detect
Not.Wherein, electronic equipment can be to the corresponding security level of application setting, the corresponding number of application program of different security levels
According to precision grade difference.For example, the security level of payment software is higher in electronic equipment, it is soft that second processing unit is sent to payment
The data precision of part is higher, and the security level of image software is relatively low, and second processing unit is sent to the data essence of image software
It spends relatively low.
It is corresponding can to search above-mentioned security level after getting the corresponding security level of application program for second processing unit
Precision grade.Wherein, security level and above-mentioned precision grade are positive correlation, i.e. the security level of application program is higher, above-mentioned peace
The corresponding precision grade of full rank is higher.Above-mentioned precision grade is higher, and to write image more clear.Second unit is being got using journey
After the corresponding precision grade of security level of sequence, can according to the precision of above-mentioned precision grade percentage regulation image, then will adjustment after
Depth image is sent to application program so that depth image can be carried out according to above-mentioned depth image face unlock, face payment or
Face 3D U.S.s face etc..
In one embodiment, include according to the precision of precision grade adjustment target image：
(1) according to the resolution ratio of precision grade percentage regulation image.
(2) number of speckle point in the speckle image of camera module acquisition is adjusted according to precision grade.
When the precision of second processing unit percentage regulation image, the resolution ratio of above-mentioned depth image can adjust.Work as depth map
When the precision grade of picture is high, the high resolution of above-mentioned depth image；When the precision grade of depth image is low, above-mentioned depth image
Resolution ratio it is low.The resolution ratio of above-mentioned adjustment image can be realized by adjusting number of pixels in image.
In camera module color-changing lamp can preset different DOE diffraction elements, wherein difference DOE diffraction element diffraction shapes
At speckle point number it is different.When the corresponding precision grade of application program is higher, color-changing lamp can control speckle point number compared with
More DOE diffraction elements emit laser, to obtaining the more speckle image of speckle point number；When the corresponding essence of application program
Spend rank it is relatively low when, DOE diffraction elements that color-changing lamp can control speckle point number less emit laser, to obtain speckle point
The less speckle image of number.
Method in the embodiment of the present application, according to the security level of application program come the precision of percentage regulation image so that no
The depth image that different accuracy can be obtained with the application program of security level reduces the lower application program leakage of security level
The risk of data improves the safety of data
In one embodiment, a kind of image processing method includes：
Step 502, if first processing units receive the image capture instruction sent in second processing unit, according to figure
As acquisition instructions control camera module acquires target image.
Step 504, target image is corrected, target image after being corrected.
Step 506, target image after correction is sent to second processing unit, target image is used for Face datection after correction
With at least one of the depth information for obtaining face.
Step 508, if receiving the data acquisition request of application program, the security level of application program is obtained.
Step 510, the corresponding data channel of the security level of application program is determined.
Step 512, depth image is sent to application program by corresponding data transmission channel.
Second processing unit can recognize that the safety of above application program after receiving the data acquisition request of application program
Rank.When depth image can be transferred to application program by second processing unit by escape way or Common passageway.Above-mentioned safety
Channel is different with the security level of Common passageway.Optionally, the security level of above-mentioned escape way is higher, the safety of Common passageway
Rank is relatively low.When data are transmitted in escape way, data can be encrypted, avoid leaking data or be stolen.Electronics
Corresponding data channel can be arranged according to the security level of application program in equipment.Optionally, the high application program of security level can
Corresponding escape way, the low application program of security level can correspond to Common passageway.Lead to for example, payment class application program corresponds to safety
Road, image class application program correspond to Common passageway.Second processing unit is in the corresponding data of security level for obtaining application program
Behind channel, depth image can be sent to application program by corresponding data channel so that application program is according to above-mentioned depth
Image carries out next step operation.
Method in the embodiment of the present application chooses corresponding data channel to transmit number according to the security level of application program
According to ensure that safety when application transfer data higher to security level.The application program low to security level, directly
Transmission data is connect it is not necessary that operation is encrypted to data, improves the speed to the lower application transfer data of security level
Degree.
In one embodiment, a kind of image processing method, including：
(1) if first processing units receive the image capture instruction of second processing unit transmission, referred to according to Image Acquisition
Control camera module is enabled to acquire target image.
(2) target image is corrected, target image after being corrected.
(3) target image after correction is sent to second processing unit, target image for Face datection and obtains after correction
Take at least one of the depth information of face.
Optionally, target image includes infrared image and speckle image after correction after correction after correction；According to mesh after correction
Logo image carry out Face datection method include：Recognition of face is carried out according to infrared image after correction, detects whether that there are first
Face；If there are the first face, depth image is obtained according to speckle image after correction；According to infrared image after correction and depth map
As carrying out In vivo detection.
Optionally, before speckle image obtains depth image after according to correction, method further includes：By the first face and
Two faces are matched；Determine the first face and the second face successful match；Second face is stored face.
Optionally, controlling camera module acquisition target image according to image capture instruction includes：Referred to according to Image Acquisition
Control camera module is enabled to acquire infrared image；Camera module, which is controlled, according to image capture instruction acquires speckle image；Wherein,
The time interval acquired between the first moment of infrared image and the second moment for acquiring speckle image is less than first threshold.
Optionally, controlling camera module acquisition target image according to image capture instruction includes：Image Acquisition is obtained to refer to
Timestamp in order；Determine that the time interval between the first moment and timestamp of acquisition infrared image is less than second threshold；It determines
The time interval acquired between the second moment and timestamp of speckle image is less than third threshold value.
Optionally, target image includes infrared image；The above method further includes：It can if image capture instruction includes acquisition
Light-exposed image controls camera module according to image capture instruction and acquires infrared image and visible images simultaneously.
Optionally, the above method further includes：If receiving the data acquisition request of application program, the peace of application program is obtained
Full rank；Search precision grade corresponding with security level；According to the precision of precision grade percentage regulation image, after adjustment
Depth image is sent to application program.
Optionally, include according to the precision of precision grade adjustment target image：According to precision grade percentage regulation image
Resolution ratio；Or the number of speckle point in the speckle image of camera module acquisition is adjusted according to precision grade.
Optionally, the above method further includes：If receiving the data acquisition request of application program, the peace of application program is obtained
Full rank；Determine the corresponding data channel of the security level of application program；Depth image is passed through into corresponding data transmission channel
It is sent to application program.
Method in the embodiment of the present application, it is single by connecting the first processing between second processing unit and camera module
Member, the image that above-mentioned first processing units can obtain camera module pre-processes, then image after pretreatment is sent to
Second processing unit improves the treatment effeciency of second processing unit, and above-mentioned first processing units are only run in first
Second processing unit under environment carries out data interaction, it can be ensured that the safety of data interaction.
Fig. 6 is the software architecture schematic diagram that image processing method is realized in one embodiment.As shown in fig. 6, the software frame
Structure includes application layer 610, operating system 620 and the first running environment 630, and above-mentioned first running environment 630 is credible operation ring
Border.Wherein, hardware layer includes floodlight ＆ color-changing lamps 631, camera 632, micro-control unit 633.Security service module
634 and encrypting module 635 may operate under the first running environment.Above-mentioned security service module 634 can be in the first running environment
The second processing unit of lower operation, the CPU core such as run under TEE environment.It include safety management module in operating system 630
621, face management module 622, webcam driver 623 and camera frame 624；It include application program 611 in application layer 610.
Application program 611 can initiate image capture instruction, and electronic equipment can drive floodlight ＆ color-changing lamps by image capture instruction
631 and camera 632 work.For example, paid, unlocked by acquiring face, the operations such as U.S. face when, application program
It can initiate the image capture instruction of acquisition facial image.It, can be according to figure after camera gets infrared image and speckle image
As acquisition instructions judge that the image currently obtained is for security application operation or non-security application operating.When the depth of acquisition
It, can be by escape way by the infrared image and speckle image of acquisition when image is for the security applications operation such as paying, unlocking
It is sent to micro-control unit 633, micro-control unit 633 carries out that depth parallax figure is calculated further according to speckle image, further according to
Depth image is calculated in depth parallax figure.And the depth image being calculated and infrared image are sent to security service module
634.It is understood that the process that depth image is calculated according to speckle image can also be in security service module 634
It carries out.Infrared image and depth image can be sent to encrypting module 635 by security service module 634, and encrypting module 635 can root
Depth image and infrared image are encrypted according to pre-stored speckle image, it can also be according to the speckle obtained in real time
Depth image and infrared image are encrypted image, then again by the depth image and infrared image hair after encryption
Give safety management module 621.Usually, different application programs 611 has corresponding safety management module 621, bursting tube
The depth that encrypted depth image and infrared image can be decrypted, and will be obtained after decryption processing by reason module 621
Image and infrared image are sent to corresponding face management module 622.Face management module 622 can be according to infrared image and depth
Image carries out the processing such as Face datection, identification, verification, then handling result is sent to the application program 611 on upper layer, application program
611 carry out security application operation further according to handling result.When the depth image of acquisition is for U.S. face, AR (Augmented
Reality, augmented reality) etc. it is non-security in application, camera 632 acquire infrared image and speckle image can be direct
It is sent to webcam driver 623 by non-security channel, webcam driver 623 can calculate disparity map according to speckle image, and
Depth image is calculated according to disparity map.Infrared image and depth image can be sent to camera by webcam driver 623
Frame 624, then face management module 622 or application program 611 are sent to by camera frame 624.Wherein, escape way and non-
The switching of escape way is completed by micro-control unit 633.
Fig. 7 is the structure diagram of image processing apparatus in one embodiment.As shown in fig. 7, a kind of image processing apparatus, packet
It includes：
Acquisition module 702, if receiving the image capture instruction of second processing unit transmission, root for first processing units
Target image is acquired according to image capture instruction control camera module；.
Correction module 704, for being corrected to target image, target image after being corrected；
Sending module 706 is sent to second processing unit for target image after correcting, and target image is used for after correction
Face datection and at least one of the depth information for obtaining face.
Fig. 8 is the structure diagram of image processing apparatus in another embodiment.As shown in figure 8, a kind of image processing apparatus,
Including：Acquisition module 802, correction module 804, sending module 806 and detection module 808.Wherein, acquisition module 802, straightening die
Block 804, sending module 806 are identical as corresponding functions of modules in Fig. 7.
Target image includes infrared image and speckle image after correction after correction after correction；Detection module 808 is according to correction
The method of target image progress Face datection includes afterwards：Recognition of face is carried out according to infrared image after correction, detects whether exist
First face；If there are the first face, depth image is obtained according to speckle image after correction；According to infrared image after correction and depth
It spends image and carries out In vivo detection.
In one embodiment, detection module 808 is additionally operable to after according to correction before speckle image acquisition depth image,
First face is matched with the second face；Determine the first face and the second face successful match；Second face is to have stored
Face.
In one embodiment, acquisition module 802 controls camera module according to image capture instruction and acquires target image
Including：Camera module, which is controlled, according to image capture instruction acquires infrared image；Camera shooting head mould is controlled according to image capture instruction
Group acquisition speckle image；Wherein, the time between the first moment of infrared image and the second moment for acquiring speckle image is acquired
Interval is less than first threshold.
In one embodiment, target image includes infrared image and speckle image；Acquisition module 802 is according to Image Acquisition
Instruction control camera module acquires target image and includes：Obtain timestamp in image capture instruction；Determine acquisition infrared image
The first moment and timestamp between time interval be less than second threshold；Determine the second moment and time of acquisition speckle image
Time interval between stamp is less than third threshold value.
In one embodiment, target image includes infrared image；If acquisition module 802 is additionally operable in image capture instruction
Including acquiring visible images, camera module is controlled according to image capture instruction and acquires infrared image and visible light figure simultaneously
Picture.
Fig. 9 is the structure diagram of image processing apparatus in another embodiment.As shown in figure 9, a kind of image processing apparatus,
Including：Acquisition module 902, correction module 904, sending module 906, acquisition module 908, searching module 910.Wherein, mould is acquired
Block 902, correction module 904, sending module 906 are identical as corresponding functions of modules in Fig. 7.
Acquisition module 908 obtains the safety level of application program if the data acquisition request for receiving application program
Not.
Searching module 910, for searching precision grade corresponding with security level.
Sending module 906 is additionally operable to the precision according to precision grade percentage regulation image, and the depth image after adjustment is sent out
Give application program.
In one embodiment, sending module 906 includes according to the precision of precision grade adjustment target image：According to precision
The resolution ratio of rank adjusting depth image；Or speckle point in the speckle image of camera module acquisition is adjusted according to precision grade
Number.
In one embodiment, if acquisition module 908 is additionally operable to receive the data acquisition request of application program, acquisition is answered
With the security level of program.
Searching module 910 is additionally operable to determine the corresponding data channel of security level of application program.
Sending module 906 is additionally operable to depth image being sent to application program by corresponding data transmission channel.
The division of modules is only used for for example, in other embodiments, can will scheme in above-mentioned image processing apparatus
As processing unit is divided into different modules as required, to complete all or part of function of above-mentioned image processing apparatus.
Specific about image processing apparatus limits the restriction that may refer to above for image processing method, herein not
It repeats again.Modules in above-mentioned image processing apparatus can be realized fully or partially through software, hardware and combinations thereof.On
Stating each module can be embedded in or independently of in the processor in electronic equipment, can also be stored in a software form in the form of hardware
In memory in electronic equipment, the corresponding operation of the above modules is executed in order to which processor calls.
Realizing for modules in the image processing apparatus provided in the embodiment of the present application can be the shape of computer program
Formula.The computer program can be run in terminal or server.The program module that the computer program is constituted is storable in terminal
Or on the memory of server.When the computer program is executed by processor, method described in the embodiment of the present application is realized
Step.
The embodiment of the present application also provides a kind of electronic equipment, and above-mentioned electronic equipment includes：First processing units 120, second
Processing unit 130 and camera module 110.
First processing units 120 are separately connected second processing unit 130 and camera module 110.
First processing units 120 are used to receive the image capture instruction of the transmission of second processing unit 130, according to Image Acquisition
Instruction control camera module 110 acquires target image.
First processing units 120 are additionally operable to be corrected target image, target image after being corrected.
First processing units 120 are additionally operable to target image after correcting and are sent to second processing unit 130.
Second processing unit 130 is used to carry out Face datection according to target image after correction and obtains the depth information of face
At least one of.
In one embodiment, target image includes infrared image and speckle image after correction after correction after correction；Second
Processing unit 130 according to after correction target image carry out Face datection method include：Face is carried out according to infrared image after correction
Identification, detects whether that there are the first faces；If there are the first face, depth image is obtained according to speckle image after correction；According to
Infrared image and depth image carry out In vivo detection after correction.
In one embodiment, second processing unit 130 is additionally operable to the speckle image after according to correction and obtains depth image
Before, the first face is matched with the second face；Determine the first face and the second face successful match；Second face is
The face of storage.
In one embodiment, first processing units 120 control camera module 110 according to image capture instruction and acquire mesh
Logo image includes：First processing units 120 control camera module 110 according to image capture instruction and acquire infrared image；First
Processing unit 120 controls camera module 110 according to image capture instruction and acquires speckle image；Wherein, infrared image is acquired
Time interval between first moment and the second moment for acquiring speckle image is less than first threshold.
In one embodiment, target image includes infrared image and speckle image；First processing units 120 are according to image
Acquisition instructions control camera module 110 acquires target image and includes：Obtain timestamp in image capture instruction；Determine that acquisition is red
Time interval between first moment of outer image and timestamp is less than second threshold；Determine the second moment of acquisition speckle image
Time interval between timestamp is less than third threshold value.
In one embodiment, target image includes infrared image；Refer to if first processing units 120 are additionally operable to Image Acquisition
Order includes acquisition visible images, and control camera module 110 according to image capture instruction acquires infrared image and can simultaneously
Light-exposed image.
In one embodiment, it if second processing unit 130 is additionally operable to receive the data acquisition request of application program, obtains
Take the security level of application program；Search precision grade corresponding with security level；According to precision grade percentage regulation image
Depth image after adjustment is sent to application program by precision.
In one embodiment, second processing unit 130 includes according to the precision of precision grade adjustment target image：According to
The resolution ratio of precision grade percentage regulation image；Or it is adjusted according to precision grade in the speckle image that camera module 110 acquires
The number of speckle point.
In one embodiment, it if second processing unit 130 is additionally operable to receive the data acquisition request of application program, obtains
Take the security level of application program；Determine the corresponding data channel of the security level of application program；Depth image is passed through into correspondence
Data transmission channel be sent to application program.
The embodiment of the present application also provides a kind of computer readable storage mediums.One or more is executable comprising computer
The non-volatile computer readable storage medium storing program for executing of instruction, when computer executable instructions are executed by one or more processors,
So that processor executes the step of image processing method.
The embodiment of the present application also provides a kind of computer program products including instruction, when it runs on computers
When so that computer executes image processing method.
Used in this application may include to any reference of memory, storage, database or other media is non-volatile
And/or volatile memory.Nonvolatile memory may include that read-only memory (ROM), programming ROM (PROM), electricity can be compiled
Journey ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include random access memory
(RAM), it is used as external cache.By way of illustration and not limitation, RAM is available in many forms, such as static state RAM
(SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDR SDRAM), enhanced SDRAM
(ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) directly RAM (RDRAM), straight
Connect memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM).
Above example only expresses the several embodiments of the application, the description thereof is more specific and detailed, but can not
Therefore it is interpreted as the limitation to the application the scope of the claims.It should be pointed out that for those of ordinary skill in the art,
Under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the protection model of the application
It encloses.Therefore, the protection domain of the application patent should be determined by the appended claims.
Claims (20)
1. a kind of image processing method, which is characterized in that including：
If first processing units receive the image capture instruction of second processing unit transmission, according to described image acquisition instructions control
Camera module processed acquires target image；
The target image is corrected, target image after being corrected；
Target image after the correction is sent to the second processing unit, target image is used for Face datection after the correction
With at least one of the depth information for obtaining face.
2. according to the method described in claim 1, it is characterized in that, target image includes infrared image after correction after the correction
With speckle image after correction；Include according to the method that target image after the correction carries out Face datection：
Recognition of face is carried out according to infrared image after the correction, detects whether that there are the first faces；
If there are the first face, depth image is obtained according to speckle image after the correction；
In vivo detection is carried out according to infrared image after the correction and depth image.
3. according to the method described in claim 2, it is characterized in that, it is described according to the correction after speckle image obtain depth
Before image, the method further includes：
First face is matched with the second face；
Determine first face and the second face successful match；Second face is stored face.
4. according to the method described in claim 1, it is characterized in that, described control camera shooting head mould according to described image acquisition instructions
Group acquires target image：
The camera module, which is controlled, according to described image acquisition instructions acquires infrared image；
The camera module, which is controlled, according to described image acquisition instructions acquires speckle image；
Wherein, the time interval between the first moment of the infrared image and the second moment of the acquisition speckle image is acquired
Less than first threshold.
5. according to the method described in claim 1, it is characterized in that, the target image includes infrared image and speckle image；
It is described to include according to described image acquisition instructions control camera module acquisition target image：
Obtain timestamp in described image acquisition instructions；
Determine that the time interval between the first moment and the timestamp that acquire the infrared image is less than second threshold；
Determine that the time interval between the second moment and the timestamp that acquire the speckle image is less than third threshold value.
6. according to the method described in claim 1, it is characterized in that, the target image includes infrared image；The method is also
Including：
If described image acquisition instructions include acquisition visible images, the camera is controlled according to described image acquisition instructions
Module acquires the infrared image and the visible images simultaneously.
7. according to the method in claim 2 or 3, which is characterized in that the method further includes：
If receiving the data acquisition request of application program, the security level of the application program is obtained；
Search precision grade corresponding with the security level；
Depth image after adjustment is sent to described using journey by the precision that the depth image is adjusted according to the precision grade
Sequence.
8. the method according to the description of claim 7 is characterized in that described adjust the target image according to the precision grade
Precision include：
The resolution ratio of the depth image is adjusted according to the precision grade；
Or, adjusting the number of speckle point in the speckle image that the camera module acquires according to the precision grade.
9. according to the method in claim 2 or 3, which is characterized in that the method further includes：
If receiving the data acquisition request of application program, the security level of the application program is obtained；
Determine the corresponding data channel of the security level of the application program；
The depth image is sent to the application program by the corresponding data transmission channel.
10. a kind of image processing apparatus, which is characterized in that including：
Acquisition module, if the image capture instruction of second processing unit transmission is received for first processing units, according to described
Image capture instruction controls camera module and acquires target image；
Correction module, for being corrected to the target image, target image after being corrected；
Sending module, for target image after the correction to be sent to the second processing unit, target figure after the correction
As at least one of the depth information for Face datection and acquisition face.
11. a kind of electronic equipment, which is characterized in that including：First processing units, second processing unit and camera module, institute
It states first processing units and is separately connected the second processing unit and camera module；
The first processing units are used to receive the image capture instruction sent in second processing unit, are adopted according to described image
Collection instruction control camera module acquires target image；
The first processing units are additionally operable to be corrected the target image, target image after being corrected；
The first processing units are additionally operable to target image after the correction being sent to described in second processing unit；
The depth that the second processing unit is used to carry out Face datection according to target image after the correction and obtains face is believed
At least one of breath.
12. electronic equipment according to claim 11, which is characterized in that target image includes red after correcting after the correction
Speckle image after outer image and correction；The method that the second processing unit carries out Face datection according to target image after the correction
Including：
Recognition of face is carried out according to infrared image after the correction, detects whether that there are the first faces；
If there are the first face, depth image is obtained according to speckle image after the correction；
In vivo detection is carried out according to infrared image after the correction and depth image.
13. electronic equipment according to claim 12, it is characterised in that：The second processing unit is additionally operable at described
Before obtaining depth image according to speckle image after the correction, first face is matched with the second face；Determine institute
State the first face and the second face successful match；Second face is stored face.
14. electronic equipment according to claim 11, which is characterized in that the first processing units are adopted according to described image
Collection instruction control camera module acquires target image and includes：
The first processing units control the camera module according to described image acquisition instructions and acquire infrared image；
The first processing units control the camera module according to described image acquisition instructions and acquire speckle image；
Wherein, the time interval between the first moment of the infrared image and the second moment of the acquisition speckle image is acquired
Less than first threshold.
15. electronic equipment according to claim 11, which is characterized in that the target image includes infrared image and speckle
Image；The first processing units control camera module acquisition target image according to described image acquisition instructions：
Obtain timestamp in described image acquisition instructions；
Determine that the time interval between the first moment and the timestamp that acquire the infrared image is less than second threshold；
Determine that the time interval between the second moment and the timestamp that acquire the speckle image is less than third threshold value.
16. electronic equipment according to claim 11, it is characterised in that：
The target image includes infrared image；
If it includes acquisition visible images that the first processing units, which are additionally operable to described image acquisition instructions, according to described image
Acquisition instructions control the camera module and acquire the infrared image and the visible images simultaneously.
17. electronic equipment according to claim 12 or 13, it is characterised in that：
If the second processing unit is additionally operable to receive the data acquisition request of application program, the peace of the application program is obtained
Full rank；Search precision grade corresponding with the security level；The essence of the depth image is adjusted according to the precision grade
Degree, the application program is sent to by the depth image after adjustment.
18. electronic equipment according to claim 17, which is characterized in that the second processing unit is according to the levels of precision
The precision for not adjusting the target image includes：
The resolution ratio of the depth image is adjusted according to the precision grade；
Or, adjusting the number of speckle point in the speckle image that the camera module acquires according to the precision grade.
19. electronic equipment according to claim 12 or 13, it is characterised in that：
If the second processing unit is additionally operable to receive the data acquisition request of application program, the peace of the application program is obtained
Full rank；Determine the corresponding data channel of the security level of the application program；The depth image is passed through described corresponding
Data transmission channel is sent to the application program.
20. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
Following steps are realized when being executed by processor：
If first processing units receive the image capture instruction of second processing unit transmission, according to described image acquisition instructions control
Camera module processed acquires target image；
The target image is corrected, target image after being corrected；
Target image after the correction is sent to the second processing unit, target image is used for Face datection after the correction
With at least one of the depth information for obtaining face.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810327216.7A CN108564032B (en) | 2018-04-12 | 2018-04-12 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN202010344912.6A CN111523499B (en) | 2018-04-12 | 2018-04-12 | Image processing method, apparatus, electronic device, and computer-readable storage medium |
| PCT/CN2019/080428 WO2019196683A1 (en) | 2018-04-12 | 2019-03-29 | Method and device for image processing, computer-readable storage medium, and electronic device |
| EP19784735.3A EP3654243A4 (en) | 2018-04-12 | 2019-03-29 | Method and device for image processing, computer-readable storage medium, and electronic device |
| US16/740,914 US11256903B2 (en) | 2018-04-12 | 2020-01-13 | Image processing method, image processing device, computer readable storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810327216.7A CN108564032B (en) | 2018-04-12 | 2018-04-12 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010344912.6A Division CN111523499B (en) | 2018-04-12 | 2018-04-12 | Image processing method, apparatus, electronic device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108564032A true CN108564032A (en) | 2018-09-21 |
| CN108564032B CN108564032B (en) | 2020-05-22 |
Family
ID=63534859
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010344912.6A Active CN111523499B (en) | 2018-04-12 | 2018-04-12 | Image processing method, apparatus, electronic device, and computer-readable storage medium |
| CN201810327216.7A Active CN108564032B (en) | 2018-04-12 | 2018-04-12 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010344912.6A Active CN111523499B (en) | 2018-04-12 | 2018-04-12 | Image processing method, apparatus, electronic device, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111523499B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108696682A (en) * | 2018-04-28 | 2018-10-23 | Oppo广东移动通信有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
| WO2019196683A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Method and device for image processing, computer-readable storage medium, and electronic device |
| WO2019206129A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Data processing method, apparatus, electronic device, and computer-readable storage medium |
| CN113014782A (en) * | 2021-03-19 | 2021-06-22 | 展讯通信（上海）有限公司 | Image data processing method and device, camera equipment, terminal and storage medium |
| US20220136859A1 (en) * | 2020-11-05 | 2022-05-05 | Toyota Jidosha Kabushiki Kaisha | Apparatus and method for updating map |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112967328A (en) * | 2021-03-20 | 2021-06-15 | 杭州知存智能科技有限公司 | Image depth information local dynamic generation method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105184246A (en) * | 2015-08-28 | 2015-12-23 | 北京旷视科技有限公司 | Living body detection method and living body detection system |
| WO2016107638A1 (en) * | 2014-12-29 | 2016-07-07 | Keylemon Sa | An image face processing method and apparatus |
| CN106682522A (en) * | 2016-11-29 | 2017-05-17 | 大唐微电子技术有限公司 | Fingerprint encryption device and implementation method thereof |
| CN107341481A (en) * | 2017-07-12 | 2017-11-10 | 深圳奥比中光科技有限公司 | It is identified using structure light image |
| CN107832677A (en) * | 2017-10-19 | 2018-03-23 | 深圳奥比中光科技有限公司 | Face identification method and system based on In vivo detection |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105217B (en) * | 2017-04-17 | 2018-11-30 | 深圳奥比中光科技有限公司 | Multi-mode depth calculation processor and 3D rendering equipment |
-
2018
- 2018-04-12 CN CN202010344912.6A patent/CN111523499B/en active Active
- 2018-04-12 CN CN201810327216.7A patent/CN108564032B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016107638A1 (en) * | 2014-12-29 | 2016-07-07 | Keylemon Sa | An image face processing method and apparatus |
| CN105184246A (en) * | 2015-08-28 | 2015-12-23 | 北京旷视科技有限公司 | Living body detection method and living body detection system |
| CN106682522A (en) * | 2016-11-29 | 2017-05-17 | 大唐微电子技术有限公司 | Fingerprint encryption device and implementation method thereof |
| CN107341481A (en) * | 2017-07-12 | 2017-11-10 | 深圳奥比中光科技有限公司 | It is identified using structure light image |
| CN107832677A (en) * | 2017-10-19 | 2018-03-23 | 深圳奥比中光科技有限公司 | Face identification method and system based on In vivo detection |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019196683A1 (en) * | 2018-04-12 | 2019-10-17 | Oppo广东移动通信有限公司 | Method and device for image processing, computer-readable storage medium, and electronic device |
| US11256903B2 (en) | 2018-04-12 | 2022-02-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, image processing device, computer readable storage medium and electronic device |
| CN108696682A (en) * | 2018-04-28 | 2018-10-23 | Oppo广东移动通信有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
| WO2019206129A1 (en) * | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Data processing method, apparatus, electronic device, and computer-readable storage medium |
| US11050918B2 (en) | 2018-04-28 | 2021-06-29 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for performing image processing, and computer readable storage medium |
| US20220136859A1 (en) * | 2020-11-05 | 2022-05-05 | Toyota Jidosha Kabushiki Kaisha | Apparatus and method for updating map |
| CN113014782A (en) * | 2021-03-19 | 2021-06-22 | 展讯通信（上海）有限公司 | Image data processing method and device, camera equipment, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111523499B (en) | 2023-07-18 |
| CN108564032B (en) | 2020-05-22 |
| CN111523499A (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108564032A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN108668078B (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108549867B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment | |
| CN108804895B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment | |
| CN108764052B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment | |
| CN108805024B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment | |
| CN108419017B (en) | Control method, apparatus, electronic equipment and the computer readable storage medium of shooting | |
| CN108573170A (en) | Information processing method and device, electronic equipment, computer readable storage medium | |
| US11256903B2 (en) | Image processing method, image processing device, computer readable storage medium and electronic device | |
| WO2019206020A1 (en) | Image processing method, apparatus, computer-readable storage medium, and electronic device | |
| CN110191266B (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN108830141A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN109213610B (en) | Data processing method and device, computer readable storage medium and electronic equipment | |
| CN108711054A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108764053A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108921903A (en) | Camera calibration method, device, computer readable storage medium and electronic equipment | |
| CN108833887B (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN108985255A (en) | Data processing method, device, computer readable storage medium and electronic equipment | |
| CN108846310A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN108712400A (en) | Data transmission method, device, computer readable storage medium and electronic equipment | |
| US11170204B2 (en) | Data processing method, electronic device and computer-readable storage medium | |
| CN108833885A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108924421A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108810516B (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN108881712B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |