CN110191266A - Data processing method, device, electronic equipment and computer readable storage medium - Google Patents
Data processing method, device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110191266A CN110191266A CN201910492085.2A CN201910492085A CN110191266A CN 110191266 A CN110191266 A CN 110191266A CN 201910492085 A CN201910492085 A CN 201910492085A CN 110191266 A CN110191266 A CN 110191266A
- Authority
- CN
- China
- Prior art keywords
- image
- controller
- processing units
- bus
- control instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/175—Controlling the light source by remote control
- H05B47/18—Controlling the light source by remote control via data-bus transmission
Abstract
The invention relates to a kind of data processing method, device, electronic equipment and computer readable storage mediums.The above method, comprising: when first processing units receive the image capture instruction of the second processing unit transmission, the image type of acquisition is determined according to described image acquisition instructions；Control instruction corresponding with image type is sent to controller by bidirectional two-line synchronous serial I2C bus, the control instruction opens at least one of floodlight and color-changing lamp for controlling；Pulse is sent to the controller by pulse width modulation (PWM) module, lights at least one of the floodlight and color-changing lamp of unlatching, and target image is acquired by Laser video camera head；Target image is handled by first processing units, and target image is sent to described the second processing unit by treated.Above-mentioned data processing method, device, electronic equipment and computer readable storage medium can reduce the complexity of control floodlight and color-changing lamp etc., and save the cost.
Description
The application is the April 28 2018 applying date application No. is 201810402999.0, denomination of invention " data processing
The divisional application of method, apparatus, electronic equipment and computer readable storage medium ".
Technical field
This application involves field of computer technology, more particularly to a kind of data processing method, device, electronic equipment and meter
Calculation machine readable storage medium storing program for executing.
Background technique
3D (3Dimensions, three-dimensional) face is equal in the different applications scenes such as recognition of face, U.S. face, 3D model foundation
It plays an important role.Electronic equipment can emit laser by lasers such as color-changing lamps, and acquired by camera and shone by laser
The facial image penetrated constructs 3D face by structure light.In traditional mode, electronic equipment controls laser transmitting laser
Mode is complex, and at high cost.
Summary of the invention
The embodiment of the present application provides a kind of data processing method, device, electronic equipment and computer readable storage medium, can
To reduce the complexity of control floodlight and color-changing lamp etc., and save the cost.
A kind of data processing method, comprising:
When first processing units receive the image capture instruction of the second processing unit transmission, acquired according to described image
Instruction determines the image type of acquisition；
Control corresponding with described image type is sent to controller by bidirectional two-line synchronous serial I2C bus to refer to
It enables, the control instruction opens at least one of floodlight and color-changing lamp for controlling；
Pulse is sent to the controller by pulse width modulation (PWM) module, lights the floodlight and radium of unlatching
At least one of shot-light, and target image is acquired by Laser video camera head；
The target image is handled by the first processing units, and target image is sent to by treated
Described the second processing unit.
A kind of data processing equipment, comprising:
Instruction sending module, for receiving the image capture instruction of the second processing unit transmission when first processing units
When, the image type of acquisition is determined according to described image acquisition instructions；By bidirectional two-line synchronous serial I2C bus to control
Device sends control instruction corresponding with image type, and the control instruction is opened in floodlight and color-changing lamp at least for controlling
One；
Pulse sending module lights unlatching for sending pulse to the controller by pulse width modulation (PWM) module
The floodlight and at least one of color-changing lamp, and target image is acquired by Laser video camera head；
Processing module, for being handled by the first processing units the target image, and by treated
Target image is sent to described the second processing unit.
A kind of electronic equipment, including camera module, first processing units, the second processing unit and controller, described
One processing unit is connected with described the second processing unit and camera module respectively, and the first processing units pass through I2C bus
It is connect with the controller；The camera module includes Laser video camera head, floodlight and color-changing lamp, the floodlight and radium-shine
Lamp is connect with the controller respectively；The first processing units include PWM module, and the first processing units pass through described
PWM module is connect with the controller；
The first processing units, for when receive the second processing unit transmission image capture instruction when, according to described
Image capture instruction determines the image type of acquisition, sends and schemes to controller by bidirectional two-line synchronous serial I2C bus
As the corresponding control instruction of type, the control instruction is opened at least one of floodlight and color-changing lamp for controlling, is passed through
Pulse width modulation (PWM) module sends pulse to the controller, lights in the floodlight and color-changing lamp of unlatching at least
One, and target image is acquired by Laser video camera head, the target image is handled, and will treated target image
It is sent to described the second processing unit.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
Above-mentioned data processing method is realized when row.
Above-mentioned data processing method, device, electronic equipment and computer readable storage medium, when first processing units receive
To the second processing unit send image capture instruction when, according to described image acquisition instructions determine acquisition image type, lead to
It crosses I2C bus and sends control instruction corresponding with image type to controller, control is opened in floodlight and color-changing lamp at least
One, and pulse is sent to controller by PWM module, at least one of floodlight and color-changing lamp of unlatching are lighted, is acquired
Target image is handled again after target image, the control to floodlight and color-changing lamp can be realized by a controller,
The complexity of control floodlight and color-changing lamp etc., and save the cost can be reduced.
Detailed description of the invention
Fig. 1 is the application scenario diagram of data processing method in one embodiment；
Fig. 2 is the application scenario diagram of data processing method in another embodiment；
Fig. 3 is the block diagram of electronic equipment in one embodiment；
Fig. 4 is the flow diagram of data processing method in one embodiment；
Fig. 5 is that first processing units, Laser video camera head and controller are connected to the same I2C bus in one embodiment
Schematic diagram；
Fig. 6 is the stream that first processing units send control instruction according to image capture instruction to controller in one embodiment
Journey schematic diagram；
Fig. 7 is the flow diagram handled by first processing units target image in one embodiment；
Fig. 8 is the block diagram of data processing equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the application, not
For limiting the application.
It is appreciated that term " first " used in this application, " second " etc. can be used to describe various elements herein,
But these elements should not be limited by these terms.These terms are only used to distinguish the first element from the other element.Citing comes
It says, in the case where not departing from scope of the present application, the first client can be known as the second client, and similarly, can incite somebody to action
Second client is known as the first client.The first client and the second client both client, but it is not same visitor
Family end.
Fig. 1 is the application scenario diagram of data processing method in one embodiment.As shown in figure 4, electronic equipment includes laser
Camera 102, floodlight 104, color-changing lamp 106, first processing units 110, the second processing unit 120 and controller 130.First
Processing unit 110 can be MCU (Microcontroller Unit, micro-control unit) module etc., and the second processing unit 120 can be
CPU (Central Processing Unit, central processing unit) module etc..First processing units 110 can be with Laser video camera head
102, the second processing unit 120 connects, and first processing units 110 can be connect by I2C bus with controller 130.First processing
PWM (Pulse Width Modulation, pulse width modulation) module 112 can be wrapped in unit 110, and passes through PWM module 112
It is connect with controller 130, controller 130 can be connect with floodlight 104, color-changing lamp 106 respectively.
It is total by I2C when first processing units 110 receive the image capture instruction of the transmission of the second processing unit 120
Line sends control instruction to controller 130, which, which can be used for controlling, opens in floodlight 104 and color-changing lamp 106 extremely
It is one few.First processing units 110 can send pulse to controller 130 by PWM module 112, light the floodlight 104 of unlatching
At least one of with color-changing lamp 106, and target image is acquired by Laser video camera head 102.First processing units 110 can be to mesh
Logo image is handled, and target image is sent to the second processing unit 120 by treated.
Fig. 2 is the application scenario diagram of data processing method in another embodiment.As shown in Fig. 2, electronic equipment 200 can wrap
Include camera module 210, the second processing unit 220, first processing units 230.Above-mentioned the second processing unit 220 can be CPU mould
Block.Above-mentioned first processing units 230 can be MCU module etc..Wherein, first processing units 230 are connected to the second processing unit 220
Between camera module 210, above-mentioned first processing units 230 can control Laser video camera head 212 in camera module 210, general
Light lamp 214 and color-changing lamp 218, above-mentioned the second processing unit 220 can control RGB camera 216 in camera module 210.
It include Laser video camera head 212, floodlight 214, RGB camera 216 and color-changing lamp 218 in camera module 210.On
Stating Laser video camera head 212 can be infrared camera, for obtaining infrared image.Above-mentioned floodlight 214 is that can emit infrared light
Area source；Above-mentioned color-changing lamp 218 is that can emit the point light source of laser and be with figuratum point light source.Wherein, when floodlight 214
When emitting area source, Laser video camera head 212 can obtain infrared image according to the light being reflected back.When 218 launch point light of color-changing lamp
When source, Laser video camera head 212 can obtain speckle image according to the light being reflected back.Above-mentioned speckle image is that color-changing lamp 218 emits
Reflected with figuratum point light source after the pattern image that deformation occurs.
The second processing unit 220 may include in TEE (Trusted execution environment, credible operation ring
Border) CPU core that runs under environment and under REE (Rich Execution Environment, natural running environment) environment
The CPU core of operation.Wherein, TEE environment and REE environment are ARM module (Advanced RISC Machines, advanced essence
Simple instruction set processor) operational mode.Wherein, the security level of TEE environment is higher, has in the second processing unit 220 and only
There is a CPU core that can operate in simultaneously under TEE environment.Under normal conditions, the higher operation of 200 medium security level of electronic equipment
Behavior needs execute in the CPU core under TEE environment, and the lower operation behavior of security level can be in the CPU under REE environment
It is executed in core.
First processing units 230 include PWM module 232, SPI/I2C (Serial Peripheral Interface/
Inter-Integrated Circuit, Serial Peripheral Interface (SPI)/bidirectional two-line synchronous serial interface) interface 234, RAM
(Random Access Memory, random access memory) module 236 and depth engine 238.First processing units 230 can lead to
PWM module 232 is crossed to connect with the controller of floodlight 214 and color-changing lamp 218, the controller can respectively with floodlight 214 and radium
Shot-light 218 connects, and controls floodlight 214 and color-changing lamp 218.First processing units 230 can also pass through I2C bus and control
Device processed connection, can open floodlight 214 or color-changing lamp 218 by the I2C bus marco of connection, and above-mentioned PWM module 232 can be to taking the photograph
As the transmitting pulse of head mould group, the floodlight 214 or color-changing lamp 218 of unlatching are lighted.First processing units 230 can pass through Laser video camera
First 212 acquisition infrared image or speckle image.Above-mentioned SPI/I2C interface 234 is used to receive the figure of the transmission of the second processing unit 220
As acquisition instructions.Above-mentioned depth engine 238 can handle speckle image to obtain depth parallax figure.
When the second processing unit 220 receives the data acquisition request of application program, for example, when application program need into
When the unlock of pedestrian's face, face payment, image can be sent to first processing units 230 by the CPU core operated under TEE environment
Acquisition instructions.After first processing units 230 receive image capture instruction, it can be sent and be controlled to controller by I2C bus
Instruction, the floodlight 214 in control camera module 210 is opened in control, then emits pulse to controller by PWM module 232
The bright floodlight 214 of wave point, and infrared image is acquired by I2C bus marco Laser video camera head 212, it can be by I2C bus to control
Device processed sends control instruction, and the color-changing lamp 218 in camera module 210 is opened in control, then passes through PWM module 232 to controller
Transmitting impulse wave lights color-changing lamp 218, and acquires speckle image by I2C bus marco Laser video camera head 212.Camera module
Collected infrared image and speckle image can be sent to first processing units 230 by 210.First processing units 230 can dock
The infrared image received is handled to obtain infrared disparity map；The speckle image received is handled to obtain speckle disparity map
Or depth parallax figure.Wherein, first processing units 230 handle to above-mentioned infrared image and speckle image and refer to infrared figure
Picture or speckle image are corrected, and remove influence of the inside and outside parameter to image in camera module 210.Wherein, the first processing is single
Member 230 can be set to different modes, and the image of different mode output is different.When first processing units 230 are set as speckle pattern
When mode, first processing units 230 obtain speckle disparity map to speckle image processing, and mesh can be obtained according to above-mentioned speckle disparity map
Mark speckle image；When first processing units 230 are set as depth chart-pattern, first processing units 230 are to speckle image processing
Depth parallax figure is obtained, depth image can be obtained according to above-mentioned depth parallax figure, above-mentioned depth image refers to depth information
Image.Above-mentioned infrared disparity map and speckle disparity map can be sent to the second processing unit 220 by first processing units 230, the
Above-mentioned infrared disparity map and depth parallax figure can also be sent to the second processing unit 220 by one processing unit 230.Second processing list
Member 220 can obtain Infrared Targets image according to above-mentioned infrared disparity map, obtain depth image according to above-mentioned depth parallax figure.Into one
Step, the second processing unit 220 can carry out recognition of face, face matching, living body inspection according to Infrared Targets image, depth image
Survey and obtain the depth information of the face detected.
Communicate between first processing units 230 and the second processing unit 220 is by fixed safe interface, to ensure
Transmit the safety of data.As shown in Figure 1, the data that the second processing unit 220 is sent to first processing units 230 are to pass through
SECURE SPI/I2C 240, the data that first processing units 230 are sent to the second processing unit 220 are to pass through SECURE
MIPI (Mobile Industry Processor Interface, mobile industry processor interface) 250.
In one embodiment, first processing units 230 can also be obtained according to above-mentioned infrared disparity map Infrared Targets image,
Above-mentioned depth parallax figure, which calculates, obtains depth image, then above-mentioned Infrared Targets image, depth image are sent to second processing list
Member 220.
Fig. 3 is the block diagram of electronic equipment in one embodiment.As shown in figure 3, the electronic equipment includes passing through system bus
Processor, memory, display screen and the input unit of connection.Wherein, memory may include non-volatile memory medium and processing
Device.The non-volatile memory medium of electronic equipment is stored with operating system and computer program, and the computer program is by processor
To realize a kind of data processing method provided in the embodiment of the present application when execution.The processor calculates and controls energy for providing
Power supports the operation of entire electronic equipment.Built-in storage in electronic equipment is the computer journey in non-volatile memory medium
The operation of sequence provides environment.The display screen of electronic equipment can be liquid crystal display or electric ink display screen etc., input dress
It sets and can be the touch layer covered on display screen, be also possible to the key being arranged on electronic equipment casing, trace ball or Trackpad,
It is also possible to external keyboard, Trackpad or mouse etc..The electronic equipment can be mobile phone, tablet computer or individual digital and help
Reason or wearable device etc..It will be understood by those skilled in the art that structure shown in Fig. 3, only with application scheme phase
The block diagram of the part-structure of pass does not constitute the restriction for the electronic equipment being applied thereon to application scheme, specific electricity
Sub- equipment may include perhaps combining certain components or with different components than more or fewer components as shown in the figure
Arrangement.
As shown in figure 4, in one embodiment, providing a kind of data processing method, comprising the following steps:
Step 410, when first processing units receive the image capture instruction of the second processing unit transmission, according to the figure
As acquisition instructions determine the image type of acquisition.
Step 420, control corresponding with the image type is sent to controller by bidirectional two-line synchronous serial I2C bus
System instruction, control instruction open at least one of floodlight and color-changing lamp for controlling.
When application program needs to obtain human face data in electronic equipment, application program can send number to the second processing unit
According to acquisition request, wherein need to carry out face under the scenes such as human face data may include but be not limited to face unlock, face is paid and test
Data and face depth information of card etc..After the second processing unit receives data acquisition request, it can be sent to first processing units
Image capture instruction, wherein first processing units can be MCU module, and the second processing unit can be CPU module.
It may include controller in electronic equipment, which can connect with floodlight and color-changing lamp respectively, floodlight and radium
Shot-light can be controlled by the same controller.Controller controls floodlight and color-changing lamp, it may include control is opened
Floodlight or color-changing lamp control the switching between floodlight and color-changing lamp, control floodlight and the transmission power of color-changing lamp etc..The
One processing unit can be connect by I2C bus with controller, and I2C bus can be realized and be connected by a data wire and a clock line
The data transmission being connected between each device in I2C bus.When first processing units receive the second processing unit transmission
When image capture instruction, can send control instruction to controller by I2C bus can basis after controller receives control instruction
Control instruction opens at least one of floodlight and color-changing lamp.
Step 430, pulse is sent to controller by pulse width modulation (PWM) module, lights the floodlight and radium of unlatching
At least one of shot-light, and target image is acquired by Laser video camera head.
First processing units can be connect by PWM module with controller, when control is opened in floodlight and color-changing lamp extremely
It is one few, pulse can be sent to controller by PWM module, light at least one of floodlight and color-changing lamp of unlatching.It can
Selection of land, the pulse signal that PWM module can continuously be issued according to certain voltage amplitude, certain time interval to controller, control are opened
Open at least one of floodlight and color-changing lamp.
First processing units can acquire target image by Laser video camera head, and target image may include infrared image, speckle
Image etc..If opening is floodlight, PWM module can send pulse to controller, light floodlight, floodlight can for it is a kind of to
The point light source of uniform irradiation from all directions can emit infrared light when floodlight is lit, and Laser video camera head can acquire face and obtain
To infrared image.If unlatching is color-changing lamp, PWM module can send pulse to controller, light color-changing lamp.Color-changing lamp is lit
When, the laser of sending can carry out diffraction by lens and DOE (diffractive optical elements, diffractive-optical element)
The pattern with speckle particle is generated, by the pattern projection with speckle particle to target object, by target object each point and electronics
The distance difference of equipment generates the offset of speckle pattern, and Laser video camera head is acquired target object to obtain speckle image.
Step 440, target image is handled by first processing units, and target image is sent to by treated
The second processing unit.
The target image of acquisition can be sent to first processing units by Laser video camera head, and first processing units can be to target figure
As being handled, wherein target image may include infrared image, speckle image etc..First processing units refer to according to Image Acquisition
It enables after determining image type, target image corresponding with image type can be acquired according to determining image type, and to target figure
As performing corresponding processing.When image type is infrared image, first processing units can be controlled by the first PWM module to first
Device processed sends pulse, lights floodlight, and acquire infrared image by Laser video camera head, can be handled to obtain to infrared image
Infrared disparity map.When image type is speckle image, first processing units can be sent out by the second PWM module to second controller
Pulse is sent, lights color-changing lamp, and speckle image is acquired by Laser video camera head, speckle image can be handled to obtain speckle view
Difference figure.When image type is depth image, first processing units can acquire speckle image, and carry out to the speckle image of acquisition
Processing obtains depth parallax figure.
In one embodiment, first processing units can be corrected processing to target image, be corrected processing and refer to
Target image picture material as caused by inside and outside parameter of Laser video camera head and RGB camera etc. is corrected to deviate, such as due to
Offset of picture material caused by placement position between Laser video camera head deflection angle, Laser video camera head and RGB camera etc. etc..
After being corrected processing to target image, the disparity map of target image can be obtained, handled for example, being corrected to infrared image
To infrared disparity map, speckle image is corrected, speckle disparity map or depth parallax figure etc. can be obtained.Target image is carried out
Correction process can prevent the image finally presented on the screen of the electronic device from the case where ghost image occur.
First processing units handle target image, can will treated that target image is sent to second processing list
Member.The second processing unit can target image obtains required image, such as infrared image, speckle image and depth according to treated
Spend image etc..The second processing unit can be handled required image according to the demand of application program.
For example, then the second processing unit then can be to obtained required image when application program needs to carry out face verification
Deng progress Face datection, wherein Face datection may include recognition of face, face matching and In vivo detection.Recognition of face refers to knowledge
It whether there is face in image needed for not, face matching refers to face in required image and the face prestored progress
Match, whether face has bioactivity etc. in image needed for In vivo detection refers to detection.If application program needs to obtain face
Depth information, then the depth image of generation can be uploaded to application program, application program can be according to the depth image received
Carry out U.S. face processing, three-dimensional modeling etc..
In the present embodiment, when first processing units receive the image capture instruction of the second processing unit transmission, lead to
It crosses I2C bus and sends control instruction to controller, at least one of floodlight and color-changing lamp are opened in control, and pass through PWM mould
Block sends pulse to controller, lights at least one of floodlight and color-changing lamp of unlatching, acquires after target image again to mesh
Logo image is handled, and the control to floodlight and color-changing lamp can be realized by a controller, can reduce control floodlight
The complexity of lamp and color-changing lamp etc., and save the cost.
In one embodiment, step acquires target image by Laser video camera head, comprising: is swashed by I2C bus marco
Light video camera head acquires target image.
First processing units can be connect by I2C bus with Laser video camera head, and be swashed by the I2C bus marco of the connection
Light video camera head acquires target image.In one embodiment, first processing units, Laser video camera head and controller can connect same
A I2C bus.It, can be total by the I2C after first processing units receive the image capture instruction of the second processing unit transmission
Line traffic control opens floodlight or color-changing lamp, and sends pulse to controller by PWM module, lights the floodlight or radium-shine of unlatching
Lamp, then the target images such as infrared image or speckle image are acquired by the I2C bus marco Laser video camera head of the connection.
In one embodiment, first processing units can be addressed controller by the I2C bus of the connection, and to
Controller sends control instruction, and floodlight or color-changing lamp are opened in control, then by the I2C bus of the connection to Laser video camera head into
Row addressing, control Laser video camera head acquire target image, are multiplexed at different times to the same I2C bus of connection,
Save resource.
Fig. 5 is that first processing units, Laser video camera head and controller are connected to the same I2C bus in one embodiment
Schematic diagram.As shown in figure 5, electronic equipment includes Laser video camera head 102, floodlight 104, color-changing lamp 106, first processing units
110, the second processing unit 120 and controller 130.First processing units 110 can be connect with the second processing unit 120.At first
Manage in unit 110 can packet PWM module 112, and connect with controller 130 by PWM module 112, controller 130 can respectively with it is general
Light lamp 104, color-changing lamp 106 connect.Laser video camera head 102, first processing units 110 and controller 130 are attached to same
I2C bus.
It, can be by this after first processing units 110 receive the image capture instruction of 120 yuan of second processing list transmissions
I2C bus sends control instruction to controller 130, and floodlight 104 or color-changing lamp 106 are opened in control, and pass through PWM module 112
Pulse is sent to controller 130, lights the floodlight 104 or color-changing lamp 106 of unlatching, then the I2C bus marco for passing through the connection
Laser video camera head 102 acquires the target images such as infrared image or speckle image.
In the present embodiment, by the same I2C bus marco floodlight, color-changing lamp and Laser video camera head, to I2C bus
It is multiplexed, the complexity of control circuit can be reduced, and reduce cost.
As shown in fig. 6, in one embodiment, step is sent by I2C bus to controller corresponding with image type
Control instruction, comprising the following steps:
Step 602, if image type is the first kind, first processing units send the to controller by I2C bus
One control instruction, the first control instruction are used to indicate controller and open the floodlight.
First processing units receive the image capture instruction of the second processing unit transmission, can be determined according to image capture instruction
The image type of acquisition, wherein image type can be one of infrared image, speckle image and depth image etc. or more
Kind.Image type can be determined according to the human face data needed for application program, and the second processing unit receives data acquisition request
Afterwards, image type can be determined according to data acquisition request, and is sent the image comprising the image type to first processing units and adopted
Collection instruction.For example, it is desired to carry out the data of face unlock, then it can determine that image type is infrared image and speckle image, need
Face depth information then can determine that image type is depth image etc., but not limited to this.
If image type is the first kind, in the present embodiment, the first kind can be infrared image, then the first processing is single
Member can send the first control instruction to controller by the I2C of connection, and controller can switch to floodlight according to the first control instruction
Lamp, and open floodlight.First processing units can emit pulse to controller by PWM module, light floodlight.Optionally,
First processing units can be addressed controller by I2C, and send the first control instruction to controller.
Step 604, if image type is Second Type, first processing units send the to controller by I2C bus
Two control instructions, the second control instruction are used to indicate controller and open the color-changing lamp.
If image type is Second Type, in the present embodiment, Second Type can be speckle image or depth image etc.,
Then first processing units can send the second control instruction to controller by the I2C of connection, and controller can refer to according to the second control
Order switches to color-changing lamp, and opens color-changing lamp.First processing units can emit pulse to controller by PWM module, light radium
Shot-light.
First processing units determine that image type, image type may include having at least two according to image capture instruction, than
Such as, image type can include the first kind and Second Type simultaneously.When image type include infrared image and speckle image, or
Comprising infrared image and when depth image, need to acquire infrared image and speckle image simultaneously.First processing units can be acquired first
Infrared image, can also first acquire speckle image, not limit successive acquisition order.First processing units can first pass through I2C bus
The first control instruction is sent to controller, floodlight is opened, and pulse is emitted to controller by PWM module, lights floodlight,
Infrared image is acquired by I2C bus marco Laser video camera head again.In first processing units control Laser video camera head acquisition and the
After the corresponding target image of one type, the second control instruction can be sent to controller by I2C bus, open color-changing lamp, and lead to
It crosses PWM module and emits pulse to controller, light color-changing lamp, then speckle image is acquired by I2C bus marco Laser video camera head.
In one embodiment, when image type can include the first kind and Second Type, first processing units simultaneously
I2C bus can be first passed through and send the second control instruction to controller, open color-changing lamp, and emit to controller by PWM module
Pulse lights color-changing lamp, then acquires speckle image by I2C bus marco Laser video camera head.Swash in first processing units control
After light video camera head acquires target image corresponding with Second Type, the first control instruction can be sent to controller by I2C bus,
Floodlight is opened, and pulse is emitted to controller by PWM module, lights floodlight, then pass through I2C bus marco Laser video camera
Head acquisition infrared image.
Optionally, first processing units can send the first control instruction and the second control to controller respectively in different moments
Instruction, send the first control instruction at the time of and send the second control instruction at the time of between time interval be smaller than time threshold
Value, Laser video camera head can collect speckle image in the time interval for being less than time threshold after having acquired infrared image, make
The picture material of the infrared image and speckle image that must acquire is more consistent, and subsequent progress Face datection etc. is facilitated to handle.Time
Threshold value can be set according to actual needs, such as 20 milliseconds, 30 milliseconds etc..Guarantee the infrared image and speckle image of acquisition
Picture material is more consistent, and the accuracy of subsequent Face datection can be improved.
In the present embodiment, the switching and control that floodlight and color-changing lamp can be realized by a controller, can reduce
The complexity of control circuit, and reduce cost.
As shown in fig. 7, in one embodiment, step 430 is handled target image by first processing units, and
By treated, target image is sent to the second processing unit, comprising the following steps:
Step 702, the reference speckle image for obtaining storage has reference depth information with reference to speckle image.
In camera coordinate system, using vertical imaging plane and across the straight line at mirror surface center as Z axis, if object is imaging
The coordinate of machine coordinate system is (X, Y, Z), then Z value therein is depth information of the object in the video camera imaging plane.If
Application program needs to obtain the depth information of face, then needs to acquire the depth image comprising face depth information.First processing
Unit can open color-changing lamp by I2C bus marco, and acquire speckle image by I2C bus marco Laser video camera head.First
It can be previously stored in processing unit with reference to speckle pattern, reference depth information can be had with reference to speckle pattern, it can dissipating according to acquisition
Spot image and the depth information that each pixel for including in speckle image is obtained with reference to speckle image.
Step 704, it will be matched with reference to speckle image with speckle image, and obtain matching result.
First processing units can be successively centered on each pixel for including in the speckle image of acquisition, and selection one pre-
If size block of pixels, such as 31pixel (pixel) * 31pixel size, the block of pixels with selection is searched on reference speckle image
The block to match.The block of pixels and refer to what speckle image matched that first processing units can be selected from the speckle image of acquisition
In block, speckle image is found and with reference to two points on same laser optical path respectively in speckle image, same laser optical path
On two points speckle information it is consistent, two points on same laser optical path can regard as corresponding pixel.With reference to
In speckle image, the depth information of the point on each laser optical path is all known.First processing units can calculate target and dissipate
Offset of the spot image with reference speckle image between two corresponding pixels on same laser optical path, and according to inclined
The depth information for each pixel for including in the speckle pattern of acquisition is calculated in shifting amount.
In one embodiment, first processing units carry out the meter of offset by the speckle image of acquisition and with reference to speckle pattern
It calculates, the depth information for each pixel for including in speckle image is calculated according to offset, calculation formula can be such as formula (1)
It is shown:
Wherein, ZDIndicate the depth information of pixel namely the depth value of pixel；L is Laser video camera head and laser
The distance between；F is the focal length of lens in Laser video camera head, Z0Reference planes are set apart from electronics when for reference to speckle image acquisition
The depth value of standby Laser video camera head, P are the offset in the speckle image and reference speckle image of acquisition between corresponding pixel points
Amount.P can be obtained by target speckle pattern and the amount of pixels with reference to pixel offset in speckle pattern multiplied by the actual range of a pixel
It arrives.When the distance between target object and Laser video camera head are greater than the distance between reference planes and Laser video camera head, P is negative
Value, when the distance between target object and Laser video camera head are less than the distance between reference planes and Laser video camera head, P is positive
Value.
Step 706, depth parallax figure is generated according to reference depth information and matching result, and depth parallax figure is sent to
The second processing unit is handled to obtain depth map by the second processing unit to depth parallax figure.
The depth information for each pixel for including in the speckle image that first processing units are acquired, can be to acquisition
Speckle image is corrected processing, corrects the speckle image of acquisition due to Laser video camera head and the inside and outside parameter of RGB camera etc.
Caused by picture material deviate.First processing units can be according to each pixel in the speckle image and speckle image after correction
The depth value of point generates depth parallax figure, and depth parallax figure is sent to the second processing unit.The second processing unit can basis
Depth parallax figure obtains depth map, may include the depth information of each pixel in depth map.The second processing unit can be by depth
Figure is uploaded to application program, and application program can carry out U.S. face, three-dimensional modeling etc. according to the depth information of face in depth map.Second
Processing unit can also carry out In vivo detection according to the depth information of face in depth map, and it is two-dimensional flat for can preventing the face of acquisition
Dough figurine face etc..
Optionally, the second processing unit may include two kinds of operational modes in electronic equipment, wherein the first operational mode can be with
It is credible running environment for TEE, TEE, security level is high；Second operational mode can be REE, and REE is nature running environment,
The safety level of REE is lower.After the second processing unit receives the data acquisition request of application program transmission, the first fortune can be passed through
Row mode sends image capture instruction to first processing units.It, can directly will be above-mentioned when the second processing unit is the CPU of monokaryon
Monokaryon is switched to the first operational mode by the second operational mode；It, can be by a kernel by the when the second processing unit is multicore
Two operational modes are switched to the first operational mode, other kernels still operate in the second operational mode, and by operating in first
Kernel under operational mode sends image capture instruction to first processing units.
It, can will treated that target image is sent to the fortune after first processing units handle the target image of acquisition
The kernel of row in the first operating mode, it is ensured that first processing units are run under credible running environment always, improve safety
Property.The second processing unit can be in the kernel of the operation in the first operating mode, and according to treated, target image obtains institute
The image needed, and required image is handled according to the demand of application program.For example, the second processing unit can operate in
Face datection is carried out to required image in kernel under first operational mode.Pass through the highly-safe kernel of the second processing unit
Image capture instruction is sent to first processing units, it is ensured that first processing units are in highly-safe environment, improve number
According to safety.
In one embodiment, since the kernel for operating in the first operational mode is uniquely, the second processing unit is in TEE
Face datection is carried out to target image under environment, serial manner can be acquired, recognition of face, face are carried out to target image one by one
Matching and In vivo detection etc..The second processing unit first can carry out recognition of face to required image, when recognizing face, then will
The face for including in required image is matched with pre-stored face, judges whether it is same face.If same people
Face carries out In vivo detection to face further according to required image, and preventing the face of acquisition is two-dimensional plane face etc..When not having
When recognizing face, the processing pressure of the second processing unit can be can reduce without face matching and In vivo detection.
In the present embodiment, the depth information for the image that can be precisely acquired by first processing units, data processing
It is high-efficient, and improve the accuracy of image procossing.
In one embodiment, a kind of data processing method is provided, comprising the following steps:
Step (1), when first processing units receive the image capture instruction of the second processing unit transmission, by two-way
Two-wire system synchronous serial I2C bus sends control instruction to controller, and control instruction opens floodlight and color-changing lamp for controlling
At least one of.
In one embodiment, step (1), comprising: the image type of acquisition is determined according to image capture instruction；If image
Type is the first kind, then first processing units send the first control instruction, the first control instruction to controller by I2C bus
It is used to indicate controller and opens floodlight；If image type is Second Type, first processing units pass through I2C bus to control
Device sends the second control instruction, and the second control instruction is used to indicate controller and opens color-changing lamp.
In one embodiment, after step determines the image type of acquisition according to image capture instruction, further includes: when
When image type includes the first kind and Second Type, first processing units send the first control to controller by I2C bus
Floodlight is opened in instruction；After acquiring target image corresponding with the first kind by Laser video camera head, pass through I2C bus
The second control instruction is sent to controller, opens color-changing lamp.
In one embodiment, after step determines the image type of acquisition according to image capture instruction, further includes: when
When image type includes the first kind and Second Type, first processing units send the second control to controller by I2C bus
Color-changing lamp is opened in instruction；After through the acquisition of Laser video camera head and the target image of Second Type, by I2C bus to control
Device processed sends the first control instruction, opens floodlight.
In one embodiment, at the time of first processing units send the first control instruction with send second control instruction
Time interval between moment is less than time threshold.
Step (2) sends pulse to controller by pulse width modulation (PWM) module, lights the floodlight and radium of unlatching
At least one of shot-light, and target image is acquired by Laser video camera head.
In one embodiment, first processing units, controller and Laser video camera head are connected in the same I2C bus；
Step acquires target image by Laser video camera head, comprising: acquires target image by I2C bus marco Laser video camera head.
Step (3) is handled target image by first processing units, and target image is sent to by treated
The second processing unit.
In one embodiment, target image includes speckle image；Step (3), comprising: obtain the reference speckle pattern of storage
Picture has reference depth information with reference to speckle image；It will be matched with reference to speckle image with speckle image, and obtain matching knot
Fruit；Depth parallax figure is generated according to reference depth information and matching result, and depth parallax figure is sent to the second processing unit,
Depth parallax figure is handled to obtain depth map by the second processing unit.
In the present embodiment, when first processing units receive the image capture instruction of the second processing unit transmission, lead to
It crosses I2C bus and sends control instruction to controller, at least one of floodlight and color-changing lamp are opened in control, and pass through PWM mould
Block sends pulse to controller, lights at least one of floodlight and color-changing lamp of unlatching, acquires after target image again to mesh
Logo image is handled, and the control to floodlight and color-changing lamp can be realized by a controller, can reduce control floodlight
The complexity of lamp and color-changing lamp etc., and save the cost.
It should be understood that although each step in above-mentioned each flow diagram is successively shown according to the instruction of arrow
Show, but these steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly state otherwise herein, this
There is no stringent sequences to limit for the execution of a little steps, these steps can execute in other order.Moreover, above-mentioned each stream
At least part step in journey schematic diagram may include that perhaps these sub-steps of multiple stages or stage be simultaneously for multiple sub-steps
It is not necessarily and executes completion in synchronization, but can execute at different times, the execution in these sub-steps or stage
Sequence, which is also not necessarily, successively to be carried out, but can be at least the one of the sub-step or stage of other steps or other steps
Part executes in turn or alternately.
In one embodiment, a kind of electronic equipment, including camera module, first processing units, second processing are provided
Unit and controller, first processing units are connected with the second processing unit and camera module respectively.First processing units pass through
I2C bus is connect with controller.Camera module includes Laser video camera head, floodlight and color-changing lamp, and floodlight and color-changing lamp divide
It is not connect with controller.First processing units include PWM module, and first processing units are connected by PWM module and the controller
It connects.
First processing units, for when receive the second processing unit transmission image capture instruction when, according to described image
Acquisition instructions determine the image type of acquisition, send control instruction corresponding with image type, control to controller by I2C bus
System instruction opens at least one of floodlight and color-changing lamp for controlling, by pulse width modulation (PWM) module to controller
Pulse is sent, lights at least one of floodlight and color-changing lamp of unlatching, and target image is acquired by Laser video camera head, it is right
Target image is handled, and target image is sent to the second processing unit by treated.
In the present embodiment, when first processing units receive the image capture instruction of the second processing unit transmission, lead to
It crosses I2C bus and sends control instruction to controller, at least one of floodlight and color-changing lamp are opened in control, and pass through PWM mould
Block sends pulse to controller, lights at least one of floodlight and color-changing lamp of unlatching, acquires after target image again to mesh
Logo image is handled, and the control to floodlight and color-changing lamp can be realized by a controller, can reduce control floodlight
The complexity of lamp and color-changing lamp etc., and save the cost.
In one embodiment, first processing units, controller and Laser video camera head are connected in the same I2C bus.
First processing units are also used to acquire target image by I2C bus marco Laser video camera head.
In the present embodiment, by the same I2C bus marco floodlight, color-changing lamp and Laser video camera head, to I2C bus
It is multiplexed, the complexity of control circuit can be reduced, and reduce cost.
In one embodiment, first processing units are also used to determine the image type of acquisition according to image capture instruction,
If image type is the first kind, first processing units send the first control instruction, the first control to controller by I2C bus
System instruction is used to indicate controller and opens floodlight, if image type is Second Type, first processing units pass through I2C bus
The second control instruction is sent to controller, the second control instruction is used to indicate controller and opens color-changing lamp.
In one embodiment, first processing units are also used to when image type includes the first kind and Second Type,
First processing units send the first control instruction to controller by I2C bus, open floodlight, adopt by Laser video camera head
After collecting target image corresponding with the first kind, the second control instruction is sent to controller by I2C bus, is opened radium-shine
Lamp.
In one embodiment, first processing units are also used to when image type includes the first kind and Second Type,
First processing units send the second control instruction to controller by I2C bus, open color-changing lamp, adopt by Laser video camera head
Collection sends the first control instruction to controller by I2C bus, opens floodlight with after the target image of Second Type.
In one embodiment, at the time of first processing units send the first control instruction with send second control instruction
Time interval between moment is less than time threshold.
In the present embodiment, the switching and control that floodlight and color-changing lamp can be realized by a controller, can reduce
The complexity of control circuit, and reduce cost.
In one embodiment, target image includes speckle image.
First processing units are also used to obtain the reference speckle image of storage, will with reference to speckle image and speckle image into
Row matching, obtains matching result, generates depth parallax figure according to reference depth information and matching result, and depth parallax figure is sent out
The second processing unit is given, has reference depth information with reference to speckle image；
The second processing unit is also used to be handled to obtain depth map to depth parallax figure.
In the present embodiment, the depth information for the image that can be precisely acquired by first processing units, data processing
It is high-efficient, and improve the accuracy of image procossing.
In one embodiment, a kind of data processing equipment 800 is provided, including instruction sending module 810, pulse send mould
Block 820 and processing module 830.
Instruction sending module 810, the Image Acquisition for receiving the second processing unit transmission when first processing units refer to
When enabling, the image type of acquisition is determined according to described image acquisition instructions, by bidirectional two-line synchronous serial I2C bus to control
Device processed sends control instruction corresponding with the image type, and control instruction is opened in floodlight and color-changing lamp at least for controlling
One.
Pulse sending module 820 lights unlatching for sending pulse to controller by pulse width modulation (PWM) module
Floodlight and at least one of color-changing lamp, and target image is acquired by Laser video camera head.
Processing module 830, for being handled by first processing units target image, and will treated target figure
As being sent to the second processing unit.
In the present embodiment, when first processing units receive the image capture instruction of the second processing unit transmission, lead to
It crosses I2C bus and sends control instruction to controller, at least one of floodlight and color-changing lamp are opened in control, and pass through PWM mould
Block sends pulse to controller, lights at least one of floodlight and color-changing lamp of unlatching, acquires after target image again to mesh
Logo image is handled, and the control to floodlight and color-changing lamp can be realized by a controller, can reduce control floodlight
The complexity of lamp and color-changing lamp etc., and save the cost.
In one embodiment, first processing units, controller and Laser video camera head are connected in the same I2C bus.
Pulse sending module 820 is also used to acquire target image by I2C bus marco Laser video camera head.
In the present embodiment, by the same I2C bus marco floodlight, color-changing lamp and Laser video camera head, to I2C bus
It is multiplexed, the complexity of control circuit can be reduced, and reduce cost.
In one embodiment, instruction sending module 810, including type determining units, the first transmission unit and the second hair
Send unit.
Type determining units, for determining the image type of acquisition according to image capture instruction.
First transmission unit sends the first control to controller by I2C bus if being the first kind for image type
System instruction, the first control instruction are used to indicate controller and open floodlight.
Second transmission unit, if image type is Second Type, first processing units are sent out by I2C bus to controller
The second control instruction is sent, the second control instruction is used to indicate controller and opens the color-changing lamp.
In one embodiment, the first transmission unit is also used to when image type includes the first kind and Second Type,
The first control instruction is sent to controller by I2C bus, opens floodlight.
Second transmission unit is also used to after acquiring target image corresponding with the first kind by Laser video camera head,
The second control instruction is sent to the controller by I2C bus, opens color-changing lamp.
In one embodiment, the second transmission unit is also used to when image type includes the first kind and Second Type,
First processing units send the second control instruction to controller by I2C bus, open color-changing lamp.
First transmission unit is also used to after the target image by the acquisition of Laser video camera head and Second Type, passes through
I2C bus sends the first control instruction to controller, opens floodlight.
In one embodiment, at the time of first processing units send the first control instruction with send second control instruction
Time interval between moment is less than time threshold.
In the present embodiment, the switching and control that floodlight and color-changing lamp can be realized by a controller, can reduce
The complexity of control circuit, and reduce cost.
In one embodiment, processing module 830, including image acquisition unit, matching unit and generation unit.
Image acquisition unit has reference depth information with reference to speckle image for obtaining the reference speckle image of storage.
Matching unit matches with speckle image for that will refer to speckle image, obtains matching result.
Generation unit, for generating depth parallax figure according to reference depth information and matching result, and by depth parallax figure
It is sent to the second processing unit, depth parallax figure is handled to obtain depth map by the second processing unit.
In the present embodiment, the depth information for the image that can be precisely acquired by first processing units, data processing
It is high-efficient, and improve the accuracy of image procossing.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, the calculating
Machine program realizes above-mentioned data processing method when being executed by processor.
In one embodiment, a kind of computer program product comprising computer program is provided, when it sets in computer
When standby upper operation, so that computer equipment realizes above-mentioned data processing method when executing.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a non-volatile computer and can be read
In storage medium, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage is situated between
Matter can be magnetic disk, CD, read-only memory (Read-Only Memory, ROM) etc..
It may include as used herein non-volatile to any reference of memory, storage, database or other media
And/or volatile memory.Suitable nonvolatile memory may include read-only memory (ROM), programming ROM (PROM),
Electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include arbitrary access
Memory (RAM), it is used as external cache.By way of illustration and not limitation, RAM is available in many forms, such as
It is static RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDR SDRAM), enhanced
SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM).
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (16)
1. a kind of data processing method characterized by comprising
When first processing units receive the image capture instruction of the second processing unit transmission, according to described image acquisition instructions
Determine the image type of acquisition；
Control instruction corresponding with described image type, institute are sent to controller by bidirectional two-line synchronous serial I2C bus
State control instruction for control unlatching at least one of floodlight and color-changing lamp；
Pulse is sent to the controller by pulse width modulation (PWM) module, lights the floodlight and color-changing lamp of unlatching
At least one of, and target image is acquired by Laser video camera head；
The target image is handled by the first processing units, and will treated that target image is sent to is described
The second processing unit.
2. the method according to claim 1, wherein the first processing units, controller and Laser video camera head
It is connected in the same I2C bus；
It is described that target image is acquired by Laser video camera head, comprising:
Target image is acquired by Laser video camera head described in the I2C bus marco.
3. according to the method described in claim 2, it is characterized in that, it is described by bidirectional two-line synchronous serial I2C bus to
Controller sends control instruction corresponding with described image type, comprising:
If described image type is the first kind, the first processing units are sent out by the I2C bus to the controller
The first control instruction corresponding with the first kind is sent, first control instruction is used to indicate described in the controller unlatching
Floodlight；
If described image type is Second Type, the first processing units are sent out by the I2C bus to the controller
The second control instruction corresponding with the Second Type is sent, second control instruction is used to indicate described in the controller unlatching
Color-changing lamp.
4. the method according to claim 1, wherein determining acquisition according to described image acquisition instructions described
After image type, the method also includes:
When described image type includes the first kind and Second Type, the first processing units by the I2C bus to
The controller sends the first control instruction, opens the floodlight；
After acquiring corresponding with first kind target image by Laser video camera head, by the I2C bus to the control
Device processed sends the second control instruction, opens the color-changing lamp.
5. the method according to claim 1, wherein determining acquisition according to described image acquisition instructions described
After image type, the method also includes:
When described image type includes the first kind and Second Type, the first processing units by the I2C bus to
The controller sends the second control instruction, opens the color-changing lamp；
After through the acquisition of Laser video camera head and the target image of Second Type, by the I2C bus to the controller
The first control instruction is sent, the floodlight is opened.
6. method according to claim 4 or 5, which is characterized in that the first processing units send the first control instruction
At the time of and send the second control instruction at the time of between time interval be less than time threshold.
7. the method according to claim 1, wherein the target image includes speckle image；
It is described that the target image is handled by the first processing units, and target image is sent to by treated
Described the second processing unit, comprising:
The reference speckle image of storage is obtained, it is described to have reference depth information with reference to speckle image；
It is matched described with reference to speckle image with the speckle image, obtains matching result；
Depth parallax figure is generated according to the reference depth information and matching result, and the depth parallax figure is sent to described
The second processing unit is handled to obtain depth map by described the second processing unit to the depth parallax figure.
8. a kind of data processing equipment characterized by comprising
Instruction sending module, when for receiving the image capture instruction of the second processing unit transmission when first processing units, root
The image type that acquisition is determined according to described image acquisition instructions is sent out by bidirectional two-line synchronous serial I2C bus to controller
Control instruction corresponding with described image type is sent, the control instruction is opened in floodlight and color-changing lamp at least for controlling
One；
Pulse sending module lights the institute of unlatching for sending pulse to the controller by pulse width modulation (PWM) module
At least one of floodlight and color-changing lamp are stated, and target image is acquired by Laser video camera head；
Processing module, for being handled by the first processing units the target image, and will treated target
Image is sent to described the second processing unit.
9. a kind of electronic equipment, which is characterized in that including camera module, first processing units, the second processing unit and control
Device, the first processing units are connected with described the second processing unit and camera module respectively, and the first processing units are logical
I2C bus is crossed to connect with the controller；The camera module includes Laser video camera head, floodlight and color-changing lamp, described general
Light lamp and color-changing lamp are connect with the controller respectively；The first processing units include PWM module, the first processing units
It is connect by the PWM module with the controller；
The first processing units, for when receive the second processing unit transmission image capture instruction when, according to described image
Acquisition instructions determine the image type of acquisition, are sent and the figure by bidirectional two-line synchronous serial I2C bus to controller
As the corresponding control instruction of type, the control instruction is opened at least one of floodlight and color-changing lamp for controlling, is passed through
Pulse width modulation (PWM) module sends pulse to the controller, lights in the floodlight and color-changing lamp of unlatching at least
One, and target image is acquired by Laser video camera head, the target image is handled, and will treated target image
It is sent to described the second processing unit.
10. electronic equipment according to claim 9, which is characterized in that the first processing units, controller and laser are taken the photograph
As head is connected in the same I2C bus；
The first processing units are also used to acquire target image by Laser video camera head described in the I2C bus marco.
11. electronic equipment according to claim 10, which is characterized in that the first processing units, if being also used to described
Image type is the first kind, then the first processing units send the first control to the controller by the I2C bus
Instruction, first control instruction are used to indicate the controller and open the floodlight, if described image type is the second class
Type, then the first processing units send the second control instruction, second control to the controller by the I2C bus
Instruction is used to indicate the controller and opens the color-changing lamp.
12. electronic equipment according to claim 11, which is characterized in that the first processing units are also used to when described
When image type includes the first kind and Second Type, the first processing units are by the I2C bus to the controller
The first control instruction is sent, the floodlight is opened, target image corresponding with the first kind is being acquired by Laser video camera head
Later, the second control instruction is sent to the controller by the I2C bus, opens the color-changing lamp.
13. electronic equipment according to claim 11, which is characterized in that the first processing units are also used to when described
When image type includes the first kind and Second Type, the first processing units are by the I2C bus to the controller
The second control instruction is sent, the color-changing lamp is opened, after the target image by the acquisition of Laser video camera head and Second Type,
The first control instruction is sent to the controller by the I2C bus, opens the floodlight.
14. electronic equipment according to claim 12 or 13, which is characterized in that the first processing units send the first control
Time interval between at the time of system instruction and at the time of sending the second control instruction is less than time threshold.
15. electronic equipment according to claim 9, which is characterized in that the target image includes speckle image；
The first processing units are also used to obtain the reference speckle image of storage, will be described with reference to speckle image and described scattered
Spot image is matched, and matching result is obtained, and generates depth parallax figure according to the reference depth information and matching result, and will
The depth parallax figure is sent to described the second processing unit, described to have reference depth information with reference to speckle image；
The second processing unit is also used to be handled to obtain depth map to the depth parallax figure.
16. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The method as described in claim 1 to 7 is any is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910492085.2A CN110191266B (en) | 2018-04-28 | 2018-04-28 | Data processing method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910492085.2A CN110191266B (en) | 2018-04-28 | 2018-04-28 | Data processing method and device, electronic equipment and computer readable storage medium |
| CN201810402999.0A CN108696682B (en) | 2018-04-28 | 2018-04-28 | Data processing method, device, electronic equipment and computer readable storage medium |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810402999.0A Division CN108696682B (en) | 2018-04-28 | 2018-04-28 | Data processing method, device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110191266A true CN110191266A (en) | 2019-08-30 |
| CN110191266B CN110191266B (en) | 2021-08-31 |
Family
ID=63845252
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910492085.2A Active CN110191266B (en) | 2018-04-28 | 2018-04-28 | Data processing method and device, electronic equipment and computer readable storage medium |
| CN201810402999.0A Active CN108696682B (en) | 2018-04-28 | 2018-04-28 | Data processing method, device, electronic equipment and computer readable storage medium |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810402999.0A Active CN108696682B (en) | 2018-04-28 | 2018-04-28 | Data processing method, device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN110191266B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116033265A (en) * | 2023-01-04 | 2023-04-28 | 浙江吉利控股集团有限公司 | Camera sharing method, system, equipment and computer readable storage medium |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019206129A1 (en) | 2018-04-28 | 2019-10-31 | Oppo广东移动通信有限公司 | Data processing method, apparatus, electronic device, and computer-readable storage medium |
| CN110191266B (en) * | 2018-04-28 | 2021-08-31 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and computer readable storage medium |
| CN108924421B (en) * | 2018-07-16 | 2020-09-11 | Oppo广东移动通信有限公司 | Image processing method, image processing device, computer-readable storage medium and electronic equipment |
| CN110335303B (en) * | 2019-06-24 | 2021-10-26 | Oppo广东移动通信有限公司 | Image processing method and apparatus, and storage medium |
| CN113014782B (en) * | 2021-03-19 | 2022-11-01 | 展讯通信（上海）有限公司 | Image data processing method and device, camera equipment, terminal and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009262344A (en) * | 2008-04-22 | 2009-11-12 | Ricoh Co Ltd | Image formation device and image correcting method |
| CN105407610A (en) * | 2015-12-09 | 2016-03-16 | 深圳天珑无线科技有限公司 | Method and apparatus for controlling dual flash lamps |
| CN106331453A (en) * | 2016-08-24 | 2017-01-11 | 深圳奥比中光科技有限公司 | Multi-image acquisition system and image acquisition method |
| CN106973251A (en) * | 2017-03-23 | 2017-07-21 | 移康智能科技（上海）股份有限公司 | Image data transfer method and device |
| CN107105217A (en) * | 2017-04-17 | 2017-08-29 | 深圳奥比中光科技有限公司 | Multi-mode depth calculation processor and 3D rendering equipment |
| CN107341481A (en) * | 2017-07-12 | 2017-11-10 | 深圳奥比中光科技有限公司 | It is identified using structure light image |
| CN108696682B (en) * | 2018-04-28 | 2019-07-09 | Oppo广东移动通信有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622591B (en) * | 2012-01-12 | 2013-09-25 | 北京理工大学 | 3D (three-dimensional) human posture capturing and simulating system |
| US9462253B2 (en) * | 2013-09-23 | 2016-10-04 | Microsoft Technology Licensing, Llc | Optical modules that reduce speckle contrast and diffraction artifacts |
| CN103971405A (en) * | 2014-05-06 | 2014-08-06 | 重庆大学 | Method for three-dimensional reconstruction of laser speckle structured light and depth information |
| CN106851927B (en) * | 2017-04-19 | 2018-06-12 | 慈溪锐恩电子科技有限公司 | A kind of multichannel light modulation toning LED drive circuit of speech recognition |
| CN107944422B (en) * | 2017-12-08 | 2020-05-12 | 业成科技（成都）有限公司 | Three-dimensional camera device, three-dimensional camera method and face recognition method |
| CN108573170B (en) * | 2018-04-12 | 2020-06-12 | Oppo广东移动通信有限公司 | Information processing method and device, electronic equipment and computer readable storage medium |
| CN108564032B (en) * | 2018-04-12 | 2020-05-22 | Oppo广东移动通信有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
-
2018
- 2018-04-28 CN CN201910492085.2A patent/CN110191266B/en active Active
- 2018-04-28 CN CN201810402999.0A patent/CN108696682B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009262344A (en) * | 2008-04-22 | 2009-11-12 | Ricoh Co Ltd | Image formation device and image correcting method |
| CN105407610A (en) * | 2015-12-09 | 2016-03-16 | 深圳天珑无线科技有限公司 | Method and apparatus for controlling dual flash lamps |
| CN106331453A (en) * | 2016-08-24 | 2017-01-11 | 深圳奥比中光科技有限公司 | Multi-image acquisition system and image acquisition method |
| CN106973251A (en) * | 2017-03-23 | 2017-07-21 | 移康智能科技（上海）股份有限公司 | Image data transfer method and device |
| CN107105217A (en) * | 2017-04-17 | 2017-08-29 | 深圳奥比中光科技有限公司 | Multi-mode depth calculation processor and 3D rendering equipment |
| CN107341481A (en) * | 2017-07-12 | 2017-11-10 | 深圳奥比中光科技有限公司 | It is identified using structure light image |
| CN108696682B (en) * | 2018-04-28 | 2019-07-09 | Oppo广东移动通信有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116033265A (en) * | 2023-01-04 | 2023-04-28 | 浙江吉利控股集团有限公司 | Camera sharing method, system, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108696682A (en) | 2018-10-23 |
| CN110191266B (en) | 2021-08-31 |
| CN108696682B (en) | 2019-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108696682B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN108419017B (en) | Control method, apparatus, electronic equipment and the computer readable storage medium of shooting | |
| CN108549867A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108769509A (en) | Control method, apparatus, electronic equipment and the storage medium of camera | |
| CN106529512B (en) | Living body faces verification method and device | |
| CN109040591B (en) | Image processing method, image processing device, computer-readable storage medium and electronic equipment | |
| CN108805024A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108833887A (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN108804895A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108650472A (en) | Control method, apparatus, electronic equipment and the computer readable storage medium of shooting | |
| CN108322646A (en) | Image processing method, device, storage medium and electronic equipment | |
| TWI709110B (en) | Camera calibration method and apparatus, electronic device | |
| CN108573170A (en) | Information processing method and device, electronic equipment, computer readable storage medium | |
| IL302172B1 (en) | Depth sensing techniques for virtual, augmented, and mixed reality systems | |
| CN109040746B (en) | Camera calibration method and apparatus, electronic equipment, computer readable storage medium | |
| CN108564032A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN109146906A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN108921903A (en) | Camera calibration method, device, computer readable storage medium and electronic equipment | |
| CN109151303A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN104155839B (en) | System and method for providing 3 d image | |
| CN114898447B (en) | Personalized fixation point detection method and device based on self-attention mechanism | |
| CN108810516A (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN108924421A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN108965716A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN108986153A (en) | Image processing method and device, electronic equipment, computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |