CN107820005B - Image processing method, device and electronic device - Google Patents
Image processing method, device and electronic device Download PDFInfo
- Publication number
- CN107820005B CN107820005B CN201711020139.2A CN201711020139A CN107820005B CN 107820005 B CN107820005 B CN 107820005B CN 201711020139 A CN201711020139 A CN 201711020139A CN 107820005 B CN107820005 B CN 107820005B
- Authority
- CN
- China
- Prior art keywords
- image
- active user
- structured light
- emission parameter
- structure light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 32
- 238000000034 method Methods 0.000 claims abstract description 22
- 230000001815 facial effect Effects 0.000 claims description 46
- 238000012545 processing Methods 0.000 claims description 26
- 238000013475 authorization Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims 1
- 238000003384 imaging method Methods 0.000 description 18
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 11
- 230000003287 optical effect Effects 0.000 description 10
- 230000014509 gene expression Effects 0.000 description 8
- 206010037660 Pyrexia Diseases 0.000 description 4
- 210000000056 organ Anatomy 0.000 description 3
- 238000005314 correlation function Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The present invention proposes a kind of image processing method, device and electronic device, wherein the method is used for electronic device, and the electronic device includes structured light device and image acquisition device, which comprises obtains the emission parameter of structured light device；Number of the structured light device to active user's projective structure light is determined according to the emission parameter；The structured light device is controlled according to the number, continuously to active user projection and the matched structure light of the emission parameter；Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains target image.By this method, instantaneous power consumption when mobile terminal is shot can reduce, solve the big technical problem of instantaneous power consumption in the prior art.
Description
Technical field
The present invention relates to technical field of mobile terminals more particularly to a kind of image processing methods, device and electronic device.
Background technique
With the development of mobile terminal technology, structured light technique is gradually applied in mobile terminal.However, existing adopt
The mobile terminal taken pictures with structured light technique, when being taken pictures, all light source points of structure light are projected to bat simultaneously
It takes the photograph on object, causes the instantaneous power consumption of mobile terminal larger, fever phenomenon is obvious.
Summary of the invention
The embodiment provides a kind of image processing method, device and electronic device, with reduce mobile terminal into
Instantaneous power consumption when row shooting, solves the big technical problem of instantaneous power consumption in the prior art.
The image processing method of embodiment of the present invention is used for electronic device, and the electronic device includes structured light device
And image acquisition device, described image processing method include:
Obtain the emission parameter of structured light device；
Number of the structured light device to active user's projective structure light is determined according to the emission parameter；
The transmitter is controlled according to the number, is continuously projected to the active user matched with the emission parameter
Structure light；
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains
To target image.
The image processing apparatus of embodiment of the present invention, is used for electronic device, and described image processing unit includes:
Structured light device is used for active user's emitting structural light；
Image acquisition device, for shooting the structure light image modulated through the active user；
Processor, the processor are used for:
Obtain the emission parameter of the structured light device；
Number of the structured light device to active user's projective structure light is determined according to the emission parameter；
The transmitter is controlled according to the number, is continuously projected to the active user matched with the emission parameter
Structure light；
Control described image collector shoots the structure light image modulated every time through the active user and carries out image and folds
Add, obtains target image.
The electronic device of embodiment of the present invention includes: one or more processors, memory and one or more program,
Wherein one or more of programs are stored in the memory, and are configured to by one or more of processors
It executes, described program includes the instruction for executing image processing method described in above embodiment.
The computer readable storage medium of embodiment of the present invention, including what is be used in combination with the electronic device that can be imaged
Computer program, the computer program can be executed by processor to complete image processing method described in above embodiment.
Image processing method, device and the electronic device of embodiment of the present invention, by the hair for obtaining structured light device
Penetrate parameter, number of the structured light device to active user's projective structure light determined according to emission parameter, control transmitter according to
Identified number is continuously to active user's projection and the matched structure light of emission parameter, each warp of control image acquisition device shooting
The structure light image of active user's modulation simultaneously carries out image superposition and then obtains target image.In the present embodiment, control when shooting
Structured light device processed can not only make to project every time according to the rule of setting by way of multiple emitting portion structure light
Structure light be unlikely to excessively, so as to which instantaneous power consumption when shooting is effectively reduced, to be conducive to radiate, mobile terminal is avoided to go out
Now apparent fever phenomenon.And since all light source points can be covered by way of repeatedly projecting, enable to shoot
The imaging of object is complete, guarantees image quality.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partially become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram for the image processing method that one embodiment of the invention proposes；
Fig. 2 is a kind of flow diagram of the method for acquisition emission parameter that the embodiment of the present invention proposes；
Fig. 3 is the flow diagram for the image processing method that another embodiment of the present invention proposes；
Fig. 4 is the array of source schematic diagram of evenly arranged light source dot matrix composition；
Fig. 5 is the structural schematic diagram for the image processing apparatus that one embodiment of the invention proposes；
Fig. 6 is the structural schematic diagram for the electronic device that one embodiment of the invention proposes；And
Fig. 7 is the structural schematic diagram of the image processing circuit in the terminal that one embodiment of the invention proposes.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to is used to explain the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings the image processing method, device and electronic device of the embodiment of the present invention are described.
Fig. 1 is the flow diagram for the image processing method that one embodiment of the invention proposes, this method can be used for electronics
In device, which can be the mobile terminals such as mobile phone, tablet computer.The electronic device includes structured light device and figure
As collector, wherein structured light device is used for reference object projective structure light, and image acquisition device is for shooting through shooting pair
As modulated structure light image.
As shown in Figure 1, the image processing method the following steps are included:
Step 101, the emission parameter of structured light device is obtained.
Currently, the function of mobile terminal is also more and more abundant with the development of mobile terminal technology, face identification functions by
Gradually become the standard configuration of mobile terminal.For example, more and more mobile terminals support face unlock, face payment etc..When with
When family is using the correlation function for needing to carry out recognition of face, after correlation function is opened, mobile terminal call built-in camera into
Row Image Acquisition.In the present embodiment, before the image of acquisition active user, mobile terminal first obtains built-in structured light
The emission parameter of device.
Structured light device is used for subject projective structure light, wherein the set of projections of known spatial direction light beam
It is collectively referred to as structure light (structured light).In the present embodiment, the type of structure light can be grating type, spot type, spot
Any one in line type (including round speckle and cross speckle), speckle pattern heterogeneous etc..
It should be noted that obtaining the specific implementation of the emission parameter of structured light device will give in subsequent content
Out, it to avoid repeating, is not described in detail herein.
Step 102, number of the structured light device to active user's projective structure light is determined according to emission parameter.
It, can further according to hair after the acquisition for mobile terminal emission parameter of structure optical transmitting set in the present embodiment
It penetrates parameter and determines number of the structured light device to active user's projective structure light.
Wherein, emission parameter generally uses fraction representation, for the determination process of the number of simplified projective structure light, can will send out
The denominator for penetrating parameter is determined as number of the structured light device to active user's projective structure light.For example, structured light device
Emission parameter is 1/3, then can determine structured light device to the number of active user's projective structure light be 3 times.
Herein it should be noted that the denominator of emission parameter is determined as structured light device to active user's projective structure
The number of light is only as an example, cannot function as limitation of the present invention.It, can also be by point of emission parameter in the embodiment of the present invention
Female integral multiple is determined as the number of structured light device projective structure light, for example emission parameter is 1/2, then structured light device
The number of projective structure light can be 2 times, 4 times, 6 inferior, the invention is not limited in this regard.
Step 103, control transmitter is according to number, continuously to active user's projection and the matched structure light of emission parameter.
Structured light device is determined to after the number of active user's projective structure light, mobile terminal can control structure
Optical transmitting set continuously projects and the matched structure of emission parameter to active user according to the number of identified projective structure light
Light.
As an example, it is assumed that emission parameter 1/3, the structured light device projective structure determined according to emission parameter
The number of light is 3 times.Then mobile terminal control structure optical transmitting set continuously projects 3 structure lights to active user, projects every time
The quantity of structure light is the 1/3 of structure light total quantity.
As another example, it is assumed that emission parameter 1/3 determines structured light device projective structure according to emission parameter
The number of light is 6 times.Then mobile terminal control structure optical transmitting set continuously projects 6 structure lights to active user, projects every time
The quantity of structure light is the 1/6 of structure light total quantity.
Step 104, control image acquisition device shoots the structure light image every time through active user's modulation and carries out image and folds
Add, obtains target image.
For structured light device every time to after active user's projective structure light, structure light reaches active user, and reaches
It changes after active user because of the modulation of active user, at this point, mobile terminal control image acquisition device shooting is currently used
The structure light image of family modulation.After each projective structure light of structured light device, image acquisition device shoots corresponding structure light
Image, and after the completion of last time is shot, resulting structure light image is overlapped, target image is obtained.
As an example, it is assumed that the number of the structured light device projective structure light determined according to emission parameter is 3 times,
Then for structured light device after first time projects the structure light of 1/3 quantity to active user, mobile terminal controls Image Acquisition
Device carries out first time shooting, obtains first structure light image；Structured light device projects 1/3 quantity to active user for the second time
Structure light, mobile terminal, which controls image acquisition device, to carry out second and shoots, and obtains second structure light image；Structured light
Device third time projects the structure light of remaining 1/3 quantity to active user, and mobile terminal controls image acquisition device and carries out third time
Shooting, obtains the third structure light image.In turn, resulting three structure light images are subjected to image superposition, obtain target figure
Picture.
It further, can will be pre- in the facial image and mobile terminal in target image after obtaining target image
The facial image first stored is matched, and is unlocked when fitting through to mobile terminal, or complete e-payment etc..
The image processing method of the present embodiment, it is true according to emission parameter by obtaining the emission parameter of structured light device
Determine number of the structured light device to active user's projective structure light, control transmitter is according to identified number continuously to current
User's projection and the matched structure light of emission parameter, the structure light figure that control image acquisition device shooting is modulated through active user every time
Picture simultaneously carries out image superposition and then obtains target image.In the present embodiment, control structure optical transmitting set is according to setting when shooting
Rule not only the structure light projected every time can be made to be unlikely to excessively by way of multiple emitting portion structure light, thus
It can be effectively reduced instantaneous power consumption when shooting, be conducive to radiate, mobile terminal is avoided apparent fever phenomenon occur.And by
In by way of repeatedly projecting, all light source points can be covered, enable to the imaging of reference object complete, guarantee imaging
Quality.
In order to clearly describe the specific implementation of the emission parameter of acquisition structured light device in above-described embodiment
Journey, the present invention provides the possibility implementations that two kinds obtain emission parameter.
As one of possible implementation, structure light can be determined according to the emission density of structured light device
The emission parameter of transmitter, Fig. 2 are a kind of flow diagram of the method for acquisition emission parameter that the embodiment of the present invention proposes.
As shown in Fig. 2, step 101 may comprise steps of on the basis of embodiment as shown in Figure 1:
Step 201, emission density of the structured light device on unit area is obtained.
Specifically, when obtaining the emission density of structured light device, light source battle array in structured light device can first be obtained
The area of column, and then according to the number of the area of acquired array of source and array of source mid-infrared light source, obtain structure light
The number of infrared light supply on the unit area of transmitter, the number of infrared light supply on resulting unit area is close as emitting
Degree.
As an example, for same type of structured light device, the array of source of the structured light device
The number of area and array of source mid-infrared light source be it is fixed, mobile terminal production when, can be by used structure light
The number of the area of the array of source of transmitter and array of source mid-infrared light source save in a memory in the mobile terminal,
When needing to obtain the emission parameter of structured light device, can directly it be obtained from the memory of mobile terminal.It in turn, will be infrared
The number of light source and the area of array of source do ratio, and resulting result is the emission density of structured light device.
Step 202, emission parameter is determined according to emission density.
In the present embodiment, after emission density has been determined, structured light further can be determined according to emission density
The emission parameter of device.
Specifically, emission density and preset numerical value can be done into ratio, obtains emission parameter.
Wherein, preset numerical value can be can choose one fixed numerical value of setting by user setting, user, can also be selected
It selects and presets a numerical value in each shooting.In general, preset numerical value is greater than emission density, thus, structure light hair
The emission parameter of emitter is score.Preferably, preset numerical value is the integral multiple of emission density.
As an example, can one selection switch of setting in the parameter setting option of camera in the terminal, such as
Setting " emission parameter dynamic adjusts " switch, the switch are defaulted as opening.When user selects to close the switch, then closed in user
After closing the switch, pop-up is shown in the display interface of mobile terminal, to remind user to input a certain numerical value as preset number
Value, in the state that the switch is in and closes, the emission parameter of structured light device is now uniquely determined, and user is subsequent to take pictures
During no longer need to that preset numerical value is arranged.When user selects to open the switch, then when camera starts every time, mobile terminal
After backstage obtains the emission density of structured light device, pop-up is shown in the display interface of mobile terminal, to remind use
Family inputs a certain numerical value as preset numerical value.Preferably, in order to avoid the undesirable and practical feelings of numerical value of user's input
Condition, for example, user input numerical value be 0 when do not meet division arithmetic rule, remind user input numerical value when, can be to user
Show several alternative numerical value, for therefrom select one as preset numerical value.
The image processing method of the present embodiment, by obtaining emission density of the structured light device on unit area, root
Emission parameter is determined according to emission density, when determining emission parameter, emission density is done into ratio with preset numerical value and is emitted
Parameter, due to preset numerical value can be different by user setting numerical value, to obtain different emission parameters, and then realize spirit
The number of adjustment structured light device projective structure light living, promotes user experience.
It, can be according to the region division of the array of source of structured light device as wherein alternatively possible implementation
Determine emission parameter, thus, the embodiment of the present invention proposes another image processing method, and Fig. 3 is another embodiment of the present invention
The flow diagram of the image processing method of proposition.
As shown in figure 3, the image processing method may comprise steps of:
Step 301, region is carried out to array of source in structured light device to divide equally.
In the present embodiment, before carrying out Image Acquisition, array of source that mobile terminal can first to structured light device
It carries out region to divide equally, array of source is averagely divided into several regions.
Wherein, a preset default can be arranged by research staff before mobile terminal dispatches from the factory in the number in divided region
Value, and can be set and it is adjusted by user.
As an example, can one switch of setting in the parameter setting option of camera in the terminal, for example be arranged
One " areal setting " switch, the default conditions of the switch are to close.When the switch is in close state, mobile terminal
Region is carried out to the array of source of structured light device according to the default value of number to divide equally；After user opens the switch, in phase
When machine starts every time, display reminding information in the display interface of mobile terminal, to remind user input area number, user setting
After areal, number that mobile terminal is this time arranged according to user carries out area to the array of source in structured light device
Domain is divided equally.
For example, Fig. 4 is the array of source schematic diagram of evenly arranged light source dot matrix composition.As shown in figure 4, the light source
Array is made of 8*8 light source point, it is assumed that each column in the array of source are numbered according to sequence from left to right, successively
Arranged for the 1st column, the 2nd ..., the 8th column；Every a line in the array of source is numbered in accordance with the order from top to bottom, is followed successively by
1st row, the 2nd row ..., eighth row.Assuming that the areal of setting is 4, then can according to sequence from left to right, by the 1st column and
2nd column are divided into the same region, and the 3rd column and the 4th column are divided into the same region, the 5th column and the 6th column are divided into same
A region, and the 7th column and the 8th column are divided into the same region；Alternatively, can also in accordance with the order from top to bottom, by the 1st
Capable and the 2nd row is divided into the same region, and the 3rd row and the 4th row are divided into the same region, the 5th row and the 6th row are divided into
7th row and eighth row are divided into the same region by the same region.
Step 302, emission parameter is determined according to the number in region.
As an example, can using the number in the region divided as the emission parameter of structured light device, at this point,
Emission parameter is positive integer.For example, array of source is divided evenly as 4 regions, then emission parameter is 4.
As another example, can join the inverse of the number in the region divided as the transmitting of structured light device
Number, at this point, emission parameter is score.For example, array of source is divided evenly as 5 regions, then emission parameter is 1/5.
Step 303, number of the structured light device to active user's projective structure light is determined according to emission parameter.
In the present embodiment, it is determined that, can be further true according to emission parameter after the emission parameter of structured light device
Determine number of the structured light device to active user's projective structure light.
As an example, when identified emission parameter be positive integer when, can using the integral multiple of emission parameter as
The number of projective structure light.For example, when emission parameter is 3, the number of projective structure light can for 3 times, 6 times, it is 9 inferior.
It can be by the integer of the denominator of emission parameter when identified emission parameter is score as another example
Number as projective structure light again.For example, the number of projective structure light can be 3 times, 6 times, 9 when emission parameter is 1/3
It is inferior.
Step 304, the sequence in the region of division is obtained.
Wherein, the sequence in the region of division include but is not limited to from left to right, and/or, from top to bottom.
Step 305, in sequence with number continuously to active user's projective structure light.
In the present embodiment, array of source carries out the equal timesharing in region in structured light device, and mobile terminal is available
The sequence of array of source is divided, for example, from left to right, from top to bottom, from right to left etc..In turn, mobile terminal can control knot
Structure optical transmitting set according to acquired sequence and projective structure light number, continuously to active user's projective structure light.
Step 306, control image acquisition device shoots the structure light image every time through active user's modulation and carries out image and folds
Add, obtains target image.
It should be noted that may refer in previous embodiment to the description of step 306 in the present embodiment to step 104
Description, realization principle is similar, and details are not described herein again.
Step 307, facial image is extracted from target image.
In the present embodiment, after the target image of acquisition, relevant face recognition technology can be used, from target image
Extract facial image.
Step 308, the authorization facial image stored in facial image and electronic device is matched.
Wherein, authorization facial image can be one or more images, can be the multiple and different of an authorized user
Image, is also possible to the multiple images of multiple and different authorized users, and authorization facial image can be pre-stored within electronic device
Memory in.
Step 309, if facial image is one authorized in facial image, electronic device is unlocked.
Authorization facial image pre-stored from the facial image and electronic device extracted in target image is carried out
Matching is unlocked electronic device if facial image is one authorized in facial image.
As an example, when multiple and different images that pre-stored authorization facial image is an authorized user
When, Expression Recognition can be carried out to the authorization facial image of extracted facial image and storage, by the consistent image of expression
It is identified as identical image.When extracted facial image is identical as the expression of one of authorization facial image of storage,
Electronic device is unlocked.
As another example, when the multiple images that authorization facial image is multiple and different authorized user, and electronics is filled
It, can be to extracted facial image and storage when storing an authorization facial image only for each authorized user in setting
It authorizes facial image to carry out face recognition, is identical image by the identical image recognition of face organ.When extracted face figure
When picture is identical as the face organ of one of authorization facial image of storage, electronic device is unlocked.
As another example, when the multiple images that authorization facial image is multiple and different authorized user, and electronics is filled
It sets when storing the authorization facial image of multiple and different expressions for each authorized user, can be known using face recognition and expression
The mode not combined, when face organ and the facial expression of extracted facial image are identical with the same authorization facial image
When, electronic device is unlocked.
The image processing method of the present embodiment is divided equally by carrying out region to array of source in structured light device, according to
The number in region determines emission parameter, and then determines structured light device to active user's projective structure light according to emission parameter
Number obtains the sequence in the region of division, controls Image Acquisition continuously to active user's projective structure light with number in sequence
Device shoots the structure light image every time through active user's modulation and carries out image superposition, obtains target image.Due to when shooting
The multiple projective structure light of control structure optical transmitting set, so that the structure light projected every time is unlikely to excessively, so as to effectively drop
Instantaneous power consumption when low shooting is conducive to radiate.After obtaining target image, facial image is extracted from target image, and
The authorization facial image stored in facial image and electronic device is matched, and electronic device is carried out in successful match
Unlock can be realized face unlock, the convenience of terminal unlocking improved while guaranteeing terminal security.
In order to realize above-described embodiment, the present invention also proposes a kind of image processing apparatus.
Fig. 5 is the structural schematic diagram for the image processing apparatus that one embodiment of the invention proposes, which is used for
In electronic device, which can be the mobile terminals such as mobile phone, tablet computer.
As shown in figure 5, the image processing apparatus 40 includes: structured light device 410, image acquisition device 420, and processing
Device 430.Wherein,
Structured light device 410 is used for active user's emitting structural light.
Image acquisition device 420, for shooting the structure light image modulated through active user.
Processor 430, processor 430 are used for:
Obtain the emission parameter of structured light device 410；
Number of the structured light device 410 to active user's projective structure light is determined according to emission parameter；
Control structure optical transmitting set 410 is according to number, continuously to active user's projection and the matched structure light of emission parameter；
Control image acquisition device 420 shoots the structure light image every time through active user's modulation and carries out image superposition, obtains
To target image.
The embodiment of the invention provides the methods of the emission parameter of two kinds of acquisition structured light devices.It can as one of which
The implementation of energy, emission density of the available structured light device 410 of processor 430 on unit area, according to transmitting
Density determines emission parameter.Specifically, in the available structured light device 410 of processor 430 array of source area, according to
The area of acquisition and the number of array of source mid-infrared light source obtain the infrared light on the unit area of structured light device 410
The number in source, using the number of infrared light supply on unit area as emission density.In turn, emission density and preset numerical value are done
Ratio obtains emission parameter.
As alternatively possible implementation, processor 430 can to the array of source in structured light device 410 into
Row region is divided equally, and determines emission parameter according to the number in region.At this point, processor 430 can also further obtain the area of division
The sequence in domain, according to acquired sequence and number continuously to active user's projective structure light.
Further, after processor 430 obtains target image, facial image can also be extracted from target image, it will
The authorization facial image stored in facial image and electronic device is matched, if facial image is in authorization facial image
One, then electronic device is unlocked.
It should be noted that the aforementioned image for being also applied for the embodiment to the explanation of image processing method embodiment
Processing unit, realization principle is similar, and details are not described herein again.
The image processing apparatus of the present embodiment, it is true according to emission parameter by obtaining the emission parameter of structured light device
Determine number of the structured light device to active user's projective structure light, control transmitter is according to identified number continuously to current
User's projection and the matched structure light of emission parameter, the structure light figure that control image acquisition device shooting is modulated through active user every time
Picture simultaneously carries out image superposition and then obtains target image.In the present embodiment, control structure optical transmitting set is according to setting when shooting
Rule not only the structure light projected every time can be made to be unlikely to excessively by way of multiple emitting portion structure light, thus
It can be effectively reduced instantaneous power consumption when shooting, be conducive to radiate, mobile terminal is avoided apparent fever phenomenon occur.And by
In by way of repeatedly projecting, all light source points can be covered, enable to the imaging of reference object complete, guarantee imaging
Quality.
In order to realize above-described embodiment, the present invention also proposes a kind of electronic device.
Fig. 6 is the structural schematic diagram for the electronic device that one embodiment of the invention proposes.As shown in fig. 6, the electronic device 50
It include: one or more processors 501, memory 502 and one or more programs 503.Wherein, one or more programs 503
It is stored in memory 502, and is configured to be executed by one or more processors 501, program 503 includes for executing
The instruction of image processing method described in aforementioned any embodiment.
The embodiment of the present invention also proposes a kind of terminal, including image processing circuit, and image processing circuit can use hardware
And/or component software is realized, it may include defines each of ISP (Image Signal Processing, image signal process) pipeline
Kind processing unit.Fig. 7 is the structural schematic diagram of the image processing circuit in the terminal that one embodiment of the invention proposes.For convenient for saying
It is bright, as shown in fig. 7, only showing the various aspects of image processing techniques relevant to the embodiment of the present invention.
As shown in fig. 7, image processing circuit 110 includes imaging device 1110, ISP processor 1130 and control logic device
1140.Imaging device 1110 may include camera and structure light with one or more lens 1112, imaging sensor 1114
Transmitter 1116.Structured light device 1116 is by structured light projection to measured object.Wherein, which can be laser strip
Line, Gray code, sine streak or, the speckle pattern etc. of random alignment.Imaging sensor 1114 captures projection to measured object shape
At structure light image, and structure light image is sent to ISP processor 1130, by ISP processor 1130 to structure light image
It carries out image superposition and obtains target image.Meanwhile imaging sensor 1114 also can capture the color information of measured object.Certainly,
The structure light image and color information of measured object can also be captured respectively by two imaging sensors 1114.
It, can quilt after the color information that ISP processor 1130 receives the measured object that imaging sensor 1114 captures
The corresponding image data of color information for surveying object is handled.ISP processor 1130 analyzes image data can with acquisition
For determining the image statistics of one or more control parameters of imaging device 1110.Imaging sensor 1114 may include color
Color filter array (such as Bayer filter), imaging sensor 1114 can be obtained is caught with each imaging pixel of imaging sensor 1114
The luminous intensity and wavelength information caught, and the one group of raw image data that can be handled by ISP processor 1130 is provided.
ISP processor 1130 handles raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processor 1130 can carry out raw image data at one or more images
Reason operation, image statistics of the collection about image data.Wherein, image processing operations can be by identical or different bit depth
Precision carries out.
ISP processor 1130 can also receive pixel data from video memory 1120.Video memory 1120 can be storage
Independent private memory in a part of device device, storage equipment or electronic equipment, and may include DMA (Direct
Memory Access, direct memory access (DMA)) feature.
When receiving raw image data, ISP processor 1130 can carry out one or more image processing operations.
The image data of target image can be transmitted to video memory 1120, to carry out other place before shown
Reason.ISP processor 1130 from video memory 1120 receive processing data, and to the processing data progress original domain in and
Image real time transfer in RGB and YCbCr color space.The image data of 3-D image may be output to display 1160, for
User watches and/or is further processed by graphics engine or GPU (Graphics Processing Unit, graphics processor).
In addition, the output of ISP processor 1130 also can be transmitted to video memory 1120, and display 1160 can be from video memory
1120 read image data.In one embodiment, video memory 1120 can be configured to realize one or more frame bufferings
Device.In addition, the output of ISP processor 1130 can be transmitted to encoder/decoder 1150, so as to encoding/decoding image data.It compiles
The image data of code can be saved, and decompress before being shown in 1160 equipment of display.Encoder/decoder 1150 can
It is realized by CPU or GPU or coprocessor.
The image statistics that ISP processor 1130 determines, which can be transmitted, gives control logic device Unit 1140.Control logic device
1140 may include the processor and/or microcontroller for executing one or more routines (such as firmware), and one or more routines can root
According to received image statistics, the control parameter of imaging device 1110 is determined.
With the image processing techniques in Fig. 7, above-mentioned image processing method can be realized.
In order to realize above-described embodiment, the present invention also proposes a kind of computer readable storage medium, including with can image
Electronic device 50 be used in combination computer program, the computer program can by processor 501 execute to complete aforementioned
Image processing method described in one embodiment.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present invention, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from
Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
The embodiment of the present invention is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as to limit of the invention
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of the invention
Type.
Claims (9)
1. a kind of image processing method, be used for electronic device, which is characterized in that the electronic device include structured light device and
Image acquisition device, which comprises
Region is carried out to array of source in the structured light device to divide equally；
Emission parameter is determined according to the number in the region, wherein the inverse of the number in the region is determined as the transmitting
Parameter, the emission parameter are score；
Determine that number of the structured light device to active user's projective structure light, the number are according to the emission parameter
The integral multiple of the denominator of the emission parameter；
The structured light device is controlled according to the number, continuously projects to the active user and is matched with the emission parameter
Structure light, wherein the structured light device every time to the quantity of active user's projective structure light be structure light sum
Amount
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains mesh
Logo image.
2. image processing method according to claim 1, which is characterized in that the control transmitter is according to described time
Number, continuously to active user projection and the matched structure light of the emission parameter, comprising:
Obtain the sequence in the region divided；
The structure light continuously is projected to the active user according to the sequence and the number.
3. image processing method according to claim 1, which is characterized in that it is described obtain target image after, further includes:
Facial image is extracted from the target image；
The authorization facial image stored in the facial image and the electronic device is matched；
If the facial image is one in the authorization facial image, the electronic device is unlocked.
4. a kind of image processing method, be used for electronic device, which is characterized in that the electronic device include structured light device and
Image acquisition device, which comprises
Obtain the area of array of source in the structured light device；
According to the number of the area and the array of source mid-infrared light source, the unit area of the structured light device is obtained
On the infrared light supply number；
The number of infrared light supply described on the unit area is determined as hair of the structured light device on unit area
Penetrate density；
The emission density and preset numerical value are done into ratio, obtain the emission parameter of the structured light device, wherein described
Preset numerical value is greater than the emission density and is the integral multiple of the emission density, and the emission parameter is score；
Determine that number of the structured light device to active user's projective structure light, the number are according to the emission parameter
The integral multiple of the denominator of the emission parameter；
The structured light device is controlled according to the number, continuously projects to the active user and is matched with the emission parameter
Structure light, wherein the structured light device every time to the quantity of active user's projective structure light be structure light sum
Amount
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains mesh
Logo image.
5. image processing method according to claim 4, which is characterized in that it is described obtain target image after, further includes:
Facial image is extracted from the target image；
The authorization facial image stored in the facial image and the electronic device is matched；
If the facial image is one in the authorization facial image, the electronic device is unlocked.
6. a kind of image processing apparatus is used for electronic device characterized by comprising
Structured light device is used for active user's emitting structural light；
Image acquisition device, for shooting the structure light image modulated through the active user；
Processor, the processor are used for:
Region is carried out to array of source in the structured light device to divide equally；
Emission parameter is determined according to the number in the region, wherein the inverse of the number in the region is determined as the transmitting
Parameter, the emission parameter are score；
Determine that number of the structured light device to active user's projective structure light, the number are according to the emission parameter
The integral multiple of the denominator of the emission parameter；
The structured light device is controlled according to the number, continuously projects to the active user and is matched with the emission parameter
Structure light, wherein the structured light device every time to the quantity of active user's projective structure light be structure light sum
Amount
Control described image collector shoots the structure light image modulated every time through the active user and carries out image superposition, obtains
To target image.
7. a kind of image processing apparatus is used for electronic device characterized by comprising
Structured light device is used for active user's emitting structural light；
Image acquisition device, for shooting the structure light image modulated through the active user；
Processor, the processor are used for:
Obtain the area of array of source in the structured light device；
According to the number of the area and the array of source mid-infrared light source, the unit area of the structured light device is obtained
On the infrared light supply number；
The number of infrared light supply described on the unit area is determined as hair of the structured light device on unit area
Penetrate density；
The emission density and preset numerical value are done into ratio, obtain the emission parameter of the structured light device, wherein described
Preset numerical value is greater than the emission density and is the integral multiple of the emission density, and the emission parameter is score；
Determine that number of the structured light device to active user's projective structure light, the number are according to the emission parameter
The integral multiple of the denominator of the emission parameter；
The structured light device is controlled according to the number, continuously projects to the active user and is matched with the emission parameter
Structure light, wherein the structured light device every time to the quantity of active user's projective structure light be structure light sum
Amount
Control described image collector shoots the structure light image modulated every time through the active user and carries out image superposition, obtains
To target image.
8. a kind of electronic device, which is characterized in that the electronic device includes:
One or more processors；
Memory；With
One or more programs, wherein one or more of programs are stored in the memory, and be configured to by
One or more of processors execute, and described program includes requiring at image described in 1 to 3 any one for perform claim
Reason method or the instruction that image processing method described in 4-5 any one is required for perform claim.
9. a kind of computer readable storage medium, which is characterized in that including the meter being used in combination with the electronic device that can be imaged
Calculation machine program, the computer program can be executed by processor to complete image procossing described in claims 1 to 3 any one
Method requires image processing method described in 4-5 any one for perform claim.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711020139.2A CN107820005B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device and electronic device |
| PCT/CN2018/112156 WO2019080934A1 (en) | 2017-10-27 | 2018-10-26 | Image processing method and device as well as electronic device |
| EP18871067.7A EP3697078B1 (en) | 2017-10-27 | 2018-10-26 | Image processing method and device as well as electronic device |
| US16/856,526 US11315268B2 (en) | 2017-10-27 | 2020-04-23 | Image processing methods, image processing apparatuses and electronic devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711020139.2A CN107820005B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107820005A CN107820005A (en) | 2018-03-20 |
| CN107820005B true CN107820005B (en) | 2019-09-17 |
Family
ID=61604042
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711020139.2A Expired - Fee Related CN107820005B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107820005B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019080934A1 (en) | 2017-10-27 | 2019-05-02 | Oppo广东移动通信有限公司 | Image processing method and device as well as electronic device |
| CN109005371B (en) * | 2018-07-27 | 2020-04-03 | Oppo广东移动通信有限公司 | Control system and electronic device for structured light projector |
| WO2020019704A1 (en) | 2018-07-27 | 2020-01-30 | Oppo广东移动通信有限公司 | Control system of structured light projector, and electronic device |
| WO2021258294A1 (en) * | 2020-06-23 | 2021-12-30 | Oppo广东移动通信有限公司 | Electronic device, unlocking method and apparatus, and storage medium |
| CN112633181B (en) * | 2020-12-25 | 2022-08-12 | 北京嘀嘀无限科技发展有限公司 | Data processing method, system, device, equipment and medium |
| CN113221635A (en) * | 2021-03-29 | 2021-08-06 | 追创科技(苏州)有限公司 | Structured light module and autonomous mobile device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102760234A (en) * | 2011-04-14 | 2012-10-31 | 财团法人工业技术研究院 | Depth image acquisition device, system and method |
| CN102780845A (en) * | 2012-06-14 | 2012-11-14 | 清华大学 | Light source alternate strobe synchronous camera shooting method and vision detection system |
| CN104639843A (en) * | 2014-12-31 | 2015-05-20 | 小米科技有限责任公司 | Method and device for processing image |
| CN106796107A (en) * | 2014-08-10 | 2017-05-31 | 脸谱公司 | For the structure light of 3D sensings |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5858744B2 (en) * | 2011-11-21 | 2016-02-10 | キヤノン株式会社 | Imaging apparatus and camera system |
-
2017
- 2017-10-27 CN CN201711020139.2A patent/CN107820005B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102760234A (en) * | 2011-04-14 | 2012-10-31 | 财团法人工业技术研究院 | Depth image acquisition device, system and method |
| CN102780845A (en) * | 2012-06-14 | 2012-11-14 | 清华大学 | Light source alternate strobe synchronous camera shooting method and vision detection system |
| CN106796107A (en) * | 2014-08-10 | 2017-05-31 | 脸谱公司 | For the structure light of 3D sensings |
| CN104639843A (en) * | 2014-12-31 | 2015-05-20 | 小米科技有限责任公司 | Method and device for processing image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107820005A (en) | 2018-03-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107820005B (en) | Image processing method, device and electronic device | |
| CN107682607B (en) | Image acquiring method, device, mobile terminal and storage medium | |
| CN107479801A (en) | Displaying method of terminal, device and terminal based on user's expression | |
| CN108764180A (en) | Face identification method, device, electronic equipment and readable storage medium storing program for executing | |
| CN107730445A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN107277053A (en) | Auth method, device and mobile terminal | |
| CN107808136A (en) | Image processing method, device, readable storage medium storing program for executing and computer equipment | |
| CN107480613A (en) | Face identification method, device, mobile terminal and computer-readable recording medium | |
| CN107395974B (en) | Image processing system and method | |
| CN109068058A (en) | Filming control method, device and electronic equipment under super night scene mode | |
| CN107481304A (en) | The method and its device of virtual image are built in scene of game | |
| CN108846807A (en) | Light efficiency processing method, device, terminal and computer readable storage medium | |
| CN107483845B (en) | Photographic method and its device | |
| CN107864337A (en) | Sketch image processing method, device and equipment | |
| CN108876709A (en) | Method for beautifying faces, device, electronic equipment and readable storage medium storing program for executing | |
| CN107551549A (en) | Video game image method of adjustment and its device | |
| CN107483428A (en) | Auth method, device and terminal device | |
| CN107564050A (en) | Control method, device and terminal device based on structure light | |
| CN108810406A (en) | Portrait light efficiency processing method, device, terminal and computer readable storage medium | |
| CN110798619B (en) | Image processing method and device and electronic device | |
| CN107493411B (en) | Image processing system and method | |
| CN107396079B (en) | White balance adjustment method and device | |
| CN107481318A (en) | Replacement method, device and the terminal device of user's head portrait | |
| CN107656611A (en) | Somatic sensation television game implementation method and device, terminal device | |
| CN107438161A (en) | Shooting picture processing method, device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190917 |