CN107820005A - Image processing method, device and electronic installation - Google Patents
Image processing method, device and electronic installation Download PDFInfo
- Publication number
- CN107820005A CN107820005A CN201711020139.2A CN201711020139A CN107820005A CN 107820005 A CN107820005 A CN 107820005A CN 201711020139 A CN201711020139 A CN 201711020139A CN 107820005 A CN107820005 A CN 107820005A
- Authority
- CN
- China
- Prior art keywords
- image
- structured light
- active user
- light device
- electronic installation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000009434 installation Methods 0.000 title claims abstract description 44
- 238000003672 processing method Methods 0.000 title claims abstract description 31
- 238000003384 imaging method Methods 0.000 claims abstract description 29
- 238000000034 method Methods 0.000 claims abstract description 23
- 230000001815 facial effect Effects 0.000 claims description 41
- 238000012545 processing Methods 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 5
- 241000208340 Araliaceae Species 0.000 claims 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 2
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 2
- 235000008434 ginseng Nutrition 0.000 claims 2
- 238000004364 calculation method Methods 0.000 claims 1
- 230000006870 function Effects 0.000 description 11
- 230000003287 optical effect Effects 0.000 description 8
- 230000014509 gene expression Effects 0.000 description 6
- 206010037660 Pyrexia Diseases 0.000 description 4
- 210000000056 organ Anatomy 0.000 description 3
- 238000005314 correlation function Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000000149 penetrating effect Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000013316 zoning Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The present invention proposes a kind of image processing method, device and electronic installation, wherein, methods described is used for electronic installation, and the electronic installation includes structured light device and image acquisition device, and methods described includes：Obtain the emission parameter of structured light device；Number of the structured light device to active user's projective structure light is determined according to the emission parameter；The structured light device is controlled according to the number, the structure light continuously matched to active user projection with the emission parameter；Control image acquisition device shoots the structure light image every time through active user modulation and carries out imaging importing, obtains target image.By this method, instantaneous power consumption when mobile terminal is shot can be reduced, solves the big technical problem of instantaneous power consumption in the prior art.
Description
Technical field
The present invention relates to technical field of mobile terminals, more particularly to a kind of image processing method, device and electronic installation.
Background technology
With the development of mobile terminal technology, structured light technique is gradually applied in mobile terminal.However, existing adopt
The mobile terminal taken pictures with structured light technique, when being taken pictures, all light source points of structure light are projected to bat simultaneously
Take the photograph on object, cause that the instantaneous power consumption of mobile terminal is larger, and fever phenomenon is obvious.
The content of the invention
The embodiment provides a kind of image processing method, device and electronic installation, is entered with reducing mobile terminal
Instantaneous power consumption during row shooting, solves the big technical problem of instantaneous power consumption in the prior art.
The image processing method of embodiment of the present invention is used for electronic installation, and the electronic installation includes structured light device
And image acquisition device, described image processing method include：
Obtain the emission parameter of structured light device；
Number of the structured light device to active user's projective structure light is determined according to the emission parameter；
The transmitter is controlled continuously to be matched according to the number to active user projection with the emission parameter
Structure light；
Control image acquisition device shoots the structure light image every time through active user modulation and carries out imaging importing, obtains
To target image.
The image processing apparatus of embodiment of the present invention, for electronic installation, described image processing unit includes：
Structured light device, for active user's emitting structural light；
Image acquisition device, for shooting the structure light image modulated through the active user；
Processor, the processor are used for：
Obtain the emission parameter of the structured light device；
Number of the structured light device to active user's projective structure light is determined according to the emission parameter；
The transmitter is controlled continuously to be matched according to the number to active user projection with the emission parameter
Structure light；
Control described image collector shoots the structure light image every time through active user modulation and carries out image and folds
Add, obtain target image.
The electronic installation of embodiment of the present invention includes：One or more processors, memory and one or more programs,
Wherein one or more of programs are stored in the memory, and are configured to by one or more of processors
Perform, described program includes being used for the instruction for performing the image processing method described in above-mentioned embodiment.
The computer-readable recording medium of embodiment of the present invention, including electronic installation with that can image are used in combination
Computer program, the computer program can be executed by processor to complete the image processing method described in above-mentioned embodiment.
Image processing method, device and the electronic installation of embodiment of the present invention, by the hair for obtaining structured light device
Penetrate parameter, structured light device determined to the number of active user's projective structure light according to emission parameter, control transmitter according to
The structure light that identified number continuously matches to active user's projection with emission parameter, control image acquisition device shooting pass through every time
The structure light image of active user's modulation simultaneously carries out imaging importing and then obtains target image.In the present embodiment, in shooting time control
Structured light device processed by way of multiple emitting portion structure light, can not only make to project every time according to the rule of setting
Structure light be unlikely to excessive, so as to effectively reduce instantaneous power consumption during shooting, be advantageous to radiate, avoid mobile terminal from going out
Now obvious fever phenomenon.And due to by way of repeatedly projecting, all light source points can be covered, enable to shoot
The imaging of object is complete, ensures image quality.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet for the image processing method that one embodiment of the invention proposes；
Fig. 2 is a kind of schematic flow sheet of the method for acquisition emission parameter that the embodiment of the present invention proposes；
Fig. 3 is the schematic flow sheet for the image processing method that another embodiment of the present invention proposes；
Fig. 4 is the array of source schematic diagram for the light source dot matrix composition uniformly arranged；
Fig. 5 is the structural representation for the image processing apparatus that one embodiment of the invention proposes；
Fig. 6 is the structural representation for the electronic installation that one embodiment of the invention proposes；And
Fig. 7 is the structural representation of the image processing circuit in the terminal that one embodiment of the invention proposes.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings the image processing method, device and electronic installation of the embodiment of the present invention are described.
Fig. 1 is the schematic flow sheet for the image processing method that one embodiment of the invention proposes, this method can be used for electronics
In device, the electronic installation can be the mobile terminals such as mobile phone, tablet personal computer.The electronic installation includes structured light device and figure
As collector, wherein, structured light device is used for reference object projective structure light, and image acquisition device is used to shoot through shooting pair
As the structure light image after modulation.
As shown in figure 1, the image processing method comprises the following steps：
Step 101, the emission parameter of structured light device is obtained.
At present, with the development of mobile terminal technology, the function of mobile terminal is also increasingly abundanter, face identification functions by
Gradually turn into the standard configuration of mobile terminal.For example increasing mobile terminal supports face unblock, face payment etc..When with
When family is using needing to carry out the correlation function of recognition of face, after correlation function is opened, mobile terminal calls built-in camera to enter
Row IMAQ.In the present embodiment, before the image of collection active user, mobile terminal first obtains built-in structured light
The emission parameter of device.
Structured light device is used for subject projective structure light, it is known that the set of projections of direction in space light beam
It is collectively referred to as structure light (structured light).In the present embodiment, the type of structure light can be grating type, spot type, spot
Any one in line type (including circular speckle and cross speckle), speckle pattern heterogeneous etc..
It should be noted that obtaining the specific implementation of the emission parameter of structured light device will give in subsequent content
Go out, to avoid repeating, be not described in detail herein.
Step 102, determine structured light device to the number of active user's projective structure light according to emission parameter.
, can further according to hair after the acquisition for mobile terminal emission parameter of structure optical transmitting set in the present embodiment
Penetrating parameter determines structured light device to the number of active user's projective structure light.
Wherein, emission parameter typically uses fraction representation, to simplify the determination process of the number of projective structure light, will can send out
The denominator for penetrating parameter is defined as structured light device to the number of active user's projective structure light.Such as structured light device
Emission parameter is 1/3, then can determine number from structured light device to active user's projective structure light be 3 times.
Herein it should be noted that the denominator of emission parameter is defined as into structured light device to active user's projective structure
The number of light is only as an example, cannot function as limitation of the present invention., can also be by point of emission parameter in the embodiment of the present invention
Female integral multiple is defined as the number of structured light device projective structure light, for example emission parameter is 1/2, then structured light device
The number of projective structure light can be 2 times, 4 times, 6 inferior, the invention is not limited in this regard.
Step 103, control transmitter is according to number, the structure light continuously matched to active user's projection with emission parameter.
Structured light device is determined to after the number of active user's projective structure light, mobile terminal can be with control structure
Optical transmitting set is according to the number of identified projective structure light, the structure continuously matched to active user's projection with emission parameter
Light.
As a kind of example, it is assumed that emission parameter 1/3, the structured light device projective structure determined according to emission parameter
The number of light is 3 times.Then mobile terminal control structure optical transmitting set continuously projects 3 structure lights to active user, every time projection
The quantity of structure light is the 1/3 of structure light total quantity.
As another example, it is assumed that emission parameter 1/3, structured light device projective structure is determined according to emission parameter
The number of light is 6 times.Then mobile terminal control structure optical transmitting set continuously projects 6 structure lights to active user, every time projection
The quantity of structure light is the 1/6 of structure light total quantity.
Step 104, control the structure light image that image acquisition device shooting is modulated through active user every time and carry out image and fold
Add, obtain target image.
For structured light device every time to after active user's projective structure light, structure light reaches active user, and reaches
Changed after active user because of the modulation of active user, now, mobile terminal control image acquisition device shooting is used through current
The structure light image of family modulation.After each projective structure light of structured light device, structure light corresponding to image acquisition device shooting
Image, and after the completion of last time is shot, the structure light image of gained is overlapped, obtains target image.
As a kind of example, it is assumed that the number of the structured light device projective structure light determined according to emission parameter is 3 times,
Then structured light device is after first time projects the structure light of 1/3 quantity to active user, mobile terminal control IMAQ
Device carries out first time shooting, obtains first structure light image；Structured light device projects 1/3 quantity to active user for the second time
Structure light, mobile terminal control image acquisition device carries out second and shoots, and obtains second structure light image；Structured light
Device third time projects the structure light of remaining 1/3 quantity to active user, and mobile terminal control image acquisition device carries out third time
Shooting, obtains the third structure light image.And then three structure light images of gained are subjected to imaging importing, obtain target figure
Picture.
Further, can will be pre- in the facial image and mobile terminal in target image after target image is obtained
The facial image first stored is matched, and mobile terminal is unlocked when fitting through, or completes e-payment etc..
The image processing method of the present embodiment, it is true according to emission parameter by obtaining the emission parameter of structured light device
Structured light device is determined to the number of active user's projective structure light, and control transmitter is according to identified number continuously to current
The structure light that user's projection matches with emission parameter, the structure light figure that control image acquisition device shooting is modulated through active user every time
Picture simultaneously carries out imaging importing and then obtains target image.In the present embodiment, structured light device is controlled in shooting according to setting
Rule, by way of multiple emitting portion structure light, not only the structure light projected every time can be made to be unlikely to excessive, so as to
Instantaneous power consumption during shooting can be effectively reduced, is advantageous to radiate, avoids mobile terminal from obvious fever phenomenon occur.And by
In by way of repeatedly projecting, all light source points can be covered, enable to the imaging of reference object complete, ensure imaging
Quality.
In order to clearly describe to obtain the specific implementation of the emission parameter of structured light device in above-described embodiment
Journey, the invention provides the possibility implementation of two kinds of acquisition emission parameters.
As the possible implementation of one of which, structure light can be determined according to the emission density of structured light device
The emission parameter of transmitter, Fig. 2 are a kind of schematic flow sheet of the method for acquisition emission parameter that the embodiment of the present invention proposes.
As shown in Fig. 2 on the basis of embodiment as shown in Figure 1, step 101 may comprise steps of：
Step 201, emission density of the structured light device in unit area is obtained.
Specifically, when obtaining the emission density of structured light device, light source battle array in structured light device can first be obtained
The area of row, and then according to the area of acquired array of source and the number of array of source mid-infrared light source, obtain structure light
The number of infrared light supply in the unit area of transmitter, the number of infrared light supply in the unit area of gained is close as launching
Degree.
As a kind of example, for same type of structured light device, the array of source of the structured light device
The number of area and array of source mid-infrared light source is fixed, can be by used structure light when mobile terminal produces
The number of the area of the array of source of transmitter and array of source mid-infrared light source preserve in a memory in the mobile terminal,
When needing to obtain the emission parameter of structured light device, directly it can be obtained from the memory of mobile terminal.And then will be infrared
The number of light source and the area of array of source do ratio, and the result of gained is the emission density of structured light device.
Step 202, emission parameter is determined according to emission density.
In the present embodiment, after emission density is determined, structured light further can be determined according to emission density
The emission parameter of device.
Specifically, emission density and default numerical value can be done ratio, obtains emission parameter.
Wherein, default numerical value can be set by user, and user can select to set a fixed numerical value, can also select
Select and pre-set a numerical value in each shooting.In general, default numerical value is more than emission density, so as to structure light hair
The emission parameter of emitter is fraction.Preferably, default numerical value is the integral multiple of emission density.
As a kind of example, a selecting switch can be set in the parameter setting option of camera in the terminal, such as
" emission parameter dynamic adjusts " switch is set, and the switch is defaulted as opening.When user selects to close the switch, then closed in user
After closing the switch, pop-up is shown in the display interface of mobile terminal, default number is used as to remind user to input a certain numerical value
Value, in the state of the switch is in and closed, the emission parameter of structured light device is now uniquely determined, and user is subsequently taken pictures
During without setting default numerical value again.When user selects to open the switch, then when camera starts every time, mobile terminal
After backstage obtains the emission density of structured light device, pop-up is shown in the display interface of mobile terminal, to remind use
Family inputs a certain numerical value as default numerical value.Preferably, in order to avoid the undesirable and actual feelings of numerical value of user's input
Condition, for example, user input numerical value be 0 when do not meet division arithmetic rule, remind user input numerical value when, can be to user
Several alternative numerical value are shown, for therefrom selecting the default numerical value of conduct.
The image processing method of the present embodiment, by obtaining emission density of the structured light device in unit area, root
Emission parameter is determined according to emission density, it is determined that during emission parameter, emission density and default numerical value are done than being worth to transmitting
Parameter, because default numerical value can be set different numerical value by user, so as to obtain different emission parameters, and then realize spirit
The number of adjustment structured light device projective structure light living, lifts Consumer's Experience.
, can be according to the region division of the array of source of structured light device as wherein alternatively possible implementation
Emission parameter is determined, so as to which the embodiment of the present invention proposes another image processing method, and Fig. 3 is another embodiment of the present invention
The schematic flow sheet of the image processing method of proposition.
As shown in figure 3, the image processing method may comprise steps of：
Step 301, region is carried out to array of source in structured light device to divide equally.
In the present embodiment, before IMAQ is carried out, mobile terminal can be first to the array of source of structured light device
Carry out region to divide equally, array of source is averagely divided into several regions.
Wherein, the number of institute zoning can set a default acquiescence before mobile terminal dispatches from the factory by research staff
Value, and can set and it is adjusted by user.
As a kind of example, a switch can be set in the parameter setting option of camera in the terminal, for example set
One " areal setting " switchs, and the default conditions of the switch are closing.When the switch is closed, mobile terminal
Default value according to number carries out region to the array of source of structured light device and divided equally；After user opens the switch, in phase
When machine starts every time, display reminding information in the display interface of mobile terminal, to remind user input area number, user is set
After areal, mobile terminal carries out area according to number that user is this time set to the array of source in structured light device
Domain is divided equally.
For example, Fig. 4 is the array of source schematic diagram for the light source dot matrix composition uniformly arranged.As shown in figure 4, the light source
Array is made up of 8*8 light source point, it is assumed that each row in the array of source are numbered according to order from left to right, successively
For the 1st row, the 2nd row ..., the 8th row；Every a line in the array of source is numbered in accordance with the order from top to bottom, is followed successively by
1st row, the 2nd row ..., eighth row.Assuming that the areal set is 4, then can according to order from left to right, by the 1st row and
2nd row are divided into same region, and the 3rd row and the 4th row are divided into same region, the 5th row and the 6th row are divided into same
Individual region, and the 7th row and the 8th row are divided into same region；Or can also in accordance with the order from top to bottom, by the 1st
Row and the 2nd row are divided into same region, and the 3rd row and the 4th row are divided into same region, the 5th row and the 6th row are divided into
Same region, the 7th row and eighth row are divided into same region.
Step 302, emission parameter is determined according to the number in region.
As a kind of example, emission parameter that can be using the number in the region divided as structured light device, now,
Emission parameter is positive integer.For example array of source is divided evenly as 4 regions, then emission parameter is 4.
As another example, can join the inverse of the number in the region divided as the transmitting of structured light device
Number, now, emission parameter is fraction.For example array of source is divided evenly as 5 regions, then emission parameter is 1/5.
Step 303, determine structured light device to the number of active user's projective structure light according to emission parameter.
In the present embodiment, it is determined that, can be further true according to emission parameter after the emission parameter of structured light device
Structured light device is determined to the number of active user's projective structure light.
As a kind of example, when identified emission parameter is positive integer, can using the integral multiple of emission parameter as
The number of projective structure light.Such as when emission parameter is 3, the number of projective structure light can be 3 times, 6 times, it is 9 inferior.
, can be by the integer of the denominator of emission parameter when identified emission parameter is fraction as another example
Number as projective structure light again.Such as when emission parameter is 1/3, the number of projective structure light can be 3 times, 6 times, 9
It is inferior.
Step 304, the order in the region of division is obtained.
Wherein, the order in the region of division includes but is not limited to from left to right, and/or, from top to bottom.
Step 305, in sequence with number continuously to active user's projective structure light.
In the present embodiment, array of source carries out the equal timesharing in region in structured light device, and mobile terminal can obtain
The order of array of source is divided, such as, from left to right, from top to bottom, from right to left etc..And then mobile terminal can control knot
Structure optical transmitting set is according to acquired order and the number of projective structure light, continuously to active user's projective structure light.
Step 306, control the structure light image that image acquisition device shooting is modulated through active user every time and carry out image and fold
Add, obtain target image.
It should be noted that the description in the present embodiment to step 306, may refer in previous embodiment to step 104
Description, its realization principle is similar, and here is omitted.
Step 307, facial image is extracted from target image.
In the present embodiment, after the target image of acquisition, related face recognition technology can be used, from target image
Extract facial image.
Step 308, facial image is matched with the mandate facial image stored in electronic installation.
Wherein, it can be one or more images to authorize facial image, can be the multiple different of authorized user
Image or the multiple images of multiple different authorized users, facial image is authorized to be pre-stored within electronic installation
Memory in.
Step 309, if facial image is unlocked to authorize one in facial image to electronic installation.
The facial image extracted from target image and the mandate facial image prestored in electronic installation are carried out
Matching, if facial image is unlocked to authorize one in facial image to electronic installation.
As a kind of example, when what is prestored authorizes multiple different images that facial image is an authorized user
When, Expression Recognition can be carried out to the facial image and the mandate facial image of storage extracted, by the consistent image of expression
It is identified as identical image.When the expression of one of mandate facial image of the facial image extracted with storing is identical,
Electronic installation is unlocked.
As another example, when the multiple images that mandate facial image is multiple different authorized users, and electronics fills
, can be to the facial image that is extracted and storage when storing one only for each authorized user in putting and authorizing facial image
Authorize facial image to carry out face recognition, be identical image by the image recognition of face organ's identical.When the face figure extracted
When picture is identical with the face organ of one of mandate facial image of storage, electronic installation is unlocked.
As another example, when the multiple images that mandate facial image is multiple different authorized users, and electronics fills
Put when storing the mandate facial image of multiple different expressions for each authorized user, face recognition and expression can be used to know
The mode not combined, when face organ and the facial expression of the facial image extracted are identical with same mandate facial image
When, electronic installation is unlocked.
The image processing method of the present embodiment, divided equally by carrying out region to array of source in structured light device, according to
The number in region determines emission parameter, and then determines structured light device to active user's projective structure light according to emission parameter
Number, the order in the region of division is obtained, control IMAQ continuously to active user's projective structure light with number in sequence
Device shoots the structure light image every time through active user's modulation and carries out imaging importing, obtains target image.Due in shooting
The multiple projective structure light of control structure optical transmitting set, so that the structure light projected every time is unlikely to excessive, so as to effectively drop
Instantaneous power consumption during low shooting, be advantageous to radiate.After target image is obtained, facial image is extracted from target image, and
Facial image is matched with the mandate facial image stored in electronic installation, and electronic installation carried out when the match is successful
Unblock, it can realize that face unlocks, the convenience of terminal unlocking is improved while terminal security is ensured.
In order to realize above-described embodiment, the present invention also proposes a kind of image processing apparatus.
Fig. 5 is the structural representation for the image processing apparatus that one embodiment of the invention proposes, the image processing apparatus is used for
In electronic installation, the electronic installation can be the mobile terminals such as mobile phone, tablet personal computer.
As shown in figure 5, the image processing apparatus 40 includes：Structured light device 410, image acquisition device 420, and processing
Device 430.Wherein,
Structured light device 410, for active user's emitting structural light.
Image acquisition device 420, for shooting the structure light image modulated through active user.
Processor 430, processor 430 are used for：
Obtain the emission parameter of structured light device 410；
Determine structured light device 410 to the number of active user's projective structure light according to emission parameter；
Control structure optical transmitting set 410 is according to number, the structure light continuously matched to active user's projection with emission parameter；
Control image acquisition device 420 shoots the structure light image every time through active user's modulation and carries out imaging importing, obtains
To target image.
The embodiments of the invention provide the method for the emission parameter of two kinds of acquisition structured light devices.Can as one of which
The implementation of energy, processor 430 can obtain emission density of the structured light device 410 in unit area, according to transmitting
Density determines emission parameter.Specifically, processor 430 can obtain the area of array of source in structured light device 410, according to
The area of acquisition and the number of array of source mid-infrared light source, obtain the infrared light in the unit area of structured light device 410
The number in source, using the number of infrared light supply in unit area as emission density.And then emission density and default numerical value are done
Ratio, obtain emission parameter.
As alternatively possible implementation, processor 430 can enter to the array of source in structured light device 410
Row region is divided equally, and emission parameter is determined according to the number in region.Now, processor 430 can also further obtain the area of division
The order in domain, according to acquired order and number continuously to active user's projective structure light.
Further, after processor 430 obtains target image, facial image can also be extracted from target image, will
Facial image is matched with the mandate facial image stored in electronic installation, if facial image is in mandate facial image
One, then electronic installation is unlocked.
It should be noted that the foregoing explanation to image processing method embodiment is also applied for the image of the embodiment
Processing unit, its realization principle is similar, and here is omitted.
The image processing apparatus of the present embodiment, it is true according to emission parameter by obtaining the emission parameter of structured light device
Structured light device is determined to the number of active user's projective structure light, and control transmitter is according to identified number continuously to current
The structure light that user's projection matches with emission parameter, the structure light figure that control image acquisition device shooting is modulated through active user every time
Picture simultaneously carries out imaging importing and then obtains target image.In the present embodiment, structured light device is controlled in shooting according to setting
Rule, by way of multiple emitting portion structure light, not only the structure light projected every time can be made to be unlikely to excessive, so as to
Instantaneous power consumption during shooting can be effectively reduced, is advantageous to radiate, avoids mobile terminal from obvious fever phenomenon occur.And by
In by way of repeatedly projecting, all light source points can be covered, enable to the imaging of reference object complete, ensure imaging
Quality.
In order to realize above-described embodiment, the present invention also proposes a kind of electronic installation.
Fig. 6 is the structural representation for the electronic installation that one embodiment of the invention proposes.As shown in fig. 6, the electronic installation 50
Including：One or more processors 501, memory 502 and one or more programs 503.Wherein, one or more programs 503
It is stored in memory 502, and is configured to be performed by one or more processors 501, program 503 includes being used to perform
The instruction of image processing method described in foregoing any embodiment.
The embodiment of the present invention also proposes a kind of terminal, including image processing circuit, and image processing circuit can utilize hardware
And/or component software is realized, it may include defines each of ISP (Image Signal Processing, picture signal processing) pipeline
Kind processing unit.Fig. 7 is the structural representation of the image processing circuit in the terminal that one embodiment of the invention proposes.For ease of saying
It is bright, as shown in fig. 7, only showing the various aspects of the image processing techniques related to the embodiment of the present invention.
As shown in fig. 7, image processing circuit 110 includes imaging device 1110, ISP processors 1130 and control logic device
1140.Imaging device 1110 may include the camera and structure light with one or more lens 1112, imaging sensor 1114
Transmitter 1116.Structured light device 1116 is by structured light projection to measured object.Wherein, the structured light patterns can be laser strip
Line, Gray code, sine streak or, speckle pattern of random alignment etc..Imaging sensor 1114 catches projection to measured object shape
Into structure light image, and structure light image is sent to ISP processors 1130, by ISP processors 1130 to structure light image
Carry out imaging importing and obtain target image.Meanwhile imaging sensor 1114 can also catch the color information of measured object.Certainly,
The structure light image and color information of measured object can also be caught respectively by two imaging sensors 1114.
, can quilt after the color information that ISP processors 1130 receive the measured object that imaging sensor 1114 captures
View data corresponding to surveying the color information of thing is handled.ISP processors 1130 are analyzed view data can with acquisition
For the image statistics for the one or more control parameters for determining imaging device 1110.Imaging sensor 1114 may include color
Color filter array (such as Bayer filters), imaging sensor 1114 can obtain is caught with each imaging pixel of imaging sensor 1114
The luminous intensity and wavelength information caught, and the one group of raw image data that can be handled by ISP processors 1130 is provided.
ISP processors 1130 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 1130 can be carried out at one or more images to raw image data
Reason operation, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth
Precision is carried out.
ISP processors 1130 can also receive pixel data from video memory 1120.Video memory 1120 can be storage
Independent private memory in the part of device device, storage device or electronic equipment, and may include DMA (Direct
Memory Access, direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 1130 can carry out one or more image processing operations.
The view data of target image can be transmitted to video memory 1120, to carry out other place before shown
Reason.ISP processors 1130 from the reception processing data of video memory 1120, and to the processing data carry out original domain in and
Image real time transfer in RGB and YCbCr color spaces.The view data of 3-D view may be output to display 1160, for
User watches and/or further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).
In addition, the output of ISP processors 1130 also can be transmitted to video memory 1120, and display 1160 can be from video memory
1120 read view data.In one embodiment, video memory 1120 can be configured as realizing one or more frame bufferings
Device.In addition, the output of ISP processors 1130 can be transmitted to encoder/decoder 1150, so as to encoding/decoding image data.Compile
The view data of code can be saved, and be decompressed before being shown in the equipment of display 1160.Encoder/decoder 1150 can
Realized by CPU or GPU or coprocessor.
The image statistics that ISP processors 1130 determine, which can be transmitted, gives the unit of control logic device 1140.Control logic device
1140 may include the processor and/or microcontroller that perform one or more routines (such as firmware), and one or more routines can root
According to the image statistics of reception, the control parameter of imaging device 1110 is determined.
With the image processing techniques in Fig. 7, above-mentioned image processing method can be realized.
In order to realize above-described embodiment, the present invention also proposes a kind of computer-readable recording medium, including with that can image
The computer program that is used in combination of electronic installation 50, the computer program can performs by processor 501 to complete foregoing
Image processing method described in one embodiment.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three
It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize custom logic function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware with another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized：With the logic gates for realizing logic function to data-signal from
Logic circuit is dissipated, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above
Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention
Type.
Claims (10)
- A kind of 1. image processing method, for electronic installation, it is characterised in that the electronic installation include structured light device and Image acquisition device, methods described include：Obtain the emission parameter of structured light device；Number of the structured light device to active user's projective structure light is determined according to the emission parameter；The structured light device is controlled continuously to project to the active user and matched with the emission parameter according to the number Structure light；Control image acquisition device shoots the structure light image every time through active user modulation and carries out imaging importing, obtains mesh Logo image.
- 2. image processing method according to claim 1, it is characterised in that the transmitting ginseng for obtaining structured light device Number, including：Obtain emission density of the structured light device in unit area；The emission parameter is determined according to the emission density.
- 3. image processing method according to claim 2, it is characterised in that described to obtain the structured light device in list Emission density in plane product, including：Obtain the area of array of source in the structured light device；According to the number of the area and the array of source mid-infrared light source, the unit area of the structured light device is obtained On the infrared light supply number；Using the number of the infrared light supply in the unit area as the emission density.
- 4. according to the method for claim 3, it is characterised in that described to determine that the transmitting is joined according to the emission density Number, including：The emission density and default numerical value are done into ratio, obtain the emission parameter.
- 5. image processing method according to claim 1, it is characterised in that the transmitting ginseng for obtaining structured light device Number, including：Region is carried out to array of source in the structured light device to divide equally；The emission parameter is determined according to the number in the region.
- 6. image processing method according to claim 5, it is characterised in that the control transmitter is according to described time Number, the structure light continuously matched to active user projection with the emission parameter, including：Obtain the order in the region of division；Continuously the structure light is projected according to the order and the number to the active user.
- 7. according to the image processing method described in claim any one of 1-6, it is characterised in that it is described obtain target image it Afterwards, in addition to：Facial image is extracted from the target image；The facial image is matched with the mandate facial image stored in the electronic installation；If the facial image is one in the mandate facial image, the electronic installation is unlocked.
- A kind of 8. image processing apparatus, for electronic installation, it is characterised in that including：Structured light device, for active user's emitting structural light；Image acquisition device, for shooting the structure light image modulated through the active user；Processor, the processor are used for：Obtain the emission parameter of the structured light device；Number of the structured light device to active user's projective structure light is determined according to the emission parameter；The structured light device is controlled continuously to project to the active user and matched with the emission parameter according to the number Structure light；Control described image collector shoots the structure light image every time through active user modulation and carries out imaging importing, obtains To target image.
- 9. a kind of electronic installation, it is characterised in that the electronic installation includes：One or more processors；Memory；WithOne or more programs, wherein one or more of programs are stored in the memory, and be configured to by One or more of computing devices, described program include being used at the image that perform claim is required described in 1 to 7 any one The instruction of reason method.
- A kind of 10. computer-readable recording medium, it is characterised in that the meter being used in combination including the electronic installation with that can image Calculation machine program, the computer program can be executed by processor to complete the image procossing described in claim 1 to 7 any one Method.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711020139.2A CN107820005B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device and electronic device |
| PCT/CN2018/112156 WO2019080934A1 (en) | 2017-10-27 | 2018-10-26 | Image processing method and device as well as electronic device |
| EP18871067.7A EP3697078B1 (en) | 2017-10-27 | 2018-10-26 | Image processing method and device as well as electronic device |
| US16/856,526 US11315268B2 (en) | 2017-10-27 | 2020-04-23 | Image processing methods, image processing apparatuses and electronic devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711020139.2A CN107820005B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107820005A true CN107820005A (en) | 2018-03-20 |
| CN107820005B CN107820005B (en) | 2019-09-17 |
Family
ID=61604042
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711020139.2A Expired - Fee Related CN107820005B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107820005B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109005371A (en) * | 2018-07-27 | 2018-12-14 | Oppo广东移动通信有限公司 | The control system and electronic device of structured light projector |
| WO2019080934A1 (en) * | 2017-10-27 | 2019-05-02 | Oppo广东移动通信有限公司 | Image processing method and device as well as electronic device |
| CN112633181A (en) * | 2020-12-25 | 2021-04-09 | 北京嘀嘀无限科技发展有限公司 | Data processing method, system, device, equipment and medium |
| CN113221635A (en) * | 2021-03-29 | 2021-08-06 | 追创科技(苏州)有限公司 | Structured light module and autonomous mobile device |
| US11115607B2 (en) | 2018-07-27 | 2021-09-07 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Control system for structured light projector and electronic device |
| WO2021258294A1 (en) * | 2020-06-23 | 2021-12-30 | Oppo广东移动通信有限公司 | Electronic device, unlocking method and apparatus, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102760234A (en) * | 2011-04-14 | 2012-10-31 | 财团法人工业技术研究院 | Depth image acquisition device, system and method |
| CN102780845A (en) * | 2012-06-14 | 2012-11-14 | 清华大学 | Light source alternate strobe synchronous camera shooting method and vision detection system |
| US20130128102A1 (en) * | 2011-11-21 | 2013-05-23 | Canon Kabushiki Kaisha | Imaging apparatus and camera system |
| CN104639843A (en) * | 2014-12-31 | 2015-05-20 | 小米科技有限责任公司 | Method and device for processing image |
| CN106796107A (en) * | 2014-08-10 | 2017-05-31 | 脸谱公司 | For the structure light of 3D sensings |
-
2017
- 2017-10-27 CN CN201711020139.2A patent/CN107820005B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102760234A (en) * | 2011-04-14 | 2012-10-31 | 财团法人工业技术研究院 | Depth image acquisition device, system and method |
| US20130128102A1 (en) * | 2011-11-21 | 2013-05-23 | Canon Kabushiki Kaisha | Imaging apparatus and camera system |
| CN102780845A (en) * | 2012-06-14 | 2012-11-14 | 清华大学 | Light source alternate strobe synchronous camera shooting method and vision detection system |
| CN106796107A (en) * | 2014-08-10 | 2017-05-31 | 脸谱公司 | For the structure light of 3D sensings |
| CN104639843A (en) * | 2014-12-31 | 2015-05-20 | 小米科技有限责任公司 | Method and device for processing image |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019080934A1 (en) * | 2017-10-27 | 2019-05-02 | Oppo广东移动通信有限公司 | Image processing method and device as well as electronic device |
| US11315268B2 (en) | 2017-10-27 | 2022-04-26 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing methods, image processing apparatuses and electronic devices |
| CN109005371A (en) * | 2018-07-27 | 2018-12-14 | Oppo广东移动通信有限公司 | The control system and electronic device of structured light projector |
| US11115607B2 (en) | 2018-07-27 | 2021-09-07 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Control system for structured light projector and electronic device |
| WO2021258294A1 (en) * | 2020-06-23 | 2021-12-30 | Oppo广东移动通信有限公司 | Electronic device, unlocking method and apparatus, and storage medium |
| CN112633181A (en) * | 2020-12-25 | 2021-04-09 | 北京嘀嘀无限科技发展有限公司 | Data processing method, system, device, equipment and medium |
| CN113221635A (en) * | 2021-03-29 | 2021-08-06 | 追创科技(苏州)有限公司 | Structured light module and autonomous mobile device |
| WO2022205810A1 (en) * | 2021-03-29 | 2022-10-06 | 追觅创新科技(苏州)有限公司 | Structured light module and autonomous moving device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107820005B (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107820005A (en) | Image processing method, device and electronic installation | |
| CN111161205B (en) | Image processing and face image recognition method, device and equipment | |
| CN107277053A (en) | Auth method, device and mobile terminal | |
| CN107479801A (en) | Displaying method of terminal, device and terminal based on user's expression | |
| CN107977940A (en) | background blurring processing method, device and equipment | |
| CN107483811A (en) | Imaging method and electronic installation | |
| CN107563304A (en) | Unlocking terminal equipment method and device, terminal device | |
| CN107864337A (en) | Sketch image processing method, device and equipment | |
| CN109360254B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| WO2022222575A1 (en) | Method and system for target recognition | |
| CN108846807A (en) | Light efficiency processing method, device, terminal and computer readable storage medium | |
| CN109564462A (en) | Electronic tracking equipment, Third-party Logistics and electronic tracking method | |
| CN107483428A (en) | Auth method, device and terminal device | |
| CN107800962A (en) | Image processing method, device and electronic installation | |
| CN107396079B (en) | White balance adjustment method and device | |
| CN107437019A (en) | The auth method and device of lip reading identification | |
| CN108737728A (en) | A kind of image capturing method, terminal and computer storage media | |
| CN109040746B (en) | Camera calibration method and apparatus, electronic equipment, computer readable storage medium | |
| CN109461186A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN107491675A (en) | information security processing method, device and terminal | |
| CN107481318A (en) | Replacement method, device and the terminal device of user's head portrait | |
| CN110188670A (en) | Face image processing process, device in a kind of iris recognition and calculate equipment | |
| CN107580205B (en) | White balance adjustment method and device | |
| CN107480614A (en) | Motion management method, apparatus and terminal device | |
| CN107493452A (en) | Video pictures processing method, device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190917 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |