CN107800963B - Image processing method, device, electronic device and computer readable storage medium - Google Patents
Image processing method, device, electronic device and computer readable storage medium Download PDFInfo
- Publication number
- CN107800963B CN107800963B CN201711022955.7A CN201711022955A CN107800963B CN 107800963 B CN107800963 B CN 107800963B CN 201711022955 A CN201711022955 A CN 201711022955A CN 107800963 B CN107800963 B CN 107800963B
- Authority
- CN
- China
- Prior art keywords
- image
- light
- light source
- source point
- structure light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Abstract
The present invention proposes a kind of image processing method, device and electronic device, this method is used for electronic device, the electronic device includes structured light device and image acquisition device, wherein method includes: to open the light source point in the structured light device by row or by column；The light source point currently opened is closed to active user's projective structure light and after having projected the structure light by the light source point currently opened；Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains target image.By this method, instantaneous power consumption when mobile terminal is shot can reduce, solve the big technical problem of instantaneous power consumption in the prior art.
Description
Technical field
The present invention relates to technical field of mobile terminals more particularly to a kind of image processing method, device, electronic device and meters
Calculation machine readable storage medium storing program for executing.
Background technique
With the development of mobile terminal technology, structured light technique is gradually applied in mobile terminal.However, existing adopt
The mobile terminal taken pictures with structured light technique, when being taken pictures, all light source points of structure light are projected to bat simultaneously
It takes the photograph on object, causes the instantaneous power consumption of mobile terminal larger, fever phenomenon is obvious.
Summary of the invention
The embodiment provides a kind of image processing method, device, electronic device and computer-readable storage mediums
Matter solves the big technical problem of instantaneous power consumption in the prior art to reduce instantaneous power consumption when mobile terminal is shot.
The image processing method of embodiment of the present invention is used for electronic device, and the electronic device includes structured light device
And image acquisition device, described image processing method include:
The light source point in the structured light device is opened by row or by column；
By the light source point currently opened to active user's projective structure light and after having projected the structure light
Close the light source point currently opened；
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains
To target image.
The image processing apparatus of embodiment of the present invention, is used for electronic device, and described image processing unit includes:
Structured light device is used for active user's emitting structural light；
Image acquisition device, for shooting the structure light image modulated through the active user；
Processor, the processor are used for:
The light source point in the structured light device is opened by row or by column；
By the light source point currently opened to active user's projective structure light and after having projected the structure light
Close the light source point currently opened；
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains
To target image.
The electronic device of embodiment of the present invention includes: one or more processors, memory and one or more program,
Wherein one or more of programs are stored in the memory, and are configured to by one or more of processors
It executes, described program includes the instruction for executing image processing method described in above embodiment.
The computer readable storage medium of embodiment of the present invention, including what is be used in combination with the electronic device that can be imaged
Computer program, the computer program can be executed by processor to complete image processing method described in above embodiment.
Image processing method, device and the electronic device of embodiment of the present invention, by by row or by column opening structure
Light source point in optical transmitting set, using the light source point currently opened to active user's projective structure light and projected structure light it
The light source point currently opened, structure light image and progress of the control image acquisition device shooting every time through active user's modulation are closed afterwards
Image superposition obtains target image.Since sequence during shooting according to row or column successively opens light source point, shooting
When can control structured light device and project less structure light every time, and can be divided into and repeatedly be projected.By every time only
Small number of structure light is projected, can be effectively reduced instantaneous power consumption when shooting, is conducive to radiate, mobile terminal is avoided to occur
Apparent fever phenomenon, solve to open in the prior art all light source point projective structure light guides cause the instantaneous power consumption of mobile terminals compared with
Big technical problem.Further, it since all light source points can be covered by way of repeatedly projecting, enables to shoot
The imaging of object is complete, guarantees image quality.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partially become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram for the image processing method that one embodiment of the invention proposes；
Fig. 2 is the array of source schematic diagram of evenly arranged light source dot matrix composition；
Fig. 3 is the flow diagram for the image processing method that another embodiment of the present invention proposes；
Fig. 4 is the structural schematic diagram for the image processing apparatus that one embodiment of the invention proposes；
Fig. 5 is the structural schematic diagram for the electronic device that one embodiment of the invention proposes；And
Fig. 6 is the structural schematic diagram of the image processing circuit in the terminal that one embodiment of the invention proposes.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to is used to explain the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings the image processing method of the embodiment of the present invention, device, electronic device and computer-readable are described
Storage medium.
Fig. 1 is the flow diagram for the image processing method that one embodiment of the invention proposes, this method can be used for electronics
In device, which can be the mobile terminals such as mobile phone, tablet computer.The electronic device includes structured light device and figure
As collector, wherein structured light device is used for reference object projective structure light, and image acquisition device is for shooting through shooting pair
As modulated structure light image.
As shown in Figure 1, the image processing method the following steps are included:
Step 101, by row or by the light source point in column opening structure optical transmitting set.
Currently, the function of mobile terminal is also more and more abundant with the development of mobile terminal technology, face identification functions by
Gradually become the standard configuration of mobile terminal.For example, more and more mobile terminals support face unlock, face payment etc..When with
When family is using the correlation function for needing to carry out recognition of face, after correlation function is opened, mobile terminal call built-in camera into
Row Image Acquisition, to obtain the image for including face.
In the present embodiment, when being shot using the image acquisition device in electronic device, electronic device can first according to
The light source point of array of source in certain sequence opening structure optical transmitting set, for example, can according to array of source row sequence or
Person's column sequence opens light source point.Preferably, in the present embodiment, the arrangement mode of light source point can be uniform arrangement in array of source
, in order to open in sequence/close light source point.
Fig. 2 is the array of source schematic diagram of evenly arranged light source dot matrix composition, for ease of understanding, below with such as Fig. 2 institute
It is explained for the array of source shown.The array of source being made of 7*7 light source point is shown in Fig. 2, it is assumed that
Each column in the array of source are numbered according to sequence from left to right, be followed successively by the 1st column, the 2nd column ..., the 7th column；It should
Every a line in array of source is numbered in accordance with the order from top to bottom, be followed successively by the 1st row, the 2nd row ..., the 7th row, such as Fig. 2
It is shown.
It, can be with when the light source point in electronic device control structure optical transmitting set is opened as a kind of possible implementation
Since the first row or last line, each line light source point in opening structure optical transmitting set line by line；Alternatively, from first row or finally
One column start, by column each column light source point in opening structure optical transmitting set.It, can be with for example, for array of source as shown in Figure 2
In accordance with the order from top to bottom, successively open the 1st line light source point, the 2nd line light source point ..., the 7th line light source point；It can also be according to
Sequence from right to left, successively open the 7th column light source point, the 6th column light source point ..., the 1st column light source point.
As a kind of possible implementation, when the light source point in electronic device control structure optical transmitting set is opened, may be used also
, to the two sides of nominated bank, to replace each line light source point in opening structure optical transmitting set, alternatively, from specified column since nominated bank
Start the two sides to specified column, alternately each column light source point in opening structure optical transmitting set.For example, for light as shown in Figure 2
Source array can successively open the 4th row, the 5th row, the 3rd row etc. since the 4th row to upper and lower two sides, when opening light source point,
Using the light source point of the 4th row as line of demarcation, the light source point of two sides up and down is alternately opened；Alternatively, the 4th row light can also be opened for the first time
Source point opens monosymmetric two line light sources point up and down later with the 4th behavior symmetry axis every time, i.e., open for second the 3rd row and
The light source point of 5th row, third time open the light source point of the 2nd row and the 6th row, and so on.
It should be understood that array of source can be by the light source point of the types such as round speckle, cross speckle in practical application
Composition, and the size of array of source is more much bigger than the size of array of source shown in Fig. 2, array of source shown in Fig. 2 is only
As an example, and cannot function as limitation of the present invention.
Further, it in practical application, was shot to avoid every secondary control a row or column light source point unlatching from may cause
The case where journey takes a long time can open multirow when by row or by light source point in column opening structure optical transmitting set every time
Or multiple row light source point, to reduce shooting duration of video.
Step 102, by the light source point currently opened to active user's projective structure light and after having projected structure light
Close the light source point currently opened.
When opening light source point every time, can by the light source point currently opened to active user's projective structure light, and
After the light source point currently opened has projected structure light, current light source point is closed.
Step 103, control image acquisition device shoots the structure light image every time through active user's modulation and carries out image and folds
Add, obtains target image.
In the present embodiment, after the light source point currently opened has projected structure light to active user, structure light reaches current
User, and change after reaching active user because of the modulation of active user, at this point, electronic device controls image acquisition device
Shoot the structure light image modulated through active user.Structured light device passes through the light source point this time opened every time and projects the structure that finishes
After light, image acquisition device shoots corresponding structure light image, and resulting structure light image is carried out image superposition, obtains mesh
Logo image.
This time it should be noted that the structure light image that control image acquisition device shooting is modulated through active user every time is gone forward side by side
The specific implementation process that row image superposition obtains target image will provide in subsequent content, to avoid repeating, not make this time in detail
Thin description.
The image processing method of the present embodiment, by by row or by the light source point in column opening structure optical transmitting set, benefit
The light source currently opened is closed to active user's projective structure light and after having projected structure light with the light source point currently opened
Point, control image acquisition device shoot the structure light image every time through active user's modulation and carry out image superposition, obtain target figure
Picture.Since sequence during shooting according to row or column successively opens light source point, structure light hair can control when shooting
Emitter projects less structure light every time, and can be divided into and repeatedly be projected.By only projecting small number of structure every time
Light can be effectively reduced instantaneous power consumption when shooting, be conducive to radiate, and mobile terminal is avoided apparent fever phenomenon, solution occur
The technical problem that all light source point projective structure light guides cause the instantaneous power consumption of mobile terminal larger is certainly opened in the prior art.Into one
Step ground enables to the imaging of reference object complete, protects due to that can cover all light source points by way of repeatedly projecting
Demonstrate,prove image quality.
In order to clearly illustrate to control image acquisition device shooting in above-described embodiment every time through active user's modulation
Structure light image simultaneously carries out image superposition and obtains the specific implementation process of target image, and the embodiment of the present invention proposes another figure
As processing method, Fig. 3 is the flow diagram for the image processing method that another embodiment of the present invention proposes.
As shown in figure 3, the image processing method may comprise steps of:
Step 201, by row or by the light source point in column opening structure optical transmitting set.
Step 202, by the light source point currently opened to active user's projective structure light and after having projected structure light
Close the light source point currently opened.
It should be noted that the description in the present embodiment to step 201- step 202, it is right in previous embodiment to may refer to
The description of step 101- step 102, realization principle is similar, and details are not described herein again.
Step 203, the structure light image for arriving current shooting since taking structure light image for the first time and last time
Obtained structure light image carries out image superposition, obtains the first image.
In shooting process, first time opens light source point and after light source point has projected structure light, and image acquisition device is clapped
It takes the photograph to obtain first structure light image, it, before can be with first without structure light image since current shooting is to shoot for the first time
It opens structure light image to be overlapped, then first structure light image can be used as resulting first image after shooting for the first time.?
Second opens light source point and after light source point has projected structure light, and image acquisition device shoots to obtain second structure light figure
Picture, and second structure light image and first structure light image are subjected to image superposition, superimposed structure light image is obtained,
And using superimposed structure light image as the first image.Third time open light source point and light source point projected structure light it
Afterwards, image acquisition device shoots to obtain third structure light image, and a third that current shooting is arrived structure light image and second
Resulting superimposed structure light image carries out image superposition after the completion of secondary shooting, obtains superimposed structure light image and conduct
First image.That is, after the completion of third time is shot in obtained the first image, contain first structure light image,
Second structure light image and third structure light image.
In summary, in the present embodiment, other than first time unlatching light source point carries out shooting resulting structure light image, after
In first image obtained in continuous shooting process, contains this time resulting structure light image of shooting and shoot institute every time before
The structure light image obtained.
Step 204, judge whether can extract complete facial image from the first image.
In the present embodiment, light source point is opened for each, and the light source point by currently opening is projected to active user and tied
Structure light, after completing current shooting and obtaining the first image, may further determine whether can be from resulting first image
Extract complete facial image.
Specifically, when judging, the second image including facial characteristics can be first extracted from the first image, wherein
Facial characteristics may include eyebrow, eyes, nose, mouth and ear etc..By extracted second image and it is stored in electronics dress
The authorization facial image set is matched, wherein authorization facial image can be one or more images, can be one and awards
The multiple and different images for weighing user, are also possible to the multiple images of multiple and different authorized users, and authorization facial image can be with
It is pre-stored in the memory of electronic device.If being matched to authorization facial image, judgement is extracted from the first image
Complete facial image executes step 205；If matching do not pass through, return to step 201, continue starting next line or
The light source point of person's next column, to continue further to obtain structure light image to active user's projective structure light.
Further, in a kind of possible implementation of the embodiment of the present invention, when electronic device is currently at locking shape
When state, after being matched to authorization facial image, electronic device can also be unlocked.
When due to the second image and authorization facial image match cognization, there are the second image is imperfect and the second image
It is completely but not two kinds of situations of facial image of authorized user, thus, in a kind of possible implementation of the embodiment of the present invention,
After extracting the second image in the first image, can first judge whether the facial characteristics of the second image is complete, if imperfect,
Then return to step 201；If complete, 206 are thened follow the steps, and on the electronic device by extracted second image and storage
Authorization facial image matched, and after fitting through, execute step 205.
Step 205, using the first image as target image.
In the present embodiment, when being matched to authorization facial image, judgement extracts complete face figure from the first image
Picture, at this point, using the first image as target image.
Step 206, the transmitting of control structure optical transmitting set stop structure light.
It is complete determining to extract from the first image in the present embodiment in order to further decrease the power consumption of electronic device
Facial image after, electronic device can control the transmitting of structured light device stop structure light.
The image processing method of the present embodiment successively opens light source by sequence during shooting according to row or column
Point can control structured light device and project less structure light every time, and can be divided into and repeatedly be projected, and can effectively drop
Instantaneous power consumption when low shooting is conducive to radiate, and mobile terminal is avoided apparent fever phenomenon occur.By to every time shooting
Image is overlapped to obtain the first image, and judges whether can extract complete facial image in the first image, and extracting
Out when complete facial image, using the first image as target image, and the transmitting of control structure optical transmitting set stop structure light,
So as to reduce the projection quantity of structure light, the power consumption of electronic device is reduced.
In order to realize above-described embodiment, the present invention also proposes a kind of image processing apparatus.
Fig. 4 is the structural schematic diagram for the image processing apparatus that one embodiment of the invention proposes, which is used for
In electronic device, which can be the mobile terminals such as mobile phone, tablet computer.
As shown in figure 4, the image processing apparatus 40 includes: structured light device 410, image acquisition device 420, and processing
Device 430.Wherein,
Structured light device 410 is used for active user's emitting structural light.
Image acquisition device 420, for shooting the structure light image modulated through active user.
Processor 430, processor 430 are used for:
By row or by the light source point in column opening structure optical transmitting set 410；
It is closed to active user's projective structure light and after having projected structure light by the light source point currently opened current
The light source point of unlatching；
Control image acquisition device 420 shoots the structure light image every time through active user's modulation and carries out image superposition, obtains
To target image.
It specifically, can be since the first row, line by line when light source point in 430 opening structure optical transmitting set 410 of processor
Each line light source point in opening structure optical transmitting set 410；Alternatively, since first row, by column in opening structure optical transmitting set 410
Each column light source point；Alternatively, replacing each row in opening structure optical transmitting set 410 to the two sides of nominated bank since nominated bank
Light source point；Or replace each column light source in opening structure optical transmitting set 410 to the two sides of specified column since specified column
Point.
Processor 430 controls image acquisition device 420 and shoots the structure light image every time through active user's modulation and carry out figure
It, can be first since taking structure light image for the first time when obtaining target image as superposition, structure light that current shooting is arrived
Image and last obtained structure light image carry out image superposition, obtain the first image, so judge be from the first image
No extractable complete facial image out, and when extracting complete facial image, using the first image as target image.Into
One step, after obtaining target image, it can control the transmitting of 410 stop structure light of structured light device.
Specifically, processor 430 judges the process that whether can extract complete facial image from the first image are as follows: from
The second image including facial characteristics is extracted in first image, by the authorization face figure of the second image and storage on the electronic device
As being matched, if being matched to authorization facial image, judgement extracts complete facial image from the first image.Into one
Step ground after being matched to authorization facial image, then unlocks electronic device when electronic device is currently at lock state.
It should be noted that the aforementioned image for being also applied for the embodiment to the explanation of image processing method embodiment
Processing unit, realization principle is similar, and details are not described herein again.
The image processing apparatus of the present embodiment, by by row or by the light source point in column opening structure optical transmitting set, benefit
The light source currently opened is closed to active user's projective structure light and after having projected structure light with the light source point currently opened
Point, control image acquisition device shoot the structure light image every time through active user's modulation and carry out image superposition, obtain target figure
Picture.Since sequence during shooting according to row or column successively opens light source point, structure light hair can control when shooting
Emitter projects less structure light every time, and can be divided into and repeatedly be projected.By only projecting small number of structure every time
Light can be effectively reduced instantaneous power consumption when shooting, be conducive to radiate, and mobile terminal is avoided apparent fever phenomenon, solution occur
The technical problem that all light source point projective structure light guides cause the instantaneous power consumption of mobile terminal larger is certainly opened in the prior art.Into one
Step ground enables to the imaging of reference object complete, protects due to that can cover all light source points by way of repeatedly projecting
Demonstrate,prove image quality.
In order to realize above-described embodiment, the present invention also proposes a kind of electronic device.
Fig. 5 is the structural schematic diagram for the electronic device that one embodiment of the invention proposes.As shown in figure 5, the electronic device 50
It include: one or more processors 501, memory 502 and one or more programs 503.Wherein, one or more programs 503
It is stored in memory 502, and is configured to be executed by one or more processors 501, program 503 includes for executing
The instruction of image processing method described in aforementioned any embodiment.
The embodiment of the present invention also proposes a kind of terminal, including image processing circuit, and image processing circuit can use hardware
And/or component software is realized, it may include defines each of ISP (Image Signal Processing, image signal process) pipeline
Kind processing unit.Fig. 6 is the structural schematic diagram of the image processing circuit in the terminal that one embodiment of the invention proposes.For convenient for saying
It is bright, as shown in fig. 6, only showing the various aspects of image processing techniques relevant to the embodiment of the present invention.
As shown in fig. 6, image processing circuit 110 includes imaging device 1110, ISP processor 1130 and control logic device
1140.Imaging device 1110 may include camera and structure light with one or more lens 1112, imaging sensor 1114
Transmitter 1116.Structured light device 1116 is by structured light projection to measured object.Wherein, which can be laser strip
Line, Gray code, sine streak or, the speckle pattern etc. of random alignment.Imaging sensor 1114 captures projection to measured object shape
At structure light image, and structure light image is sent to ISP processor 1130, by ISP processor 1130 to structure light image
It carries out image superposition and obtains target image.Meanwhile imaging sensor 1114 also can capture the color information of measured object.Certainly,
The structure light image and color information of measured object can also be captured respectively by two imaging sensors 1114.
It, can quilt after the color information that ISP processor 1130 receives the measured object that imaging sensor 1114 captures
The corresponding image data of color information for surveying object is handled.ISP processor 1130 analyzes image data can with acquisition
For determining the image statistics of one or more control parameters of imaging device 1110.Imaging sensor 1114 may include color
Color filter array (such as Bayer filter), imaging sensor 1114 can be obtained is caught with each imaging pixel of imaging sensor 1114
The luminous intensity and wavelength information caught, and the one group of raw image data that can be handled by ISP processor 1130 is provided.
ISP processor 1130 handles raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processor 1130 can carry out raw image data at one or more images
Reason operation, image statistics of the collection about image data.Wherein, image processing operations can be by identical or different bit depth
Precision carries out.
ISP processor 1130 can also receive pixel data from video memory 1120.Video memory 1120 can be storage
Independent private memory in a part of device device, storage equipment or electronic equipment, and may include DMA (Direct
Memory Access, direct memory access (DMA)) feature.
When receiving raw image data, ISP processor 1130 can carry out one or more image processing operations.
The image data of target image can be transmitted to video memory 1120, to carry out other place before shown
Reason.ISP processor 1130 from video memory 1120 receive processing data, and to the processing data progress original domain in and
Image real time transfer in RGB and YCbCr color space.The image data of 3-D image may be output to display 1160, for
User watches and/or is further processed by graphics engine or GPU (Graphics Processing Unit, graphics processor).
In addition, the output of ISP processor 1130 also can be transmitted to video memory 1120, and display 1160 can be from video memory
1120 read image data.In one embodiment, video memory 1120 can be configured to realize one or more frame bufferings
Device.In addition, the output of ISP processor 1130 can be transmitted to encoder/decoder 1150, so as to encoding/decoding image data.It compiles
The image data of code can be saved, and decompress before being shown in 1160 equipment of display.Encoder/decoder 1150 can
It is realized by CPU or GPU or coprocessor.
The image statistics that ISP processor 1130 determines, which can be transmitted, gives control logic device Unit 1140.Control logic device
1140 may include the processor and/or microcontroller for executing one or more routines (such as firmware), and one or more routines can root
According to received image statistics, the control parameter of imaging device 1110 is determined.
With the image processing techniques in Fig. 6, above-mentioned image processing method can be realized.
In order to realize above-described embodiment, the present invention also proposes a kind of computer readable storage medium, including with can image
Electronic device 50 be used in combination computer program, the computer program can by processor 501 execute to complete aforementioned
Image processing method described in one embodiment.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present invention, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from
Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
The embodiment of the present invention is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as to limit of the invention
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of the invention
Type.
Claims (9)
1. a kind of image processing method, be used for electronic device, which is characterized in that the electronic device include structured light device and
Image acquisition device, which comprises
The light source point in the structured light device is opened by row or by column；
It is closed to active user's projective structure light and after having projected the structure light by the light source point currently opened
The light source point currently opened；
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains mesh
Logo image；
Wherein, the control image acquisition device shoots the structure light image modulated every time through the active user and carries out image and folds
Add, obtain target image, comprising:
Since taking structure light image for the first time, by current shooting to the structure light image and last obtained knot
Structure light image carries out image superposition, obtains the first image；
Judge whether can extract complete facial image from the first image；
If the complete facial image is extracted, using the first image as the target image.
2. image processing method according to claim 1, which is characterized in that described to open the structure by row or by column
Light source point in optical transmitting set, comprising:
Since the first row, each line light source point in the structured light device is opened line by line；Alternatively,
Since first row, each column light source point in the structured light device is opened by column.
3. image processing method according to claim 1, which is characterized in that described to open the structure by row or by column
Light source point in optical transmitting set, comprising:
To the two sides of the nominated bank since nominated bank, alternating opens each line light source point in the structured light device；Or
Person,
To the two sides of the specified column since specified column, alternating opens each column light source point in the structured light device.
4. image processing method according to claim 1, which is characterized in that it is described judgement from the first image whether
Extractable complete facial image out, comprising:
The second image including facial characteristics is extracted from the first image；
Second image is matched with the authorization facial image of storage on said electronic device；
If being matched to the authorization facial image, judgement extracts the complete face figure from the first image
Picture.
5. image processing method according to claim 4, which is characterized in that further include:
When the electronic device is currently at lock state, after being matched to authorization facial image, then the electronics dress is unlocked
It sets.
6. image processing method according to claim 4, which is characterized in that if described extract the complete face
Image, then using the first image as the target image after, further includes:
Control the transmitting that the structured light device stops the structure light.
7. a kind of image processing apparatus is used for electronic device characterized by comprising
Structured light device is used for active user's emitting structural light；
Image acquisition device, for shooting the structure light image modulated through the active user；
Processor, the processor are used for:
The light source point in the structured light device is opened by row or by column；
It is closed to active user's projective structure light and after having projected the structure light by the light source point currently opened
The light source point currently opened；
Control image acquisition device shoots the structure light image modulated every time through the active user and carries out image superposition, obtains mesh
Logo image；
Wherein, the control image acquisition device shoots the structure light image modulated every time through the active user and carries out image and folds
Add, obtain target image, comprising:
Since taking structure light image for the first time, by current shooting to the structure light image and last obtained knot
Structure light image carries out image superposition, obtains the first image；
Judge whether can extract complete facial image from the first image；
If the complete facial image is extracted, using the first image as the target image.
8. a kind of electronic device, which is characterized in that the electronic device includes:
One or more processors；
Memory；With
One or more programs, wherein one or more of programs are stored in the memory, and be configured to by
One or more of processors execute, and require image processing method described in 1 to 6 any one with perform claim.
9. a kind of computer readable storage medium, which is characterized in that the meter that storage is used in combination with the electronic device that can be imaged
Calculation machine program, the computer program can be executed by processor to complete image procossing described in claim 1 to 6 any one
Method.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711022955.7A CN107800963B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device, electronic device and computer readable storage medium |
| PCT/CN2018/112156 WO2019080934A1 (en) | 2017-10-27 | 2018-10-26 | Image processing method and device as well as electronic device |
| EP18871067.7A EP3697078B1 (en) | 2017-10-27 | 2018-10-26 | Image processing method and device as well as electronic device |
| US16/856,526 US11315268B2 (en) | 2017-10-27 | 2020-04-23 | Image processing methods, image processing apparatuses and electronic devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711022955.7A CN107800963B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device, electronic device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107800963A CN107800963A (en) | 2018-03-13 |
| CN107800963B true CN107800963B (en) | 2019-08-30 |
Family
ID=61548026
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711022955.7A Active CN107800963B (en) | 2017-10-27 | 2017-10-27 | Image processing method, device, electronic device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107800963B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019080934A1 (en) * | 2017-10-27 | 2019-05-02 | Oppo广东移动通信有限公司 | Image processing method and device as well as electronic device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101226587A (en) * | 2007-01-15 | 2008-07-23 | 中国科学院自动化研究所 | Image collecting device as well as human face identification system and method using the same |
| CN103810463A (en) * | 2012-11-14 | 2014-05-21 | 汉王科技股份有限公司 | Face recognition device and face image detection method |
| CN104769387A (en) * | 2012-11-14 | 2015-07-08 | 高通股份有限公司 | Structured light active depth sensing systems combining multiple images to compensate for differences in reflectivity and/or absorption |
| CN106131405A (en) * | 2016-06-30 | 2016-11-16 | 北京旷视科技有限公司 | Image processing method and device and for its image capturing system |
| CN106454287A (en) * | 2016-10-27 | 2017-02-22 | 深圳奥比中光科技有限公司 | Combined camera shooting system, mobile terminal and image processing method |
| CN106572340A (en) * | 2016-10-27 | 2017-04-19 | 深圳奥比中光科技有限公司 | Camera shooting system, mobile terminal and image processing method |
| CN106990112A (en) * | 2017-03-14 | 2017-07-28 | 清华大学 | The multi-layer multi-pass welding track detection device and method merged based on multi-visual information |
| CN107229925A (en) * | 2017-07-12 | 2017-10-03 | 深圳奥比中光科技有限公司 | Conversed using ear recognition |
| CN206584368U (en) * | 2016-05-27 | 2017-10-24 | 北京理工大学 | A kind of position of human eye detection device based on video |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9554057B2 (en) * | 2013-07-16 | 2017-01-24 | Texas Instruments Incorporated | Wide dynamic range depth imaging |
-
2017
- 2017-10-27 CN CN201711022955.7A patent/CN107800963B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101226587A (en) * | 2007-01-15 | 2008-07-23 | 中国科学院自动化研究所 | Image collecting device as well as human face identification system and method using the same |
| CN103810463A (en) * | 2012-11-14 | 2014-05-21 | 汉王科技股份有限公司 | Face recognition device and face image detection method |
| CN104769387A (en) * | 2012-11-14 | 2015-07-08 | 高通股份有限公司 | Structured light active depth sensing systems combining multiple images to compensate for differences in reflectivity and/or absorption |
| CN206584368U (en) * | 2016-05-27 | 2017-10-24 | 北京理工大学 | A kind of position of human eye detection device based on video |
| CN106131405A (en) * | 2016-06-30 | 2016-11-16 | 北京旷视科技有限公司 | Image processing method and device and for its image capturing system |
| CN106454287A (en) * | 2016-10-27 | 2017-02-22 | 深圳奥比中光科技有限公司 | Combined camera shooting system, mobile terminal and image processing method |
| CN106572340A (en) * | 2016-10-27 | 2017-04-19 | 深圳奥比中光科技有限公司 | Camera shooting system, mobile terminal and image processing method |
| CN106990112A (en) * | 2017-03-14 | 2017-07-28 | 清华大学 | The multi-layer multi-pass welding track detection device and method merged based on multi-visual information |
| CN107229925A (en) * | 2017-07-12 | 2017-10-03 | 深圳奥比中光科技有限公司 | Conversed using ear recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107800963A (en) | 2018-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107820005B (en) | Image processing method, device and electronic device | |
| CN107480613A (en) | Face identification method, device, mobile terminal and computer-readable recording medium | |
| CN107977940A (en) | background blurring processing method, device and equipment | |
| CN107479801A (en) | Displaying method of terminal, device and terminal based on user's expression | |
| CN107483428A (en) | Auth method, device and terminal device | |
| CN107563304A (en) | Unlocking terminal equipment method and device, terminal device | |
| CN108965732A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN109005364A (en) | Image formation control method, device, electronic equipment and computer readable storage medium | |
| CN107483845B (en) | Photographic method and its device | |
| CN107481304A (en) | The method and its device of virtual image are built in scene of game | |
| CN109040591A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| CN107564050A (en) | Control method, device and terminal device based on structure light | |
| CN107657652A (en) | Image processing method and device | |
| CN109672819A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN108024054A (en) | Image processing method, device and equipment | |
| CN107800962A (en) | Image processing method, device and electronic installation | |
| CN107590435A (en) | Palm grain identification method, device and terminal device | |
| CN107493427A (en) | Focusing method, device and the mobile terminal of mobile terminal | |
| CN109360254A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN109040746B (en) | Camera calibration method and apparatus, electronic equipment, computer readable storage medium | |
| CN109151303A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN107491675A (en) | information security processing method, device and terminal | |
| CN107621867A (en) | Put out screen control method, device and terminal device | |
| CN107820019A (en) | Blur image acquiring method, device and equipment | |
| CN107820018A (en) | User's photographic method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |