CN109257540A - Take the photograph photography bearing calibration and the camera of lens group more - Google Patents
Take the photograph photography bearing calibration and the camera of lens group more Download PDFInfo
- Publication number
- CN109257540A CN109257540A CN201811307126.8A CN201811307126A CN109257540A CN 109257540 A CN109257540 A CN 109257540A CN 201811307126 A CN201811307126 A CN 201811307126A CN 109257540 A CN109257540 A CN 109257540A
- Authority
- CN
- China
- Prior art keywords
- image
- block
- sharpness
- lens group
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The present invention relates to photography bearing calibration and cameras that one kind takes the photograph lens group more, comprising: S1. enables the lens groups taken the photograph in lens group more and absorbs the first image, and generates the first sharpness index based on the first image；S2. judge whether the first sharpness index meets preset first threshold condition, if it is not, then enable another lens group taken the photograph in lens group absorbs the second image more；S3. the pixel quantity filled into based on the second image described in the first sharpness index selection to the first image, completes the correction of the first image.Based on sharpness index to assess whether the imaging of the first lens group obscures, when some or all of first image is fuzzy, second camera lens of the focal range different from the first lens group will be enabled and shoot the second image, and the region obscured in the first image is replaced or synthesized by the second image, and then in the case where ensure that picture quality, it is greatly reduced calculation amount of the invention, improves computational efficiency.
Description
Technical field
The present invention relates to optical lens imaging field, more particularly to a kind of photography bearing calibration and photography for taking the photograph lens group more
Device.
Background technique
In recent years, with the development of science and technology, the portable electronic products such as mobile phone, tablet computer gradually rise, and have
The portable electronic product of camera function, which obtains people, more to be favored, therefore market is taken the photograph to portable electronic product is suitable for
As the demand of camera lens is gradually increased.And with portable electronic product be intended to miniaturization, it is lightening, limit the total of camera lens
It is long, to increase the design difficulty of camera lens.Meanwhile with common photosensitive element CCD (Charge-Coupled Device, sense
Optical coupling element) or CMOS (Complementary Metal-Oxide Semiconductor, Complimentary Metal-Oxide are partly led
Volume elements part) etc. the raising of element functions and the reduction of size, high image quality for camera lens and miniaturization propose higher
It is required that.Currently, by provide two lens groups formed it is double take the photograph mould group and apply can satisfy on part on portable electronic product
The requirement stated, and realize optical zoom, wide-angle auxiliary, depth of field auxiliary, 3D imaging and augmented reality etc. other singly take the photograph mould group and be difficult to
The function of realization.But it is still incomplete for the application of two camera lenses in the prior art, it can also be realized by double camera lenses of taking the photograph
Various usage scenarios wait for being excavated.Especially double lens groups of taking the photograph are difficult to realize dynamic zoom, but are frequently necessary to lead to
It crosses to merge the image that two lens groups are respectively shot and Zoom effect is simulated with software approach, taken the photograph so as to cause existing pair
The clarity for the image that mould group is absorbed is low, and effect effect is poor.
Summary of the invention
The purpose of the present invention is to provide photography bearing calibration and cameras that one kind takes the photograph lens group more, improve and take the photograph mirror more
The image quality of head group.
For achieving the above object, the present invention provides the photography bearing calibration that one kind takes the photograph lens group more, comprising:
S1. the lens groups taken the photograph in lens group are enabled more and absorb the first images, and generate the based on the first image
One sharpness index；
S2. judge whether the first sharpness index meets preset first threshold condition, if it is not, then enabling described more
Another lens group taken the photograph in lens group absorbs the second image；
S3. the pixel number filled into based on the second image described in the first sharpness index selection to the first image
Amount, completes the correction of the first image.
According to an aspect of the present invention, include: in step S1
S11. the first image is absorbed by the lens groups taken the photograph in lens group more, and the first image is divided
For multiple blocks；
S12. the first image is subjected to conversion and obtains the first grayscale image, and obtain the according to first gray level image
One shade of gray figure；
S13. at least one in the first image is obtained according to first grayscale image and the first shade of gray figure
The first sharpness index of the block.
According to an aspect of the present invention, the first sharpness index are as follows:
Wherein, GmnIt is that maximum gradation value and minimum gradation value are averaged in block, G0It is the flat of all gray values in block
Mean value, gmnIt is that maximum shade of gray value and minimal gray gradient value are averaged in block, g0It is all shade of gray values in block
Average value.
According to an aspect of the present invention, in step S2, the first threshold condition is accounting in the first image
It is less than or equal to preset sharpness threshold value than the first sharpness index among the block more than preset ratio.
According to an aspect of the present invention, in step S2, the first threshold condition is described the of multiple blocks
The sum of one sharpness index is less than or equal to preset sharpness summation threshold value.
According to an aspect of the present invention, in step S2, pass through another lens groups intakes taken the photograph in lens group the more
In the step of two images further include:
S21. second image is mapped to described first according to the consistent block division mode of the first image
Multiple blocks in image；
S22. second image is subjected to conversion and obtains the second grayscale image, and obtain the according to second gray level image
Two shade of gray figures；
S13. at least one in second image is obtained according to second grayscale image and the second shade of gray figure
Second sharpness index of the block.
According to an aspect of the present invention, in step S3, the first sharpness index and second sharpness are based on
The difference of index obtains at least one block of second image for filling into the picture of respective block in the first image
Prime number amount.
According to an aspect of the present invention, in step S3, in the first sharpness index of a block and described the
When the difference of two sharpness indexs is greater than the scheduled sharpness difference upper limit, all pixels in the first image block are replaced
It is changed to the pixel of corresponding block in the second image.
According to an aspect of the present invention, in step S3, when the first sharpness index and second sharpness refer to
When target difference is less than scheduled sharpness difference lower limit, the lens group of intake second image is deactivated.
According to an aspect of the present invention, in step S21, second image is carried out using pre-stored calibration information
The mode of coordinate transform completes mapping with block division mode in the first image by the way of Image Feature Matching.
According to an aspect of the present invention, in step S11, in multiple blocks of the first image, at least one
The size of a block is different from the size of remaining block.
For achieving the above object, the present invention provides the photography bearing calibration that one kind takes the photograph lens group more, comprising:
S1. the first lens groups for taking the photograph lens group are enabled more and shoot the first image, the first image is divided into multiple areas
Block；
S2. the first grayscale image is converted by the first image, and calculates its corresponding first shade of gray figure；
S3. the first sharp of at least one block is calculated by first grayscale image and the first shade of gray figure
Sharp degree index；
S4. preset first threshold condition is unsatisfactory in response to the first sharpness index and enable the camera lens of taking the photograph more
Second lens group of group shoots the second image；And
It is determined at least one described block based on the first sharpness index for being closed with the first image
At second image in pixel quantity.
For achieving the above object, the present invention provides a kind of camera, comprising: take the photograph lens group more, it is described to take the photograph mirror more
Head group includes the first camera lens for obtaining the first image, for obtaining the second camera lens of the second image；
The focal range of first camera lens is different from the focal range of second camera lens；
The first sharpness index is generated based on the first image, and it is pre- to judge whether the first sharpness index meets
If first threshold condition, if it is not, then enabling second camera lens absorbs second image；
Based on the pixel quantity that the second image described in the first sharpness index selection is filled into the first image, and
Correct the first image.
According to an aspect of the present invention, further includes: be mutually electrically connected with first camera lens and second camera lens respectively
The processor connect, the memory being electrically connected to each other with the processor, display for displaying images and communication interface；
The first image and the processor of the intake of first camera lens described in the memory storage are by the first image
Multiple blocks after division；
The first image is carried out conversion and obtains the first grayscale image by the processor, and according to first gray level image
Obtain the first shade of gray figure；
The processor obtains in the first image extremely according to first grayscale image and the first shade of gray figure
The first sharpness index of a few block.
According to an aspect of the present invention, the first sharpness index are as follows:
Wherein, GmnIt is that maximum gradation value and minimum gradation value are averaged in block, G0It is the flat of all gray values in block
Mean value, gmnIt is that maximum shade of gray value and minimal gray gradient value are averaged in block, g0It is all shade of gray values in block
Average value.
According to an aspect of the present invention, it is more than default that the first threshold condition, which is the accounting in the first image,
The first sharpness index among the block of ratio is less than or equal to preset sharpness threshold value.
According to an aspect of the present invention, the first threshold condition is that first sharpness of multiple blocks refers to
The sum of mark is less than or equal to preset sharpness summation threshold value.
According to an aspect of the present invention, the processor is by second image according to consistent with the first image
Block division mode is mapped to multiple blocks in the first image；
Second image is carried out conversion and obtains the second grayscale image by the processor, and according to second gray level image
Obtain the second shade of gray figure；
The processor obtains in second image extremely according to second grayscale image and the second shade of gray figure
Second sharpness index of a few block.
According to an aspect of the present invention, the processor is based on the first sharpness index and second sharpness
The difference of index obtains at least one block of second image for filling into the picture of respective block in the first image
Prime number amount.
According to an aspect of the present invention, refer in the first sharpness index of a block with second sharpness
When target difference is greater than the scheduled sharpness difference upper limit, all pixels in the first image block are replaced with into the second figure
The pixel of corresponding block as in.
According to an aspect of the present invention, when the difference of the first sharpness index and the second sharpness index is small
When scheduled sharpness difference lower limit, second camera lens is deactivated.
According to an aspect of the present invention, second image is coordinately transformed using pre-stored calibration information
Mode completes mapping with block division mode in the first image by the way of Image Feature Matching.
According to an aspect of the present invention, in multiple blocks of the first image, at least one described block
Size be different from the size of remaining block.
For achieving the above object, the present invention provides a kind of camera, comprising:
Take the photograph lens group containing the first lens group and the second lens group more, for storing the memory and processor of image,
Wherein the processor is configured that
It enables first lens group and shoots the storage of the first image in memory；
The first image is divided into multiple blocks；
It converts the first image to after the first grayscale image and calculates its corresponding first shade of gray figure；
Referred to by the first sharpness that first grayscale image and the first shade of gray figure calculate at least one block
Mark；
Preset first threshold condition is unsatisfactory in response to the first sharpness index and enables second lens group
Shoot the second video memory in memory；And
It is determined at least one described block based on the first sharpness index for being closed with the first image
At second image in pixel quantity.
A kind of scheme according to the present invention, by the way that the first image is divided into different size or shape, to realize pair
Part in first image with important feature is divided according to significance level, and ensure that can be quasi- using method of the invention
Really existing that the clarity of important feature is optimized, and then after improving and ensure that image calibration to the calibration accuracy of image
Quality.Meanwhile calculation amount of the invention can be further reduced by above-mentioned division mode, have to the calibration efficiency for improving image
Benefit.
A kind of scheme according to the present invention, while sharpness index is generated using grayscale image and shade of gray figure, and be based on
Sharpness index is burnt by enabling when some or all of first image is fuzzy to assess whether the imaging of the first lens group obscures
The second image is shot away from the second camera lens that range is different from the first lens group, and replaces or synthesize the first image by the second image
In obscure region, so as to realize the effect of zoom.In addition, when helping to reduce operation by block appropriate division
Between and power consumption, can only synthesize a part of block in the first image by means of the present invention, without synthesis whole figure
Picture.Meanwhile the fuzzy region replaced or synthesized for needs is handled, and then in the case where ensure that picture quality, pole
Big reduces calculation amount of the invention, improves computational efficiency.In addition, according to the specific size of sharpness index, to determine
It needs the pixel replacement of block in how many second images or is synthesized in the block of the first image, sharpness is smaller, needs
What is be replaced is more.Therefore, the picture filled into the first image can efficiently and accurately be judged by sharpness index
Prime number amount, so that the calibration process of image be made more to refine, not only less calculation amount, but also ensure that the pixel filled into
Accuracy improves the calibrating quality of image.
A kind of scheme according to the present invention, the definition of above-mentioned sharpness index are based on sum of the grayscale values shade of gray in block
The difference of the extremum of value and all average value.Therefore, smaller by the error in above-mentioned sharpness the index mostly result of calculating, from
And the block can be preferably applied for whether because of judgement out of focus and fuzzy, improve the accurate of deterministic process of the present invention
Property, equally, the calculated result for needing the pixel quantity filled into is also improved, and then to the guarantee present invention to the calibration result of image
It is beneficial.
A kind of scheme according to the present invention flexibly and easily can be directed to difference by setting different first threshold conditions
Scene requires to realize the calibration to the first image, and then improves the flexibility of calibration method of the invention, makes of the invention
Method significantly more efficient can be suitable for several scenes.In addition, can influence according to different first threshold conditions and then effectively
To the precision of image calibration, therefore, method of the invention can also be enable to be suitable for variety classes and school by above-mentioned setting
The processing of the image of quasi- required precision improves the calibration validity of method of the invention.
A kind of scheme according to the present invention can be guaranteed by obtaining the second sharpness index in better Zoom effect
In the case where, the sharpness of image captured by the second lens group can be further calculated, and then can be realized more accurately with
First image compares, and then replacement during making image fill into pixel or synthesis are more accurate, bright particularly with gap
Show biggish some blocks be replaced it is more efficient.
Detailed description of the invention
Fig. 1 schematically shows a kind of step block diagram of embodiment according to the present invention；
Fig. 2 schematically shows a kind of structural block diagram of the camera of embodiment according to the present invention.
Specific embodiment
It, below will be to embodiment in order to illustrate more clearly of embodiment of the present invention or technical solution in the prior art
Needed in attached drawing be briefly described.It should be evident that the accompanying drawings in the following description is only of the invention some
Embodiment for those of ordinary skills without creative efforts, can also be according to these
Attached drawing obtains other attached drawings.
When being described for embodiments of the present invention, term " longitudinal direction ", " transverse direction ", "upper", "lower", " preceding ",
" rear ", "left", "right", "vertical", "horizontal", "top", "bottom" "inner", orientation or positional relationship expressed by "outside" are based on phase
Orientation or positional relationship shown in the drawings is closed, is merely for convenience of description of the present invention and simplification of the description, rather than instruction or dark
Show that signified device or element must have a particular orientation, be constructed and operated in a specific orientation, therefore above-mentioned term cannot
It is interpreted as limitation of the present invention.
The present invention is described in detail with reference to the accompanying drawings and detailed description, embodiment cannot go to live in the household of one's in-laws on getting married one by one herein
It states, but therefore embodiments of the present invention are not defined in following implementation.
As shown in Figure 1, a kind of embodiment according to the present invention, one kind of the invention photography correction sides for taking the photograph lens group more
Method, comprising:
S1. the lens groups taken the photograph in lens group are enabled more and absorb the first image, and is sharp based on the generation first of the first image
Sharp degree index；
S2. judge whether the first sharpness index meets preset first threshold condition, take the photograph lens group if it is not, then enabling more
In another lens group absorb the second image；
S3. the pixel quantity filled into based on first the second image of sharpness index selection to the first image completes the first figure
The correction of picture.
Method of the invention can be used more by taking the photograph lens group realization for two, three or more lens groups.
To elaborate our invention, to have, there are two lens group more to take the photograph camera lens the present invention is described in detail.
A kind of embodiment according to the present invention includes: in step S1
S11. the first image is absorbed by taking the photograph a lens group in lens group more, and the first image is divided into multiple areas
Block.In present embodiment, take the photograph includes the first lens group 11 and the second lens group 12 in lens group more.In the present embodiment, exist
When carrying out image taking, default the first lens group 11 first carries out image taking, and then can be obtained by the first lens group 11
One the first image.In the present embodiment, the first image is multiple blocks, the division of block according to grid dividing model split
It can be carried out according to the characteristics of image of the first image, for example, when carrying out piecemeal to the first image, it can be according to COLOR COMPOSITION THROUGH DISTRIBUTION, face
The different characteristics of image such as portion's identification are divided.Meanwhile during dividing to the first image, also user can be felt emerging
The part division of interest is thinner, and the part such as uninterested edge of user can be divided relatively slightly, for example, having on the first image
There are four when user's interesting part, then thinner division is carried out to the block comprising four interesting parts, be not necessarily to each area
Block is defined as same size.Therefore, in multiple blocks of the first image, the size of at least one block is different from remaining
The size of block.I.e. in multiple blocks of the first image, at least there are two the sizes of block to be different, and is a block
Size be more than or less than another block size.By the way that the first image is divided into different size or shape, to realize
Part in first image with important feature is divided according to significance level, ensure that using method energy of the invention
Enough accurate realize optimize the clarity of important feature, and then improve and ensure that image calibration to the calibration accuracy of image
Quality afterwards.Meanwhile calculation amount of the invention can be further reduced by above-mentioned division mode, the calibration for improving image is imitated
Rate is advantageous.
S12. the first image is subjected to conversion and obtains the first grayscale image, and the first gray scale ladder is obtained according to the first gray level image
Degree figure.In the present embodiment, the first image is converted into the first grayscale image, and by convolution algorithms such as Laplace operators or
Person's calculus of finite differences obtains the first shade of gray figure to calculate the gradient of the first grayscale image.And by obtained first grayscale image and first
Shade of gray figure is stored,
S13. sharp according to first of at least one block in the first grayscale image and the first shade of gray figure the first image of acquisition
Sharp degree index.In the present embodiment, it is obtained according to the first grayscale image of acquisition and the first shade of gray figure every in the first image
A block is that unit calculates respective first sharpness index.Obtain after the first sharpness index can to the first image whether mould
It pastes and image synthesis is needed to be assessed.
Sharpness index is generated by above-mentioned setting, while using grayscale image and shade of gray figure, and is referred to based on sharpness
It is marked with whether assessment the first lens group imaging obscures, when some or all of first image is fuzzy, focal range will be enabled not
Be same as the first lens group the second camera lens shoot the second image, and by the second image replace or synthesize the first image in obscure
Region, so as to realize the effect of zoom.In addition, helping to reduce operation time and power consumption by block appropriate division
Amount, can only synthesize a part of block in the first image by means of the present invention, without synthesizing whole image.Meanwhile
The fuzzy region replaced or synthesized for needs is handled, and then in the case where ensure that picture quality, is greatly reduced
Calculation amount of the invention, improves computational efficiency.In addition, according to the specific size of sharpness index, to determine that needs will be more
The pixel of block is replaced or is synthesized in the block of the first image in few second image, and sharpness is smaller, needs to be replaced
It is more.Therefore, the pixel quantity filled into the first image can efficiently and accurately be judged by sharpness index, from
And refine the calibration process of image more, not only less calculation amount, but also ensure that the accuracy of the pixel filled into, it mentions
The high calibrating quality of image.
A kind of embodiment according to the present invention, the first sharpness index are as follows:
Wherein, GmnIt is that maximum gradation value and minimum gradation value are averaged in block, G0It is the flat of all gray values in block
Mean value, gmnIt is that maximum shade of gray value and minimal gray gradient value are averaged in block, g0It is all shade of gray values in block
Average value.In the present embodiment, above-mentioned first sharpness refers to that target value is smaller and illustrates that edge is fuzzyyer, can be by by
One sharpness index assesses whether to need to enable the shooting of the second lens group 12 compared with opposite or fixed standard of comparison
Second image corrects the first image.Certainly, the definition of the first sharpness index can change, however it is not limited to use above-mentioned restriction
Expression formula.
By above-mentioned setting, the definition of above-mentioned sharpness index be based in block sum of the grayscale values shade of gray value it is extreme
The difference of value and all average value.Therefore, smaller by the error in above-mentioned sharpness the index mostly result of calculating, so as to more
Whether it is applied to the block well because of judgement out of focus and fuzzy, improves the accuracy of deterministic process of the present invention, equally, also
The calculated result for needing the pixel quantity filled into is improved, and then of the invention beneficial to the calibration result of image to guaranteeing.
A kind of embodiment according to the present invention, in step s 2, when judging that the first sharpness index is unsatisfactory for presetting
First threshold condition after, will directly enable the second lens module 12, and shoot second image.In the present embodiment,
First threshold condition be the accounting in the first image be more than preset ratio block among the first sharpness index be less than or
Equal to preset sharpness threshold value.In the present embodiment, it is specified that enabling the Rule of judgment that second lens group 12 is shot
One of, preset ratio can be set to 20%, 40% or 60% etc., preset sharpness threshold value can be set to 15%,
30% or 50% etc..In the present embodiment, the value of the preset ratio in the Rule of judgment, preset sharpness threshold value are according to institute
The case where needing specific photographed scene and be adjusted correspondingly, for example, closely static portrait etc. needs higher resolution
In the case where can make be more than 20% block in sharpness be less than or equal to 15% in the case where, it is just that these sharpness are inadequate
Block enable the second lens group be replaced.And distant view is shot etc. on a large scale without in the case where more fine definition, it can be only
Be more than 60% block in sharpness less than 50% in the case where, enable the second lens group be replaced.
It is first sharp keen to may be arranged as multiple blocks for another embodiment according to the present invention, first threshold condition
It spends the sum of index and is less than or equal to preset sharpness summation threshold value.Define in the present embodiment enable the second lens group into
The two of the Rule of judgment of row shooting, in the case where the first image is for example divided into 144 blocks, if the of all blocks
The sum of one sharpness index is greater than 50, the 60 or 70 summation threshold values for waiting settings, then judges that image integrally needs to correct, will be to all
Block carries out relevant replacement or synthesis.
By above-mentioned setting, different scenes can be flexibly and easily directed to by the different first threshold condition of setting or wanted
The realistic existing calibration to the first image, and then the flexibility of calibration method of the invention is improved, enable method of the invention
It is significantly more efficient to be suitable for several scenes.In addition, can influence according to different first threshold conditions and then effectively to image calibration
Therefore quasi- precision can also enable method of the invention want suitable for variety classes and calibration accuracy by above-mentioned setting
The processing for the image asked improves the calibration validity of method of the invention.
In the present embodiment, it in step S2, is taken the photograph by taking the photograph another lens group in lens group (i.e. the second lens group) more
In the step of taking the second image further include:
S21. the second image is multiple in the first image according to being mapped to the consistent block division mode of the first image
Block.In the present embodiment, the second image carries out first in such a way that pre-stored calibration information is coordinately transformed
The coordinate matching of image and the second image, and the second image is mapped on the first image with the block division mode of the first image
The each block divided.Second image is mapped in the block of the first image by another embodiment according to the present invention
The step of in, can also be completed according to the mode of actual Image Feature Matching.
S22. the second image is subjected to conversion and obtains the second grayscale image, and the second gray scale ladder is obtained according to the second gray level image
Degree figure.
S23. sharp according to second of at least one block in the second grayscale image and the second shade of gray figure the second image of acquisition
Sharp degree index.By obtaining the second sharpness index, it can guarantee in the case where better Zoom effect, can further count
The sharpness of image captured by the second lens group is calculated, and then can be realized and more accurately compared with the first image, in turn
Replacement or synthesis during making image fill into pixel is more accurate, is replaced particularly with the significantly greater some blocks of gap
It changes more efficient.
A kind of embodiment according to the present invention, in step S3, based on first the second image of sharpness index selection to the
The pixel quantity that one image fills into completes the correction of the first image.Therefore, according to first in the fuzzy block of the first image
Sharpness index fills into the pixel in how many second images among the first image to determine.In the present embodiment, to
During one image fills into pixel, pixel is filled into using within a block every a1 pixel insertion b1 from the second image
In the ratio of pixel of corresponding block be replaced, in the first image the pixel of each replacement according to a1/b1 interval
It is inserted within a block.For example, in the block of an a1*a2 size of the first image, with b1*b2 in the second image respective block
It the pixel of quantity and is combined with original pixel of a1*a2-b1*b2 quantity in the first image block.Generally, the second image
In characteristics of image only include a part of the characteristics of image in the first image, therefore might have some areas among the first image
Block can not be compensated by the second lens group.
In the present embodiment, it in step S3, is obtained based on the difference of the first sharpness index and the second sharpness index
For filling into the pixel quantity of respective block in the first image at least one block of second image.In the present embodiment,
Picture is carried out according to the difference of the first sharpness index of the first image in each block and the second sharpness index of the second image
Element replacement, difference is bigger, and the pixel quantity being replaced is also more.
In the present embodiment, it is greater than in the difference of the first sharpness index of a block and the second sharpness index pre-
When the fixed sharpness difference upper limit, all pixels in the first image block are replaced with to the picture of corresponding block in the second image
Element.In the present embodiment, it could dictate that the upper limit of difference between the first sharpness index and the second sharpness index, for example,
50%, 100% equal value, if it exceeds the upper limit, it is believed that the block is disabled in the first image, i.e., by the first figure
The all pixels of the block are replaced with the pixel in the second image as in, below in the upper limit, then can be according to linear side
Formula gradually reduces the pixel quantity being replaced.
In the present embodiment, when the difference of the first sharpness index and the second sharpness index is less than scheduled sharpness
When difference lower limit, the lens group of the second image of intake is deactivated.In the present embodiment, it could dictate that the first sharpness index and second
Poor lower limit between sharpness index, for example, 10% equal value, if in the lower limit hereinafter, if show the sharp keen of the first image
Degree enough, is temporarily not necessarily to be replaced, can deactivate the second lens group, shot merely with the first lens group to save resource, and
It can be with power saving.
It is of the invention to take the photograph lens group as shown in Fig. 2, a kind of embodiment according to the present invention, comprising: for obtaining the more
First camera lens 11 of one image, for obtaining the second camera lens 12 of the second image.In the present embodiment, the coke of the first camera lens 11
Away from range discrimination in the focal range of the second camera lens 12, the i.e. focal range of the focal range of the first camera lens 11 and the second camera lens 12
It is different, the focal range of the second camera lens 12 will be longer than the focal range of the first camera lens 11, so as to guarantee the first camera lens
11 can not be in the case where blur-free imaging, and the second camera lens 12 still being capable of blur-free imaging.Certainly, the present invention can also use more
Lens group carries out image calibration, it is only necessary to choose the lens group of different focal length range, image calibration process and above-mentioned mistake
Cheng Xiangtong, details are not described herein.First camera lens 11 and the second camera lens can use zoom lens.In the present embodiment,
One camera lens 11 is wide-angle lens or conventional camera lens.
As shown in Fig. 2, a kind of embodiment according to the present invention, camera of the invention, comprising: take the photograph lens group 1 more,
With the processor 2 taking the photograph lens group 1 more and being electrically connected to each other, the memory 3 being electrically connected to each other with processor 2 takes the photograph mirror for showing more
The display 4 and communication interface 5 for the image that head group 1 is absorbed.In the present embodiment, take the photograph absorbed in lens group 1 more
One image or the second image are required to be stored by being transported to memory 3 after the processing of processor 2, to guarantee carrying out figure
As calling can be facilitated in calibration process, processing speed of the invention is improved.In the present embodiment, communication interface 5 can adopt
With I/O interface.
As shown in Fig. 2, a kind of embodiment according to the present invention, take the photograph lens group includes for obtaining the first image more
One camera lens 11, for obtaining the second camera lens 12 of the second image.In the present embodiment, the focal range difference of the first camera lens 11
In the focal range of the second camera lens 12, so as to guarantee that the first camera lens 11 can not be in the case where blur-free imaging, the second camera lens 12
It still being capable of blur-free imaging.Certainly, the present invention can also carry out image calibration using more lens groups, it is only necessary to choose different
The lens group of focal range, image calibration process is same as described above, and details are not described herein.First camera lens 11 and
Two camera lenses can use zoom lens.In the present embodiment, the first camera lens 11 is wide-angle lens or conventional camera lens.
In the present embodiment, the first sharpness index is generated based on the first image, and judges that the first sharpness index is
It is no to meet preset first threshold condition, if it is not, then enabling the second camera lens 12 absorbs the second image；
In the present embodiment, the pixel number filled into based on first the second image of sharpness index selection to the first image
Amount, and correct the first image.
As shown in Fig. 2, a kind of embodiment according to the present invention, memory 3 stores the first figure of the first camera lens 11 intake
Picture and processor 2 first image is divided after multiple blocks；In the present embodiment, processor 2 carries out the first image
Conversion obtains the first grayscale image, and obtains the first shade of gray figure according to the first gray level image；In the present embodiment, processor
2 obtain the first sharpness index of at least one block in the first image according to the first grayscale image and the first shade of gray figure.
A kind of embodiment according to the present invention, the first sharpness index are as follows:
Wherein, GmnIt is that maximum gradation value and minimum gradation value are averaged in block, G0It is the flat of all gray values in block
Mean value, gmnIt is that maximum shade of gray value and minimal gray gradient value are averaged in block, g0It is all shade of gray values in block
Average value.
A kind of embodiment according to the present invention, first threshold condition are that the accounting in the first image is more than preset ratio
Block among the first sharpness index be less than or equal to preset sharpness threshold value.
A kind of embodiment according to the present invention, first threshold condition are that the sum of first sharpness index of multiple blocks is small
In or equal to preset sharpness summation threshold value.
A kind of embodiment according to the present invention, processor divide the second image according to the consistent block of the first image
Mode is mapped to multiple blocks in the first image；
In the present embodiment, the second image is carried out conversion and obtains the second grayscale image by processor 2, and according to the second gray scale
Image obtains the second shade of gray figure；
In the present embodiment, processor 2 obtains in the second image extremely according to the second grayscale image and the second shade of gray figure
Second sharpness index of a few block.
A kind of embodiment according to the present invention, processor 2 are based on 2 first sharpness indexs and 2 second sharpness indexs
Difference obtain at least one block of the second image for filling into the pixel quantity of respective block in the first image.
A kind of embodiment according to the present invention, in the first sharpness index and the second sharpness index of a block
When difference is greater than the scheduled sharpness difference upper limit, all pixels in the first image block are replaced with opposite in the second image
Answer the pixel of block.When the difference of the first sharpness index and the second sharpness index is less than scheduled sharpness difference lower limit
When, deactivate the second camera lens 12.
A kind of embodiment according to the present invention, what the second image was coordinately transformed using pre-stored calibration information
Mode completes mapping with block division mode on the first image by the way of Image Feature Matching.
A kind of embodiment according to the present invention, in multiple blocks of the first image, the ruler of at least one block
The very little size for being different from remaining block.
A kind of embodiment according to the present invention, a kind of camera of the invention, comprising:
Lens group 1 is taken the photograph containing the first lens group 11 and the second lens group 12, for storing memory 3 and the place of image more
Device 2 is managed, wherein processor 2 is configured that enabling the first lens group 11 the first image of shooting is stored in memory 3.In this implementation
In mode, the first image is divided into multiple blocks.Convert the first image to after the first grayscale image calculate its corresponding the
One shade of gray figure.The first sharpness index of at least one block is calculated by the first grayscale image and the first shade of gray figure.
Preset first threshold condition is unsatisfactory in response to the first sharpness index and is enabled the second lens group 12 the second image of shooting and is deposited
Reservoir is in memory 3；And it is determined at least one block based on the first sharpness index for being closed with the first image
At the second image in pixel quantity.
Above content is only the example of concrete scheme of the invention, for the equipment and structure of wherein not detailed description, is answered
When being interpreted as that the existing common apparatus in this field and universal method is taken to be practiced.
The foregoing is merely a schemes of the invention, are not intended to restrict the invention, for the technology of this field
For personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (19)
1. a kind of photography bearing calibration for taking the photograph lens group more, comprising:
S1. the lens groups taken the photograph in lens group are enabled more and absorb the first image, and is sharp based on the first image generation first
Sharp degree index；
S2. judge whether the first sharpness index meets preset first threshold condition, if it is not, then enabling the mirror of taking the photograph more
Another lens group in head group absorbs the second image；
S3. the pixel quantity filled into based on the second image described in the first sharpness index selection to the first image, it is complete
At the correction of the first image.
2. photography bearing calibration according to claim 1, which is characterized in that include: in step S1
S11. the first images are absorbed by the lens groups taken the photograph in lens group more, and the first image is divided into more
A block；
S12. the first image is subjected to conversion and obtains the first grayscale image, and the first ash is obtained according to first gray level image
Spend gradient map；
S13. it is obtained described at least one in the first image according to first grayscale image and the first shade of gray figure
The first sharpness index of block.
3. photography bearing calibration according to claim 1 or 2, which is characterized in that the first sharpness index are as follows:
Wherein, GmnIt is that maximum gradation value and minimum gradation value are averaged in block, G0It is the average value of all gray values in block,
gmnIt is that maximum shade of gray value and minimal gray gradient value are averaged in block, g0It is that all shade of gray values are averaged in block
Value.
4. photography bearing calibration according to claim 1, which is characterized in that in step S2, the first threshold condition is
Accounting in the first image is more than that the first sharpness index among the block of preset ratio is less than or equal in advance
If sharpness threshold value；Alternatively, the first threshold condition is that the sum of described first sharpness index of multiple blocks is small
In or equal to preset sharpness summation threshold value.
5. photography bearing calibration according to claim 4, which is characterized in that in step S2, take the photograph lens group by described more
In another lens group absorb the second image the step of in further include:
S21. second image is mapped to the first image according to the consistent block division mode of the first image
In multiple blocks；
S22. second image is subjected to conversion and obtains the second grayscale image, and the second ash is obtained according to second gray level image
Spend gradient map；
S13. it is obtained described at least one in second image according to second grayscale image and the second shade of gray figure
Second sharpness index of block.
6. photography bearing calibration according to claim 5, which is characterized in that in step S3, be based on first sharpness
The difference of index and the second sharpness index obtains at least one block of second image for filling into described the
The pixel quantity of respective block in one image.
7. photography bearing calibration according to claim 6, which is characterized in that in step S3, described the of a block
When the difference of one sharpness index and the second sharpness index is greater than the scheduled sharpness difference upper limit, by first figure
As all pixels replace with the pixel of corresponding block in the second image in the block；
When the difference of the first sharpness index and the second sharpness index is less than scheduled sharpness difference lower limit,
Deactivate the lens group of intake second image.
8. photography bearing calibration according to claim 5, which is characterized in that in step S21, second image is using pre-
Mode that the calibration information first stored is coordinately transformed is completed and the first image by the way of Image Feature Matching
The mapping of upper block division mode.
9. photography bearing calibration according to claim 2, which is characterized in that in step S11, the first image it is multiple
In the block, the size of at least one block is different from the size of remaining block.
10. a kind of photography bearing calibration for taking the photograph lens group more, comprising:
S1. the first lens groups for taking the photograph lens group are enabled more and shoot the first image, the first image is divided into multiple blocks；
S2. the first grayscale image is converted by the first image, and calculates its corresponding first shade of gray figure；
S3. the first sharpness of at least one block is calculated by first grayscale image and the first shade of gray figure
Index；
S4. preset first threshold condition is unsatisfactory in response to the first sharpness index and enable the lens group of taking the photograph more
Second lens group shoots the second image；And
Based on be used to be synthesized with the first image at least one determining described block of the first sharpness index
Pixel quantity in second image.
11. a kind of camera characterized by comprising take the photograph lens group (1), described that take the photograph lens group (1) include for obtaining is more more
The first camera lens (11) for taking the first image, for obtaining the second camera lens (12) of the second image；
The focal range of first camera lens (11) is different from the focal range of second camera lens (12)；
The first sharpness index is generated based on the first image, and it is preset to judge whether the first sharpness index meets
First threshold condition, if it is not, then enabling second camera lens (12) absorbs second image；
Based on the pixel quantity that the second image described in the first sharpness index selection is filled into the first image, and correct
The first image.
12. camera according to claim 11, which is characterized in that further include: respectively with first camera lens (11)
The processor (2) being electrically connected to each other with second camera lens (12), the memory (3) being electrically connected to each other with the processor (2),
Display (4) for displaying images and communication interface (5)；
The first image and the processor (2) that the memory (3) stores the first camera lens (11) intake are by described the
Multiple blocks after the division of one image；
The first image is carried out conversion and obtains the first grayscale image by the processor (2), and according to first gray level image
Obtain the first shade of gray figure；
The processor (2) obtains in the first image at least according to first grayscale image and the first shade of gray figure
The first sharpness index of one block.
13. camera according to claim 11, which is characterized in that the first threshold condition is in first figure
Accounting as in is more than that the first sharpness index among the block of preset ratio is less than or equal to preset sharpness threshold
Value.Alternatively, the first threshold condition is the sum of described first sharpness index of multiple blocks less than or equal to default
Sharpness summation threshold value.
14. camera according to claim 13, which is characterized in that
The processor (2) is described according to being mapped to the consistent block division mode of the first image by second image
Multiple blocks in first image；
Second image is carried out conversion and obtains the second grayscale image by the processor (2), and according to second gray level image
Obtain the second shade of gray figure；
The processor (2) obtains in second image at least according to second grayscale image and the second shade of gray figure
Second sharpness index of one block.
15. camera according to claim 14, which is characterized in that it is sharp keen that the processor (2) is based on described first
The difference of degree index and the second sharpness index obtains described for filling at least one block of second image
The pixel quantity of respective block in first image.
16. camera according to claim 15, which is characterized in that in the first sharpness index of a block
When being greater than the scheduled sharpness difference upper limit with the difference of the second sharpness index, by institute in the first image block
There is pixel to replace with the pixel of corresponding block in the second image；
When the difference of the first sharpness index and the second sharpness index is less than scheduled sharpness difference lower limit,
Deactivate second camera lens (12).
17. camera according to claim 16, which is characterized in that second image uses pre-stored calibration
The mode or completed by the way of Image Feature Matching and block division side in the first image that information is coordinately transformed
The mapping of formula.
18. camera according to claim 12, which is characterized in that in multiple blocks of the first image,
The size of at least one block is different from the size of remaining block.
19. a kind of camera characterized by comprising
Lens group (1) is taken the photograph containing the first lens group (11) and the second lens group (12), for storing the memory (3) of image more
With processor (2), wherein the processor (2) is configured that
The first image of the first lens group (11) shooting is enabled to be stored in memory (3)；
The first image is divided into multiple blocks；
It converts the first image to after the first grayscale image and calculates its corresponding first shade of gray figure；
The first sharpness index of at least one block is calculated by first grayscale image and the first shade of gray figure；
Preset first threshold condition is unsatisfactory in response to the first sharpness index and enables second lens group (12)
The second video memory is shot in memory (3)；And
Based on be used to be synthesized with the first image at least one determining described block of the first sharpness index
Pixel quantity in second image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811307126.8A CN109257540B (en) | 2018-11-05 | 2018-11-05 | Photographing correction method of multi-photographing lens group and photographing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811307126.8A CN109257540B (en) | 2018-11-05 | 2018-11-05 | Photographing correction method of multi-photographing lens group and photographing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109257540A true CN109257540A (en) | 2019-01-22 |
| CN109257540B CN109257540B (en) | 2021-06-18 |
Family
ID=65044116
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811307126.8A Active CN109257540B (en) | 2018-11-05 | 2018-11-05 | Photographing correction method of multi-photographing lens group and photographing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109257540B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112188096A (en) * | 2020-09-27 | 2021-01-05 | 北京小米移动软件有限公司 | Photographing method and device, terminal and storage medium |
| WO2022111461A1 (en) * | 2020-11-27 | 2022-06-02 | 维沃移动通信有限公司 | Recognition method and apparatus, and electronic device |
| CN115348390A (en) * | 2022-08-23 | 2022-11-15 | 维沃移动通信有限公司 | Shooting method and shooting device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402191A (en) * | 2002-09-19 | 2003-03-12 | 上海交通大学 | Multiple focussing image fusion method based on block dividing |
| US20060152803A1 (en) * | 2005-01-11 | 2006-07-13 | Provitola Anthony I | Enhancement of depth perception |
| CN103186894A (en) * | 2013-03-22 | 2013-07-03 | 南京信息工程大学 | Multi-focus image fusion method for self-adaptive partitioning |
| CN103702024A (en) * | 2013-12-02 | 2014-04-02 | 宇龙计算机通信科技(深圳)有限公司 | Image processing device and image processing method |
| CN104299198A (en) * | 2014-10-14 | 2015-01-21 | 嘉应学院 | Fast image defogging method based on dark channels of pixels |
| CN104363379A (en) * | 2014-11-28 | 2015-02-18 | 广东欧珀移动通信有限公司 | Shooting method by use of cameras with different focal lengths and terminal |
| CN105637557A (en) * | 2013-10-18 | 2016-06-01 | 株式会社理光 | Image processing apparatus, image processing system, image processing method, and recording medium |
| CN106331497A (en) * | 2016-08-31 | 2017-01-11 | 宇龙计算机通信科技(深圳)有限公司 | Image processing method and terminal |
| CN106709882A (en) * | 2016-12-16 | 2017-05-24 | 努比亚技术有限公司 | Image fusion method and device |
| CN107872614A (en) * | 2016-09-27 | 2018-04-03 | 中兴通讯股份有限公司 | A kind of image pickup method and filming apparatus |
-
2018
- 2018-11-05 CN CN201811307126.8A patent/CN109257540B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402191A (en) * | 2002-09-19 | 2003-03-12 | 上海交通大学 | Multiple focussing image fusion method based on block dividing |
| US20060152803A1 (en) * | 2005-01-11 | 2006-07-13 | Provitola Anthony I | Enhancement of depth perception |
| CN103186894A (en) * | 2013-03-22 | 2013-07-03 | 南京信息工程大学 | Multi-focus image fusion method for self-adaptive partitioning |
| CN105637557A (en) * | 2013-10-18 | 2016-06-01 | 株式会社理光 | Image processing apparatus, image processing system, image processing method, and recording medium |
| CN103702024A (en) * | 2013-12-02 | 2014-04-02 | 宇龙计算机通信科技(深圳)有限公司 | Image processing device and image processing method |
| CN104299198A (en) * | 2014-10-14 | 2015-01-21 | 嘉应学院 | Fast image defogging method based on dark channels of pixels |
| CN104363379A (en) * | 2014-11-28 | 2015-02-18 | 广东欧珀移动通信有限公司 | Shooting method by use of cameras with different focal lengths and terminal |
| CN106331497A (en) * | 2016-08-31 | 2017-01-11 | 宇龙计算机通信科技(深圳)有限公司 | Image processing method and terminal |
| CN107872614A (en) * | 2016-09-27 | 2018-04-03 | 中兴通讯股份有限公司 | A kind of image pickup method and filming apparatus |
| CN106709882A (en) * | 2016-12-16 | 2017-05-24 | 努比亚技术有限公司 | Image fusion method and device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112188096A (en) * | 2020-09-27 | 2021-01-05 | 北京小米移动软件有限公司 | Photographing method and device, terminal and storage medium |
| WO2022111461A1 (en) * | 2020-11-27 | 2022-06-02 | 维沃移动通信有限公司 | Recognition method and apparatus, and electronic device |
| CN115348390A (en) * | 2022-08-23 | 2022-11-15 | 维沃移动通信有限公司 | Shooting method and shooting device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109257540B (en) | 2021-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9558543B2 (en) | Image fusion method and image processing apparatus | |
| TWI602152B (en) | Image capturing device nd image processing method thereof | |
| CN110473159B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN108055452A (en) | Image processing method, device and equipment | |
| CN107925751A (en) | For multiple views noise reduction and the system and method for high dynamic range | |
| CN103973963B (en) | Image acquisition device and image processing method thereof | |
| CN107948500A (en) | Image processing method and device | |
| CN107948520A (en) | Image processing method and device | |
| JP6308748B2 (en) | Image processing apparatus, imaging apparatus, and image processing method | |
| US20190253593A1 (en) | Photographing Method for Terminal and Terminal | |
| CN108024054A (en) | Image processing method, device and equipment | |
| CN108154514A (en) | Image processing method, device and equipment | |
| CN105678736B (en) | Change the image processing system and its operating method of estimation of Depth with aperture | |
| CN108053363A (en) | Background blurring processing method, device and equipment | |
| US20220270345A1 (en) | Subject detection method and apparatus, electronic device, and computer-readable storage medium | |
| CN109257540A (en) | Take the photograph photography bearing calibration and the camera of lens group more | |
| US20150054986A1 (en) | Image processing apparatus, imaging apparatus, and image processing method | |
| CN108156369A (en) | Image processing method and device | |
| CN111385461B (en) | Panoramic shooting method and device, camera and mobile terminal | |
| CN105657394A (en) | Photographing method based on double cameras, photographing device and mobile terminal | |
| CN108053438A (en) | Depth of field acquisition methods, device and equipment | |
| CN112261292B (en) | Image acquisition method, terminal, chip and storage medium | |
| WO2007075066A1 (en) | Image processor, apparatus and method for lens shading compensation | |
| JP2015088832A (en) | Image processing device, imaging device and image processing method | |
| CN110930440B (en) | Image alignment method, device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |