CN106385541A - Method for realizing zooming through wide-angle photographing component and long-focus photographing component - Google Patents
Method for realizing zooming through wide-angle photographing component and long-focus photographing component Download PDFInfo
- Publication number
- CN106385541A CN106385541A CN201610872244.8A CN201610872244A CN106385541A CN 106385541 A CN106385541 A CN 106385541A CN 201610872244 A CN201610872244 A CN 201610872244A CN 106385541 A CN106385541 A CN 106385541A
- Authority
- CN
- China
- Prior art keywords
- image
- wide
- focal length
- angle
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a method for realizing zooming through a wide-angle photographing component and a long-focus photographing component. The method is applied to an electronic device provided with the wide-angle photographing component and the long-focus photographing component. The electronic device can control the photographing components and can respectively capture a wide-angle image and a long-focus image of the same scenic spot and can respectively perform exposure and white balance adjustment processing on the images so that the exposure and the white balance of the two images are enabled to be consistent; robust image matching operation is performed on the images so that the corresponding pixel points on the images are enabled to be mutually matched; and finally offset deformation is performed on the pixel points of the long-focus image according to the dense optical flow field of the offset of all the pixel points on the long-focus image acquired through the matching operation, and the pixel points are mutually matched with the corresponding pixel points on the wide-angle image and then the pixel points can be fused with the corresponding pixel values on the wide-angle image so that image deformation fusion processing can be completed, and accurate and clear optical zooming can be realized.
Description
Technical field
The present invention is with regard to a kind of image processing method, espespecially a kind of real using wide-angle imaging assembly and focal length camera assembly
The method of now accurate and clear optical zoom.
Background technology
In recent years, advancing by leaps and bounds with electronics technology, the camera function of smart mobile phone is also more and more powerful, and existing by
Gradually replace the trend typically with camera, for Creates Difference, the manufacturer of each categorles mobile phone there's no one who doesn't or isn't exhausts thought, constantly changes
Enter shooting specification and the function of its smart mobile phone, such as：Lifting image picture element, strengthening Self-timer, increasing aperture, enhancing optics are prevented
Tremble (OIS) function, accelerate focusing speed, support manual professional mode etc., though those shooting specifications and improvement functionally are
It is universally implemented on various smart mobile phone, but, the wherein design about " twin-lens " is but had an optimistic view of by industry at present
Hardware trend.
Why will be for the shooting specification of smart mobile phone development " twin-lens " and function？The intelligent hand of configuration " twin-lens "
Which function machine can provide on earth？This careful demand with regard to current smart mobile phone in " twin-lens " design and present situation, illustrate such as
Under：
(1) single-lens shooting limitation：With image sensing chip (such as：CMOS pixel) and precision, lens quality
And the continuous evolution of the characteristic such as later stage algorithm, the camera function of smart mobile phone also becomes stronger day by day, and reached and gradually threaten specialty single
The degree of anti-phase machine, however, compact development trend, but leads to smart mobile phone because being limited to the limit of volume and hardware configuration
System, is only capable of using less camera assembly (being integrated and winner by camera lens and image sensing chip), and those camera assemblies is mostly
Single-lens using fixing large aperture and wide-angle design, do not have optical zoom function.General speech, taking pictures of smart mobile phone is right
As be mostly personage with nearly thing based on, add that occasion is still in the majority with the interior of low light source, large aperture design is shallower because producing
The depth of field, tends to obtain preferable imaging effect, but, but also easily produce the not enough problem of the depth of field, particularly, it is right easily to make
Background beyond burnt main body or prospect thicken unclear, therefore, when shooting the big scape of mountain using current smart mobile phone, institute
The image quality capturing will seem loose and not sharp keen, is also not easily achieved the effect of pull-in time (such as：Shooting flowing water,
Track, star orbital, shadow scribble, luminous point become radiance and other effects), under the sufficient imaging environment of sunny and light source, generally also
Easily produce over-exposed problem.
(2) twin-lens or many camera lenses demand are given birth to because of fortune：In recent years, because various 3D or cinerama are sold fast in the whole world,
Start the fervent demand to 3D or panoramic shooting for the consumer, also allowed the big factory of many smart mobile phones to related research and development and apply more
Increase to regard, and release one after another and can support the smart mobile phone of 3D or panoramic shooting, to provide the shooting application of a new generation, such as：360 degree
Virtual reality (VR) real-time video signal crossfire, long-range augmented reality (AR), the video signal relay of superelevation image quality scene etc., because respectively this is taken the photograph
Supported as application is required for different special lens, the design of twin-lens or many camera lenses is therefore to change one's identity suddenly to become new one
The outfit that must augment for smart mobile phone.
(3) twin-lens technology cannot realize precisely and clearly optical zoom mechanism：This is existed with HTC Corporation
As a example the One M8 type smart mobile phone of first pair of depth of field in the whole world that 2014 release, the twin-lens technology that it is adopted is Altek
The UltraPixel with Duo Camera of Corporation design, this Duo Camera are divided into main lens and secondary mirror head, main
If passing through two camera lens cooperating syringe at the smart mobile phone back side, wherein, the larger main lens charge capture image in lower section, and on
The less secondary mirror head in side is then used for recording environment depth data (depth information), and so, user can be led to afterwards
Cross operate interface to change focusing position；Secondly, the V10 type intelligence hand released in November, 2015 with LG Corporation
As a example machine, in it, have 80 ° of general camera lenses of two 5,000,000 picture elements and 120 ° of bugeye lenses, double front lens design can from
Selection standard or wide-angle view during bat, 120 ° of wide-angle lens can catch whole background, or even group autodynes and all can enter mirror,
80 ° of standard lens then can shoot excellent auto heterodyne feature, and LG Corporation in the 2016 G5 type smart mobile phones delivered, then will
Twin-lens design makes into rearmounted, possesses 78 ° of general camera lenses of 16,000,000 pixels and 135 ° of bugeye lenses of 8,000,000 pixels, its
In, 135 ° of bugeye lenses are provided that the visual angle than broad 1.7 times of other smart mobile phones, and exceed 15 degree of naked eyes visual angle, allow use
Family shoots without long distance, can photograph more and higher scenery easily；Finally, predicted in 2016 with much scientific and technological media
As a example the built-in twin-lens design that Apple Corporation may release on iPhone7, the design of its twin-lens is to use 2
The camera assembly of different focal, makes smart mobile phone can be used in mode standard and the shooting switching of landscape mode.However, no
Precisely and clearly optical zoom mechanism all cannot be realized by aforementioned which kind of twin-lens design.
This fills it and cannot realize accurate and clear optical zoom machine taking the various smart mobile phone that aforementioned twin-lens designs as a example
The true cause of system, the twin-lens mainly arranging thereon is only the wide-angle lens of a standard lens and a large aperture, therefore, is intended to
When realizing optical zoom whereby, in zooming procedure, often there is following point：
(1) main body image of focusing of dolly-out,ing dolly-back is made to thicken unclear：Refer to shown in Fig. 1, because of this standard lens and wide-angle
Camera lens all precisely cannot focus to main body 10 (mineral water body as shown in Figure 1) of dolly-out,ing dolly-back, the main body 10 easily amplified in zoom
The ambiguous image 11 (the word image with the mineral water bottle as shown in Fig. 1 lower right corner) of upper generation.
(2) there is obvious image hopping phenomenon in zooming procedure：Refer to shown in Fig. 2 a to Fig. 2 b, because of this standard mirror
The head and wide-angle lens difference on hardware parameter, such as：The visual field (Field of View, abbreviation FOV) parameter, visual angle
(Picture Angle) parameter etc. and its corresponding image sensing chip are (such as：CMOS size), leads to this standard lens
And the difference existing in image ratio between the image that captured of wide-angle lens, and then corresponding pixel on those images is made to occur
Skew, and in zooming procedure, such as：Zoom rate (zoom ratio) is by 1.79 (as shown in Figure 2 a) to 1.80 (as shown in Figure 2 b)
Zooming procedure in, occur obvious image hopping phenomenon (such as Fig. 2 a and the saltus step difference between xl and x2 shown in Fig. 2 b).
Mentioned above, it is seen with the Development Revolution of current twin-lens smart mobile phone and course, the application of twin-lens and design
Though quite polynary and difference, such as：Lift 3D efficiency, draw high the depth of field, follow the trail of face, ultra-wide angle, supplement picture element, many apertures etc., but
It is, if twin-lens design is intended merely to make up the deficiency of single-lens large aperture wide-angle design, but not possess precisely and clearly
Optical zoom mechanism, then difficulty can be reached the optical zoom function that professional slr camera is provided by it.Accordingly, how to design
A kind of method that utilization twin-lens realizes accurate and clear optical zoom, so that smart mobile phone can amplify to long distance main body zoom
When, clearly zoomed image can not only be obtained, and obvious image hopping phenomenon will not occur in zooming procedure, and make intelligence
Mobile phone possesses excellent optical zoom mechanism, becomes the important topic that here of the present invention to be inquired into.
Content of the invention
The purpose of the present invention, is to provide a kind of method realizing zoom using wide-angle imaging assembly and focal length camera assembly,
The method is to apply to an electronic installation (such as：Smart mobile phone, digital camera or panel computer etc.), this electronic installation is equiped with
One wide-angle imaging assembly and a focal length camera assembly, this wide-angle imaging assembly and this focal length camera assembly can be subject to this electronic installation
Control, simultaneously to same sight spot, capture a wide-angle image (wide-angle image) and a focal length image (long- respectively
Focus image), and this electronic installation can be after reading this wide-angle image and this focal length image, respectively to the execution of those images
One exposure (exposure) and white balance (white balance) adjustment process (adjustment) so that the exposure of the two and
White balance is consistent；Then, a robustness (robust) images match computing is executed to those images so that corresponding on those images
Pixel can be mutually matched；Finally, on this focal length image being obtained according to matching operation, each pixel side-play amount is dense
Optical flow field, enters line displacement deformation to each pixel on this focal length image, so that the pixel energy on this focal length image strained
After pixel corresponding with this wide-angle image is mutually matched one by one, the two can be merged, complete the figure to those images
Distortion of image fusion treatment.
The present invention having the beneficial effects that compared to prior art：
The present invention is to apply to being provided with one of a wide-angle imaging assembly and focal length camera assembly electronic installation, so that
This electronic installation can control those camera assemblies, simultaneously to same sight spot, captures a wide-angle image and a focal length image respectively, and
Those images individually and sequentially can be executed with an exposure and blank level adjustment process, a robustness images match computing and an image
Deformation fusion treatment, and then a clearly zoomed image is presented on this electronic installation, and will not occur in zooming procedure
Significantly image hopping phenomenon, to realize precisely and clearly optical zoom mechanism (optical zoom mechanism).
So, the electronic installation of the present invention, when amplifying to long distance main body zoom, can obtain easily and precisely and clearly become
Burnt image, and obvious image hopping phenomenon will not occur in zooming procedure, and make smart mobile phone possess excellent optics and become
Burnt mechanism.
Brief description
Fig. 1 is the image that background technology is single-lens or twin-lens smart mobile phone Digital Zoom is captured；
Fig. 2 a, Fig. 2 b are the image hopping phenomenon signals of generation during background technology twin-lens smart mobile phone Digital Zoom
Figure；
Fig. 3 is the electronic installation schematic diagram of the present invention；
Fig. 4 is the schematic flow sheet of the present invention；
Fig. 5 is the schematic diagram of camera assembly hardware parameter；
Fig. 6 a to Fig. 6 c is that wide-angle image is become a new wide-angle image by the electronic installation of the present invention with focal length visual fusion
Schematic diagram；And
Fig. 7 a, Fig. 7 b are that the electronic installation of the present invention does not occur the schematic diagram of image saltus step in zooming procedure.
Reference
10th, 60～main body；
11st, 61,62,63～image；
30～electronic installation；
31～wide-angle imaging assembly；
32～focal length camera assembly；
401st, 402,403～step；
L～camera lens；
S～image sensing chip；
M～sight spot.
Specific embodiment
For ease of your juror can to the object of the invention, technical characteristic and its effect, do further understanding with
Solution, this measure embodiment coordinates accompanying drawing, describes in detail as follows：
With electronic apparatus (such as：Smart mobile phone, digital camera or panel computer etc.) more and more popularize, and its function
In the state of more and more comprehensive, when people are using respectively this electronic apparatus filmed image, no longer can be satisfied with simple bat
Camera shooting function, but be more desirable to the shooting process of respectively this electronic apparatus and taken image quality all can match in excellence or beauty senior and
The slr camera of specialty, than if more clearly photograph distant view.However, due to various electronic apparatus at present, for fear of
Its compact size design, the design of single-lens thereon or aforementioned twin-lens, when carrying out vista shot, mostly digital become
Jiao, so to after certain distance, the pixel on its image will thicken unclear, and cannot realize senior specialty slr camera
The effect of upper excellent optical zoom.
In view of this, inventor through research for many years, experiment and continuous improve, just expect using a wide-angle imaging assembly and
One focal length camera assembly, makes electronic apparatus can realize the mechanism of accurate and clear optical zoom easily.
The present invention is to provide one kind to realize accurate and clear optical zoom using wide-angle imaging assembly and focal length camera assembly
Method, the method be application to an electronic installation (such as：Smart mobile phone, digital camera or panel computer etc.), refer to Fig. 3 institute
Show, this electronic installation 30 be equiped with a wide-angle imaging assembly 31 and a focal length camera assembly 32, this wide-angle imaging assembly 31 and
This focal length camera assembly 32 is separately mounted on before this electronic installation 30 or on the back side two adjacent positions, this wide-angle imaging group
Part 31 is by a wide-angle lens (wide-angle lens) and one first image sensing chip (such as：CMOS) formed, this focal length
Camera assembly 32 is then made up of a telephoto lens (long-focus lens) and one second image sensing chip, this wide-angle
The focal length (focal length) of camera lens is less than 50 centimetres of focal lengths of a standard lens.
The focal length of standard lens, this wide-angle imaging assembly 31 and this focal length camera assembly 32 can be subject to this electronic installation 30 respectively
Control, simultaneously to same sight spot, capture a wide-angle image and a focal length image respectively, the method is to make this electronic installation 30 energy
According to the following step, refer to shown in Fig. 4, realize accurate and clear optical zoom mechanism：
(401) this wide-angle image W (x, y) and this focal length image T (x+u, y+v) are read, and respectively to this wide-angle image W
(x, y) and this focal length image T (x+u, y+v) execution one exposure and blank level adjustment are processed, so that the exposure of the two and white balance
Unanimously；The main purpose of this adjustment process be although, this wide-angle imaging assembly 31 and this focal length camera assembly 32 can be simultaneous for
Same sight spot, captures this wide-angle image W (x, y) and this focal length image T (x+u, y+v) respectively, but, because this wide-angle imaging group
Part 31 and this focal length camera assembly 32 are not attached to the same position on this electronic installation 30, but on this electronic installation 30
Two adjacent diverse locations, lead to this wide-angle image W (x, y) and this focal length image T (x+u, y+v) still can be because of the difference of camera angle
Different, and in exposure and white balance, there is some difference, meanwhile, in the corresponding pixel points of this wide-angle image and this focal length image
(pixel) can there is certain deviation amount (u, v) on the position of (x, y).
(402) execution (the robust image matching) computing (algorithm) of one robustness images match so that
This wide-angle image W (x, y) and the upper corresponding pixel (pixel) of this focal length image T (x+u, y+v) can be mutually matched, its practice
It is the hardware parameter according to this wide-angle imaging assembly 31 and this focal length camera assembly 32, refer to shown in Fig. 5, such as：Camera lens L thereon
The visual field (Field of View, the abbreviation FOV) parameter of (that is, this wide-angle lens and this telephoto lens), Tu Jiao (Picture
Angle) parameter, visual angle (Vertical Angle ofView and Horizontal Angle ofView) parameter etc. and its
The size of upper image sensing chip S (that is, this first image sensing chip and this second image sensing chip), is calculated
This sight spot M respectively on this first image sensing chip and this second image sensing chip imaging this wide-angle image W (x, y) and
An image ratio between this focal length image T (x+u, y+v), further according to this image ratio, captures from this wide-angle image W (x, y)
Go out the region (hereinafter referred to as " corresponding wide-angle image W (x, y) ") corresponding with this focal length image T (x+u, y+v), then, adopt
With optical flow method (optical flow estimation), such as estimate the energy side of model according to following Horn-Schunck optical flow method
Formula (this is at present more ripe and general algorithm, but when the present invention actual applies it is not limited to this), light stream is estimated
Meter is converted into asking for the minimum optimization process of error, to obtain dense optical flow field (dense optical flow field), and
It is directed to this corresponding wide-angle image W (x, y) according to this and carry out robustness images match computing with this focal length image T (x+u, y+v), so that
This corresponding wide-angle image W (x, y) can be mutually corresponding one by one with the pixel in this focal length image T (x+u, y+v)：
Wherein, Section 1 is a data item, represents gray value conservation constraints, is this correspondence wide-angle image after making registration
W (x, y) is as identical as possible with this focal length image T (x+u, y+v) each corresponding pixel upper, is error function；Section 2
Being a smooth item, representing light stream smoothness constraint, because being to be not enough to complete dense matching only with this data item, such as：To this correspondence
Wide-angle image W (x, y) and the pixel of the upper solid color regions of this focal length image T (x+u, y+v), are only to be looked for by this data item
To accurate side-play amount, therefore, it is also desirable to add this smooth item, so that this corresponding wide-angle image W (x, y) and this focal length image T
The side-play amount difference of (x+u, y+v) upper two neighboring feature pixel will not be too big, it is, the rate of change of side-play amount can not be too
Greatly, α is weight factor, for controlling the weight of this data item and this smooth item, to improve the light stream in various complex scene
Estimated accuracy, its value can set based on experience value, also can dynamic change according to the actual requirements, be also error function.Those errors
Function, can be according to different demands, the function that takes absolute value, quadratic function or non-negative be symmetrical and positive axis monotonically increasing function etc.,
In the subsequently shown embodiment of the present invention, for the sake of convenience of calculation, take is quadratic function, in order to carry out extreme value solution,
But when the present invention actual applies it is not limited to this.Then long for the mould of side-play amount gradient.Additionally, aforementioned light
The hypotheses of stream method are：
(1) brightness constancy between this corresponding wide-angle image W (x, y) and this focal length image T (x+u, y+v)；
(2) this corresponding wide-angle image W (x, y) is micro- with the movement differential of the interior corresponding pixel points of this focal length image T (x+u, y+v)
Little；
(3) this corresponding wide-angle image W (x, y) and the interior corresponding pixel points of this focal length image T (x+u, y+v) have identical fortune
Moving vector.
Because this corresponding wide-angle image W (x, y) is that synchronization obtains to same sight spot with this focal length image T (x+u, y+v)
The image taking, therefore, should be able to meet the hypotheses of aforementioned optical flow method easily；So, robustness figure to be done is to matching operation
Afterwards, according to above-listed energy equation, can obtain this focal length image T (x+u, y+v) each pixel side-play amount upper one is dense
Optical flow field.
(403) execution one anamorphose fusion treatment (image morphing fusion), its way is according to aforementioned fortune
Calculate the dense optical flow field of the upper each pixel side-play amount of this focal length image T (x+u, y+v) of being obtained, to this focal length image T (x+u,
Y+v) upper each pixel enters line displacement deformation, so that the pixel on strained this focal length image T (x+u, y+v) can be right with this
Answer the pixel mutual Corresponding matching one by one on wide-angle image W (x, y), so, strained this focal length image T (x+u, y+v)
Can according to demand, by a weights λ, wide-angle image W (x, y) corresponding with this carries out following fusion, to obtain a new correspondence
Wide-angle image WNEW：
WNEW=(1- λ) T (x+u, y+v)+λ * W (x, y)
Wherein, depending on this weights λ is according to the actual requirements, such as：Picture on strained this focal length image T (x+u, y+v)
When corresponding pixel is clear in vegetarian refreshments relatively this correspondence wide-angle image W (x, y), λ=0 can be taken, transitional region therebetween then may be used
To take 0 ＜ λ ＜ 1.0, treat pixel on strained this focal length image T (x+u, y+v) can wide-angle image W corresponding with this (x,
Y), after the pixel on corresponds to one by one, the pixel value that can directly choose on strained this focal length image T (x+u, y+v) replaces
Pixel value on this corresponding wide-angle image W (x, y), completes the deformation fusion treatment of image；As on this wide-angle image W (x, y)
The pixel that (in addition to this correspondence wide-angle image) does not match, also can pass through image enhancement processing, strengthen its visual effect.
So, in the present invention although this being used on this wide-angle imaging assembly 31 and this focal length camera assembly 32 is wide
Angle mirror head and this telephoto lens are all tight shot respectively, and this electronic installation 30 is all only capable of respectively to this wide-angle image W (x, y)
And this focal length image T (x+u, y+v) execution Digital Zoom, but, once really it has been observed that this wide-angle imaging assembly 31 and this focal length
Image ratio after the hardware parameter of camera assembly 32 is determined, between this wide-angle image W (x, y) and this focal length image T (x+u, y+v)
Rate is determined, such as：1.8 or 2.3, the present invention, in the verification process of subsequent embodiment, is all taking image ratio 1.8 as a example,
Illustrate.
Accordingly, refer to shown in Fig. 6 a to Fig. 6 c, if user is operating this electronic installation 30 execution Digital Zoom (its zoom
Rate (zoom ratio) be 0～3.0) when, when this wide-angle imaging assembly 31 zoom produces the wide-angle image shown in Fig. 6 a although
This wide-angle imaging assembly 31 precisely cannot focus to main body 60 (mineral water body as shown in Figure 6 a) therein, leads to zoom to be put
Ambiguous image 61 (the word image with mineral water bottle as shown in Fig. 6 a lower right corner) is produced on big main body 60, but
It is, now because this focal length camera assembly 32 precisely can focus to main body 60 (mineral water body as shown in Figure 6 b) therein, therefore
When this focal length camera assembly 32 zoom produces the focal length image shown in Fig. 6 b, the image 62 in the main body 60 that zoom amplifies is (as schemed
Word image with mineral water bottle shown in the 6b lower right corner) still keep clearly incomparable, therefore, by the method for the present invention,
After this wide-angle image and focal length visual fusion, in the main body 60 (mineral water body as fig. 6 c) in new wide-angle image
Image 63 (the word image with mineral water bottle as shown in Fig. 6 c lower right corner) will keep clearly incomparable, and no any mould
Paste unclear problem.
Additionally, when user passes through the method for the present invention, during to this electronic installation 30 execution Digital Zoom, referring to Fig. 7 a
To shown in Fig. 7 b, this with zoom rate (zoom ratio) by 1.79 (as shown in Figure 7a) to 1.80 (as shown in Figure 7b) zoom mistake
As a example journey, also can clearly find entirely without any obvious image hopping phenomenon.Accordingly, the method for the present invention, makes this electricity really
Sub-device 30 possesses precisely and clearly excellent optical zoom mechanism, the optical zoom that the professional slr camera that can match in excellence or beauty is provided
Function.
The above, be only presently preferred embodiments of the present invention, but, the interest field that the present invention is advocated, do not limit to
In this, those skilled in the art, according to disclosed herein technology contents, can think easily and equivalence changes, all should belong to not
Depart from the protection category of the present invention.
Claims (9)
1. a kind of method realizing zoom using wide-angle imaging assembly and focal length camera assembly, the method is to apply to fill to an electronics
Put, this electronic installation is equiped with a wide-angle imaging assembly and a focal length camera assembly it is characterised in that this wide-angle imaging assembly
Lens focus be less than 50 centimetres of focal lengths of a standard lens, the lens focus of this focal length camera assembly are then greater than this standard
The focal length of camera lens, this wide-angle imaging assembly and this focal length camera assembly can be controlled by this electronic installation, simultaneously to same sight spot,
Capture a wide-angle image and a focal length image respectively, the method is to make this electronic installation can realize precisely and clear according to the following step
Clear optical zoom mechanism：
Read this wide-angle image and this focal length image, and respectively this wide-angle image and this focal length image execution one are exposed and put down in vain
Weighing apparatus adjustment is processed, so that the exposure of the two is consistent with white balance；
One robustness images match computing is executed to this wide-angle image and this focal length image so that pixel on this focal length image
Can be mutually matched with corresponding pixel on this wide-angle image；And
One anamorphose fusion treatment is executed to pixel corresponding on the pixel on this focal length image and this wide-angle image, with
Produce a new wide-angle image.
2. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 1, its feature
It is, this robustness images match computing is the hardware parameter according to this wide-angle imaging assembly and this focal length camera assembly, calculate
Go out the image ratio between this wide-angle image and this focal length image, and according to this image ratio, capture from this wide-angle image
With the region of this focal length image mapping, then, using an optical flow method, calculate on this focal length image pixel with respect to this wide-angle
The dense optical flow field of a side-play amount of corresponding pixel points on image.
3. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 2, its feature
It is, this anamorphose fusion treatment is the dense of the side-play amount (u, v) according to the upper pixel of this focal length image T (x+u, y+v)
Optical flow field, to this focal length image T (x+u, y+v), upper pixel enters line displacement deformation, so that strained this focal length image T (x+
U, y+v) on pixel upper corresponding pixel can be mutually matched with this wide-angle image W (x, y), and according to following equation, to this
Focal length image T (x+u, y+v) and this wide-angle image W (x, y) are merged, to obtain this new wide-angle image WNEW：
WNEW=(1- λ) T (x+u, y+v)+λ * W (x, y)
Wherein, λ is weights.
4. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 3, its feature
It is, when the upper corresponding pixel of pixel relatively this wide-angle image W (x, y) on strained this focal length image T (x+u, y+v)
When clear, take λ=0, then take 0 ＜ λ ＜ 1.0 for other pixels.
5. the utilization wide-angle imaging assembly according to any one of claim 2 to 4 and focal length camera assembly realize the side of zoom
Method, it is characterised in that this optical flow method is to estimate the following energy equation of model by an optical flow method, light stream is estimated to be converted into
Ask for the minimum optimization process of error, to obtain this dense optical flow field：
Wherein, Section 1It is a data item, represent gray value conservation constraints, be to make registration
This wide-angle image W (x, y) afterwards is as identical as possible with this focal length image T (x+u, y+v) each corresponding pixel upper,It is by mistake
Difference function；Section 2It is a smooth item, represent light stream smoothness constraint, so that this wide-angle image W (x,
Y) will not differ too big with the side-play amount of the upper two adjacent pixels of this focal length image T (x+u, y+v), α is for controlling this
Data item and the weight of this smooth item, to improve the light stream estimated accuracy in various complex scene, ψ is also error function,Then long for the mould of side-play amount gradient.
6. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 5, wherein, should
Error functionψ is a quadratic function.
7. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 6, its feature
It is, the hypotheses of this optical flow method are that the upper pixel of this focal length image T (x+u, y+v) is upper with this wide-angle image W (x, y) right
Answer the brightness constancy between pixel.
8. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 7, its feature
It is, the hypotheses of this optical flow method are that the upper pixel of this focal length image T (x+u, y+v) is upper with this wide-angle image W (x, y) right
Answer the movement differential between pixel small.
9. the method realizing zoom using wide-angle imaging assembly and focal length camera assembly according to claim 8, its feature
It is, the hypotheses of this optical flow method are that the upper pixel of this focal length image T (x+u, y+v) is upper with this wide-angle image W (x, y) right
Answer and there is between pixel identical motion vector.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610872244.8A CN106385541A (en) | 2016-09-30 | 2016-09-30 | Method for realizing zooming through wide-angle photographing component and long-focus photographing component |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610872244.8A CN106385541A (en) | 2016-09-30 | 2016-09-30 | Method for realizing zooming through wide-angle photographing component and long-focus photographing component |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106385541A true CN106385541A (en) | 2017-02-08 |
Family
ID=57937170
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610872244.8A Pending CN106385541A (en) | 2016-09-30 | 2016-09-30 | Method for realizing zooming through wide-angle photographing component and long-focus photographing component |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106385541A (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107371007A (en) * | 2017-07-25 | 2017-11-21 | 广东欧珀移动通信有限公司 | White balancing treatment method, device and terminal |
| CN107948505A (en) * | 2017-11-14 | 2018-04-20 | 维沃移动通信有限公司 | A kind of panorama shooting method and mobile terminal |
| CN107979726A (en) * | 2017-11-28 | 2018-05-01 | 信利光电股份有限公司 | The matching method and full shot of a kind of full shot |
| CN108377342A (en) * | 2018-05-22 | 2018-08-07 | Oppo广东移动通信有限公司 | double-camera photographing method, device, storage medium and terminal |
| CN108737739A (en) * | 2018-06-15 | 2018-11-02 | Oppo广东移动通信有限公司 | A kind of preview screen acquisition method, preview screen harvester and electronic equipment |
| CN108965719A (en) * | 2018-08-08 | 2018-12-07 | 杭州赛翁思科技有限公司 | A kind of image processing method and device |
| WO2019019923A1 (en) * | 2017-07-25 | 2019-01-31 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and device for adjusting white balance and storage medium |
| CN109937568A (en) * | 2016-11-17 | 2019-06-25 | 索尼公司 | Image processing apparatus and image processing method |
| WO2019148996A1 (en) * | 2018-01-31 | 2019-08-08 | Oppo广东移动通信有限公司 | Image processing method and device, storage medium, and electronic apparatus |
| CN110365894A (en) * | 2018-03-26 | 2019-10-22 | 联发科技股份有限公司 | The method and relevant apparatus of image co-registration in camera system |
| CN110493539A (en) * | 2019-08-19 | 2019-11-22 | Oppo广东移动通信有限公司 | Automatic exposure processing method, processing unit and electronic equipment |
| CN110855883A (en) * | 2019-11-05 | 2020-02-28 | 浙江大华技术股份有限公司 | Image processing system, method, device equipment and storage medium |
| CN110868541A (en) * | 2019-11-19 | 2020-03-06 | 展讯通信（上海）有限公司 | Visual field fusion method and device, storage medium and terminal |
| CN111294505A (en) * | 2019-07-19 | 2020-06-16 | 展讯通信（上海）有限公司 | Image processing method and device |
| CN111510618A (en) * | 2019-01-30 | 2020-08-07 | 虹软科技股份有限公司 | Zooming method and electronic equipment applying same |
| CN111563552A (en) * | 2020-05-06 | 2020-08-21 | 浙江大华技术股份有限公司 | Image fusion method and related equipment and device |
| CN112118393A (en) * | 2019-06-19 | 2020-12-22 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
| KR20210032922A (en) * | 2019-09-10 | 2021-03-25 | 베이징 시아오미 모바일 소프트웨어 컴퍼니 리미티드 | Image processing method, device, device and media based on multiple camera modules |
| CN112584034A (en) * | 2019-09-30 | 2021-03-30 | 虹软科技股份有限公司 | Image processing method, image processing device and electronic equipment applying same |
| US11140327B2 (en) | 2018-06-28 | 2021-10-05 | Aver Information Inc. | Image-capturing device and method for operating image-capturing system of two cameras |
| CN114205515A (en) * | 2020-09-18 | 2022-03-18 | 荣耀终端有限公司 | Anti-shake processing method for video and electronic equipment |
| EP4040776A1 (en) * | 2017-07-10 | 2022-08-10 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for inhibiting aec value jump, and terminal device |
| US11758265B2 (en) | 2020-03-03 | 2023-09-12 | Honor Device Co., Ltd. | Image processing method and mobile terminal |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060175549A1 (en) * | 2005-02-09 | 2006-08-10 | Miller John L | High and low resolution camera systems and methods |
| US20080030592A1 (en) * | 2006-08-01 | 2008-02-07 | Eastman Kodak Company | Producing digital image with different resolution portions |
| CN103109524A (en) * | 2010-09-24 | 2013-05-15 | 英特尔公司 | Zoom camera image blending technique |
| CN103247058A (en) * | 2013-05-13 | 2013-08-14 | 北京工业大学 | Fast optical flow field calculation method based on error-distributed multilayer grid |
| CN103871056A (en) * | 2014-03-11 | 2014-06-18 | 南京信息工程大学 | Anisotropic optical flow field and deskew field-based brain MR (magnetic resonance) image registration method |
| US20150207999A1 (en) * | 2014-01-17 | 2015-07-23 | Samsung Electronics Co., Ltd. | Method and apparatus for compositing image by using multiple focal lengths for zooming image |
| US20160028949A1 (en) * | 2014-07-25 | 2016-01-28 | Samsung Electronics Co., Ltd. | Image photographing apparatus and image photographing method |
| CN105308947A (en) * | 2013-06-13 | 2016-02-03 | 核心光电有限公司 | Dual aperture zoom digital camera |
-
2016
- 2016-09-30 CN CN201610872244.8A patent/CN106385541A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060175549A1 (en) * | 2005-02-09 | 2006-08-10 | Miller John L | High and low resolution camera systems and methods |
| US20080030592A1 (en) * | 2006-08-01 | 2008-02-07 | Eastman Kodak Company | Producing digital image with different resolution portions |
| CN103109524A (en) * | 2010-09-24 | 2013-05-15 | 英特尔公司 | Zoom camera image blending technique |
| CN103247058A (en) * | 2013-05-13 | 2013-08-14 | 北京工业大学 | Fast optical flow field calculation method based on error-distributed multilayer grid |
| CN105308947A (en) * | 2013-06-13 | 2016-02-03 | 核心光电有限公司 | Dual aperture zoom digital camera |
| US20150207999A1 (en) * | 2014-01-17 | 2015-07-23 | Samsung Electronics Co., Ltd. | Method and apparatus for compositing image by using multiple focal lengths for zooming image |
| CN103871056A (en) * | 2014-03-11 | 2014-06-18 | 南京信息工程大学 | Anisotropic optical flow field and deskew field-based brain MR (magnetic resonance) image registration method |
| US20160028949A1 (en) * | 2014-07-25 | 2016-01-28 | Samsung Electronics Co., Ltd. | Image photographing apparatus and image photographing method |
Non-Patent Citations (4)
| Title |
|---|
| 张枝军: "《网店商品图像信息与视觉设计》", 31 January 2015 * |
| 朱璐瑶: "改进的Horn_Schunck光流法在目标追踪中的应用", 《中国体视学与图像分析》 * |
| 田中希美男: "《数码单反摄影从入门到精通 镜头篇》", 30 June 2011 * |
| 苏松志等: "《行人检测 理论与实践》", 31 March 2016 * |
Cited By (43)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109937568A (en) * | 2016-11-17 | 2019-06-25 | 索尼公司 | Image processing apparatus and image processing method |
| CN109937568B (en) * | 2016-11-17 | 2021-03-09 | 索尼公司 | Image processing apparatus, image processing method, and program |
| EP4040776A1 (en) * | 2017-07-10 | 2022-08-10 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for inhibiting aec value jump, and terminal device |
| WO2019019923A1 (en) * | 2017-07-25 | 2019-01-31 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and device for adjusting white balance and storage medium |
| US10455206B2 (en) | 2017-07-25 | 2019-10-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd | Method and device for adjusting white balance and storage medium |
| CN107371007A (en) * | 2017-07-25 | 2017-11-21 | 广东欧珀移动通信有限公司 | White balancing treatment method, device and terminal |
| US11412195B2 (en) | 2017-07-25 | 2022-08-09 | Shenzhen Heytap Technology Corp., Ltd. | Method and device for adjusting white balance and storage medium |
| CN107948505A (en) * | 2017-11-14 | 2018-04-20 | 维沃移动通信有限公司 | A kind of panorama shooting method and mobile terminal |
| CN107948505B (en) * | 2017-11-14 | 2020-06-23 | 维沃移动通信有限公司 | Panoramic shooting method and mobile terminal |
| CN107979726B (en) * | 2017-11-28 | 2020-05-22 | 信利光电股份有限公司 | Panoramic lens pairing method and panoramic lens |
| CN107979726A (en) * | 2017-11-28 | 2018-05-01 | 信利光电股份有限公司 | The matching method and full shot of a kind of full shot |
| WO2019148996A1 (en) * | 2018-01-31 | 2019-08-08 | Oppo广东移动通信有限公司 | Image processing method and device, storage medium, and electronic apparatus |
| CN110365894A (en) * | 2018-03-26 | 2019-10-22 | 联发科技股份有限公司 | The method and relevant apparatus of image co-registration in camera system |
| CN110365894B (en) * | 2018-03-26 | 2021-05-07 | 联发科技股份有限公司 | Method for image fusion in camera device and related device |
| CN108377342A (en) * | 2018-05-22 | 2018-08-07 | Oppo广东移动通信有限公司 | double-camera photographing method, device, storage medium and terminal |
| CN108737739A (en) * | 2018-06-15 | 2018-11-02 | Oppo广东移动通信有限公司 | A kind of preview screen acquisition method, preview screen harvester and electronic equipment |
| US11140327B2 (en) | 2018-06-28 | 2021-10-05 | Aver Information Inc. | Image-capturing device and method for operating image-capturing system of two cameras |
| CN108965719A (en) * | 2018-08-08 | 2018-12-07 | 杭州赛翁思科技有限公司 | A kind of image processing method and device |
| CN108965719B (en) * | 2018-08-08 | 2021-05-28 | 常山赛翁思智能科技有限公司 | Image processing method and device |
| CN111510618B (en) * | 2019-01-30 | 2022-04-05 | 虹软科技股份有限公司 | Zooming method and electronic equipment applying same |
| CN111510618A (en) * | 2019-01-30 | 2020-08-07 | 虹软科技股份有限公司 | Zooming method and electronic equipment applying same |
| US11490016B2 (en) | 2019-01-30 | 2022-11-01 | Arcsoft Corporation Limited | Zooming method and electronic device using the same |
| CN112118393B (en) * | 2019-06-19 | 2022-03-15 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
| CN112118393A (en) * | 2019-06-19 | 2020-12-22 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
| WO2021012766A1 (en) * | 2019-07-19 | 2021-01-28 | 展讯通信（上海）有限公司 | Image processing method and apparatus |
| CN111294505B (en) * | 2019-07-19 | 2021-05-04 | 展讯通信（上海）有限公司 | Image processing method and device |
| US11792518B2 (en) | 2019-07-19 | 2023-10-17 | Spreadtrum Communications (Shanghai) Co., Ltd. | Method and apparatus for processing image |
| CN111294505A (en) * | 2019-07-19 | 2020-06-16 | 展讯通信（上海）有限公司 | Image processing method and device |
| CN110493539A (en) * | 2019-08-19 | 2019-11-22 | Oppo广东移动通信有限公司 | Automatic exposure processing method, processing unit and electronic equipment |
| US11070744B2 (en) | 2019-09-10 | 2021-07-20 | Beijing Xiaomi Mobile Software Co., Ltd. | Method for image processing based on multiple camera modules, electronic device, and storage medium |
| KR20210032922A (en) * | 2019-09-10 | 2021-03-25 | 베이징 시아오미 모바일 소프트웨어 컴퍼니 리미티드 | Image processing method, device, device and media based on multiple camera modules |
| KR102278474B1 (en) | 2019-09-10 | 2021-07-20 | 베이징 시아오미 모바일 소프트웨어 컴퍼니 리미티드 | Multi-camera module-based image processing method, device, device and medium |
| CN112584034A (en) * | 2019-09-30 | 2021-03-30 | 虹软科技股份有限公司 | Image processing method, image processing device and electronic equipment applying same |
| CN112584034B (en) * | 2019-09-30 | 2023-04-07 | 虹软科技股份有限公司 | Image processing method, image processing device and electronic equipment applying same |
| WO2021063245A1 (en) * | 2019-09-30 | 2021-04-08 | 虹软科技股份有限公司 | Image processing method and image processing apparatus, and electronic device applying same |
| CN110855883B (en) * | 2019-11-05 | 2021-07-20 | 浙江大华技术股份有限公司 | Image processing system, method, device equipment and storage medium |
| CN110855883A (en) * | 2019-11-05 | 2020-02-28 | 浙江大华技术股份有限公司 | Image processing system, method, device equipment and storage medium |
| CN110868541A (en) * | 2019-11-19 | 2020-03-06 | 展讯通信（上海）有限公司 | Visual field fusion method and device, storage medium and terminal |
| US11758265B2 (en) | 2020-03-03 | 2023-09-12 | Honor Device Co., Ltd. | Image processing method and mobile terminal |
| CN111563552A (en) * | 2020-05-06 | 2020-08-21 | 浙江大华技术股份有限公司 | Image fusion method and related equipment and device |
| CN111563552B (en) * | 2020-05-06 | 2023-09-05 | 浙江大华技术股份有限公司 | Image fusion method, related device and apparatus |
| CN114205515A (en) * | 2020-09-18 | 2022-03-18 | 荣耀终端有限公司 | Anti-shake processing method for video and electronic equipment |
| US11750926B2 (en) | 2020-09-18 | 2023-09-05 | Honor Device Co., Ltd. | Video image stabilization processing method and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106385541A (en) | Method for realizing zooming through wide-angle photographing component and long-focus photographing component | |
| US10432869B2 (en) | Method of utilizing wide-angle image capturing element and long-focus image capturing element for achieving clear and precise optical zooming mechanism | |
| US10425638B2 (en) | Equipment and method for promptly performing calibration and verification of intrinsic and extrinsic parameters of a plurality of image capturing elements installed on electronic device | |
| WO2015161698A1 (en) | Image shooting terminal and image shooting method | |
| CN102761706B (en) | Imaging device and imaging method | |
| CN110493525B (en) | Zoom image determination method and device, storage medium and terminal | |
| CN108432230B (en) | Imaging device and method for displaying an image of a scene | |
| KR101720190B1 (en) | Digital photographing apparatus and control method thereof | |
| CN107925751A (en) | For multiple views noise reduction and the system and method for high dynamic range | |
| CN108024058B (en) | Image blurs processing method, device, mobile terminal and storage medium | |
| CN105141841B (en) | Picture pick-up device and its method | |
| JP2015231220A (en) | Image processing apparatus, imaging device, image processing method, imaging method and program | |
| CN107800979A (en) | High dynamic range video image pickup method and filming apparatus | |
| CN105872356A (en) | Imaging apparatus and imaging method | |
| EP4169240A1 (en) | Multiple camera system for wide angle imaging | |
| US20160292842A1 (en) | Method and Apparatus for Enhanced Digital Imaging | |
| WO2023086694A1 (en) | Image modification techniques | |
| JP2016208075A (en) | Image output device, method for controlling the same, imaging apparatus, and program | |
| CN106303202A (en) | A kind of image information processing method and device | |
| WO2022247731A1 (en) | Camera, photographing method, terminal and storage medium | |
| US11330204B1 (en) | Exposure timing control for multiple image sensors | |
| JP2016134886A (en) | Imaging apparatus and control method thereof | |
| US20130321690A1 (en) | Methods and Apparatus for Refocusing via Video Capture | |
| US11825207B1 (en) | Methods and systems for shift estimation for one or more output frames | |
| US20230370727A1 (en) | High dynamic range (hdr) image generation using a combined short exposure image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180306 Address after: 310012 room B, block A, block A, No. three, Paradise Software Park, West Dou Gate Road, Xihu District, Hangzhou, Zhejiang Applicant after: ArcSoft (Hangzhou) Multimedia Technology Company Limited Address before: 310000 building A, No. 3, No. 3, Paradise Software Park, West Dou Gate Road, Xihu District, Zhejiang Applicant before: ArcSoft Hangzhou Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 310000 Building 22 and 23 of Paradise Software Park A, No. 3 Xidoumen Road, Xihu District, Hangzhou City, Zhejiang Province Applicant after: Hongsoft Technology Co., Ltd. Address before: Room B, 20th floor, Building A, Paradise Software Park, No. 3 Xidoumen Road, Xihu District Applicant before: ArcSoft (Hangzhou) Multimedia Technology Company Limited |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170208 |