CN107277387A - High dynamic range images image pickup method, terminal and computer-readable recording medium - Google Patents

Abstract

The invention provides a kind of high dynamic range images image pickup method, mobile terminal and computer-readable recording medium, wherein, high dynamic range images image pickup method includes：First camera and the second camera is controlled to gather preview image respectively, and the preview image that first camera is gathered is included in shooting preview interface；Obtain the M frame preview images of the first camera collection；Alignment synthesis processing is carried out to the M frames preview image, the first image is generated；Obtain the N frame preview images of the second camera collection；High dynamic range images synthesis processing is carried out to the N frames preview image, the second image is generated；Alignment synthesis processing is carried out to described first image and second image, high dynamic range images are generated.This programme meets wide dynamic range and high definition image quality demand simultaneously, and realizes the live preview of processing procedure.

Description

High dynamic range images image pickup method, terminal and computer-readable recording medium

Technical field

The present invention relates to communication technical field, more particularly to a kind of high dynamic range images image pickup method, mobile terminal and Computer-readable recording medium.

Background technology

HDR is HDR (High-Dynamic Range) abbreviation, compared to common image, and HDR can be provided More dynamic ranges and image detail, and image seen by person is relatively.The existing general embodiment of HDR technologies For：Open camera and be switched to HDR patterns；Run the 3A algorithms of acquiescence；Click is taken pictures；Different EV values (exposure value) are set, Capture the RAW data (initial data) of a normal exposure, the RAW data of an overexposure, the deficient RAW data exposed；Into Image-signal processor (ISP)；Get the yuv data of a normal exposure, the yuv data of an overexposure, one is owed what is exposed Yuv data；One yuv data of HDR algorithms synthesis->H:JPEG compression is simultaneously preserved.

Night scene mode is to reach more details and less noise based on multiformat film synthesis.Existing night scene mode skill The general implementation of art is：Open camera and be switched to night scene mode；Run the 3A algorithms of acquiescence；Click is taken pictures；Crawl is current The RAW data of frame and before this N-1 frames；Into image-signal processor (ISP), distribution obtains N frames by pretreatment (Raw domains) YUV；Most clearly frame benchmark the most in N frames is extracted, other N-1 frames, which are alignd and synthesized with it one, exports YUV；On The YUV that one operation is obtained carries out the further noise reduction in YUV domains and Edge contrast again；JPEG compression is simultaneously preserved.

During mobile terminal user takes pictures, user is wished while obtaining the photograph of HDR and clear noise less Piece, but the two are difficult to get both at present, easily attend to one thing and lose sight of another.

At the same time, when traditional HDR is realized, in order to ensure preview brightness not significant change, press take pictures when preview meeting Freeze screen；And in order that preview freeze screen substantially do not perceived by user, usually require that the frame number of different exposures can not be more, generally 3 frames, But 3 frames can not accomplish relatively good transition to height contrast scene.

The content of the invention

The embodiment of the present invention provides a kind of high dynamic range images image pickup method, mobile terminal and computer-readable storage medium Matter, to solve the problem of high dynamic range images are unsatisfactory for clearly lacking noise conditions in the prior art.

In a first aspect, the embodiment of the present invention provides a kind of high dynamic range images image pickup method, taken the photograph applied to including first As head and the mobile terminal of second camera, the high dynamic range images image pickup method includes：

First camera and the second camera is controlled to gather preview image respectively, and by first camera The preview image of collection is shown in shooting preview interface；

Obtain the M frame preview images of the first camera collection；

Alignment synthesis processing is carried out to the M frames preview image, the first image is generated；

Obtain the N frame preview images of the second camera collection；

High dynamic range images synthesis processing is carried out to the N frames preview image, the second image is generated；

Alignment synthesis processing is carried out to described first image and second image, high dynamic range images are generated.

Second aspect, the embodiment of the present invention additionally provides a kind of mobile terminal, including the first camera and second camera, Also include：

First processing module, for controlling first camera and the second camera to gather preview image respectively, And the preview image for gathering first camera is included in shooting preview interface；

First acquisition module, the M frame preview images for obtaining the first camera collection；

Second processing module, the M frames preview image for being obtained to first acquisition module carries out alignment synthesis processing, Generate the first image；

Second acquisition module, the N frame preview images for obtaining the second camera collection；

3rd processing module, the N frames preview image for being obtained to second acquisition module carries out HDR figure As synthesis processing, the second image is generated；

Fourth processing module, gives birth to for the first image generated to the Second processing module and the 3rd processing module Into the second image carry out alignment synthesis processing, generate high dynamic range images.

The third aspect, the embodiment of the present invention additionally provides a kind of mobile terminal, including processor, memory and is stored in institute The computer program that can be run on memory and on the processor is stated, when the computer program is by the computing device The step of realizing above-mentioned high dynamic range images image pickup method.

Fourth aspect, the embodiment of the present invention additionally provides a kind of computer-readable recording medium, described computer-readable to deposit Be stored with computer program on storage media, and the computer program realizes above-mentioned high dynamic range images when being executed by processor The step of image pickup method.

So, in the embodiment of the present invention, by controlling first camera and the second camera to gather pre- respectively Look at image, and the preview image that first camera is gathered is included in shooting preview interface；Obtain first shooting The M frame preview images of head collection；Alignment synthesis processing is carried out to the M frames preview image, the first image is generated；Obtain described The N frame preview images of two cameras collection；High dynamic range images synthesis processing, generation the are carried out to the N frames preview image Two images；Alignment synthesis processing is carried out to described first image and second image, high dynamic range images are generated；It is simultaneously full Foot breadth dynamic range and high definition image quality demand, and realize the live preview of processing procedure.

Brief description of the drawings

In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these accompanying drawings Obtain other accompanying drawings.

Fig. 1 is the high dynamic range images image pickup method schematic flow sheet one of the embodiment of the present invention；

Fig. 2 is the high dynamic range images image pickup method schematic flow sheet two of the embodiment of the present invention；

Fig. 3 is the high dynamic range images image pickup method schematic flow sheet three of the embodiment of the present invention；

Fig. 4 is the high dynamic range images image pickup method schematic flow sheet four of the embodiment of the present invention；

Fig. 5 is the high dynamic range images image pickup method schematic flow sheet five of the embodiment of the present invention；

Fig. 6 is the high dynamic range images image pickup method schematic flow sheet six of the embodiment of the present invention；

Fig. 7 is the high dynamic range images image pickup method schematic flow sheet seven of the embodiment of the present invention；

Fig. 8 is the high dynamic range images image pickup method schematic flow sheet eight of the embodiment of the present invention；

Fig. 9 is the mobile terminal structure schematic diagram one of the embodiment of the present invention；

Figure 10 is the mobile terminal structure schematic diagram two of the embodiment of the present invention；

Figure 11 is the mobile terminal structure schematic diagram three of the embodiment of the present invention；

Figure 12 is the mobile terminal structure schematic diagram four of the embodiment of the present invention；

Figure 13 is the mobile terminal structure schematic diagram five of the embodiment of the present invention；

Figure 14 is the mobile terminal structure schematic diagram six of the embodiment of the present invention；

Figure 15 is the mobile terminal structure schematic diagram seven of the embodiment of the present invention；

Figure 16 is the mobile terminal structure schematic diagram eight of the embodiment of the present invention；

Figure 17 is the mobile terminal structure schematic diagram nine of the embodiment of the present invention；

Figure 18 is the mobile terminal structure schematic diagram ten of the embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made Example, belongs to the scope of protection of the invention.

The present invention is directed to the problem of high dynamic range images are unsatisfactory for clearly lacking noise conditions in existing technology, and there is provided one High dynamic range images image pickup method is planted, applied to the mobile terminal of the first camera and second camera is included, such as Fig. 1 institutes Show, the high dynamic range images image pickup method includes：

Step 101：First camera and the second camera is controlled to gather preview image respectively, and by described the The preview image of one camera collection is shown in shooting preview interface.

First camera uses identical exposure value using preview image, and second camera collection preview image is used Different exposure values.

First camera is identical with the hardware configuration of second camera, it can be understood as the hardware of two modules is the same , such as chip, camera lens, motor etc. are just as.

Step 102：Obtain the M frame preview images of the first camera collection.

The exposure value that first camera is used is more than or equal to normal exposure lower limit and less than or equal on normal exposure Limit value.

Step 103：Alignment synthesis processing is carried out to the M frames preview image, the first image is generated.

One in M frame preview images is chosen as reference frame, unsharp preview image is rejected, by remaining preview graph As carrying out alignment synthesis processing, the first image is generated.

The first image now generated meets the condition of clear noise less.

Step 104：Obtain the N frame preview images of the second camera collection.

The exposure value that second camera is used at least is included less than the exposure value of normal exposure lower limit and more than normal exposure The exposure value of light higher limit.

Corresponding continuous exposure stepping gradient can be determined according to the feature of scene, such as big backlight scene, normal exposure is drawn Face, highlighted spilling is very serious, and dark place pixel is also very more simultaneously, and in order to preferably suppress highlighted, deficient exposure needs to use EV-2 Image, dark place highlights the image needed with EV+2.

Step 105：High dynamic range images synthesis processing is carried out to the N frames preview image, the second image is generated.

Default characteristic information, such as image edge information, color, overexposure or deficient exposure etc., for carrying out can specifically be passed through Image synthesis is handled.

The second image now generated meets the condition of HDR.

Step 106：Alignment synthesis processing is carried out to described first image and second image, HDR figure is generated Picture.

The high dynamic range images obtained after first image and the second image synthesis processing clear noise had less both been met into Condition, also meets the condition of HDR.

High dynamic range images image pickup method provided in an embodiment of the present invention by control respectively first camera and The second camera gathers preview image, and the preview image that first camera is gathered is included in shooting preview interface On；Obtain the M frame preview images of the first camera collection；Alignment synthesis processing, generation are carried out to the M frames preview image First image；Obtain the N frame preview images of the second camera collection；HDR is carried out to the N frames preview image Image synthesis is handled, and generates the second image；Alignment synthesis processing is carried out to described first image and second image, generation is high Dynamic image；Wide dynamic range and high definition image quality demand are met simultaneously, and realizes the live preview of processing procedure.

Scheme i.e. provided in an embodiment of the present invention is by using similarly configuring dual camera, and the first camera is decided shooting Head, for gathering normal exposure multiframe picture, and the preview on mobile phone screen in real time, second camera does secondary camera, is used for The multiframe picture of different exposures is obtained, will not be shown in picture, the same exposure multiframe picture gathered using the first camera is reached The effect that noise declines is lifted to definition, the different exposure pictures of second camera collection do HDR algorithms and realize HDR, The composite result of first camera and the composite result of second camera, the image quality that tries again fusion, existing dynamic range is again There is clear image quality, and picture does not stop.

Before step 101, it can also include：Obtain camera mode switching command；Referred to according to camera mode switching Order enters the super HDR Super HDR patterns of the camera of the terminal, starts first camera and second and takes the photograph As head.

In actual use it is, opening camera, Super HDR patterns are switched to, into preview interface；In the present invention In embodiment, this operation can be that user opens camera, and what is be now introduced into is common exposal model, i.e. list camera is carried out The pattern taken pictures, then switches to Super HDR patterns, is run simultaneously while opening many cameras.Preview screen is using master Camera live preview.

It is described to M frames preview image progress alignment synthesis processing in the present embodiment, the step of generating the first image, As shown in Fig. 2 including：

Step 1031, the maximum preview image of definition values in the M frames preview image is defined as the first reference picture.

Choose a maximum preview image of definition values in M frame preview images and be used as reference frame.

Step 1032, give up the preview image that definition values in M-1 frame preview images are less than predetermined threshold value, obtain S frames pre- Look at image.

Reject unsharp preview image.

Step 1033, the image on the basis of first reference picture, is carried out at image alignment to the S frames preview image Reason.

Step 1034, on frequency domain and spatial domain, to the S frames after first reference picture and image alignment processing Preview image carries out image synthesis processing, generates the first image.

I.e. on frequency domain and spatial domain, remaining preview image is subjected to alignment synthesis processing, the first image is generated.Its In, the M-1 frames preview image is all preview images in the M frames preview image in addition to first reference picture.

Screened by the M frame preview images to acquisition, can further improve the definition of image.

Specifically, the step of M frame preview images of acquisition the first camera collection, as shown in figure 3, including：

Step 1021, the M frame preview graphs that the first camera collection exposure value is default automatic exposure value are controlled Picture.

The first camera is controlled to gather M frame preview images using same exposure value.

Step 1022, the M frames preview image is obtained.

Obtain the M frame preview images collected.Wherein, M >=3.

The step of N frame preview images of the acquisition second camera collection, as shown in figure 4, including：

Step 1041, the N frame preview images for controlling the second camera collection equal value of exposure value different.

I.e. control second camera gathers N frame preview images using N number of exposure value.Step 1042, the N frames preview is obtained Image.

Obtain the N frame preview images collected.Wherein, N >=3, and M=N.

First camera collection exposure value is that the M frames preview image of default automatic exposure value can be easy to post-process It is met the first image of clear noise conditions less；The different N frame preview images of the second camera collection equal value of exposure value The second image of dynamic range of conditions can be easy to be met with post processing.

, can be with employing mode one when generating the second image in the present embodiment：Using a frame conduct in N frame preview images Benchmark is handled, it would however also be possible to employ mode two：Handled using a frame in M frame preview images as benchmark.

Corresponding to mode one, if N values are 5, the different N of the control second camera collection equal value of exposure value The step of frame preview image, as shown in figure 5, including：

Step 10411, whether detection present filming scene is backlight scene；Step 10412, if present filming scene is not Backlight scene, then it is EV-b to control the second camera to gather deficient exposure preview image, exposure value that exposure value is EV-a successively Time owe expose secondary overexposure preview image that normal exposure preview image, exposure value that preview image, exposure value are EV are EV+c and Exposure value is EV+d overexposure preview image.

Step 10413, if present filming scene is backlight scene, the second camera is controlled to gather exposure value successively The normal exposure preview that time deficient exposure preview image, the exposure value for being EV0-f for EV0-e deficient exposure preview image, exposure value are EV The overexposure preview image that the secondary overexposure preview image and exposure value that image, exposure value are EV+g are EV+h.

Wherein, EV is the exposure value of present filming scene, a>B, d>C, e>F, h>g；A ≠ e, b ≠ f, c ≠ g, d ≠ h；a、 B, c, d, e, f, g, h are positive number.

So enable to the processing speed of generation image faster.

Under this mode, step 101,102 and 103, which can be realized, is：Using the first camera as main camera, output is continuous Multiple normal identical exposure raw data, by alignment one 10bit raw domains picture of synthesis, raw domains picture is a kind of original lattice The picture of formula, be specially：

Receive after photographing instruction, main camera can determine the shooting of main camera according to the demand and speed of image quality Frame number, wherein, frame number is more, and image quality is better, and speed is slower, for example, shoot the image of the identical exposure of n frames, such as select 6 frames, select Most clearly one is used as reference frame A, unsharp of rejecting, using green channel g channel Grad in six frames Choose, gradient is bigger, more clear, smaller about to obscure, remaining frame is done based on reference frame A to align, for example, separating the picture into block, such as 64x64, every piece is done the size and Orientation for aliging, being offset；Multiframe synthesis is done further according to the picture after alignment, from frequency domain and sky Between domain all synthesized, reduce noise, while also processing is likely to occur the wrong situation of aliging, obtain raw domains 10bit pictures.

Step 101,104,105 and 106 can be realized：Using second camera as secondary camera, export different exposures and set Fixed multiple pictures, and the output of step 103 carry out HDR algorithms one 10bit raw domains picture of synthesis, at picture signal Device ISP is managed, is specially：

Receive after photographing instruction, secondary camera obtains one group and continuously set, can continuously capture multiframe difference exposure and set Fixed photo, frame number is according to image quality demand and speed, it is determined that the frame number of crawl, frame number is more, picture brightness level, which is crossed, to be getted over, Speed is slower；Such as 4, the deficient image for exposing (EV-1), the secondary deficient image for exposing (EV-0.5), the image of secondary overexposure (EV+0.5), The image of overexposure (EV+1), picture is shown not in preview.

In addition can be according to the feature of scene, the continuous exposure stepping gradient of different scenes can be different, such as regicide light field Scape, normal exposure picture, highlighted spilling is very serious, and dark place pixel is also very more simultaneously, in order to preferably suppress highlighted, owes Exposing needs the image with EV-2, and dark place, which is highlighted, needs the image with EV+2, then 4 of this scene collection are exactly：Owe to expose (EV-2) image, the secondary deficient image for exposing (EV-1), the image of secondary overexposure (EV+1), the image of overexposure (EV+2), picture does not exist Shown in preview, then take the result obtained by step 103 as normal exposure EV0 image.

The picture of 5 continuous different exposure settings is subjected to algorithm synthesis, EV0 as definition benchmark, other EV's The foundation of picture low bright composition algorithm the most highlighted.Extract following characteristic point：Image edge information, color, overexposure are owed to expose Pixel.Same edge information, color information brings alignment, and overexposure pixel is alignd with the local location for the sampled images for owing to expose Synthesis, owes the sampling picture alignment synthesis of pixel overexposures exposed, does not repeat specifically.It is finally synthesizing highlighted not overexposure, dark place The good Raw domains 10bit pictures of the HDR and definition that highlight.

By picture obtained as above, into image-signal processor, by demosaicing, sharpening, denoising, color conversion, Color enhancement etc. is operated, and 1 yuv data is obtained after the completion of processing, as follow-up input, carries out data format JPEG compression simultaneously Preserve.

Corresponding to mode two, if N values are 4, the different N of the control second camera collection equal value of exposure value The step of frame preview image, as shown in fig. 6, including：Step 10414, whether detection present filming scene is backlight scene；Step 10415, if present filming scene is not backlight scene, it is EV-t1's to control the second camera to gather exposure value successively It is the secondary overexposure preview image and exposure that EV-t2 time deficient exposure preview image, exposure value are EV+t3 to owe to expose preview image, exposure value Light value is EV+t4 overexposure preview image.

Step 10416, if present filming scene is backlight scene, the second camera is controlled to gather exposure value successively The secondary overexposure preview that time deficient exposure preview image, the exposure value for being EV-b2 for EV-b1 deficient exposure preview image, exposure value are EV+b3 Image and the overexposure preview image that exposure value is EV+b4；Wherein, EV is the exposure value of present filming scene, t1>T2, t4>T3, b1>B2, b4>b3；T1 ≠ b1, t2 ≠ b2, t3 ≠ b3, t4 ≠ b4；T1, t2, t3, t4, b1, b2, b3, b4 are positive number.

The image of generation is so enabled to more conform to the condition of HDR, while lifting definition.

Under this mode, step 101,102 and 103, which can be realized, is：Using the first camera as main camera, output is continuous Multiple normal identical exposure raw data, by alignment one 10bit raw domains picture of synthesis, raw domains picture is a kind of original number According to the picture of form, it is specially：

Receive after photographing instruction, main camera can select frame number according to the demand and speed of image quality, and general frame number is got over Many, image quality is better, and speed is slower, the identical exposure of n frames, such as selects 6 frames, selects in six frames most clearly one as reference frame A, Unsharp is rejected, is chosen using green channel g channel Grad, gradient is bigger, more clear, smaller about mould Paste, remaining frame is done based on reference frame A to align, for example, separate the picture into block, such as 64x64, every piece is done the size alignd, offset And direction；Multiframe synthesis is done further according to the picture after alignment, is all synthesized from frequency domain and spatial domain, noise is reduced, also simultaneously Processing is likely to occur wrong situation of aliging, and obtains raw domains 10bit pictures.

Corresponding, step 101,104,105 and 106, which can be realized, is：While execution with aforesaid operations, by second camera As secondary camera, the multiple pictures of different exposure settings are exported, HDR algorithms is carried out and synthesizes a 10bit raw domains picture, will Two obtained raw domains 10bit pictures do alignment synthesis, into image-signal processor ISP, are specially：

Receive after photographing instruction, secondary camera obtains one group and continuously set, can continuously capture multiframe difference exposure and set Fixed photo, frame number can determine that general frame number is more, and picture brightness level, which is crossed, to be getted over, speed according to image quality demand and speed It is slower, such as 5, owe to expose the image of (EV-1), the secondary deficient image for exposing (EV-0.5), the picture of normal exposure (EV=0), secondary overexposure (EV+0.5) image, the image of overexposure (EV+1), picture is shown not in preview.

In addition can be according to the feature of scene, the continuous exposure stepping gradient of different scenes can be different, such as regicide light field Scape, normal exposure picture, highlighted spilling is very serious, and dark place pixel is also very more simultaneously, in order to preferably suppress highlighted, owes Exposing needs the image with EV-2, and dark place, which is highlighted, needs the image with EV+2, then 5 of this scene collection are exactly：Owe to expose (EV-2) image, the secondary deficient image for exposing (EV-1), the picture of normal exposure (EV=0), the image of secondary overexposure (EV+1), overexposure (EV+2) image, picture is shown not in preview.

The picture of 5 continuous different exposure settings is subjected to algorithm synthesis, merging is done using following information：Extract as follows Characteristic point：Image edge information, color, overexposure or the pixel p ixel for owing exposure.Same edge information, color information is brought pair Together, the local location alignment synthesis of the overexposure pixel sampled images for owing to expose, owes the pixel exposed, with the sampling picture pair of overexposure Neat synthesis, is not repeated specifically.It is finally synthesizing highlighted not overexposure, the Raw domains 10bit pictures for the HDR that dark place is highlighted.

The raw of the raw that is obtained by main camera night scene noise reduction algorithm and secondary camera HDR algorithms tries again algorithm conjunction Into the raw that main camera is obtained first is done with the raw that secondary camera is obtained to align, and then frequency domain and the synthesis of the algorithm of spatial domain, simultaneous Turn round and look at the design sketch 10bit of HDR and super clear noise reduction.

By the design sketch 10bit of gained, into image-signal processor, turn by demosaicing, sharpening, denoising, color Change, the operation such as color enhancement, 1 yuv data is obtained after the completion of processing, follow-up input is used as, data format JPEG pressures are carried out Contract preservation.

It is described that high dynamic range images synthesis processing, generation are carried out to the N frames preview image corresponding to aforesaid way two The step of second image, as shown in fig. 7, comprises：Step 1051, each frame preview image in the N frames preview image is extracted Characteristic information, the characteristic information includes image edge information, color information, the pixel information in overexposure region and owes to expose region Pixel information.

The characteristic information can also include other information certainly, be not limited thereto.

Step 1052, the two field picture obtained in the M frames preview image is used as the second reference picture.

The two field picture in the M frames preview image is obtained as reference frame.

Step 1053, according to described image marginal information and color information, the image on the basis of second reference picture, Image alignment processing is carried out to the N frames preview image.

It is defined by reference frame, other images is alignd.

Step 1054, by all pictures for owing same area in exposure frame preview image of the overexposure region in the reference picture Vegetarian refreshments is filled, and the deficient exposure region in the reference picture is filled out with all pixels point of same area in overexposure frame preview image Fill.

This is operated for synthesizing highlighted not overexposure, the Raw domains picture for the HDR that dark place is highlighted.

Step 1055, after the completion of being filled when the overexposure region in the reference picture and the deficient exposure region, generation the Two images.Operation synthesizes highlighted not overexposure above, the good picture of the HDR and definition that dark place is highlighted.

Specifically, described carry out alignment synthesis and handle to described first image with second image, high dynamic range is generated The step of enclosing image, as shown in figure 8, including：Step 1061, described first image is defined as the 3rd reference picture.

It regard described first image as reference frame.

Step 1062, the image on the basis of the 3rd reference picture, image alignment processing is carried out to second image.

It is defined by reference frame, other images is alignd.

Step 1063, on frequency domain and spatial domain, to second figure after described first image and image alignment processing As carrying out image synthesis processing, high dynamic range images are generated.The image obtained with this not only meets the condition of clear noise less, Also meet the condition of HDR.

From the foregoing, it will be observed that the embodiments of the invention provide one kind be based on using similarly configure dual camera collection preview image, And then image alignment and synthesis are carried out, and final image is obtained, the scheme that HDR and clear image quality get both is realized, can be simultaneously Wide dynamic range and high definition image quality demand are met, live preview is carried out.

The embodiment of the present invention additionally provides a kind of mobile terminal, including the first camera and second camera, such as Fig. 9 to figure Shown in 12 and Figure 15 and Figure 16, in addition to：

First processing module 901, for controlling first camera and the second camera to gather preview graph respectively Picture, and the preview image that first camera is gathered is including in shooting preview interface.

First acquisition module 902, the M frame preview images for obtaining the first camera collection.

Second processing module 903, the M frames preview image for being obtained to first acquisition module is carried out at alignment synthesis Reason, generates the first image.

Second acquisition module 904, the N frame preview images for obtaining the second camera collection.

3rd processing module 905, the N frames preview image for being obtained to second acquisition module carries out HDR Image synthesis is handled, and generates the second image.

Fourth processing module 906, for the first image and the 3rd processing mould generated to the Second processing module Second image of block generation carries out alignment synthesis processing, generates high dynamic range images.

The mobile terminal provided in an embodiment of the present invention by controlling first camera and described second to take the photograph respectively As head collection preview image, and the preview image that first camera is gathered is including in shooting preview interface；Obtain institute State the M frame preview images of the first camera collection；Alignment synthesis processing is carried out to the M frames preview image, the first image is generated； Obtain the N frame preview images of the second camera collection；The N frames preview image is carried out at high dynamic range images synthesis Reason, generates the second image；Alignment synthesis processing is carried out to described first image and second image, HDR figure is generated Picture；Wide dynamic range and high definition image quality demand are met simultaneously, and realizes the live preview of processing procedure.

As shown in Figure 10, the Second processing module 903 includes：First determination sub-module 9031, for the M frames is pre- The maximum preview image of definition values in image of looking at is defined as the first reference picture；First processing submodule 9032, for giving up Definition values are less than the preview image of predetermined threshold value in M-1 frame preview images, obtain S frame preview images.

Second processing submodule 9033, for scheming on the basis of the first reference picture for being determined by first determination sub-module Picture, image alignment processing is carried out to the S frames preview image that the described first processing submodule is obtained；3rd processing submodule 9034, For in frequency domain and spatial domain, to the first reference picture and the second processing submodule of first determination sub-module determination The S frames preview image that block performs after image alignment processing carries out image synthesis processing, generates the first image；Wherein, it is described M-1 frames preview image is all preview images in the M frames preview image in addition to first reference picture.

As shown in figure 11, first acquisition module 902 includes：First control submodule 9021, for controlling described One camera collection exposure value is the M frame preview images of default automatic exposure value；First acquisition submodule 9022, for obtaining Take the M frames preview image；Wherein, M >=3.

As shown in Figure 12 to Figure 14, second acquisition module 904 includes：Second control submodule 9041, for controlling The different N frame preview images of the second camera collection equal value of exposure value；Second acquisition submodule 9042, for obtaining State N frame preview images；Wherein, N >=3, and M=N.

As shown in figure 13, if N values are 5, second control submodule 9041 includes：First detection unit 90411, is used In detection present filming scene whether be backlight scene；First control unit 90412, if not being backlight for present filming scene Scene, then control the second camera to gather time that deficient exposure preview image, the exposure value that exposure value is EV-a are EV-b successively Owe to expose the secondary overexposure preview image and exposure that preview image, the normal exposure preview image that exposure value is EV, exposure value are EV+c It is worth the overexposure preview image for EV+d.

Second control unit 90413, if for present filming scene be backlight scene, control the second camera according to Time deficient preview image, exposure value of exposing that deficient exposure preview image, the exposure value that secondary collection exposure value is EV0-e are EV0-f is EV's The overexposure preview image that the secondary overexposure preview image and exposure value that normal exposure preview image, exposure value are EV+g are EV+h；Its In, EV is the exposure value of present filming scene, a>B, d>C, e>F, h>g；A ≠ e, b ≠ f, c ≠ g, d ≠ h；a、b、c、d、e、f、 G, h are positive number.

As shown in figure 14, if N values are 4, second control submodule 9041 includes：Second detection unit 90414, is used In detection present filming scene whether be backlight scene；3rd control unit 90415, if not being backlight for present filming scene Scene, then it is EV-t2's to control the second camera to gather deficient exposure preview image, exposure value that exposure value is EV-t1 successively The overexposure preview image that the secondary overexposure preview image and exposure value that secondary deficient exposure preview image, exposure value are EV+t3 are EV+t4.

4th control unit 90416, if for present filming scene be backlight scene, control the second camera according to Time deficient preview image, exposure value of exposing that deficient exposure preview image, the exposure value that secondary collection exposure value is EV-b1 are EV-b2 is EV+b3 Secondary overexposure preview image and exposure value be EV+b4 overexposure preview image；Wherein, EV is the exposure value of present filming scene, t1>T2, t4>T3, b1>B2, b4>b3；T1 ≠ b1, t2 ≠ b2, t3 ≠ b3, t4 ≠ b4；T1, t2, t3, t4, b1, b2, b3, b4 are equal For positive number.

As shown in figure 15, the 3rd processing module 905 includes：First extracting sub-module 9051, for extracting the N frames The characteristic information of each frame preview image in preview image, the characteristic information includes image edge information, color information, overexposure The pixel information in region and the pixel information for owing exposure region；3rd acquisition submodule 9052, for obtaining the M frames preview A two field picture in image is used as the second reference picture.

Fourth process submodule 9053, for the image edge information and color extracted according to first extracting sub-module Image on the basis of information, the second reference picture obtained by the 3rd acquisition submodule, schemes to the N frames preview image As registration process；5th processing submodule 9054, for overexposure region in the reference picture to be exposed into frame preview image with deficient The all pixels point filling of middle same area, and by the deficient exposure region in the reference picture with identical in overexposure frame preview image The all pixels point filling in region；First generation submodule 9055, for when the overexposure region in the reference picture and described After the completion of deficient exposure region is filled, the second image is generated.

As shown in figure 16, the fourth processing module 906 includes：Second determination sub-module 9061, for by described first Image is defined as the 3rd reference picture；6th processing submodule 9062, for determined with second determination sub-module the 3rd Image on the basis of reference picture, image alignment processing is carried out to second image；7th processing submodule 9063, in frequency On domain and spatial domain, image synthesis processing is carried out to second image after described first image and image alignment processing, it is raw Into high dynamic range images.

From the foregoing, it will be observed that being based on, using dual camera is similarly configured, realizing high dynamic range the embodiments of the invention provide one kind The scheme got both with clear image quality is enclosed, while meeting wide dynamic range and high definition image quality demand, and the reality of processing procedure is realized When preview.

Wherein, the described of above-mentioned high dynamic range images image pickup method realizes the reality that embodiment is applied to the mobile terminal Apply in example, can also reach identical technique effect.

The embodiment of the present invention also provides a kind of mobile terminal, including processor, memory, is stored on the memory simultaneously The computer program that can be run on the processor, is realized above-mentioned high dynamic when the computer program is by the computing device Each process of state range image image pickup method embodiment, and identical technique effect can be reached, to avoid repeating, here no longer Repeat.

The embodiment of the present invention also provides the meter that is stored with a kind of computer-readable recording medium, computer-readable recording medium Calculation machine program, the computer program realizes each of above-mentioned high dynamic range images image pickup method embodiment when being executed by processor Individual process, and identical technique effect can be reached, to avoid repeating, repeat no more here.Wherein, it is described computer-readable to deposit Storage media, such as read-only storage (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic disc or CD etc..

The embodiment of the present invention additionally provides a kind of mobile terminal, as shown in figure 17, and mobile terminal 1 700 includes：

At least one processor 1701, memory 1702, at least one network interface 1704 and user interface 1703 and First camera 1706 and second camera 1707.Each component in mobile terminal 1 700 is coupling in by bus system 1705 Together.It is understood that bus system 1705 is used to realize the connection communication between these components.Bus system 1705, which is removed, includes data Outside bus, in addition to power bus, controlling bus and status signal bus in addition.But for the sake of clear explanation, in fig. 17 Various buses are all designated as bus system 1705.

Wherein, user interface 1703 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch-screen etc..

It is appreciated that the memory 1702 in the embodiment of the present invention can be volatile memory or non-volatile memories Device, or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read-Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), erasable programmable are only Read memory (Erasable PROM, EPROM), Electrically Erasable Read Only Memory (Electrically EPROM, ) or flash memory EEPROM.Volatile memory can be random access memory (Random Access Memory, RAM), and it is used Make External Cache.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static random-access Memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random-access Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate SDRAM, DDRSDRAM), it is enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronous Connect dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct Rambus RAM, DRRAM).The memory 1702 of system and method described herein be intended to including but not limited to this The memory of a little and any other suitable type.

In some embodiments, memory 1702 stores following element, can perform module or data structure, or Their subset of person, or their superset：Operating system 17021 and application program 17022.

Wherein, operating system 17021, comprising various system programs, such as ccf layer, core library layer, driving layer, are used for Realize various basic businesses and handle hardware based task.Application program 17022, includes various application programs, such as matchmaker Body player (Media Player), browser (Browser) etc., for realizing various applied business.Realize that the present invention is implemented The program of example method may be embodied in application program 17022.

In embodiments of the present invention, mobile terminal 1 700 also includes：It is stored on memory 1702 and can be in processor The computer program run on 1701, computer program realizes following steps when being performed by processor 1701：Control respectively described First camera 1706 and the second camera 1707 collection preview image, and by first camera 1706 gather it is pre- Image of looking at is shown in shooting preview interface；Obtain the M frame preview images that first camera 1706 is gathered；To the M frames Preview image carries out alignment synthesis processing, generates the first image；Obtain the N frame preview graphs that the second camera 1707 is gathered Picture；High dynamic range images synthesis processing is carried out to the N frames preview image, the second image is generated；To described first image and Second image carries out alignment synthesis processing, generates high dynamic range images.

The method that the embodiments of the present invention are disclosed can apply in processor 1701, or real by processor 1701 It is existing.Processor 1701 is probably a kind of IC chip, the disposal ability with signal.In implementation process, the above method Each step can be completed by the instruction of the integrated logic circuit of the hardware in processor 1701 or software form.Above-mentioned Processor 1701 can be general processor, digital signal processor (Digital Signal Processor, DSP), special Integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic, Discrete hardware components.It can realize or perform disclosed each method, step and the logic diagram in the embodiment of the present invention.It is general Processor can be microprocessor or the processor can also be any conventional processor etc..With reference to institute of the embodiment of the present invention The step of disclosed method, can be embodied directly in hardware decoding processor and perform completion, or with the hardware in decoding processor And software module combination performs completion.Software module can be located at random access memory, and flash memory, read-only storage may be programmed read-only In the ripe computer-readable recording medium in this area such as memory or electrically erasable programmable memory, register.The meter Calculation machine readable storage medium storing program for executing is located at memory 1702, and processor 1701 reads the information in memory 1702, complete with reference to its hardware The step of into the above method.Specifically, be stored with computer program on the computer-readable recording medium, and computer program is located Manage each step realized when device 1701 is performed such as above-mentioned high dynamic range images image pickup method embodiment.

It is understood that embodiments described herein can with hardware, software, firmware, middleware, microcode or its Combine to realize.Realized for hardware, processing unit can be realized in one or more application specific integrated circuit (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general processor, In controller, microcontroller, microprocessor, other electronic units for performing herein described function or its combination.

Realize, can be realized by performing the module (such as process, function) of function described herein herein for software Described technology.Software code is storable in memory and by computing device.Memory can within a processor or Realized outside processor.

Alternatively, following steps specifically can be achieved when computer program is performed by processor 1701：By the M frames preview graph The maximum preview image of definition values is defined as the first reference picture as in；Give up definition values in M-1 frame preview images to be less than The preview image of predetermined threshold value, obtains S frame preview images；The image on the basis of first reference picture, to the S frames preview Image carries out image alignment processing；On frequency domain and spatial domain, to the institute after first reference picture and image alignment processing State S frames preview image and carry out image synthesis processing, generate the first image；Wherein, the M-1 frames preview image is that the M frames are pre- All preview images look in image in addition to first reference picture.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1701：Control described first The collection exposure value of camera 1706 is the M frame preview images of default automatic exposure value；Obtain the M frames preview image；Its In, M >=3.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1701：Control described second The different N frame preview images of the collection of the camera 1707 equal value of exposure value；Obtain the N frames preview image；Wherein, N >=3, and M =N.

Alternatively, if N values are 5, following steps specifically can be also realized when computer program is performed by processor 1701：Inspection Survey whether present filming scene is backlight scene；If present filming scene is not backlight scene, the second camera is controlled 1707 gather time deficient preview image, exposure value of exposing that deficient exposure preview image, the exposure values that exposure value is EV-a are EV-b successively is The overexposure preview graph that the secondary overexposure preview image and exposure value that EV normal exposure preview image, exposure value is EV+c are EV+d Picture；If present filming scene is backlight scene, the second camera 1707 is controlled to gather exposure value owing for EV0-e successively It is that the secondary of EV0-f is owed to expose preview image, the normal exposure preview image that exposure value is EV, exposure value to expose preview image, exposure value The overexposure preview image for being EV+h for EV+g secondary overexposure preview image and exposure value；Wherein, EV is the exposure of present filming scene Light value, a>B, d>C, e>F, h>g；A ≠ e, b ≠ f, c ≠ g, d ≠ h；A, b, c, d, e, f, g, h are positive number.

Alternatively, if N values are 4, following steps specifically can be also realized when computer program is performed by processor 1701：Inspection Survey whether present filming scene is backlight scene；If present filming scene is not backlight scene, the second camera is controlled Time deficient exposure preview image, exposure value that 1707 deficient exposure preview image, the exposure values that collection exposure value is EV-t1 successively are EV-t2 The overexposure preview image for being EV+t4 for EV+t3 secondary overexposure preview image and exposure value；If present filming scene is backlight Scape, then it is EV-b2 to control the second camera 1707 to gather deficient exposure preview image, exposure value that exposure value is EV-b1 successively Time owe expose the overexposure preview image that secondary overexposure preview image and exposure value that preview image, exposure value are EV+b3 are EV+b4； Wherein, EV is the exposure value of present filming scene, t1>T2, t4>T3, b1>B2, b4>b3；T1 ≠ b1, t2 ≠ b2, t3 ≠ b3, t4 ≠b4；T1, t2, t3, t4, b1, b2, b3, b4 are positive number.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1701：Extract the N frames pre- Look at the characteristic information of each frame preview image in image, the characteristic information includes image edge information, color information, overexposure area The pixel information in domain and the pixel information for owing exposure region；The two field picture in the M frames preview image is obtained as second Reference picture；According to described image marginal information and color information, the image on the basis of second reference picture, to the N Frame preview image carries out image alignment processing；Overexposure region in the reference picture is exposed into same zone in frame preview image with deficient The all pixels point filling in domain, and by the institute of deficient exposure region same area in overexposure frame preview image in the reference picture There is pixel filling；After the completion of being filled when the overexposure region in the reference picture and the deficient exposure region, the second figure is generated Picture.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1701：By first figure As being defined as the 3rd reference picture；The image on the basis of the 3rd reference picture, image alignment is carried out to second image Processing；On frequency domain and spatial domain, image conjunction is carried out to second image after described first image and image alignment processing Into processing, high dynamic range images are generated.

Mobile terminal 1 700 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, this In repeat no more.

To sum up, the mobile terminal provided in an embodiment of the present invention by controlling first camera and described respectively Two cameras gather preview image, and the preview image that first camera is gathered is included in shooting preview interface；Obtain Take the M frame preview images of the first camera collection；Alignment synthesis processing, generation first are carried out to the M frames preview image Image；Obtain the N frame preview images of the second camera collection；High dynamic range images are carried out to the N frames preview image Synthesis is handled, and generates the second image；Alignment synthesis processing is carried out to described first image and second image, high dynamic is generated Range image；Wide dynamic range and high definition image quality demand are met simultaneously, and realizes the live preview of processing procedure.

The embodiment of the present invention additionally provides a kind of mobile terminal, specifically, as shown in figure 18, the shifting in the embodiment of the present invention Dynamic terminal 1800 can for mobile phone, tablet personal computer, personal digital assistant (Personal Digital Assistant, PDA) or Vehicle-mounted computer etc..

Mobile terminal 1 800 in Figure 18 include radio frequency (Radio Frequency, RF) circuit 1810, memory 1820, Input block 1830, display unit 1840, processor 1860, voicefrequency circuit 1870, WiFi (Wireless Fidelity) module 1880 and the camera 18100 of power supply 1890 and first and second camera 18110.

Wherein, input block 1830 can be used for the numeral or character information of reception user's input, and produce and mobile whole The signal input that the user at end 1800 is set and function control is relevant.Specifically, in the embodiment of the present invention, the input block 1830 can include contact panel 1831.Contact panel 1831, also referred to as touch-screen, collect user's touching on or near it Operation (such as user uses the operations of any suitable object or annex on contact panel 1831 such as finger, stylus) is touched, and Corresponding attachment means are driven according to formula set in advance.Optionally, contact panel 1831 may include touch detecting apparatus and Two parts of touch controller.Wherein, touch detecting apparatus detects the touch orientation of user, and detects the letter that touch operation is brought Number, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into Contact coordinate, then give the processor 1860, and the order sent of reception processing device 1860 and can be performed.Furthermore, it is possible to Contact panel 1831 is realized using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves.Except contact panel 1831, input block 1830 can also include other input equipments 1832, and other input equipments 1832 can include but is not limited to One kind or many in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc. Kind.

Wherein, display unit 1840 can be used for information and the movement for showing the information inputted by user or being supplied to user The various menu interfaces of terminal 1800.Display unit 1840 may include display panel 1841, optionally, using LCD or can have The forms such as machine light emitting diode (Organic Light-Emitting Diode, OLED) configure display panel 1841.

It should be noted that contact panel 1831 can cover display panel 1841, touch display screen is formed, when the touch display screen Detect after the touch operation on or near it, processor 1860 is sent to determine the type of touch event, with post processing Device 1860 provides corresponding visual output according to the type of touch event in touch display screen.

Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area And arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area It can also be the empty interface not comprising any content.The conventional control viewing area is used to show the higher control of utilization rate, for example, Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..

Wherein processor 1860 is the control centre of mobile terminal 1 800, utilizes various interfaces and connection whole mobile phone Various pieces, by operation or perform and be stored in software program and/or module in first memory 1821, and call and deposit The data in second memory 1822 are stored up, the various functions and processing data of mobile terminal 1 800 are performed, so as to mobile whole End 1800 carries out integral monitoring.Optionally, processor 1860 may include one or more processing units.

In embodiments of the present invention, mobile terminal 1 800 also includes：It is stored in the storage of first memory 1821 and/or second In device 1822, and the computer program that can be run on processor 1860, computer program is realized when being performed by processor 1860 Following steps：First camera 18100 and the second camera 18110 is controlled to gather preview image respectively, and by institute The preview image for stating the collection of the first camera 18100 is shown in shooting preview interface；First camera 18100 is obtained to adopt The M frame preview images of collection；Alignment synthesis processing is carried out to the M frames preview image, the first image is generated；Described second is obtained to take the photograph As the N frame preview images of first 18110 collections；High dynamic range images synthesis processing, generation the are carried out to the N frames preview image Two images；Alignment synthesis processing is carried out to described first image and second image, high dynamic range images are generated.

Alternatively, following steps specifically can be achieved when computer program is performed by processor 1860：By the M frames preview graph The maximum preview image of definition values is defined as the first reference picture as in；Give up definition values in M-1 frame preview images to be less than The preview image of predetermined threshold value, obtains S frame preview images；The image on the basis of first reference picture, to the S frames preview Image carries out image alignment processing；On frequency domain and spatial domain, to the institute after first reference picture and image alignment processing State S frames preview image and carry out image synthesis processing, generate the first image；Wherein, the M-1 frames preview image is that the M frames are pre- All preview images look in image in addition to first reference picture.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1860：Control described first The collection exposure value of camera 18100 is the M frame preview images of default automatic exposure value；Obtain the M frames preview image；Its In, M >=3.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1860：Control described second The different N frame preview images of the collection of the camera 18110 equal value of exposure value；Obtain the N frames preview image；Wherein, N >=3, and M=N.

Alternatively, if N values are 5, following steps specifically can be also realized when computer program is performed by processor 1860：Inspection Survey whether present filming scene is backlight scene；If present filming scene is not backlight scene, the second camera is controlled 18110 gather time deficient preview image, exposure value of exposing that deficient exposure preview image, the exposure values that exposure value is EV-a are EV-b successively is The overexposure preview graph that the secondary overexposure preview image and exposure value that EV normal exposure preview image, exposure value is EV+c are EV+d Picture；If present filming scene is backlight scene, it is EV0-e's to control the second camera 18110 to gather exposure value successively It is that the secondary of EV0-f is owed to expose preview image, the normal exposure preview image that exposure value is EV, exposure to owe to expose preview image, exposure value The overexposure preview image that the secondary overexposure preview image and exposure value that value is EV+g are EV+h；Wherein, EV is present filming scene Exposure value, a>B, d>C, e>F, h>g；A ≠ e, b ≠ f, c ≠ g, d ≠ h；A, b, c, d, e, f, g, h are positive number.

Alternatively, if N values are 4, following steps specifically can be also realized when computer program is performed by processor 1860：Inspection Survey whether present filming scene is backlight scene；If present filming scene is not backlight scene, the second camera is controlled Time deficient exposure preview image, exposure value that 18110 deficient exposure preview image, the exposure values that collection exposure value is EV-t1 successively are EV-t2 The overexposure preview image for being EV+t4 for EV+t3 secondary overexposure preview image and exposure value；If present filming scene is backlight Scape, then it is EV-b2 to control the second camera 18110 to gather deficient exposure preview image, exposure value that exposure value is EV-b1 successively Time owe expose the overexposure preview image that secondary overexposure preview image and exposure value that preview image, exposure value are EV+b3 are EV+b4； Wherein, EV is the exposure value of present filming scene, t1>T2, t4>T3, b1>B2, b4>b3；T1 ≠ b1, t2 ≠ b2, t3 ≠ b3, t4 ≠b4；T1, t2, t3, t4, b1, b2, b3, b4 are positive number.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1860：Extract the N frames pre- Look at the characteristic information of each frame preview image in image, the characteristic information includes image edge information, color information, overexposure area The pixel information in domain and the pixel information for owing exposure region；The two field picture in the M frames preview image is obtained as second Reference picture；According to described image marginal information and color information, the image on the basis of second reference picture, to the N Frame preview image carries out image alignment processing；Overexposure region in the reference picture is exposed into same zone in frame preview image with deficient The all pixels point filling in domain, and by the institute of deficient exposure region same area in overexposure frame preview image in the reference picture There is pixel filling；After the completion of being filled when the overexposure region in the reference picture and the deficient exposure region, the second figure is generated Picture.

Alternatively, following steps specifically can be also realized when computer program is performed by processor 1860：By first figure As being defined as the 3rd reference picture；The image on the basis of the 3rd reference picture, image alignment is carried out to second image Processing；On frequency domain and spatial domain, image conjunction is carried out to second image after described first image and image alignment processing Into processing, high dynamic range images are generated.

It can be seen that, the mobile terminal provided in an embodiment of the present invention by controlling first camera and described respectively Two cameras gather preview image, and the preview image that first camera is gathered is included in shooting preview interface；Obtain Take the M frame preview images of the first camera collection；Alignment synthesis processing, generation first are carried out to the M frames preview image Image；Obtain the N frame preview images of the second camera collection；High dynamic range images are carried out to the N frames preview image Synthesis is handled, and generates the second image；Alignment synthesis processing is carried out to described first image and second image, high dynamic is generated Range image；Wide dynamic range and high definition image quality demand are met simultaneously, and realizes the live preview of processing procedure.

It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight Point explanation be all between difference with other embodiment, each embodiment identical similar part mutually referring to.

Those of ordinary skill in the art are it is to be appreciated that the list of each example described with reference to the embodiments described herein Member and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually Performed with hardware or software mode, depending on the application-specific and design constraint of technical scheme.Professional and technical personnel Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed The scope of the present invention.

It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.

In embodiment provided herein, it should be understood that disclosed apparatus and method, others can be passed through Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces Connect, can be electrical, machinery or other forms.

The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.

In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.

If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described. And foregoing storage medium includes：USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.

It should also be noted that, herein, such as first and second or the like relational terms are used merely to one Entity or operation make a distinction with another entity or operation, and not necessarily require or imply between these entities or operation There is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to contain Lid nonexcludability is included, so that process, method, article or terminal device including a series of key elements not only include that A little key elements, but also other key elements including being not expressly set out, or also include be this process, method, article or The intrinsic key element of terminal device.In the absence of more restrictions, the key element limited by sentence "including a ...", and It is not precluded within the process including the key element, method, article or terminal device and also there is other identical element.

The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (18)

1. a kind of high dynamic range images image pickup method, applied to including the mobile terminal of the first camera and second camera, Characterized in that, the high dynamic range images image pickup method includes：

Control first camera and the second camera to gather preview image respectively, and first camera is gathered Preview image be shown in shooting preview interface；

Obtain the M frame preview images of the first camera collection；

Alignment synthesis processing is carried out to the M frames preview image, the first image is generated；

Obtain the N frame preview images of the second camera collection；

High dynamic range images synthesis processing is carried out to the N frames preview image, the second image is generated；

Alignment synthesis processing is carried out to described first image and second image, high dynamic range images are generated.

2. high dynamic range images image pickup method according to claim 1, it is characterised in that described to the M frames preview The step of image carries out alignment synthesis processing, the first image of generation, including：

The maximum preview image of definition values in the M frames preview image is defined as the first reference picture；

Give up the preview image that definition values in M-1 frame preview images are less than predetermined threshold value, obtain S frame preview images；

The image on the basis of first reference picture, image alignment processing is carried out to the S frames preview image；

On frequency domain and spatial domain, the S frames preview image after first reference picture and image alignment processing is carried out Image synthesis is handled, and generates the first image；

Wherein, the M-1 frames preview image is all previews in the M frames preview image in addition to first reference picture Image.

3. high dynamic range images image pickup method according to claim 1, it is characterised in that the acquisition described first is taken the photograph The step of M frame preview images that picture head is gathered, including：

Control the M frame preview images that the first camera collection exposure value is default automatic exposure value；

Obtain the M frames preview image；

Wherein, M >=3.

4. high dynamic range images image pickup method according to claim 3, it is characterised in that the acquisition described second is taken the photograph The step of N frame preview images that picture head is gathered, including：

The N frame preview images for controlling the second camera collection equal value of exposure value different；

Obtain the N frames preview image；

Wherein, N >=3, and M=N.

5. high dynamic range images image pickup method according to claim 4, it is characterised in that if N values are 5, the control The step of second camera gathers the equal value of exposure value different N frame preview images is made, including：

Detect whether present filming scene is backlight scene；

If present filming scene is not backlight scene, the second camera is controlled to gather the deficient exposure that exposure value is EV-a successively Time deficient preview image, the normal exposure preview image that exposure value is EV, the exposure value of exposing that preview image, exposure value are EV-b is EV + c secondary overexposure preview image and exposure value is EV+d overexposure preview image；

If present filming scene is backlight scene, the second camera is controlled to gather the deficient exposure that exposure value is EV0-e successively Preview image, exposure value be EV0-f time owe to expose normal exposure preview image, exposure value that preview image, exposure value are EV be EV+g secondary overexposure preview image and exposure value is EV+h overexposure preview image；

Wherein, EV is the exposure value of present filming scene, a>B, d>C, e>F, h>g；A ≠ e, b ≠ f, c ≠ g, d ≠ h；a、b、c、 D, e, f, g, h are positive number.

6. high dynamic range images image pickup method according to claim 4, it is characterised in that if N values are 4, the control The step of second camera gathers the equal value of exposure value different N frame preview images is made, including：

Detect whether present filming scene is backlight scene；

If present filming scene is not backlight scene, the second camera is controlled to gather exposure value owing for EV-t1 successively It is the secondary overexposure preview image and exposure that EV-t2 time deficient exposure preview image, exposure value are EV+t3 to expose preview image, exposure value It is worth the overexposure preview image for EV+t4；

If present filming scene is backlight scene, the second camera is controlled to gather the deficient exposure that exposure value is EV-b1 successively Secondary overexposure preview image and exposure value that time deficient exposure preview image, the exposure value that preview image, exposure value are EV-b2 are EV+b3 For EV+b4 overexposure preview image；

Wherein, EV is the exposure value of present filming scene, t1>T2, t4>T3, b1>B2, b4>b3；T1 ≠ b1, t2 ≠ b2, t3 ≠ B3, t4 ≠ b4；T1, t2, t3, t4, b1, b2, b3, b4 are positive number.

7. high dynamic range images image pickup method according to claim 1, it is characterised in that described to the N frames preview The step of image carries out high dynamic range images synthesis processing, the second image of generation, including：

The characteristic information of each frame preview image in the N frames preview image is extracted, the characteristic information is believed including image border Breath, color information, the pixel information in overexposure region and the pixel information for owing exposure region；

The two field picture in the M frames preview image is obtained as the second reference picture；

According to described image marginal information and color information, the image on the basis of second reference picture, to the N frames preview Image carries out image alignment processing；

Overexposure region in the reference picture is filled with all pixels point for owing to expose same area in frame preview image, and will Filled with all pixels point of same area in overexposure frame preview image in deficient exposure region in the reference picture；

After the completion of being filled when the overexposure region in the reference picture and the deficient exposure region, the second image is generated.

8. high dynamic range images image pickup method according to claim 1, it is characterised in that described to described first image The step of alignment synthesis processing, generation high dynamic range images being carried out with second image, including：

Described first image is defined as the 3rd reference picture；

The image on the basis of the 3rd reference picture, image alignment processing is carried out to second image；

On frequency domain and spatial domain, image synthesis is carried out to second image after described first image and image alignment processing Processing, generates high dynamic range images.

9. a kind of mobile terminal, including the first camera and second camera, it is characterised in that also include：

First processing module, for controlling first camera and the second camera to gather preview image respectively, and will The preview image of the first camera collection is shown in shooting preview interface；

First acquisition module, the M frame preview images for obtaining the first camera collection；

Second processing module, the M frames preview image for being obtained to first acquisition module carries out alignment synthesis processing, generation First image；

Second acquisition module, the N frame preview images for obtaining the second camera collection；

3rd processing module, the N frames preview image for being obtained to second acquisition module carries out high dynamic range images conjunction Into processing, the second image is generated；

Fourth processing module, is generated for the first image generated to the Second processing module and the 3rd processing module Second image carries out alignment synthesis processing, generates high dynamic range images.

10. mobile terminal according to claim 9, it is characterised in that the Second processing module includes：

First determination sub-module, for the maximum preview image of definition values in the M frames preview image to be defined as into the first ginseng Examine image；

First processing submodule, the preview image of predetermined threshold value is less than for giving up definition values in M-1 frame preview images, is obtained S frame preview images；

Second processing submodule, for image on the basis of the first reference picture for being determined by first determination sub-module, to institute State the S frames preview image progress image alignment processing that the first processing submodule is obtained；

3rd processing submodule, in frequency domain and spatial domain, first determined to first determination sub-module to be with reference to figure The S frames preview image that picture and the second processing submodule are performed after image alignment processing carries out image synthesis processing, raw Into the first image；

Wherein, the M-1 frames preview image is all previews in the M frames preview image in addition to first reference picture Image.

11. mobile terminal according to claim 9, it is characterised in that first acquisition module includes：

First control submodule, for controlling the M frames that the first camera collection exposure value is default automatic exposure value Preview image；

First acquisition submodule, for obtaining the M frames preview image；

Wherein, M >=3.

12. mobile terminal according to claim 11, it is characterised in that second acquisition module includes：

Second control submodule, for controlling the different N frame preview images of the second camera collection equal value of exposure value；

Second acquisition submodule, for obtaining the N frames preview image；

Wherein, N >=3, and M=N.

13. mobile terminal according to claim 12, it is characterised in that if N values are 5, second control submodule Including：

First detection unit, for detecting whether present filming scene is backlight scene；

First control unit, if being not backlight scene for present filming scene, controls the second camera to gather successively The normal exposure that time deficient exposure preview image, the exposure value that deficient exposure preview image, the exposure value that exposure value is EV-a are EV-b are EV The overexposure preview image that the secondary overexposure preview image and exposure value that preview image, exposure value are EV+c are EV+d；

Second control unit, if being backlight scene for present filming scene, controls the second camera to gather exposure successively The normal exposure that time deficient exposure preview image, the exposure value that deficient exposure preview image, the exposure value that light value is EV0-e are EV0-f are EV The overexposure preview image that the secondary overexposure preview image and exposure value that preview image, exposure value are EV+g are EV+h；

Wherein, EV is the exposure value of present filming scene, a>B, d>C, e>F, h>g；A ≠ e, b ≠ f, c ≠ g, d ≠ h；a、b、c、 D, e, f, g, h are positive number.

14. mobile terminal according to claim 12, it is characterised in that if N values are 4, second control submodule Including：

Second detection unit, for detecting whether present filming scene is backlight scene；

3rd control unit, if being not backlight scene for present filming scene, controls the second camera to gather successively The secondary mistake that time deficient exposure preview image, the exposure value that deficient exposure preview image, the exposure value that exposure value is EV-t1 are EV-t2 are EV+t3 Expose the overexposure preview image of preview image and exposure value for EV+t4；

4th control unit, if being backlight scene for present filming scene, controls the second camera to gather exposure successively The secondary overexposure that time deficient exposure preview image, the exposure value that deficient exposure preview image, the exposure value that light value is EV-b1 are EV-b2 are EV+b3 Preview image and the overexposure preview image that exposure value is EV+b4；

Wherein, EV is the exposure value of present filming scene, t1>T2, t4>T3, b1>B2, b4>b3；T1 ≠ b1, t2 ≠ b2, t3 ≠ B3, t4 ≠ b4；T1, t2, t3, t4, b1, b2, b3, b4 are positive number.

15. mobile terminal according to claim 9, it is characterised in that the 3rd processing module includes：

First extracting sub-module, the characteristic information for extracting each frame preview image in the N frames preview image, the feature Information includes image edge information, color information, the pixel information in overexposure region and owes to expose the pixel information in region；

3rd acquisition submodule, for obtaining the two field picture in the M frames preview image as the second reference picture；

Fourth process submodule, for the image edge information and color information extracted according to first extracting sub-module, with Image on the basis of the second reference picture that 3rd acquisition submodule is obtained, image alignment is carried out to the N frames preview image Processing；

5th processing submodule, for overexposure region in the reference picture to be exposed into same area in frame preview image with deficient All pixels point is filled, and by all pictures of the deficient exposure region in the reference picture with same area in overexposure frame preview image Vegetarian refreshments is filled；

First generation submodule, after the completion of being filled when the overexposure region in the reference picture and the deficient exposure region, Generate the second image.

16. mobile terminal according to claim 9, it is characterised in that the fourth processing module includes：

Second determination sub-module, for described first image to be defined as into the 3rd reference picture；

6th processing submodule, for image on the basis of the 3rd reference picture that is determined by second determination sub-module, to institute State the second image and carry out image alignment processing；

7th processing submodule, in frequency domain and spatial domain, described in after described first image and image alignment processing Second image carries out image synthesis processing, generates high dynamic range images.

17. a kind of mobile terminal, it is characterised in that including processor, memory and be stored on the memory and can be in institute The computer program run on processor is stated, the computer program is realized such as claim 1 to 8 during the computing device Any one of high dynamic range images image pickup method the step of.

18. a kind of computer-readable recording medium, it is characterised in that be stored with computer on the computer-readable recording medium Program, realizes the HDR figure as any one of claim 1 to 8 when the computer program is executed by processor As the step of image pickup method.