CN110177221A

CN110177221A - The image pickup method and device of high dynamic range images

Info

Publication number: CN110177221A
Application number: CN201910559380.5A
Authority: CN
Inventors: 杨威
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Aiku software technology (Shanghai) Co.,Ltd.
Priority date: 2019-06-25
Filing date: 2019-06-25
Publication date: 2019-08-27
Anticipated expiration: 2039-06-25
Also published as: CN110177221B

Abstract

The present invention provides a kind of image pickup method of high dynamic range images and devices.The described method includes: carrying out survey light to shooting area using the first camera, obtain target normal exposure value, according to the scene information of target normal exposure value and shooting area, determine that first owes to expose exposure value and the first overexposure exposure value, survey light is carried out using mistake dark areas of the second camera to shooting area, second is obtained to owe to expose exposure value, survey light is carried out using overly bright region of the third camera to shooting area, obtain the second overexposure exposure value, the first overexposure exposure value is corrected based on the second overexposure exposure value, generate overexposure corrected value, exposure exposure value is owed based on second to be corrected the first deficient exposure value that exposes, it generates and owes to expose corrected value, according to overexposure corrected value, target normal exposure value and the deficient corrected value that exposes shoot shooting area, generate high dynamic range images.The high dynamic range images overall brightness that the present invention can make is moderate, and tone relationship is accurate.

Description

The image pickup method and device of high dynamic range images

Technical field

The present invention relates to mobile communication technology fields, more particularly to the image pickup method and dress of a kind of high dynamic range images It sets.

Background technique

With the extensive use of intelligent handheld device, more and more users' selection is taken pictures using handheld device.And The limitation of the dynamic range of camera sensing device as built in handheld device, most of handheld devices are in high dynamic range scene Under can need to shoot not using HDR (High-Dynamic Range, high dynamic range images) imaging technique, the technology when taking pictures With the image sequence of exposure parameter, the image of a high dynamic range is finally merged out.The image sequence of different exposure parameters Exposure parameter plays a crucial role the dynamic range for the image being finally fused into, overall brightness and tone relationship.

And the exposure parameter of the acquisition image sequence of the HDR imaging technique of Most current handheld device is using fixation EV value, this exposure strategies can not adapt to the scene of Different Dynamic range.It will lead under high dynamic range scene and to merge out Dynamic range of images is insufficient, and the overall brightness that may cause blending image under low-dynamic range scene is higher or relatively low, leads Tone relationship is caused to invert.

Summary of the invention

The embodiment of the present invention provides image pickup method, device, mobile terminal and the storage medium of a kind of high dynamic range images, To solve HDR imaging technique in the prior art, it may cause the dynamic range of images deficiency merged out or tone relationship occur The problem of reversion.

In order to solve the above-mentioned technical problem, the embodiments of the present invention are implemented as follows:

In a first aspect, the embodiment of the invention provides a kind of image pickup methods of high dynamic range images, comprising: described in use First camera carries out survey light to shooting area, determines target normal exposure value；According to the target normal exposure value and described The scene information of shooting area determines that first owes to expose exposure value and the first overexposure exposure value；Using the second camera to institute The mistake dark areas for stating shooting area carries out survey light, obtains second and owes to expose exposure value；The dark areas of crossing is in the shooting area Region of the brightness value less than the first luminance threshold；The overly bright region of the shooting area is surveyed using the third camera Light obtains the second overexposure exposure value；The overly bright region is the area that brightness value is greater than the second luminance threshold in the shooting area Domain, second luminance threshold are greater than first luminance threshold；Based on the second overexposure exposure value to first overexposure Exposure value is corrected, and generates overexposure corrected value；Owe to expose exposure value to the described first deficient exposure exposure value progress based on described second Correction generates and owes to expose corrected value；According to the overexposure corrected value, the target normal exposure value and the deficient exposure corrected value to institute It states shooting area to be shot, generates high dynamic range images.

Second aspect, the embodiment of the invention provides a kind of filming apparatus of high dynamic range images, comprising: target light exposure It is worth determining module, for carrying out survey light to shooting area using first camera, determines target normal exposure value；First exposes Light value obtains module, for the scene information according to the target normal exposure value and the shooting area, determines that first owes to expose Exposure value and the first overexposure exposure value；Second deficient exposure value obtains module, for using the second camera to the shooting area The mistake dark areas in domain carries out survey light, obtains second and owes to expose exposure value；The dark areas of crossing is that brightness value is small in the shooting area In the region of the first luminance threshold；Second overexposure value obtains module, for using the third camera to the shooting area Overly bright region carry out survey light, obtain the second overexposure exposure value；The overly bright region is that brightness value is greater than in the shooting area The region of second luminance threshold, second luminance threshold are greater than first luminance threshold；Overexposure corrected value generation module is used The first overexposure exposure value is corrected in based on the second overexposure exposure value, generates overexposure corrected value；It owes to expose correction It is worth generation module, the described first deficient exposure value that exposes is corrected for owing exposure exposure value based on described second, generates and owes exposure school Positive value；Dynamic image generation module, for according to the overexposure corrected value, the target normal exposure value and the deficient exposure correction Value shoots the shooting area, generates high dynamic range images.

The third aspect the embodiment of the invention provides a kind of mobile terminal, including processor, memory and is stored in described It is real when the computer program is executed by the processor on memory and the computer program that can run on the processor The step of image pickup method of existing above-mentioned high dynamic range images.

Fourth aspect, it is described computer-readable to deposit the embodiment of the invention also provides a kind of computer readable storage medium Computer program is stored on storage media, the computer program realizes the bat of above-mentioned high dynamic range images when being executed by processor The step of taking the photograph method.

In embodiments of the present invention, survey light is carried out to shooting area using the first camera, obtains target normal exposure value, According to the scene information of target normal exposure value and shooting area, determines that first owes to expose exposure value and the first overexposure exposure value, adopt Survey light is carried out with mistake dark areas of the second camera to shooting area, second is obtained and owes to expose exposure value, using third camera pair The overly bright region of shooting area carries out survey light, obtains the second overexposure exposure value, is exposed based on the second overexposure exposure value to the first overexposure Light value is corrected, and is generated overexposure corrected value, and owe exposure exposure value based on second and be corrected to the first deficient exposure value that exposes, is generated It owes to expose corrected value, in turn, shooting area is shot according to overexposure corrected value, target normal exposure value and the deficient corrected value that exposes, To generate high dynamic range images.The embodiment of the present invention is by carrying out survey light to scene dark space and scene clear zone, with light value pair Calculated overexposure exposure value and the deficient exposure value that exposes are corrected, and can accurately estimate the dynamic range of current scene and using dynamic The exposure parameter of state obtains different high light pattern sequences, and high dynamic range images can be obtained after these images are merged, The high dynamic range images overall brightness made is moderate, and tone relationship is accurate.

Detailed description of the invention

Fig. 1 is a kind of step flow chart of the image pickup method of high dynamic range images provided in an embodiment of the present invention；

Fig. 2 is a kind of step flow chart of the image pickup method of high dynamic range images provided in an embodiment of the present invention；

Fig. 3 is a kind of structural schematic diagram of the filming apparatus of high dynamic range images provided in an embodiment of the present invention；

Fig. 4 is a kind of structural schematic diagram of the filming apparatus of high dynamic range images provided in an embodiment of the present invention；

Fig. 5 is a kind of structural schematic diagram of mobile terminal provided in an embodiment of the present invention.

Specific embodiment

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.

Embodiment one

Referring to Fig.1, the step of showing a kind of image pickup method of high dynamic range images provided in an embodiment of the present invention stream Cheng Tu, the image pickup method of the high dynamic range images can be applied to mobile terminal, and mobile terminal includes the first camera, second Camera and third camera, the image pickup method of the high dynamic range images can specifically include following steps:

Step 101: survey light being carried out to shooting area using first camera, determines target normal exposure value.

In embodiments of the present invention, mobile terminal can be mobile phone, PAD (Portable Android Device, plate Computer) etc. mobile electronic devices.

First camera can be a pre-set main camera on mobile terminal, second camera and third camera shooting Head can be pre-set two auxiliary cameras on mobile terminal, and the embodiment of the present invention is by a main camera and two The adjustment for the exposure parameter that a auxiliary camera carries out.

It is to be appreciated that being usually to select three EV (Exposure Values) values in HDR imaging technique, acquire respectively The fusion that the image of high dynamic range carries out, i.e. EV0, EV+ and EV-, wherein EV0 is normal exposure value.

Shooting area is the region for being in dynamic range, i.e. region to be captured in the present invention.

Target normal exposure value refers to when carrying out dynamic image fusion using HDR imaging technique, carries out to shooting area Survey EV0 value namely the corresponding exposure value of benchmark image obtained from light.

It, can be continuous to shooting area using the first camera being arranged on mobile terminal after determining shooting area Light is surveyed, specifically, survey light can be carried out to shooting area to the first camera of starting by shooting personnel, i.e., certainly using mobile terminal The photometric system of body accurately detects the light intensity of shooting environmental, to calculate correct f-number+fast automatically The combination of door speed, both can be obtained accurate exposure value, which is target normal exposure value in this way.

After carrying out survey light to shooting area using the first camera and determining target normal exposure value, step 102 is executed.

Step 102: according to the scene information of the target normal exposure value and the shooting area, determining that first owes to expose Light value and the first overexposure exposure value.

First deficient exposure exposure value refers to be used to carry out darkness to shooting area based on what target normal exposure value was calculated The exposure value of compensation.

First overexposure exposure value refers to be used to carry out brightness to shooting area based on what target normal exposure value was calculated The exposure value of compensation.

It is to be appreciated that first owes to expose exposure value to be EV1-, and the first overexposure exposes when target normal exposure value is EV0 Light value is EV1+.

When the scene information of shooting area refers to current shooting, the corresponding scene information in captured region, scene information can To be such as indoor and outdoor, night scene and sales field scene, specifically, can according to the actual situation depending on, the embodiment of the present invention is to this It is without restriction.

And the mode of the scene information for obtaining shooting area, it can be after mobile terminal opens photographing mode, The parameter informations such as light luminance, a riot of sound degree by mobile terminal acquisition shooting area, to be divided with these parameters Analysis, determines the scene information of shooting area.

Certainly, in the concrete realization, those skilled in the art can also obtain the scene of shooting area using other way Information, the embodiment of the present invention are also without restriction to this.

After carrying out survey light to shooting area and obtaining the scene information of target normal exposure value and shooting area, Ke Yijie The scene information for closing target normal exposure value and shooting area determines that first owes to expose exposure value and the first overexposure exposure value, tool Body: it, can be according to the shooting after carrying out survey light to shooting area using the first camera and obtaining target normal exposure value The scene information of shooting area and target normal exposure value are inputted trained relational model in advance by the scene information in region In, to owe to expose exposure value and the first overexposure exposure value by relational model output first.

In the scene information according to target normal exposure value and shooting area, determine that first owes to expose exposure value and the first overexposure After exposure value, step 103 and step 104 are executed.

Step 103: survey light being carried out to the mistake dark areas of the shooting area using the second camera, second is obtained and owes Expose exposure value；The region that dark areas is crossed for brightness value in the shooting area less than the first luminance threshold.

First luminance threshold can be by the corresponding threshold value of the pre-set brightness with shooting area of business personnel.

And the specific value of the first luminance threshold can be configured in advance in conjunction with actual photographed scene, the present invention is real It is without restriction to this to apply example.

Cross the region that dark areas refers to brightness value in shooting area less than the first luminance threshold, i.e., dark areas be shooting area The lower region of brightness in domain.

Second deficient exposure exposure value, which refers to, carries out exposure value obtained from survey light to dark areas excessively.

After determining the mistake dark areas in shooting area, second camera can be opened to survey to dark areas excessively Light specifically can carry out survey light to dark areas is crossed to starting second camera by shooting personnel, that is, utilize mobile terminal itself Photometric system accurately to cross dark situation light intensity detect, to calculate correct f-number+shutter automatically Accurate exposure value had both can be obtained in the combination of speed in this way, which is deficient exposure exposure value corresponding to shooting area, i.e., Second owes to expose exposure value.

Step 104: survey light being carried out to the overly bright region of the shooting area using the third camera, obtains the second mistake Expose exposure value；The overly bright region is the region that brightness value is greater than the second luminance threshold in the shooting area, and described second is bright It spends threshold value and is greater than first luminance threshold.

Second luminance threshold can be by the corresponding threshold value of the pre-set brightness with shooting area of business personnel.

And the specific value of the second luminance threshold can be configured in advance in conjunction with actual photographed scene, the present invention is real It is without restriction to this to apply example.

Overly bright region refers to that brightness value in shooting area is greater than the region of the second luminance threshold, i.e. overly bright region is shooting area The higher region of brightness in domain.

It is to be appreciated that being greater than the first luminance threshold when above-mentioned second luminance threshold, namely crossing dark areas is shooting area Interior darker area, and overly bright region is the brighter areas in shooting area.

Second overexposure exposure value, which refers to, carries out exposure value obtained from survey light to overly bright region.

After determining the overly bright region in shooting area, third camera can be opened to survey to overly bright region Light specifically can carry out survey light to overly bright region to starting third camera by shooting personnel, that is, utilize mobile terminal itself Photometric system accurately to cross bright ring border light intensity detect, to calculate correct f-number+shutter automatically Accurate exposure value had both can be obtained in the combination of speed in this way, which is overexposure exposure value corresponding to shooting area, i.e., Second overexposure exposure value.

It is to be appreciated that the execution sequence of above-mentioned steps 103 and above-mentioned steps 104 is without successive point, it can first carry out Step 103, then step 104 is executed, step 104 can also be first carried out, then execute step 103, it specifically, can be according to practical feelings Depending on condition.

Above-mentioned steps 103 and above-mentioned steps 104 are being based on, after surveying light and obtaining the second overexposure exposure value, are executing step 105；And after surveying light and obtaining the second deficient exposure exposure value, execute step 106.

Step 105: the first overexposure exposure value being corrected based on the second overexposure exposure value, generates overexposure school Positive value.

Overly bright region is being carried out survey after light obtains the second overexposure exposure value, it can be using the second overexposure exposure value to the One overexposure exposure value is corrected, to generate overexposure corrected value.

It, can multiplying in conjunction with the second overexposure exposure value and the second corresponding constant of overexposure exposure value for above-mentioned correction course Long-pending and the first overexposure exposure value constant corresponding with the first overexposure exposure value product, often divided by two by the sum of two products Several and value is to get arriving overexposure corrected value.

Above-mentioned calculating process will be described in detail in following embodiments two, the embodiment of the present invention no longer adds herein To repeat.

The embodiment of the present invention by using the second overexposure exposure value to the first overexposure exposure value, it is available relatively accurate Overexposure corrected value.

Step 106: owing exposure exposure value based on described second and the described first deficient exposure value that exposes is corrected, generate and owe exposure school Positive value.

To cross dark areas survey light obtain second owe to expose exposure value after, can owe to expose exposure value to the using second One, which owes exposure exposure value, is corrected, and owes to expose corrected value to generate.

For above-mentioned correction course, exposure exposure value can be owed in conjunction with second and owe to expose multiplying for the corresponding constant of exposure value with second Product and first owe to expose the product that exposure value owes to expose the corresponding constant of exposure value with first, the sum of two products is normal divided by two Several and value exposes corrected value to get to deficient.

The embodiment of the present invention owes exposure exposure value by using second and owes to expose exposure value to first, available relatively accurate It owes to expose corrected value.

It is to be appreciated that the execution sequence of above-mentioned steps 105 and above-mentioned steps 106 is without successive point, it can first carry out Step 105, then step 106 is executed, step 106 can also be first carried out, then execute step 105, it specifically, can be according to practical feelings Depending on condition.

Above-mentioned steps 105 and above-mentioned steps 106 are being based on, is obtaining after owing to expose corrected value and overexposure corrected value, executes step Rapid 107.

Step 107: according to the overexposure corrected value, the target normal exposure value and the deficient exposure corrected value to the bat It takes the photograph region to be shot, generates high dynamic range images.

High dynamic range images (High-Dynamic Range, HDR) can provide more dynamic ranges and image is thin Section, it is corresponding best using each time for exposure according to LDR (Low-Dynamic Range) image of different time for exposure The LDR image of details synthesizes final HDR image.

After obtaining overexposure corrected value and owing to expose corrected value, according to overexposure corrected value and it can owe to expose corrected value combination mesh Normal exposure value is marked, shooting area is shot, to generate corresponding image sequence (i.e. three images), and to image sequence Column carry out dynamic fusion, to generate high dynamic range images.

It is to combine EV- (owing to expose corrected value), EV0 (target normal exposure value) and EV+ (overexposure correction i.e. in the above process Value) shooting area is shot respectively, to generate three images, three images is used to be merged to generate high dynamic range Enclose image.

The scheme of the embodiment of the present invention is by carrying out survey light to scene dark space and scene clear zone, with light value to calculated Overexposure exposure value and the deficient exposure value that exposes are corrected, and can accurately estimate the dynamic range of current scene and using dynamic exposure Parameter obtains different high light pattern sequences, and high dynamic range images can be obtained after these images are merged, so that obtaining High dynamic range images overall brightness it is moderate, tone relationship is accurate.

The image pickup method of high dynamic range images provided in an embodiment of the present invention, using the first camera to shooting area into Row surveys light, obtains target normal exposure value, according to the scene information of target normal exposure value and shooting area, determines that first owes to expose Exposure value and the first overexposure exposure value carry out survey light using mistake dark areas of the second camera to shooting area, obtain the second mistake Exposure value is exposed, survey light is carried out using overly bright region of the third camera to shooting area, second is obtained and owes to expose exposure value, based on the Two overexposure exposure values are corrected the first overexposure exposure value, generate overexposure corrected value, and owe to expose exposure value to the based on second One, which owes exposure exposure value, is corrected, and generation owes to expose corrected value, in turn, according to overexposure corrected value, target normal exposure value and deficient exposure Corrected value shoots shooting area, to generate high dynamic range images.The embodiment of the present invention passes through to scene dark space and field Scape clear zone carries out survey light, is corrected, can be accurately estimated to calculated overexposure exposure value and the deficient exposure value that exposes with light value The dynamic range of current scene simultaneously obtains different high light pattern sequences using dynamic exposure parameter, these images are melted High dynamic range images can be obtained after conjunction, so that obtained high dynamic range images overall brightness is moderate, tone relationship is accurate.

Embodiment two

Referring to Fig. 2, the step of showing a kind of image pickup method of high dynamic range images provided in an embodiment of the present invention stream Cheng Tu, the image pickup method of the high dynamic range images can be applied to mobile terminal, and mobile terminal includes the first camera, second Camera and third camera, the image pickup method of the high dynamic range images can specifically include following steps:

Step 201: survey light being carried out to shooting area using first camera, determines target normal exposure value.

Step 202: using multiple training images using multiple exposure values, corresponding multiple scene informations as material, training Obtain relationship by objective (RBO) model.

Relationship by objective (RBO) model refers to for determining normal exposure value and shooting according to normal exposure value and photographed scene information Scene jointly corresponding overexposure exposure value and owe expose exposure value model.

Scene information can refer to the scene informations such as indoor and outdoor, night scene and sales field, specifically, can be according to practical feelings Depending on condition, the embodiments of the present invention are not limited thereto.

In the present invention, multiple exposure values can be used, acquire multiple images respectively for each scene information, in turn, Using multiple corresponding training images of multiple scene informations as material, training obtains relationship by objective (RBO) model, for training mesh The detailed process of mark relational model is referred to the description of embodiments discussed below.

In one preferred embodiment of the invention, above-mentioned steps 202 may include:

Sub-step A1: multiple corresponding described training images of each scene information are directed to, are successively obtained described in every The corresponding gray level image of training image.

In embodiments of the present invention, correspond to a kind of photographed scene, multiple exposure values can be respectively adopted and acquire the shooting The shooting image of scene, specifically, the range of EV value are as follows: -5EV~+5EV in the embodiment of the present invention, that is, uses -5EV~+5EV Totally 5 exposure values acquire the image of the corresponding 11 frame difference exposure parameter of every kind of photographed scene, the exposure value of adjacent two field pictures Between be divided into 1EV.

And in the collection process of training sample, 0EV image can be shot, 0EV image exposure parameter passes through automatic exposure (AE) algorithm is calculated.Then click stop and ISO (Sensitivity, sensitivity), by change the time obtain remaining 10 The image of frame difference exposure value.

It, can be by the more of each scene information after acquiring multiple images of each scene information using multiple exposure values Image is as training image, in turn, training objective relational model in the follow-up process.

Gray level image is usually the brightness of each pixel of measurement in single electromagnetic spectrum (such as visible light) obtains.With It is usually saved with each sampled pixel 8 Nonlinear Scales in the gray level image of display, can there is 256 grades of gray scales in this way. This precision just can be avoided visible Distortion of Striping, and be highly susceptible to programming.

After obtaining multiple corresponding training images of each scene information, it is corresponding can successively to obtain each scene information Multiple images gray level image.

And the scheme for obtaining the corresponding gray level image of image has been the more mature technology in this field, and obtain each field The detailed process of the gray level image of multiple corresponding images of scape information, the embodiment of the present invention are not repeated here herein.

Multiple corresponding training images of each scene information are being directed to, the corresponding grayscale image of every training image is successively obtained As after, sub-step A2 is executed.

Sub-step A2: statistics obtains the corresponding pixel ratio of every gray level image.

In the present invention, pixel ratio refers to the ratio of the length and width pixel of every gray level image.

After the gray level image for obtaining multiple corresponding training images of each scene information, every grayscale image can be counted The pixel ratio of picture.

Specifically, every gray level image can be decomposed into histogram information, histogram information includes the extreme value of histogram Slope (fgradient) between point position (fextermpoint) and histogram adjacent extreme point；Count gray level image Pixel ratio, the median (fMedian) and the information such as mode (fMode) and average value of gray level image.To according to every The corresponding histogram information of gray level image can be directly obtained corresponding pixel ratio.

It is to be appreciated that above-mentioned example is merely to more fully understand the technical solution of the embodiment of the present invention and showing for enumerating Example, not as the sole limitation to the embodiment of the present invention.

After statistics obtains the corresponding pixel ratio of every gray level image, sub-step A3 is executed.

Sub-step A3: according to each pixel ratio, the first gray level image and are obtained from gray level image described in multiple Two gray level images.

It, can be just with calculation procedure to every group of image after statistics obtains the corresponding pixel ratio of every gray level image It is successively traversed, is picked out greater than 250 and least less than 5 pixel ratios in every group of image from -5EV image to+5EV image Image, and the EV value for recording the image is the EVRef of this group of image；Using calculation procedure to every group of image from 0EV image to+ 5EV gray level image is successively traversed, and is terminated when traversing a frame gray level image and the image less than 5 being not present and is recorded this The EV value of group image is EV+, and using the gray level image as the second gray level image.

Every group of image is successively traversed from 0EV to -5EV, is not present when traversing a frame gray level image greater than 255 It is terminated when image and the EV value for recording this group of image is EV-, and using the gray level image as the first gray level image.

And for the acquisition modes of the first gray level image and the second gray level image, it is referred to embodiments discussed below progress Detailed description.

In another preferred embodiment of the invention, above-mentioned sub-step A4 may include:

Sub-step B1: it from multiple described gray level images, extracts and owes to expose multiple the first of exposure value acquisition using third Image, and multiple second images using the acquisition of third overexposure exposure value.

In embodiments of the present invention, third owes to expose exposure value and third overexposure exposure value refers to above-mentioned acquisition training image In the process, an overexposure exposure value in multiple exposure values and deficient exposure exposure value.

First image refers to the image for owing to expose exposure value acquisition using third, and the second image refers to be exposed using third overexposure It is worth the image of acquisition.

I.e. the step of embodiment of the present invention, is intended to for each scene information, using the training figure of different exposure values acquisition Picture establishes the incidence relation between different exposure values and different training images.

It is to be appreciated that use -5EV~5EV exposure value is already indicated above in above-mentioned example acquires each scene information Multiple training images, the corresponding deficient exposure exposure value of the first image and the corresponding overexposure exposure value of the second image are corresponding, for example, When the corresponding deficient exposure exposure value of the first image is -5EV, the corresponding overexposure exposure value of the second image is 5EV；And in the first image When corresponding deficient exposure exposure value is -3EV, the corresponding overexposure exposure value of the second image is 3EV.

Multiple first images for owing exposure exposure value acquisition using third from multiple gray level images, are being extracted, and are being used After multiple second images of third overexposure exposure value acquisition, sub-step B2 is executed.

Sub-step B2: according to the pixel ratio of each the first image, pixel ratio is obtained from each the first image Less than first gray level image of the first presetted pixel ratio.

It, can be just with calculation procedure to every group of image after statistics obtains the corresponding pixel ratio of every gray level image It is successively traversed, is picked out greater than 250 and least less than 5 pixel ratios in every group of image from -5EV image to+5EV image Image, and the EV value for recording the image is the EVRef of this group of image；Using calculation procedure to every group of image from 0EV image to+ 5EV gray level image is successively traversed, and is successively traversed to every group of image from 0EV to -5EV, when traversing a frame grayscale image As being EV- there is no the EV value that this group of image is terminated and recorded when the image greater than 255, and using the gray level image as first Gray level image.

Sub-step B3: according to the pixel ratio of each second image, pixel ratio is obtained from each second image Greater than second gray level image of the second presetted pixel ratio.

The EV value that this group of image is terminated and recorded when traversing a frame gray level image and the image less than 5 being not present is EV +, and using the gray level image as the second gray level image.

It is to be appreciated that above preferred embodiment is merely to more fully understanding the technical solution of the embodiment of the present invention and arranging The mode of a kind of acquisition the first gray level image and the second gray level image lifted, in practical applications, those skilled in the art may be used also To obtain the first gray level image and the second gray level image using other way, the embodiments of the present invention are not limited thereto.

According to each pixel ratio, after obtaining the first gray level image and the second gray level image in multiple gray level images, Execute sub-step A4.

Sub-step A4: it obtains the corresponding target of first gray level image and owes to expose exposure value and second gray level image Corresponding target overexposure exposure value.

Target owes exposure exposure value and refers to exposure value used by the first gray level image of acquisition.

Target overexposure exposure value refers to exposure value used by the second gray level image of acquisition.

After obtaining the first gray level image, it is corresponding the first gray level image of acquisition can be obtained according to the first gray level image It owes to expose exposure value, i.e. target owes to expose exposure value.

After obtaining the second gray level image, it is corresponding the second gray level image of acquisition can be obtained according to the second gray level image Overexposure exposure value, i.e. target overexposure exposure value.

I.e. the calculated EVRef of the step, EV1+ and EV1- are this group of image ideal exposure value (Ground under the scene Truth), EV1+ and EV1- is respectively that target overexposure exposure value and target owe to expose exposure value.

After getting target and owing to expose exposure value and target overexposure exposure value, sub-step A5 is executed.

Sub-step A5: each corresponding deficient exposure exposure value of the target of scene information and the target overexposure are exposed Value is used as material, and training obtains the relationship by objective (RBO) model.

It, can will be more after getting the corresponding target of each scene information and owing to expose exposure value and target overexposure exposure value A exposure value, the corresponding target of each scene information owe to expose exposure value and target overexposure exposure value is used as training material to be instructed Practice, to obtain relationship by objective (RBO) model.

To, in the scene and target normal exposure value for determining shooting area, can directly by the scene of shooting area and Target normal exposure value is input to relationship by objective (RBO) model, so as to show that corresponding first owes to expose exposure value and the exposure of the first overexposure Light value (is described) in following step

Step 203: the scene information of the target normal exposure value and the shooting area is inputted into the relationship by objective (RBO) Model obtains described first and owes to expose exposure value and the first overexposure exposure value.

In embodiments of the present invention, first owe expose exposure value refer to based on target normal exposure value be calculated for pair The exposure value of shooting area progress darkness compensation.

After carrying out survey light to shooting area and obtaining the scene information of target normal exposure value and shooting area, it can incite somebody to action The scene information of target normal exposure value and shooting area inputs in above-mentioned relationship by objective (RBO) model, due to pre- in relationship by objective (RBO) model It first saves various different photographed scenes and overexposure exposure value and owes to expose the mapping relations between exposure value, therefore, by target The scene information of normal exposure value and shooting area inputs after relationship by objective (RBO) model, and relationship by objective (RBO) model can export accordingly First overexposure exposure value and first is owed to expose exposure value.

Step 204: survey light being carried out to the mistake dark areas of the shooting area using the second camera, second is obtained and owes Expose exposure value；The region that dark areas is crossed for brightness value in the shooting area less than the first luminance threshold.

Step 205: survey light being carried out to the overly bright region of the shooting area using the third camera, obtains the second mistake Expose exposure value；The overly bright region is the region that brightness value is greater than the second luminance threshold in the shooting area, and described second is bright It spends threshold value and is greater than first luminance threshold.

It is to be appreciated that the execution sequence of above-mentioned steps 204 and above-mentioned steps 205 is without successive point, it can first carry out Step 204, then step 205 is executed, step 205 can also be first carried out, then execute step 204, it specifically, can be according to practical feelings Depending on condition.

Step 206: the first overexposure exposure value being corrected based on the second overexposure exposure value, generates overexposure school Positive value.

Specifically calculating process can be with are as follows:

1, the first product value between the first overexposure exposure value and the first preset constant and the exposure of the second overexposure is calculated The second product value between value and the second preset constant；

First preset constant is constant corresponding with the first overexposure exposure value, and the second preset constant is exposed with the second overexposure It is worth corresponding constant.

It is to be appreciated that the first preset constant and the second preset constant are associated with photographed scene and normal exposure value , and the specific value of the first preset constant and the second default scene can be set by business personnel according to business demand in advance Fixed, the embodiments of the present invention are not limited thereto.

First product value refers to the product value between the first overexposure exposure value and the first preset constant, i.e. the first product value= First overexposure exposure value × the first preset constant.

Second product value refers to the product value between the second overexposure exposure value and the second preset constant, i.e. the second product value= Second overexposure exposure value × the second preset constant.

After obtaining the first overexposure exposure value and the second overexposure exposure value, it can calculate separately to obtain the exposure of the first overexposure The second product between the first product value and the second overexposure exposure value and the second preset constant between value and the first preset constant Value.

2, first between the first product value and the second product value and value and the first preset constant and second pre- is calculated If second between constant and value；

First refers to the first product value and the second product value are added and value with value, i.e., first and the=the first product of value It is worth the+the second product value.

Second refers to the first preset constant is added with the second preset constant and value with value, i.e., second and value=the first The+the second preset constant of preset constant.

In above process, it is calculated after the first product value and the second product value, the first product can be calculated First between value and the second product value and value, and the second He being calculated between the first preset constant and the second preset constant Value.

3, the first ratio between first and value and second and value is calculated, and is corrected the first ratio as overexposure Value；

First ratio refers to the ratio between first and value and second and value, i.e. the/the second He of the first ratio=the first and value Value.

Obtained in above-mentioned steps first and value and second with value after, first and value and second and value can be calculated Between the first ratio, will and, can be using first ratio as overexposure corrected value.

206~step 208 through the above steps, the process of above-mentioned calculating overexposure corrected value can according to the following equation (1) It indicates:

(a* (EV1+)+b* (EV2+))/(a+b) (1) EV+=

In above-mentioned formula (1), EV+ indicates that overexposure corrected value, EV1+ indicate that the first overexposure exposure value, EV2+ indicate the second mistake Exposure value is exposed, a indicates the first preset constant, and b indicates the second preset constant.

Step 207: owing exposure exposure value based on described second and the described first deficient exposure value that exposes is corrected, generate and owe exposure school Positive value.

Specifically calculating process can be with are as follows:

1, the first deficient third product value exposed between exposure value and the first preset constant is calculated and the second deficient expose exposes The 4th product value between value and the second preset constant；

Third product value refers to that first owes to expose the product value between exposure value and the first preset constant, i.e., third product value= First owes to expose exposure value × first preset constant.

4th product value refers to that second owes to expose the product value between exposure value and the second preset constant, i.e. the 4th product value= Second owes to expose exposure value × second preset constant.

Obtain first owe expose exposure value and second owe expose exposure value after, can be calculated first owe expose exposure value and Third product value between first preset constant, and be calculated second and owe to expose the 4th between exposure value and the second preset constant Product value.

2, third and value between third product value and the 4th product value is calculated；

Third and value refer between third product value and the 4th product value and value, i.e., third and value=third product value+ 4th product value.

After obtaining third product value and the 4th product value in above-mentioned steps, third product value and can be calculated Third and value between four product values.

3, the second ratio between third and value and second and value is calculated, and is corrected using the second ratio as exposure is owed Value；

Second ratio refers to the ratio between third and value and second and value, i.e. the/the second He of the second ratio=third and value Value.

Obtained in above-mentioned steps second and value and third with third and value and second and value after value, can be calculated Between the second ratio, and using the second ratio as owe expose corrected value.

209~step 211 through the above steps, above-mentioned calculating owe to expose the process of corrected value, can according to the following equation (2) It indicates:

(a* (EV1-)+b* (EV2-))/(a+b) (2) EV-=

In above-mentioned formula (2), EV- indicates to owe to expose corrected value, and EV1- indicates that first owes to expose exposure value, and EV2- indicates that second owes Exposure value is exposed, a indicates the first preset constant, and b indicates the second preset constant.

Step 208: according to the overexposure corrected value, the target normal exposure value and the deficient exposure corrected value to the bat It takes the photograph region to be shot, generates high dynamic range images.

The image pickup method of high dynamic range images provided in an embodiment of the present invention, in addition to having the offer of above-described embodiment one Outside the beneficial effect that the image pickup method of high dynamic range images has, it can also be counted by mass data and classify and return Return the calculated dynamic range exposure parameter of training, compared to the fixed exposure parameter of traditional HDR, the present invention has exposure in real time Accurate advantage.

Embodiment three

Referring to Fig. 3, the structure for showing a kind of filming apparatus of high dynamic range images provided in an embodiment of the present invention is shown It is intended to, the filming apparatus of the high dynamic range images includes the first camera, second camera and third camera, the high dynamic The filming apparatus of range image can also include specifically following module:

Target light exposure value determining module 310 determines mesh for carrying out survey light to shooting area using first camera Mark normal exposure value；

First exposure value obtains module 320, for the scene according to the target normal exposure value and the shooting area Information determines that first owes to expose exposure value and the first overexposure exposure value；

Second deficient exposure value obtains module 330, for the mistake dark areas using the second camera to the shooting area Survey light is carried out, second is obtained and owes to expose exposure value；The dark areas of crossing is brightness value in the shooting area less than the first luminance threshold The region of value；

Second overexposure value obtains module 340, for the overly bright region using the third camera to the shooting area Survey light is carried out, the second overexposure exposure value is obtained；The overly bright region is that brightness value is greater than the second luminance threshold in the shooting area The region of value, second luminance threshold are greater than first luminance threshold；

Overexposure corrected value generation module 350, for being based on the second overexposure exposure value to the first overexposure exposure value It is corrected, generates overexposure corrected value；

It owes to expose corrected value generation module 360, for owing to expose exposure value to described first based on the described second deficient exposure value that exposes It is corrected, generates and owe to expose corrected value；

Dynamic image generation module 370, for according to the first overexposure exposure value, the target normal exposure value and institute It states the first deficient exposure value that exposes to shoot the shooting area, generates high dynamic range images.

The filming apparatus of high dynamic range images provided in an embodiment of the present invention, using the first camera to shooting area into Row surveys light, obtains target normal exposure value, according to the scene information of target normal exposure value and shooting area, determines that first owes to expose Exposure value and the first overexposure exposure value carry out survey light using mistake dark areas of the second camera to shooting area, obtain second and owe Exposure value is exposed, survey light is carried out using overly bright region of the third camera to shooting area, obtains the second overexposure exposure value, based on the Two overexposure exposure values are corrected the first overexposure exposure value, generate overexposure corrected value, and owe to expose exposure value to the based on second One, which owes exposure exposure value, is corrected, and generation owes to expose corrected value, in turn, according to overexposure corrected value, target normal exposure value and deficient exposure Corrected value shoots shooting area, to generate high dynamic range images.The embodiment of the present invention passes through to scene dark space and field Scape clear zone carries out survey light, is corrected, can be accurately estimated to calculated overexposure exposure value and the deficient exposure value that exposes with light value The dynamic range of current scene simultaneously obtains different high light pattern sequences using dynamic exposure parameter, these images are melted High dynamic range images can be obtained after conjunction, so that obtained high dynamic range images overall brightness is moderate, tone relationship is accurate.

Example IV

Referring to Fig. 4, the structure for showing a kind of filming apparatus of high dynamic range images provided in an embodiment of the present invention is shown It is intended to, the filming apparatus of the high dynamic range images includes the first camera, second camera and third camera, the high dynamic The filming apparatus of range image can also include specifically following module:

Target light exposure value determining module 410 determines mesh for carrying out survey light to shooting area using first camera Mark normal exposure value；

Relationship by objective (RBO) model obtains module 420, for that will use multiple instructions of multiple exposure values, corresponding multiple scene informations Practice image as material, training obtains relationship by objective (RBO) model；

First exposure value obtains module 430, owes to expose exposure with the target normal exposure value matched first for obtaining Value and the first overexposure exposure value；

Second deficient exposure value obtains module 440, for the mistake dark areas using the second camera to the shooting area Survey light is carried out, second is obtained and owes to expose exposure value；The dark areas of crossing is brightness value in the shooting area less than the first luminance threshold The region of value；

Second overexposure value obtains module 450, for the overly bright region using the third camera to the shooting area Survey light is carried out, the second overexposure exposure value is obtained；The overly bright region is that brightness value is greater than the second luminance threshold in the shooting area The region of value, second luminance threshold are greater than first luminance threshold；

Overexposure corrected value generation module 460, for being based on the second overexposure exposure value to the first overexposure exposure value It is corrected, generates overexposure corrected value；

It owes to expose corrected value generation module 470, for owing to expose exposure value to described first based on the described second deficient exposure value that exposes It is corrected, generates and owe to expose corrected value；

Dynamic image generation module 480, for according to the overexposure corrected value, the target normal exposure value and it is described owe It exposes corrected value to shoot the shooting area, generates high dynamic range images.

Preferably, the first exposure value acquisition module 430 includes:

First exposure value acquisition submodule 4301, for by the scene of the target normal exposure value and the shooting area Relationship by objective (RBO) model described in information input obtains described first and owes to expose exposure value and the first overexposure exposure value.

Preferably, the relationship by objective (RBO) model acquisition module 420 includes:

Gray level image acquisition submodule, for being directed to multiple corresponding described training images of each scene information, according to It is secondary to obtain the corresponding gray level image of every training image；

Pixel ratio statistic submodule obtains the corresponding pixel ratio of every gray level image for counting；

Gray level image extracting sub-module, for according to each pixel ratio, obtaining the from gray level image described in multiple One gray level image and the second gray level image；

Target light exposure value acquisition submodule owes to expose exposure value for obtaining the corresponding target of first gray level image, and The corresponding target overexposure exposure value of second gray level image；

Relationship by objective (RBO) model acquisition submodule, for owing the corresponding target of each scene information to exposure exposure value With the target overexposure exposure value as material, training obtains the relationship by objective (RBO) model.

Preferably, the gray level image extracting sub-module includes:

Image zooming-out submodule is owed to expose exposure value acquisition using third for extracting from multiple described gray level images Multiple first images, and using third overexposure exposure value acquisition multiple second images；

First gray level image acquisition submodule, for the pixel ratio according to each the first image, from each described first First gray level image of the pixel ratio less than the first presetted pixel ratio is obtained in image；

Second gray level image acquisition submodule, for the pixel ratio according to each second image, from each described second Second gray level image that pixel ratio is greater than the second presetted pixel ratio is obtained in image

The filming apparatus of high dynamic range images provided in an embodiment of the present invention, in addition to having the offer of above-described embodiment three Outside the beneficial effect that the filming apparatus of high dynamic range images has, it can also be counted by mass data and classify and return Return the calculated dynamic range exposure parameter of training, compared to the fixed exposure parameter of traditional HDR, the present invention has exposure in real time Accurate advantage.

Embodiment five

Referring to Fig. 5, the hardware structural diagram of a kind of mobile terminal of each embodiment to realize the present invention.

The mobile terminal 500 includes but is not limited to: radio frequency unit 501, network module 502, audio output unit 503, defeated Enter unit 504, sensor 505, display unit 506, user input unit 507, interface unit 508, memory 509, processor The components such as 510 and power supply 511.It will be understood by those skilled in the art that mobile terminal structure shown in Fig. 5 is not constituted Restriction to mobile terminal, mobile terminal may include than illustrating more or fewer components, perhaps combine certain components or Different component layouts.In embodiments of the present invention, mobile terminal include but is not limited to mobile phone, tablet computer, laptop, Palm PC, car-mounted terminal, wearable device and pedometer etc..

Processor 510 determines target normal exposure for carrying out survey light to shooting area using first camera Value；According to the scene information of the target normal exposure value and the shooting area, determine that first owes to expose exposure value and the first mistake Expose exposure value；Survey light is carried out using mistake dark areas of the second camera to the shooting area, second is obtained and owes to expose exposure Value；The region that dark areas is crossed for brightness value in the shooting area less than the first luminance threshold；It is imaged using the third Head carries out survey light to the overly bright region of the shooting area, obtains the second overexposure exposure value；The overly bright region is the shooting Brightness value is greater than the region of the second luminance threshold in region, and second luminance threshold is greater than first luminance threshold；It is based on The second overexposure exposure value is corrected the first overexposure exposure value, generates overexposure corrected value；It is owed based on described second It exposes exposure value to be corrected the described first deficient exposure value that exposes, generates and owe to expose corrected value；According to the overexposure corrected value, the mesh Mark normal exposure value and the deficient exposure corrected value shoot the shooting area, generate high dynamic range images.

In embodiments of the present invention, survey light is carried out to shooting area using the first camera, obtains target normal exposure value, According to the scene information of target normal exposure value and shooting area, determines that first owes to expose exposure value and the first overexposure exposure value, adopt Survey light is carried out with mistake dark areas of the second camera to shooting area, second is obtained and owes to expose exposure value, using third camera pair The overly bright region of shooting area carries out survey light, obtains the second overexposure exposure value, is exposed based on the second overexposure exposure value to the first overexposure Light value is corrected, and is generated overexposure corrected value, and owe exposure exposure value based on second and be corrected to the first deficient exposure value that exposes, is generated It owes to expose corrected value, in turn, shooting area is shot according to overexposure corrected value, target normal exposure value and the deficient corrected value that exposes, To generate high dynamic range images.The embodiment of the present invention is by carrying out survey light to scene dark space and scene clear zone, with light value pair Calculated overexposure exposure value and the deficient exposure value that exposes are corrected, and can accurately estimate the dynamic range of current scene and using dynamic The exposure parameter of state obtains different high light pattern sequences, and high dynamic range images can be obtained after these images are merged, So that obtained high dynamic range images overall brightness is moderate, tone relationship is accurate.

It should be understood that the embodiment of the present invention in, radio frequency unit 501 can be used for receiving and sending messages or communication process in, signal Send and receive, specifically, by from base station downlink data receive after, to processor 510 handle；In addition, by uplink Data are sent to base station.In general, radio frequency unit 501 includes but is not limited to antenna, at least one amplifier, transceiver, coupling Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 501 can also by wireless communication system and network and other set Standby communication.

Mobile terminal provides wireless broadband internet by network module 502 for user and accesses, and such as user is helped to receive It sends e-mails, browse webpage and access streaming video etc..

Audio output unit 503 can be received by radio frequency unit 501 or network module 502 or in memory 509 The audio data of storage is converted into audio signal and exports to be sound.Moreover, audio output unit 503 can also be provided and be moved The relevant audio output of specific function that dynamic terminal 500 executes is (for example, call signal receives sound, message sink sound etc. Deng).Audio output unit 503 includes loudspeaker, buzzer and receiver etc..

Input unit 504 is for receiving audio or video signal.Input unit 504 may include graphics processor (Graphics Processing Unit, GPU) 5041 and microphone 5042, graphics processor 5041 is in video acquisition mode Or the image data of the static images or video obtained in image capture mode by image capture apparatus (such as camera) carries out Reason.Treated, and picture frame may be displayed on display unit 506.Through graphics processor 5041, treated that picture frame can be deposited Storage is sent in memory 509 (or other storage mediums) or via radio frequency unit 501 or network module 502.Mike Wind 5042 can receive sound, and can be audio data by such acoustic processing.Treated audio data can be The format output that mobile communication base station can be sent to via radio frequency unit 501 is converted in the case where telephone calling model.

Mobile terminal 500 further includes at least one sensor 505, such as optical sensor, motion sensor and other biographies Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 5061, and proximity sensor can close when mobile terminal 500 is moved in one's ear Display panel 5061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (general For three axis) size of acceleration, it can detect that size and the direction of gravity when static, can be used to identify mobile terminal posture (ratio Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；It passes Sensor 505 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet Meter, thermometer, infrared sensor etc. are spent, details are not described herein.

Display unit 506 is for showing information input by user or being supplied to the information of user.Display unit 506 can wrap Display panel 5061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 5061.

User input unit 507 can be used for receiving the number or character information of input, and generate the use with mobile terminal Family setting and the related key signals input of function control.Specifically, user input unit 507 include touch panel 5071 and Other input equipments 5072.Touch panel 5071, also referred to as touch screen collect the touch operation of user on it or nearby (for example user uses any suitable objects or attachment such as finger, stylus on touch panel 5071 or in touch panel 5071 Neighbouring operation).Touch panel 5071 may include both touch detecting apparatus and touch controller.Wherein, touch detection Device detects the touch orientation of user, and detects touch operation bring signal, transmits a signal to touch controller；Touch control Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 510, receiving area It manages the order that device 510 is sent and is executed.Furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc. Seed type realizes touch panel 5071.In addition to touch panel 5071, user input unit 507 can also include other input equipments 5072.Specifically, other input equipments 5072 can include but is not limited to physical keyboard, function key (such as volume control button, Switch key etc.), trace ball, mouse, operating stick, details are not described herein.

Further, touch panel 5071 can be covered on display panel 5061, when touch panel 5071 is detected at it On or near touch operation after, send processor 510 to determine the type of touch event, be followed by subsequent processing device 510 according to touching The type for touching event provides corresponding visual output on display panel 5061.Although in Fig. 5, touch panel 5071 and display Panel 5061 is the function that outputs and inputs of realizing mobile terminal as two independent components, but in some embodiments In, can be integrated by touch panel 5071 and display panel 5061 and realize the function that outputs and inputs of mobile terminal, it is specific this Place is without limitation.

Interface unit 508 is the interface that external device (ED) is connect with mobile terminal 500.For example, external device (ED) may include having Line or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end Mouth, port, the port audio input/output (I/O), video i/o port, earphone end for connecting the device with identification module Mouthful etc..Interface unit 508 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and By one or more elements that the input received is transferred in mobile terminal 500 or can be used in 500 He of mobile terminal Data are transmitted between external device (ED).

Memory 509 can be used for storing software program and various data.Memory 509 can mainly include storing program area The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function Sound playing function, image player function etc.) etc.；Storage data area can store according to mobile phone use created data (such as Audio data, phone directory etc.) etc..In addition, memory 509 may include high-speed random access memory, it can also include non-easy The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.

Processor 510 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection A part by running or execute the software program and/or module that are stored in memory 509, and calls and is stored in storage Data in device 509 execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.Place Managing device 510 may include one or more processing units；Preferably, processor 510 can integrate application processor and modulatedemodulate is mediated Manage device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is main Processing wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 510.

Mobile terminal 500 can also include the power supply 511 (such as battery) powered to all parts, it is preferred that power supply 511 Can be logically contiguous by power-supply management system and processor 510, to realize management charging by power-supply management system, put The functions such as electricity and power managed.

In addition, mobile terminal 500 includes some unshowned functional modules, details are not described herein.

Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor 510, and memory 509 is stored in On memory 509 and the computer program that can run on the processor 510, the computer program are executed by processor 510 Each process of the image pickup method embodiment of the above-mentioned high dynamic range images of Shi Shixian, and identical technical effect can be reached, it is It avoids repeating, which is not described herein again.

The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium Calculation machine program, the computer program realize each of the image pickup method embodiment of above-mentioned high dynamic range images when being executed by processor A process, and identical technical effect can be reached, to avoid repeating, which is not described herein again.Wherein, described computer-readable to deposit Storage media, such as read-only memory (Read-OnlyMemory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic or disk etc..

It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do There is also other identical elements in the process, method of element, article or device.

Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art The part contributed out can be embodied in the form of software products, which is stored in a storage medium In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal (can be mobile phone, computer, service Device, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.

The embodiment of the present invention is described with above attached drawing, but the invention is not limited to above-mentioned specific Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much Form belongs within protection of the invention.

Claims

1. a kind of image pickup method of high dynamic range images, be applied to mobile terminal, the mobile terminal include the first camera, Second camera and third camera, which is characterized in that the described method includes:

Survey light is carried out to shooting area using first camera, determines target normal exposure value；

According to the scene information of the target normal exposure value and the shooting area, determine that first owes to expose exposure value and the first mistake Expose exposure value；

Survey light is carried out using mistake dark areas of the second camera to the shooting area, second is obtained and owes to expose exposure value；Institute Stated region of the dark areas for brightness value in the shooting area less than the first luminance threshold；

Survey light is carried out using overly bright region of the third camera to the shooting area, obtains the second overexposure exposure value；Institute Stating overly bright region is the region that brightness value is greater than the second luminance threshold in the shooting area, and second luminance threshold is greater than institute State the first luminance threshold；

The first overexposure exposure value is corrected based on the second overexposure exposure value, generates overexposure corrected value；

Exposure exposure value is owed based on described second to be corrected the described first deficient exposure value that exposes, and is generated and is owed exposure corrected value；

The shooting area is clapped according to the overexposure corrected value, the target normal exposure value and the deficient exposure corrected value It takes the photograph, generates high dynamic range images.

2. the method according to claim 1, wherein described according to the target normal exposure value and the shooting The scene information in region, before determining the first deficient exposure exposure value and the first overexposure exposure value, the method also includes:

Using multiple training images using multiple exposure values, corresponding multiple scene informations as material, training obtains relationship by objective (RBO) Model；

The scene information according to the target normal exposure value and the shooting area determines that first owes to expose exposure value and the One overexposure exposure value, comprising:

The scene information of the target normal exposure value and the shooting area is inputted into the relationship by objective (RBO) model, is obtained described First owes to expose exposure value and the first overexposure exposure value.

3. according to the method described in claim 2, it is characterized in that, described will be using multiple exposure values, corresponding multiple scene letters Multiple training images of breath obtain relationship by objective (RBO) model as material, training, comprising:

For multiple corresponding described training images of each scene information, it is corresponding successively to obtain every training image Gray level image；

Statistics obtains the corresponding pixel ratio of every gray level image；

According to each pixel ratio, the first gray level image and the second gray level image are obtained from gray level image described in multiple；

The corresponding target of first gray level image is obtained to owe to expose exposure value and the corresponding target overexposure of second gray level image Exposure value；

Using each corresponding deficient exposure exposure value of the target of scene information and the target overexposure exposure value as material, instruction Get the relationship by objective (RBO) model.

4. according to the method described in claim 3, it is characterized in that, described according to the pixel ratio, from gray scale described in multiple The first gray level image and the second gray level image are obtained in image, comprising:

From multiple described gray level images, multiple first images for owing to expose exposure value acquisition using third are extracted, and using the Multiple second images of three overexposure exposure values acquisition；

According to the pixel ratio of each the first image, pixel ratio is obtained from each the first image less than the first default picture First gray level image of plain ratio；

According to the pixel ratio of each second image, pixel ratio is obtained from each second image and is greater than the second default picture Second gray level image of plain ratio.

5. a kind of filming apparatus of high dynamic range images, described device includes that the first camera, second camera and third are taken the photograph As head, which is characterized in that described device further include:

Target light exposure value determining module determines that target is normal for carrying out survey light to shooting area using first camera Exposure value；

First exposure value obtains module, for the scene information according to the target normal exposure value and the shooting area, really Fixed first owes to expose exposure value and the first overexposure exposure value；

Second deficient exposure value obtains module, for being surveyed using the second camera to the mistake dark areas of the shooting area Light obtains second and owes to expose exposure value；The area that dark areas is crossed for brightness value in the shooting area less than the first luminance threshold Domain；

Second overexposure value obtains module, for being surveyed using the third camera to the overly bright region of the shooting area Light obtains the second overexposure exposure value；The overly bright region is the area that brightness value is greater than the second luminance threshold in the shooting area Domain, second luminance threshold are greater than first luminance threshold；

Overexposure corrected value generation module, for carrying out school to the first overexposure exposure value based on the second overexposure exposure value Just, overexposure corrected value is generated；

Exposure corrected value generation module is owed, carries out school for owing exposure exposure value to described first based on the described second deficient exposure exposure value Just, it generates and owes to expose corrected value；

Dynamic image generation module, for according to the overexposure corrected value, the target normal exposure value and the deficient exposure correction Value shoots the shooting area, generates high dynamic range images.

6. device according to claim 5, which is characterized in that described device further include:

Relationship by objective (RBO) model obtains module, for that will use multiple training images of multiple exposure values, corresponding multiple scene informations As material, training obtains relationship by objective (RBO) model；

First exposure value obtains module

First exposure value acquisition submodule, for inputting the scene information of the target normal exposure value and the shooting area The relationship by objective (RBO) model obtains described first and owes to expose exposure value and the first overexposure exposure value.

7. device according to claim 6, which is characterized in that the relationship by objective (RBO) model obtains module and includes:

Gray level image acquisition submodule is successively obtained for being directed to multiple corresponding described training images of each scene information Take the corresponding gray level image of every training image；

Gray level image extracting sub-module, for obtaining the first ash from gray level image described in multiple according to each pixel ratio Spend image and the second gray level image；

Target light exposure value acquisition submodule owes to expose exposure value and described for obtaining the corresponding target of first gray level image The corresponding target overexposure exposure value of second gray level image；

Relationship by objective (RBO) model acquisition submodule, for owing the corresponding target of each scene information to exposure exposure value and institute Target overexposure exposure value is stated as material, training obtains the relationship by objective (RBO) model.

8. the device stated according to claim 7, which is characterized in that the gray level image extracting sub-module includes:

Image zooming-out submodule is owed to expose the more of exposure value acquisition using third for extracting from multiple described gray level images A first image, and multiple second images using the acquisition of third overexposure exposure value；

First gray level image acquisition submodule, for the pixel ratio according to each the first image, from each the first image It is middle to obtain first gray level image of the pixel ratio less than the first presetted pixel ratio；

Second gray level image acquisition submodule, for the pixel ratio according to each second image, from each second image Middle second gray level image for obtaining pixel ratio and being greater than the second presetted pixel ratio.

9. a kind of mobile terminal, which is characterized in that including processor, memory and be stored on the memory and can be described The computer program run on processor is realized when the computer program is executed by the processor as in Claims 1-4 The step of image pickup method of described in any item high dynamic range images.

10. a kind of computer readable storage medium, which is characterized in that store computer journey on the computer readable storage medium Sequence, the computer program realize high dynamic range images according to any one of claims 1 to 4 when being executed by processor Image pickup method the step of.