CN109005363A

CN109005363A - Image formation control method, device, electronic equipment and storage medium

Info

Publication number: CN109005363A
Application number: CN201810915380.XA
Authority: CN
Inventors: 黄杰文
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-08-13
Filing date: 2018-08-13
Publication date: 2018-12-14
Anticipated expiration: 2038-08-13
Also published as: CN109005363B

Abstract

The application proposes a kind of image formation control method and device, imaging device includes the pixel unit array being made of multiple sensitive pixel elements, wherein, method includes: when photographed scene belongs to brightness and is greater than the light environment of threshold luminance, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine whether the scene belongs to exposure than the narrow dynamic range less than the first exposure than threshold value, if it is determined that belonging to narrow dynamic range, it controls pixel unit array and exports original pixels information, according to exposing pixels long in same sensitive pixel elements, the merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of middle exposing pixels and short exposure pixel, it is imaged according to the corresponding reduction Pixel Information of Pixel Information is merged.It as a result, when photographed scene belongs to the narrow dynamic range under light environment, is restored and is imaged according to the merging Pixel Information of each sensitive pixel elements, improve imaging effect and image quality, improve the shooting experience of user.

Description

Image formation control method, device, electronic equipment and storage medium

Technical field

This application involves technical field of mobile terminals more particularly to a kind of image formation control method, device, electronic equipment and Storage medium.

Background technique

With the continuous development of terminal technology, more and more users shoot image using electronic equipment.In backlight scene Under, when user uses the front camera self-timer of electronic equipment, since user is between light source and electronic equipment, it is easy to make Insufficient situation is exposed at face to occur.If improving face brightness by adjusting exposure, background area overexposure can be made Light, or even can not clearly show that photographed scene.

In the prior art, in order to improve the shooting quality under the high dynamic range scene such as backlight, in shooting process, lead to It crosses control pixel array and carries out long exposure, middle exposure and short exposure respectively, then the image obtained under different exposures is synthesized Output imaging afterwards, to improve the imaging effect of image.

But it has been found that the image quality that this mode shoots to obtain image can become with photographed scene difference Change, under some photographed scenes, although dynamic range is larger, image resolution ratio and signal-to-noise ratio are all relatively low, therefore, this The single screening-mode of kind can not adapt to a variety of photographed scenes.

Summary of the invention

The application proposes a kind of image formation control method, device, electronic equipment and readable storage medium storing program for executing, for according to different bats The ambient brightness value for taking the photograph scene obtains image using corresponding screening-mode, poor to solve image quality in the prior art Technical problem.

The application one side embodiment proposes a kind of image formation control method, comprising:

When photographed scene belongs to brightness and is greater than the light environment of threshold luminance, according to the long exposing pixels and short exposure Exposure ratio of the pixel under the photographed scene, determines whether the photographed scene belongs to exposure than comparing threshold value less than the first exposure Narrow dynamic range；

If it is determined that belonging to narrow dynamic range, the pixel unit array output original pixels information is controlled；

Believed according to the original pixels of the original pixels information of exposing pixels long in same sensitive pixel elements, middle exposing pixels The merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of breath and short exposure pixel；

It is imaged according to the corresponding reduction Pixel Information of the merging Pixel Information.

The image formation control method of the embodiment of the present application belongs to the light environment that brightness is greater than threshold luminance in photographed scene When, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine whether the scene belongs to exposure than small In narrow dynamic range of first exposure than threshold value, however, it is determined that belong to narrow dynamic range, control pixel unit array exports original image Prime information, according to the original pixels information of exposing pixels long in same sensitive pixel elements, middle exposing pixels and short exposure pixel The merging Pixel Information of each sensitive pixel elements is calculated, according to merge the progress of Pixel Information corresponding reduction Pixel Information at Picture.As a result, when photographed scene belongs to the narrow dynamic range under light environment, believed according to the merging pixel of each sensitive pixel elements Breath reduction imaging, increases image resolution ratio, to improve imaging effect and image quality, improves the shooting experience of user.

The another aspect embodiment of the application proposes a kind of imaging control apparatus, and the imaging device includes by multiple photosensitive The pixel unit array of pixel unit composition, each sensitive pixel elements at least one long exposing pixels, at least one including exposing Pixel and at least a short exposure pixel, described device include:

Determining module, for being exposed according to the length when photographed scene belongs to brightness and is greater than the light environment of threshold luminance Light pixel and exposure ratio of the short exposure pixel under the photographed scene, determine whether the photographed scene belongs to exposure ratio and be less than Narrow dynamic range of first exposure than threshold value；

Control module, for if it is determined that belong to narrow dynamic range, controlling the pixel unit array output original pixels Information；

Processing module, for the original pixels information according to exposing pixels long in same sensitive pixel elements, middle exposure picture The merging pixel letter of each sensitive pixel elements is calculated in the original pixels information of element and the original pixels information of short exposure pixel Breath；

Image-forming module, for being imaged according to the corresponding reduction Pixel Information of the merging Pixel Information.

The imaging control apparatus of the embodiment of the present application belongs to the light environment that brightness is greater than threshold luminance in photographed scene When, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine whether the scene belongs to exposure than small In narrow dynamic range of first exposure than threshold value, however, it is determined that belong to narrow dynamic range, control pixel unit array exports original image Prime information, according to the original pixels information of exposing pixels long in same sensitive pixel elements, middle exposing pixels and short exposure pixel The merging Pixel Information of each sensitive pixel elements is calculated, according to merge the progress of Pixel Information corresponding reduction Pixel Information at Picture.As a result, when photographed scene belongs to the narrow dynamic range under light environment, believed according to the merging pixel of each sensitive pixel elements Breath reduction imaging, increases image resolution ratio, to improve imaging effect and image quality, improves the shooting experience of user.

The another aspect embodiment of the application proposes a kind of electronic equipment, comprising: memory, processor and is stored in storage On device and the computer program that can run on a processor, when the processor executes described program, such as previous embodiment is realized The image formation control method.

The another aspect embodiment of the application proposes a kind of computer readable storage medium, is stored thereon with computer journey Sequence, which is characterized in that the program realizes image formation control method as in the foregoing embodiment when being executed by processor.

The additional aspect of the application and advantage will be set forth in part in the description, and will partially become from the following description It obtains obviously, or recognized by the practice of the application.

Detailed description of the invention

The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, in which:

Fig. 1 is a kind of flow diagram of image formation control method provided by the embodiment of the present application；

Fig. 2 is a kind of partial structure diagram of imaging device provided by the embodiment of the present application；

Fig. 3 is the structural schematic diagram of the pixel unit array of imaging device provided by the embodiment of the present application；

Fig. 4 is the structural schematic diagram of the sensitive pixel elements of imaging device provided by the embodiment of the present application；

Fig. 5 is the flow diagram of another image formation control method provided by the embodiments of the present application；

Fig. 6 is the flow diagram of another image formation control method provided by the embodiments of the present application；

Fig. 7 is the flow diagram of another image formation control method provided by the embodiments of the present application；

Fig. 8 is the flow diagram of another image formation control method provided by the embodiments of the present application；

Fig. 9 is the flow diagram of another image formation control method provided by the embodiments of the present application；

Figure 10 is a kind of structural schematic diagram of imaging control apparatus provided by the embodiments of the present application；

Figure 11 is the module diagram of the electronic equipment of the application certain embodiments；

Figure 12 is the module diagram of the image processing circuit of the application certain embodiments.

Specific embodiment

Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, it is intended to for explaining the application, and should not be understood as the limitation to the application.

Below with reference to the accompanying drawings the image formation control method and device of the embodiment of the present application are described.

Fig. 1 is a kind of flow diagram of image formation control method provided by the embodiment of the present application.

As shown in Figure 1, the image formation control method the following steps are included:

Wherein, which is applied to imaging device, and referring to fig. 2, which includes pixel unit battle array Column 31 and the filter unit array 32 being arranged in pixel unit array 31.Pixel unit array 31 includes multiple photosensitive pixels Unit 311, each sensitive pixel elements 311 include multiple photosensitive pixels 3111.Filter unit array 32 includes and multiple senses The corresponding multiple filter units 322 of light pixel unit 311, each filter unit 322 cover corresponding sensitive pixel elements 311.Each of pixel unit array 31 sensitive pixel elements 311 at least one long exposing pixels, at least one including exposing Light pixel and at least a short exposure pixel.

Step 101, photographed scene belong to brightness be greater than threshold luminance light environment when, according to long exposing pixels with it is short It is narrower than threshold value than less than the first exposure to determine whether photographed scene belongs to exposure for exposure ratio of the exposing pixels under photographed scene Dynamic range.

In the embodiment of the present application, the ISO of imaging device preview image or time for exposure first under acquisition photographed scene, wherein ISO value is used to refer to the sensitivity of camera.If the ISO of the photographed scene obtained or time for exposure are less than corresponding first ginseng Number threshold value, it is determined that photographed scene belongs to light environment.Wherein, the first parameter threshold may be configured as, and the parameter value of ISO is 200, Time for exposure is 30ms.

Wherein, it obtains under photographed scene there are many ISO value methods of preview image, as a kind of possible way of realization, It can control each photosensitive pixel in pixel unit array, measurement obtains the sensitivity value of preview image under photographed scene.

As alternatively possible way of realization, independent Photometer part can be used, preview graph under photographed scene is measured The sensitivity value of picture.

As alternatively possible way of realization, the ISO value of the camera automatic adjustment of imaging device can be read, is obtained The ISO value of preview image under photographed scene.

It should be noted that ISO value is used to refer to the sensitivity of camera, common ISO value has 50,100,200,400, 1000 etc., camera can according to ambient brightness, automatically adjust ISO value, thus, in the present embodiment, can according to ISO value, The anti-ambient brightness for releasing shooting environmental.

In the embodiment of the present application, the time for exposure can be preset in the plug-in of electronic equipment, alternatively, can also by with Family is configured, and then the time for exposure of preview image under photographed scene can be obtained by imaging device.

Specifically, the ISO of the photographed scene got when basis or time for exposure, determine that present filming scene belongs to light When brightness is greater than the light environment of threshold luminance, under the photographed scene, the exposure of long exposing pixels Yu short exposure pixel is calculated Than if obtained exposure, which is compared, compares threshold value less than the first exposure, it may be determined that the photographed scene belongs to narrow dynamic range.

Wherein, threshold luminance refers to the preset brightness value for judging photographed scene and whether belonging to light environment, can be with It is to be preset in the plug-in of imaging device, alternatively, being configured by user；First exposure refers to and presets than threshold value The exposure ratio according to long exposing pixels and short exposure pixel, judge the threshold value of the dynamic range of photographed scene.Work as photographed scene Exposure than threshold value less than first exposure than threshold value when, present filming scene is then narrow dynamic range；When the exposure of photographed scene When being greater than the first exposure than threshold value than threshold value, present filming scene is then middle high dynamic range.

Step 102, when determining that photographed scene belongs to exposure than exposing the narrow dynamic range than threshold value less than first, control Pixel unit array exports original pixels information.

According to the exposure ratio of exposing pixels long in step 101 and short exposure pixel, judge that the photographed scene belongs to narrow dynamic After range, control pixel unit array exports original pixels information.

Since pixel unit array includes multiple sensitive pixel elements 311, and each sensitive pixel elements 311 include extremely Few long exposing pixels, exposing pixels and an at least short exposure pixel at least one.Therefore, pixel unit array 31 exports original Pixel Information includes, the original pixels information of long exposing pixels, the original pixels information of middle exposing pixels and short exposure pixel Original pixels information.

As an example, as shown in figure 3, each of pixel unit array 31 in imaging device photosensitive pixel list Member 311 includes four photosensitive pixels 3111, and four photosensitive pixels 3111 are in 2*2 array arrangement.The four of each pixel unit 311 A photosensitive pixel 3111 is specially a long exposing pixels, two middle exposing pixels and a short exposure pixel.At this point, pixel list Element array 31 exports original pixels information, the original pixels information of a long exposing pixels, the original of two middle exposing pixels The original pixels information of beginning Pixel Information and a short exposure pixel.Certainly, in other embodiments, each pixel unit The quantity of long exposing pixels, middle exposing pixels in 311 and short exposure pixel can also be other numerical value.

As an example, by taking photosensitive pixel 3111 red in pixel unit array 31 shown in Fig. 3 as an example, R (1,1) For long exposing pixels, R (1,2) and R (2,1) are middle exposing pixels, and R (2,2) is short exposure pixel, each photosensitive pixel 3111 Exposure process may is that control long exposing pixels R (1,1) first starts to expose at first, in the exposure of long exposing pixels R (1,1) During, then exposing pixels R (1,2), middle exposing pixels R (2,1) and short exposure pixel R (2,2) exposure in controlling, wherein The exposure initial time of middle exposing pixels R (1,2) and middle exposing pixels R (2,1) are consistent, and middle exposing pixels R (1,2) and R (2, 1) and the exposure deadline of short exposure pixel R (2,2) should it is identical as the exposure deadline of long exposing pixels R (1,1) or Before the exposure deadline of long exposing pixels R (1,1)；Alternatively, controlling long exposing pixels R (1,1), middle exposing pixels R (1,2), middle exposing pixels R (2,1) and short exposure pixel R (2,2) start simultaneously at exposure, i.e., long exposing pixels R (1,1), in The exposure initial time of exposing pixels R (1,2), middle exposing pixels R (2,1) and short exposure pixel R (2,2) are identical.

After end exposure, each sensitive pixel elements 311 will export four original pixels information, with red shown in Fig. 3 Sensitive pixel elements 311 for, four original pixels information include the output of long exposing pixels R (1,1) original pixels information, The original pixels information of middle exposing pixels R (1,2) output, the original pixels information of middle exposing pixels R (2,1) output and short The original pixels information of exposing pixels R (2,2) output.

Step 103, according to the original pixels information of exposing pixels long in same sensitive pixel elements, the original of middle exposing pixels The merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of beginning Pixel Information and short exposure pixel.

After end exposure, each sensitive pixel elements 311 will export four original pixels information, with red shown in Fig. 3 Sensitive pixel elements 311 for, four original pixels information include the output of long exposing pixels R (1,1) original pixels information, The original pixels information of middle exposing pixels R (1,2) output, the original pixels information of middle exposing pixels R (2,1) output and short The original pixels information of exposing pixels R (2,2) output.The processor of imaging device controls the sense in each sensitive pixel elements The synchronous exposure for carrying out the long, medium and short time of the equal manner described above of light pixel 3111, and obtain each sensitive pixel elements output Multiple original pixels information.Then, processor is according to time for exposure identical original pixels in same sensitive pixel elements 311 Multiple merging Pixel Informations are calculated in information.

Specifically, by taking the sensitive pixel elements 311 of red shown in Fig. 3 as an example, in a scenario, when photosensitive pixel list When the number of photosensitive pixel 3111 is 2 × 2 in member 311, the original pixels information of long exposing pixels R (1,1) is long exposure Merge Pixel Information, the original pixels information of the original pixels information of middle exposing pixels R (1,2) and middle exposing pixels R (2,1) it With the merging Pixel Information for being middle exposure, the original pixels information of short exposure pixel R (2,2) is the merging pixel of short exposure Information.

Under another scene, when the number of photosensitive pixel 3111 in sensitive pixel elements 311 is 2 × 4, and long exposure picture The number of element is 2, and middle exposing pixels are 4, when short exposure pixel is 2, the original pixels information of 2 long exposing pixels it With the merging Pixel Information for being long exposure, the sum of original pixels information of 4 middle exposing pixels is the middle merging picture exposed Prime information, the sum of original pixels information of 2 short exposure pixels are the merging Pixel Information of short exposure.

As an example, referring to fig. 4, institute is schemed on the right of original pixels information arrangement such as Fig. 4 in sensitive pixel elements 311 Show, the size of single photosensitive pixel at this time is 1.0 μm, and each photosensitive pixel is arranged in the form of RRRR/GGGG/BBBB；Right figure In sensitive pixel elements 311 after the combination of four photosensitive pixels be the sensitive pixel elements 311 after combination shown in the figure of the left side Fig. 4 By the sequential arrangement of GRBG, the sensitive pixel elements 311 after combination become 2.0 μm of big pixel, which has used pixel Four-in-one technology, after pixel becomes larger, light-inletting quantity is higher, and taking the photo come can be brighter.

Step 104, it is imaged according to the corresponding reduction Pixel Information of merging Pixel Information.

Specifically, when photographed scene is light environment, light is very sufficient, and high pixel bring parsing power effect is brighter It is aobvious.Therefore, merge Pixel Information for each, determine corresponding at least two reduction Pixel Information；Wherein, a merging picture Prime information corresponds to a kind of color, same at least two corresponding at least two colors of reduction Pixel Information for merging Pixel Information and determining It is color.For example, the merging Pixel Information of a sensitive pixel elements 311 in Fig. 4 left figure is reduced to going back for corresponding three colors Each 2.0 μm in left figure of big pixel can be such as reduced to 1.0 μm of pixels of four GRBG arrangement by preimage prime information.Final root Image output is carried out according to each reduction Pixel Information determined, at this point, the image of output is more clear.

The image formation control method of the embodiment of the present application, by belonging to the light ring that brightness is greater than threshold luminance in photographed scene When border, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine whether the scene belongs to exposure ratio Narrow dynamic range less than the first exposure than threshold value, however, it is determined that belong to narrow dynamic range, control pixel unit array 31 exports original Beginning Pixel Information, according to the original image of long exposing pixels, middle exposing pixels and short exposure pixel in same sensitive pixel elements 311 The merging Pixel Information of each sensitive pixel elements is calculated in prime information, according to the corresponding reduction Pixel Information of merging Pixel Information It is imaged.As a result, when photographed scene belongs to the narrow dynamic range under light environment, according to the merging of each sensitive pixel elements Pixel Information reduction imaging, improves imaging effect and image quality, improves the shooting experience of user.

As a kind of possible implementation, referring to Fig. 5, the ISO or time for exposure for obtaining photographed scene are greater than corresponding Second parameter threshold controls each sensitive pixel elements in pixel unit array and exports original pixels information, and then closed And Pixel Information, finally it is imaged according to the corresponding reduction Pixel Information of merging Pixel Information.Specifically image formation control method The step of referring to Fig. 5, Fig. 5 is the flow diagram of another image formation control method provided by the embodiments of the present application.

Step 201, ISO or the time for exposure of photographed scene are obtained.

Step in the embodiment of the present application, in the ISO of photographed scene or the acquisition modes of time for exposure such as above-described embodiment Described in 101, details are not described herein again.

Step 202, if the ISO of photographed scene or time for exposure are greater than corresponding second parameter threshold, at least two are executed Secondary control pixel unit array exports original pixels information.

Specifically, if the ISO of the photographed scene got or time for exposure are greater than corresponding second parameter threshold, and It is short when the time for exposure of photographed scene at this time is relative to the first parameter threshold less than corresponding first parameter threshold, light line Part is with regard to poor, and imaging device, which is once shot, may not be able to obtain the high image of clarity, and therefore, imaging device will be at least twice It controls pixel unit array and exports original pixels information.Wherein, the parameter value of the corresponding ISO of the second parameter threshold is 100, exposure Time is 20ms.

Step 203, according to the original pixels information of exposing pixels long in same sensitive pixel elements, the original of middle exposing pixels The merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of beginning Pixel Information and short exposure pixel.

In the embodiment of the present application, in the calculation method such as above-described embodiment of the merging Pixel Information of each sensitive pixel elements Described in step 103, details are not described herein again.

Step 204, it is imaged according to the corresponding reduction Pixel Information of merging Pixel Information.

Since in step 201, imaging device executes control pixel unit array at least twice and exports original pixels information, because This, be calculated the conjunction of each sensitive pixel elements according to the original pixels information of photosensitive unit each in photosensitive array at least twice And Pixel Information.

Specifically, the reduction Pixel Information according to corresponding to the merging Pixel Information that execution obtains each time, generates third Image, then synthesized to third image generated is executed every time, clarity, which is obtained, after ensuring image synthesis preferably schemes Picture will carry out noise reduction process when image synthesizes.Finally, image output is carried out according to the third image after synthesis noise reduction.

Image formation control method in the embodiment of the present application determines shooting by obtaining ISO or the time for exposure of photographed scene When the ISO of scene or time for exposure are greater than corresponding second parameter threshold, control pixel unit array output at least twice is executed Original pixels information, according to the original pixels information of exposing pixels long in same sensitive pixel elements, middle exposing pixels it is original The merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of Pixel Information and short exposure pixel, according to conjunction And the corresponding reduction Pixel Information of Pixel Information is imaged.It is executed as a result, by imaging device and controls pixel list at least twice Element array exports original pixels information, further according to merge during the corresponding reduction Pixel Information of Pixel Information is imaged into Row synthesis noise reduction process, improves the signal-to-noise ratio and imaging effect of image, so that image is more clear.

As alternatively possible implementation, when photographed scene belongs to brightness and is greater than the light environment of threshold luminance, According to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine photographed scene belong to exposure than being greater than or When exposing the middle high dynamic range than threshold value equal to first, and according to the merging pixel of sensitive pixel elements in pixel unit array Information is imaged.Specifically the step of image formation control method is referring to Fig. 6, Fig. 6 be it is provided by the embodiments of the present application another at As the flow diagram of control method.

As shown in fig. 6, the image formation control method may comprise steps of:

Step 301, photographed scene belong to brightness be greater than threshold luminance light environment when, according to long exposing pixels with it is short Exposure ratio of the exposing pixels under photographed scene determines that photographed scene belongs to exposure and compares threshold value than being greater than or equal to the first exposure Middle high dynamic range.

The shooting of the embodiment of the present application is carried out in the light environment that light luminance is greater than threshold luminance, in the shooting Under scene, the exposure ratio of long exposing pixels Yu short exposure pixel is calculated, if obtained exposure is compared more than or equal to the first exposure Compare threshold value, it is determined that the photographed scene belongs to middle high dynamic range.

Step 302, when exposure is than being greater than or equal to the second exposure than threshold value, control pixel unit array output is located respectively Multiple original pixels information under different exposure time.

Specifically, present filming scene is being determined in belonging to after high dynamic range, when exposure is exposed than being greater than or equal to second When light is than threshold value, current photographed scene is then high dynamic range, and imaging device controls long exposing pixels and starts to expose at first, During the exposure of long exposing pixels, then exposing pixels and short exposure pixel exposure in controlling, wherein middle exposing pixels and short The exposure deadline of exposing pixels should exposures identical or positioned at long exposing pixels with the exposure deadline of long exposing pixels Before deadline；Alternatively, controlling long exposing pixels, middle exposing pixels and short exposure pixel starts simultaneously at exposure, i.e., it is long to expose The exposure initial time of light pixel, middle exposing pixels and short exposure pixel is identical.In this way, without control pixel unit array according to Secondary to carry out long exposure, middle exposure and short exposure, i.e., controllable pixel unit array exports the multiple originals being respectively under different exposure time Beginning Pixel Information.Wherein, the second exposure is greater than the first exposure than threshold value and compares threshold value.

Wherein, long exposing pixels refer to that the photosensitive pixel corresponding time for exposure is the long time for exposure, and middle exposing pixels refer to Be the photosensitive pixel corresponding time for exposure be the middle time for exposure, short exposure pixel refers to the photosensitive pixel corresponding time for exposure For short exposure time, wherein the long time for exposure of long exposing pixels is greater than the middle time for exposure of middle exposing pixels, and middle exposure picture The middle time for exposure of element is greater than the short exposure time of short exposure pixel.

Step 303, in same sensitive pixel elements, original pixels information, the short exposure pixel of long exposing pixels are chosen Original pixels information or middle exposing pixels original pixels information.

Due in same sensitive pixel elements, including at least one long exposing pixels, exposing pixels and at least one at least one Short exposure pixel, therefore, from the original pixels information, the original pixels information of short exposure pixel or middle exposure picture of long exposing pixels In the original pixels information of element, chooses one and be used as original pixels information.

As an example, in a sensitive pixel elements, including a long exposing pixels, two middle exposing pixels and One short exposure pixel, and the original pixels information of long exposing pixels is 80, the original pixels information of short exposure pixel is 255, The original pixels information of two middle exposing pixels is also 255, since the upper limit of original pixels information is 255, is then exposed in explanation The original pixels information overexposure of the original pixels information and short exposure pixel of pixel, therefore, selection can be length The original pixels information of exposing pixels: 80.

Step 304, according to the original pixels information of selection and long time for exposure, middle time for exposure and short exposure time Between exposure ratio, merging Pixel Information is calculated.

Specifically, in same sensitive pixel elements, according to the original pixels information of the long exposing pixels of selection, short exposure The original pixels information of pixel or the original pixels information of middle exposing pixels and long time for exposure, middle time for exposure and short exposure Merging Pixel Information can be obtained by calculating in exposure ratio between light time.It specifically, for example, can be to three kinds of different exposures Original pixels information between light time assigns different weights respectively, then the original pixels information of selection is multiplied with corresponding weight Afterwards, the resulting pixel information an of pixel unit can be obtained.

Still with above-mentioned example, it is assumed that the exposure ratio between long time for exposure, middle time for exposure and short exposure time are as follows: 16:4:1 then merges Pixel Information are as follows: 80*16=1280.

Step 305, image output is carried out according to merging Pixel Information.

In the present embodiment, due to each synthesis being calculated according to the original pixels information of three kinds of different exposure times The grey level of Pixel Information can generate variation, therefore, need to believe each resulting pixel after obtaining resulting pixel information Breath does the compression of grey level.After compression, imaging device according to multiple compressions after obtained resulting pixel information into Row interpolation calculates, i.e., exportable higher dynamic image, at this point, overexposure region or the area Qian Bao is not present in the image of output Domain has preferable imaging effect.

The image formation control method of the embodiment of the present application, by belonging to the light ring that brightness is greater than threshold luminance in photographed scene When border, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine that photographed scene belongs to exposure ratio Middle high dynamic range more than or equal to the first exposure than threshold value, when exposure is than being greater than or equal to the second exposure than threshold value, control Pixel unit array processed exports the multiple original pixels information being respectively under different exposure time, in same sensitive pixel elements In, choose the original image of the original pixels information of long exposing pixels, the original pixels information of short exposure pixel or middle exposing pixels An original pixels information in prime information, according to the original pixels information of selection and long time for exposure, the middle time for exposure and Exposure ratio between short exposure time, is calculated merging Pixel Information, carries out image output according to Pixel Information is merged.By This, exports original pixels information by controlling pixel unit array, and merge Pixel Information output figure under different exposure time Picture, available higher dynamic image promote imaging effect and picture quality, improve the shooting experience of user.

As alternatively possible implementation, expose determining that photographed scene belongs to than being greater than or equal to described second After exposure is than the high dynamic range of threshold value, the ISO of the photographed scene got or time for exposure are less than or equal to corresponding parameter When threshold value, referring to Fig. 7, it is as shown in Figure 7 that control process is specifically imaged.

As shown in fig. 7, the image formation control method may comprise steps of:

Step 401, ISO or the time for exposure of photographed scene are obtained.

Step in the embodiment of the present application, in the ISO of photographed scene or the acquisition modes of time for exposure such as above-described embodiment Described in 101, this will not be repeated here.

Step 402, if the ISO of photographed scene or time for exposure are less than or equal to corresponding parameter threshold, single is executed Control pixel unit array exports the multiple original pixels information being respectively under different exposure time.

It should be noted that shooting field when photographed scene belongs to exposure than being greater than or equal to the second exposure than threshold value Scape belongs to high dynamic range, when the ISO or time for exposure in photographed scene are less than or equal to corresponding parameter threshold, photographed scene Belong to the light environment in high dynamic range, imaging device, which carries out single shot, can be obtained the preferable image of imaging effect.

Therefore, in the present embodiment, imaging device single executes control pixel unit array output and is respectively at different exposures Multiple original pixels information under time.Specifically the output of control pixel unit array is respectively at more under different exposure time The process of a original pixels information, as described in the step 302 of above-described embodiment, this will not be repeated here.

Step 403, in same sensitive pixel elements, original pixels information, the short exposure pixel of long exposing pixels are chosen Original pixels information or middle exposing pixels original pixels information.

Step 404, according to the original pixels information of selection and long time for exposure, middle time for exposure and short exposure time Between exposure ratio, merging Pixel Information is calculated.

The step 403 of the embodiment of the present application and the execution step of step 404 may refer in above-described embodiment step 303 and The implementation procedure of step 304, this will not be repeated here.

Step 405, image output is carried out according to merging Pixel Information.

Specifically, interpolation calculation is carried out to the merging Pixel Information that single executes, the first image of single frames can be generated, And then image output is carried out to the first image of single frames.With specific reference to the method for merging Pixel Information generation the first image of single frames, ginseng See the step 305 in above-described embodiment, this will not be repeated here.

As alternatively possible implementation, expose determining that photographed scene belongs to than being greater than or equal to described second After exposure is than the high dynamic range of threshold value, when the ISO of the photographed scene got or time for exposure are greater than corresponding parameter threshold, The brightness ratio of photographed scene at this time is darker, and single shot cannot obtain preferable imaging effect, therefore, imaging device execute to Few two secondary control sensitive pixel elements arrays export the multiple original pixels information being respectively under different exposure time.Specifically Exposure mode is as described in the step 302 in above-described embodiment, and this will not be repeated here.

Further, in same sensitive pixel elements, original pixels information, the short exposure pixel of long exposing pixels are chosen Original pixels information or middle exposing pixels original pixels information in one be used as original pixels information, according to the original of selection Exposure ratio between beginning Pixel Information and long time for exposure, middle time for exposure and short exposure time, is calculated merging pixel Information.Specifically, for example, different weights can be assigned respectively to the original pixels information of three kinds of different exposure times, then will After the original pixels information of selection is multiplied with corresponding weight, the resulting pixel information an of sensitive pixel elements can be obtained. Specifically calculating process can refer to the step 303 and step 304 of above-described embodiment, and this will not be repeated here.

When the dark of photographed scene, imaging device executes each time to be obtained merging Pixel Information, is generated corresponding First image, then the first image for executing generation at least twice is synthesized, by the processor of imaging device to synthesis First image carries out noise reduction process, and then obtains the image of low noise point, then carries out to the first image obtained after noise reduction after synthesis Image output.At this point, the image in the output of middle high dynamic range can have lower noise.

In the above-described embodiments, when photographed scene belongs to exposure than being greater than or equal to middle high dynamic of first exposure than threshold value When range, the multiple original pixels letter being respectively under different exposure time is exported in imaging device control pixel unit array Breath, and then the exposure ratio according to the original pixels information of selection and between the time for exposure, obtain merging Pixel Information carry out at Picture.As alternatively possible implementation, imaging device can control pixel unit array output and use the identical time for exposure Expose obtained multiple original pixels information, and then average value calculated according to original pixels information, obtain merging Pixel Information into Row imaging output.Specific process is illustrated referring to the process that Fig. 8, Fig. 8 are another imaging control provided by the embodiments of the present application Figure.

As shown in figure 8, the image formation control method may comprise steps of:

Step 501, photographed scene belong to brightness be greater than threshold luminance light environment when, according to long exposing pixels with it is short Exposure ratio of the exposing pixels under photographed scene determines that photographed scene belongs to exposure and compares threshold value than being greater than or equal to the first exposure Middle high dynamic range.

In the embodiment of the present application, determine that photographed scene belongs to the method for middle high dynamic range referring to the step in above-described embodiment Described in rapid 301, this will not be repeated here.

Step 502, multiple original pixels letter that the output of control pixel unit array is exposed using the identical time for exposure Breath.

Specifically, long exposing pixels, short exposure pixel and the middle exposing pixels of imaging device control pixel unit array are adopted It is exposed with the identical time for exposure, after end exposure, sensitive pixel elements will obtain the original pixels information, short of long exposing pixels The original pixels information of exposing pixels and the original pixels information of middle exposing pixels.

It should be noted that control pixel unit array exposes using the identical time for exposure or uses different exposure time Exposure, is determined according to the ambient brightness of specific photographed scene, herein only as an example, not to the selection of time for exposure It limits.

Step 503, average value is calculated to the original pixels information of same sensitive pixel elements, obtains merging Pixel Information, The corresponding merging Pixel Information of each sensitive pixel elements.

Specifically, in same sensitive pixel elements, original pixels information, the short exposure of the long exposing pixels of acquisition are calculated The average value of the original pixels information of the original pixels information and middle exposing pixels of pixel, and then obtain merging Pixel Information.And And the corresponding merging Pixel Information of each sensitive pixel elements.

As an example, by taking the sensitive pixel elements of red shown in Fig. 3 as an example, R (1,1) is long exposing pixels, R (1,2) and R (2,1) are middle exposing pixels, and R (2,2) is short exposure pixel.The processor of imaging device controls long exposure picture first The synchronous exposure of plain R (1,1), middle exposing pixels R (1,2), middle exposing pixels R (2,1) and short exposure pixel R (2,2).End exposure Afterwards, red pixel unit will export four original pixels information, i.e., the original pixels information of long exposing pixels R (1,1) output, The original pixels information of middle exposing pixels R (1,2) output, the original pixels information of middle exposing pixels R (2,1) output and short The original pixels information of exposing pixels R (2,2) output.In this way, processor controls the light-sensitive image in each sensitive pixel elements Plain manner described above synchronizes exposure, and obtains multiple original pixels information of each sensitive pixel elements output.

Further, the processor of imaging device is combined meter to the original pixels information in same sensitive pixel elements It calculates to obtain multiple packed-pixel information, is calculated using the following equation the packed-pixel information of each sensitive pixel elements:In this way, the processor of imaging device can calculate entire pixel unit array In multiple sensitive pixel elements multiple packed-pixel information.

Step 504, image output is carried out according to the corresponding merging Pixel Information of each sensitive pixel elements.

In the embodiment of the present application, the processor of imaging device can calculate each photosensitive according to the method for above-mentioned steps 504 The corresponding merging Pixel Information of pixel unit, and then interpolation meter is carried out according to the corresponding merging Pixel Information of each sensitive pixel elements It calculates, image can be obtained, and then export image.

The image formation control method of the embodiment of the present application, by belonging to the light ring that brightness is greater than threshold luminance in photographed scene When border, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine that photographed scene belongs to exposure ratio Middle high dynamic range more than or equal to the first exposure than threshold value, control pixel unit array output are exposed using the identical time for exposure Multiple original pixels information that light obtains calculate average value to the original pixels information of same sensitive pixel elements, are merged Pixel Information, the corresponding merging Pixel Information of each sensitive pixel elements, finally according to the corresponding conjunction of each sensitive pixel elements And Pixel Information carries out image output.As a result, in the middle high dynamic range of dark, pass through the original of each sensitive pixel elements High dynamic range images improve while guaranteeing dynamic range in the corresponding merging Pixel Information acquisition of beginning Pixel Information Imaging effect and image quality improve the shooting experience of user.

As alternatively possible implementation, needs imaging device that control pixel unit array output is performed a plurality of times and use Multiple original pixels information that the identical time for exposure exposes, to the original pixels information meter of same sensitive pixel elements Average value is calculated, obtains merging Pixel Information, carries out image output further according to the corresponding merging Pixel Information of each sensitive pixel elements. Referring to Fig. 9, Fig. 9 is the flow diagram of another imaging control provided by the embodiments of the present application.

As shown in figure 9, the image formation control method may comprise steps of:

Step 601, photographed scene belong to brightness be greater than threshold luminance light environment when, according to long exposing pixels with it is short Exposure ratio of the exposing pixels under photographed scene determines that photographed scene belongs to exposure and compares threshold value than being greater than or equal to the first exposure Middle high dynamic range.

Step 602, imaging device is performed a plurality of times control pixel unit array output and exposes to obtain using the identical time for exposure Multiple original pixels information.

In the present embodiment, when photographed scene belongs to middle high dynamic range, the image that imaging device single shot obtains can Can there are the overexposure of large area, or the situation that part is excessively dark, therefore, it is necessary to control pixel unit array output is performed a plurality of times The multiple original pixels information exposed using the identical time for exposure, and then multiple images are obtained after merging Pixel Information.

Specifically, imaging device repeatedly controls long exposing pixels, short exposure pixel and the middle exposure picture of pixel unit array Element is exposed using the identical time for exposure, and after end exposure, sensitive pixel elements believe the original pixels for obtaining long exposing pixels The original pixels information of breath, the original pixels information of short exposure pixel and middle exposing pixels.Wherein, the every secondary control picture of imaging device The time for exposure that plain cell array obtains original pixels information is at least two kinds.

As a kind of possible implementation, imaging device repeatedly controls pixel unit array and obtains original pixels information The time for exposure used in the process is different.

As alternatively possible implementation, imaging device repeatedly controls pixel unit array and obtains original pixels information During time for exposure, identical time for exposure several times and primary too long time for exposure can be used.

Step 603, average value is calculated to the original pixels information of same sensitive pixel elements, obtains merging Pixel Information.

In the present embodiment, in same sensitive pixel elements, average value is calculated according to original pixels information, obtains merging picture The method of prime information is as described in the step 503 of above-described embodiment, and this will not be repeated here.

Step 604, image output is carried out according to the corresponding merging Pixel Information of each sensitive pixel elements.

Specifically, according to the corresponding merging Pixel Information of each sensitive pixel elements executed each time, and then pairing And Pixel Information carries out interpolation calculation, that is, corresponding second image is produced, in the light of the photographed scene of middle high dynamic range When darker, the image of shooting can have noise, therefore carry out synthesis noise reduction process to the second image generated is performed a plurality of times, And then image output is carried out to the second image after synthesis noise reduction process.

As a kind of possible implementation, imaging device repeatedly controls pixel unit array and obtains original pixels information When the time for exposure used in the process is different, in turn, the corresponding merging picture of each sensitive pixel elements being performed a plurality of times Prime information generates the different image of corresponding a few exposed frame degree.

As alternatively possible implementation, imaging device repeatedly controls pixel unit array and obtains original pixels information During using identical time for exposure several times and primary too long time for exposure, in turn, each sense being performed a plurality of times The corresponding merging Pixel Information of light pixel unit generates the image and a frame overexposure figure of the identical exposure of corresponding a few frames Picture.

The control method of the imaging device of the embodiment of the present application is used by the way that control pixel unit array output is performed a plurality of times Multiple original pixels information that the identical time for exposure exposes calculate the original pixels information of same sensitive pixel elements flat Mean value obtains merging Pixel Information, carries out image output according to the corresponding merging Pixel Information of each sensitive pixel elements.This method When imaging device is performed a plurality of times control pixel unit array and exports multiple original pixels information, obtained using the different time for exposure Synthesis noise reduction process is carried out to the image of multiframe difference exposure, then to image, can preferably control and make an uproar under low light environment Point improves imaging effect and clarity, further improves user experience.

In order to realize above-described embodiment, the application also proposes a kind of imaging control apparatus.

Figure 10 is a kind of structural schematic diagram of imaging control apparatus provided by the embodiments of the present application.

As shown in Figure 10, the imaging control apparatus comprise determining that module 110, control module 120, processing module 130 and Image-forming module 140.

Determining module 110, for being exposed according to long when photographed scene belongs to brightness and is greater than the light environment of threshold luminance Pixel and exposure ratio of the short exposure pixel under photographed scene, determine whether photographed scene belongs to exposure than less than the first exposure ratio The narrow dynamic range of threshold value.

Control module 120, for if it is determined that belonging to narrow dynamic range, control pixel unit array output original pixels to be believed Breath.

Processing module 130, for the original pixels information according to exposing pixels long in same sensitive pixel elements, middle exposure The merging pixel of each sensitive pixel elements is calculated in the original pixels information of pixel and the original pixels information of short exposure pixel Information.

Image-forming module 140, for being imaged according to the corresponding reduction Pixel Information of merging Pixel Information.

As alternatively possible implementation, the imaging control apparatus, further includes:

First image-forming module, for determining that photographed scene belongs to exposure than being greater than or equal to the first exposure than in threshold value When high dynamic range, it is imaged according to the merging Pixel Information of sensitive pixel elements in pixel unit array.

As alternatively possible implementation, the first image-forming module, further includes:

First control unit, for controlling pixel unit array when exposure is than being greater than or equal to the second exposure than threshold value Export the multiple original pixels information being respectively under different exposure time；Wherein, the long time for exposure of long exposing pixels is greater than The middle time for exposure of the middle exposing pixels, and the middle time for exposure of middle exposing pixels be greater than short exposure pixel short exposure when Between；Second exposure is greater than the first exposure than threshold value and compares threshold value.

First constituency unit chooses the original pixels information, short of long exposing pixels in same sensitive pixel elements The original pixels information of exposing pixels or the original pixels information of middle exposing pixels.

First processing units, for according to the original pixels information of selection and long time for exposure, middle time for exposure and short Exposure ratio between time for exposure, is calculated merging Pixel Information.

First output unit, for carrying out image output according to merging Pixel Information.

Second control unit, it is single for being less than or equal to corresponding parameter threshold in the ISO of photographed scene or time for exposure Secondary execute controls multiple original pixels information that the pixel unit array output is respectively under different exposure time.

Second selection unit chooses the original pixels information, short of long exposing pixels in same sensitive pixel elements The original pixels information of exposing pixels or the original pixels information of middle exposing pixels.

The second processing unit, for according to the original pixels information of selection and long time for exposure, middle time for exposure and short Exposure ratio between time for exposure, is calculated merging Pixel Information.

Second output unit, for carrying out image output according to merging Pixel Information, comprising: executed according to single Merge Pixel Information, generates the first image of single frames；Image output is carried out to the first image of single frames.

Third control unit executes at least for being greater than corresponding parameter threshold as the ISO of photographed scene or time for exposure Two secondary control pixel unit arrays export the multiple original pixels information being respectively under different exposure time.

Third selection unit chooses the original pixels information, short of long exposing pixels in same sensitive pixel elements The original pixels information of exposing pixels or the original pixels information of middle exposing pixels.

Third processing unit, for according to the original pixels information of selection and long time for exposure, middle time for exposure and short Exposure ratio between time for exposure, is calculated merging Pixel Information.

Third output unit, for carrying out image output according to merging Pixel Information, comprising: obtained according to executing each time Merging Pixel Information, generate corresponding first image；Synthesis noise reduction is carried out according to the first image for executing generation at least twice Processing；Image output is carried out to the first image after synthesis noise reduction.

4th control module is exposed for controlling pixel unit array output using the identical time for exposure more A original pixels information.

Fourth processing unit calculates average value for the original pixels information to same sensitive pixel elements, is merged Pixel Information, the corresponding merging Pixel Information of each sensitive pixel elements；

4th output unit, for carrying out image output according to the corresponding merging Pixel Information of each sensitive pixel elements.

5th control unit exposes to obtain for control pixel unit array output to be performed a plurality of times using the identical time for exposure Multiple original pixels information；Wherein, the time for exposure used during being performed a plurality of times is at least two.

5th processing unit calculates average value for the original pixels information to same sensitive pixel elements, obtains Merge Pixel Information.

5th output unit, for carrying out image output, packet according to the corresponding merging Pixel Information of each sensitive pixel elements It includes: according to the corresponding merging Pixel Information of each sensitive pixel elements executed each time, generating corresponding second image；It is right The second image generated is performed a plurality of times and carries out synthesis noise reduction process；It is defeated that image is carried out to the second image after synthesis noise reduction process Out.

Second determining module determines corresponding at least two reduction Pixel Information for merging Pixel Information to each； Wherein, a merging Pixel Information corresponds to a kind of color, and same Pixel Information is determined at least two also original pixel that merge are believed Cease corresponding at least two colors.

Output module, for carrying out image output according to each reduction Pixel Information determined.

Module is obtained, for obtaining ISO or the time for exposure of photographed scene.

Second determining module is determined for being less than corresponding first parameter threshold as the ISO of photographed scene or time for exposure Photographed scene belongs to light environment.

Second control module is executed for being greater than corresponding second parameter threshold as the ISO of photographed scene or time for exposure Control pixel unit array exports original pixels information at least twice.Wherein, the second parameter threshold is less than corresponding first parameter Threshold value.

First processing module, for the original pixels information according to exposing pixels long in same sensitive pixel elements, middle exposure The merging picture of each sensitive pixel elements is calculated in the original pixels information of light pixel and the original pixels information of short exposure pixel Prime information.

First image-forming module, for being imaged according to the corresponding reduction Pixel Information of merging Pixel Information, comprising: according to Reduction Pixel Information corresponding to obtained merging Pixel Information is executed each time, generates third image；To executing at least twice Third image generated carries out synthesis noise reduction；Image output is carried out according to the third image after synthesis noise reduction.

The imaging control apparatus of the embodiment of the present application belongs to the light environment that brightness is greater than threshold luminance in photographed scene When, according to long exposing pixels and exposure ratio of the short exposure pixel under photographed scene, determine whether the scene belongs to exposure than small In narrow dynamic range of first exposure than threshold value, however, it is determined that belong to narrow dynamic range, control pixel unit array exports original image Prime information, according to the original pixels information of exposing pixels long in same sensitive pixel elements, middle exposing pixels and short exposure pixel The merging Pixel Information of each sensitive pixel elements is calculated, according to merge the progress of Pixel Information corresponding reduction Pixel Information at Picture.As a result, when photographed scene belongs to the narrow dynamic range under light environment, believed according to the merging pixel of each sensitive pixel elements Breath reduction imaging, improves imaging effect and image quality, improves the shooting experience of user.

It should be noted that the aforementioned imaging for being also applied for the embodiment to the explanation of image formation control method embodiment Control device, details are not described herein again.

In order to realize above-described embodiment, the application also proposes a kind of electronic equipment, comprising: memory, processor and storage On a memory and the computer program that can run on a processor, it when the processor executes described program, realizes as above-mentioned Image formation control method described in embodiment.

In order to realize above-described embodiment, the application also proposes a kind of computer readable storage medium, is stored thereon with calculating Machine program, which is characterized in that the image formation control method as described in above-described embodiment is realized when the program is executed by processor.

Figure 11 is please referred to, the application also provides a kind of electronic equipment 200.Electronic equipment 200 includes memory 50 and processing Device 60.Computer-readable instruction is stored in memory 50.When computer-readable instruction is stored by 50 execution, so that processor 60 execute the image formation control method of any of the above-described embodiment.

Figure 11 is the schematic diagram of internal structure of electronic equipment 200 in one embodiment.The electronic equipment 200 includes passing through to be Processor 60, the memory 50 (for example, non-volatile memory medium), built-in storage 82,83 and of display screen of bus 81 of uniting connection Input unit 84.Wherein, the memory 50 of electronic equipment 200 is stored with operating system and computer-readable instruction.The computer Readable instruction can be executed by processor 60, to realize the image formation control method of the application embodiment.The processor 60 is for mentioning For calculating and control ability, the operation of entire electronic equipment 200 is supported.The built-in storage 50 of electronic equipment 200 is memory 52 In computer-readable instruction operation provide environment.The display screen 83 of electronic equipment 200 can be liquid crystal display or electricity Sub- ink display screen etc., input unit 84 can be the touch layer covered on display screen 83, be also possible to 200 shell of electronic equipment Key, trace ball or the Trackpad of upper setting, are also possible to external keyboard, Trackpad or mouse etc..The electronic equipment 200 can Be mobile phone, tablet computer, laptop, personal digital assistant or wearable device (such as Intelligent bracelet, smartwatch, Intelligent helmet, intelligent glasses) etc..It will be understood by those skilled in the art that structure shown in Figure 11, only with the application side The schematic diagram of the relevant part-structure of case does not constitute the restriction for the electronic equipment 200 being applied thereon to application scheme, Specific electronic equipment 200 may include perhaps combining certain components than more or fewer components as shown in the figure or having Different component layouts.

Figure 12 is please referred to, includes image processing circuit 90, image processing circuit in the electronic equipment 200 of the embodiment of the present application 90 can be realized using hardware and or software component, including define ISP (Image Signal Processing, at picture signal Reason) pipeline various processing units.Figure 12 is the schematic diagram of image processing circuit 90 in one embodiment.As shown in figure 12, it is Convenient for explanation, the various aspects of image processing techniques relevant to the embodiment of the present application are only shown.

As shown in figure 12, image processing circuit 90 includes ISP processor 91 (ISP processor 91 can be processor 60) and controls Logic device 92 processed.The image data that camera 93 captures is handled by ISP processor 91 first, and ISP processor 91 is to image data It is analyzed to capture the image statistics for the one or more control parameters that can be used for determining camera 93.Camera 93 can Including one or more lens 932 and imaging sensor 934.Imaging sensor 934 may include colour filter array (such as Bayer Filter), imaging sensor 934 can obtain the luminous intensity and wavelength information that each imaging pixel captures, and provide and can be handled by ISP One group of raw image data of the processing of device 91.Sensor 94 (such as gyroscope) can be based on 94 interface type of sensor the figure of acquisition As the parameter (such as stabilization parameter) of processing is supplied to ISP processor 91.94 interface of sensor can be SMIA (Standard Mobile Imaging Architecture, Standard Mobile Imager framework) interface, other serial or parallel camera interfaces or The combination of above-mentioned interface.

In addition, raw image data can also be sent to sensor 94 by imaging sensor 934, sensor 94 can be based on sensing Raw image data is supplied to ISP processor 91 or sensor 94 and arrives raw image data storage by 94 interface type of device In video memory 95.

ISP processor 91 handles raw image data pixel by pixel in various formats.For example, each image pixel can have There is the bit depth of 8,10,12 or 14 bits, ISP processor 91 can carry out one or more image procossing behaviour to raw image data Make, statistical information of the collection about image data.Wherein, image processing operations can by identical or different bit depth precision into Row.

ISP processor 91 can also receive image data from video memory 95.For example, 94 interface of sensor is by original image Data are sent to video memory 95, and the raw image data in video memory 95 is available to ISP processor 91 for place Reason.Video memory 95 can be independent special in memory 50, a part of memory 50, storage equipment or electronic equipment It with memory, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.

When receiving the original from 934 interface of imaging sensor or from 94 interface of sensor or from video memory 95 When beginning image data, ISP processor 91 can carry out one or more image processing operations, such as time-domain filtering.Treated image Data can be transmitted to video memory 95, to carry out other processing before shown.ISP processor 91 is stored from image Device 95 receives processing data, and carries out at the image data in original domain and in RGB and YCbCr color space to processing data Reason.Treated that image data may be output to display 97 (display 97 may include display screen 83) for ISP processor 91, for Family is watched and/or is further processed by graphics engine or GPU (Graphics Processing Unit, graphics processor).This Outside, the output of ISP processor 91 also can be transmitted to video memory 95, and display 97 can read image from video memory 95 Data.In one embodiment, video memory 95 can be configured to realize one or more frame buffers.In addition, ISP is handled The output of device 91 can be transmitted to encoder/decoder 96, so as to encoding/decoding image data.The image data of coding can be protected It deposits, and is decompressed before being shown in 97 equipment of display.Encoder/decoder 96 can be real by CPU or GPU or coprocessor It is existing.

The statistical data that ISP processor 91 determines, which can be transmitted, gives control logic device Unit 92.For example, statistical data may include The imaging sensors such as automatic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, 932 shadow correction of lens 934 statistical informations.Control logic device 92 may include the processing element and/or microcontroller for executing one or more routines (such as firmware) Device, one or more routines can statistical data based on the received, determine the control parameter of camera 93 and the control of ISP processor 91 Parameter processed.For example, the control parameter of camera 93 may include 94 control parameter of sensor (such as the integral of gain, spectrum assignment Time, stabilization parameter etc.), camera flash control parameter, 932 control parameter of lens (such as focus or zoom focal length) or The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing) 932 shadow correction parameter of gain level and color correction matrix and lens.

In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples It closes and combines.

In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three It is a etc., unless otherwise specifically defined.

Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be by the application Embodiment person of ordinary skill in the field understood.

Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media His suitable method is handled electronically to obtain described program, is then stored in computer storage.

It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile Journey gate array (FPGA) etc..

Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.

It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer In read/write memory medium.

Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application Type.

Claims

1. a kind of image formation control method, which is characterized in that be applied to imaging device, the imaging device includes by multiple light-sensitive images The pixel unit array of plain unit composition, each sensitive pixel elements are including exposing picture at least one long exposing pixels, at least one Element and an at least short exposure pixel, the described method comprises the following steps:

When photographed scene belongs to brightness and is greater than the light environment of threshold luminance, according to the long exposing pixels and short exposure pixel It is narrower than threshold value than less than the first exposure to determine whether the photographed scene belongs to exposure for exposure ratio under the photographed scene Dynamic range；

According to the original pixels information of exposing pixels long in same sensitive pixel elements, the original pixels information of middle exposing pixels and The merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of short exposure pixel；

2. image formation control method according to claim 1, which is characterized in that whether the determination photographed scene belongs to After exposure less than first than exposing than the narrow dynamic range of threshold value, further includes:

If it is determined that the photographed scene belongs to exposure than being greater than or equal to middle high dynamic range of first exposure than threshold value When, it is imaged according to the merging Pixel Information of sensitive pixel elements in the pixel unit array.

3. image formation control method according to claim 2, which is characterized in that described to feel according in the pixel unit array The merging Pixel Information of light pixel unit is imaged, comprising:

When the exposure is than being greater than or equal to the second exposure than threshold value, controls the pixel unit array output and be respectively at not With multiple original pixels information under the time for exposure；Wherein, the long time for exposure of the long exposing pixels is greater than the middle exposure The middle time for exposure of pixel, and the middle time for exposure of the middle exposing pixels is greater than the short exposure time of the short exposure pixel； Second exposure is greater than first exposure than threshold value and compares threshold value；

In same sensitive pixel elements, the original pixels information of long exposing pixels, the original pixels letter of short exposure pixel are chosen The original pixels information of breath or middle exposing pixels；

According to the original pixels information of selection and the long time for exposure, the middle time for exposure and the short exposure time Between exposure ratio, the merging Pixel Information is calculated；

Image output is carried out according to the merging Pixel Information.

4. image formation control method according to claim 3, which is characterized in that the method, further includes:

If the ISO of the photographed scene or time for exposure are less than or equal to corresponding parameter threshold, single executes the control institute It states pixel unit array and exports the multiple original pixels information being respectively under different exposure time, in same sensitive pixel elements In, choose the original image of the original pixels information of long exposing pixels, the original pixels information of short exposure pixel or middle exposing pixels Prime information, when according to the original pixels information of selection and the long time for exposure, the middle time for exposure and the short exposure Between between exposure ratio, the step of merging Pixel Information is calculated；

It is described that image output is carried out according to the merging Pixel Information, comprising:

The merging Pixel Information executed according to single generates the first image of single frames；

Image output is carried out to first image of single frames.

5. image formation control method according to claim 3, which is characterized in that the method, further includes:

If the ISO of the photographed scene or time for exposure are greater than corresponding parameter threshold, execute described in the control at least twice Pixel unit array exports the multiple original pixels information being respectively under different exposure time, in same sensitive pixel elements In, choose the original image of the original pixels information of long exposing pixels, the original pixels information of short exposure pixel or middle exposing pixels Prime information, when according to the original pixels information of selection and the long time for exposure, the middle time for exposure and the short exposure Between between exposure ratio, the step of merging Pixel Information is calculated；

According to the merging Pixel Information executed each time, corresponding first image is generated；

Synthesis noise reduction process is carried out according to first image for executing generation at least twice；

Image output is carried out to the first image after synthesis noise reduction.

6. image formation control method according to claim 2, which is characterized in that described to feel according in the pixel unit array The merging Pixel Information of light pixel unit is imaged, comprising:

Control multiple original pixels information that the pixel unit array output is exposed using the identical time for exposure；

Average value is calculated to the original pixels information of same sensitive pixel elements, obtains the merging Pixel Information, each Sensitive pixel elements correspond to a merging Pixel Information；

Image output is carried out according to the corresponding merging Pixel Information of each sensitive pixel elements.

7. image formation control method according to claim 6, which is characterized in that the method, further includes:

Multiple original images that the control pixel unit array output is exposed using the identical time for exposure are performed a plurality of times Prime information calculates average value to the original pixels information of same sensitive pixel elements, obtains the merging Pixel Information Step；Wherein, it is described be performed a plurality of times during time for exposure for using at least two；

It is described that image output is carried out according to the corresponding merging Pixel Information of each sensitive pixel elements, comprising:

According to the corresponding merging Pixel Information of each sensitive pixel elements executed each time, corresponding second image is generated；

Synthesis noise reduction process is carried out to the second image generated is performed a plurality of times；

Image output is carried out to the second image after synthesis noise reduction process.

8. image formation control method according to claim 1, which is characterized in that described corresponding according to the merging Pixel Information Reduction Pixel Information be imaged, comprising:

Pixel Information is merged to each, determines corresponding at least two reduction Pixel Information；Wherein, a merging Pixel Information A kind of corresponding color, same corresponding at least two colors of at least two reduction Pixel Information for merging Pixel Information and determining It is color；

Image output is carried out according to each reduction Pixel Information determined.

9. image formation control method according to claim 1-8, which is characterized in that the method also includes:

Obtain ISO or the time for exposure of the photographed scene；

If the ISO of the photographed scene or time for exposure are less than corresponding first parameter threshold, determine that the photographed scene belongs to The light environment.

10. image formation control method according to claim 9, which is characterized in that the ISO for obtaining the photographed scene or After time for exposure, further includes:

If the ISO of the photographed scene or time for exposure are greater than corresponding second parameter threshold, the control at least twice is executed The pixel unit array exports original pixels information, is believed according to the original pixels of exposing pixels long in same sensitive pixel elements Each sensitive pixel elements are calculated in the original pixels information of breath, the original pixels information of middle exposing pixels and short exposure pixel The step of merging Pixel Information；Wherein, second parameter threshold is less than corresponding first parameter threshold；

It is described to be imaged according to the corresponding reduction Pixel Information of the merging Pixel Information, comprising:

According to reduction Pixel Information corresponding to the merging Pixel Information executed each time, third image is generated；

To described third image generated is executed at least twice carry out synthesis noise reduction；

Image output is carried out according to the third image after synthesis noise reduction.

11. a kind of imaging control apparatus, which is characterized in that the imaging device includes the picture being made of multiple sensitive pixel elements Plain cell array, each sensitive pixel elements include exposing pixels and at least one short exposure at least one long exposing pixels, at least one Light pixel, described device include:

Determining module, for exposing picture according to the length when photographed scene belongs to brightness and is greater than the light environment of threshold luminance Element and exposure ratio of the short exposure pixel under the photographed scene, determine whether the photographed scene belongs to exposure ratio less than first Expose the narrow dynamic range than threshold value；

Processing module, for according to the original pixels information of exposing pixels long in same sensitive pixel elements, middle exposing pixels The merging Pixel Information of each sensitive pixel elements is calculated in the original pixels information of original pixels information and short exposure pixel；

12. a kind of electronic equipment characterized by comprising memory, processor and storage are on a memory and can be in processor The computer program of upper operation, when the processor executes described program, realize as described in any in claim 1-10 at As control method.

13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The image formation control method as described in any in claim 1-10 is realized when execution.