CN107205120A - The processing method and mobile terminal of a kind of image - Google Patents

The processing method and mobile terminal of a kind of image Download PDF

Info

Publication number
CN107205120A
CN107205120A CN201710528157.5A CN201710528157A CN107205120A CN 107205120 A CN107205120 A CN 107205120A CN 201710528157 A CN201710528157 A CN 201710528157A CN 107205120 A CN107205120 A CN 107205120A
Authority
CN
China
Prior art keywords
image
exposure
exposure image
normal
scene
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710528157.5A
Other languages
Chinese (zh)
Other versions
CN107205120B (en
Inventor
索国国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201710528157.5A priority Critical patent/CN107205120B/en
Publication of CN107205120A publication Critical patent/CN107205120A/en
Application granted granted Critical
Publication of CN107205120B publication Critical patent/CN107205120B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image
    • G06T3/40—Scaling the whole image or part thereof
    • G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

The embodiments of the invention provide a kind of processing method of image and mobile terminal, the mobile terminal includes camera, image-signal processor ISP and the digital signal processor DSP being connected respectively with the camera and the ISP, and methods described includes：Under shooting preview state, the time series data of camera is determined；Control the DSP continuously to circulate and obtain the multiframe preview image that the camera is gathered according to the time series data；If receiving photographing instruction, it is determined that present filming scene；Based on the present filming scene, input picture is filtered out from the multiframe preview image；Image synthesis is carried out to the input picture, composograph is generated；The composograph is exported to the ISP.Suitable input picture can be selected according to different photographed scenes using the embodiment of the present invention, so as to obtain truer image attractive in appearance under different scenes.

Description

The processing method and mobile terminal of a kind of image
Technical field
The present invention relates to the processing method and mobile terminal of communication technical field, more particularly to a kind of image.
Background technology
With the development of shooting technology, it is already possible to taken image under image apparent, attractive in appearance, especially half-light One of main aspect through ability of being taken pictures as mobile terminals such as one mobile phones of measurement.User how is allowed to photograph truer attractive in appearance Image, is that we improve constantly horizontal ultimate attainment pursuit of taking pictures.
Some scenes of taking pictures are currently limited to, particularly dark scene, in order to obtain better image, should show dark The details in portion region, needs wider dynamic range also to show the part of highlight regions in night scene again.So current Major programme one is the scheme using multiple normal frames (also referred to as normal exposure image) synthesis, and another is exactly normal The scheme of the synthesis of frame longer exposure frame (also referred to as long exposure image) plus short exposure frames (also referred to as short exposed images), the two Scheme detail is as follows：
Scheme 1：Camera is opened, if under shooting preview state, current camera collection is stored when preview Newest N two field pictures, when user press camera button using this several frame as image input picture.Then after being handled by ISP, Synthesized in YUV domains.Retain more details and noise during image procossing, can be reduced to a certain extent after the synthesis of YUV domains Noise, and strengthen details, the mode that it also avoid directly highlighting strengthens the excessive situation of details noise.But this YUV domains Lifting of the multiframe synthesis in the details of dark space is limited, and most of night scene has HDR, such as ornament lamp, bright doorplate Deng always occurring overexposure region in image.
Scheme 2：In order to improve the dynamic range of image, the details in normal brightness region is showed using a frame normal frames, Again plus frame length exposure frame obtains the details in half-light region, a frame short exposure frames obtain the details of highlight regions, similar to scheme 1, after ISP is handled, in the synthesis of YUV domains.The details for crossing dark space and highlight bar is shown simultaneously in this way, one Determine to improve dynamic range in degree.But this method for improving dynamic range is generally used for daytime, for night scene, improves The brightness of dark space can produce serious noise, and the influence of image quality is larger.Therefore, how under night scene or other dark scenes The truer image attractive in appearance that obtains be urgent problem to be solved.
The content of the invention
The embodiment of the present invention provides the method and mobile terminal of a kind of view data, to solve to rely on ISP processing, in night scene Or the problem of the truer image attractive in appearance of can not obtain under other dark scenes.
First aspect is there is provided a kind of processing method of image, applied to mobile terminal, and the mobile terminal includes shooting Head, image-signal processor ISP and the digital signal processor DSP being connected respectively with the camera and the ISP, it is described Method includes：
Under shooting preview state, the time series data of camera is determined；
Control the DSP continuously to circulate and obtain the multiframe preview image that the camera is gathered according to the time series data；
If receiving photographing instruction, it is determined that present filming scene；
Based on the present filming scene, input picture is filtered out from the multiframe preview image；
Image synthesis is carried out to the input picture, composograph is generated；
The composograph is exported to the ISP.
Second aspect is there is provided a kind of processing mobile terminal of image, applied to mobile terminal, and the mobile terminal includes Camera, image-signal processor ISP and the digital signal processor DSP being connected respectively with the camera and the ISP, The mobile terminal includes：
Time series data determining module, under shooting preview state, determining the time series data of camera；
Preview image acquisition module, for control the DSP continuously circulate the acquisition camera according to it is described when ordinal number According to the multiframe preview image of collection；
Present filming scene determining module, if for receiving photographing instruction, it is determined that present filming scene；
Input picture screening module, for based on the present filming scene, being filtered out from the multiframe preview image Input picture；
Image synthesis unit, for carrying out image synthesis to the input picture, generates composograph；
Composograph output module, for the composograph to be exported to the ISP.
The third aspect, also provides a kind of mobile terminal, including processor, memory and is stored on the memory and can The computer program run on the processor, realizes above-mentioned image when the computer program is by the computing device The step of processing method.
So, in the embodiment of the present invention, first under shooting preview state, control camera is based on default time series data Continuous circulation carries out IMAQ, and controls DSP to receive the multiframe preview image gathered, if receiving the finger of taking pictures that user sends Order, it is determined that present filming scene is based on after present filming scene, suitable input picture is filtered out from multiframe preview image Image synthesis is carried out, composograph is generated, can then export to the ISP and carry out other processing.Using present invention implementation Example can select suitable input picture according to different photographed scenes, truer attractive in appearance so as to be obtained under different scenes Image.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these accompanying drawings Obtain other accompanying drawings.
Fig. 1 is one of flow chart of processing method embodiment of image provided in an embodiment of the present invention；
Fig. 2 is the two of the flow chart of the processing method embodiment of image provided in an embodiment of the present invention；
Fig. 3 is a kind of histogram of preview image of the embodiment of the present invention；
Fig. 4 A are a kind of one of structured flowcharts of mobile terminal embodiment of the embodiment of the present invention；
Fig. 4 B are the two of the structured flowchart of a kind of mobile terminal embodiment of the embodiment of the present invention；
Fig. 5 is the block diagram of the mobile terminal of another embodiment of the present invention；
Fig. 6 is the structural representation of the mobile terminal of another embodiment of the invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made Example, belongs to the scope of protection of the invention.
Reference picture 1, shows a kind of step flow chart of the processing method embodiment of view data of the present invention, the shifting Dynamic terminal includes camera, image-signal processor ISP and the data signal being connected respectively with the camera and the ISP Processor DSP.
In the camera system of mobile terminal, the DSP (Digital being connected with the sensor sensor of camera are provided with Signal Processing, digital signal processor), image procossing can be carried out for the view data of thecamera head. In practical application, the inside of dsp chip uses program and the separated Harvard structure of data, with special hardware multiplier, extensively General use pile line operation, can be for quickly realizing various digital signal processing algorithms there is provided special DSP instructions.Its In, DSP can be arranged at mobile terminal in internal or external mode, set according to the actual requirements, the embodiment of the present invention This is not any limitation as.In embodiments of the present invention, DSP can be independent chip.
It should be noted that the embodiment of the present invention is on the basis of the hardware frame of original mobile terminal, DSP is added, is made View data is obtained before ISP (Image Signal Processing, image-signal processor) is entered, can be realized more Image processing function, lifted view data picture quality.Wherein, ISP is can be integrated in CPU (Central Processing Unit, central processing unit) in or independent chip, the embodiment of the present invention need not be limited this System.
Methods described specifically may include steps of：
Step 101, under shooting preview state, the time series data of camera is determined.
When in the specific implementation, starting the camera applications of mobile terminal, it will usually enter preview state, now camera meeting Preview image is gathered, and the display screen that the preview image of collection is sent into mobile terminal carries out preview.Specifically, camera meeting According to the time series data set, go to complete the work of collection image.
Step 102, controlling the DSP continuously to circulate, to obtain the multiframe that the camera gathers according to the time series data pre- Look at image.
In embodiments of the present invention, camera can go circulation to obtain multiframe preview graph according to the time series data set Picture, goes to gather preview image according to the sequential section corresponding time for exposure in order according to each sequential section in time series data, and takes the photograph As the preview image that head is gathered, it will be transmitted in DSP and cached.
Step 103, if receiving photographing instruction, it is determined that present filming scene.
If receiving photographing instruction, present filming scene, e.g. night scene or scene on daytime are determined first, sentence is changed Talk about, be exactly that present filming scene is than dark or relatively brighter.
Step 104, based on the present filming scene, input picture is filtered out from the multiframe preview image；
In embodiments of the present invention, for different photographed scenes, accordingly it can be used as using different preview images defeated Enter image.Specifically, when it is determined that after present filming scene, it is possible to the multiframe cached according to present filming scene from DSP In preview image, the input picture of image synthesis can be subsequently used for by filtering out.
Step 105, image synthesis is carried out to the input picture, generates composograph.
It is determined that after input picture, control DSP is synthesized for these images based on the composition algorithm built in DSP, from And obtain composograph.
Step 106, the composograph is exported to the ISP.
When control DSP calculates composograph, it is possible to send composograph to ISP and carry out other image procossings.
So, in the embodiment of the present invention, first under shooting preview state, control camera is based on default time series data Continuous circulation carries out IMAQ, and controls DSP to receive the multiframe preview image gathered, if receiving the finger of taking pictures that user sends Order, it is determined that present filming scene is based on after present filming scene, suitable input picture is filtered out from multiframe preview image Image synthesis is carried out, composograph is generated, can then export to the ISP and carry out other processing.Using present invention implementation Example can select suitable input picture according to different photographed scenes, truer attractive in appearance so as to be obtained under different scenes Image.
Reference picture 2, shows a kind of step flow chart of the processing method embodiment of view data of the present invention, the shifting Dynamic terminal includes camera, image-signal processor ISP and the data signal being connected respectively with the camera and the ISP Processor DSP, methods described includes：
Step 201, under shooting preview state, the time series data of camera is determined.
Before taking pictures, the image that camera is collected would generally carry out preview on intelligent terminal, and camera is root Gathered in order according to default time series data.
Step 202, the sequential section corresponding time for exposure in the time series data is sequentially obtained.
In a particular application, the preview image includes under-exposure image, long exposure image and normal exposure image；It is described Time series data includes sequential section, and the sequential section has the corresponding time for exposure.
The sequential includes special sequential and common sequential, during the exposure of the common sequential correspondence normal exposure image Between, the time for exposure of the special sequential under-exposure image of correspondence and long exposure image；
In the specific implementation, time series data be exactly one by the data that are combined into of multiple sequential section, each sequential section can be with Correspondence performs an operation.In embodiments of the present invention, it can go to obtain the time for exposure based on sequential section.
In one preferred embodiment of the invention, the step 202 can include：
If sequential in the time series data is special sequential section, the under-exposure image and long exposure image are calculated Time for exposure；
If the sequential in the time series data is common sequential section, the normal exposure figure is obtained from default exposure meter The time for exposure of picture.
Such as, it is assumed that a time series data is made up of 1,2,3,4,5,6,7 and 8 these sequential section, wherein 1 to 6 can be with It is considered common sequential section, 7 and 8 may be considered special sequential section.So when the sequential section got is 1 to 6, just from pre- If exposure meter exposure obtain normal exposure image time for exposure so that camera can according to this time for exposure, gather To normal exposure image；The time for exposure of under-exposure image is just calculated when the sequential section got is 7 so that camera can According to this time for exposure, under-exposure image is collected；When calculating the exposure of long exposure image when the sequential section got is 8 Between so that camera can collect long exposure image according to this time for exposure.
In one preferred embodiment of the invention, the time for exposure includes under-exposure image, long exposure image and just Normal exposure image distinguishes the corresponding time for exposure；
The step of time for exposure of the calculating under-exposure image and long exposure image, including：
From default exposure meter, the time for exposure of the normal exposure image is obtained；
The histogram of the normal exposure image is generated, the histogram includes each pixel in the normal exposure image The brightness distribution data of point；
From the histogram, the brightness distribution data of predeterminable area is filtered out；
Based on the brightness distribution data of the predeterminable area, by linear regression, a straight line is calculated；
Determine the straight line and the angle of inclination of the histogrammic abscissa formation；
Calculate the sine value at the angle of inclination；
The sine value is multiplied by into predetermined constant to obtain exposing ratio；
According to the time for exposure and the exposure ratio, the time for exposure of the under-exposure image and long exposure are calculated The time for exposure of image；
Wherein, in the histogram, abscissa is brightness, and ordinate is the pixel quantity of the brightness.
Increase DSP hardware chip on the mobile terminal of the embodiment of the present invention, so as to the continuous multiframe of storage in real time raw The image in domain.The demand designed at present according to actual DSP, can continuously acquire eight two field pictures.
When user opens camera, time series data is determined in CPU, makes to continuously generate six frame normal exposure images, one in preview Frame is under-exposure image, a frame length exposure image, constantly circulation.And in ISP according to time series data to the under-exposure figure in preview Picture, long exposure image add different exposure gains, make the final preview effect of this two field pictures and the effect of normal exposure image Fruit is consistent.
In one preferred embodiment of the invention, the predeterminable area includes highlight regions and half-light region, the height Bright area refers to the region that brightness in histogram is more than or equal to 200, the half-light region refer in histogram brightness be less than or Region equal to 130.
The time for exposure of the exposure image of the embodiment of the present invention, long exposure image, can be according to the exposure of normal exposure image Calculate and obtain between light time.Specifically, it is assumed that the time for exposure T of normal exposure image, under exposed time for exposure t is, then：
T=T/m (m is constant, is obtained according to the histogram calculation of normal exposure image)
One histogram is obtained according to distribution situation of the pixel of each in preview image in brightness, if histogrammic There is more pixel in highlight regions, and brighter quantity is more, then it is assumed that highlight bar also has more details, such as Fig. 3.Then by m Bigger numerical value is adjusted to, the picture showing highlight bar details of more deficient exposure is obtained.Brightness in Fig. 3 histograms is abscissa, often Pixel number in individual brightness is ordinate, and being based on highlight regions by linear regression algorithm, (brightness reaches 230 to 255 picture The distributed areas of vegetarian refreshments) distribution situation obtain straight line, the angle of inclination of this straight line and abscissa is then obtained again, and Exposure ratio m is further calculated based on angle of inclination.
When angle of inclination is more than 15 degree and is less than 80 degree, it is believed that the overexposure area of the scene also has certain details, and Under-exposure ratio m=N*sinR is calculated according to angle of inclination R.N is Fixed constant, can be set according to actual conditions.
Calculate after exposure ratio m, it is possible to the time for exposure T based on normal exposure image, be inserted in formula t=T/m meters Calculate the time for exposure of under-exposure image.
The similar short exposure frames of time for exposure calculation of long exposure image, simply the slope in linear regression algorithm is negative Value, is just repeated no more.
Step 203, controlling the DSP continuously to circulate, to obtain the multiframe that the camera gathers according to the time for exposure pre- Look at image.
In one preferred embodiment of the invention, methods described also includes：
Control the ISP according to the time series data, adjust the exposure gain of each preview image.
The time series data of the embodiment of the present invention can be corresponded on the preview image of ISP outputs simultaneously, be preview image by ISP Another digit explosure gain (digital gain) is adjusted, the brightness adjustment of under-exposure image and long exposure image is arrived in pressure The brightness of normal exposure image, it is not in the bright exception secretly changed to make preview.
In one preferred embodiment of the invention, the DSP includes memory；, can be with before the step 204 Including：
The multiframe preview image is cyclically updated into the memory of the DSP.
When in camera preview state, camera applications make camera continuously circulate eight frame previews of generation according to time series data Image, is the under-exposure image of a frame, a frame length exposure image, six frame normal exposure images respectively.DSP can also be by these preview graphs As being constantly updated in DSP memory.
In one preferred embodiment of the invention, after the step 203, before the step 204, it can also wrap Include：
If receiving the preview image of predetermined number, present filming scene is detected.
In a kind of preferred scheme, the preview image of predetermined number can be received, detection current shooting is just gone Scape, specifically, can receive three frame preview images, just go to detect a present filming scene.
In one preferred embodiment of the invention, the step of detection present filming scene, including：
Judge whether to open high dynamic illumination render mode；
If not opening high dynamic illumination render mode, it is determined that present filming scene is normal photographing scene.
In embodiments of the present invention, it can determine whether mobile terminal has unlatching high dynamic illumination render mode first, i.e., HDR patterns, if be not turned on, photographed scene is normal photographing scene before can directly determining.
In one preferred embodiment of the invention, it is described judge whether open high dynamic illumination render mode the step of it Afterwards, in addition to：
If opening high dynamic illumination render mode, the exposure gain of the normal exposure image is obtained；
If the exposure gain of the normal exposure image is more than or equal to N times of gain, and the normal exposure image is present First half-light region and the first highlight regions, it is determined that present filming scene is night scene high dynamic illumination render scenes；
If the exposure gain of the normal exposure image is less than or equal to M times of gain, and the normal exposure image is present Second half-light region and the second highlight regions, it is determined that present filming scene is high dynamic illumination render scenes on daytime；
Wherein, the half-light region include the first half-light region and the second half-light region, the first half-light region it is bright Brightness of the degree less than the second half-light region；The highlight regions of stating include the first highlight regions and the second highlight regions, institute The brightness for stating the first highlight regions is higher than the brightness of second highlight regions；The span of the N and M are 2~30.
In embodiments of the present invention, if it is determined that mobile terminal opens high dynamic illumination render mode, i.e. HDR patterns, then It is HDR patterns on daytime that judgement, which can further be gone, or night scene HDR patterns.
Specifically, it can be determined by the exposure gain of normal exposure image, wherein, exposure gain is mobile terminal root Adjusted according to current environmental light brightness.Exposure gain is bigger, and brightness of image is bigger, conversely, exposure gain is smaller, brightness of image It is smaller.
In embodiments of the present invention, if the exposure gain that normal exposure image is used is more than 2~10 times, and have Certain half-light region (being less than 50~20) and highlight regions (being more than 240), then be judged as night scene HDR patterns.If normal expose When light image is less than 2 times using exposure gain, and with certain dark space half-light region (being less than 120~60) and highlight regions (being more than 200~220) is then considered HDR patterns on daytime.
In one preferred embodiment of the invention, it is described judge whether open high dynamic illumination render mode the step of it Afterwards, in addition to：
If the exposure gain of the normal exposure image is more than or equal to N times of gain, less than or equal to M times gain, and institute Normal exposure image is stated in the presence of the first half-light region and the first highlight regions, it is determined that present filming scene is night scene high dynamic light According to render scenes.
In actual applications, it is possible to while meeting night scene high dynamic illumination render scenes and high dynamic illumination on daytime is rendered The condition of scene.Specifically, at the beginning normal exposure image is that exposure gain is more than 2 times of gains when, adds and meets first Dark clear zone, it may be determined that be night scene HDR, now, exposure gain are less than in 20 multiplications increasingly and meet the second dark clear zone, it may be determined that It is HDR on daytime.
So, if exposure gain is more than 2 times of gains less than 20 times of gains, the condition for adding the first dark clear zone both met Night scene HDR meets HDR on daytime again, because the first dark clear zone is belonging respectively to the second dark clear zone, can now be defined as night scene HDR.
Step 204, if receiving photographing instruction, it is determined that present filming scene.
After photographing instruction is received, it is possible to according to the present filming scene above detected, go to determine current bat Take the photograph scene.
Step 205, based on the present filming scene, input picture is filtered out from the multiframe preview image.
In one preferred embodiment of the invention, the preview image includes under-exposure image, long exposure image and just Normal exposure image；The step 205 can include：
If the present filming scene is night scene high dynamic illumination render scenes, screened from the multiframe preview image Go out under-exposure image and normal exposure image as input picture；
If the present filming scene is high dynamic illumination render scenes on daytime, screened from the multiframe preview image Go out under-exposure image, long exposure image and normal exposure image as input picture；
If the present filming scene is normal photographing scene, normal exposure is filtered out from the multiframe preview image Image is used as input picture.
In the present invention, if the scene detected is daytime, HDR scene then uses normal exposure image, long exposure figure As, short exposed images are as input picture, normal exposure image, short is used if the scene detected is night scene HDR scene Exposure image is used as input picture.In addition, if being normal photographing scene, then normal exposure image only can be used as input Image.
In one preferred embodiment of the invention, rendered if the present filming scene is night scene high dynamic illumination Scene, then after the step of step 205, in addition to：
Whether there is moving object in the highlight regions for judging the under-exposure image and the normal exposure image；
If moving object is not present in the highlight regions of the under-exposure image and the normal exposure image, give up The half-light region of the under-exposure image, and again by the under-exposure image for giving up half-light region and the normal exposure figure As being used as input picture；
If there is moving object in the highlight regions of the under-exposure image and the normal exposure image, give up institute Under-exposure image is stated, and regard the normal exposure image as input picture again.
, can be with order to improve the quality of composograph after input picture has been primarily determined that based on present filming scene Denoising is done further to these input pictures.
Specifically, judge to owe to expose whether image has moving object with normal exposure image in input picture, if do not had Have and send six frame normal exposure images and under-exposure image into dsp chip, give up the half-light area part of under-exposure image, enter The quick synthesis processing of row.If there is moving object or under-exposure image and normal in under-exposure image and normal exposure image Exposure image matching is not punctual, then only uses six frame normal exposure images as input picture, can avoid the occurrence of smear.
Details in normal exposure image is in identical position, and the noise of different images is random, in synthesis, carefully Section part can further be superimposed enhancing, noise can cancel out each other, the data after addition again divided by synthesis frame number acquisition result frame. Be made up of in image pixel one by one, minimum data value is 0, and maximum data value is 255, correspond to respectively most dark pixel and Most bright pixel, when the brightness in normal exposure image reaches 230 or so, being considered as the region has tended to overexposure, needs Want the data filling details of same area in under-exposure image.But, it is less than 100 when the presence in under-exposure image is less than brightness Pixel in the case of, then when being synthesized with normal exposure image the brightness of image will be dragged down, so the pixel less than 100 Directly cast out.
In one preferred embodiment of the invention, if there is moving object described, the under-exposure image is given up, And again using the normal exposure image as after the step of input picture, in addition to：
Obtain the moving region image of the moving object per frame normal exposure image；
Image synthesis is carried out to the moving region image of the moving object per frame normal exposure image, target fortune is obtained Dynamic area image；
Calculate the gray-scale map of the normal exposure image；
Based on the gray-scale map, definition highest normal exposure image is filtered out as benchmark image；
Moving region image in the benchmark image is replaced using target moving region image.
When the car or the moving object such as people that there is motion in the scene of shooting, select first most clearly on the basis of image Image, it is determined that the position of the moving object in benchmark image.Then using moving object as analysis site, by the motion in all images Area image is overlaped, and the details of moving object is reduced as far as possible, the moving object image after reduction then is placed on into base In quasi- image in the position of moving object.
In one preferred embodiment of the invention, before the step 205, in addition to：
Determine the highlight regions of the normal exposure image；
Obtain the vicinity points of each pixel and the pixel in the highlight regions；
If there is the brightness of target pixel points and the luminance difference of vicinity points exceed predetermined threshold value, using the neighbour The target pixel points are smoothed by the brightness of nearly pixel.
In practice, when having pixel in normal exposure image or regional luminance is more than 230, it is necessary to under-exposure figure During the corresponding region subsidiary details of picture, the region can lift the brightness adjustment demand that certain brightness meets whole image.But More noise can be caused while lifting brightness, therefore the embodiment of the present invention can strengthen denoising for this region, look for first The brightness for going out normal exposure image is more than 230 highlight regions, then analyzes each pixel of this highlight regions and neighbouring picture The relation of vegetarian refreshments, if the luminance difference of pixel and neighbouring pixel is larger, then it is single stain to illustrate the pixel Or bright spot, it is random, then can carries out difference processing using the data of the pixel near this pixel, make the pixel In whole image smoothly a bit, that is, it was unlikely to dark or excessively bright.
In one preferred embodiment of the invention, the pixel of the preview image includes color component, the color Component includes red component, green component and blue component；After step 205, before the step 206, it can also include：
Determine the highlight regions of the under-exposure image and the normal exposure image；
Calculate accounting of the red component in the color component described in the highlight regions；
If the accounting exceedes preset ratio, red component described in the highlight regions is reduced in the color component In accounting.
In practice, if there are pure red highlight regions in image, if the regional luminance and area reach necessarily Numerical value, and red component reaches certain accounting, then needs to strengthen red suppression.
Highlight regions in detection image, easily cause red spilling when brightness is more than 200 first.Region more than 200 is recognized To be highlight regions, the ratio of the red component in whole color components (R, G and B) in the region is then detected, if red point Amount is compared with blue component, green component, and when red accounting b reaches more than 60%, the red component r in the region is multiplied by one and is Number D is reduced, it is assumed that D is 0.7, then amended red component r=0.7*b*R.
Step 206, image synthesis is carried out to the input picture, generates composograph.
It is determined that after input picture, control DSP is synthesized for these images based on the composition algorithm built in DSP, from And obtain composograph.
Step 207, the composograph is exported to the ISP.
When control DSP calculates composograph, it is possible to send composograph to ISP and carry out other image procossings, Operated such as denoising.
So, in the embodiment of the present invention, under shooting preview state, control camera is based in default time series data Sequential section goes continuous circulation to carry out IMAQ, and controls DSP to receive the multiframe preview image of collection, is sent if receiving user Photographing instruction, it is determined that present filming scene is based on after present filming scene, it is suitable to be filtered out from multiframe preview image Input picture carries out image synthesis, generates composograph, can then export to the ISP and carry out other processing.Due to this Inventive embodiments can rely on DSP hardware chip processing data, therefore speed is fast, can improve overall treatment efficiency, and most Whole composograph bandwagon effect.
In order that those skilled in the art more fully understand the present invention, illustrated below using specific example.At this In example, at least one in ISP and DSP is individual chips；ISP is integrated in central processor CPU.
Step 1：Under shooting preview state, the time series data of camera is determined.
Step 2：Sequentially obtain the sequential section corresponding time for exposure in time series data.If the sequential in time series data is spy Different sequential section, then calculate the time for exposure of under-exposure image and long exposure image；If the sequential in time series data is common sequential Section, then obtain the time for exposure of the normal exposure image from default exposure meter.
Wherein, the time for exposure includes under-exposure image, long exposure image and the corresponding exposure of normal exposure image difference Between light time；The step of time for exposure of the calculating under-exposure image and long exposure image, including：From default exposure meter In, obtain the time for exposure of the normal exposure image；The histogram of the normal exposure image is generated, the histogram includes The brightness distribution data of each pixel in normal exposure image；From histogram, the Luminance Distribution number of predeterminable area is filtered out According to；Brightness distribution data based on predeterminable area, by linear regression, calculates a straight line；Determine straight line and histogrammic horizontal stroke The angle of inclination of coordinate formation；Calculate the sine value at angle of inclination；Sine value is multiplied by into predetermined constant to obtain exposing ratio；According to Time for exposure and exposure ratio, calculate the time for exposure of under-exposure image and the time for exposure of long exposure image；Wherein, Nogata In figure, abscissa is brightness, and ordinate is the pixel quantity of brightness.
In addition, predeterminable area includes highlight regions and half-light region, highlight regions refer to that brightness is more than or waited in histogram In 200 region, half-light region refers to region of the brightness less than or equal to 130 in histogram.
Step 3：Control DSP, which is continuously circulated, obtains the multiframe preview image that camera is gathered according to the time for exposure.
Step 4：Multiframe preview image is cyclically updated into DSP memory.
Step 5：Control ISP according to time series data, adjust the exposure gain of each preview image.
Step 6：If receiving the preview image of predetermined number, present filming scene is detected.Wherein, current shooting is detected The step of scene, including：Judge whether to open high dynamic illumination render mode；If not opening high dynamic illumination render mode, It is normal photographing scene to determine present filming scene.
If in addition, opening high dynamic illumination render mode, obtaining the exposure gain of normal exposure image；If normal exposure The exposure gain of image is more than N times of gain, and normal exposure image has the first half-light region and the first highlight regions, it is determined that Present filming scene is night scene high dynamic illumination render scenes；If the exposure gain of normal exposure image doubles less than or equal to M Benefit, and there are the second half-light region and the second highlight regions in normal exposure image, it is determined that present filming scene is that daytime is high dynamic State illumination render scene；Wherein, half-light region includes the first half-light region and the second half-light region, the brightness in the first half-light region Less than the brightness in the second half-light region；Stating highlight regions includes the first highlight regions and the second highlight regions, the first highlight regions Brightness be higher than the second highlight regions brightness；N and M span is 2~30.
Step 7：If receiving photographing instruction, it is determined that present filming scene.
Step 8：Based on present filming scene, input picture is filtered out from multiframe preview image.Specifically, if current clap Scene is taken the photograph for night scene high dynamic illumination render scenes, then under-exposure image and normal exposure figure are filtered out from multiframe preview image As being used as input picture；If present filming scene is high dynamic illumination render scenes on daytime, screened from multiframe preview image Go out under-exposure image, long exposure image and normal exposure image as input picture；If present filming scene is normal photographing Scape, then filter out normal exposure image as input picture from multiframe preview image.
Wherein, N can be that 2, M can be 20.If the exposure gain of normal exposure image is more than or equal to 2 times of gains, small In or equal to 20 times of gains, and there are the first half-light region and the first highlight regions in normal exposure image, it is determined that current shooting Scene is night scene high dynamic illumination render scenes.
Step 9：Judge whether there is moving object in the highlight regions of under-exposure image and normal exposure image；
Step 10：If moving object is not present in under-exposure image and normal exposure image, give up under-exposure image Half-light region, and regard the under-exposure image and normal exposure image that give up half-light region as input picture again；
Step 11：If there is moving object in under-exposure image and normal exposure image, give up under-exposure image, and Again it regard normal exposure image as input picture.
Step 12：Determine the highlight regions of normal exposure image；
Step 13：Obtain the vicinity points of each pixel and pixel in highlight regions.
Step 14：If there is the brightness of target pixel points and the luminance difference of vicinity points exceedes predetermined threshold value, adopt With the brightness of vicinity points, target pixel points are smoothed.
Step 15：Image synthesis is carried out to input picture, composograph is generated.
Step 16：Composograph is exported to ISP.
The starting point of the present invention is mainly using the image quality for lifting night scene as target, is carried by obtaining six frame normal exposure images The dark portion details of night scene is risen, and adds the details lifting dynamic range of the under-exposure picture showing highlight bar of a frame.In raw domains, six frames Normal exposure image carries out multiframe by DSP hardware chip with the under-exposure image of a frame and synthesized, and adjusts the brightness and conjunction of image Into mode, one result raw figure of output, the details of details enhancing and highlight bar with dark portion, then obtained most by ISP processing Whole image.At least had the following advantages that using the embodiment of the present invention：
1st, scheme to synthesize using RAW, data volume is more, and detailed information enriches
2nd, by DSP hardware chip processing data, speed is fast.
3rd, a variety of composition algorithms are used in synthesizing, it is to avoid synthesis in multiple images occur and abnormal problem occur.
4th, obtain carrying out ISP processing again after result raw, do not reducing image overall brightness, do not increasing the situation of noise Under, strengthen the dark portion details of night scene.
5th, effectively lifting night scene dynamic range, the details of highlight bar can be showed, obtained image closer to people soon The true night scene arrived.
In summary, the details for showing highlight bar can be realized using the embodiment of the present invention, meanwhile, the brightness of image is adjusted It is whole when arriving common brightness, also can be truer in terms of color rendition.Because the dynamic range of human eye is higher, it is seen that actual field Scape overexposure region can be less, so present example can bring more real Night Scenery Effect.
The embodiment of the present invention can clearly show the details under half-light region while highlight regions are effectively suppressed, with Common HDR patterns are compared, and the noise of the embodiment of the present invention is less, and the highlight regions details of night scene becomes apparent from.The effect of image With real scene seen by person closer to.
Reference picture 4, shows a kind of structured flowchart of mobile terminal embodiment of the present invention, applied to mobile terminal, institute Stating mobile terminal includes camera, image-signal processor ISP and the numeral being connected respectively with the camera and the ISP Signal processor DSP, the mobile terminal includes：
Time series data determining module 301, under shooting preview state, determining the time series data of camera；
Preview image acquisition module 302, for controlling the DSP continuously to circulate the acquisition camera according to the sequential The multiframe preview image of data acquisition；
Present filming scene determining module 303, if for receiving photographing instruction, it is determined that present filming scene；
Input picture screening module 304, for based on the present filming scene, being screened from the multiframe preview image Go out input picture；
Image synthesis unit 305, for carrying out image synthesis to the input picture, generates composograph；
Composograph output module 306, for the composograph to be exported to the ISP.
As a preferred embodiment of the present invention, at least one in the ISP and the DSP is individual chips；Institute ISP is stated to be integrated in central processor CPU.
As a preferred embodiment of the present invention, the preview image includes under-exposure image, long exposure image and just Normal exposure image；The time series data includes sequential section, and the sequential section has the corresponding time for exposure.
As a preferred embodiment of the present invention, the preview image acquisition module 302, including：
Time for exposure acquisition submodule 3021, for sequentially obtaining during the corresponding exposure of section of the sequential in the time series data Between；
Preview image gathers submodule 3022, for controlling the DSP continuously to circulate the acquisition camera according to described The multiframe preview image of time for exposure collection.
As a preferred embodiment of the present invention, the preview image includes under-exposure image, long exposure image and just Normal exposure image；The sequential includes special sequential and common sequential, the exposure of the common sequential correspondence normal exposure image The time for exposure of time, the special sequential under-exposure image of correspondence and long exposure image；The time for exposure acquisition submodule, Including：
Time for exposure computing unit, if being special sequential section for the sequential in the time series data, calculates described owe The time for exposure of exposure image and long exposure image；
Time for exposure call unit, if being common sequential section for the sequential in the time series data, from default exposure The time for exposure of the normal exposure image is obtained in table.
As a preferred embodiment of the present invention, the time for exposure includes under-exposure image, long exposure image and just Normal exposure image distinguishes the corresponding time for exposure；The time for exposure computing unit, including：
Time for exposure obtains subelement, for from default exposure meter, obtaining the time for exposure of the normal exposure image；
Histogram generates subelement, and the histogram for generating the normal exposure image, the histogram includes described The brightness distribution data of each pixel in normal exposure image；
Brightness distribution data screens subelement, the Luminance Distribution number for from the histogram, filtering out predeterminable area According to；
Straight line computation subunit, for the brightness distribution data based on the predeterminable area, by linear regression, is calculated One straight line；
Angle of inclination determination subelement, for determining the straight line and the inclination angle of the histogrammic abscissa formation Degree；
Sine value computation subunit, the sine value for calculating the angle of inclination；
Ratio calculation subelement is exposed, obtains exposing ratio for the sine value to be multiplied by into predetermined constant；
Time for exposure computation subunit, for according to the time for exposure and the exposure ratio, calculating the deficient exposure The time for exposure of light image and the time for exposure of long exposure image；
Wherein, in the histogram, abscissa is brightness, and ordinate is the pixel quantity of the brightness.
As a preferred embodiment of the present invention, the predeterminable area includes highlight regions and half-light region, the height Bright area refers to the region that brightness in histogram is more than or equal to 200, the half-light region refer in histogram brightness be less than or Region equal to 130.
As a preferred embodiment of the present invention, the DSP includes memory；Also include：
Image cycle update module, for the multiframe preview image to be cyclically updated into the memory of the DSP.
As a preferred embodiment of the present invention, in addition to：
Exposure gain adjusting module, for controlling the ISP according to the time series data, adjusts the exposure of each preview image The gain of light.
As a preferred embodiment of the present invention, in addition to：
Present filming scene detection module, if the preview image for receiving predetermined number, detection current shooting Scape.
As a preferred embodiment of the present invention, the present filming scene detection module, including：
HDR mode decision submodules, for judging whether to open high dynamic illumination render mode；
First photographed scene determination sub-module, if for not opening high dynamic illumination render mode, it is determined that current shooting Scene is normal photographing scene.
As a preferred embodiment of the present invention, in addition to：
Exposure gain acquisition submodule, if for opening high dynamic illumination render mode, obtaining the normal exposure figure The exposure gain of picture；
Second photographed scene determination sub-module, if the exposure gain for the normal exposure image is more than N times of gain, and There are the first half-light region and the first highlight regions in the normal exposure image, it is determined that present filming scene is night scene high dynamic Illumination render scene；
Third shot takes the photograph scene determination sub-module, if the exposure gain for the normal exposure image is less than or equal to N times Gain, and there are the second half-light region and the second highlight regions in the normal exposure image, it is determined that present filming scene is white Its high dynamic illumination render scenes；
Wherein, the half-light region include the first half-light region and the second half-light region, the first half-light region it is bright Brightness of the degree less than the second half-light region；The highlight regions of stating include the first highlight regions and the second highlight regions, institute The brightness for stating the first highlight regions is higher than the brightness of second highlight regions；The span of the N is 2~30.
As a preferred embodiment of the present invention, in addition to：
4th photographed scene determination sub-module, if the exposure gain for the normal exposure image is more than or equal to N times There are the first half-light region and the first highlight regions in gain, less than or equal to M times gain, and the normal exposure image, then really Present filming scene is determined for night scene high dynamic illumination render scenes.
As a preferred embodiment of the present invention, the preview image includes under-exposure image, long exposure image and just Normal exposure image；The input picture screening module, including：
First input picture screens submodule, if being that night scene high dynamic illumination renders field for the present filming scene Scape, then filter out under-exposure image and normal exposure image as input picture from the multiframe preview image；
Second input picture screens submodule, if rendering field for the present filming scene for high dynamic illumination on daytime Scape, then filter out under-exposure image, long exposure image and normal exposure image from the multiframe preview image and scheme as input Picture；
3rd input picture screens submodule, if being normal photographing scene for the present filming scene, from described Normal exposure image is filtered out in multiframe preview image as input picture.
As a preferred embodiment of the present invention, in addition to：
Moving object judging submodule, the highlight regions for judging the under-exposure image and the normal exposure image In whether there is moving object；
First input picture determination sub-module, if for the under-exposure image and the highlight bar of the normal exposure image Moving object is not present in domain, then gives up the half-light region of the under-exposure image, and give up half-light region by described again Under-exposure image and the normal exposure image be used as input picture；
Second input picture determination sub-module, if for the under-exposure image and the highlight bar of the normal exposure image There is moving object in domain, then give up the under-exposure image, and regard the normal exposure image as input picture again.
As a preferred embodiment of the present invention, in addition to：
Moving region image collection module, the moving region figure of the moving object for obtaining every frame normal exposure image Picture；
Target moving region image obtains module, for the motor area to the moving object per frame normal exposure image Area image carries out image synthesis, obtains target moving region image；
Gray-scale map computing module, the gray-scale map for calculating the normal exposure image；
Benchmark image screening module, makees for based on the gray-scale map, filtering out definition highest normal exposure image On the basis of image；
Moving region image replacement module, for being replaced using target moving region image in the benchmark image Moving region image.
As a preferred embodiment of the present invention, in addition to：
Highlight regions determining module, the highlight regions for determining the normal exposure image；
Vicinity points acquisition module, the neighbour for obtaining each pixel and the pixel in the highlight regions Nearly pixel；
Smoothing module, if for there is the luminance difference of the brightness of target pixel points and vicinity points more than default Threshold value, then using the brightness of the vicinity points, be smoothed to the target pixel points.
As a preferred embodiment of the present invention, the pixel of the preview image includes color component, the color Component includes red component, green component and blue component；Also include：
Highlight regions determining module, the highlight regions for determining the under-exposure image and the normal exposure image；
Accounting computing module, for calculating red component accounting in the color component described in the highlight regions Than；
Accounting reduces module, if exceeding preset ratio for the accounting, reduces red described in the highlight regions Accounting of the component in the color component.
For mobile terminal embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, The relevent part can refer to the partial explaination of embodiments of method.
So, in the embodiment of the present invention, first under shooting preview state, control camera is based on default time series data Continuous circulation carries out IMAQ, and controls DSP to receive the multiframe preview image gathered, if receiving the finger of taking pictures that user sends Order, it is determined that present filming scene is based on after present filming scene, suitable input picture is filtered out from multiframe preview image Image synthesis is carried out, composograph is generated, can then export to the ISP and carry out other processing.Using present invention implementation Example can select suitable input picture according to different photographed scenes, truer attractive in appearance so as to be obtained under different scenes Image.
The embodiment of the present invention also provides a kind of mobile terminal, including processor, memory, is stored on the memory simultaneously The computer program that can be run on the processor, realizes above-mentioned image when the computer program is by the computing device Processing method embodiment each process, and can reach identical technique effect, to avoid repeating, repeat no more here.
Fig. 5 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 700 shown in Fig. 5 includes：At least One processor 701, memory 702, at least one network interface 704 and other users interface 703, in addition with camera 706.It should be noted that processor 701 includes digital signal processor DSP 7011 and picture signal handles ISP7012, two Person belongs to processor, but can be independent mutually chip or be coupling in same chip, or even coupling respectively Together in different chips.
Each component in mobile terminal 700 is coupled by bus system 705.It is understood that bus system 705 is used Connection communication between these components are realized.Bus system 705 is in addition to including data/address bus, in addition to power bus, control Bus and status signal bus in addition processed.But for the sake of clear explanation, various buses are all designated as bus system 705 in Figure 5.
Wherein, user interface 703 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch-screen etc..
It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory, Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read- OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM (ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) dodge Deposit.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside slow at a high speed Deposit.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory (SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory (DirectRambusRAM, DRRAM).The memory 702 of the system and method for description of the embodiment of the present invention is intended to include but not limited In these memories with any other suitable type.
In some embodiments, memory 702 stores following element, can perform module or data structure, or Their subset of person, or their superset：Operating system 7021 and application program 7022.
Wherein, operating system 7021, comprising various system programs, such as ccf layer, core library layer, driving layer, are used for Realize various basic businesses and handle hardware based task.Application program 7022, includes various application programs, such as media Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side The program of method may be embodied in application program 7022.
In embodiments of the present invention, by calling program or the instruction of the storage of memory 702, specifically, can be application The program stored in program 7022 or instruction.In embodiments of the present invention, mobile terminal 700 also includes：Storage is on a memory 702 and the computer program that can be run on processor 701, computer program realizes following steps when being performed by processor 701： Under shooting preview state, the time series data of camera is determined；The DSP is controlled continuously to circulate the acquisition camera according to institute State the multiframe preview image of time series data collection；If receiving photographing instruction, it is determined that present filming scene；Based on described current Photographed scene, input picture is filtered out from the multiframe preview image；Image synthesis is carried out to the input picture, generation is closed Into image；The composograph is exported to the ISP.
The method that the embodiments of the present invention are disclosed can apply in processor 701, or be realized by processor 701. Processor 701 is probably a kind of IC chip, the disposal ability with signal.In implementation process, the above method it is each Step can be completed by the integrated logic circuit of the hardware in processor 701 or the instruction of software form.Above-mentioned processing Device 701 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), application specific integrated circuit (ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array (FieldProgrammableGateArray, FPGA) or other PLDs, discrete gate or transistor logic Device, discrete hardware components.It can realize or perform disclosed each method, step and the box in the embodiment of the present invention Figure.General processor can be microprocessor or the processor can also be any conventional processor etc..With reference to the present invention The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and perform completion, or use decoding processor In hardware and software module combination perform completion.Software module can be located at random access memory, and flash memory, read-only storage can In the ripe storage medium in this area such as program read-only memory or electrically erasable programmable memory, register.The storage Medium is located at memory 702, and processor 701 reads the information in memory 702, and the step of the above method is completed with reference to its hardware Suddenly.
It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware, Microcode or its combination are realized.Realized for hardware, processing unit can be realized in one or more application specific integrated circuits (ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor (DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device (ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray, FPGA), general processor, controller, microcontroller, microprocessor, other electronics lists for performing herein described function In member or its combination.
For software realize, can by perform the module (such as process, function) of function described in the embodiment of the present invention come Realize the technology described in the embodiment of the present invention.Software code is storable in memory and by computing device.Memory can To realize within a processor or outside processor.
Optionally, following steps can be also realized when computer program is performed by processor 701：Ordinal number when sequentially obtaining described The sequential section corresponding time for exposure in；The DSP is controlled continuously to circulate the acquisition camera according to the time for exposure The multiframe preview image of collection.
Optionally, following steps can be also realized when computer program is performed by processor 701：If in the time series data Sequential is special sequential section, then calculates the time for exposure of the under-exposure image and long exposure image；If in the time series data Sequential for common sequential section, then the time for exposure of the normal exposure image is obtained from default exposure meter.
Optionally, following steps can be also realized when computer program is performed by processor 701：From default exposure meter, obtain Take the time for exposure of the normal exposure image；The histogram of the normal exposure image is generated, the histogram includes described The brightness distribution data of each pixel in normal exposure image；From the histogram, the brightness point of predeterminable area is filtered out Cloth data；Based on the brightness distribution data of the predeterminable area, by linear regression, a straight line is calculated；Determine the straight line With the angle of inclination of the histogrammic abscissa formation；Calculate the sine value at the angle of inclination；The sine value is multiplied by Predetermined constant obtains exposing ratio；According to the time for exposure and the exposure ratio, the exposure of the under-exposure image is calculated With the time for exposure of long exposure image between light time；Wherein, in the histogram, abscissa is brightness, and ordinate is the brightness Pixel quantity.
Optionally, following steps can be also realized when computer program is performed by processor 701：By the multiframe preview image It is cyclically updated into the memory of the DSP.
Optionally, following steps can be also realized when computer program is performed by processor 701：The ISP is controlled according to institute Time series data is stated, the exposure gain of each preview image is adjusted.
Optionally, following steps can be also realized when computer program is performed by processor 701：If receiving predetermined number Preview image, then detect present filming scene.
Optionally, following steps can be also realized when computer program is performed by processor 701：Judge whether to open high dynamic Illumination render pattern；If not opening high dynamic illumination render mode, it is determined that present filming scene is normal photographing scene.
Optionally, following steps can be also realized when computer program is performed by processor 701：If opening high dynamic illumination wash with watercolours Dye pattern, then obtain the exposure gain of the normal exposure image；If the exposure gain of the normal exposure image doubles more than N Benefit, and there are the first half-light region and the first highlight regions in the normal exposure image, it is determined that present filming scene is night scene High dynamic illumination render scenes；If the exposure gain of the normal exposure image is less than or equal to N times of gain, and the normal exposure There are the second half-light region and the second highlight regions in light image, it is determined that present filming scene renders field for high dynamic illumination on daytime Scape；Wherein, the half-light region includes the first half-light region and the second half-light region, and the brightness in the first half-light region is less than The brightness in the second half-light region；The highlight regions of stating include the first highlight regions and the second highlight regions, described first The brightness of highlight regions is higher than the brightness of second highlight regions；The span of the N is 2~30.
Optionally, following steps can be also realized when computer program is performed by processor 701：If the normal exposure image Exposure gain be more than or equal to N times of gain, less than or equal to M times gain, and the normal exposure image and there is the first half-light Region and the first highlight regions, it is determined that present filming scene is night scene high dynamic illumination render scenes.
Optionally, following steps can be also realized when computer program is performed by processor 701：If the present filming scene For night scene high dynamic illumination render scenes, then under-exposure image and normal exposure image are filtered out from the multiframe preview image It is used as input picture；If the present filming scene is high dynamic illumination render scenes on daytime, from the multiframe preview image In filter out under-exposure image, long exposure image and normal exposure image as input picture；If the present filming scene is Normal photographing scene, then filter out normal exposure image as input picture from the multiframe preview image.
Optionally, following steps can be also realized when computer program is performed by processor 701：Judge the under-exposure image Whether there is moving object with the highlight regions of the normal exposure image；If the under-exposure image and the normal exposure Moving object is not present in the highlight regions of light image, then gives up the half-light region of the under-exposure image, and again by institute The under-exposure image for giving up half-light region and the normal exposure image are stated as input picture；If the under-exposure image and institute There is moving object in the highlight regions for stating normal exposure image, then give up the under-exposure image, and again by it is described just Normal exposure image is used as input picture
Optionally, following steps can be also realized when computer program is performed by processor 701：Obtain per frame normal exposure figure The moving region image of the moving object of picture；The moving region image of the moving object per frame normal exposure image is carried out Image is synthesized, and obtains target moving region image；Calculate the gray-scale map of the normal exposure image；Based on the gray-scale map, sieve Definition highest normal exposure image is selected as benchmark image；The benchmark is replaced using target moving region image Moving region image in image.
Optionally, following steps can be also realized when computer program is performed by processor 701：Determine the normal exposure figure The highlight regions of picture；Obtain the vicinity points of each pixel and the pixel in the highlight regions；If there is mesh Mark the brightness of pixel and the luminance difference of vicinity points exceedes predetermined threshold value, then using the brightness of the vicinity points, The target pixel points are smoothed.
Optionally, following steps can be also realized when computer program is performed by processor 701：Determine the under-exposure image With the highlight regions of the normal exposure image；Red component described in the highlight regions is calculated in the color component Accounting；If the accounting exceedes preset ratio, red component described in the highlight regions is reduced in the color component Accounting.
Mobile terminal 700 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here Repeat no more.
So, in the embodiment of the present invention, first under shooting preview state, control camera is based on default time series data Continuous circulation carries out IMAQ, and controls DSP to receive the multiframe preview image gathered, if receiving the finger of taking pictures that user sends Order, it is determined that present filming scene is based on after present filming scene, suitable input picture is filtered out from multiframe preview image Image synthesis is carried out, composograph is generated, can then export to the ISP and carry out other processing.Using present invention implementation Example can select suitable input picture according to different photographed scenes, truer attractive in appearance so as to be obtained under different scenes Image.
Fig. 6 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 6 800 can be mobile phone, tablet personal computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer Deng.
Mobile terminal 800 in Fig. 6 includes radio frequency (RadioFrequency, RF) circuit 810, memory 820, input list Member 830, display unit 840, processor 860, voicefrequency circuit 870, WiFi (WirelessFidelity) module 880 and power supply 890.It should be noted that processor 860 includes digital signal processor DSP 861 and picture signal processing ISP862, both Belong to processor, but can be independent mutually chip or be coupling in same chip, or even couple respectively In different chips.
Wherein, input block 830 can be used for the numeral or character information for receiving user's input, and produce and mobile terminal The signal input that 800 user is set and function control is relevant.Specifically, in the embodiment of the present invention, the input block 830 can With including contact panel 831.Contact panel 831, also referred to as touch-screen, collect touch operation of the user on or near it (such as user uses the operations of any suitable object or annex on contact panel 831 such as finger, stylus), and according to advance The formula of setting drives corresponding attachment means.Optionally, contact panel 831 may include touch detecting apparatus and touch controller Two parts.Wherein, touch detecting apparatus detects the touch orientation of user, and detects the signal that touch operation is brought, by signal Send touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, Give the processor 860 again, and the order sent of reception processing device 860 and can be performed.Furthermore, it is possible to using resistance-type, The polytypes such as condenser type, infrared ray and surface acoustic wave realize contact panel 831.Except contact panel 831, input block 830 can also include other input equipments 832, and other input equipments 832 can include but is not limited to physical keyboard, function key One or more in (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..
Wherein, display unit 840 can be used for information and the movement for showing the information inputted by user or being supplied to user The various menu interfaces of terminal 800.Display unit 840 may include display panel 841, optionally, can use LCD or organic hairs The forms such as optical diode (OrganicLight-EmittingDiode, OLED) configure display panel 841.
It should be noted that contact panel 831 can cover display panel 841, touch display screen is formed, when touch display screen inspection Measure after the touch operation on or near it, processor 860 is sent to determine the type of touch event, with preprocessor 860 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area And arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area It can also be the empty interface not comprising any content.The conventional control viewing area is used to show the higher control of utilization rate, for example, Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..
Wherein processor 860 is the control centre of mobile terminal 800, utilizes various interfaces and connection whole mobile phone Various pieces, software program and/or module in first memory 821 are stored in by operation or execution, and call storage Data in second memory 822, perform the various functions and processing data of mobile terminal 800, so as to mobile terminal 800 Carry out integral monitoring.Optionally, processor 860 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 821 in software program and/or module and/ Or the data in the second memory 822, in embodiments of the present invention, mobile terminal 800 also includes：Storage is on a memory 820 and the computer program that can be run on processor 860, computer program realizes following steps when being performed by processor 860： Under shooting preview state, the time series data of camera is determined；The DSP is controlled continuously to circulate the acquisition camera according to institute State the multiframe preview image of time series data collection；If receiving photographing instruction, it is determined that present filming scene；Based on described current Photographed scene, input picture is filtered out from the multiframe preview image；Image synthesis is carried out to the input picture, generation is closed Into image；The composograph is exported to the ISP.
Optionally, following steps can be also realized when computer program is performed by processor 860：Ordinal number when sequentially obtaining described The sequential section corresponding time for exposure in；The DSP is controlled continuously to circulate the acquisition camera according to the time for exposure The multiframe preview image of collection.
Optionally, following steps can be also realized when computer program is performed by processor 860：If in the time series data Sequential is special sequential section, then calculates the time for exposure of the under-exposure image and long exposure image；If in the time series data Sequential for common sequential section, then the time for exposure of the normal exposure image is obtained from default exposure meter.
Optionally, following steps can be also realized when computer program is performed by processor 860：From default exposure meter, obtain Take the time for exposure of the normal exposure image；The histogram of the normal exposure image is generated, the histogram includes described The brightness distribution data of each pixel in normal exposure image；From the histogram, the brightness point of predeterminable area is filtered out Cloth data；Based on the brightness distribution data of the predeterminable area, by linear regression, a straight line is calculated；Determine the straight line With the angle of inclination of the histogrammic abscissa formation；Calculate the sine value at the angle of inclination；The sine value is multiplied by Predetermined constant obtains exposing ratio；According to the time for exposure and the exposure ratio, the exposure of the under-exposure image is calculated With the time for exposure of long exposure image between light time；Wherein, in the histogram, abscissa is brightness, and ordinate is the brightness Pixel quantity.
Optionally, following steps can be also realized when computer program is performed by processor 860：By the multiframe preview image It is cyclically updated into the memory of the DSP.
Optionally, following steps can be also realized when computer program is performed by processor 860：The ISP is controlled according to institute Time series data is stated, the exposure gain of each preview image is adjusted.
Optionally, following steps can be also realized when computer program is performed by processor 860：If receiving predetermined number Preview image, then detect present filming scene.
Optionally, following steps can be also realized when computer program is performed by processor 860：Judge whether to open high dynamic Illumination render pattern；If not opening high dynamic illumination render mode, it is determined that present filming scene is normal photographing scene.
Optionally, following steps can be also realized when computer program is performed by processor 860：If opening high dynamic illumination wash with watercolours Dye pattern, then obtain the exposure gain of the normal exposure image；If the exposure gain of the normal exposure image doubles more than N Benefit, and there are the first half-light region and the first highlight regions in the normal exposure image, it is determined that present filming scene is night scene High dynamic illumination render scenes；If the exposure gain of the normal exposure image is less than or equal to N times of gain, and the normal exposure There are the second half-light region and the second highlight regions in light image, it is determined that present filming scene renders field for high dynamic illumination on daytime Scape；Wherein, the half-light region includes the first half-light region and the second half-light region, and the brightness in the first half-light region is less than The brightness in the second half-light region；The highlight regions of stating include the first highlight regions and the second highlight regions, described first The brightness of highlight regions is higher than the brightness of second highlight regions；The span of the N is 2~30.
Optionally, following steps can be also realized when computer program is performed by processor 860：If the normal exposure image Exposure gain be more than or equal to N times of gain, less than or equal to M times gain, and the normal exposure image and there is the first half-light Region and the first highlight regions, it is determined that present filming scene is night scene high dynamic illumination render scenes.
Optionally, following steps can be also realized when computer program is performed by processor 860：If the present filming scene For night scene high dynamic illumination render scenes, then under-exposure image and normal exposure image are filtered out from the multiframe preview image It is used as input picture；If the present filming scene is high dynamic illumination render scenes on daytime, from the multiframe preview image In filter out under-exposure image, long exposure image and normal exposure image as input picture；If the present filming scene is Normal photographing scene, then filter out normal exposure image as input picture from the multiframe preview image.
Optionally, following steps can be also realized when computer program is performed by processor 860：Judge the under-exposure image Whether there is moving object with the highlight regions of the normal exposure image；If the under-exposure image and the normal exposure Moving object is not present in the highlight regions of light image, then gives up the half-light region of the under-exposure image, and again by institute The under-exposure image for giving up half-light region and the normal exposure image are stated as input picture；If the under-exposure image and institute There is moving object in the highlight regions for stating normal exposure image, then give up the under-exposure image, and again by it is described just Normal exposure image is used as input picture
Optionally, following steps can be also realized when computer program is performed by processor 860：Obtain per frame normal exposure figure The moving region image of the moving object of picture；The moving region image of the moving object per frame normal exposure image is carried out Image is synthesized, and obtains target moving region image；Calculate the gray-scale map of the normal exposure image；Based on the gray-scale map, sieve Definition highest normal exposure image is selected as benchmark image；The benchmark is replaced using target moving region image Moving region image in image.
Optionally, following steps can be also realized when computer program is performed by processor 860：Determine the normal exposure figure The highlight regions of picture；Obtain the vicinity points of each pixel and the pixel in the highlight regions；If there is mesh Mark the brightness of pixel and the luminance difference of vicinity points exceedes predetermined threshold value, then using the brightness of the vicinity points, The target pixel points are smoothed.
Optionally, following steps can be also realized when computer program is performed by processor 860：Determine the under-exposure image With the highlight regions of the normal exposure image；Red component described in the highlight regions is calculated in the color component Accounting；If the accounting exceedes preset ratio, red component described in the highlight regions is reduced in the color component Accounting.
For the embodiment of mobile terminal 800, because it is substantially similar to embodiment of the method, so the comparison of description is simple Single, the relevent part can refer to the partial explaination of embodiments of method.
So, in the embodiment of the present invention, first under shooting preview state, control camera is based on default time series data Continuous circulation carries out IMAQ, and controls DSP to receive the multiframe preview image gathered, if receiving the finger of taking pictures that user sends Order, it is determined that present filming scene is based on after present filming scene, suitable input picture is filtered out from multiframe preview image Image synthesis is carried out, composograph is generated, can then export to the ISP and carry out other processing.Using present invention implementation Example can select suitable input picture according to different photographed scenes, truer attractive in appearance so as to be obtained under different scenes Image.
Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each The unit and algorithm steps of example, can be realized with the combination of electronic hardware or computer software and electronic hardware.These Function is performed with hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.Specialty Technical staff can realize described function to each specific application using distinct methods, but this realization should not Think beyond the scope of this invention.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, others can be passed through Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces Connect, can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described. And foregoing storage medium includes：USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims (39)

1. a kind of processing method of image, applied to mobile terminal, it is characterised in that the mobile terminal includes camera, figure As signal processor ISP and the digital signal processor DSP being connected respectively with the camera and the ISP, methods described Including：
Under shooting preview state, the time series data of camera is determined；
Control the DSP continuously to circulate and obtain the multiframe preview image that the camera is gathered according to the time series data；
If receiving photographing instruction, it is determined that present filming scene；
Based on the present filming scene, input picture is filtered out from the multiframe preview image；
Image synthesis is carried out to the input picture, composograph is generated；
The composograph is exported to the ISP.
2. according to the method described in claim 1, it is characterised in that at least one in the ISP and the DSP is independent core Piece；The ISP is integrated in central processor CPU.
3. according to the method described in claim 1, it is characterised in that the preview image includes under-exposure image, long exposure diagram Picture and normal exposure image；The time series data includes sequential section, and the sequential section has the corresponding time for exposure.
4. method according to claim 3, it is characterised in that the control DSP continuously circulates the acquisition shooting The step of multiframe preview image that head is gathered according to the time series data, including：
Sequentially obtain the sequential section corresponding time for exposure in the time series data；
Control the DSP continuously to circulate and obtain the multiframe preview image that the camera is gathered according to the time for exposure.
5. method according to claim 4, it is characterised in that the preview image includes under-exposure image, long exposure diagram Picture and normal exposure image；The sequential includes special sequential and common sequential, the common sequential correspondence normal exposure image Time for exposure, the time for exposure of the special sequential under-exposure image of correspondence and long exposure image；
The step of sequential sequentially obtained in the time series data corresponding time for exposure, including：
If the sequential in the time series data is special sequential section, the exposure of the under-exposure image and long exposure image is calculated Time；
If the sequential in the time series data is common sequential section, the normal exposure image is obtained from default exposure meter Time for exposure.
6. method according to claim 5, it is characterised in that the time for exposure includes under-exposure image, long exposure diagram Picture and normal exposure image distinguish the corresponding time for exposure；
The step of time for exposure of the calculating under-exposure image and long exposure image, including：
From default exposure meter, the time for exposure of the normal exposure image is obtained；
The histogram of the normal exposure image is generated, the histogram includes each pixel in the normal exposure image Brightness distribution data；
From the histogram, the brightness distribution data of predeterminable area is filtered out；
Based on the brightness distribution data of the predeterminable area, by linear regression, a straight line is calculated；
Determine the straight line and the angle of inclination of the histogrammic abscissa formation；
Calculate the sine value at the angle of inclination；
The sine value is multiplied by into predetermined constant to obtain exposing ratio；
According to the time for exposure and the exposure ratio, the time for exposure of the under-exposure image and long exposure image are calculated Time for exposure；
Wherein, in the histogram, abscissa is brightness, and ordinate is the pixel quantity of the brightness.
7. method according to claim 6, it is characterised in that the predeterminable area includes highlight regions and half-light region, The highlight regions refer to region of the brightness more than or equal to 200 in histogram, and the half-light region refers to brightness in histogram Region less than or equal to 130.
8. according to the method described in claim 1, it is characterised in that the DSP includes memory；
If receiving photographing instruction described, it is determined that before the step of present filming scene, in addition to：
The multiframe preview image is cyclically updated into the memory of the DSP.
9. according to the method described in claim 1, it is characterised in that if described receive photographing instruction, it is determined that current shooting Before the step of scene, the control DSP continuously circulate obtain the camera according to the time series data gather it is many After the step of frame preview image, in addition to：
Control the ISP according to the time series data, adjust the exposure gain of each preview image.
10. method according to claim 9, it is characterised in that the control DSP continuously circulates the acquisition shooting After the step of multiframe preview image that head is gathered according to the time series data, if described receive photographing instruction, it is determined that when Before the step of preceding photographed scene, in addition to：
If receiving the preview image of predetermined number, present filming scene is detected.
11. method according to claim 10, it is characterised in that the step of the detection present filming scene, including：
Judge whether to open high dynamic illumination render mode；
If not opening high dynamic illumination render mode, it is determined that present filming scene is normal photographing scene.
12. method according to claim 11, it is characterised in that described to judge whether to open high dynamic illumination render mode The step of after, in addition to：
If opening high dynamic illumination render mode, the exposure gain of the normal exposure image is obtained；
If the exposure gain of the normal exposure image is more than or equal to N times of gain, and the normal exposure image has first Half-light region and the first highlight regions, it is determined that present filming scene is night scene high dynamic illumination render scenes；
If the exposure gain of the normal exposure image is less than or equal to M times of gain, and the normal exposure image has second Half-light region and the second highlight regions, it is determined that present filming scene is high dynamic illumination render scenes on daytime；
Wherein, the half-light region includes the first half-light region and the second half-light region, and the brightness in the first half-light region is low Brightness in the second half-light region；The highlight regions of stating are including the first highlight regions and the second highlight regions, and described the The brightness of one highlight regions is higher than the brightness of second highlight regions；The span of the N and M are 2~30, and the N is small In M.
13. method according to claim 12, it is characterised in that the N is 2, the M is 20.
14. method according to claim 13, it is characterised in that described to judge whether to open high dynamic illumination render mode The step of after, in addition to：
If the exposure gain of the normal exposure image is more than or equal to N times of gain, less than or equal to M times gain, and it is described just There are the first half-light region and the first highlight regions in normal exposure image, it is determined that present filming scene is night scene high dynamic illumination wash with watercolours Contaminate scene.
15. method according to claim 12, it is characterised in that the preview image includes under-exposure image, long exposure Image and normal exposure image；
It is described be based on the present filming scene, the step of filtering out input picture from the multiframe preview image, including：
If the present filming scene is night scene high dynamic illumination render scenes, filtered out from the multiframe preview image deficient Exposure image and normal exposure image are used as input picture；
If the present filming scene is high dynamic illumination render scenes on daytime, filtered out from the multiframe preview image deficient Exposure image, long exposure image and normal exposure image are used as input picture；
If the present filming scene is normal photographing scene, normal exposure image is filtered out from the multiframe preview image It is used as input picture.
16. method according to claim 15, it is characterised in that if the present filming scene is night scene high dynamic Illumination render scene, then filter out under-exposure image and normal exposure image as input picture from the multiframe preview image The step of after, in addition to：
Whether there is moving object in the highlight regions for judging the under-exposure image and the normal exposure image；
If moving object is not present in the highlight regions of the under-exposure image and the normal exposure image, give up described The half-light region of under-exposure image, and again make the under-exposure image for giving up half-light region and the normal exposure image For input picture；
If there is moving object in the highlight regions of the under-exposure image and the normal exposure image, give up described owe Exposure image, and it regard the normal exposure image as input picture again.
17. method according to claim 16, it is characterised in that if there is moving object described, gives up described owe Exposure image, and again using the normal exposure image as after the step of input picture, in addition to：
Obtain the moving region image of the moving object per frame normal exposure image；
Image synthesis is carried out to the moving region image of the moving object per frame normal exposure image, target motor area is obtained Area image；
Calculate the gray-scale map of the normal exposure image；
Based on the gray-scale map, definition highest normal exposure image is filtered out as benchmark image；
Moving region image in the benchmark image is replaced using target moving region image.
18. method according to claim 17, it is characterised in that described to be based on the present filming scene, from described many It is described that image synthesis, generation synthesis are carried out to the input picture after the step of filtering out input picture in frame preview image Before the step of image, in addition to：
Determine the highlight regions of the normal exposure image；
Obtain the vicinity points of each pixel and the pixel in the highlight regions；
If there is the brightness of target pixel points and the luminance difference of vicinity points exceed predetermined threshold value, using the neighbouring picture The target pixel points are smoothed by the brightness of vegetarian refreshments.
19. method according to claim 16, it is characterised in that the pixel of the preview image includes color component, The color component includes red component, green component and blue component；
Described based on the present filming scene, after the step of filtering out input picture from the multiframe preview image, It is described that image synthesis is carried out to the input picture, before the step of generating composograph, in addition to：
Determine the highlight regions of the under-exposure image and the normal exposure image；
Calculate accounting of the red component in the color component described in the highlight regions；
If the accounting exceedes preset ratio, red component described in the highlight regions is reduced in the color component Accounting.
20. the processing mobile terminal of a kind of image, applied to mobile terminal, it is characterised in that the mobile terminal includes shooting Head, image-signal processor ISP and the digital signal processor DSP being connected respectively with the camera and the ISP, it is described Mobile terminal includes：
Time series data determining module, under shooting preview state, determining the time series data of camera；
Preview image acquisition module, is adopted for controlling the DSP continuously to circulate the acquisition camera according to the time series data The multiframe preview image of collection；
Present filming scene determining module, if for receiving photographing instruction, it is determined that present filming scene；
Input picture screening module, for based on the present filming scene, input to be filtered out from the multiframe preview image Image；
Image synthesis unit, for carrying out image synthesis to the input picture, generates composograph；
Composograph output module, for the composograph to be exported to the ISP.
21. mobile terminal according to claim 20, it is characterised in that in the ISP and the DSP at least one of be Individual chips；The ISP is integrated in central processor CPU.
22. mobile terminal according to claim 20, it is characterised in that the preview image includes under-exposure image, length Exposure image and normal exposure image；The time series data includes sequential section, and the sequential section has the corresponding time for exposure.
23. mobile terminal according to claim 22, it is characterised in that the preview image acquisition module, including：
Time for exposure acquisition submodule, for sequentially obtaining the section of the sequential in the time series data corresponding time for exposure；
Preview image gathers submodule, for controlling the DSP continuously to circulate the acquisition camera according to the time for exposure The multiframe preview image of collection.
24. mobile terminal according to claim 23, it is characterised in that the preview image includes under-exposure image, length Exposure image and normal exposure image；The sequential includes special sequential and common sequential, and the common sequential correspondence is normal to expose The time for exposure of the time for exposure of light image, the special sequential under-exposure image of correspondence and long exposure image；
The time for exposure acquisition submodule, including：
Time for exposure computing unit, if being special sequential section for the sequential in the time series data, calculates described under-exposure The time for exposure of image and long exposure image；
Time for exposure call unit, if being common sequential section for the sequential in the time series data, from default exposure meter Obtain the time for exposure of the normal exposure image.
25. mobile terminal according to claim 24, it is characterised in that the time for exposure includes under-exposure image, length Exposure image and normal exposure image distinguish the corresponding time for exposure；
The time for exposure computing unit, including：
Time for exposure obtains subelement, for from default exposure meter, obtaining the time for exposure of the normal exposure image；
Histogram generates subelement, the histogram for generating the normal exposure image, and the histogram includes described normal The brightness distribution data of each pixel in exposure image；
Brightness distribution data screens subelement, for from the histogram, filtering out the brightness distribution data of predeterminable area；
Straight line computation subunit, for the brightness distribution data based on the predeterminable area, by linear regression, is calculated always Line；
Angle of inclination determination subelement, for determining the straight line and the angle of inclination of the histogrammic abscissa formation；
Sine value computation subunit, the sine value for calculating the angle of inclination；
Ratio calculation subelement is exposed, obtains exposing ratio for the sine value to be multiplied by into predetermined constant；
Time for exposure computation subunit, for according to the time for exposure and the exposure ratio, calculating the under-exposure figure The time for exposure of picture and the time for exposure of long exposure image；
Wherein, in the histogram, abscissa is brightness, and ordinate is the pixel quantity of the brightness.
26. mobile terminal according to claim 25, it is characterised in that the predeterminable area includes highlight regions and half-light Region, the highlight regions refer to region of the brightness more than or equal to 200 in histogram, and the half-light region refers in histogram Brightness is less than or equal to 130 region.
27. mobile terminal according to claim 20, it is characterised in that the DSP includes memory；Also include：
Image cycle update module, for the multiframe preview image to be cyclically updated into the memory of the DSP.
28. mobile terminal according to claim 20, it is characterised in that also include：
Exposure gain adjusting module, for controlling the ISP according to the time series data, the exposure for adjusting each preview image increases Benefit.
29. mobile terminal according to claim 28, it is characterised in that also include：
Present filming scene detection module, if the preview image for receiving predetermined number, detects present filming scene.
30. mobile terminal according to claim 29, it is characterised in that the present filming scene detection module, including：
HDR mode decision submodules, for judging whether to open high dynamic illumination render mode；
First photographed scene determination sub-module, if for not opening high dynamic illumination render mode, it is determined that present filming scene For normal photographing scene.
31. mobile terminal according to claim 30, it is characterised in that also include：
Exposure gain acquisition submodule, if for opening high dynamic illumination render mode, obtaining the normal exposure image Exposure gain；
Second photographed scene determination sub-module, if the exposure gain for the normal exposure image is more than or equal to N times of gain, And there are the first half-light region and the first highlight regions in the normal exposure image, it is determined that present filming scene is that night scene height is dynamic State illumination render scene；
Third shot takes the photograph scene determination sub-module, if the exposure gain for the normal exposure image is less than or equal to M times of gain, And there are the second half-light region and the second highlight regions in the normal exposure image, it is determined that present filming scene is that daytime is high dynamic State illumination render scene；
Wherein, the half-light region includes the first half-light region and the second half-light region, and the brightness in the first half-light region is low Brightness in the second half-light region；The highlight regions of stating are including the first highlight regions and the second highlight regions, and described the The brightness of one highlight regions is higher than the brightness of second highlight regions；The span of the N is 2~30.
32. mobile terminal according to claim 31, it is characterised in that the N is 2, the M is 20.
33. mobile terminal according to claim 32, it is characterised in that also include：
4th photographed scene determination sub-module, if the exposure gain for the normal exposure image is more than or equal to N times of gain, Less than or equal to M times gain, and there are the first half-light region and the first highlight regions in the normal exposure image, it is determined that it is current Photographed scene is night scene high dynamic illumination render scenes.
34. mobile terminal according to claim 31, it is characterised in that the preview image includes under-exposure image, length Exposure image and normal exposure image；The input picture screening module, including：
First input picture screens submodule, if being night scene high dynamic illumination render scenes for the present filming scene, Under-exposure image and normal exposure image are filtered out from the multiframe preview image as input picture；
Second input picture screens submodule, if being high dynamic illumination render scenes on daytime for the present filming scene, Under-exposure image, long exposure image and normal exposure image are filtered out from the multiframe preview image as input picture；
3rd input picture screens submodule, if being normal photographing scene for the present filming scene, from the multiframe Normal exposure image is filtered out in preview image as input picture.
35. mobile terminal according to claim 34, it is characterised in that also include：
It is in moving object judging submodule, the highlight regions for judging the under-exposure image and the normal exposure image It is no to there is moving object；
First input picture determination sub-module, if in highlight regions for the under-exposure image and the normal exposure image Moving object is not present, then gives up the half-light region of the under-exposure image, and give up owing for half-light region by described again Exposure image and the normal exposure image are used as input picture；
Second input picture determination sub-module, if in highlight regions for the under-exposure image and the normal exposure image There is moving object, then give up the under-exposure image, and regard the normal exposure image as input picture again.
36. mobile terminal according to claim 35, it is characterised in that also include：
Moving region image collection module, the moving region image of the moving object for obtaining every frame normal exposure image；
Target moving region image obtains module, for the moving region figure to the moving object per frame normal exposure image As carrying out image synthesis, target moving region image is obtained；
Gray-scale map computing module, the gray-scale map for calculating the normal exposure image；
Benchmark image screening module, for based on the gray-scale map, filtering out definition highest normal exposure image as base Quasi- image；
Moving region image replacement module, for replacing the motion in the benchmark image using target moving region image Area image.
37. mobile terminal according to claim 36, it is characterised in that also include：
Highlight regions determining module, the highlight regions for determining the normal exposure image；
Vicinity points acquisition module, the neighbouring picture for obtaining each pixel and the pixel in the highlight regions Vegetarian refreshments；
Smoothing module, if exceeding default threshold for there is the luminance difference of the brightness of target pixel points and vicinity points Value, then using the brightness of the vicinity points, be smoothed to the target pixel points.
38. mobile terminal according to claim 35, it is characterised in that the pixel of the preview image includes color point Amount, the color component includes red component, green component and blue component；Also include：
Highlight regions determining module, the highlight regions for determining the under-exposure image and the normal exposure image；
Accounting computing module, for calculating accounting of the red component in the color component described in the highlight regions；
Accounting reduces module, if exceeding preset ratio for the accounting, reduces red component described in the highlight regions Accounting in the color component.
39. a kind of mobile terminal, it is characterised in that including processor, memory and be stored on the memory and can be in institute State the computer program run on processor, the computer program realized during the computing device as claim 1 to The step of processing method of image any one of 19.
CN201710528157.5A 2017-06-30 2017-06-30 A kind of processing method and mobile terminal of image Active CN107205120B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710528157.5A CN107205120B (en) 2017-06-30 2017-06-30 A kind of processing method and mobile terminal of image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710528157.5A CN107205120B (en) 2017-06-30 2017-06-30 A kind of processing method and mobile terminal of image

Publications (2)

Publication Number Publication Date
CN107205120A true CN107205120A (en) 2017-09-26
CN107205120B CN107205120B (en) 2019-04-09

Family

ID=59911787

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710528157.5A Active CN107205120B (en) 2017-06-30 2017-06-30 A kind of processing method and mobile terminal of image

Country Status (1)

Country Link
CN (1) CN107205120B (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107809592A (en) * 2017-11-13 2018-03-16 广东欧珀移动通信有限公司 Method, apparatus, terminal and the storage medium of shooting image
CN107809591A (en) * 2017-11-13 2018-03-16 广东欧珀移动通信有限公司 Method, apparatus, terminal and the storage medium of shooting image
CN107888839A (en) * 2017-10-30 2018-04-06 广东欧珀移动通信有限公司 High-dynamic-range image acquisition method, device and equipment
CN108174125A (en) * 2018-01-23 2018-06-15 奇酷互联网络科技（深圳）有限公司 Control the method, apparatus and electronic equipment of HDR functions
CN109068059A (en) * 2018-08-27 2018-12-21 Oppo广东移动通信有限公司 A kind of method, mobile terminal and storage medium calling camera
CN109089053A (en) * 2018-10-23 2018-12-25 Oppo广东移动通信有限公司 Image transfer method, device, electronic equipment and storage medium
CN109348124A (en) * 2018-10-23 2019-02-15 Oppo广东移动通信有限公司 Image transfer method, device, electronic equipment and storage medium
CN109547699A (en) * 2018-12-24 2019-03-29 成都西纬科技有限公司 A kind of method and device taken pictures
CN109672819A (en) * 2018-12-10 2019-04-23 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and computer readable storage medium
CN109753435A (en) * 2018-12-29 2019-05-14 广州云测信息技术有限公司 A kind of method for testing software and device
CN109976348A (en) * 2019-04-11 2019-07-05 深圳市大富科技股份有限公司 A kind of vehicle and its motion control method, equipment, storage medium
CN110033421A (en) * 2019-04-09 2019-07-19 Oppo广东移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN110475072A (en) * 2017-11-13 2019-11-19 Oppo广东移动通信有限公司 Shoot method, apparatus, terminal and the storage medium of image
CN110636227A (en) * 2019-09-24 2019-12-31 合肥富煌君达高科信息技术有限公司 High dynamic range HDR image synthesis method and high-speed camera integrating same
EP3609177A1 (en) * 2018-08-06 2020-02-12 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method, control apparatus, imaging device, and electronic device
WO2020063508A1 (en) * 2018-09-29 2020-04-02 上海众链科技有限公司 Smart terminal, image processing method and computer readable storage medium
CN110958401A (en) * 2019-12-16 2020-04-03 北京迈格威科技有限公司 Super night scene image color correction method and device and electronic equipment
CN111050143A (en) * 2018-10-11 2020-04-21 华为技术有限公司 Image shooting method and terminal equipment
CN111064890A (en) * 2019-12-25 2020-04-24 安凯(广州)微电子技术有限公司 Multi-view circuit equipment and multi-view circuit control method
CN112532856A (en) * 2019-09-17 2021-03-19 中兴通讯股份有限公司 Shooting method, device and system
CN113303905A (en) * 2021-05-26 2021-08-27 中南大学湘雅二医院 Interventional operation simulation method based on video image feedback
CN113473014A (en) * 2021-06-30 2021-10-01 北京紫光展锐通信技术有限公司 Image data processing method and electronic equipment
CN113938602A (en) * 2021-09-08 2022-01-14 荣耀终端有限公司 Image processing method, electronic device, chip and readable storage medium
WO2023070261A1 (en) * 2021-10-25 2023-05-04 深圳市大疆创新科技有限公司 Photographic method and apparatus, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010053759A2 (en) * 2008-11-10 2010-05-14 Victor Charles Bruce Imaging apparatus for image integration
CN105227858A (en) * 2015-10-30 2016-01-06 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN105681665A (en) * 2016-02-29 2016-06-15 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN105812553A (en) * 2015-09-24 2016-07-27 维沃移动通信有限公司 Rapid shooting method and mobile terminal
CN105827971A (en) * 2016-03-31 2016-08-03 维沃移动通信有限公司 Image processing method and mobile terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010053759A2 (en) * 2008-11-10 2010-05-14 Victor Charles Bruce Imaging apparatus for image integration
CN105812553A (en) * 2015-09-24 2016-07-27 维沃移动通信有限公司 Rapid shooting method and mobile terminal
CN105227858A (en) * 2015-10-30 2016-01-06 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN105681665A (en) * 2016-02-29 2016-06-15 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN105827971A (en) * 2016-03-31 2016-08-03 维沃移动通信有限公司 Image processing method and mobile terminal

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107888839A (en) * 2017-10-30 2018-04-06 广东欧珀移动通信有限公司 High-dynamic-range image acquisition method, device and equipment
CN107888839B (en) * 2017-10-30 2019-12-06 Oppo广东移动通信有限公司 high dynamic range image acquisition method, device and equipment
CN107809592A (en) * 2017-11-13 2018-03-16 广东欧珀移动通信有限公司 Method, apparatus, terminal and the storage medium of shooting image
CN107809591B (en) * 2017-11-13 2019-09-10 Oppo广东移动通信有限公司 Shoot method, apparatus, terminal and the storage medium of image
CN107809591A (en) * 2017-11-13 2018-03-16 广东欧珀移动通信有限公司 Method, apparatus, terminal and the storage medium of shooting image
US11412153B2 (en) 2017-11-13 2022-08-09 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Model-based method for capturing images, terminal, and storage medium
US11146739B2 (en) * 2017-11-13 2021-10-12 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for image shooting, terminal device, and storage medium
US11102397B2 (en) 2017-11-13 2021-08-24 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for capturing images, terminal, and storage medium
CN110475072B (en) * 2017-11-13 2021-03-09 Oppo广东移动通信有限公司 Method, device, terminal and storage medium for shooting image
CN110475072A (en) * 2017-11-13 2019-11-19 Oppo广东移动通信有限公司 Shoot method, apparatus, terminal and the storage medium of image
WO2019091411A1 (en) * 2017-11-13 2019-05-16 Oppo广东移动通信有限公司 Image capturing method, device, terminal, and storage medium
WO2019091487A1 (en) * 2017-11-13 2019-05-16 Oppo广东移动通信有限公司 Image photographing method and device, terminal, and storage medium
CN107809592B (en) * 2017-11-13 2019-09-17 Oppo广东移动通信有限公司 Shoot method, apparatus, terminal and the storage medium of image
CN108174125B (en) * 2018-01-23 2020-12-25 奇酷互联网络科技（深圳）有限公司 Method, device, electronic equipment and storage medium for controlling HDR function
CN108174125A (en) * 2018-01-23 2018-06-15 奇酷互联网络科技（深圳）有限公司 Control the method, apparatus and electronic equipment of HDR functions
EP3609177A1 (en) * 2018-08-06 2020-02-12 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method, control apparatus, imaging device, and electronic device
CN109068059A (en) * 2018-08-27 2018-12-21 Oppo广东移动通信有限公司 A kind of method, mobile terminal and storage medium calling camera
WO2020063508A1 (en) * 2018-09-29 2020-04-02 上海众链科技有限公司 Smart terminal, image processing method and computer readable storage medium
CN111050143A (en) * 2018-10-11 2020-04-21 华为技术有限公司 Image shooting method and terminal equipment
CN111050143B (en) * 2018-10-11 2021-09-21 华为技术有限公司 Image shooting method and terminal equipment
US11595588B2 (en) 2018-10-11 2023-02-28 Huawei Technologies Co., Ltd. Image capturing method and terminal device
CN109089053B (en) * 2018-10-23 2021-03-05 Oppo广东移动通信有限公司 Image transmission method, image transmission device, electronic equipment and storage medium
CN109089053A (en) * 2018-10-23 2018-12-25 Oppo广东移动通信有限公司 Image transfer method, device, electronic equipment and storage medium
CN109348124A (en) * 2018-10-23 2019-02-15 Oppo广东移动通信有限公司 Image transfer method, device, electronic equipment and storage medium
CN109672819A (en) * 2018-12-10 2019-04-23 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and computer readable storage medium
CN109547699A (en) * 2018-12-24 2019-03-29 成都西纬科技有限公司 A kind of method and device taken pictures
CN109753435A (en) * 2018-12-29 2019-05-14 广州云测信息技术有限公司 A kind of method for testing software and device
CN109753435B (en) * 2018-12-29 2022-02-01 北京云测信息技术有限公司 Software testing method and device
CN110033421B (en) * 2019-04-09 2021-08-24 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
CN110033421A (en) * 2019-04-09 2019-07-19 Oppo广东移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN109976348A (en) * 2019-04-11 2019-07-05 深圳市大富科技股份有限公司 A kind of vehicle and its motion control method, equipment, storage medium
CN112532856A (en) * 2019-09-17 2021-03-19 中兴通讯股份有限公司 Shooting method, device and system
CN112532856B (en) * 2019-09-17 2023-10-17 中兴通讯股份有限公司 Shooting method, device and system
CN110636227B (en) * 2019-09-24 2021-09-10 合肥富煌君达高科信息技术有限公司 High dynamic range HDR image synthesis method and high-speed camera integrating same
CN110636227A (en) * 2019-09-24 2019-12-31 合肥富煌君达高科信息技术有限公司 High dynamic range HDR image synthesis method and high-speed camera integrating same
CN110958401B (en) * 2019-12-16 2022-08-23 北京迈格威科技有限公司 Super night scene image color correction method and device and electronic equipment
CN110958401A (en) * 2019-12-16 2020-04-03 北京迈格威科技有限公司 Super night scene image color correction method and device and electronic equipment
CN111064890A (en) * 2019-12-25 2020-04-24 安凯(广州)微电子技术有限公司 Multi-view circuit equipment and multi-view circuit control method
CN113303905A (en) * 2021-05-26 2021-08-27 中南大学湘雅二医院 Interventional operation simulation method based on video image feedback
CN113473014A (en) * 2021-06-30 2021-10-01 北京紫光展锐通信技术有限公司 Image data processing method and electronic equipment
CN113473014B (en) * 2021-06-30 2022-11-18 北京紫光展锐通信技术有限公司 Image data processing method and electronic equipment
CN113938602A (en) * 2021-09-08 2022-01-14 荣耀终端有限公司 Image processing method, electronic device, chip and readable storage medium
CN113938602B (en) * 2021-09-08 2022-08-02 荣耀终端有限公司 Image processing method, electronic device, chip and readable storage medium
WO2023070261A1 (en) * 2021-10-25 2023-05-04 深圳市大疆创新科技有限公司 Photographic method and apparatus, and storage medium

Also Published As

Publication number Publication date
CN107205120B (en) 2019-04-09

Similar Documents

Publication Publication Date Title
CN107205120A (en) The processing method and mobile terminal of a kind of image
CN105227858B (en) A kind of image processing method and mobile terminal
CN107277387B (en) High dynamic range images image pickup method, terminal and computer readable storage medium
CN105827990B (en) A kind of automatic explosion method and mobile terminal
CN106331510B (en) A kind of backlight photographic method and mobile terminal
CN107231530B (en) A kind of photographic method and mobile terminal
CN106131449B (en) A kind of photographic method and mobile terminal
CN107222680A (en) The image pickup method and mobile terminal of a kind of panoramic picture
CN107395998A (en) A kind of image capturing method and mobile terminal
CN106161967A (en) A kind of backlight scene panorama shooting method and mobile terminal
CN107197169A (en) A kind of high dynamic range images image pickup method and mobile terminal
CN106170058B (en) A kind of exposure method and mobile terminal
CN107302664A (en) A kind of image pickup method and mobile terminal
CN106060419B (en) A kind of photographic method and mobile terminal
CN106060406A (en) Photographing method and mobile terminal
CN107197170A (en) A kind of exposal control method and mobile terminal
CN107205119B (en) A kind for the treatment of method and apparatus of image data
CN107635093A (en) A kind of image processing method, mobile terminal and computer-readable recording medium
CN107395898A (en) A kind of image pickup method and mobile terminal
CN106060422B (en) A kind of image exposure method and mobile terminal
CN107395976B (en) A kind of acquisition parameters setting method and mobile terminal
CN106303250A (en) A kind of image processing method and mobile terminal
CN106131398B (en) A kind of image browsing method and mobile terminal
CN107465874B (en) A kind of dark current processing method and mobile terminal
CN106454104A (en) Photographing method and mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant