CN110166711A - Image processing method, device, electronic equipment and storage medium - Google Patents
Image processing method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110166711A CN110166711A CN201910509592.2A CN201910509592A CN110166711A CN 110166711 A CN110166711 A CN 110166711A CN 201910509592 A CN201910509592 A CN 201910509592A CN 110166711 A CN110166711 A CN 110166711A
- Authority
- CN
- China
- Prior art keywords
- image
- exposure
- night scene
- frame
- shooting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 43
- 238000003860 storage Methods 0.000 title claims abstract description 16
- 238000000034 method Methods 0.000 claims abstract description 21
- 230000004044 response Effects 0.000 claims abstract description 12
- 230000035945 sensitivity Effects 0.000 claims description 64
- 238000012545 processing Methods 0.000 claims description 36
- 230000015572 biosynthetic process Effects 0.000 claims description 33
- 238000003786 synthesis reaction Methods 0.000 claims description 33
- 230000015654 memory Effects 0.000 claims description 30
- 230000009467 reduction Effects 0.000 claims description 13
- 239000000463 material Substances 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 238000003384 imaging method Methods 0.000 abstract description 43
- 230000000694 effects Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 8
- 238000001514 detection method Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 230000000717 retained effect Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000003631 expected effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000001795 light effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000005375 photometry Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The application proposes a kind of image processing method, device, electronic equipment and storage medium, wherein, method includes: in response to user's operation, it is switched to night scene mode, preview image is acquired in the night mode, if being identified as non-night scene scene according to the preview image of acquisition, brightness adjustment is carried out to the shooting image acquired under night scene mode, to reduce the brightness of shooting image.This method under non-night scene scene, is acquired shooting image using night scene mode, and carry out brightness adjustment to shooting image, enables shooting image to retain more details in highlight regions and dark portion region, to improve the imaging effect of shooting image by user's operation.
Description
Technical field
This application involves technical field of imaging more particularly to a kind of image processing method, device, electronic equipment and storages
Medium.
Background technique
With the development of science and technology, the camera technology for relying on science and technology is more and more mature, in daily production and life
In, take pictures using the built-in camera of intelligent mobile terminal (such as smart phone, tablet computer), it is a kind of normal to have become
State.Therefore, as the normalization for the demand taken pictures develops, the demand of taking pictures for how more preferably meeting user becomes the main of development
Direction, for example, meeting the demand of clearly taking pictures in the more scenes of user at night, in the daytime.
Currently, during shooting image under daytime or bright field scape, if user is by the screening-mode of mobile terminal
Be set as night scene mode, system can taking pictures as a result, automatically falling back on general mode according to scene detection, make so as to cause user
Expected effect is not achieved with the image that night scene mode is taken pictures.
Summary of the invention
The application is intended to solve at least some of the technical problems in related technologies.
The application proposes a kind of image processing method, device, electronic equipment and storage medium, to realize on daytime or
Under bright field scape, controlling electronic devices shoots image using night scene mode, enables shooting image in highlight regions and dark portion region
Enough retain more details, improves the imaging effect of shooting image.
The application first aspect embodiment proposes a kind of image processing method, comprising:
In response to user's operation, it is switched to night scene mode；
Preview image is acquired under the night scene mode；
If being identified as non-night scene scene according to the preview image of acquisition, to the shooting image acquired under the night scene mode into
Row brightness adjustment, to reduce the brightness of the shooting image.
The image processing method of the embodiment of the present application, by being switched to night scene mode in response to user's operation, in night scene mould
Preview image is acquired under formula, if being identified as non-night scene scene according to the preview image of acquisition, the shooting to being acquired under night scene mode
Image carries out brightness adjustment, to reduce the brightness of shooting image.This method under non-night scene scene, uses night by user's operation
Scape type collection shoots image, and carries out brightness adjustment to shooting image, so that shooting image is in highlight regions and dark portion region
More details can be retained, to improve the imaging effect of shooting image.
The application second aspect embodiment proposes a kind of image processing apparatus, comprising:
Switching module, for being switched to night scene mode in response to user's operation；
Preview image, for acquiring preview image under the night scene mode；
Module is adjusted, if being identified as non-night scene scene for the preview image according to acquisition, to adopting under the night scene mode
The shooting image of collection carries out brightness adjustment, to reduce the brightness of the shooting image.
The image processing apparatus of the embodiment of the present application, by being switched to night scene mode in response to user's operation, in night scene mould
Preview image is acquired under formula, if being identified as non-night scene scene according to the preview image of acquisition, the shooting to being acquired under night scene mode
Image carries out brightness adjustment, to reduce the brightness of shooting image.This method under non-night scene scene, uses night by user's operation
Scape type collection shoots image, and carries out brightness adjustment to shooting image, so that shooting image is in highlight regions and dark portion region
More details can be retained, to improve the imaging effect of shooting image.
The application third aspect embodiment proposes a kind of electronic equipment, including memory, processor and is stored in storage
On device and the computer program that can run on a processor, when the processor executes described program, such as above-described embodiment is realized
Described in image processing method.
The application fourth aspect embodiment proposes a kind of computer readable storage medium, is stored thereon with computer journey
Sequence realizes such as above-mentioned image processing method as described in the examples when the program is executed by processor.
The additional aspect of the application and advantage will be set forth in part in the description, and will partially become from the following description
It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram of the first image processing method provided by the embodiments of the present application；
Fig. 2 is the flow diagram of second of image processing method provided by the embodiments of the present application；
Fig. 3 is the flow diagram of the third image processing method provided by the embodiments of the present application；
Fig. 4 is the flow diagram of the 4th kind of image processing method provided by the embodiments of the present application；
Fig. 5 is the flow diagram of the 5th kind of image processing method provided by the embodiments of the present application；
Fig. 6 is a kind of structural schematic diagram of image processing apparatus provided by the embodiments of the present application；
Fig. 7 is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application；
Fig. 8 is the schematic illustration of a kind of electronic equipment provided by the embodiments of the present application；
Fig. 9 is a kind of schematic illustration of image processing circuit provided by the embodiments of the present application.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the application, and should not be understood as the limitation to the application.
Below with reference to the accompanying drawings the image processing method, device, electronic equipment and storage medium of the embodiment of the present application are described.
Fig. 1 is a kind of flow diagram of image processing method provided by the embodiments of the present application.
The image processing method of the embodiment of the present application, is applied to electronic equipment, which can be mobile phone, plate electricity
Brain, personal digital assistant, wearable device etc. have the hardware device of various operating systems, imaging device.
As shown in Figure 1, the image processing method the following steps are included:
Step 101, in response to user's operation, it is switched to night scene mode.
In the embodiment of the present application, the camera of electronic equipment is arranged to night scene mode by operation by user, and electronic equipment is rung
The screening-mode of imaging device should be switched to night scene mode in the operation of user, to take the figure with night scenery
Picture.As a result, under daytime or bright field scape, image is acquired using night scene mode, so that image is in highlight regions and dark portion area
Domain can retain more details, to improve the imaging effect of image.
For example, imaging device is arranged to night scene mode in response to user's operation by electronic equipment under the bright field scape on daytime,
The strong light on daytime is changed into dim light by the optical principle in object, the scene light effects at night are manufactured, to be imaged.
Step 102, preview image is acquired in the night mode.
Wherein, preview image is the image taken pictures on interface for being shown in imaging device.
In the embodiment of the present application, after the imaging device of electronic equipment is switched to night scene mode, in imaging device in night scene
During acquiring image under mode, preview interface can be shown according to the shooting operation of user, in the preview of electronic equipment
Interface display preview image, and the preview image of imaging device acquisition is got, so that during Image Acquisition
User can clearly see the imaging effect of each frame image.
Step 103, if non-night scene scene is identified as according to the preview image of acquisition, to the shooting figure acquired under night scene mode
As carrying out brightness adjustment, to reduce the brightness of shooting image.
In the embodiment of the present application, the preview image that can be acquired in the night mode according to electronic equipment, to identify acquisition
The photographed scene of preview image is night scene scene, is also non-night scene scene.
As a kind of possible implementation, since the picture material of preview image under different photographed scenes is not identical, because
This, can identify the picture material of present filming scene preview image, to judge whether present filming scene belongs to non-night scene field
Scape.
As an example, the picture material of preview image includes each region middle ring of sunlight etc. or preview image
Border brightness value meets the Luminance Distribution characteristic of image under non-night scene environment, that is, can determine that present filming scene belongs to non-night scene field
Scape.
As alternatively possible implementation, current shooting field can be determined according to the sensitivity of acquisition preview image
Whether scape is non-night scene scene.Specifically, when the sensitivity for acquiring preview image is less than or equal to sensitivity threshold value, determination is worked as
Preceding photographed scene is non-night scene scene.Wherein, sensitivity threshold value is to determine according in preview image with the presence or absence of face.
As another possible implementation, after getting the preview image that electronic equipment acquires in the night mode,
Image characteristics extraction is carried out to preview image, the characteristics of image of extraction is inputted into identification model, the field exported according to identification model
Scape type determines that present filming scene belongs to non-night scene scene, wherein identification model has learnt to obtain characteristics of image and scene class
Corresponding relationship between type.
As another possible implementation, detection is used for the user's operation of scene switching, when detect switch to it is non-
When the user's operation of night scene scene, detection ambient brightness, as a kind of possible implementation, can be led to obtaining luminance information
It crosses the survey optical module built in electronic equipment to detect current ambient brightness, determines the luminance information of current environment.According to
Luminance information determines that present filming scene belongs to non-night scene scene, for example, brightness can be measured by brightness index Lix_index
Wherein, the value of luminance information is bigger, represents current scene brightness is lower, will acquire luminance information and preset brightness value for height
It compares, if the luminance information obtained is greater than predetermined luminance value, determines that present filming scene belongs to night scene scene.Further, if
The luminance information of acquisition is less than predetermined luminance value, it is determined that present filming scene belongs to non-night scene scene.
In the embodiment of the present application, according to the preview image of acquisition identify present filming scene be non-night scene scene after, to night
The shooting image acquired under scape mode carries out brightness adjustment, to reduce the brightness of shooting image.Similar night scene scene is obtained as a result,
The image of lower shooting realizes the shooting under daytime or light environment and obtains night scene image.
It, can be with when carrying out brightness adjustment to the shooting image acquired under night scene mode as a kind of possible implementation
According to whether including face in shooting image, shooting image is inputted into corresponding brightness adjustment model, after obtaining brightness reduction
Shoot image.
It should be noted that controlling electronic devices does not include the non-of face using night scene mode acquisition under bright field scape
Night scene image is trained brightness adjustment model respectively as training sample set with the non-night scene image for including face, into
And it obtains not including face brightness adjustment model corresponding with the shooting image comprising face.
The image processing method of the embodiment of the present application, by being switched to night scene mode in response to user's operation, in night scene mould
Preview image is acquired under formula, if being identified as non-night scene scene according to the preview image of acquisition, the shooting to being acquired under night scene mode
Image carries out brightness adjustment, to reduce the brightness of shooting image.This method under non-night scene scene, uses night by user's operation
Scape type collection shoots image, and carries out brightness adjustment to shooting image, so that shooting image is in highlight regions and dark portion region
More details can be retained, to improve the imaging effect of shooting image.
It, can be by under identification night scene mode as a kind of possible implementation on the basis of the embodiment described in Fig. 1
It whether include face in the preview image of acquisition, to determine the exposure compensation mode of acquisition multiframe original image, and then in determination
Exposure compensation mode under, acquire multiframe original image, synthesis obtain shooting image.The above process is carried out below with reference to Fig. 2
It is discussed in detail, Fig. 2 is the flow diagram of second of image processing method provided by the embodiments of the present application.
As shown in Fig. 2, after step 102 can with the following steps are included:
Step 201, identify in preview image whether include face.
In the embodiment of the present application, human face region identification is carried out to preview image, whether to identify in preview image comprising people
Face.
As a kind of possible implementation, face detection algorithm, such as the face detection based on the colour of skin can be used to calculate
Method or the face detection algorithm based on human face five-sense-organ feature etc. detect face area-of-interest, identify the face in preview image
Region, human face region, then show that face area-of-interest recognition of face frame does not show face sense if unidentified arrive if it exists
Interest region recognition of face frame.In turn, according to identification as a result, whether determine in preview image includes face.
Step 202, if comprising face, according to the first exposure compensation mode, exposure obtains multiframe original image.
Step 203, if not including face, according to the second exposure compensation mode, exposure obtains multiframe original image.
Wherein, the exposure compensating grade value upper limit of each frame original image is exposed less than second under the first exposure compensation mode
The exposure compensating grade value upper limit of each frame original image under compensation model.
It should be noted that when detecting in the preview image that electronic equipment currently acquires comprising face, electronic equipment
Survey optical module can carry out survey light based on human face region automatically, and determine that benchmark exposes according to the photometry result of human face region
Amount.However, the illuminance of human face region is usually lower in night scene mode, so as to cause determining benchmark light exposure, and do not wrap
The benchmark light exposure that when containing face determines if still acquiring excessive overexposure frame when comprising face, is easy to lead compared to higher
Human face region overexposure is caused, it is poor so as to cause the effect of target image.Therefore, for identical degree of jitter, electronic equipment is
In the preview image of acquisition comprising face compared with when not including face, corresponding exposure compensation mode needs to have lower
Exposure compensating range.
In a kind of possible way of realization of the embodiment of the present application, for identical degree of jitter, it can be set according to electronics
Whether comprising face in the standby preview image currently acquired, using different exposure compensating strategies.Therefore, for identical shake
Degree can correspond to multiple exposure compensation modes.For example, the degree of jitter of electronic equipment is " slight jitter ", it is corresponding pre-
If exposure compensation mode have first mode and second mode, wherein the corresponding each EV value of first mode be [0,0,0,0, -2, -
4, -6], the corresponding each EV value of second mode is [+1 ,+1 ,+1 ,+1,0, -3, -6].The current shake of electronic equipment is being determined
In degree, and the preview image that is currently acquired according to electronic equipment whether comprising after face, that is, can determine that with it is current
The preset exposure compensation mode that actual conditions are consistent.
As an example it is assumed that the current degree of jitter of electronic equipment is " slight jitter ", corresponding preset exposure compensating
Mode has the first exposure compensation mode and the second exposure compensation mode, wherein the corresponding each EV value of the first exposure compensation mode is
[0,0,0,0, -2, -4, -6], the corresponding each EV value of the second exposure compensation mode are [+1 ,+1 ,+1 ,+1,0, -3, -6], it is seen then that
The exposure compensating range of first exposure compensation mode is less than the exposure compensating range of second mode.If detecting, electronic equipment is current
In the image of acquisition include face, it is determined that preset exposure compensation mode be the first exposure compensation mode, i.e., each EV value be [0,
0,0,0,-2,-4,-6]；If detecting in image that electronic equipment currently acquires not comprising face, it is determined that preset exposure benefit
Repaying mode is the second exposure compensation mode, i.e., each EV value is [+1 ,+1 ,+1 ,+1,0, -3, -6].
It whether include face according to identifying in preview image in the embodiment of the present application, after determining exposure compensation mode, according to
Corresponding exposure compensation mode, control imaging device expose to obtain multiframe original image.
In the embodiment of the present application, original image refers to and is not appointed by what the imaging sensor of electronic equipment collected
The RAW image of where reason, wherein RAW image is exactly that the light signal captured is converted digital signal by imaging sensor
Original image.RAW image has recorded the collected raw information of digital camera sensor, while having recorded and being produced by camera shooting
Raw some metadata, such as the setting of sensitivity, shutter speed, f-number, white balance.
Step 204, according to multiframe original image, synthesis obtains shooting image.
As a kind of possible implementation, high dynamic synthesis can be carried out to the multiple image of acquisition, obtain shooting figure
Picture.Wherein, high dynamic synthesizes, i.e., is synthesized by the picture that same scene difference exposes, to obtain high dynamic range images
(High-Dynamic Range, abbreviation HDR).It should be noted that comparing common image, HDR image can be provided more
Dynamic range and image detail, according to the low dynamic range echograms of different time for exposure (Low-Dynamic Range, letter
Claim LDR), final HDR image is synthesized using the LDR image of corresponding best details of each time for exposure, it can be preferably anti-
Mirror the visual effect in true environment.
Specifically, it by extracting the image information in multiframe original image, and is overlapped for corresponding image information,
Shooting image is obtained with synthesis.
It should be noted that since multiframe original image is to shoot to obtain under different exposure parameters, multiframe is former
It include the image information of different brightness in beginning image.It may be overexposure in different original images for same scenery, it can
Can owe to expose, it is also possible to appropriate exposure.After synthesizing these original images, make to shoot as far as possible each in image
Scenery appropriate exposure is also more close with actual scene.
Image processing method in the embodiment of the present application, by whether including face in identification preview image, if including people
Face, according to the first exposure compensation mode, exposure obtains multiframe original image, if not including face, according to the second exposure compensating mould
Formula, exposure obtain multiframe original image, and in turn, according to multiframe original image, synthesis obtains shooting image.Pass through identification as a result,
Whether include face in preview image, adjusts the exposure compensation mode of each frame, shooting obtains multiframe original image, and then synthesizes
To shooting image, the dynamic range and overall brightness that image is shot under night scene mode are not only improved, but also effectively inhibit bat
The noise in image is taken the photograph, the quality of shooting image is improved, improves user experience.
On the basis of the embodiment described in Fig. 2, as a kind of possible implementation, according to determining exposure compensating mould
Formula can determine benchmark light exposure according to the luminance information of preview image, and according to setting when exposure obtains multiframe original image
Benchmark sensitivity, determine benchmark exposure time, and then according to exposure compensation mode, compensate to benchmark exposure time, really
Determine the corresponding compensation exposure time of each frame original image, corresponding original image is obtained with exposure.Below with reference to Fig. 3 to above-mentioned mistake
Journey describes in detail, and Fig. 3 is the flow diagram of the third image processing method provided by the embodiments of the present application.Such as Fig. 3 institute
Show, the image processing method specifically includes the following steps:
Step 301, according to the luminance information of preview image, benchmark light exposure is determined.
Wherein, light exposure refers to that the sensor devices in electronic equipment receive the number of light, light exposure in exposure time
It is related with aperture, exposure time and sensitivity.Wherein, aperture i.e. clear aperture, light passes through in the decision unit time
Quantity；Exposure time refers to time of the light by camera lens；Sensitivity, also known as ISO value are the spirits for measuring egative film for light
The index of quick degree, for indicating the film speed of photosensitive element, the more high photosensitive energy for just illustrating the sensitive component of ISO numerical value
Power is stronger.
Specifically, the preview image that present filming scene is obtained by imaging sensor, further passes through sensor devices
Measurement obtains the environmental light brightness in each region of preview image, to determine benchmark light exposure according to the luminance information of preview image.Its
In, in the case where aperture is fixed, benchmark light exposure can specifically include benchmark exposure time and benchmark sensitivity.
In the embodiment of the present application, benchmark light exposure refers to the current shooting field by survey to preview image light acquisition
After the luminance information of scape, the light exposure adaptable with the luminance information of current environment determined, the value of benchmark light exposure can be with
It is the product between benchmark sensitivity and benchmark exposure time.
Step 302, according to the benchmark sensitivity of setting, benchmark exposure time needed for reaching benchmark light exposure is determined.
In the embodiment of the present application, benchmark sensitivity can be the float degree according to preview image, set and current
The adaptable sensitivity of degree of jitter；It is also possible to the degree of jitter current according to the imaging sensor of acquisition preview image,
The setting benchmark sensitivity adaptable with current degree of jitter, it is not limited here.Wherein, the value range of benchmark sensitivity
It can be 100ISO to 200ISO.
For example, however, it is determined that the degree of jitter for acquiring the imaging sensor of preview image is " non-jitter ", then can incite somebody to action
Benchmark sensitivity is determined as lesser value, to obtain higher-quality image as far as possible, for example determines that benchmark sensitivity is 100ISO；
If it is determined that the degree of jitter of the imaging sensor of acquisition preview image is " slight jitter ", then benchmark sensitivity can be determined as
Biggish value to reduce shooting duration of video, for example determines that benchmark sensitivity is 120ISO；If it is determined that the image of acquisition preview image passes
The degree of jitter of sensor is " small shake ", then can further increase benchmark sensitivity, to reduce shooting duration of video, for example determines base
Quasi- sensitivity is 180ISO；If it is determined that the degree of jitter of the imaging sensor of acquisition preview image is " big shake ", then it can be true
Degree of jitter before settled is excessive, can further increase benchmark sensitivity at this time, to reduce shooting duration of video, for example determines benchmark
Sensitivity is 200ISO.
It should be noted that the example above is exemplary only, the limitation to the application cannot be considered as.In actual use,
When acquiring the variation of the degree of jitter of imaging sensor of preview image, it can change benchmark sensitivity, it is optimal to obtain
Scheme.Wherein, the degree of jitter benchmark sensitivity corresponding with every frame image to be collected of the imaging sensor of preview image is acquired
Mapping relations, can preset according to actual needs.
It should be noted that according to the degree of jitter of imaging device, when adjusting benchmark sensitivity corresponding with degree of jitter,
If current base sensitivity and degree of jitter are just adapted, adjusting the result is that benchmark sensitivity remains unchanged.It is such
Situation also belongs in the embodiment of the present application the scope of " adjustment ".
In addition, under a kind of possible application scenarios, the camera module of imaging device be made of a plurality of lenses, thus
Different camera lenses can also correspond to different sensitivity under same shooting environmental, and the benchmark sensitivity adjusted in this step should
It is for the shooting process executed for a camera lens in a plurality of lenses, in this shooting process, acquisition multiple image is equal
Using same benchmark sensitivity.
In addition, being not limited to adjust benchmark sensitivity according only to the degree of jitter of imaging device, may be used also in the embodiment of the present application
To determine benchmark sensitivity according to the multiple parameters such as the luminance information of degree of jitter and photographed scene are comprehensive, do not limit herein
It is fixed.
In the embodiment of the present application, the shake of the imaging sensor of the float degree and acquisition preview image of preview image
Degree correlation sets the realization process of benchmark sensitivity referring to above-mentioned according to the float degree of preview image
Process, details are not described herein.
In the embodiment of the present application, the value of benchmark light exposure can be multiplying between benchmark sensitivity and benchmark exposure time
Product.Therefore, in the brightness according to photographed scene, benchmark light exposure is determined, and after determining benchmark sensitivity according to degree of jitter,
Benchmark exposure time needed for reaching benchmark light exposure can be determined according to benchmark light exposure and benchmark sensitivity.
Step 303, according to the corresponding exposure compensating grade of each frame original image, benchmark exposure time is compensated, is obtained
To the exposure time of each frame original image.
Wherein, exposure compensating is that dark image frame is improved or added by aperture and shutter speed.I.e. in aperture priority
Under mode, if increasing exposure compensating, realized indeed through shutter speed is reduced；Conversely, being then fast by improving
Door speed is realized.Under shutter priority mode, if increasing exposure compensating, realized indeed through aperture is increased
(until reaching the attainable maximum ring of camera lens).
In the embodiment of the present application, it is corresponding can be set according to the brightness of image in preview screen for each frame original image of acquisition
Exposure compensating grade, and then benchmark exposure time is compensated according to the exposure compensating grade of setting, it is original to obtain each frame
The exposure time of image.
For example, if the light and shade ratio of image is 1:1 in preview screen, compensation need not be exposed；If bright
Dark ratio is 1:2, then carries out -0.3 grade of exposure compensating；If light and shade ratio is 2:1 ,+0.3 grade of exposure compensating is carried out；If
Light and shade ratio is 1:3, then carries out -0.3 grade of exposure compensating；If light and shade ratio is 2:1, this does+0.3 grade of exposure compensating；Such as
Fruit light and shade ratio is 1:2, then carries out -0.3 grade of exposure compensating；If light and shade ratio is 2:1, this does+0.3 grade of exposure compensating；
In short, light and shade ratio is bigger, then exposure compensating numerical value is bigger, certainly, no more than camera exposure compensation range.
Step 304, according to the exposure time of benchmark sensitivity and each frame original image, exposure obtains corresponding original image.
In the embodiment of the present application, the benchmark sensitivity for acquiring each frame original image is determined, and according to each frame original image
Corresponding exposure compensating grade, compensates benchmark exposure time, after obtaining the exposure time of each frame original image, control
Imaging device is exposed to obtain corresponding original image.
The image processing method of the embodiment of the present application determines benchmark light exposure by the luminance information according to preview image,
According to the benchmark sensitivity of setting, benchmark exposure time needed for reaching benchmark light exposure is determined, according to each frame original image pair
The exposure compensating grade answered, compensates benchmark exposure time, the exposure time of each frame original image is obtained, according to benchmark sense
The exposure time of luminosity and each frame original image, exposure obtain corresponding original image.It not only improves and is clapped under night scene mode as a result,
The dynamic range and overall brightness for taking the photograph image, effectively inhibit the noise in image, and inhibit ghost caused by hand-held shake
Shadow improves the quality of shooting image, improves user experience.
On the basis of the embodiment described in Fig. 3, under another possible scene, according to the corresponding exposure of each frame original image
Light compensates grade, compensates to benchmark exposure time, after obtaining the exposure time of each frame original image, by each frame original image
Exposure time be compared with the duration lower limit of setting, with according to exposure time lower limit to be less than duration lower limit exposure time
It is adjusted.It describes in detail below with reference to Fig. 4 to the above process, Fig. 4 is the 4th kind of night scene provided by the embodiments of the present application
The flow diagram of image processing method, as shown in figure 4, further comprising the steps of after step 303:
Step 401, by the exposure time of each frame original image compared with the duration lower limit of setting.
As a kind of possible situation, what exposure time lower limit can be determined according to the degree of jitter of electronic equipment.Specifically
Ground can acquire displacement information according to the displacement sensor being arranged in electronic equipment to determine degree of jitter, in turn, according to
The displacement information of collected electronic equipment determines the degree of jitter of electronic equipment.Further, according to determining electronic equipment
Degree of jitter be compared with preset dithering threshold, to determine exposure time lower limit.
In the embodiment of the present application, in the exposure compensating grade according to setting, benchmark exposure time is compensated, is obtained each
After the exposure time of frame original image, by the exposure time of each frame original image compared with the duration lower limit of setting, with according to when
Long lower limit is adjusted the exposure time for being less than duration lower limit.Wherein, duration lower limit is greater than or equal to 10ms.
Step 402, exposure time increases to exposure time under duration less than the original image of duration lower limit if it exists
Limit.
In the embodiment of the present application, if the corresponding exposure time of original image to be collected is less than the image of duration lower limit,
It may cause that the noise in image is excessive to be difficult to eliminate.Therefore, when the corresponding exposure time of a certain frame original image to be collected is small
When duration lower limit, the corresponding exposure time of frame original image to be collected is increased to duration lower limit.
Step 403, determine exposure time increase after with the ratio before increase.
For example, preset duration lower limit is equal to 10ms, and the exposure time before exposure time increases is 8ms, will be original
The corresponding exposure time of image is increased to preset duration lower limit 10ms, then can determine that the corresponding exposure time of original image increases
Ratio after big and before increasing is 10/8.
Step 404, remaining each frame original image of duration lower limit is not less than to exposure time, according to ratio, updates and corresponds to
Exposure time or benchmark sensitivity.
Specifically, remaining each frame original image of duration lower limit is not less than for exposure time, is being determined less than under duration
After the exposure time increase of the original image of limit and after the ratio before increase, before the ratio and remaining each frame original image are updated
Sensitivity or exposure time product, as the updated sensitivity of remaining each frame original image or exposure time.
As an example, if the original image to be collected that exposure time is not less than duration lower limit is 4 frames, according to electronics
The degree of jitter of equipment determines that the preset sensitivity value of each frame is 100ISO, and the exposure time of 4 frames image to be collected is distinguished
For 100ms, 200ms, 400ms and 800ms.In view of the updated exposure time of original image for being less than duration lower limit and before updating
Exposure time between ratio be 10ms/1.5ms, i.e., 20/3, when determining the exposure of this 4 frame original image to be collected as a result,
Long 20/3 times for expanding as original 100ms, 200ms, 400ms and 800ms.
It is similar to the update mode of sensitivity and the update mode of exposure time, it is only necessary to replace with exposure time photosensitive
Degree.But should be noted that only can be according to the aforementioned updated exposure time of original image less than duration lower limit and more
The ratio between exposure time before new, updates one in exposure time and sensitivity, if desired to exposure time and photosensitive
It spends while updating, then after needing to be allocated the ratio according to weight, be updated.Such as: it is each to exposure time and sensitivity
Half weight is accounted for, if between the aforementioned exposure time less than before the updated exposure time of original image of duration lower limit and update
Ratio be R, exposure time is expanded as into original R/2 times, sensitivity is expanded as into original R/2 times.
In the embodiment of the present application, by the exposure time of each frame original image compared with the duration lower limit of setting, expose if it exists
The light time long original image for being less than duration lower limit, increases to duration lower limit for exposure time, determine after exposure time increases with increasing
Ratio before big, remaining each frame original image to exposure time not less than duration lower limit update corresponding exposure according to ratio
Duration or benchmark are photosensitive.Thus, it is determined that acquire the exposure time of original image, and then each frame is updated according to exposure time lower limit
The benchmark sensitivity and exposure time of original image, finally according to the exposure time and sensitivity of updated each frame image, into
Row spectrum assignment, and then be imaged, the dynamic range and overall brightness that image is shot under night scene mode are not only improved, but also effectively
The noise in shooting image is inhibited, the quality of night scene shooting image is improved, improves user experience.
On the basis of the embodiment described in Fig. 2, under a kind of possible scene, exposing can in the multiframe original image of acquisition
To include the first image of the identical light exposure of at least two frames, and at least second figure of frame including light exposure lower than the first image
Picture, and then according at least two the first images of frame and at least second image of frame of acquisition, synthesis obtains high dynamic range images.
It describes in detail below with reference to Fig. 5 to the above process, Fig. 5 is the 5th kind of image processing method provided by the embodiments of the present application
Flow diagram.As shown in figure 5, this method specifically includes the following steps:
Step 501, it according at least two the first images of frame, generates for multiframe noise reduction to obtain the first of synthesis noise-reduced image
Task.
Wherein, multiframe noise reduction is exactly to acquire multiple image by imaging sensor, is found under different frame numbers different
Pixel with noise property, by obtaining a more clean, pure image after weighting synthesis.
In the embodiment of the present application, the noise in image in order to reduce night scene mode acquisition can be according at least two frames the
One image is generated for multiframe noise reduction to obtain the first task of synthesis noise-reduced image, and then the processor for passing through electronic equipment
First task is executed, multiframe noise reduction is carried out at least two the first images of frame and obtains synthesis noise-reduced image.
Step 502, it according to the target image chosen at least two the first images of frame and at least second image of frame, generates
For determining the second task of high dynamic synthetic weight information.
It, can be according to the clarity of definition judgment at least two the first images of frame of image, in turn in the embodiment of the present application
At least two the first images of frame are screened, choose the highest image of clarity as target image.In turn, according to target image
And at least second image of frame, generate the second task for determining high dynamic synthetic weight information.
Step 503, first task is executed parallel and executes the second task.
It is raw according at least two the first images of frame during using night scene mode shooting image in the embodiment of the present application
At the first task for obtaining synthesizing noise-reduced image for multiframe noise reduction, and according to the mesh chosen at least two the first images of frame
Logo image and at least second image of frame, generate the second task for determining high dynamic synthetic weight information.It can be by
One task and the second task distribute to the central processing unit of electronic equipment (Central Processing Unit/Processor,
Abbreviation CPU), graphics processor (Graphics Processing Unit, abbreviation GPU) and digital signal processor
Different processor in (Digital Signal Processing, abbreviation DSP) executes parallel, to improve the processing speed of image
Degree.
For example, first task can be distributed to the CPU of electronic equipment, first task is executed by CPU, to realize
According at least two the first images of frame, multiframe noise reduction is carried out to obtain the purpose of synthesis noise-reduced image.Specifically, electronic equipment passes through
Imaging sensor acquires at least two the first images of frame, makes an uproar to multiple frame numbers at least two field pictures when shooting image
Point quantity and position are calculated and are screened, and will have the frame number of the place of noise not noise to replace position, by adding repeatedly
Power, replacement, just obtain a very clean synthesis noise-reduced image.First task is executed by CPU as a result, it can will be in image
Dark portion treatment of details it is very soft, realize reduce noise while more retain image detail.
Meanwhile can distribute the second task to the DSP of electronic equipment, the second task is executed by DSP, to realize basis
The target image and at least second image of frame chosen at least two the first images of frame, determine high dynamic synthetic weight information.
Specifically, high dynamic synthesis is carried out at least second image of frame and target image, is obtained with determination in synthesis
Weight shared by different zones in image, at least second image of frame and target image.Since target image is at least two frames
The highest image of clarity in one image, remains the information of image to greatest extent, therefore, can be by the weight of target image
Weight as synthesis noise-reduced image.In turn, according to the weight of synthesis noise-reduced image, and the power of at least second image of frame
Weight generates high dynamic synthetic weight information.
Step 504, the high dynamic synthetic weight information determined according to the second task synthesizes at least second image of frame and conjunction
At noise-reduced image, to obtain high dynamic range images.
In the embodiment of the present application, according to the high dynamic synthetic weight information that the second task determines, an at least frame second is synthesized
Image and synthesis noise-reduced image, to obtain high dynamic range images.Such as: if synthesis noise-reduced image is using several frame EV0's
Original image multiframe noise reduction obtains, and there may be overexposures for highlight regions for the high dynamic range images, for middle low-light level
Region may be appropriate exposure, and the EV value of at least second image of frame is usually negative, thus for height in second image
Bright area may be appropriate exposure, and middle low brightness area may be under-exposure.By the way that the same area will be corresponded in different images
Part is synthesized according to weight information, is enabled to image that can be realized appropriate exposure in each region, is improved into image quality
Amount.
It should be noted that due to having significantly reduced the noise of image in synthesis noise-reduced image, to greatest extent
Retain the information of image, therefore, carries out the high dynamic range images after high dynamic synthesizes, obtained at least second image of frame
In include more image informations, it is also more close with actual scene.
The image processing method of the embodiment of the present application, by generating and being used for multiframe noise reduction according at least two the first images of frame
To obtain the first task of synthesis noise-reduced image, according to the target image and an at least frame chosen at least two the first images of frame
Second image generates the second task for determining high dynamic synthetic weight information, parallel to execute first task and execution second
Task, according to the high dynamic synthetic weight information that the second task determines, synthesis at least second image of frame and synthesis noise-reduced image,
To obtain high dynamic range images.As a result, by executing first task parallel and executing the second task, so that synthesis noise-reduced image
The processing speed of image is improved with generation high dynamic synthetic weight information parallel processing so as to shorten the time of image procossing
Degree, and image taking speed is improved, improve the experience of taking pictures of user.
In order to realize above-described embodiment, the application also proposes a kind of image processing apparatus.
Fig. 6 is a kind of structural schematic diagram of image processing apparatus provided by the embodiments of the present application.
As shown in fig. 6, the image processing apparatus 100 includes: switching module 110, preview image 120 and adjustment module
130。
Switching module 110, for being switched to night scene mode in response to user's operation.
Preview image 120, for acquiring preview image in the night mode.
Module 130 is adjusted, if being identified as non-night scene scene for the preview image according to acquisition, to acquiring under night scene mode
Shooting image carry out brightness adjustment, with reduce shooting image brightness.
As a kind of possible implementation, the image processing apparatus 100, further includes:
Identification module, for identification picture material of preview image.
First determining module, for being determined as non-night scene scene according to picture material.
As alternatively possible implementation, the image processing apparatus 100, further includes:
Second determining module, for determining the sensitivity of preview image.
Third determining module is determined as non-night scene if the sensitivity for preview image is less than or equal to sensitivity threshold value
Scene.
As alternatively possible implementation, sensitivity threshold value is determining according to whether there is face in preview image
's.
As alternatively possible implementation, the image processing apparatus 100, further includes:
Whether the second identification module includes for identification face in preview image.
Processing module, if, according to the first exposure compensation mode, exposure obtains multiframe original image for comprising face；If
Not comprising face, according to the second exposure compensation mode, exposure obtains multiframe original image；Wherein, under the first exposure compensation mode
Exposure of the exposure compensating grade value upper limit of each frame original image less than frame original image each under the second exposure compensation mode is mended
Repay the grade value upper limit.
Synthesis module, for according to multiframe original image, synthesis to obtain shooting image.
As alternatively possible implementation, processing module can also include:
First determination unit determines benchmark light exposure for the luminance information according to preview image.
Second determination unit determines that benchmark needed for reaching benchmark light exposure exposes for the benchmark sensitivity according to setting
Light time is long.
Compensating unit, for being mended to benchmark exposure time according to the corresponding exposure compensating grade of each frame original image
It repays, obtains the exposure time of each frame original image.
Exposing unit, for the exposure time according to benchmark sensitivity and each frame original image, exposure obtains corresponding original
Image.
As alternatively possible implementation, benchmark sensitivity is determined according to degree of jitter.
It include the first figure of the identical light exposure of at least two frames as alternatively possible implementation, in multiframe original image
Picture, and at least second image of frame including light exposure lower than the first image；Synthesis module is specifically used for:
According at least two the first images of frame, generate for multiframe noise reduction to obtain the first task of synthesis noise-reduced image；Root
According to the target image and at least second image of frame chosen at least two the first images of frame, generate for determining that high dynamic synthesizes
Second task of weight information；It is parallel to execute first task and execute the second task；It is closed according to the high dynamic that the second task determines
At weight information, at least second image of frame and synthesis noise-reduced image are synthesized, to obtain high dynamic range images.
As alternatively possible implementation, module 130 is adjusted, is specifically used for:
According to whether including face in the shooting image, the shooting image is inputted into corresponding brightness adjustment model,
Shooting image after obtaining brightness reduction.
It should be noted that the aforementioned image for being also applied for the embodiment to the explanation of image processing method embodiment
Processing unit, details are not described herein again.
The image processing apparatus of the embodiment of the present application, by being switched to night scene mode in response to user's operation, in night scene mould
Preview image is acquired under formula, if being identified as non-night scene scene according to the preview image of acquisition, the shooting to being acquired under night scene mode
Image carries out brightness adjustment, to reduce the brightness of shooting image.This method under non-night scene scene, uses night by user's operation
Scape type collection shoots image, and carries out brightness adjustment to shooting image, so that shooting image is in highlight regions and dark portion region
More details can be retained, to improve the imaging effect of shooting image.
In order to realize above-described embodiment, the application also proposes a kind of electronic equipment, including memory, processor and is stored in
On memory and the computer program that can run on a processor, when the processor executes described program, such as above-mentioned reality is realized
Apply image processing method described in example.
As an example, the application also proposes a kind of electronic equipment 200, referring to Fig. 7, comprising: imaging sensor 210,
Processor 220, memory 230 and it is stored in the computer program that can be run on memory 230 and on processor 220, it is described
Imaging sensor 210 is electrically connected with the processor 220, when the processor 220 executes described program, realizes such as above-mentioned implementation
Image processing method described in example.
As a kind of possible situation, processor 220 may include: image signal process (Image Signal
Processor, abbreviation ISP) processor, graphics processor (the Graphics Processing that is connect with ISP processor
Unit, abbreviation GPU).
It as an example, is the embodiment of the present application in Fig. 8 referring to Fig. 8, on the basis of the electronic equipment described in Fig. 7
The principle exemplary diagram of a kind of electronic equipment of offer.The memory 230 of electronic equipment 200 includes nonvolatile memory 80, interior
Memory 82 and processor 220.Computer-readable instruction is stored in memory 230.Computer-readable instruction, which is stored by, to be held
When row, so that processor 230 executes the image processing method of any of the above-described embodiment.
As shown in figure 8, the electronic equipment 200 includes the processor 220 connected by system bus 81, non-volatile memories
Device 80, built-in storage 82, display screen 83 and input unit 84.Wherein, the nonvolatile memory 80 of electronic equipment 200 is stored with
Operating system and computer-readable instruction.The computer-readable instruction can be executed by processor 220, to realize the application embodiment party
The image processing method of formula.The processor 220 supports the operation of entire electronic equipment 200 for providing calculating and control ability.
The built-in storage 82 of electronic equipment 200 provides environment for the operation of the computer-readable instruction in nonvolatile memory 80.Electricity
The display screen 83 of sub- equipment 200 can be liquid crystal display or electric ink display screen etc., and input unit 84 can be display
The touch layer that covers on screen 83, is also possible to key, trace ball or the Trackpad being arranged on 200 shell of electronic equipment, can also be with
It is external keyboard, Trackpad or mouse etc..The electronic equipment 200 can be mobile phone, tablet computer, laptop, individual
Digital assistants or wearable device (such as Intelligent bracelet, smartwatch, intelligent helmet, intelligent glasses) etc..Those skilled in the art
Member is it is appreciated that structure shown in Fig. 8, and only the schematic diagram of part-structure relevant to application scheme, is not constituted
Restriction to the electronic equipment 200 that application scheme is applied thereon, specific electronic equipment 200 may include than institute in figure
Show more or fewer components, perhaps combines certain components or with different component layouts.
In order to realize above-described embodiment, the application also proposes a kind of image processing circuit, referring to Fig. 9, Fig. 9 is the application
The schematic illustration for a kind of image processing circuit that embodiment provides, as shown in figure 9, image processing circuit 90 includes picture signal
Handle ISP processor 91 (ISP processor 91 is used as processor 220) and graphics processor GPU.
The image data that camera 93 captures is handled by ISP processor 91 first, and ISP processor 91 carries out image data
It analyzes to capture the image statistics for the one or more control parameters that can be used for determining camera 93.Camera module 310 can
Including one or more lens 932 and imaging sensor 934.Imaging sensor 934 may include colour filter array (such as Bayer
Filter), imaging sensor 934 can obtain the luminous intensity and wavelength information that each imaging pixel captures, and provide and can be handled by ISP
One group of raw image data of the processing of device 91.Sensor 94 (such as gyroscope) can be based on 94 interface type of sensor the figure of acquisition
As the parameter (such as stabilization parameter) of processing is supplied to ISP processor 91.94 interface of sensor can be SMIA (Standard
Mobile Imaging Architecture, Standard Mobile Imager framework) interface, other serial or parallel camera interfaces or
The combination of above-mentioned interface.
In addition, raw image data can also be sent to sensor 94 by imaging sensor 934, sensor 94 can be based on sensing
Raw image data is supplied to ISP processor 91 or sensor 94 and arrives raw image data storage by 94 interface type of device
In video memory 95.
ISP processor 91 handles raw image data pixel by pixel in various formats.For example, each image pixel can have
There is the bit depth of 8,10,12 or 14 bits, ISP processor 91 can carry out one or more image procossing behaviour to raw image data
Make, statistical information of the collection about image data.Wherein, image processing operations can by identical or different bit depth precision into
Row.
ISP processor 91 can also receive image data from video memory 95.For example, 94 interface of sensor is by original image
Data are sent to video memory 95, and the raw image data in video memory 95 is available to ISP processor 91 for place
Reason.Video memory 95 can be independent in memory 330, a part of memory 330, storage equipment or electronic equipment
Private memory, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the original from 934 interface of imaging sensor or from 94 interface of sensor or from video memory 95
When beginning image data, ISP processor 91 can carry out one or more image processing operations, such as time-domain filtering.Treated image
Data can be transmitted to video memory 95, to carry out other processing before shown.ISP processor 91 is stored from image
Device 95 receives processing data, and carries out at the image data in original domain and in RGB and YCbCr color space to processing data
Reason.Treated that image data may be output to display 97 (display 97 may include display screen 83) for ISP processor 91, for
Family is watched and/or is further processed by graphics engine or GPU.It is stored in addition, the output of ISP processor 91 also can be transmitted to image
Device 95, and display 97 can read image data from video memory 95.In one embodiment, video memory 95 can be matched
It is set to the one or more frame buffers of realization.In addition, the output of ISP processor 91 can be transmitted to encoder/decoder 96, so as to
Encoding/decoding image data.The image data of coding can be saved, and decompress before being shown in 97 equipment of display.
Encoder/decoder 96 can be realized by CPU or GPU or coprocessor.
The statistical data that ISP processor 91 determines, which can be transmitted, gives control logic device Unit 92.For example, statistical data may include
The imaging sensors such as automatic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, 932 shadow correction of lens
934 statistical informations.Control logic device 92 may include the processing element and/or microcontroller for executing one or more routines (such as firmware)
Device, one or more routines can statistical data based on the received, determine the control parameter of camera 93 and the control of ISP processor 91
Parameter processed.For example, the control parameter of camera 93 may include 94 control parameter of sensor (such as the integral of gain, spectrum assignment
Time, stabilization parameter etc.), camera flash control parameter, 932 control parameter of lens (such as focus or zoom focal length) or
The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing)
932 shadow correction parameter of gain level and color correction matrix and lens.
In order to realize above-described embodiment, the application also proposes a kind of computer readable storage medium, is stored thereon with calculating
Machine program realizes such as above-mentioned image processing method as described in the examples when the program is executed by processor.
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application
Type.
Claims (12)
1. a kind of image processing method, which is characterized in that the described method comprises the following steps:
In response to user's operation, it is switched to night scene mode；
Preview image is acquired under the night scene mode；
If being identified as non-night scene scene according to the preview image of acquisition, the shooting image acquired under the night scene mode is carried out bright
Degree adjustment, to reduce the brightness of the shooting image.
2. image processing method according to claim 1, which is characterized in that if described identify according to the preview image of acquisition
For non-night scene scene, before carrying out brightness adjustment to the shooting image acquired under the night scene mode, further includes:
Identify the picture material of the preview image；
According to described image content, it is determined as non-night scene scene.
3. image processing method according to claim 1, which is characterized in that if described identify according to the preview image of acquisition
For non-night scene scene, before carrying out brightness adjustment to the shooting image acquired under the night scene mode, further includes:
Determine the sensitivity of the preview image；
If the sensitivity of the preview image is less than or equal to sensitivity threshold value, it is determined as non-night scene scene.
4. image pickup method according to claim 3, which is characterized in that the sensitivity threshold value is according to the preview graph
It is determined as in the presence or absence of face.
5. image processing method according to claim 1-4, which is characterized in that described under the night scene mode
After acquisition preview image, further includes:
It whether identifies in the preview image comprising face；
If, according to the first exposure compensation mode, exposure obtains multiframe original image comprising face；
If not including face, according to the second exposure compensation mode, exposure obtains multiframe original image；Wherein, first exposure
It is former to be less than each frame under second exposure compensation mode for the exposure compensating grade value upper limit of each frame original image under compensation model
The exposure compensating grade value upper limit of beginning image；
According to multiframe original image, synthesis obtains the shooting image.
6. image processing method according to claim 5, which is characterized in that the exposure obtains multiframe original image, packet
It includes:
According to the luminance information of the preview image, benchmark light exposure is determined；
According to the benchmark sensitivity of setting, benchmark exposure time needed for reaching the benchmark light exposure is determined；
According to the corresponding exposure compensating grade of each frame original image, the benchmark exposure time is compensated, it is former to obtain each frame
The exposure time of beginning image；
According to the exposure time of the benchmark sensitivity and each frame original image, exposure obtains corresponding original image.
7. image processing method according to claim 6, which is characterized in that the benchmark sensitivity is according to shake journey
Degree determination.
8. image processing method according to claim 6, which is characterized in that include at least two in the multiframe original image
First image of the identical light exposure of frame, and at least second image of frame including light exposure lower than the first image；
It is described according to multiframe original image, synthesis obtains the shooting image, comprising:
According at least two first images of frame, generate for multiframe noise reduction to obtain the first task of synthesis noise-reduced image；
It is used for according to the target image and at least second image of frame, the generation chosen at least two first images of frame
Determine the second task of high dynamic synthetic weight information；
The first task is executed parallel and executes second task；
According to the high dynamic synthetic weight information that second task determines, synthesis at least second image of frame and the institute
Synthesis noise-reduced image is stated, to obtain high dynamic range images.
9. image processing method according to claim 1-4, which is characterized in that described under the night scene mode
The shooting image of acquisition carries out brightness adjustment, to reduce the brightness of the shooting image, comprising:
According to whether including face in the shooting image, the shooting image is inputted into corresponding brightness adjustment model, is obtained
Shooting image after brightness reduction.
10. a kind of image processing apparatus, which is characterized in that described device includes:
Switching module, for being switched to night scene mode in response to user's operation；
Preview image, for acquiring preview image under the night scene mode；
Module is adjusted, if being identified as non-night scene scene for the preview image according to acquisition, to what is acquired under the night scene mode
It shoots image and carries out brightness adjustment, to reduce the brightness of the shooting image.
11. a kind of electronic equipment, which is characterized in that on a memory and can be in processor including memory, processor and storage
The computer program of upper operation when the processor executes described program, realizes the image as described in any in claim 1-9
Processing method.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The image processing method as described in any in claim 1-9 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910509592.2A CN110166711B (en) | 2019-06-13 | 2019-06-13 | Image processing method, image processing apparatus, electronic device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910509592.2A CN110166711B (en) | 2019-06-13 | 2019-06-13 | Image processing method, image processing apparatus, electronic device, and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110166711A true CN110166711A (en) | 2019-08-23 |
| CN110166711B CN110166711B (en) | 2021-07-13 |
Family
ID=67628853
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910509592.2A Active CN110166711B (en) | 2019-06-13 | 2019-06-13 | Image processing method, image processing apparatus, electronic device, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110166711B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110958401A (en) * | 2019-12-16 | 2020-04-03 | 北京迈格威科技有限公司 | Super night scene image color correction method and device and electronic equipment |
| CN112532855A (en) * | 2019-09-17 | 2021-03-19 | 华为技术有限公司 | Image processing method and device |
| WO2021082580A1 (en) * | 2019-10-31 | 2021-05-06 | 北京迈格威科技有限公司 | Night scene high dynamic range image generation method, device, and electronic apparatus |
| CN116055855A (en) * | 2022-07-28 | 2023-05-02 | 荣耀终端有限公司 | Image processing method and related device |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101046567A (en) * | 2004-02-13 | 2007-10-03 | 钰瀚科技股份有限公司 | LCD brightness compensating method and device |
| US20080199079A1 (en) * | 2007-02-19 | 2008-08-21 | Seiko Epson Corporation | Information Processing Method, Information Processing Apparatus, and Storage Medium Having Program Stored Thereon |
| CN101277394A (en) * | 2007-02-19 | 2008-10-01 | 精工爱普生株式会社 | Information processing method, information processing apparatus and program |
| CN101778220A (en) * | 2010-03-01 | 2010-07-14 | 华为终端有限公司 | Method for automatically switching over night scene mode and image pickup device |
| JP2012119858A (en) * | 2010-11-30 | 2012-06-21 | Aof Imaging Technology Ltd | Imaging device, imaging method, and program |
| CN107220956A (en) * | 2017-04-18 | 2017-09-29 | 天津大学 | A kind of HDR image fusion method of the LDR image based on several with different exposures |
| CN107517351A (en) * | 2017-10-18 | 2017-12-26 | 广东小天才科技有限公司 | Photographing mode switching method and device |
| CN108900782A (en) * | 2018-08-22 | 2018-11-27 | Oppo广东移动通信有限公司 | Exposal control method, device and electronic equipment |
| CN108989700A (en) * | 2018-08-13 | 2018-12-11 | Oppo广东移动通信有限公司 | Image formation control method, device, electronic equipment and computer readable storage medium |
| CN109005366A (en) * | 2018-08-22 | 2018-12-14 | Oppo广东移动通信有限公司 | Camera module night scene image pickup processing method, device, electronic equipment and storage medium |
-
2019
- 2019-06-13 CN CN201910509592.2A patent/CN110166711B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101046567A (en) * | 2004-02-13 | 2007-10-03 | 钰瀚科技股份有限公司 | LCD brightness compensating method and device |
| US20080199079A1 (en) * | 2007-02-19 | 2008-08-21 | Seiko Epson Corporation | Information Processing Method, Information Processing Apparatus, and Storage Medium Having Program Stored Thereon |
| CN101277394A (en) * | 2007-02-19 | 2008-10-01 | 精工爱普生株式会社 | Information processing method, information processing apparatus and program |
| CN101778220A (en) * | 2010-03-01 | 2010-07-14 | 华为终端有限公司 | Method for automatically switching over night scene mode and image pickup device |
| JP2012119858A (en) * | 2010-11-30 | 2012-06-21 | Aof Imaging Technology Ltd | Imaging device, imaging method, and program |
| CN107220956A (en) * | 2017-04-18 | 2017-09-29 | 天津大学 | A kind of HDR image fusion method of the LDR image based on several with different exposures |
| CN107517351A (en) * | 2017-10-18 | 2017-12-26 | 广东小天才科技有限公司 | Photographing mode switching method and device |
| CN108989700A (en) * | 2018-08-13 | 2018-12-11 | Oppo广东移动通信有限公司 | Image formation control method, device, electronic equipment and computer readable storage medium |
| CN108900782A (en) * | 2018-08-22 | 2018-11-27 | Oppo广东移动通信有限公司 | Exposal control method, device and electronic equipment |
| CN109005366A (en) * | 2018-08-22 | 2018-12-14 | Oppo广东移动通信有限公司 | Camera module night scene image pickup processing method, device, electronic equipment and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112532855A (en) * | 2019-09-17 | 2021-03-19 | 华为技术有限公司 | Image processing method and device |
| CN112532855B (en) * | 2019-09-17 | 2022-04-29 | 华为技术有限公司 | Image processing method and device |
| WO2021082580A1 (en) * | 2019-10-31 | 2021-05-06 | 北京迈格威科技有限公司 | Night scene high dynamic range image generation method, device, and electronic apparatus |
| CN110958401A (en) * | 2019-12-16 | 2020-04-03 | 北京迈格威科技有限公司 | Super night scene image color correction method and device and electronic equipment |
| CN110958401B (en) * | 2019-12-16 | 2022-08-23 | 北京迈格威科技有限公司 | Super night scene image color correction method and device and electronic equipment |
| CN116055855A (en) * | 2022-07-28 | 2023-05-02 | 荣耀终端有限公司 | Image processing method and related device |
| CN116055855B (en) * | 2022-07-28 | 2023-10-31 | 荣耀终端有限公司 | Image processing method and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110166711B (en) | 2021-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110072051B (en) | Image processing method and device based on multi-frame images | |
| CN109068067B (en) | Exposure control method and device and electronic equipment | |
| CN110062160B (en) | Image processing method and device | |
| CN109040609B (en) | Exposure control method, exposure control device, electronic equipment and computer-readable storage medium | |
| CN110072052B (en) | Image processing method and device based on multi-frame image and electronic equipment | |
| CN110166708B (en) | Night scene image processing method and device, electronic equipment and storage medium | |
| CN108900782B (en) | Exposure control method, exposure control device and electronic equipment | |
| CN110445988B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN110290289B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
| CN110191291B (en) | Image processing method and device based on multi-frame images | |
| CN109788207B (en) | Image synthesis method and device, electronic equipment and readable storage medium | |
| CN110248106B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
| CN110166707B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| WO2020207261A1 (en) | Image processing method and apparatus based on multiple frames of images, and electronic device | |
| CN110166709B (en) | Night scene image processing method and device, electronic equipment and storage medium | |
| CN110264420B (en) | Image processing method and device based on multi-frame images | |
| JP2021530911A (en) | Night view photography methods, devices, electronic devices and storage media | |
| CN110166706B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| CN110166711A (en) | Image processing method, device, electronic equipment and storage medium | |
| CN109151333B (en) | Exposure control method, exposure control device and electronic equipment | |
| CN107509044A (en) | Image combining method, device, computer-readable recording medium and computer equipment | |
| CN108833802A (en) | Exposal control method, device and electronic equipment | |
| CN108900785A (en) | Exposal control method, device and electronic equipment | |
| CN110113539A (en) | Exposal control method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |