CN109788207A - Image composition method, device, electronic equipment and readable storage medium storing program for executing - Google Patents

Image composition method, device, electronic equipment and readable storage medium storing program for executing Download PDF

Info

Publication number
CN109788207A
CN109788207A CN201910094208.7A CN201910094208A CN109788207A CN 109788207 A CN109788207 A CN 109788207A CN 201910094208 A CN201910094208 A CN 201910094208A CN 109788207 A CN109788207 A CN 109788207A
Authority
CN
China
Prior art keywords
image
exposure
original image
frame
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910094208.7A
Other languages
Chinese (zh)
Other versions
CN109788207B (en
Inventor
张弓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910094208.7A priority Critical patent/CN109788207B/en
Publication of CN109788207A publication Critical patent/CN109788207A/en
Application granted granted Critical
Publication of CN109788207B publication Critical patent/CN109788207B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The application proposes a kind of image composition method, device, electronic equipment and readable storage medium storing program for executing, wherein method includes: to acquire multiframe original image frame by frame under light compensating lamp open state by controlling imaging sensor;Wherein, multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down the brightness of target area, short exposed images, middle exposure image and long exposure image adjusted are synthesized, composograph is obtained.This method passes through in the case where photographed scene is very dark, multiframe original image is acquired in the state of opening light compensating lamp, it solves in the related technology in night scene scene capture, the technical issues of acquisition multiple image leads to fuzzy pictures is exposed using long, the shooting details of short distance dark space object is improved simultaneously, and then improves whole image quality.

Description

Image composition method, device, electronic equipment and readable storage medium storing program for executing
Technical field
This application involves technical field of imaging more particularly to a kind of image composition method, device, electronic equipment and readable deposit Storage media.
Background technique
With the continuous development of intelligent terminal technology, the use of mobile terminal device (such as smart phone, tablet computer) It is more more and more universal.Most mobile terminal devices are all built-in with camera, and with the enhancing of mobile terminal processing capacity And the development of camera technology, the performance of built-in camera is stronger and stronger, and the quality for shooting image is also higher and higher.It is mobile Terminal device to people it is daily take pictures bring convenient while, requirement of the people to the picture quality of shooting is also increasingly It is high.
Especially under night scene photographed scene, in order to enable prospect can blur-free imaging, often using longer duration carry out Exposure, still, the image collected when the time for exposure is too long, it is possible that making shooting picture due to shake etc. Fuzzy situation.
Summary of the invention
The application proposes a kind of image composition method, device, electronic equipment and readable storage medium storing program for executing, by environment bright Spend under very dark photographed scene, open light compensating lamp and light filling is carried out to prospect, to shorten exposure time, solve in the related technology, When night scene scene capture, exposed the technical issues of acquisition multiple image leads to fuzzy pictures using long, meanwhile, it improves closely The shooting details of dark space object, and then improve whole image quality.
The application one side embodiment proposes a kind of image composition method, comprising:
Control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, the multiframe is former Beginning image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;
To the long exposure image in the multiframe original image, identify that brightness is greater than the target area of setting luminance threshold;
Turn down the brightness of the target area;
The short exposed images, the middle exposure image and long exposure image adjusted are synthesized, synthesized Image.
The image composition method of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area Picture.This method is solved by acquiring multiframe original image in the state of opening light compensating lamp in the case where photographed scene is very dark In the related technology in night scene scene capture, exposed the technical issues of acquisition multiple image leads to fuzzy pictures using long, meanwhile, The shooting details of short distance dark space object is improved, and then improves whole image quality.
The application another aspect embodiment proposes a kind of image synthesizer, comprising:
Control module acquires multiframe original image for controlling imaging sensor frame by frame under light compensating lamp open state;Its In, the multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;
Identification module, for identifying that brightness is greater than setting luminance threshold to the long exposure image in the multiframe original image The target area of value;
Module is adjusted, for turning down the brightness of the target area;
Synthesis module, for carrying out the short exposed images, the middle exposure image and long exposure image adjusted Synthesis, obtains composograph.
The image synthesizer of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area Picture.This method is solved by acquiring multiframe original image in the state of opening light compensating lamp in the case where photographed scene is very dark In the related technology in night scene scene capture, exposed the technical issues of acquisition multiple image leads to fuzzy pictures using long, meanwhile, The shooting details of short distance dark space object is improved, and then improves whole image quality.
The another aspect embodiment of the application proposes a kind of electronic equipment, comprising: memory, processor and is stored in storage On device and the computer program that can run on a processor, when the processor executes described program, such as above-described embodiment is realized The image composition method.
The another aspect embodiment of the application proposes a kind of computer readable storage medium, is stored thereon with computer journey Sequence, which is characterized in that the image composition method as described in above-described embodiment is realized when the program is executed by processor.
The additional aspect of the application and advantage will be set forth in part in the description, and will partially become from the following description It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, in which:
Fig. 1 is a kind of flow diagram of image composition method provided by the embodiment of the present application;
Fig. 2 is a kind of imaging example figure of photographed scene provided by the embodiment of the present application;
Fig. 3 is the flow diagram of another image composition method provided by the embodiments of the present application.
Fig. 4 is a kind of method flow schematic diagram of determining original image target light exposure amount provided by the embodiments of the present application;
Fig. 5 is a kind of structural schematic diagram of image synthesizer provided by the embodiment of the present application;
Fig. 6 is the structural schematic diagram of a kind of electronic equipment provided by the embodiment of the present application.
Fig. 7 is the module diagram of the image processing circuit of the application certain embodiments.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, it is intended to for explaining the application, and should not be understood as the limitation to the application.
Below with reference to the accompanying drawings the image composition method and device of the embodiment of the present application are described.
Fig. 1 is a kind of flow diagram of image composition method provided by the embodiment of the present application.
The embodiment of the present application is configured in image synthesizer for example, image synthesis dress with the image composition method Setting can be applied in any electronic equipment with shooting function, wherein electronic equipment, can be smart phone, plate electricity Brain, personal digital assistant, wearable device etc. have the hardware device of various operating systems, imaging device.
As shown in Figure 1, the image composition method the following steps are included:
Step 101, control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, more Frame original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases.
Wherein, original image refers to the almost untreated mistake directly obtained from CCD image sensor or CMOS Image, for example, original image of RAW format contained more image detail in original image, by original image Acquisition and processing obtain image, the details of brightness and dark portion in image can be made apparent, imaging can be improved Quality.
In the embodiment of the present application, due to the environmental factors such as light intensity in photographed scene and testee Facing material, Structure, degree of roughness are distributed different influences, so that the picture quality that shooting obtains is bad, therefore, the electricity with shooting function Sub- equipment needs to acquire multiframe original image when shooting image, compound imaging is used for, to improve image quality.Wherein, multiframe Original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases.
It should be noted that exposure, refers to the degree that the sensor devices of imaging device are irradiated by light.Sensor devices connect The light received is more, and exposure is higher, and the image of shooting is brighter;The light that sensor devices receive is fewer, and exposure is smaller, claps The image taken the photograph is darker.
In the embodiment of the present application, the electronic equipment with shooting function is when acquiring multiframe original image, electronic equipment meeting Notify whether user is same to be intended to acquire image in the state of unlatching light compensating lamp.In the very dark night scene scene of light, for example, environment When brightness is less than 5lux, after electronic equipment detects the operation of unlatching light compensating lamp of user's triggering, and then image sensing is controlled Device acquires multiframe original image in the state that light compensating lamp is opened, using different exposures.
As alternatively possible scene, in certain occasions for not allowing to open light compensating lamp shooting, electronic equipment will not be visited The operation for measuring the unlatching light compensating lamp of user's triggering, is adopted in the state that light compensating lamp is closed at this time, it may be necessary to control imaging sensor Collect multiframe original image.
In the embodiment of the present application, electronic equipment may include visible light image sensor, can be based in electronic equipment Visible light image sensor acquires multiframe original image.Specifically, it is seen that optical image sensor may include visible image capturing head, Visible image capturing head can be captured to be imaged by the visible light of imaging object reflection.
As alternatively possible situation, in the embodiment of the present application, electronic equipment can also include that structure light image senses Device can acquire multiframe original image based on the structure light image sensor in electronic equipment.Optionally, structure light image senses Device may include color-changing lamp and Laser video camera head.Pulse width modulates (Pulse Width Modulation, abbreviation PWM) can Structure light is issued to modulate color-changing lamp, structure light exposes to imaging object, and Laser video camera head can capture anti-by imaging object The structure light penetrated is imaged, and the corresponding structure light image of imaging object is obtained.
Step 102, to the long exposure image in multiframe original image, identify that brightness is greater than the target area of setting luminance threshold Domain.
Wherein, luminance threshold is to preset brightness value.
In the embodiment of the present application, since the multiframe original image of acquisition is electronic equipment control imaging sensor in light compensating lamp Acquired frame by frame under open state, thus occur in the image collected the brightness of far and near scape by light compensating lamp light filling effect not Together, the case where partial region will appear overexposure, so that there is unnatural phenomenon in the image of synthesis.
Step 103, the brightness of target area is turned down.
Therefore, in the embodiment of the present application, to the long exposure image in the multiframe original image of acquisition, pass through identification image Brightness value, and then identify highlight regions of the brightness greater than preset luminance threshold, i.e., the aforementioned target area referred to, with Reduce the brightness of target area.Wherein, the brightness of image is substantially the brightness of each pixel in image, the brightness value of pixel Between 0 to 255, the pixel intensity close to 255 is higher, and the brightness close to 0 is lower.When the brightness value of pixel is 0, the picture of image Vegetarian refreshments is black, and when the brightness value of pixel is 255, pixel is most bright, for white.
As an example, if preset luminance threshold is 180, by carrying out brightness knowledge to long exposure image Not, it is all larger than 180 region or when average brightness value is greater than 180 region, and then turns down and identify when recognizing brightness value Target area brightness.
Step 104, short exposed images, middle exposure image and long exposure image adjusted are synthesized, is synthesized Image.
In the embodiment of the present application, electronic equipment is controlled into the short exposure that imaging sensor collects under light filling open state Light image, middle exposure image and long exposure image adjusted, subregion is weighted synthesis and obtains composograph.
It should be noted that in order to compare the overall brightness of composograph naturally, length exposes during image synthesis The weight of target area in light image, less than the weight of corresponding region in short exposed images and middle exposure image.
Further, when in the very dark brightness degree of ambient brightness, each frame original image of shooting there may be noise, At this time, it may be necessary to which the multiframe original image obtained to shooting carries out synthesis noise reduction process, and then obtain the figure after synthesis noise reduction process Picture.
As an example, referring to fig. 2, Far Left picture is the quilt under the very dark photographed scene of environmental light brightness in Fig. 2 Shooting picture;Intermediate image is the image that is shot by imaging device in the state of not opening light compensating lamp;Right image is In the state of opening light compensating lamp, the image that is shot by imaging device.It can be observed by Fig. 2, opening light compensating lamp The image shot under state improves the shooting details of short distance dark space object, and then improves whole image quality.
The image composition method of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area Picture.This method is solved by acquiring multiframe original image in the state of opening light compensating lamp in the case where photographed scene is very dark In the related technology in night scene scene capture, the technical issues of acquisition multiple image leads to fuzzy pictures is exposed using long, thus The shooting details of short distance dark space object is improved, and then improves whole image quality.
As a kind of possible implementation, referring to Fig. 3, the method for obtaining multiframe original image in a step 101, specifically The following steps are included:
Step 201, preview image is obtained.
Specifically, after imaging device detects the operation for opening camera that user triggers, imaging device can passed through Obtain the preview screen of present filming scene.
Step 202, the brightness for judging preview image and/or picture light are corresponded to than whether being less than corresponding threshold value if being less than Threshold value, then execute open light compensating lamp the step of, if be not less than corresponding threshold value, be not turned on light compensating lamp.
Wherein, threshold value, the brightness for referring to preset preview image and/or picture light are than the maximum value that should meet.It draws Face light ratio, refers to the light ratio of the dark face of object and bright face in preview image.
In the embodiment of the present application, the brightness of the image of the display interface preview by determining imaging device and/or picture light Than whether being less than corresponding threshold value, and then determine whether to open light compensating lamp.
As a kind of possible scene, the brightness of the image of the display interface preview of determining imaging device is less than corresponding When threshold value, and then determines and open light compensating lamp.
As alternatively possible scene, the picture light ratio of the image of the display interface preview of determining imaging device is less than When corresponding threshold value, and then determines and open light compensating lamp.
As alternatively possible scene, the brightness of the image of the display interface preview of determining imaging device and picture light When than being respectively less than corresponding threshold value, and then determines and open light compensating lamp.
Step 203, under light compensating lamp open state, light is surveyed with the target light exposure amount of each frame original image of determination.
Wherein, light exposure refers to that the sensor devices in imaging device receive the number of light, light exposure in exposure time It is related with aperture, exposure time and sensitivity.Wherein, aperture i.e. clear aperture, light passes through in the decision unit time Quantity;Exposure time refers to time of the light by camera lens;Sensitivity, also known as ISO value are the spirits for measuring egative film for light The index of quick degree, for indicating the film speed of photosensitive element, the more high photosensitive energy for just illustrating the sensitive component of ISO numerical value Power is stronger.
It should be noted that when the sensitivity of imaging device is lower, need to expose the longer time with reach with it is photosensitive Identical imaging effect when spending higher.Certainly, in order to reduce the time for exposure, using relatively high sensitivity would generally introduce compared with More noise, to will lead to picture quality reduction.Therefore, under night scene scene, preferable noise suppression effect in order to obtain, Wish that lower sensitivity, such as 100ISO or 200ISO etc. is arranged, simultaneously as the aperture of the electronic equipments such as mobile phone is usually adopted With fixed value, to need to correspondingly increase exposure time, i.e. shutter duration.
Specifically, the preview image of present filming scene is obtained by imaging device, it is further to be surveyed by sensor devices The environmental light brightness in each region of preview image is measured, and then in the brightness of preview image and/or picture light ratio less than corresponding When threshold value, in the state of opening light compensating lamp, the target light exposure amount of each frame original image is determined by measuring environmental light brightness.
Step 204, it according to the target light exposure amount of each frame original image and each preset sensitivity of frame original image, determines each The exposure time of frame original image.
In the embodiment of the present application, as a kind of possible implementation, when each preset sensitivity of frame original image is identical When, each preset sensitivity of frame original image can be determined according to the environmental light brightness of photographed scene.In photographed scene light ratio In the case where darker, sensitivity is improved, the speed of shutter can be made to accelerate, to reduce float.
As alternatively possible implementation, when each preset sensitivity of frame original image is identical, can according at As the degree of jitter of equipment, each preset sensitivity of frame original image is determined.
Specifically, in order to determine degree of jitter, displacement letter can be acquired according to the displacement sensor being arranged in imaging device Breath, in turn, according to the displacement information of collected imaging device, determines the degree of jitter of imaging device.When trembling for imaging device When traverse degree is greater than or equal to dithering threshold, determine that each preset sensitivity value of frame image to be collected is in present filming scene First photosensitive value;When the degree of jitter of imaging device is less than dithering threshold, each frame original image in present filming scene is determined Preset sensitivity value is the second photosensitive value.Wherein, dithering threshold is preset default for determining in imaging device The jitter value of sensitivity value.
Wherein, the first photosensitive value is greater than the second photosensitive value, and the first photosensitive value is the presupposition multiple of the second photosensitive value, presets again Several values is more than or equal to 2.As a kind of possible implementation, in order to obtain lower noise, the second photosensitive value can be The minimum sensitivity of imaging device, the i.e. value of the second photosensitive value are 100ISO, and correspondingly, the value range of the first photosensitive value can Think 200,400,800 or higher.
Since light exposure is equal to sensitivity multiplied by exposure time, in the embodiment of the present application, according to each frame original image Target light exposure amount and each preset sensitivity of frame original image, can determine the exposure time of each frame original image.
As an example, if the target light exposure amount for surveying the frame image to be collected that light determines is 800, the frame determined The preset sensitivity of original image is 400ISO, and the exposure time for acquiring the frame original image at this time is then 2s.By the method, It can determine the exposure time of each frame original image.
Step 205, if the exposure time of an at least frame original image is greater than setting maximum time limit, according to maximum time limit, more The exposure time of a new at least frame original image.
As a kind of possible implementation, in the embodiment of the present application, the exposure time upper limit of each frame original image can be with It is determined according to the degree of jitter of imaging device.
Specifically, in order to determine degree of jitter, displacement letter can be acquired according to the displacement sensor being arranged in imaging device Breath, in turn, according to the displacement information of collected imaging device, determines the degree of jitter of imaging device.When trembling for imaging device When traverse degree is greater than or equal to dithering threshold, determine that the exposure time upper limit of each frame original image in present filming scene is first Exposure time;When the degree of jitter of imaging device is less than dithering threshold, determine that each frame original image exposes in present filming scene Light maximum time limit is the second exposure time.Wherein, dithering threshold, in imaging device it is preset for determine preset it is photosensitive Spend the jitter value of value.
Wherein, the value range of maximum time limit is 4.5s to 5.5s.
In the embodiment of the present application, when the exposure time of at least frame image to be collected is greater than the exposure time upper limit, at this point, will The exposure time of at least frame image to be collected is set as maximum time limit.In turn, according to the mesh of at least frame image to be collected The relationship between light exposure and maximum time limit and light exposure and sensitivity and exposure time is marked, updating this, at least a frame waits adopting Collect the sensitivity of image.And then according to the exposure time upper limit, the exposure time of at least frame image to be collected is updated.
It is understood that if the corresponding exposure time of at least frame image to be collected is greater than preset maximum time limit, It may cause whole shooting duration of video to extend, aggravate the degree of jitter of imaging device, so that in the image finally taken It is likely to occur since ghost caused by shaking and image obviously obscure;If the corresponding exposure time of image to be collected is less than preset Duration lower limit, then may cause that the noise in image is excessive to be difficult to eliminate.
Therefore, after determining the corresponding exposure time of each frame original image, can by each exposure time with it is preset Whether duration range compares, to judge the corresponding exposure time of each frame original image within the scope of preset duration.Wherein, it exposes The value range of maximum time limit is 4.5s to 5.5s, and duration lower limit is greater than or equal to 10ms.When a certain frame image to be collected is corresponding Exposure time be less than setting exposure time lower limit when, which is set as duration lower limit Minimum value, i.e. 10ms;It is when the corresponding exposure time of a certain frame image to be collected is greater than the exposure time upper limit, the frame is original The corresponding exposure time of image is set as the maximum value of maximum time limit, i.e. 5.5s.
The frame is waited adopting if the exposure time of certain frame original image is greater than maximum time limit as a kind of possible situation Collection image exposure time be updated to maximum time limit, further, determine updated exposure time and update before exposure when Ratio between length, remaining each frame original image for being greater than or equal to duration lower limit to exposure time update remaining according to ratio The sensitivity or exposure time of each frame original image.
As alternatively possible scene, when the exposure time of original image is less than duration lower limit, by the exposure time It is set as the minimum value of exposure time lower limit, due to the product that light exposure is sensitivity and exposure time, and then according to corresponding Target light exposure amount and exposure time lower limit, update the sensitivity or exposure time of remaining each frame original image.
In the embodiment of the present application, if the exposure time of an at least frame original image is less than setting duration lower limit, by the exposure Duration is set as the minimum value of exposure time lower limit, the ratio between exposure time before determining updated exposure time and updating Value, the sensitivity product before ratio and remaining each frame original image are updated, as remaining each updated sense of frame original image Luminosity.Exposure time product before ratio and remaining each frame original image can also being updated, as remaining each frame original image Updated exposure time.
As an example it is assumed that the exposure time for setting a certain frame original image is less than duration lower limit, by exposure time value The ratio between exposure time for the minimum value of duration lower limit, i.e. 10ms, and then before determining updated exposure time and updating Value, and accordingly update the sensitivity value or exposure time of remaining each frame original image.Such as: according to the brightness of present filming scene Information determines that current exposure value is EV0.When the exposure value of image to be collected is EV+2, then exposure time and sensitivity are divided Not Wei 8ms and 100ISO, due to exposure time be 8ms when be less than duration lower limit 10ms, then be by the exposure time value of EV+2 10ms, ISO value are determined as 8/10*100ISO, as 80ISO.It is carried out as a result, by the exposure time to frame image to be collected It updates, while guaranteeing light exposure, improves brightness of image, avoiding time for exposure too long caused overexposure causes image to lose Very.
Step 206, according to the exposure time and sensitivity of each frame original image, control is exposed to imaging sensor, To collect multiframe original image frame by frame.
In the embodiment of the present application, imaging device can according to the exposure time and sensitivity of determining each frame original image, Control is exposed to imaging sensor and obtains each frame original image.
As a kind of possible implementation, referring to fig. 4, step 203 can with the following steps are included:
Step 301, according to the image content of preview screen, determination belongs to night scene scene.
In the embodiment of the present application, the preview screen of present filming scene can be obtained by imaging device, is worked as determination Whether preceding photographed scene belongs to night scene scene.
Specifically, due to ambient brightness value difference under different scenes, preview screen content is not also identical, according to current shooting The ambient brightness value in the image content of scene preview picture and each region, judges whether present filming scene belongs to night scene field Scape.
For example, the image content of preview screen includes each area of night sky perhaps night scene lamp source etc. or preview screen Ambient brightness value meets the Luminance Distribution characteristic of image under night scene environment in domain, that is, can determine that present filming scene belongs to night scene field Scape.
Step 302, whether include face according to the degree of jitter of imaging device and/or preview screen, identify applicable night Scape mode.
In the embodiment of the present application, the displacement sensor that can be arranged by imaging device, collects imaging device and exists Displacement information in shooting process, and then the current degree of jitter of imaging device is determined according to the displacement information of acquisition.As a result, may be used Judge that user is that imaging device is fixed on foot prop to shoot or by hand-held by the degree of jitter of imaging device Mode shooting.In turn, the degree of jitter current according to imaging device, the applicable night scene mode of identification present filming scene.Wherein, Night scene mode uses foot prop mode or hand-held mode.
As an example, can by obtaining current gyroscope (Gyro-sensor) information of electronic equipment, determine at As the current degree of jitter of equipment.
Wherein, gyroscope is called angular-rate sensor, can measure rotational angular velocity when physical quantity deflection, inclination.? In imaging device, gyroscope can be very good the movement of measurement rotation, deflection, judge user's so as to Accurate Analysis Actual act.The gyroscope information (gyro information) of electronic equipment may include imaging device three dimension sides in three dimensions Upward motion information, three dimensions of three-dimensional space can be expressed as three X-axis, Y-axis, Z axis directions, wherein X-axis, Y Axis, Z axis are vertical relation two-by-two.
As a result, in the embodiment of the present application, gyro information that can be current according to electronic equipment determines that imaging device is current Degree of jitter.The absolute value of the gyro movement of electronic equipment in three directions is bigger, then the degree of jitter of imaging device is bigger. Specifically, the absolute value threshold value of gyro movement in three directions can be preset, and current in three directions according to what is got On gyro movement the sum of absolute value, the relationship with preset threshold value determines the current degree of jitter of imaging device.
As an example it is assumed that preset threshold value is first threshold A, second threshold B, third threshold value C, and A < B < C is currently obtained The sum of absolute value for the movement of gyro in three directions got is S.If S < A, it is determined that the current degree of jitter of imaging device For " non-jitter ";If A < S < B, it can determine that the current degree of jitter of imaging device is " slight jitter ";If B < S < C, can To determine the current degree of jitter of imaging device for " small shake ";If S > C, the current degree of jitter of imaging device can be determined For " big shake ".
It should be noted that the example above is exemplary only, the limitation to the application cannot be considered as.In actual use, Can the quantity of preset threshold and each threshold value according to actual needs specific value, and the pass according to gyro information and each threshold value System presets the mapping relations of gyro information and imaging device degree of jitter.
It whether can include face by determining the preview screen of imaging device as alternatively possible implementation, into And identify the applicable night scene mode of present filming scene.
In the embodiment of the present application, whether preview screen includes that face can be determined by face recognition technology.Face is known Other technology is to compare face visual signature information by analysis to carry out identity identification, it belongs to biometrics identification technology, is pair The biological characteristic of organism (generally refering in particular to people) itself is individual to distinguish organism.Currently, face recognition technology has been supplied in crowd In multi-field, for example, digital camera face auto-focusing and the fast gate technique of smiling face;Enterprise, house safety and management;Gate inhibition system System;Shooting and monitoring system etc..
It should be noted that the survey optical module of imaging device can be automatically with people when detecting that preview screen includes face Survey light is carried out based on face region, and benchmark light exposure is determined according to the photometry result of human face region.However, in night scene scene, The illuminance of human face region is usually lower, so as to cause determining benchmark light exposure, exposes with the benchmark determined when not including face Light quantity if still acquiring excessive overexposure frame when comprising face, is easy to cause human face region overexposure, to lead compared to higher Cause the imaging effect of acquisition image poor.Therefore, for identical degree of jitter, in preview screen comprising face with do not include people It is compared when face, the night scene mode of use is not identical.
Step 303, according to night scene mode, the exposure bias value of each frame original image setting is determined.
Wherein, preset exposure bias value refers to the preset exposure of environmental light brightness according to present filming scene It is worth (Exposure Value, EV).In the initial definition of exposure value, exposure value does not imply that an accurate numerical value, but Refer to " all camera apertures and the combination of exposure time that unified light exposure can be provided ".Sensitivity, aperture and exposure time It has been determined that the light exposure of camera, different parameter combinations can produce equal light exposure, i.e. the EV value of these various combinations is It is the same, for example, combine in the identical situation of sensitivity using the aperture of 1/125 second exposure time and f11, and use 1/ The combination of 250 second time for exposure and f8 shutter, the light exposure of acquisition be it is identical, i.e., EV value is identical.
As a kind of possible implementation, the degree of jitter of imaging device is different, is applicable in the night scene of present filming scene Mode is not also identical, accordingly, it is determined that each preset exposure bias value of frame original image gone out is not also identical.In the embodiment of the present application In, the mapping relations between the degree of jitter of imaging device and exposure bias value can be preset, according to the shake of imaging device Degree determines current each preset exposure bias value of frame original image.
For example, when can be " non-jitter " by the degree of jitter of imaging device, the corresponding exposure compensating of each frame original image The EV value range of value is preset as -6~2, and the difference between adjacent EV value is 0.5;It is " light by the degree of jitter of imaging device The EV value range of micro- shake ", the corresponding exposure bias value of each frame original image is preset as -5~1, and between adjacent EV value Difference is 1, etc..
As alternatively possible way of realization, whether the preview screen for detecting imaging device includes face, preview screen In comprising face with do not include face when, the night scene mode for being applicable in present filming scene is not identical, and each frame thereby determined that is original The preset exposure bias value of image is not also identical.
Whether identical degree of jitter can be wrapped according in preview screen as alternatively possible implementation Containing face, determine each frame original image using different exposure bias values.Therefore, it for identical degree of jitter, can correspond to In multiple exposure bias values.For example, the degree of jitter of imaging device is " slight jitter ", each preset exposure of frame original image is mended Repaying value has comprising face and without two kinds of situations of face.
In night scene mode, when in original image including face, the intensity of illumination of human face region is usually lower, to lead Determining benchmark light exposure is caused, it is higher compared with the benchmark light exposure determined when not including face, if when comprising face still Excessive overexposure frame is acquired, then is easy to cause human face region overexposure, the imaging effect so as to cause acquisition image is poor, corresponds to Exposure compensation mode need that there is lower exposure compensating range.Therefore, it for identical degree of jitter, is wrapped in preview screen Containing face compared with when not including face, determined the current degree of jitter of imaging device and preview screen whether include After face, that is, it can determine that the preset exposure bias value being consistent with current actual conditions.
Step 304, according to the luminance information of preview image, benchmark light exposure is determined.
Specifically, the preview image of present filming scene is obtained by imaging device, it is further to be surveyed by sensor devices The environmental light brightness in each region of preview image is measured, and then according to the luminance information of preview image, determines benchmark light exposure.Its In, in the case where aperture is fixed, benchmark light exposure can specifically include benchmark exposure time and benchmark sensitivity.
In the embodiment of the present application, benchmark light exposure refers to the current shooting field by survey to preview image light acquisition The luminance information of scape, the light exposure adaptable with present filming scene luminance information that be determining.The value of benchmark light exposure can To be the product between benchmark sensitivity and benchmark exposure time.
Wherein, benchmark sensitivity, can be the degree of jitter current according to imaging device, determining with current shake journey The adaptable sensitivity of degree can also be the sensitivity obtained by surveying light, be not construed as limiting in the present embodiment to this.It is understood that , since light exposure and sensitivity influence whether whole shooting duration of video, when shooting duration of video is too long, may result in hand-held racket The degree of jitter aggravation of imaging device when taking the photograph, to influence picture quality.Therefore, in the shake journey current according to imaging device Degree when determining benchmark sensitivity, should make shooting duration of video control in suitable range.
Step 305, the exposure bias value set according to benchmark light exposure and each frame original image, determines each frame original image Target light exposure amount.
It specifically,, can when the size of aperture is fixed since light exposure is related with aperture, exposure time and sensitivity According to benchmark light exposure and benchmark sensitivity, benchmark exposure time is determined.It is EV0 by benchmark exposure time, according to each frame The preset exposure bias value of original image, it may be determined that the target light exposure amount of each frame original image.
As an example, if the luminance information for the preview image that imaging device is obtained according to measurement, determines that each frame is former The benchmark light exposure of beginning image is 400, and benchmark sensitivity ISO value is 100 at this time, then benchmark exposure time is 4s.If each frame The preset exposure bias value of original image is EV+1, it may be determined that target light exposure amount at this time is 800.Wherein, the exposure of EV+1 Light compensation, which refers to, increases by one grade of exposure relative to the corresponding light exposure of imaging device photometric data, i.e. actual exposure amount is to survey light number According to twice of corresponding light exposure.
It in the embodiment of the present application, can be pre- by the determining corresponding EV value of benchmark light exposure when presetting exposure bias value It is set as 0, EV+1 and refers to one grade of exposure of increase, is i.e. light exposure is 2 times of benchmark light exposure, and EV+2 refers to two grades of exposures of increase, i.e., Light exposure is 4 times of benchmark light exposure, and EV-1 refers to one grade of exposure of reduction, i.e. light exposure is 0.5 times etc. of benchmark light exposure.
For example, if the original image quantity of imaging sensor acquisition is 7 frames, corresponding default exposure bias value EV Value can be [+1 ,+1 ,+1 ,+1,0, -3, -6].Wherein, the frame that exposure bias value is EV+1 is preset, can solve noise problem, Time domain noise reduction is carried out by the higher frame of brightness ratio, inhibits noise while promoting dark portion details;Default exposure bias value is The frame of EV-6, retains the details of highlight area at the problem of can solve bloom overexposure;Default exposure bias value is EV0 and EV-3 Frame, then can be used for keeping bloom to the transition between dark space, keep the effect of preferable light and shade transition.
The image composition method of the embodiment of the present application, by surveying light with the target light exposure amount of each frame original image of determination, root According to the target light exposure amount and each preset sensitivity of frame original image of each frame original image, when determining the exposure of each frame original image It is long, if the exposure time of an at least frame original image is greater than maximum time limit, according to maximum time limit, update an at least frame original image Exposure time be exposed control finally according to the exposure time and sensitivity of each frame original image.Pass through basis as a result, The degree of jitter of imaging device, it is determined that the exposure time of each frame original image, and then an at least frame is updated according to maximum time limit The exposure time of original image is exposed control finally according to the exposure time and sensitivity of updated each frame original image System, obtains each frame original image, not only improves the dynamic range and overall brightness that image is shot under night scene screening-mode, but also The noise in shooting image is effectively inhibited, the quality of night scene shooting image is improved, improves user experience.
In order to realize above-described embodiment, the application also proposes a kind of image synthesizer.
Fig. 5 is a kind of structural schematic diagram of image synthesizer provided by the embodiments of the present application.
As shown in figure 5, the image synthesizer 100 include: control module 110, identification module 120, adjustment module 130 with And synthesis module 140.
Control module 110 acquires multiframe original image for controlling imaging sensor frame by frame under light compensating lamp open state; Wherein, multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases.
Identification module 120, for identifying that brightness is greater than setting luminance threshold to the long exposure image in multiframe original image Target area.
Module 130 is adjusted, for turning down the brightness of target area.
Synthesis module 140, for short exposed images, middle exposure image and long exposure image adjusted to be synthesized, Obtain composograph.
Further, in a kind of possible implementation of the embodiment of the present application, referring to Fig. 5, embodiment shown in Fig. 4 On the basis of, which can also include:
Module 150 is obtained, user obtains preview image.
Determining module 160, brightness and/or picture light ratio for determining preview image are less than corresponding threshold value.
As a kind of possible implementation, control module 110 is specifically used under light compensating lamp open state, survey light with The target light exposure amount for determining each frame original image, it is preset according to the target light exposure amount of each frame original image and each frame original image Sensitivity determines the exposure time of each frame original image, according to the exposure time and sensitivity of each frame original image, passes to image Sensor is exposed control, to collect multiframe original image frame by frame.
As a kind of possible implementation, control module 110, if an at least frame original image can also be specifically used for Exposure time is greater than setting maximum time limit, according to maximum time limit, updates the exposure time of an at least frame original image;Maximum time limit Value range is 4.5s to 5.5s.
As a kind of possible implementation, control module 110, if an at least frame original image can also be specifically used for Exposure time is less than setting duration lower limit, and according to duration lower limit, it is original less than each frame of setting duration lower limit to update exposure time The exposure time of image;Duration lower limit is greater than or equal to 10ms;In turn, the exposure before determining updated exposure time and updating Ratio between duration, remaining each frame original image for being greater than or equal to duration lower limit to exposure time update it according to ratio The sensitivity or exposure time of remaining each frame original image.
As alternatively possible implementation, control module 110 can also include:
First processing units, for the sensitivity product before updating ratio and remaining each frame original image, as remaining Each updated sensitivity of frame original image.
Alternatively, for the exposure time product before updating ratio and remaining each frame original image, it is former as remaining each frame Exposure time after beginning image update.
As alternatively possible implementation, control module 110 can also include:
Acquiring unit, for obtaining preview screen.
First determination unit, for the image content according to preview screen, determination belongs to night scene scene.
Recognition unit, whether for including face according to the degree of jitter and/or preview screen of imaging device, identification is applicable in Night scene mode.
Second determination unit, for determining the exposure bias value of each frame original image setting according to night scene mode.
Third determination unit determines benchmark light exposure for the luminance information according to preview image.
4th determination unit determines each for the exposure bias value according to benchmark light exposure and the setting of each frame original image The target light exposure amount of frame original image.
As alternatively possible implementation, synthesis module 140 is specifically used for short exposed images, middle exposure image With long exposure image adjusted, subregion is weighted synthesis and obtains composograph;
Wherein, in long exposure image target area weight, be less than corresponding region in short exposed images and middle exposure image Weight.
It should be noted that the aforementioned image for being also applied for the embodiment to the explanation of image composition method embodiment Synthesizer, details are not described herein again.
The image synthesizer of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area Picture.
In order to realize above-described embodiment, the application also proposes a kind of electronic equipment, including memory, processor and is stored in On memory and the computer program that can run on a processor, when the processor executes described program, such as above-mentioned reality is realized Apply image composition method described in example.
Referring to Fig. 6, the application also provides another electronic equipment 200.Electronic equipment 200 includes memory 50 and processing Device 60.Computer-readable instruction is stored in memory 50.When computer-readable instruction is stored by 50 execution, so that processor 60 execute the exposal control method of any of the above-described embodiment.
Fig. 6 is the schematic diagram of internal structure of electronic equipment 200 in one embodiment.The electronic equipment 200 includes passing through to be Processor 60, the memory 50 (for example, non-volatile memory medium), built-in storage 82,83 and of display screen of bus 81 of uniting connection Input unit 84.Wherein, the memory 50 of electronic equipment 200 is stored with operating system and computer-readable instruction.The computer Readable instruction can be executed by processor 60, to realize the exposal control method of the application embodiment.The processor 60 is for mentioning For calculating and control ability, the operation of entire electronic equipment 200 is supported.The built-in storage 50 of electronic equipment 200 is memory 52 In computer-readable instruction operation provide environment.The display screen 83 of electronic equipment 200 can be liquid crystal display or electricity Sub- ink display screen etc., input unit 84 can be the touch layer covered on display screen 83, be also possible to 200 shell of electronic equipment Key, trace ball or the Trackpad of upper setting, are also possible to external keyboard, Trackpad or mouse etc..The electronic equipment 200 can Be mobile phone, tablet computer, laptop, personal digital assistant or wearable device (such as Intelligent bracelet, smartwatch, Intelligent helmet, intelligent glasses) etc..It will be understood by those skilled in the art that structure shown in Fig. 6, only with the application side The schematic diagram of the relevant part-structure of case does not constitute the restriction for the electronic equipment 200 being applied thereon to application scheme, Specific electronic equipment 200 may include perhaps combining certain components than more or fewer components as shown in the figure or having Different component layouts.
Referring to Fig. 7, including image processing circuit 90, image processing circuit in the electronic equipment 200 of the embodiment of the present application 90 can be realized using hardware and or software component, including define ISP (Image Signal Processing, at picture signal Reason) pipeline various processing units.Fig. 7 is the schematic diagram of image processing circuit 90 in one embodiment.As shown in fig. 7, for just In explanation, the various aspects of image processing techniques relevant to the embodiment of the present application are only shown.
As shown in fig. 7, image processing circuit 90 includes ISP processor 91 (ISP processor 91 can be processor 60) and controls Logic device 92 processed.The image data that camera 93 captures is handled by ISP processor 91 first, and ISP processor 91 is to image data It is analyzed to capture the image statistics for the one or more control parameters that can be used for determining camera 93.Camera 93 can Including one or more lens 932 and imaging sensor 934.Imaging sensor 934 may include colour filter array (such as Bayer Filter), imaging sensor 934 can obtain the luminous intensity and wavelength information that each imaging pixel captures, and provide and can be handled by ISP One group of raw image data of the processing of device 91.Sensor 94 (such as gyroscope) can be based on 94 interface type of sensor the figure of acquisition As the parameter (such as stabilization parameter) of processing is supplied to ISP processor 91.94 interface of sensor can be SMIA (Standard Mobile Imaging Architecture, Standard Mobile Imager framework) interface, other serial or parallel camera interfaces or The combination of above-mentioned interface.
In addition, raw image data can also be sent to sensor 94 by imaging sensor 934, sensor 94 can be based on sensing Raw image data is supplied to ISP processor 91 or sensor 94 and arrives raw image data storage by 94 interface type of device In video memory 95.
ISP processor 91 handles raw image data pixel by pixel in various formats.For example, each image pixel can have There is the bit depth of 8,10,12 or 14 bits, ISP processor 91 can carry out one or more image procossing behaviour to raw image data Make, statistical information of the collection about image data.Wherein, image processing operations can by identical or different bit depth precision into Row.
ISP processor 91 can also receive image data from video memory 95.For example, 94 interface of sensor is by original image Data are sent to video memory 95, and the raw image data in video memory 95 is available to ISP processor 91 for place Reason.Video memory 95 can be independent special in memory 50, a part of memory 50, storage equipment or electronic equipment It with memory, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the original from 934 interface of imaging sensor or from 94 interface of sensor or from video memory 95 When beginning image data, ISP processor 91 can carry out one or more image processing operations, such as time-domain filtering.Treated image Data can be transmitted to video memory 95, to carry out other processing before shown.ISP processor 91 is stored from image Device 95 receives processing data, and carries out at the image data in original domain and in RGB and YCbCr color space to processing data Reason.Treated that image data may be output to display 97 (display 97 may include display screen 83) for ISP processor 91, for Family is watched and/or is further processed by graphics engine or GPU (Graphics Processing Unit, graphics processor).This Outside, the output of ISP processor 91 also can be transmitted to video memory 95, and display 97 can read image from video memory 95 Data.In one embodiment, video memory 95 can be configured to realize one or more frame buffers.In addition, ISP is handled The output of device 91 can be transmitted to encoder/decoder 96, so as to encoding/decoding image data.The image data of coding can be protected It deposits, and is decompressed before being shown in 97 equipment of display.Encoder/decoder 96 can be real by CPU or GPU or coprocessor It is existing.
The statistical data that ISP processor 91 determines, which can be transmitted, gives control logic device Unit 92.For example, statistical data may include The imaging sensors such as automatic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, 932 shadow correction of lens 934 statistical informations.Control logic device 92 may include the processing element and/or microcontroller for executing one or more routines (such as firmware) Device, one or more routines can statistical data based on the received, determine the control parameter of camera 93 and the control of ISP processor 91 Parameter processed.For example, the control parameter of camera 93 may include 94 control parameter of sensor (such as the integral of gain, spectrum assignment Time, stabilization parameter etc.), camera flash control parameter, 932 control parameter of lens (such as focus or zoom focal length) or The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing) 932 shadow correction parameter of gain level and color correction matrix and lens.
The following are realize image composition method with image processing techniques in Fig. 7:
Control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, multiframe original graph Short exposed images, middle exposure image and long exposure image as including the increase of exposure sequence;
To the long exposure image in multiframe original image, identify that brightness is greater than the target area of setting luminance threshold;
Turn down the brightness of target area;
Short exposed images, middle exposure image and long exposure image adjusted are synthesized, composograph is obtained.
In order to realize above-described embodiment, the application also proposes a kind of computer readable storage medium, is stored thereon with calculating Machine program, which is characterized in that the image composition method as described in above-described embodiment is realized when the program is executed by processor.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application Type.

Claims (11)

1. a kind of image composition method, which is characterized in that the described method comprises the following steps:
Control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, the multiframe original graph Short exposed images, middle exposure image and long exposure image as including the increase of exposure sequence;
To the long exposure image in the multiframe original image, identify that brightness is greater than the target area of setting luminance threshold;
Turn down the brightness of the target area;
The short exposed images, the middle exposure image and long exposure image adjusted are synthesized, composograph is obtained.
2. image composition method according to claim 1, which is characterized in that the control imaging sensor is opened in light compensating lamp It opens before acquiring multiframe original image under state frame by frame, further includes:
Obtain preview image;
The brightness and/or picture light ratio for determining the preview image are less than corresponding threshold value.
3. image composition method according to claim 1, which is characterized in that the control imaging sensor is opened in light compensating lamp It opens and acquires multiframe original image under state frame by frame, comprising:
Under the light compensating lamp open state, light is surveyed with the target light exposure amount of each frame original image of determination;
According to the target light exposure amount of each frame original image and each preset sensitivity of frame original image, each frame original image is determined Exposure time;
According to the exposure time and sensitivity of each frame original image, control is exposed to described image sensor, to adopt frame by frame Collection obtains the multiframe original image.
4. image composition method according to claim 3, which is characterized in that described to be exposed according to the target of each frame original image Light quantity and each preset sensitivity of frame original image, after the exposure time for determining each frame original image, further includes:
If the exposure time of an at least frame original image is greater than setting maximum time limit, according to the maximum time limit, update is described extremely The exposure time of a few frame original image;The maximum time limit value range is 4.5s to 5.5s.
5. image composition method according to claim 3, which is characterized in that described to be exposed according to the target of each frame original image Light quantity and each preset sensitivity of frame original image, after the exposure time for determining each frame original image, further includes:
If the exposure time of an at least frame original image is less than setting duration lower limit, according to the duration lower limit, when updating exposure The exposure time of the long each frame original image for being less than setting duration lower limit;The duration lower limit is greater than or equal to 10ms;
The ratio between exposure time before determining updated exposure time and updating;
It is greater than or equal to remaining each frame original image of the duration lower limit to exposure time, according to the ratio, described in update The sensitivity or exposure time of remaining each frame original image.
6. image composition method according to claim 5, which is characterized in that it is described according to the ratio, update it is described its The sensitivity or exposure time of remaining each frame original image, comprising:
Sensitivity product before the ratio and remaining described each frame original image are updated, as remaining described each frame original graph As updated sensitivity;
Alternatively, the exposure time product before the ratio and remaining described each frame original image are updated, remaining is each as described The updated exposure time of frame original image.
7. image composition method according to claim 3, which is characterized in that the survey light is with each frame original image of determination Target light exposure amount, comprising:
Obtain preview screen;
According to the image content of the preview screen, determination belongs to night scene scene;
Whether include face according to the degree of jitter of imaging device and/or the preview screen, identifies applicable night scene mode;
According to the night scene mode, the exposure bias value of each frame original image setting is determined;
According to the luminance information of preview image, benchmark light exposure is determined;
According to the exposure bias value that the benchmark light exposure and each frame original image are set, determine that the target of each frame original image exposes Light quantity.
8. image composition method according to claim 1-7, which is characterized in that described by the short exposure figure Picture, the middle exposure image and long exposure image adjusted are synthesized, and composograph is obtained, comprising:
To the short exposed images, the middle exposure image and long exposure image adjusted, subregion, which is weighted, to be synthesized To the composograph;
Wherein, the weight of target area described in the long exposure image is less than the short exposed images and the middle exposure diagram The weight of corresponding region as in.
9. a kind of image synthesizer, which is characterized in that described device includes:
Control module acquires multiframe original image for controlling imaging sensor frame by frame under light compensating lamp open state;Wherein, institute Stating multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;
Identification module, for identifying that brightness is greater than setting luminance threshold to the long exposure image in the multiframe original image Target area;
Module is adjusted, for turning down the brightness of the target area;
Synthesis module, for the short exposed images, the middle exposure image and long exposure image adjusted to be synthesized, Obtain composograph.
10. a kind of electronic equipment characterized by comprising memory, processor and storage are on a memory and can be in processor The computer program of upper operation when the processor executes described program, realizes such as image described in any one of claims 1-8 Synthetic method.
11. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor Such as image composition method described in any one of claims 1-8 is realized when execution.
CN201910094208.7A 2019-01-30 2019-01-30 Image synthesis method and device, electronic equipment and readable storage medium Active CN109788207B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910094208.7A CN109788207B (en) 2019-01-30 2019-01-30 Image synthesis method and device, electronic equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910094208.7A CN109788207B (en) 2019-01-30 2019-01-30 Image synthesis method and device, electronic equipment and readable storage medium

Publications (2)

Publication Number Publication Date
CN109788207A true CN109788207A (en) 2019-05-21
CN109788207B CN109788207B (en) 2021-03-23

Family

ID=66503814

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910094208.7A Active CN109788207B (en) 2019-01-30 2019-01-30 Image synthesis method and device, electronic equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN109788207B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108156392A (en) * 2017-12-28 2018-06-12 努比亚技术有限公司 A kind of image pickup method, terminal and computer readable storage medium
CN110661972A (en) * 2019-09-27 2020-01-07 维沃移动通信有限公司 Image processing method, image processing apparatus, electronic device, and medium
CN111064898A (en) * 2019-12-02 2020-04-24 联想(北京)有限公司 Image shooting method and device, equipment and storage medium
CN111405205A (en) * 2020-03-24 2020-07-10 维沃移动通信有限公司 Image processing method and electronic device
CN112235512A (en) * 2020-09-16 2021-01-15 浙江大华技术股份有限公司 Image exposure parameter adjusting method, equipment and device
CN112367458A (en) * 2020-09-18 2021-02-12 格科微电子(上海)有限公司 HDR image generation method and device, storage medium and image processing device
CN112907701A (en) * 2019-11-19 2021-06-04 杭州海康威视数字技术股份有限公司 Method and device for acquiring image, computer equipment and storage medium
CN113038026A (en) * 2021-03-01 2021-06-25 维沃移动通信有限公司 Image processing method and electronic device
CN114095666A (en) * 2021-08-12 2022-02-25 荣耀终端有限公司 Photographing method, electronic device and computer-readable storage medium
CN115412678A (en) * 2022-10-20 2022-11-29 荣耀终端有限公司 Exposure processing method and device and electronic equipment
CN115802133A (en) * 2021-09-10 2023-03-14 Oppo广东移动通信有限公司 Camera module, electronic equipment, image acquisition method and device and storage medium
CN116437222A (en) * 2021-12-29 2023-07-14 荣耀终端有限公司 Image processing method and electronic equipment
CN116452475A (en) * 2022-01-10 2023-07-18 荣耀终端有限公司 Image processing method and related device
CN117278864A (en) * 2023-11-15 2023-12-22 荣耀终端有限公司 Image capturing method, electronic device, and storage medium
CN117499779A (en) * 2023-12-27 2024-02-02 荣耀终端有限公司 Image preview method, device and storage medium
CN116452475B (en) * 2022-01-10 2024-05-31 荣耀终端有限公司 Image processing method and related device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140016001A1 (en) * 2012-07-10 2014-01-16 Canon Kabushiki Kaisha Image-pickup apparatus, control method for the same, and non-transitory computer-readable storage medium
US20170048442A1 (en) * 2010-07-05 2017-02-16 Apple Inc. Operating a device to capture high dynamic range images
CN108683862A (en) * 2018-08-13 2018-10-19 Oppo广东移动通信有限公司 Image formation control method, device, electronic equipment and computer readable storage medium
CN108900782A (en) * 2018-08-22 2018-11-27 Oppo广东移动通信有限公司 Exposal control method, device and electronic equipment
CN108965729A (en) * 2018-08-13 2018-12-07 Oppo广东移动通信有限公司 Control method, device, electronic equipment and computer readable storage medium
CN109194855A (en) * 2018-09-20 2019-01-11 Oppo广东移动通信有限公司 Imaging method, device and electronic equipment
CN109218613A (en) * 2018-09-18 2019-01-15 Oppo广东移动通信有限公司 High dynamic-range image synthesis method, device, terminal device and storage medium
CN109218628A (en) * 2018-09-20 2019-01-15 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170048442A1 (en) * 2010-07-05 2017-02-16 Apple Inc. Operating a device to capture high dynamic range images
US20140016001A1 (en) * 2012-07-10 2014-01-16 Canon Kabushiki Kaisha Image-pickup apparatus, control method for the same, and non-transitory computer-readable storage medium
CN108683862A (en) * 2018-08-13 2018-10-19 Oppo广东移动通信有限公司 Image formation control method, device, electronic equipment and computer readable storage medium
CN108965729A (en) * 2018-08-13 2018-12-07 Oppo广东移动通信有限公司 Control method, device, electronic equipment and computer readable storage medium
CN108900782A (en) * 2018-08-22 2018-11-27 Oppo广东移动通信有限公司 Exposal control method, device and electronic equipment
CN109218613A (en) * 2018-09-18 2019-01-15 Oppo广东移动通信有限公司 High dynamic-range image synthesis method, device, terminal device and storage medium
CN109194855A (en) * 2018-09-20 2019-01-11 Oppo广东移动通信有限公司 Imaging method, device and electronic equipment
CN109218628A (en) * 2018-09-20 2019-01-15 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and storage medium

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108156392A (en) * 2017-12-28 2018-06-12 努比亚技术有限公司 A kind of image pickup method, terminal and computer readable storage medium
CN110661972A (en) * 2019-09-27 2020-01-07 维沃移动通信有限公司 Image processing method, image processing apparatus, electronic device, and medium
US11678066B2 (en) 2019-09-27 2023-06-13 Vivo Mobile Communication Co., Ltd. Image processing method, electronic device and medium
CN112907701A (en) * 2019-11-19 2021-06-04 杭州海康威视数字技术股份有限公司 Method and device for acquiring image, computer equipment and storage medium
CN111064898A (en) * 2019-12-02 2020-04-24 联想(北京)有限公司 Image shooting method and device, equipment and storage medium
CN111064898B (en) * 2019-12-02 2021-07-16 联想(北京)有限公司 Image shooting method and device, equipment and storage medium
CN111405205A (en) * 2020-03-24 2020-07-10 维沃移动通信有限公司 Image processing method and electronic device
CN112235512A (en) * 2020-09-16 2021-01-15 浙江大华技术股份有限公司 Image exposure parameter adjusting method, equipment and device
CN112367458A (en) * 2020-09-18 2021-02-12 格科微电子(上海)有限公司 HDR image generation method and device, storage medium and image processing device
CN112367458B (en) * 2020-09-18 2022-04-22 格科微电子(上海)有限公司 HDR image generation method and device, storage medium and image processing device
CN113038026A (en) * 2021-03-01 2021-06-25 维沃移动通信有限公司 Image processing method and electronic device
CN113038026B (en) * 2021-03-01 2023-07-25 维沃移动通信有限公司 Image processing method and electronic device
WO2023015991A1 (en) * 2021-08-12 2023-02-16 荣耀终端有限公司 Photography method, electronic device, and computer readable storage medium
CN114095666A (en) * 2021-08-12 2022-02-25 荣耀终端有限公司 Photographing method, electronic device and computer-readable storage medium
CN114095666B (en) * 2021-08-12 2023-09-22 荣耀终端有限公司 Photographing method, electronic device, and computer-readable storage medium
CN115802133A (en) * 2021-09-10 2023-03-14 Oppo广东移动通信有限公司 Camera module, electronic equipment, image acquisition method and device and storage medium
CN116437222A (en) * 2021-12-29 2023-07-14 荣耀终端有限公司 Image processing method and electronic equipment
CN116437222B (en) * 2021-12-29 2024-04-19 荣耀终端有限公司 Image processing method and electronic equipment
CN116452475A (en) * 2022-01-10 2023-07-18 荣耀终端有限公司 Image processing method and related device
CN116452475B (en) * 2022-01-10 2024-05-31 荣耀终端有限公司 Image processing method and related device
CN115412678A (en) * 2022-10-20 2022-11-29 荣耀终端有限公司 Exposure processing method and device and electronic equipment
CN117278864A (en) * 2023-11-15 2023-12-22 荣耀终端有限公司 Image capturing method, electronic device, and storage medium
CN117278864B (en) * 2023-11-15 2024-04-05 荣耀终端有限公司 Image capturing method, electronic device, and storage medium
CN117499779A (en) * 2023-12-27 2024-02-02 荣耀终端有限公司 Image preview method, device and storage medium
CN117499779B (en) * 2023-12-27 2024-05-10 荣耀终端有限公司 Image preview method, device and storage medium

Also Published As

Publication number Publication date
CN109788207B (en) 2021-03-23

Similar Documents

Publication Publication Date Title
CN109788207A (en) Image composition method, device, electronic equipment and readable storage medium storing program for executing
CN110072051B (en) Image processing method and device based on multi-frame images
CN108900782B (en) Exposure control method, exposure control device and electronic equipment
CN109005366B (en) Night scene shooting processing method and device for camera module, electronic equipment and storage medium
CN109068067A (en) Exposal control method, device and electronic equipment
CN110072052B (en) Image processing method and device based on multi-frame image and electronic equipment
CN109040609A (en) Exposal control method, device and electronic equipment
CN110290289B (en) Image noise reduction method and device, electronic equipment and storage medium
CN108683862B (en) Imaging control method, imaging control device, electronic equipment and computer-readable storage medium
CN110166708B (en) Night scene image processing method and device, electronic equipment and storage medium
CN110248106B (en) Image noise reduction method and device, electronic equipment and storage medium
CN109005369A (en) Exposal control method, device, electronic equipment and computer readable storage medium
CN109068058A (en) Filming control method, device and electronic equipment under super night scene mode
CN109005364A (en) Image formation control method, device, electronic equipment and computer readable storage medium
CN108989700A (en) Image formation control method, device, electronic equipment and computer readable storage medium
CN109756681A (en) Image composition method, device, electronic equipment and readable storage medium storing program for executing
CN109005361A (en) Control method, device, imaging device, electronic equipment and readable storage medium storing program for executing
CN110166707B (en) Image processing method, image processing apparatus, electronic device, and storage medium
CN108833804A (en) Imaging method, device and electronic equipment
CN109151333B (en) Exposure control method, exposure control device and electronic equipment
CN109756680A (en) Image composition method, device, electronic equipment and readable storage medium storing program for executing
CN110191291A (en) Image processing method and device based on multiple image
CN110062159A (en) Image processing method, device, electronic equipment based on multiple image
CN109348088A (en) Image denoising method, device, electronic equipment and computer readable storage medium
CN108833802A (en) Exposal control method, device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant