CN110958400A - System, method and device for keeping exposure of continuously shot pictures consistent - Google Patents
System, method and device for keeping exposure of continuously shot pictures consistent Download PDFInfo
- Publication number
- CN110958400A CN110958400A CN201911282432.5A CN201911282432A CN110958400A CN 110958400 A CN110958400 A CN 110958400A CN 201911282432 A CN201911282432 A CN 201911282432A CN 110958400 A CN110958400 A CN 110958400A
- Authority
- CN
- China
- Prior art keywords
- exposure
- image data
- image sensor
- current moment
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the specification discloses a system, a method and a device for keeping consistent exposure of continuously shot pictures, wherein the system comprises: image sensor, treater, diaphragm drive controller, exposure and gain control ware, wherein: the image sensor is used for acquiring image data and acquiring preview image data; the processor is used for identifying and matching the scenes of the image data at the previous moment and the scenes of the image data at the current moment, and if the two identified scenes have the same area, calculating the exposure parameter combination required at the current moment according to the brightness information of the same area in the image data at the previous moment; the diaphragm driving controller is used for controlling the light flux of the image sensor according to the diaphragm parameters; and the exposure and gain controller is used for controlling the exposure time and the gain of the image sensor according to the exposure time and the gain parameters.
Description
The specification relates to the field of unmanned aerial vehicles, in particular to a system, a method and a device for keeping consistent exposure of continuously shot photos.
Background
Data collected by the current aerial survey camera are continuously shot photos instead of videos, although the overlap degree of the continuously shot photos is more than 50%, the exposure amount of each photo is only controlled independently according to the current environment during shooting, so that under the condition of light change or scene change, the exposure amount of the same scene part in different photos is different, and a discontinuous luminance fault phenomenon occurs between the photos, so that the discontinuous luminance fault phenomenon occurs in the continuous scene during later splicing or mapping by utilizing the photos.
Disclosure of Invention
The embodiments of the present disclosure provide a system, method and apparatus for consistent exposure of continuously taken pictures, so as to overcome at least one technical problem in the prior art.
According to a first aspect of embodiments herein, there is provided a system for consistent exposure of continuously taken photographs, comprising: image sensor, treater, diaphragm drive controller, exposure and gain control ware, wherein:
the image sensor is used for acquiring image data, storing the acquired image data into a corresponding storage area, acquiring preview image data and sending the acquired preview image data to the processor;
the processor includes: the system comprises a data acquisition module, a scene recognition matching module, an exposure parameter calculation first module, an exposure parameter calculation second module, a parameter setting module and a data acquisition triggering module, wherein: the data acquisition module is configured to acquire preview image data of the image sensor at the current moment and judge whether the image sensor acquires the image data at the previous moment; the scene identification matching module is configured to identify a scene of the image data at the previous moment and a scene of preview image data of the image sensor at the current moment if the image sensor acquires the image data at the previous moment, match the two identified scenes and judge whether the two identified scenes have the same area; the exposure parameter calculation first module is configured to calculate the exposure amount of the same region in the image data at the last moment if the two scenes have the same region, and calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture; the exposure parameter calculation second module is configured to calculate an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm if the two scenes do not have the same area; the parameter setting module is configured to send the exposure parameter combination to a corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor; the acquired data triggering module is configured to judge whether a shooting instruction is received or not, if the shooting instruction is received, a triggering signal is sent to the image sensor so that the image sensor acquires image data at the current moment, and if the shooting instruction is not received, an instruction for continuously executing a corresponding function is sent to the data acquisition module;
the aperture driving controller is used for controlling the light transmission amount of the image sensor according to the received aperture parameters;
and the exposure and gain controller is used for controlling the exposure time and the gain of the image sensor according to the received exposure time and gain parameters.
Optionally, the exposure parameter calculation module comprises: a first luminance value statistic submodule configured to count luminance values of the same region in the image data at a previous time; the exposure calculation first submodule is configured to deduce the exposure of the same area in the image data at the last moment according to the brightness value; and the exposure parameter calculation first sub-module is configured to calculate the exposure parameter combination required by the current moment by taking the exposure as the expected value of the exposure required by the image sensor at the current moment and combining a preset exposure algorithm.
Optionally, the exposure parameter second calculation sub-module includes: the second luminance value statistics submodule is configured to count an average luminance value or a weight luminance value of the preview image data at the current moment; the exposure calculation second submodule is configured to calculate the exposure of the preview image data at the current moment according to the brightness value; and the exposure parameter calculation second sub-module is configured to calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm according to the exposure amount.
Optionally, the parameter setting module includes: an exposure time and gain parameter setting sub-module configured to transmit parameters of the exposure time and gain to an exposure and gain controller so that the exposure and gain controller controls the exposure time and gain of the image sensor; an aperture parameter setting submodule configured to transmit a parameter of the aperture to an aperture driving controller so that the aperture driving controller controls a light flux amount of the image sensor.
According to a second aspect of embodiments herein, there is provided a method of uniform exposure of continuously taken photographs, comprising: acquiring preview image data of the image sensor at the current moment, and judging whether the image sensor acquires the image data at the previous moment; if the image sensor acquires the image data at the previous moment, identifying the scene of the image data at the previous moment and the scene of the preview image data of the image sensor at the current moment, matching the two identified scenes, and judging whether the two identified scenes have the same area; if the two scenes have the same area, calculating the exposure of the same area in the image data at the previous moment, and calculating the exposure parameter combination required by the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture; if the two scenes do not have the same area, calculating the exposure parameter combination required at the current moment according to a preset automatic exposure algorithm; sending the exposure parameter combination to a corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor; judging whether a shooting instruction is received or not, if so, sending a trigger signal to the image sensor to enable the image sensor to collect the image data at the current moment, and if not, returning to execute the steps of obtaining the preview image data of the image sensor at the current moment and judging whether the image sensor collects the image data at the previous moment.
Optionally, before the step of sending the exposure parameter combination to the corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor, the method further includes: and if the image sensor does not acquire the image data at the previous moment, calculating an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm.
Optionally, if the two scenes have the same area, calculating the exposure amount of the same area in the image data at the previous time, and calculating the exposure parameter combination required at the current time by combining a preset exposure algorithm includes: counting the brightness values of the same area in the image data at the previous moment; calculating the exposure of the same area in the image data at the previous moment according to the brightness value; and calculating the exposure parameter combination required by the current moment by taking the exposure as the expected value of the exposure required by the image sensor at the current moment and combining a preset exposure algorithm.
Optionally, if the two scenes do not have the same area, the step of calculating the exposure parameter combination required at the current time according to a preset automatic exposure algorithm includes: counting the average brightness value or the weight brightness value of the preview image data at the current moment; calculating the exposure of the preview image data at the current moment according to the brightness value; and calculating the exposure parameter combination required at the current moment by combining a preset exposure algorithm according to the exposure.
Optionally, the step of sending the exposure parameter combinations to the corresponding parameter controllers, so that the parameter controllers control the exposure parameter combinations of the image sensors includes: sending the parameters of the exposure time and the gain to an exposure and gain controller, so that the exposure and gain controller controls the exposure time and the gain of the image sensor; and sending the parameters of the diaphragm to a diaphragm driving controller, so that the diaphragm driving controller controls the light transmission amount of the image sensor.
According to a third aspect of embodiments herein, there is provided an apparatus for equalizing exposure amounts of consecutively photographed pictures, comprising: the data acquisition module is configured to acquire preview image data of the image sensor at the current moment and judge whether the image sensor acquires the image data at the previous moment; the scene identification matching module is configured to identify a scene of the image data at the previous moment and a scene of preview image data of the image sensor at the current moment if the image sensor acquires the image data at the previous moment, match the two identified scenes and judge whether the two identified scenes have the same area; the exposure parameter calculation first module is configured to calculate the exposure amount of the same area in the image data at the last moment if the two scenes have the same area, and calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture; the exposure parameter calculation second module is configured to calculate an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm if the two scenes do not have the same area; a parameter setting module configured to transmit the exposure parameter combination to a corresponding parameter controller so that the parameter controller controls the exposure parameter combination of the image sensor; the data acquisition module is configured to acquire image data of a current moment, and if the shooting instruction is not received, the data acquisition module sends a command for continuously executing a corresponding function to the data acquisition module.
The beneficial effects of the embodiment of the specification are as follows:
after preview image data at the current moment and image data at the previous moment are obtained, identifying scenes of the two data, matching the two identified scenes, and judging whether the two identified scenes have the same area; if the two scenes have the same area, taking the exposure of the image data at the previous moment as the expected value of the exposure required at the current moment, and calculating the exposure parameter combination required at the current moment according to an exposure algorithm so as to ensure that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment; if the two scenes do not have the same area, calculating an exposure parameter combination according to an automatic exposure algorithm; after the exposure parameter combination is obtained, the exposure parameters are sent to the corresponding parameter controllers, and the exposure parameters required by the image sensor are adjusted through the parameter controllers; and judging whether to acquire the image data at the current moment according to the remote shooting instruction. The method comprises the steps of conducting brightness information statistics aiming at the same area of image data at the previous moment and the image data at the current moment, calculating exposure according to the brightness value of the same area in the image data at the previous moment, controlling the exposure of the image data collected at the current moment, ensuring that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment, relating the exposure of the pictures which are shot independently and have spatial domain relevance in a time domain, ensuring that the exposure of the same area in the pictures which are shot continuously is consistent all the time, and solving the problem of the fault phenomenon of discontinuous brightness of the continuous area during later-period picture splicing caused by the difference of the exposure of the same area of different pictures in the prior art.
The innovation points of the embodiment of the specification comprise:
1. the method includes the steps of conducting brightness information statistics on the same area of image data at the previous moment and the same area of image data at the current moment, calculating exposure according to the brightness value of the same area in the image data at the previous moment, controlling the exposure of the image data acquired at the current moment, ensuring that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment, relating the exposure of pictures which are shot independently and have spatial domain relevance in a time domain, ensuring that the exposure of the same area in the pictures shot continuously is consistent all the time, solving the problem that the continuous area brightness is discontinuous in a fault phenomenon caused by the difference of the exposure of the same area of different pictures in the prior art when the pictures are spliced in the later period, and is one of innovation points of the embodiment of the specification.
Drawings
In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present specification, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a schematic diagram of an apparatus illustrating a system for consistent exposure of continuously taken photographs in accordance with an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating a method for consistent exposure of continuously taken photos according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart illustrating a method for consistent exposure of continuously taken photos according to an embodiment of the present disclosure;
FIG. 4 is a block diagram illustrating an apparatus for consistent exposure of continuously taken photographs according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments in the present specification without any inventive step are within the scope of the present specification.
It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present specification and the drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the specification discloses a system, a method and a device for keeping consistent exposure of continuously shot pictures. The following are detailed below.
FIG. 1 is a schematic diagram of an apparatus illustrating a system for consistent exposure of continuously taken photographs according to an embodiment of the present disclosure. As shown in fig. 1, a system for consistent exposure of continuously taken photos provided in an embodiment of the present disclosure may include:
the image sensor 110 is configured to acquire image data, store the acquired image data in a corresponding storage area, acquire preview image data, and send the acquired preview image data to the processor.
The processor 120 includes: the system comprises a data acquisition module, a scene recognition matching module, an exposure parameter calculation first module, an exposure parameter calculation second module, a parameter setting module and a data acquisition triggering module, wherein:
the data acquisition module is configured to acquire preview image data of the image sensor at the current moment and judge whether the image sensor acquires the image data at the previous moment; the scene identification matching module is configured to identify a scene of the image data at the previous moment and a scene of preview image data of the image sensor at the current moment if the image sensor acquires the image data at the previous moment, match the two identified scenes and judge whether the two identified scenes have the same area; the exposure parameter calculation first module is configured to calculate the exposure amount of the same region in the image data at the last moment if the two scenes have the same region, and calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture; the exposure parameter calculation second module is configured to calculate an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm if the two scenes do not have the same area; the parameter setting module is configured to send the exposure parameter combination to a corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor; the acquired data triggering module is configured to judge whether a shooting instruction is received, if the shooting instruction is received, a triggering signal is sent to the image sensor, so that the image sensor acquires image data at the current moment, and if the shooting instruction is not received, an instruction for continuously executing a corresponding function is sent to the data acquisition module.
In one embodiment, the exposure parameter calculation first module includes:
a first luminance value statistic submodule configured to count luminance values of the same region in the image data at a previous time; the exposure calculation first submodule is configured to deduce the exposure of the same area in the image data at the last moment according to the brightness value; and the exposure parameter calculation first sub-module is configured to calculate the exposure parameter combination required by the current moment by taking the exposure as the expected value of the exposure required by the image sensor at the current moment and combining a preset exposure algorithm.
In a specific embodiment, the exposure parameter second calculation submodule includes: the second luminance value statistics submodule is configured to count an average luminance value or a weight luminance value of the preview image data at the current moment; the exposure calculation second submodule is configured to calculate the exposure of the preview image data at the current moment according to the brightness value; and the exposure parameter calculation second sub-module is configured to calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm according to the exposure amount.
In one embodiment, the parameter setting module comprises: an exposure time and gain parameter setting sub-module configured to transmit parameters of the exposure time and gain to an exposure and gain controller so that the exposure and gain controller controls the exposure time and gain of the image sensor; an aperture parameter setting submodule configured to transmit a parameter of the aperture to an aperture driving controller so that the aperture driving controller controls a light flux amount of the image sensor.
And an aperture driving controller 130 for controlling the light flux amount of the image sensor according to the received aperture parameter.
An exposure and gain controller 140 for controlling the exposure time and gain of the image sensor according to the received exposure time and gain parameters.
According to the content, after the image acquisition device acquires the preview image data of the current moment, the image acquisition device sends the preview image data to the processor; the processor calls the image data at the previous moment, if the image data at the previous moment is not called, the average brightness value or the weight brightness value of the preview image data at the current moment is counted, the exposure of the preview image data at the current moment is calculated according to the brightness value, and the exposure parameter combination required by the current moment is calculated according to the exposure by combining a preset exposure algorithm; if the image data at the previous moment is called, identifying a scene of preview image data at the current moment and a scene of image data at the previous moment, matching the two identified scenes, counting the brightness value of the same area in the image data at the previous moment if the two scenes have the same area, calculating the exposure amount of the same area in the image data at the previous moment according to the brightness value, taking the exposure amount as the expected value of the exposure amount required by the image sensor at the current moment, and calculating the exposure parameter combination required by the current moment by combining a preset exposure algorithm; if the two scenes do not have the same area, counting the average brightness value or the weight brightness value of the preview image data at the current moment, calculating the exposure of the preview image data at the current moment according to the brightness value, and calculating the exposure parameter combination required by the current moment by combining a preset exposure algorithm according to the exposure; after acquiring the exposure parameter combination, the processor respectively sends the parameters of the aperture, the exposure time and the gain parameters to the aperture driving controller and the exposure and gain controller; the aperture driving controller controls the light flux amount of the image sensor according to the received aperture parameters, and the exposure and gain controller controls the exposure time and the gain of the image sensor according to the received exposure time and the received gain parameters; the processor judges whether to send a trigger signal to the image sensor according to a remote shooting instruction, and the image sensor acquires image data at the current moment according to the trigger signal. The method comprises the steps of conducting brightness information statistics aiming at the same area of image data at the previous moment and the image data at the current moment, calculating exposure according to the brightness value of the same area in the image data at the previous moment, controlling the exposure of the image data collected at the current moment, ensuring that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment, relating the exposure of the pictures which are shot independently and have spatial domain relevance in a time domain, ensuring that the exposure of the same area in the pictures which are shot continuously is consistent all the time, and solving the problem of the fault phenomenon of discontinuous brightness of the continuous area during later-period picture splicing caused by the difference of the exposure of the same area of different pictures in the prior art.
FIG. 2 is a flowchart illustrating a method for consistent exposure of continuously taken photos according to an embodiment of the present disclosure. As shown in fig. 2, the method specifically includes the following steps:
s210: acquiring preview image data of the image sensor at the current moment, and judging whether the image sensor acquires the image data at the previous moment;
the image sensor acquires preview image data of the current moment and sends the preview image data of the current moment to the processor. The processor calls the image data of the previous moment collected by the image sensor stored in the corresponding storage area, and judges whether the image sensor collects the image data of the previous moment or not by judging whether the image sensor collects the image data of the previous moment or not. By the method, the data of two continuous moments acquired by the image sensor can be acquired, the image data of the last moment is stored in the corresponding storage area, post-processing is facilitated, the preview image data of the current moment is not final data, the preview image data does not need to be stored and directly sent to the processor, caching time is shortened, and storage space is saved.
S220: if the image sensor acquires the image data at the previous moment, identifying the scene of the image data at the previous moment and the scene of the preview image data of the image sensor at the current moment, matching the two identified scenes, and judging whether the two identified scenes have the same area;
and identifying and matching the same area of the scene of the image data at the continuous time, and only carrying out brightness statistics on the same area of the image data at the continuous time.
S230: if the two scenes have the same area, calculating the exposure of the same area in the image data at the previous moment, and calculating the exposure parameter combination required by the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture;
if the two scenes have the same area, the processor counts the brightness value of the same area in the image data at the previous moment, calculates the exposure amount of the same area in the image data at the previous moment according to the brightness value, takes the exposure amount as the expected value of the exposure amount required by the image sensor at the current moment, and calculates the exposure parameter combination required at the current moment by combining a preset exposure algorithm. The exposure of the same area in the image data of the current moment and the image data of the previous moment are kept consistent, the exposure of the independently shot pictures with spatial domain relevance is correlated in the time domain, the exposure of the same area in the continuously shot pictures is always kept consistent, and the fault phenomenon that the brightness of the continuous area is discontinuous when the pictures are spliced in the later period caused by the difference of the exposure of the same area of different pictures in the prior art is solved.
S240: if the two scenes do not have the same area, calculating the exposure parameter combination required at the current moment according to a preset automatic exposure algorithm;
the processor counts the average brightness value or the weight brightness value of the preview image data at the current moment, calculates the exposure of the preview image data at the current moment according to the brightness value, and calculates the exposure parameter combination required at the current moment by combining a preset exposure algorithm according to the exposure. Under the condition that the two scenes do not have the same area, the preset automatic exposure algorithm is utilized to solve the exposure parameter combination required at the current moment, and image data with good effect can be obtained.
S250: sending the exposure parameter combination to a corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor;
and after acquiring the exposure parameter combination, the processor respectively sends the parameters of the aperture, the exposure time and the gain parameters to the aperture driving controller and the exposure and gain controller. The aperture driving controller controls the light flux amount of the image sensor according to the received aperture parameters, and the exposure and gain controller controls the exposure time and the gain of the image sensor according to the received exposure time and the received gain parameters. The exposure parameters required by the image sensor are adjusted by the plurality of controllers simultaneously, and each controller is independent from each other, so that a good control effect can be achieved.
S260: judging whether a shooting instruction is received or not, if so, sending a trigger signal to the image sensor to enable the image sensor to collect the image data at the current moment, and if not, returning to execute the steps of obtaining the preview image data of the image sensor at the current moment and judging whether the image sensor collects the image data at the previous moment.
The unmanned aerial vehicle-related operating personnel can remotely control the unmanned aerial vehicle, the importance of the scene of the preview image data of the image sensor is judged, and the irrelevant scene can be ignored, so that the storage space is saved. And for an important scene, sending a shooting instruction to the processor, so that the processor sends a trigger signal to the image sensor, and the image sensor acquires current image data according to the set exposure parameters.
In a general specific embodiment, after acquiring preview image data at a current moment and image data at a previous moment, a processor identifies scenes of the two data, matches the two identified scenes, and determines whether the two identified scenes have the same area; if the two scenes have the same area, taking the exposure of the image data at the previous moment as the expected value of the exposure required at the current moment, and calculating the exposure parameter combination required at the current moment according to an exposure algorithm so as to ensure that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment; if the two scenes do not have the same area, calculating an exposure parameter combination according to an automatic exposure algorithm; after the exposure parameter combination is obtained, the exposure parameters are sent to the corresponding parameter controllers, and the exposure parameters required by the image sensor are adjusted through the parameter controllers; and judging whether to acquire the image data at the current moment according to the remote shooting instruction. The method comprises the steps of conducting brightness information statistics aiming at the same area of image data at the previous moment and the image data at the current moment, calculating exposure according to the brightness value of the same area in the image data at the previous moment, controlling the exposure of the image data collected at the current moment, ensuring that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment, relating the exposure of the pictures which are shot independently and have spatial domain relevance in a time domain, ensuring that the exposure of the same area in the pictures which are shot continuously is consistent all the time, and solving the problem of the fault phenomenon of discontinuous brightness of the continuous area during later-period picture splicing caused by the difference of the exposure of the same area of different pictures in the prior art.
FIG. 3 is a schematic flow chart illustrating a method for consistent exposure of continuously taken photos according to an embodiment of the present disclosure. As shown in fig. 3, after acquiring preview image data at the current time and image data at the previous time, the processor identifies scenes of the two data, matches the two identified scenes, and determines whether the two identified scenes have the same area; if the two scenes have the same area, counting the brightness information of the same area in the image data at the previous moment, and calculating the exposure parameter combination required at the current moment; if the two scenes do not have the same area, calculating the exposure parameter combination required by the current time according to the brightness information of the whole image of the preview image data of the current time, which is set by the algorithm; after the exposure parameter combination is obtained, setting the exposure parameters to the corresponding controllers; and judging whether a remote shooting instruction is received or not, if the processor receives the shooting instruction, sending a trigger signal to the image sensor, acquiring the image data of the current moment by the image sensor according to the currently set exposure parameters, and otherwise, executing the steps again. The method comprises the steps of conducting brightness information statistics aiming at the same area of image data at the previous moment and the image data at the current moment, calculating exposure according to the brightness value of the same area in the image data at the previous moment, controlling the exposure of the image data collected at the current moment, ensuring that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment, relating the exposure of the pictures which are shot independently and have spatial domain relevance in a time domain, ensuring that the exposure of the same area in the pictures which are shot continuously is consistent all the time, and solving the problem of the fault phenomenon of discontinuous brightness of the continuous area during later-period picture splicing caused by the difference of the exposure of the same area of different pictures in the prior art.
FIG. 4 is a block diagram illustrating an apparatus for consistent exposure of continuously taken photographs according to an embodiment of the present disclosure. As shown in fig. 4, an apparatus for equalizing exposure of continuously taken photos according to an embodiment of the present disclosure may include:
a data obtaining module 410, configured to obtain preview image data of the image sensor at a current moment, and determine whether the image sensor acquires image data at a previous moment;
a scene identification matching module 420 configured to, if the image sensor acquires image data at a previous time, identify a scene of the image data at the previous time and a scene of preview image data of the image sensor at a current time, match the two identified scenes, and determine whether there is a same region;
an exposure parameter calculation first module 430, configured to calculate, if the two scenes have the same area, the exposure amount of the same area in the image data at the last time, and calculate, by combining with a preset exposure algorithm, an exposure parameter combination required at the current time; wherein the exposure parameter combination is the combination of exposure time, gain and aperture;
an exposure parameter calculation second module 440 configured to calculate an exposure parameter combination required at the current time according to a preset automatic exposure algorithm if the two scenes do not have the same area;
a parameter setting module 450 configured to transmit the exposure parameter combinations to the corresponding parameter controllers so that the parameter controllers control the exposure parameter combinations of the image sensors;
the collected data triggering module 460 is configured to determine whether a shooting instruction is received, send a triggering signal to the image sensor if the shooting instruction is received, so that the image sensor collects image data at the current time, and send an instruction to continue executing a corresponding function to the data acquisition module if the shooting instruction is not received.
According to the above contents, after the preview image data at the current moment and the image data at the previous moment are obtained, the scenes of the two data are identified, the two identified scenes are matched, and whether the same area exists is judged; if the two scenes have the same area, taking the exposure of the image data at the previous moment as the expected value of the exposure required at the current moment, and calculating the exposure parameter combination required at the current moment according to an exposure algorithm so as to ensure that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment; if the two scenes do not have the same area, calculating an exposure parameter combination according to an automatic exposure algorithm; after the exposure parameter combination is obtained, the exposure parameters are sent to the corresponding parameter controllers, and the exposure parameters required by the image sensor are adjusted through the parameter controllers; and judging whether to acquire the image data at the current moment according to the remote shooting instruction. The method comprises the steps of conducting brightness information statistics aiming at the same area of image data at the previous moment and the image data at the current moment, calculating exposure according to the brightness value of the same area in the image data at the previous moment, controlling the exposure of the image data collected at the current moment, ensuring that the exposure of the image data at the current moment is consistent with the exposure of the same area in the image data at the previous moment, relating the exposure of the pictures which are shot independently and have spatial domain relevance in a time domain, ensuring that the exposure of the same area in the pictures which are shot continuously is consistent all the time, and solving the problem of the fault phenomenon of discontinuous brightness of the continuous area during later-period picture splicing caused by the difference of the exposure of the same area of different pictures in the prior art.
Those of ordinary skill in the art will understand that: the figures are merely schematic representations of one embodiment, and the blocks or processes in the figures are not necessarily required to practice this description.
Those of ordinary skill in the art will understand that: modules in the devices in the embodiments may be distributed in the devices in the embodiments according to the description of the embodiments, or may be located in one or more devices different from the embodiments with corresponding changes. The modules of the above embodiments may be combined into one module, or further split into multiple sub-modules.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solutions of the present specification, and not to limit them; although the present description has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the spirit and scope of the technical solutions of the embodiments of the present specification.
Claims (10)
1. A system for consistent exposure of consecutively taken pictures, comprising: image sensor, treater, diaphragm drive controller, exposure and gain control ware, wherein:
the image sensor is used for acquiring image data, storing the acquired image data into a corresponding storage area, acquiring preview image data and sending the acquired preview image data to the processor;
the processor includes: the system comprises a data acquisition module, a scene recognition matching module, an exposure parameter calculation first module, an exposure parameter calculation second module, a parameter setting module and a data acquisition triggering module, wherein:
the data acquisition module is configured to acquire preview image data of the image sensor at the current moment and judge whether the image sensor acquires the image data at the previous moment;
the scene identification matching module is configured to identify a scene of the image data at the previous moment and a scene of preview image data of the image sensor at the current moment if the image sensor acquires the image data at the previous moment, match the two identified scenes and judge whether the two identified scenes have the same area;
the exposure parameter calculation first module is configured to calculate the exposure amount of the same region in the image data at the last moment if the two scenes have the same region, and calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture;
the exposure parameter calculation second module is configured to calculate an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm if the two scenes do not have the same area;
the parameter setting module is configured to send the exposure parameter combination to a corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor;
the acquired data triggering module is configured to judge whether a shooting instruction is received or not, if the shooting instruction is received, a triggering signal is sent to the image sensor so that the image sensor acquires image data at the current moment, and if the shooting instruction is not received, an instruction for continuously executing a corresponding function is sent to the data acquisition module;
the aperture driving controller is used for controlling the light transmission amount of the image sensor according to the received aperture parameters;
and the exposure and gain controller is used for controlling the exposure time and the gain of the image sensor according to the received exposure time and gain parameters.
2. The system of claim 1, wherein the exposure parameter calculation first module comprises:
a first luminance value statistic submodule configured to count luminance values of the same region in the image data at a previous time;
the exposure calculation first submodule is configured to deduce the exposure of the same area in the image data at the last moment according to the brightness value;
and the exposure parameter calculation first sub-module is configured to calculate the exposure parameter combination required by the current moment by taking the exposure as the expected value of the exposure required by the image sensor at the current moment and combining a preset exposure algorithm.
3. The system of claim 1, wherein the exposure parameter second calculation submodule comprises:
the second luminance value statistics submodule is configured to count an average luminance value or a weight luminance value of the preview image data at the current moment;
the exposure calculation second submodule is configured to calculate the exposure of the preview image data at the current moment according to the brightness value;
and the exposure parameter calculation second sub-module is configured to calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm according to the exposure amount.
4. The apparatus of claim 1, wherein the parameter setting module comprises:
an exposure time and gain parameter setting sub-module configured to transmit parameters of the exposure time and gain to an exposure and gain controller so that the exposure and gain controller controls the exposure time and gain of the image sensor;
an aperture parameter setting submodule configured to transmit a parameter of the aperture to an aperture driving controller so that the aperture driving controller controls a light flux amount of the image sensor.
5. A method for consistent exposure of continuously shot photos, comprising:
acquiring preview image data of the image sensor at the current moment, and judging whether the image sensor acquires the image data at the previous moment;
if the image sensor acquires the image data at the previous moment, identifying the scene of the image data at the previous moment and the scene of the preview image data of the image sensor at the current moment, matching the two identified scenes, and judging whether the two identified scenes have the same area;
if the two scenes have the same area, calculating the exposure of the same area in the image data at the previous moment, and calculating the exposure parameter combination required by the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture;
if the two scenes do not have the same area, calculating the exposure parameter combination required at the current moment according to a preset automatic exposure algorithm;
sending the exposure parameter combination to a corresponding parameter controller, so that the parameter controller controls the exposure parameter combination of the image sensor;
judging whether a shooting instruction is received or not, if so, sending a trigger signal to the image sensor to enable the image sensor to collect the image data at the current moment, and if not, returning to execute the steps of obtaining the preview image data of the image sensor at the current moment and judging whether the image sensor collects the image data at the previous moment.
6. The method of claim 5, further comprising, prior to the step of sending the exposure parameter combinations to respective parameter controllers such that the parameter controllers control the exposure parameter combinations of the image sensors:
and if the image sensor does not acquire the image data at the previous moment, calculating an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm.
7. The method according to claim 5, wherein if the two scenes have the same area, calculating the exposure of the same area in the image data at the previous time, and the step of calculating the exposure parameter combination required at the current time by combining a preset exposure algorithm comprises:
counting the brightness values of the same area in the image data at the previous moment;
calculating the exposure of the same area in the image data at the previous moment according to the brightness value;
and calculating the exposure parameter combination required by the current moment by taking the exposure as the expected value of the exposure required by the image sensor at the current moment and combining a preset exposure algorithm.
8. The method according to claim 5, wherein if the two scenes do not have the same area, the step of calculating the exposure parameter combination required at the current time according to a preset automatic exposure algorithm comprises:
counting the average brightness value or the weight brightness value of the preview image data at the current moment;
calculating the exposure of the preview image data at the current moment according to the brightness value;
and calculating the exposure parameter combination required at the current moment by combining a preset exposure algorithm according to the exposure.
9. The method of claim 5, wherein the step of sending the exposure parameter combinations to the respective parameter controllers such that the parameter controllers control the exposure parameter combinations of the image sensors comprises:
sending the parameters of the exposure time and the gain to an exposure and gain controller, so that the exposure and gain controller controls the exposure time and the gain of the image sensor;
and sending the parameters of the diaphragm to a diaphragm driving controller, so that the diaphragm driving controller controls the light transmission amount of the image sensor.
10. An apparatus for consistent exposure of continuously taken pictures, comprising:
the data acquisition module is configured to acquire preview image data of the image sensor at the current moment and judge whether the image sensor acquires the image data at the previous moment;
the scene identification matching module is configured to identify a scene of the image data at the previous moment and a scene of preview image data of the image sensor at the current moment if the image sensor acquires the image data at the previous moment, match the two identified scenes and judge whether the two identified scenes have the same area;
the exposure parameter calculation first module is configured to calculate the exposure amount of the same area in the image data at the last moment if the two scenes have the same area, and calculate the exposure parameter combination required at the current moment by combining a preset exposure algorithm; wherein the exposure parameter combination is the combination of exposure time, gain and aperture;
the exposure parameter calculation second module is configured to calculate an exposure parameter combination required at the current moment according to a preset automatic exposure algorithm if the two scenes do not have the same area;
a parameter setting module configured to transmit the exposure parameter combination to a corresponding parameter controller so that the parameter controller controls the exposure parameter combination of the image sensor;
the data acquisition module is configured to acquire image data of a current moment, and if the shooting instruction is not received, the data acquisition module sends a command for continuously executing a corresponding function to the data acquisition module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911282432.5A CN110958400B (en) | 2019-12-13 | 2019-12-13 | System, method and device for keeping exposure of continuously shot pictures consistent |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911282432.5A CN110958400B (en) | 2019-12-13 | 2019-12-13 | System, method and device for keeping exposure of continuously shot pictures consistent |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110958400A true CN110958400A (en) | 2020-04-03 |
| CN110958400B CN110958400B (en) | 2021-11-23 |
Family
ID=69981501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911282432.5A Active CN110958400B (en) | 2019-12-13 | 2019-12-13 | System, method and device for keeping exposure of continuously shot pictures consistent |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110958400B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112672060A (en) * | 2020-12-29 | 2021-04-16 | 维沃移动通信有限公司 | Shooting method and device and electronic equipment |
| CN113835462A (en) * | 2021-09-13 | 2021-12-24 | 星宸科技股份有限公司 | Control circuit and control method of image sensor |
| CN115134492A (en) * | 2022-05-31 | 2022-09-30 | 北京极豪科技有限公司 | Image acquisition method, electronic device and computer readable medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801919A (en) * | 2011-05-27 | 2012-11-28 | 佳能株式会社 | Image capture apparatus and method of controlling the same |
| CN107872631A (en) * | 2017-12-06 | 2018-04-03 | 广东欧珀移动通信有限公司 | Image capturing method, device and mobile terminal based on dual camera |
| CN108337445A (en) * | 2018-03-26 | 2018-07-27 | 华为技术有限公司 | Photographic method, relevant device and computer storage media |
| CN110166705A (en) * | 2019-06-06 | 2019-08-23 | Oppo广东移动通信有限公司 | High dynamic range HDR image generation method and device, electronic equipment, computer readable storage medium |
| CN110445988A (en) * | 2019-08-05 | 2019-11-12 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
-
2019
- 2019-12-13 CN CN201911282432.5A patent/CN110958400B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801919A (en) * | 2011-05-27 | 2012-11-28 | 佳能株式会社 | Image capture apparatus and method of controlling the same |
| CN107872631A (en) * | 2017-12-06 | 2018-04-03 | 广东欧珀移动通信有限公司 | Image capturing method, device and mobile terminal based on dual camera |
| CN108337445A (en) * | 2018-03-26 | 2018-07-27 | 华为技术有限公司 | Photographic method, relevant device and computer storage media |
| CN110166705A (en) * | 2019-06-06 | 2019-08-23 | Oppo广东移动通信有限公司 | High dynamic range HDR image generation method and device, electronic equipment, computer readable storage medium |
| CN110445988A (en) * | 2019-08-05 | 2019-11-12 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112672060A (en) * | 2020-12-29 | 2021-04-16 | 维沃移动通信有限公司 | Shooting method and device and electronic equipment |
| CN113835462A (en) * | 2021-09-13 | 2021-12-24 | 星宸科技股份有限公司 | Control circuit and control method of image sensor |
| CN115134492A (en) * | 2022-05-31 | 2022-09-30 | 北京极豪科技有限公司 | Image acquisition method, electronic device and computer readable medium |
| CN115134492B (en) * | 2022-05-31 | 2024-03-19 | 北京极光智芯科技有限公司 | Image acquisition method, electronic device, and computer-readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110958400B (en) | 2021-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110958400B (en) | System, method and device for keeping exposure of continuously shot pictures consistent | |
| CN110351490B (en) | Exposure method, exposure device and image pickup equipment | |
| CN111182268B (en) | Video data transmission method, system, equipment and shooting device | |
| US9473689B2 (en) | Method for automatically switching terminal focus mode and terminal | |
| JP4942185B2 (en) | Imaging apparatus, pan head control method, program, and storage medium | |
| CN109922275B (en) | Self-adaptive adjustment method and device of exposure parameters and shooting equipment | |
| US20170124821A1 (en) | Alarm method and device | |
| EP2624538B1 (en) | Image signal processing apparatus and image signal processing method | |
| US20090231364A1 (en) | Display system capable of auto-regulating brightness and brightness auto-regulating method thereof | |
| CN104853112A (en) | Method and apparatus for controlling long exposure time | |
| US8913150B2 (en) | Dynamic image capture utilizing prior capture settings and user behaviors | |
| CN108496352B (en) | Shooting method and device, image processing method and device | |
| CN108933903B (en) | Camera fault processing method, intelligent terminal and device with storage function | |
| US8223258B2 (en) | Backlight photographing method | |
| US10609265B2 (en) | Methods and apparatus for synchronizing camera flash and sensor blanking | |
| CN111246114B (en) | Photographing processing method and device, terminal equipment and storage medium | |
| US10284767B2 (en) | Shooting device, shooting method, and non-transitory computer readable recording medium storing program | |
| KR101038650B1 (en) | Adaptive modeling method for background image, detecting method and system for illegal-stopping and parking vehicle using it | |
| CN106708070B (en) | Aerial photography control method and device | |
| CN111698493A (en) | White balance processing method and device | |
| KR20150088201A (en) | Imaging apparatus, imaging control method and program | |
| JP6265602B2 (en) | Surveillance camera system, imaging apparatus, and imaging method | |
| US7813629B2 (en) | Photographing apparatus, and control method and computer program product for controlling the same | |
| CN105721829B (en) | Monitoring camera, recording equipment for monitoring and monitoring system | |
| CN112312108B (en) | White balance abnormity determining method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211115 Address after: 201600 No. 292, Lane 2188, Wencheng Road, Songjiang District, Shanghai Applicant after: Qu Jiantao Address before: 201613 No. 1, Lane 288, Mingnan Road, Songjiang District, Shanghai Applicant before: Shanghai Seagull digital camera Co., Ltd |
|
| TA01 | Transfer of patent application right |