CN110708472B - Control method, system and equipment for inhibiting exposure of moving bright light source - Google Patents
Control method, system and equipment for inhibiting exposure of moving bright light source Download PDFInfo
- Publication number
- CN110708472B CN110708472B CN201911081507.3A CN201911081507A CN110708472B CN 110708472 B CN110708472 B CN 110708472B CN 201911081507 A CN201911081507 A CN 201911081507A CN 110708472 B CN110708472 B CN 110708472B
- Authority
- CN
- China
- Prior art keywords
- brightness
- exposure
- target area
- target
- light source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
Abstract
The invention provides a method, a system and equipment for controlling exposure of a light source for inhibiting movement, which comprises the steps of obtaining the brightness of a target area in a display unit as the current brightness; judging whether the current brightness is within a preset brightness threshold interval; if the current brightness is larger than the upper limit value of the preset brightness threshold interval, recording the target area as overexposure, and suppressing the exposure of the target area to reduce the current brightness to the target brightness; and if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, recording the target area as underexposure, unlocking the exposure of the target area, and increasing the current brightness back to the target brightness. The invention can not depend on the detection of the target subject, can quickly suppress the exposure, and can capture and identify the target subject in a limited time. When the target object moves, the display picture can be kept from flickering and stable.
Description
Technical Field
The invention relates to the technical field of monitoring, in particular to a method, a system and equipment for controlling exposure of a light source for inhibiting movement, which are used in the field of video monitoring.
Background
With the increasing importance of scientific and technological development in practical scene applications, the demand for effective image data information is more and more urgent, and the front-end video acquisition device is used as an image data inlet and needs to adapt to a data source main body to be acquired as far as possible in an exposure strategy. In the field of intelligent monitoring application, the brightness of the whole video static picture is opposite to the exposure strategy of a main body capturing and identifying a moving target. In a road application scene, it is desirable that exposure can be quickly suppressed when a moving vehicle passes by, so as to meet the requirements of capturing and identifying vehicle characteristics, and the image brightness meeting the requirements of security monitoring or face capturing and identifying applications can be stably and slowly restored when the vehicle is out of the image. In the existing exposure strategies, the image brightness is suppressed by limiting the upper limit of the exposure factor aiming at vehicle capture and identification, and the image brightness is improved by releasing the exposure control factor aiming at human faces or video monitoring application scenes. The method adopts the scheme that when a target main body is not detected, the average brightness of a current frame and the preset brightness are used as exposure control bases. However, in an excessively dark or excessively exposed scene, the probability of detecting the target object is low, even if the preset brightness information is referred and the adjusting speed is not timely, the detection target may leave the image frame, and the capturing and identifying rate of the target main body cannot be improved. Moreover, the existing exposure strategy has the following two problems: firstly, brightness required by capturing and identifying a moving vehicle and motion smear brought by a slow shutter cannot be quickly inhibited; secondly, the picture frequently flickers when a moving vehicle follows, and the picture cannot be kept stable.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, it is an object of the present invention to provide a method, system and apparatus for suppressing the moving bright light source from automatic exposure control, which can solve the technical problems in the prior art.
To achieve the above and other related objects, the present invention provides an automatic exposure control method for suppressing a moving bright light source, the method comprising the steps of:
acquiring the brightness of a target area in a display unit as the current brightness;
judging whether the current brightness is within a preset brightness threshold interval; if the current brightness is larger than the upper limit value of the preset brightness threshold interval, suppressing the exposure of the target area to reduce the current brightness to the target brightness; and if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, unlocking the exposure of the target area, and increasing the current brightness back to the target brightness.
Optionally, the method further includes detecting whether a bright light source exists in the target area, specifically including:
dividing the display unit into a plurality of display areas, the target area including one or more display areas;
judging whether the brightness of the display area is greater than the upper limit value of a preset brightness threshold interval or not, and if the brightness of the display area is greater than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area;
and if the marking times of the brightest display area in the target area are more than the preset times, the target area has a bright light source.
Optionally, during the exposure process of pressing the target area, detecting whether a brightest display area still exists in the target area; if the brightest display area still exists in the target area, continuing to suppress the exposure of the target area; and if the brightest display area does not exist in the target area, locking the exposure of the target area.
Optionally, if it is detected that a bright light source exists in the target area, mapping an acceleration weight coefficient of the exposure amount by piecewise linear interpolation according to the brightness of the bright light source; and adjusting an acceleration weight coefficient of the exposure amount, and accelerating the exposure of the target area to enable the brightness of the target area to quickly reach the target brightness.
Optionally, the exposure of the target area is suppressed according to an aperture, a shutter, a sensor, a fill light and a processor.
Optionally, the exposure of the target area is unlocked, and the current brightness is raised back to the target brightness by adjusting a scaling factor of the exposure, wherein the calculation of the scaling factor includes:
Ratio＝(Luma/Tar)*Accuracy；
in the formula, Ratio represents a scale factor, Luma represents display unit luminance, Tar represents target luminance, and Accuracy represents calculation Accuracy.
The invention also provides an automatic exposure control system for inhibiting the motion bright light source, which comprises:
the brightness acquisition module is used for acquiring the brightness of a target area in the display unit as the current brightness;
the exposure control module is used for judging whether the current brightness is within a preset brightness threshold interval; the exposure control module comprises an exposure pressing unit and an exposure unlocking unit; if the current brightness is larger than the upper limit value of the preset brightness threshold interval, the exposure pressing unit presses the exposure of the target area to reduce the current brightness to the target brightness; and if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, the exposure unlocking unit unlocks the exposure of the target area, and the current brightness is increased back to the target brightness.
Optionally, the brightness acquiring module further includes a brightness detecting unit, configured to detect whether a bright light source exists in the target area, and specifically includes:
dividing the display unit into a plurality of display areas, the target area including one or more display areas;
judging whether the brightness of the display area is greater than the upper limit value of a preset brightness threshold interval or not, and if the brightness of the display area is greater than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area;
and if the marking times of the brightest display area in the target area are more than the preset times, the target area has a bright light source.
Optionally, during the exposure process of suppressing the target area by the exposure suppressing unit, detecting whether a brightest display area still exists in the target area; if the brightest display area still exists in the target area, continuing to suppress the exposure of the target area; and if the brightest display area does not exist in the target area, locking the exposure of the target area.
Optionally, the exposure of the target area is unlocked, and the current brightness is raised back to the target brightness by adjusting a scaling factor of the exposure, wherein the calculation of the scaling factor includes:
Ratio＝(Luma/Tar)*Accuracy；
in the formula, Ratio represents a scale factor, Luma represents display unit luminance, Tar represents target luminance, and Accuracy represents calculation Accuracy.
The present invention also provides an apparatus comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform a method as described in one or more of the above.
As described above, the method and system for controlling automatic exposure by suppressing the moving bright light source according to the present invention have the following advantages: acquiring the brightness of a target area in a display unit as the current brightness; judging whether the current brightness is within a preset brightness threshold interval; if the current brightness is larger than the upper limit value of the preset brightness threshold interval, recording the target area as overexposure, and suppressing the exposure of the target area to reduce the current brightness to the target brightness; and if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, recording the target area as underexposure, unlocking the exposure of the target area, and increasing the current brightness back to the target brightness. The invention can not depend on the detection of the target subject, can quickly suppress the exposure, and can capture and identify the target subject in a limited time. When the target object moves, the display picture can be kept from flickering and stable.
Drawings
Fig. 1 is a flowchart illustrating an automatic exposure control method for suppressing a moving bright light source according to an embodiment.
Fig. 2 is a flowchart illustrating a method for suppressing a moving bright light source from automatic exposure control according to another embodiment.
Fig. 3 is a schematic diagram of a display screen division according to an embodiment.
Fig. 4a is a schematic diagram of a mapping relationship according to an embodiment.
Fig. 4b is a schematic diagram of a mapping relationship according to another embodiment.
FIG. 5 is a schematic diagram of an exposure line configuration according to one embodiment.
Fig. 6 is a schematic flow chart of a lift-back mechanism according to an embodiment.
Fig. 7 is a schematic diagram of a hardware structure of a terminal device according to an embodiment.
Fig. 8 is a schematic diagram of a hardware structure of a terminal device according to another embodiment.
Description of the element reference numerals
1100 input device
1101 first processor
1102 output device
1103 first memory
1104 communication bus
1200 processing assembly
1201 second processor
1202 second memory
1203 communication assembly
1204 Power supply Assembly
1205 multimedia assembly
1206 voice assembly
1207 input/output interface
1208 sensor assembly
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
Please refer to fig. 1 to 8. It should be noted that the drawings provided in the present embodiment are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated. The structures, proportions, sizes, and other dimensions shown in the drawings and described in the specification are for understanding and reading the present disclosure, and are not intended to limit the scope of the present disclosure, which is defined in the claims, and are not essential to the art, and any structural modifications, changes in proportions, or adjustments in size, which do not affect the efficacy and attainment of the same are intended to fall within the scope of the present disclosure. In addition, the terms "upper", "lower", "left", "right", "middle" and "one" used in the present specification are for clarity of description, and are not intended to limit the scope of the present invention, and the relative relationship between the terms and the terms is not to be construed as a scope of the present invention.
Target area: in this application, a region of interest (ROI).
Exposure: the photographic negative or the photographic paper is exposed.
Exposure amount: the light-passing time (determined by the shutter speed) and the light-passing area (determined by the aperture size) are used.
Overexposure: the brightness of the picture counted in real time in the region of interest is greater than the brightness of the picture expected by the user.
Underexposure: and the brightness of the picture counted in real time by the region of interest is less than the brightness of the picture expected by the user.
Referring to fig. 1 and fig. 2, the present embodiment provides a method for suppressing a moving bright light source from automatic exposure control, the method includes the following steps:
s100, acquiring the brightness of a target area in a display unit as the current brightness. Obtaining the brightness of a target area in a display unit, and detecting whether the target area has a bright light source specifically includes:
dividing the display unit into a plurality of display areas, the target area including one or more display areas;
judging whether the brightness of the display area is greater than the upper limit value of a preset brightness threshold interval or not, and if the brightness of the display area is greater than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area;
and if the marking times of the brightest display area in the target area are more than the preset times, the target area has a bright light source.
The display unit comprises a display picture of the image acquisition equipment and a picture which is transmitted to the display to be displayed after the picture is acquired by the image acquisition equipment. The region of interest is in this application a region of interest (ROI).
As shown in fig. 3, the display screen is divided into M × N display blocks or display areas. A region of interest ROI or target region is configured for detecting the brightest region. If the brightness of the display area is larger than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area; or, if the brightness of the display block is greater than the upper limit value of the preset brightness threshold interval, marking the display block as a bright block. And records the coordinate Num of the brightest display area or bright blocki(x, y); meanwhile, the marking times of the brightest display area or the bright block are increased by one, namely Num + 1; num is the number of times the brightest display area or bright block is marked. Presetting the number of the brightest display areas or bright blocks as Numblock(ii) a When the number of times of marking the brightest display area or the bright block is more than the preset number, that is, Num is more than NumblockAnd if the coordinates of the bright blocks meet the connection condition or are in a certain redundant area, the bright light source is considered to exist currently. If the brightness corresponding to the bright block is within the preset brightness threshold interval, taking the bright block as a normal bright block; if the brightness is smaller than the lower limit value of the preset brightness threshold interval, the brightest display area or the bright block is marked as underexposure.
S200, judging whether the current brightness is within a preset brightness threshold interval; in the embodiment of the present application, the preset brightness threshold interval may be set to [ Luma ], for exampledown，Lumaup]. Wherein, LumaupFor presetting an upper limit value of a brightness threshold interval, LumadownIs the lower limit value of the preset brightness threshold interval.
S210, if the current brightness is larger than the upper limit value of a preset brightness threshold interval, recording the target area as overexposure; and S220, after the mark overexposure, suppressing the exposure of the target area to reduce the current brightness to the target brightness. And if the target area is detected to have the bright light source, accelerating the exposure of the suppressed target area by adjusting the acceleration weight of the exposure. As shown in fig. 3 to 5, when the device is applied to a road scene and a bright light source is detected, if the light source is a vehicle headlight and its halo, features such as a vehicle outline and a license plate are difficult to distinguish, so that exposure control factors need to be suppressed quickly and accurately, so that a vehicle target can be captured and identified in time.
The exposure strategy in the application can control and adjust the exposure factors according to the brightness of the picture, and the acceleration mechanism is to accelerate the adjustment speed in the exposure adjustment process. Can obtain the information of real-time exposure amount during exposure control, dynamically add the acceleration Weight coefficient Weight of the adjusted exposure amount when the existence of a bright light source is sensediThereby accelerating the exposure adjustment and enabling the exposure to reach the target brightness quickly. The exposure acceleration weight coefficient is mapped by subsection linear interpolation according to the brightness of the bright light source, and when the brightness is higher, the acceleration weight is calculated to be larger, otherwise, the acceleration weight is lower. Setting the threshold value of the brightest area interval [ Lumaa，Lumab，Lumac，Lumad]And acceleration Weight [ Weight ] corresponding theretoa，Weightb，Weightc，Weightd]And carrying out piecewise linear interpolation, wherein the mapping relation is shown in figure 4a, and an exposure acceleration weight coefficient is obtained.
The application also changes the brightness of the display picture by adjusting the execution sequence of the exposure factors. Exposure factors include aperture, shutter, sensor capability, fill light, platform capability (i.e., processor capability of the image capture device). And suppressing the exposure of the target area by controlling the aperture, the shutter, the sensor of the image acquisition equipment, the light supplement lamp and the processor of the image acquisition equipment.
Fig. 5 of the present application shows a set of exposure line configurations. As shown in fig. 5, in the exposure of the pressing target area, the adjustment of the exposure factor by the present application is set according to the initial exposure line. In selecting the exposure control factor, since the capture target subject is a moving object, the shutter time is first selected for exposure control adjustment. As shown in fig. 5, exposure adjustment may be performed using the option of (r). When determining to adjust the control factor to carry out exposure adjustment, firstly recording the control factor and intensity of the previous state of exposure adjustment, then adjusting from large to small according to the control factor label, at the moment, determining to carry out shutter suppression adjustment, therefore, the adjustment sequence is from the third to the fourth, when the shutter is adjusted to meet the shutter threshold value that the moving object can not generate motion smear, if the bright light source still exists at the moment, the rest control factors can be adjusted from large to small according to the recorded initial state intensity of the exposure line configuration label. Wherein, the first, second, third, and fourth … represent the control sequence or control procedure of the exposure factors.
As shown in fig. 6, during the exposure process of pressing the target area, it is also detected in real time whether the brightest display area still exists in the target area; if the brightest display area still exists in the target area, continuing to suppress the exposure of the target area; if the brightest display area does not exist in the target area, the exposure of the target area is locked, and the display picture can be kept stable after the exposure is locked.
For a road application scene, a plurality of vehicles are probably driven along, and a common exposure algorithm adjusts the bright light of the post-exposure pressing part within a certain range according to the brightness of the whole picture. However, when the bright light source is changed, the video image repeatedly flickers in a short time due to the automatic adjustment of the exposure control, and therefore, it is necessary to keep the video image or the display image stable.
Automatic exposure calculates and counts brightness data of the brightest display area in real time during the exposure process of adjusting the control factor to suppress the target area. When the brightness of the brightest display area is larger than the upper limit of the set brightness threshold, performing rapid suppression; after the suppression exposure, when the brightness of the brightest display area and the brightness of the whole picture are in a normal threshold range or feedback information exists, the exposure is locked to prevent the picture from flickering. And after the exposure is locked, continuously calculating and counting the brightness information of the brightest display area, unlocking the exposure if the brightness of the brightest display area is detected to be larger than the upper limit of the set brightness threshold, enabling the brightness of the brightest display area to be within the range of the set brightness threshold again, then locking the exposure again, and unlocking the exposure within a certain time and executing a back-up mechanism if the brightness of the brightest display area is not larger than the upper limit of the set brightness threshold.
S230, if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, recording the target area as underexposure; s240, unlocking the exposure of the target area, and executing a back-up mechanism to enable the current brightness to be back-up to the target brightness.
The exposure is unlocked after a period of stability, the brightness of the brightest block is possibly smaller than the lower limit of the exposure threshold or within the range of the threshold, and the brightness of the whole picture can be improved to meet the picture brightness of security monitoring or face recognition due to the fact that no bright light source exists at the moment. In order to avoid sudden change of the picture when the picture is lifted too fast and also avoid detecting a bright light source in the lifting process, a slow speed raising strategy is adopted to ensure smooth brightness improvement of the picture. And calculating the difference value between the image brightness and the target brightness according to the automatic exposure, calculating the adjustment proportion required by the control factor, and adding the proportion coefficient weight for adjusting the exposure to ensure the slow rise of the exposure. Wherein, the calculation of the proportionality coefficient comprises the following steps:
Ratio＝(Luma/Tar)*Accuracy；
in the formula, Ratio represents a scale factor, Luma represents display unit luminance or display screen luminance, Tar represents target luminance, and Accuracy represents calculation Accuracy. After the adjustment proportion is calculated, the difference Luma between the current calculated picture brightness and the target picture brightness is calculateddiffMapping out the Weight Weight of the adjusting proportionality coefficientRatio. As shown in FIG. 4b, brightness difference thresholds [ Luma1, Luma2, Luma3, Luma4 ] are set](ii) a And deceleration weights [ Weight1, Weight2, Weight3, Weight4](ii) a Linearly interpolating intermediate segmentsValues, where the deceleration weight range may be set, for example, as: (1/4, 1/2, 3/4, 1); finally, the final adjusting intensity Ratio-Weight is obtained by the adjustable proportion and the coefficient WeightRatio。
The invention provides a control method for inhibiting automatic exposure of a moving light source, which is an automatic exposure strategy, does not depend on detection of a target subject, can quickly suppress exposure, captures and identifies the target subject within a limited time, and provides a stable mechanism aiming at flicker of pictures caused by a moving following vehicle. The invention can improve the product adaptability, can particularly highlight the technical advantages of the scene at night when people and vehicles travel together, can accurately control the exposure factor adjustment for vehicle snapshot, and meets the shutter requirement. The brightness flicker of the following picture of the vehicle in a general exposure strategy is optimized and improved, and the adaptability and the continuity of exposure are greatly ensured. For example, in the application of road scenes at night, when no moving vehicles or strong light sources exist, the overall brightness of the picture is high, and the requirements of video monitoring and pedestrian capturing and identification can be met; when a bright light source brought by the vehicle lamp exists, the overexposure and the lamp halation brought by the vehicle lamp can be quickly suppressed, so that the picture brightness can meet the requirements of vehicle capture and vehicle feature identification; and in the road section with the vehicle, the flicker of the image brightness caused by the traditional exposure can be avoided, the exposure is always kept stable in the whole process of the vehicle running, and the image can be smooth and slow when the image is returned after the brightness is suppressed, so that the adaptation process of human eyes to the change of the image brightness is greatly met. The self-adaptive exposure of the human-vehicle scene is achieved to a certain extent, and intelligent related indexes are improved, so that the product competitiveness is improved.
As shown in fig. 3 to 6, the present invention further provides an automatic exposure control system for suppressing a motion light source, the system comprising:
and the brightness acquisition module is used for acquiring the brightness of the target area in the display unit as the current brightness. The brightness acquisition module comprises a brightness detection unit for detecting whether a bright light source exists in the target area, and specifically comprises the following steps:
dividing the display unit into a plurality of display areas, the target area including one or more display areas;
judging whether the brightness of the display area is greater than the upper limit value of a preset brightness threshold interval or not, and if the brightness of the display area is greater than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area;
and if the marking times of the brightest display area in the target area are more than the preset times, the target area has a bright light source.
The display unit comprises a display picture of the image acquisition equipment and a picture which is transmitted to the display to be displayed after the picture is acquired by the image acquisition equipment. The region of interest is in this application a region of interest (ROI).
As shown in fig. 3, the display screen is divided into M × N display blocks or display areas. A region of interest ROI or target region is configured for detecting the brightest region. If the brightness of the display area is larger than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area; or, if the brightness of the display block is greater than the upper limit value of the preset brightness threshold interval, marking the display block as a bright block. And records the coordinate Num of the brightest display area or bright blocki(x, y); meanwhile, the marking times of the brightest display area or the bright block are increased by one, namely Num + 1; num is the number of times the brightest display area or bright block is marked. Presetting the number of the brightest display areas or bright blocks as Numblock(ii) a When the number of times of marking the brightest display area or the bright block is more than the preset number, that is, Num is more than NumblockAnd if the coordinates of the bright blocks meet the connection condition or are in a certain redundant area, the bright light source is considered to exist currently. If the brightness corresponding to the bright block is within the preset brightness threshold interval, taking the bright block as a normal bright block; if the brightness is smaller than the lower limit value of the preset brightness threshold interval, the brightest display area or the bright block is marked as underexposure.
The exposure control module is used for judging whether the current brightness is within a preset brightness threshold interval; in the embodiment of the present application, the preset brightness threshold interval may be set to [ Luma ], for exampledown，Lumaup]. Wherein, LumaupFor presetting an upper limit value of a brightness threshold interval, LumadownIs the lower limit value of the preset brightness threshold interval.
The exposure control module comprises an exposure pressing unit and an exposure unlocking unit; and if the current brightness is larger than the upper limit value of the preset brightness threshold interval, the exposure suppression unit suppresses the exposure of the target area, so that the current brightness is reduced to the target brightness. As shown in fig. 3 to 5, when the device is applied to a road scene and a bright light source is detected, if the light source is a vehicle headlight and its halo, features such as a vehicle outline and a license plate are difficult to distinguish, so that exposure control factors need to be suppressed quickly and accurately, so that a vehicle target can be captured and identified in time.
The exposure strategy in the application can control and adjust the exposure factors according to the brightness of the picture, and the acceleration mechanism is to accelerate the adjustment speed in the exposure adjustment process. Can obtain the information of real-time exposure amount during exposure control, dynamically add the acceleration Weight coefficient Weight of the adjusted exposure amount when the existence of a bright light source is sensediThereby accelerating the exposure adjustment and enabling the exposure to reach the target brightness quickly. And the exposure acceleration weight coefficient is mapped by segmented linear interpolation according to the brightness of the bright light source obtained by calculation, and the acceleration weight coefficient is calculated to be larger when the brightness is higher, and is lower otherwise. Setting the threshold value of the brightest area interval [ Lumaa，Lumab，Lumac，Lumad]And acceleration Weight [ Weight ] corresponding theretoa，Weightb，Weightc，Weightd]And carrying out piecewise linear interpolation, wherein the mapping relation is shown in figure 4a, and an exposure acceleration weight coefficient is obtained.
The application also changes the brightness of the display picture by adjusting the execution sequence of the exposure factors. Exposure factors include aperture, shutter, sensor capability, fill light, platform capability (i.e., processor capability of the image capture device). And suppressing the exposure of the target area by controlling the aperture, the shutter, the sensor of the image acquisition equipment, the light supplement lamp and the processor of the image acquisition equipment.
Fig. 5 of the present application shows a set of exposure line configurations. As shown in fig. 5, in the exposure of the pressing target area, the adjustment of the exposure factor by the present application is set according to the initial exposure line. In selecting the exposure control factor, since the capture target subject is a moving object, the shutter time is first selected for exposure control adjustment. As shown in fig. 5, exposure adjustment may be performed using the option of (r). When determining to adjust the control factor to carry out exposure adjustment, firstly recording the control factor and intensity of the previous state of exposure adjustment, then adjusting from large to small according to the control factor label, at the moment, determining to carry out shutter suppression adjustment, therefore, the adjustment sequence is from the third to the fourth, when the shutter is adjusted to meet the shutter threshold value that the moving object can not generate motion smear, if the bright light source still exists at the moment, the rest control factors can be adjusted from large to small according to the recorded initial state intensity of the exposure line configuration label. Wherein, the first, second, third, and fourth … represent the control sequence or control procedure of the exposure factors.
As shown in fig. 6, during the exposure process of pressing the target area, it is also detected in real time whether the brightest display area still exists in the target area; if the brightest display area still exists in the target area, continuing to suppress the exposure of the target area; if the brightest display area does not exist in the target area, the exposure of the target area is locked, and the display picture can be kept stable after the exposure is locked.
For a road application scene, a plurality of vehicles are probably driven along, and a common exposure algorithm adjusts the bright light of the post-exposure pressing part within a certain range according to the brightness of the whole picture. However, when the bright light source is changed, the video image repeatedly flickers in a short time due to the automatic adjustment of the exposure control, and therefore, it is necessary to keep the video image or the display image stable.
Automatic exposure calculates and counts brightness data of the brightest display area in real time during the exposure process of adjusting the control factor to suppress the target area. When the brightness of the brightest display area is larger than the upper limit of the set brightness threshold, performing rapid suppression; after the suppression exposure, when the brightness of the brightest display area and the brightness of the whole picture are in a normal threshold range or feedback information exists, the exposure is locked to prevent the picture from flickering. And after the exposure is locked, continuously calculating and counting the brightness information of the brightest display area, unlocking the exposure if the brightness of the brightest display area is detected to be larger than the upper limit of the set brightness threshold, enabling the brightness of the brightest display area to be within the range of the set brightness threshold again, then locking the exposure again, and unlocking the exposure within a certain time and executing a back-up mechanism if the brightness of the brightest display area is not larger than the upper limit of the set brightness threshold.
And if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, the exposure unlocking unit unlocks the exposure of the target area, and the current brightness is increased back to the target brightness.
The exposure is unlocked after a period of stability, the brightness of the brightest block is possibly smaller than the lower limit of the exposure threshold or within the range of the threshold, and the brightness of the whole picture can be improved to meet the picture brightness of security monitoring or face recognition due to the fact that no bright light source exists at the moment. In order to avoid sudden change of the picture when the picture is lifted too fast and also avoid detecting a bright light source in the lifting process, a slow speed raising strategy is adopted to ensure smooth brightness improvement of the picture. And calculating the difference value between the image brightness and the target brightness according to the automatic exposure, calculating the adjustment proportion required by the control factor, and adding the weight of the adjustment proportion coefficient to ensure the slow rise of the exposure. Wherein, the calculation of the proportionality coefficient comprises the following steps:
Ratio＝(Luma/Tar)*Accuracy；
in the formula, Ratio represents a scale factor, Luma represents display unit luminance or display screen luminance, Tar represents target luminance, and Accuracy represents calculation Accuracy. After the adjustment proportion is calculated by the formula, the difference Luma between the current calculated picture brightness and the target picture brightness is calculateddiffMapping out the Weight Weight of the adjusting proportionality coefficientRatio. As shown in FIG. 4b, brightness difference thresholds [ Luma1, Luma2, Luma3, Luma4 ] are set](ii) a And deceleration weights [ Weight1, Weight2, Weight3, Weight4](ii) a The middle segment is linearly interpolated, where the deceleration weight range may be set, for example, as: (1/4, 1/2, 3/4, 1); finally, the final adjusting intensity Ratio and Weight of coefficient are used for obtaining the final adjusting intensity RatioRatio。
The invention provides a control system for inhibiting automatic exposure of a moving light source, which is an automatic exposure strategy, does not depend on detection of a target subject, can quickly suppress exposure, captures and identifies the target subject within a limited time, and provides a stable mechanism aiming at flicker of pictures caused by a moving following vehicle. The invention can improve the product adaptability, can particularly highlight the technical advantages of the scene at night when people and vehicles travel together, can accurately control the exposure factor adjustment for vehicle snapshot, and meets the shutter requirement. The brightness flicker of the following picture of the vehicle in a general exposure strategy is optimized and improved, and the adaptability and the continuity of exposure are greatly ensured. For example, in the application of road scenes at night, when no moving vehicles or strong light sources exist, the overall brightness of the picture is high, and the requirements of video monitoring and pedestrian capturing and identification can be met; when a bright light source brought by the vehicle lamp exists, the overexposure and the lamp halation brought by the vehicle lamp can be quickly suppressed, so that the picture brightness can meet the requirements of vehicle capture and vehicle feature identification; and in the road section with the vehicle, the flicker of the image brightness caused by the traditional exposure can be avoided, the exposure is always kept stable in the whole process of the vehicle running, and the image can be smooth and slow when the image is returned after the brightness is suppressed, so that the adaptation process of human eyes to the change of the image brightness is greatly met. The self-adaptive exposure of the human-vehicle scene is achieved to a certain extent, and intelligent related indexes are improved, so that the product competitiveness is improved.
An embodiment of the present application further provides an apparatus, which may include: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of fig. 1. In practical applications, the device may be used as a terminal device, and may also be used as a server, where examples of the terminal device may include: the mobile terminal includes a smart phone, a tablet computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a laptop, a vehicle-mounted computer, a desktop computer, a set-top box, an intelligent television, a wearable device, and the like.
The present application further provides a non-transitory readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a device, the device may be caused to execute instructions (instructions) of steps included in the method in fig. 1 according to the present application.
Fig. 7 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present application. As shown, the terminal device may include: an input device 1100, a first processor 1101, an output device 1102, a first memory 1103, and at least one communication bus 1104. The communication bus 1104 is used to implement communication connections between the elements. The first memory 1103 may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and the first memory 1103 may store various programs for performing various processing functions and implementing the method steps of the present embodiment.
Alternatively, the first processor 1101 may be, for example, a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, a microprocessor, or other electronic components, and the first processor 1101 is coupled to the input device 1100 and the output device 1102 through a wired or wireless connection.
Optionally, the input device 1100 may include a variety of input devices, such as at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor. Optionally, the device interface facing the device may be a wired interface for data transmission between devices, or may be a hardware plug-in interface (e.g., a USB interface, a serial port, etc.) for data transmission between devices; optionally, the user-facing user interface may be, for example, a user-facing control key, a voice input device for receiving voice input, and a touch sensing device (e.g., a touch screen with a touch sensing function, a touch pad, etc.) for receiving user touch input; optionally, the programmable interface of the software may be, for example, an entry for a user to edit or modify a program, such as an input pin interface or an input interface of a chip; the output devices 1102 may include output devices such as a display, audio, and the like.
In this embodiment, the processor of the terminal device includes a function for executing each module of the speech recognition apparatus in each device, and specific functions and technical effects may refer to the above embodiments, which are not described herein again.
Fig. 8 is a schematic hardware structure diagram of a terminal device according to an embodiment of the present application. FIG. 8 is a specific embodiment of FIG. 7 in an implementation. As shown in fig. 8, the terminal device of the present embodiment may include a second processor 1201 and a second memory 1202.
The second processor 1201 executes the computer program code stored in the second memory 1202 to implement the method described in fig. 7 in the above embodiment.
The second memory 1202 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so forth. The second memory 1202 may include a Random Access Memory (RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
Optionally, a second processor 1201 is provided in the processing assembly 1200. The terminal device may further include: communication component 1203, power component 1204, multimedia component 1205, speech component 1206, input/output interfaces 1207, and/or sensor component 1208. The specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.
The processing component 1200 generally controls the overall operation of the terminal device. The processing assembly 1200 may include one or more second processors 1201 to execute instructions to perform all or part of the steps of the data processing method described above. Further, the processing component 1200 can include one or more modules that facilitate interaction between the processing component 1200 and other components. For example, the processing component 1200 can include a multimedia module to facilitate interaction between the multimedia component 1205 and the processing component 1200.
The power supply component 1204 provides power to the various components of the terminal device. The power components 1204 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device.
The multimedia components 1205 include a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
The voice component 1206 is configured to output and/or input voice signals. For example, the voice component 1206 includes a Microphone (MIC) configured to receive external voice signals when the terminal device is in an operational mode, such as a voice recognition mode. The received speech signal may further be stored in the second memory 1202 or transmitted via the communication component 1203. In some embodiments, the speech component 1206 further comprises a speaker for outputting speech signals.
The input/output interface 1207 provides an interface between the processing component 1200 and peripheral interface modules, which may be click wheels, buttons, etc. These buttons may include, but are not limited to: a volume button, a start button, and a lock button.
The sensor component 1208 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor component 1208 may detect an open/closed state of the terminal device, relative positioning of the components, presence or absence of user contact with the terminal device. The sensor assembly 1208 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 1208 may also include a camera or the like.
The communication component 1203 is configured to facilitate communications between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot therein for inserting a SIM card therein, so that the terminal device may log onto a GPRS network to establish communication with the server via the internet.
As can be seen from the above, the communication component 1203, the voice component 1206, the input/output interface 1207 and the sensor component 1208 involved in the embodiment of fig. 8 can be implemented as the input device in the embodiment of fig. 7.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. An automatic exposure control method for suppressing a moving bright light source, comprising the steps of:
acquiring the brightness of a target area in a display unit as the current brightness;
judging whether the current brightness is within a preset brightness threshold interval; if the current brightness is larger than the upper limit value of the preset brightness threshold interval, suppressing the exposure of the target area to reduce the current brightness to the target brightness; if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, unlocking the exposure of the target area, and raising the current brightness back to the target brightness;
if the target area is detected to have a bright light source, mapping an acceleration weight coefficient of the exposure amount by sectional linear interpolation according to the brightness of the bright light source; and accelerating the exposure of the target area by adjusting the acceleration weight coefficient of the exposure amount, so that the brightness of the target area quickly reaches the target brightness.
2. The automatic exposure control method for suppressing a moving bright light source according to claim 1, characterized in that: still include whether the detection target area has bright light source, specifically have:
dividing the display unit into a plurality of display areas, the target area including one or more display areas;
judging whether the brightness of the display area is greater than the upper limit value of a preset brightness threshold interval or not, and if the brightness of the display area is greater than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area;
and if the marking times of the brightest display area in the target area are more than the preset times, the target area has a bright light source.
3. The automatic exposure control method for suppressing a moving bright light source according to claim 2, characterized in that: in the exposure process of suppressing the target area, detecting whether a brightest display area exists in the target area; if the brightest display area still exists in the target area, continuing to suppress the exposure of the target area; and if the brightest display area does not exist in the target area, locking the exposure of the target area.
4. The automatic exposure control method for suppressing a moving bright light source according to claim 1, characterized in that: and suppressing the exposure of the target area according to the aperture, the shutter, the sensor, the light supplement lamp and the processor.
5. The automatic exposure control method for suppressing a moving bright light source according to claim 2, characterized in that: unlocking the exposure of the target area, and increasing the current brightness to the target brightness by adjusting the exposure scale factor, wherein the calculation of the scale factor comprises the following steps:
Ratio＝(Luma/Tar)*Accuracy；
in the formula, Ratio represents a scale factor, Luma represents display unit luminance, Tar represents target luminance, and Accuracy represents calculation Accuracy.
6. An automatic exposure control system for suppressing a moving highlight, the system comprising:
the brightness acquisition module is used for acquiring the brightness of a target area in the display unit as the current brightness;
the exposure control module is used for judging whether the current brightness is within a preset brightness threshold interval; the exposure control module comprises an exposure pressing unit and an exposure unlocking unit; if the current brightness is larger than the upper limit value of the preset brightness threshold interval, the exposure pressing unit presses the exposure of the target area to reduce the current brightness to the target brightness; if the current brightness is smaller than the lower limit value of the preset brightness threshold interval, the exposure unlocking unit unlocks the exposure of the target area, and the current brightness is increased back to the target brightness;
if the target area is detected to have a bright light source, mapping an acceleration weight coefficient of the exposure amount by sectional linear interpolation according to the brightness of the bright light source; and accelerating the exposure of the target area by adjusting the acceleration weight coefficient of the exposure amount, so that the brightness of the target area quickly reaches the target brightness.
7. The automatic exposure control system for suppressing a moving bright light source according to claim 6, wherein: the brightness acquisition module further comprises a brightness detection unit for detecting whether a bright light source exists in the target area, and the brightness acquisition module specifically comprises:
dividing the display unit into a plurality of display areas, the target area including one or more display areas;
judging whether the brightness of the display area is greater than the upper limit value of a preset brightness threshold interval or not, and if the brightness of the display area is greater than the upper limit value of the preset brightness threshold interval, marking the display area as the brightest display area;
and if the marking times of the brightest display area in the target area are more than the preset times, the target area has a bright light source.
8. The automatic exposure control system for suppressing a moving bright light source according to claim 7, wherein: detecting whether a brightest display area exists in the target area or not in the exposure process of pressing the target area by the exposure pressing unit; if the brightest display area still exists in the target area, continuing to suppress the exposure of the target area; and if the brightest display area does not exist in the target area, locking the exposure of the target area.
9. The automatic exposure control system for suppressing a moving bright light source according to claim 7, wherein: unlocking the exposure of the target area, and increasing the current brightness to the target brightness by adjusting the exposure scale factor, wherein the calculation of the scale factor comprises the following steps:
Ratio＝(Luma/Tar)*Accuracy；
in the formula, Ratio represents a scale factor, Luma represents display unit luminance, Tar represents target luminance, and Accuracy represents calculation Accuracy.
10. An apparatus, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method recited by one or more of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911081507.3A CN110708472B (en) | 2019-11-07 | 2019-11-07 | Control method, system and equipment for inhibiting exposure of moving bright light source |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911081507.3A CN110708472B (en) | 2019-11-07 | 2019-11-07 | Control method, system and equipment for inhibiting exposure of moving bright light source |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110708472A CN110708472A (en) | 2020-01-17 |
| CN110708472B true CN110708472B (en) | 2021-06-29 |
Family
ID=69204605
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911081507.3A Active CN110708472B (en) | 2019-11-07 | 2019-11-07 | Control method, system and equipment for inhibiting exposure of moving bright light source |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110708472B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153297B (en) * | 2019-06-27 | 2022-02-18 | 浙江大华技术股份有限公司 | Exposure adjusting method and device, and storage device |
| CN113630545B (en) * | 2020-05-07 | 2023-03-24 | 华为技术有限公司 | Shooting method and equipment |
| CN111626958B (en) * | 2020-05-27 | 2021-01-26 | 重庆紫光华山智安科技有限公司 | Exposure adjusting method, exposure adjusting device, computer-readable storage medium and electronic equipment |
| CN111654640B (en) * | 2020-05-27 | 2021-11-23 | 维沃移动通信有限公司 | Exposure adjusting method and device and electronic equipment |
| CN112153360B (en) * | 2020-08-24 | 2022-03-18 | 青岛小鸟看看科技有限公司 | Method, device and equipment for determining exposure parameters of head-mounted equipment |
| CN112584089B (en) * | 2020-12-10 | 2021-05-07 | 浙江华创视讯科技有限公司 | Face brightness adjusting method and device, computer equipment and storage medium |
| CN113703332B (en) * | 2021-08-27 | 2022-11-22 | 广东启智创新教育科技有限公司 | Interactive control system of educational toy and toy |
| CN114007019B (en) * | 2021-12-31 | 2022-06-17 | 杭州魔点科技有限公司 | Method and system for predicting exposure based on image brightness in backlight scene |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI285047B (en) * | 2005-11-24 | 2007-08-01 | Sunplus Technology Co Ltd | Method of automatic exposure control and automatic exposure compensated apparatus |
| JP5365407B2 (en) * | 2009-08-17 | 2013-12-11 | ソニー株式会社 | Image acquisition apparatus and image acquisition method |
| TW201439982A (en) * | 2013-04-03 | 2014-10-16 | Ind Tech Res Inst | Around view detecting system and method |
| JP6744424B2 (en) * | 2016-11-24 | 2020-08-19 | マクセル株式会社 | Lighting equipment |
| CN109587407A (en) * | 2018-12-14 | 2019-04-05 | 广州华多网络科技有限公司 | Exposure amount adjustment method, device and the computer equipment of image taking |
-
2019
- 2019-11-07 CN CN201911081507.3A patent/CN110708472B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110708472A (en) | 2020-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110708472B (en) | Control method, system and equipment for inhibiting exposure of moving bright light source | |
| CN111418201B (en) | Shooting method and equipment | |
| EP3599760B1 (en) | Image processing method and apparatus | |
| CN104517268B (en) | Adjust the method and device of brightness of image | |
| CN105488527B (en) | Image classification method and device | |
| RU2628494C1 (en) | Method and device for generating image filter | |
| KR102263537B1 (en) | Electronic device and control method of the same | |
| US7450756B2 (en) | Method and apparatus for incorporating iris color in red-eye correction | |
| US11763470B2 (en) | Method and apparatus for aligning image frames, electronic device and storage medium | |
| CN109040523B (en) | Artifact eliminating method and device, storage medium and terminal | |
| CN108090908B (en) | Image segmentation method, device, terminal and storage medium | |
| CN109618102B (en) | Focusing processing method and device, electronic equipment and storage medium | |
| CN108551552A (en) | Image processing method, device, storage medium and mobile terminal | |
| CN111062868B (en) | Image processing method, device, machine readable medium and equipment | |
| WO2021046793A1 (en) | Image acquisition method and apparatus, and storage medium | |
| WO2019196240A1 (en) | Photographing method, apparatus, computer device, and storage medium | |
| CN117201930B (en) | Photographing method and electronic equipment | |
| CN104539846B (en) | Shoot the method, apparatus and terminal of picture | |
| CN111210777A (en) | Backlight brightness adjusting method and device, electronic equipment and machine-readable storage medium | |
| CN110636222B (en) | Photographing control method and device, terminal equipment and storage medium | |
| WO2023011302A1 (en) | Photographing method and related apparatus | |
| CN113891008B (en) | Exposure intensity adjusting method and related equipment | |
| CN112291481B (en) | Exposure automatic adjusting method and device, electronic equipment and storage medium | |
| CN105227841A (en) | To take pictures reminding method and device | |
| CN114945019B (en) | Data transmission method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |