CN117857905A - Image light supplementing control method, device, equipment and storage medium - Google Patents
Image light supplementing control method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117857905A CN117857905A CN202311750649.0A CN202311750649A CN117857905A CN 117857905 A CN117857905 A CN 117857905A CN 202311750649 A CN202311750649 A CN 202311750649A CN 117857905 A CN117857905 A CN 117857905A
- Authority
- CN
- China
- Prior art keywords
- image
- determining
- light
- acquisition period
- light source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000001502 supplementing effect Effects 0.000 title claims abstract description 112
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012545 processing Methods 0.000 claims abstract description 20
- 238000004364 calculation method Methods 0.000 claims description 13
- 230000003287 optical effect Effects 0.000 claims description 13
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 238000013507 mapping Methods 0.000 claims description 6
- 239000011159 matrix material Substances 0.000 claims description 5
- 238000001514 detection method Methods 0.000 abstract description 11
- 238000005286 illumination Methods 0.000 description 10
- 239000000047 product Substances 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 230000004907 flux Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 239000013589 supplement Substances 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The invention belongs to the technical field of image processing, and discloses an image light supplementing control method, an image light supplementing control device, image light supplementing control equipment and a storage medium. The method comprises the steps of determining image brightness information of a current acquisition period based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor; calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance; determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance; and performing image light supplementing control according to the target working mode of the infrared light supplementing light source. Through the mode, the accurate detection of the ambient light is realized on the premise of not increasing the hardware cost of the photosensitive or ambient light detection sensor and the like, the overall power consumption is reduced, the brightness of the acquired image is ensured, and the use experience of a user is improved.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for controlling image light compensation.
Background
At present, in order to ensure that clear pictures can be shot at night, infrared light supplement is needed for products at night, infrared lamps are arranged on IP camera products in the market, and the IP camera products are turned on at night and turned off at daytime. However, how to identify the day and night, most IP camera products are added with a photosensitive or ambient light detection sensor for identifying the ambient light intensity of the day and night, so that the switch of the infrared lamp is adjusted, and the hardware cost of the product is increased. In addition, many infrared camera products are powered by batteries for easy installation. Photosensitive or ambient light detection sensors and infrared lamps are power consuming devices, especially infrared lamps, which consume significant power. The product consumes too fast can reduce battery life, needs the user to change the battery frequently, and user experience is poor.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide an image light supplementing control method, an image light supplementing control device and a storage medium, and aims to solve the technical problem of accurately identifying ambient light and guaranteeing image brightness on the premise of not increasing hardware cost.
In order to achieve the above object, the present invention provides an image light supplementing control method, comprising the steps of:
determining image brightness information of a current acquisition period based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor;
calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance;
determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance;
and performing image light supplementing control according to the target working mode of the infrared light supplementing light source.
Optionally, the calculating the brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance includes:
determining a plurality of image brightness values according to the image brightness information of the current acquisition period;
calculating the average value of the brightness values of the plurality of images, and determining the average value of the brightness of the images in the current acquisition period;
and calculating the brightness according to the preset exposure time, the preset gain and the image brightness average value, and determining the current ambient illuminance.
Optionally, the determining the target working mode of the infrared light compensating light source according to the current ambient illuminance includes:
detecting according to the current ambient illuminance and a preset illuminance threshold;
when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period;
when the current acquisition period is not a preset initial acquisition period, acquiring historical ambient illuminance;
and determining a target working mode of the infrared light supplementing light source according to the historical ambient illuminance and the current ambient illuminance.
Optionally, the determining the target working mode of the infrared light compensating light source according to the historical ambient light illuminance and the current ambient light illuminance includes:
performing difference calculation according to the historical ambient illuminance and the current ambient illuminance, and determining the difference ambient illuminance;
determining an interval where the illuminance is located according to the difference ambient illuminance;
determining a target running state and a target working parameter of the infrared light supplementing light source according to the interval where the illuminance is and the light supplementing strategy mapping relation;
and determining a target working mode of the infrared light supplementing light source according to the target running state and the target working parameter.
Optionally, when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period further includes:
when the current acquisition period is a preset initial acquisition period, determining that the target running state of the infrared light supplementing light source is a light source closing state;
and determining a target working mode of the infrared light supplementing light source according to the light source closing state.
Optionally, the performing image light compensation control according to the target working mode of the infrared light compensation light source includes:
when the target working mode of the infrared light supplementing light source is a light source closing state, determining that the filter working mode of the infrared filter is a filter opening state;
and starting the infrared optical filter according to the optical filter on state, and closing the infrared light supplementing light source according to the light source off state.
Optionally, the determining the image brightness information of the current acquisition period based on the raw image data acquired by the image sensor includes:
determining a plurality of image data to be processed in a current acquisition period based on the original image data acquired by the image sensor;
respectively carrying out image conversion on each image data to be processed according to the space conversion matrix, and determining a plurality of initial brightness values of the current acquisition period;
calculating a difference between a plurality of initial luminance values;
and when the difference value between the initial brightness values is smaller than a preset difference value threshold value, determining the image brightness information of the current acquisition period according to the initial brightness values.
In addition, in order to achieve the above object, the present invention also proposes an image light supplementing control device including:
the processing module is used for determining image brightness information of a current acquisition period based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor;
the calculation module is used for calculating brightness according to the image brightness information of the current acquisition period and determining the current ambient illuminance;
the processing module is used for determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance;
and the control module is used for carrying out image light supplementing control according to the target working mode of the infrared light supplementing light source.
In addition, to achieve the above object, the present invention also proposes an image light supplementing control apparatus including: a memory, a processor, and an image light-supplementing control program stored on the memory and executable on the processor, the image light-supplementing control program configured to implement the steps of the image light-supplementing control method as described above.
In addition, in order to achieve the above object, the present invention also proposes a storage medium having stored thereon an image light-supplementing control program which, when executed by a processor, implements the steps of the image light-supplementing control method as described above.
The method comprises the steps of determining image brightness information of a current acquisition period based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor; calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance; determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance; and performing image light supplementing control according to the target working mode of the infrared light supplementing light source. By the method, the image brightness information of the current acquisition period is determined according to the original image data generated by the preset central area, brightness calculation is further carried out based on the image brightness information, the current ambient illuminance is determined, and the target working mode of the infrared light supplementing light source is determined by utilizing the current ambient illuminance, so that image light supplementing control is carried out, the accurate detection of ambient light is realized on the premise of not increasing the hardware cost of a photosensitive or ambient light detecting sensor and the like, the overall power consumption is reduced, the brightness of an acquired image is ensured, and the experience of user use experience is improved.
Drawings
Fig. 1 is a schematic structural diagram of an image light supplementing control device of a hardware running environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of a first embodiment of an image light supplementing control method according to the present invention;
FIG. 3 is a schematic diagram of a conventional architecture of an embodiment of an image light-compensating control method according to the present invention;
FIG. 4 is a schematic diagram of an improved architecture of an embodiment of an image light-compensating method according to the present invention;
FIG. 5 is a schematic diagram of a photosensitive array according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a central area of an embodiment of an image light-compensating control method according to the present invention;
FIG. 7 is a flowchart of a second embodiment of an image light supplementing control method according to the present invention;
FIG. 8 is a flowchart of a third embodiment of an image light supplementing control method according to the present invention;
FIG. 9 is a schematic diagram illustrating an overall flow chart of an embodiment of an image light supplementing control method according to the present invention;
fig. 10 is a block diagram of a first embodiment of an image light supplementing control device according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an image light compensation control device of a hardware operation environment according to an embodiment of the present invention.
As shown in fig. 1, the image light supplementing control device may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the image light supplementing control device, and may include more or fewer components than shown, or may combine certain components, or may have a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and an image light supplement control program may be included in the memory 1005 as one type of storage medium.
In the image light supplementing control device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the image light compensation control apparatus of the present invention may be disposed in the image light compensation control apparatus, and the image light compensation control apparatus calls an image light compensation control program stored in the memory 1005 through the processor 1001 and executes the image light compensation control method provided by the embodiment of the present invention.
An embodiment of the invention provides an image light supplementing control method, referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the image light supplementing control method.
In this embodiment, the image light supplementing control method includes the following steps:
step S10: image brightness information of a current acquisition period is determined based on raw image data acquired by an image sensor, wherein the raw image data is generated based on a preset central area of the image sensor.
It should be noted that, the execution body of the embodiment is a controller in the infrared imaging apparatus, where the controller has functions of data processing, data communication, program running, and the like, and the controller may be a unit such as an image processing chip, or may be other devices having similar functions, which is not limited in this embodiment.
It can be understood that the architecture of the existing infrared camera device is shown in fig. 3, and the lens is used for receiving external light; the infrared filter is switched inside the IR-CUT (infrared switching), and when the illumination is good in the daytime, the infrared filter is started to filter infrared light in order to prevent the excessive exposure of the picture. Closing the optical filter at night to allow more light to enter the image sensor; the image sensor is responsible for collecting optical signals, recording R, G and B color information in the optical signals, generating Rawdata, converting the received optical signals into electric signals through AD, and outputting the electric signals to the image processing chip through MIPI mode; the image processing chip is internally provided with black point correction, noise reduction, brightness correction, white balance, color difference, gamma, color space conversion and other algorithms for processing the electric signals transmitted by the image sensor, and finally converting RGB into YUV signals convenient to display through color space conversion, wherein Y is brightness, and U and V are chroma signals. The infrared lamp is used for light filling at night. The infrared lamp drive is used to turn on the infrared lamp. When an object such as a person or an animal capable of radiating infrared rays outwards approaches the IPcamera, the PIR (passive infrared receiving device) can trigger the system to start a photographing or video function, so that the system can be in an idle state under normal conditions and can be started only when a movable object is detected, and the power consumption of the system can be reduced; the system end determines whether to turn on the infrared lamp according to the detected ambient light brightness, and the power supply is used for supplying power to the system; the storage device is used for storing programs; the WiFi/Bluetooth module is used for wireless connection and can transmit images or video information of the product to the cloud.
In a specific implementation, in order to reduce product power consumption and hardware cost, in the image light supplementing control method provided in this embodiment, an ambient light detection sensor of an infrared camera device is omitted, and the architecture is as shown in fig. 4, and the brightness of ambient light is calculated by image acquisition and then an image brightness analysis mode, whether to turn on an infrared lamp, whether to switch an IR-CUT, and the like are confirmed according to the calculated ambient brightness information; if the infrared lamp is started, the system end dynamically adjusts the brightness of the infrared lamp according to a preset brightness curve, so that the purpose of reducing the power consumption of the product is achieved.
It should be noted that in a normal case, all pixel points of the image sensor collect photosensitive information, so that a high-definition picture with pixels is produced, for example, the resolution of the image sensor is h×v, and the photosensitive array of the image sensor is shown in fig. 5. In practical situations, since the light passing through the lens has a weak intensity at the photosensitive points around the image sensor due to the angle difference, the brightness is dark at the middle position, and the embodiment selects only the middle region p×p (P < min (H, V)) of the image sensor for accurately calculating the ambient light brightness based on no ambient light sensor for exposing the pixels, as shown in fig. 6 below. In this embodiment, the middle area exposed by p×p (P < min (H, V)) pixels in the image sensor is the preset central area.
It can be understood that when the infrared camera device is started up for the first time, the image processing chip ISP presets a set of photographing parameters, that is, exposure time T and gain G, for ensuring that a clear picture is taken under normal ambient light conditions. In addition, because no ambient light information exists, the infrared camera equipment can start an ambient light detection mechanism, start photographing, and close the IR-CUT and close the infrared lamp when working for the first time in order to ensure that more light enters the image sensor and reduce power consumption.
In a specific implementation, the image sensor operates with only a preset central region. Since the external ambient light is varied, it is necessary to take a photograph at regular intervals to obtain ambient light information, and the embodiment sets the photographing time interval Δt, i.e. from time t0 to time t0, respectively at t 0 +△t，t 0 +2×△t，t 0 +3×△t，…, t 0 Photographs were taken at time +nχΔt. Since the image sensor has only the middle region p×p (P<min (M, N)) pixels are exposed, and the generated raw image data is written as: [ R, G, B ]] P×P . In this embodiment, each photographing time is an image acquisition period.
It should be noted that, in order to ensure accuracy of identifying ambient light in each photographing, at least two images are collected in each image collection period, image brightness information corresponding to each image is calculated based on original image data of each image, and image brightness information of a current collection period is determined by using the image brightness information corresponding to each image in each image collection period.
Step S20: and calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance.
It should be noted that, after the image brightness information of the current acquisition period is determined, brightness calculation may be performed by using the image brightness information of the current acquisition period, the preset gain and the preset exposure time, so as to determine the current ambient illuminance in the current acquisition period.
Step S30: and determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance.
It should be noted that, the target working mode includes an operation state and an operation parameter of the infrared light-compensating light source, the operation state includes an off state and an on state, the operation parameter refers to a duty ratio of the infrared light-compensating light source, different illuminance dividing sections correspond to different target working modes, and the target working mode of the infrared light-compensating light source in the current acquisition period is determined based on the illuminance dividing section where the current ambient illuminance is located. In this embodiment, the infrared light source refers to an infrared lamp, or may be other devices, which is not limited in this embodiment.
Step S40: and performing image light supplementing control according to the target working mode of the infrared light supplementing light source.
The current working mode of the infrared light compensating light source is adjusted based on the target working mode of the infrared light compensating light source, the corresponding working mode of the infrared filter is determined, and the current working mode of the infrared filter is adjusted based on the working mode of the infrared filter, so that the light compensating control of an image is realized. For example, based on the target working mode of the infrared light-compensating light source, the infrared light-compensating light source is turned off, and the duty ratio parameter of the infrared light-compensating light source is adjusted to 0, and at this time, an infrared filter is required to be started to reduce the luminous flux of infrared light, so that the light-compensating control of the image is realized.
The method comprises the steps that image brightness information of a current acquisition period is determined based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor; calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance; determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance; and performing image light supplementing control according to the target working mode of the infrared light supplementing light source. By the method, the image brightness information of the current acquisition period is determined according to the original image data generated by the preset central area, brightness calculation is further carried out based on the image brightness information, the current ambient illuminance is determined, and the target working mode of the infrared light supplementing light source is determined by utilizing the current ambient illuminance, so that image light supplementing control is carried out, the accurate detection of ambient light is realized on the premise of not increasing the hardware cost of a photosensitive or ambient light detecting sensor and the like, the overall power consumption is reduced, the brightness of an acquired image is ensured, and the experience of user use experience is improved.
Referring to fig. 7, fig. 7 is a flowchart illustrating a second embodiment of an image light supplementing control method according to the present invention.
Based on the above first embodiment, the image light supplementing control method of this embodiment includes, at step S20:
step S21: and determining a plurality of image brightness values according to the image brightness information of the current acquisition period.
It should be noted that, since at least two images are included in one image acquisition period, the image brightness values corresponding to the plurality of images are determined based on the image brightness information in the current acquisition period.
Step S22: and carrying out average value calculation on the plurality of image brightness values, and determining the image brightness average value of the current acquisition period.
It should be noted that, the average value of the brightness values of the plurality of images is calculated, and the obtained average value is the average value of the brightness of the image in the current image acquisition period. For example, two images exist in the current acquisition period, and the brightness values of the images are respectively、/>The average value of the brightness of the image is +.>
Step S23: and calculating the brightness according to the preset exposure time, the preset gain and the image brightness average value, and determining the current ambient illuminance.
It should be noted that, based on the preset exposure time T, the preset gain G, and the image brightness average value, the current ambient illuminance in the current acquisition period may be calculated。
It may be appreciated that, to accurately identify the ambient light based on the image, further, the determining the image brightness information of the current acquisition period based on the raw image data acquired by the image sensor includes: determining a plurality of image data to be processed in a current acquisition period based on the original image data acquired by the image sensor; respectively carrying out image conversion on each image data to be processed according to the space conversion matrix, and determining a plurality of initial brightness values of the current acquisition period; calculating a difference between a plurality of initial luminance values; and when the difference value between the initial brightness values is smaller than a preset difference value threshold value, determining the image brightness information of the current acquisition period according to the initial brightness values.
In a specific implementation, based on the original image data acquired by the image sensor, determining the original image data corresponding to each image in the current acquisition period, wherein the original image data corresponding to each image is the image data [ R, G, B ] to be processed] P×P Converting each image data to be processed into YUV output by using a color space conversion matrix T,wherein->By using the formula, the initial brightness value corresponding to each image in the current acquisition period can be calculated, the difference value between the initial brightness values is calculated, and when the difference value between the initial brightness values is smaller than the preset difference value threshold value, the image acquired in the current acquisition period is effective, and at the moment, the image brightness information of the current acquisition period is obtained based on the initial brightness values of the images. For example, there are two images in the current acquisition period, and the initial brightness values are respectivelyIs->、/>The preset difference threshold is +.>When->When the current acquisition period is shown to be effective, the initial brightness value is +.>、/>As image brightness information for the current acquisition cycle.
The embodiment determines a plurality of image brightness values according to the image brightness information of the current acquisition period; calculating the average value of the brightness values of the plurality of images, and determining the average value of the brightness of the images in the current acquisition period; and calculating the brightness according to the preset exposure time, the preset gain and the image brightness average value, and determining the current ambient illuminance. By the method, illuminance calculation is performed based on the image brightness average value, the preset exposure time and the preset gain of the current acquisition period, so that the accurate detection of the ambient light is ensured.
Referring to fig. 8, fig. 8 is a flowchart of a third embodiment of an image light supplementing control method according to the present invention.
Based on the above first embodiment, the image light supplementing control method of this embodiment includes, at step S30:
step S31: and detecting according to the current ambient illuminance and a preset illuminance threshold.
The preset illuminance threshold refers to an illuminance threshold set by switching the infrared filter and the infrared light compensating light source.
Step S32: and when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period.
It should be noted that, when the current ambient illuminance is greater than the preset illuminance threshold, it is indicated that the current ambient illuminance is strong, and the infrared light source needs to be turned off, but in order to avoid the detection effect caused by the infrared light source, it needs to be determined whether the current acquisition period is the first acquisition period. In this embodiment, the preset initial acquisition period refers to a first acquisition period.
It may be appreciated that, to ensure reasonable utilization of resources, further, when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period further includes: when the current acquisition period is a preset initial acquisition period, determining that the target running state of the infrared light supplementing light source is a light source closing state; and determining a target working mode of the infrared light supplementing light source according to the light source closing state.
In a specific implementation, when the current acquisition period is a preset initial acquisition period, the current ambient illuminance is strong, the infrared light supplementing light source needs to be turned off, at this time, the target running state of the infrared light supplementing light source is determined to be the light source off state, the target working parameter of the infrared light supplementing light source is a preset value of 0, the target running state of the infrared light filter is determined to be the light filter on state, and the light source off state is used as the target working mode of the infrared light supplementing light source.
Step S33: and when the current acquisition period is not the preset initial acquisition period, acquiring the historical ambient illuminance.
When the current acquisition period is not the preset initial acquisition period, the calculated ambient illuminance in the last acquisition period is obtained, and the calculated ambient illuminance in the last acquisition period is the historical ambient illuminance.
Step S34: and determining a target working mode of the infrared light supplementing light source according to the historical ambient illuminance and the current ambient illuminance.
It should be noted that, calculating the difference between the historical ambient illuminance and the current ambient illuminance, determining the target working mode of the infrared light source based on the difference between the historical ambient illuminance and the current ambient illuminance, and in order to ensure the accuracy of mode determination, further, determining the target working mode of the infrared light source according to the historical ambient illuminance and the current ambient illuminance includes: performing difference calculation according to the historical ambient illuminance and the current ambient illuminance, and determining the difference ambient illuminance; determining an interval where the illuminance is located according to the difference ambient illuminance; determining a target running state and a target working parameter of the infrared light supplementing light source according to the interval where the illuminance is and the light supplementing strategy mapping relation; and determining a target working mode of the infrared light supplementing light source according to the target running state and the target working parameter.
It will be appreciated that in a historical ambient light level ofWhen the historical ambient illuminance and the current ambient illuminance are calculated +>Difference between the historical ambient light and the current ambient light +.>The difference between the two is the difference ambient illuminanceAnd taking the difference ambient illuminance as the actual ambient illuminance in the current acquisition period, and determining the illuminance dividing interval in which the difference ambient illuminance is located as the illuminance interval in which the difference ambient illuminance is located because different illuminance dividing intervals correspond to different target working modes.
In specific implementation, a target operation state and a target working parameter of the infrared light-compensating light source corresponding to an interval where illuminance is located are searched in a light-compensating strategy mapping relation, and a target working mode of the infrared light-compensating light source is determined based on the target operation state and the target working parameter.
Note that, in this embodiment, each of the light-filling policy mapping relationships existsThe running state of the infrared filter, the running state of the infrared light supplementing light source and the duty ratio parameter of the infrared light supplementing light source corresponding to the illuminance dividing interval are shown in table 1, and in this embodiment, the preset illuminance threshold is l H4 . When the infrared filter is turned on, the infrared light is filtered, the infrared light supplementing light source is turned off, and when the infrared filter is turned off, the infrared light is added, and the infrared light supplementing light source is turned on.
TABLE 1
It will be appreciated that in general, 0 to l L3 The illuminance in the interval is lower, the infrared filter is closed, the luminous flux of infrared light is increased, and meanwhile, the infrared lamp is opened to increase light supplement; l (L) H4 ～l H7 The illuminance in the interval is higher, for example, an infrared filter is started, the luminous flux of infrared light is reduced, and meanwhile, an infrared lamp is turned off; l (L) L3 ～l H4 Is the turning point from low illumination to high illumination, and the illumination is centered. At this time, in order to take clearer pictures, user experience is improved, the low-illumination mode can be set, the infrared filter is closed to increase infrared light, and meanwhile the infrared lamp is turned on.
In a specific implementation, the initial time t 0 At the moment, in order to eliminate the influence of the infrared lamp, the infrared lamp is set to be closed according to the low-illumination setting, and the infrared filter is started. When the ambient light is bright and dark, the first photographing period t 0 Ambient illuminance L1 detected at time +1XDeltat at [ L ] H4 ,l H7 ]When the ambient illuminance is higher in the interval, the infrared filter is started to reduce the luminous flux of infrared light, the infrared lamp is turned off at the same time, and the system end records the ambient illuminance L of the test 1 . Third photographing period t 0 Repeating the above operation at +3XDeltat time, and recording the ambient illuminance L of the test 3 At the same time, the first ambient illuminance L1 is deleted, and the second ambient illuminance L is maintained 2， I.e. each photograph will only retain the previous ambient light illumination value. When the nth photographing period t0+n×At time Deltat, when ambient illuminance L is detected n At [ l ] L3 ,l H4 ]When the illumination of the environment is considered to be low in the interval, the system end is in a critical state of high and low illumination, the infrared filter is closed, the infrared lamp is opened, and the measured illumination L of the environment is recorded n . And according to the illuminance range, selecting the lowest duty ratio parameter P H4 And the system power consumption is reduced to the greatest extent while the brightness of the picture is ensured. When the detected ambient illuminance gradually decreases, the duty cycle of the infrared lamp is gradually adjusted to achieve the desired brightness of the photograph. When t 0 When the ambient light is changed from dark to bright at +xxDeltat, the ambient illuminance L at that time x At [ l ] H4 ,l H5 ]In the interval, the infrared lamp needs to be turned off at this time. Record last t 0 Ambient illuminance L at time + (x-1) x Deltat x-1 At [ l ] L3 ,l H4 ]. Due to at t 0 The infrared lamp is turned on at the time of + (x-1) x delta t, and has infrared light supplementing effect, so t 0 The system does not turn off the infrared lamp at time +xxDeltat, thus t 0 Actual illuminance L at +xxDeltat ＇ x ：L ＇ x= L x - L x-1， Thus only when L ＇ x At [ l ] L3 ,l H4 ]In the interval, the system starts to turn off the infrared lamp, starts the infrared filter, and the whole execution flow is shown in fig. 9.
It should be noted that, in order to ensure accuracy of image light compensation, further, the performing image light compensation according to the target working mode of the infrared light compensation light source includes: when the target working mode of the infrared light supplementing light source is a light source closing state, determining that the filter working mode of the infrared filter is a filter opening state; and starting the infrared optical filter according to the optical filter on state, and closing the infrared light supplementing light source according to the light source off state.
It can be understood that when the target working mode of the infrared light supplementing light source is the light source off state, the infrared light filter needs to be started to filter infrared light, and at the moment, the working mode of the light filter of the infrared light filter is determined to be the light filter on state, the infrared light filter is started, and the infrared light supplementing light source is turned off.
The embodiment detects according to the current ambient illuminance and a preset illuminance threshold; when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period; when the current acquisition period is not a preset initial acquisition period, acquiring historical ambient illuminance; and determining a target working mode of the infrared light supplementing light source according to the historical ambient illuminance and the current ambient illuminance. Through the mode, the accuracy in the follow-up image light supplementing control is guaranteed.
In addition, the embodiment of the invention also provides a storage medium, wherein the storage medium is stored with an image light supplementing control program, and the image light supplementing control program realizes the steps of the image light supplementing control method when being executed by a processor.
Referring to fig. 10, fig. 10 is a block diagram illustrating a first embodiment of an image light supplementing control device according to the present invention.
As shown in fig. 10, an image light supplementing control device according to an embodiment of the present invention includes:
the processing module 10 is configured to determine image brightness information of a current acquisition period based on raw image data acquired by an image sensor, where the raw image data is generated based on a preset central area of the image sensor.
And the calculating module 20 is configured to perform brightness calculation according to the image brightness information of the current acquisition period, and determine the current ambient illuminance.
The processing module 10 is configured to determine a target working mode of the infrared light compensating light source according to the current ambient illuminance.
And the control module 30 is used for carrying out image light supplementing control according to the target working mode of the infrared light supplementing light source.
The method comprises the steps that image brightness information of a current acquisition period is determined based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor; calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance; determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance; and performing image light supplementing control according to the target working mode of the infrared light supplementing light source. By the method, the image brightness information of the current acquisition period is determined according to the original image data generated by the preset central area, brightness calculation is further carried out based on the image brightness information, the current ambient illuminance is determined, and the target working mode of the infrared light supplementing light source is determined by utilizing the current ambient illuminance, so that image light supplementing control is carried out, the accurate detection of ambient light is realized on the premise of not increasing the hardware cost of a photosensitive or ambient light detecting sensor and the like, the overall power consumption is reduced, the brightness of an acquired image is ensured, and the experience of user use experience is improved.
In an embodiment, the calculating module 20 is further configured to determine a plurality of image brightness values according to the image brightness information of the current acquisition period;
calculating the average value of the brightness values of the plurality of images, and determining the average value of the brightness of the images in the current acquisition period;
and calculating the brightness according to the preset exposure time, the preset gain and the image brightness average value, and determining the current ambient illuminance.
In an embodiment, the processing module 10 is further configured to detect according to the current ambient illuminance and a preset illuminance threshold;
when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period;
when the current acquisition period is not a preset initial acquisition period, acquiring historical ambient illuminance;
and determining a target working mode of the infrared light supplementing light source according to the historical ambient illuminance and the current ambient illuminance.
In an embodiment, the processing module 10 is further configured to perform a difference calculation according to the historical ambient illuminance and the current ambient illuminance, and determine a difference ambient illuminance;
determining an interval where the illuminance is located according to the difference ambient illuminance;
determining a target running state and a target working parameter of the infrared light supplementing light source according to the interval where the illuminance is and the light supplementing strategy mapping relation;
and determining a target working mode of the infrared light supplementing light source according to the target running state and the target working parameter.
In an embodiment, the processing module 10 is further configured to determine that the target running state of the infrared light compensating light source is a light source off state when the current acquisition period is a preset initial acquisition period;
and determining a target working mode of the infrared light supplementing light source according to the light source closing state.
In an embodiment, the control module 30 is further configured to determine that the filter operation mode of the infrared filter is a filter on state when the target operation mode of the infrared light compensating light source is a light source off state;
and starting the infrared optical filter according to the optical filter on state, and closing the infrared light supplementing light source according to the light source off state.
In an embodiment, the processing module 10 is further configured to determine a plurality of image data to be processed in the current acquisition period based on the raw image data acquired by the image sensor;
respectively carrying out image conversion on each image data to be processed according to the space conversion matrix, and determining a plurality of initial brightness values of the current acquisition period;
calculating a difference between a plurality of initial luminance values;
and when the difference value between the initial brightness values is smaller than a preset difference value threshold value, determining the image brightness information of the current acquisition period according to the initial brightness values.
It should be understood that the foregoing is illustrative only and is not limiting, and that in specific applications, those skilled in the art may set the invention as desired, and the invention is not limited thereto.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
It should be noted that the above-described working procedure is merely illustrative, and does not limit the scope of the present invention, and in practical application, a person skilled in the art may select part or all of them according to actual needs to achieve the purpose of the embodiment, which is not limited herein.
Furthermore, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of embodiments, it will be clear to a person skilled in the art that the above embodiment method may be implemented by means of software plus a necessary general hardware platform, but may of course also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. Read Only Memory (ROM)/RAM, magnetic disk, optical disk) and comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (10)
1. An image light-supplementing control method, characterized in that the image light-supplementing control method comprises the following steps:
determining image brightness information of a current acquisition period based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor;
calculating brightness according to the image brightness information of the current acquisition period, and determining the current ambient illuminance;
determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance;
and performing image light supplementing control according to the target working mode of the infrared light supplementing light source.
2. The method of claim 1, wherein the calculating brightness according to the image brightness information of the current acquisition period to determine the current ambient illuminance comprises:
determining a plurality of image brightness values according to the image brightness information of the current acquisition period;
calculating the average value of the brightness values of the plurality of images, and determining the average value of the brightness of the images in the current acquisition period;
and calculating the brightness according to the preset exposure time, the preset gain and the image brightness average value, and determining the current ambient illuminance.
3. The method for controlling image light according to claim 1, wherein determining the target operation mode of the infrared light source according to the current ambient illuminance comprises:
detecting according to the current ambient illuminance and a preset illuminance threshold;
when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period;
when the current acquisition period is not a preset initial acquisition period, acquiring historical ambient illuminance;
and determining a target working mode of the infrared light supplementing light source according to the historical ambient illuminance and the current ambient illuminance.
4. The method of claim 3, wherein determining the target operating mode of the infrared light source based on the historical ambient light level and the current ambient light level comprises:
performing difference calculation according to the historical ambient illuminance and the current ambient illuminance, and determining the difference ambient illuminance;
determining an interval where the illuminance is located according to the difference ambient illuminance;
determining a target running state and a target working parameter of the infrared light supplementing light source according to the interval where the illuminance is and the light supplementing strategy mapping relation;
and determining a target working mode of the infrared light supplementing light source according to the target running state and the target working parameter.
5. The method for image light compensation control of claim 3, wherein when the current ambient illuminance is greater than the preset illuminance threshold, determining whether the current acquisition period is a preset initial acquisition period further includes:
when the current acquisition period is a preset initial acquisition period, determining that the target running state of the infrared light supplementing light source is a light source closing state;
and determining a target working mode of the infrared light supplementing light source according to the light source closing state.
6. The image light-compensating control method according to claim 1, wherein the performing the image light-compensating control according to the target operation mode of the infrared light-compensating light source comprises:
when the target working mode of the infrared light supplementing light source is a light source closing state, determining that the filter working mode of the infrared filter is a filter opening state;
and starting the infrared optical filter according to the optical filter on state, and closing the infrared light supplementing light source according to the light source off state.
7. The image light supplementing control method according to any one of claims 1 to 6, wherein the determining the image brightness information of the current acquisition period based on the raw image data acquired by the image sensor includes:
determining a plurality of image data to be processed in a current acquisition period based on the original image data acquired by the image sensor;
respectively carrying out image conversion on each image data to be processed according to the space conversion matrix, and determining a plurality of initial brightness values of the current acquisition period;
calculating a difference between a plurality of initial luminance values;
and when the difference value between the initial brightness values is smaller than a preset difference value threshold value, determining the image brightness information of the current acquisition period according to the initial brightness values.
8. An image light-supplementing control device, characterized in that the image light-supplementing control device comprises:
the processing module is used for determining image brightness information of a current acquisition period based on original image data acquired by an image sensor, wherein the original image data is generated based on a preset central area of the image sensor;
the calculation module is used for calculating brightness according to the image brightness information of the current acquisition period and determining the current ambient illuminance;
the processing module is used for determining a target working mode of the infrared light supplementing light source according to the current ambient illuminance;
and the control module is used for carrying out image light supplementing control according to the target working mode of the infrared light supplementing light source.
9. An image light supplementing control device, characterized in that the device comprises: a memory, a processor, and an image light-supplementing control program stored on the memory and executable on the processor, the image light-supplementing control program configured to implement the image light-supplementing control method of any one of claims 1 to 7.
10. A storage medium having stored thereon an image light-supplementing control program which, when executed by a processor, implements the image light-supplementing control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311750649.0A CN117857905A (en) | 2023-12-18 | 2023-12-18 | Image light supplementing control method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311750649.0A CN117857905A (en) | 2023-12-18 | 2023-12-18 | Image light supplementing control method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117857905A true CN117857905A (en) | 2024-04-09 |
Family
ID=90542852
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311750649.0A Pending CN117857905A (en) | 2023-12-18 | 2023-12-18 | Image light supplementing control method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117857905A (en) |
-
2023
- 2023-12-18 CN CN202311750649.0A patent/CN117857905A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108419023B (en) | Method for generating high dynamic range image and related equipment | |
| US8994845B2 (en) | System and method of adjusting a camera based on image data | |
| US7733383B2 (en) | Image capture apparatus with a color property control function and image capture program | |
| US20070248342A1 (en) | Image quality in cameras using flash | |
| US7826662B2 (en) | Digital camera provided with gradation correction function | |
| CN112118388B (en) | Image processing method, image processing device, computer equipment and storage medium | |
| CN100511379C (en) | Display control device and display control method | |
| JP2007316599A (en) | Display control device and display control program | |
| JP2012523799A (en) | Automatic backlight detection | |
| WO2018121185A1 (en) | Method for adjusting power of infrared lamp, and photographic equipment | |
| JP4539432B2 (en) | Image processing apparatus and imaging apparatus | |
| US20060007238A1 (en) | Monitor control apparatus for optical device | |
| JP2006080942A (en) | Image processing apparatus, image processing program, image processing method, and imaging apparatus | |
| JP3882522B2 (en) | Mobile device with camera | |
| JP5316923B2 (en) | Imaging apparatus and program thereof | |
| CN117857905A (en) | Image light supplementing control method, device, equipment and storage medium | |
| EP2658245B1 (en) | System and method of adjusting camera image data | |
| JP6606981B2 (en) | Output control device, output control method, and program | |
| JP2009063674A (en) | Imaging apparatus and flash control method | |
| JP2002223386A (en) | Photographing device | |
| JP4887680B2 (en) | White balance adjusting device and white balance adjusting method | |
| JP6335497B2 (en) | Imaging device, control method thereof, and control program | |
| JP2023001975A (en) | Information processing apparatus, information processing method, and program | |
| CA2776009C (en) | System and method of adjusting camera image data | |
| JP2012222407A (en) | Imaging apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |