CN111741185B

CN111741185B - Light supplement control method, device, system and equipment and storage medium

Info

Publication number: CN111741185B
Application number: CN202010590637.6A
Authority: CN
Inventors: 陈辰; 张奇; 项延德; 罗玉新; 胡思启
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2020-06-24
Filing date: 2020-06-24
Publication date: 2022-04-26
Anticipated expiration: 2040-06-24
Also published as: CN111741185A

Abstract

The invention provides a light supplement control method, a device, a system, equipment and a storage medium, which can control a plurality of paths of light supplement lamps to supplement light at different time and can be applied to more scenes. A supplementary lighting control method is applied to camera equipment, the camera comprises N supplementary lighting lamps, and the method comprises the following steps: generating a frame synchronization signal according to a set image frame rate, and sending the frame synchronization signal to an image sensor in a camera device to control the image sensor to perform exposure; respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

Description

Light supplement control method, device, system and equipment and storage medium

Technical Field

The present invention relates to the field of monitoring technologies, and in particular, to a light supplement control method, device, system, and apparatus, and storage medium.

Background

In some low light environments, such as at night, the camera device also needs to be monitored. However, in a low-light environment, the image sensor in the camera apparatus may fail to image or the imaging noise may be large. In order to make the camera device obtain better image quality in a low-light environment, a fill-in lamp is generally adopted) to illuminate the shooting area of the camera device.

In the related art, there are several light supplement methods as follows: constantly bright, snap shot, flash, etc. Specifically, the normally-on mode is: in the process of camera equipment collection, the light filling lamp is kept on all the time, namely the light filling lamp is always on. The snap-shot flashing mode is as follows: the light filling lamp is started for a period of time when the snapshot is needed, the light filling lamp can be exposed and the snapshot is generally carried out for the period of time to obtain a plurality of images, and the light filling lamp is closed when the snapshot is not carried out.

In the above manner, the light supplement lamp of the camera device is always turned on and off simultaneously, the light supplement mode is single, and the application scene is limited.

Disclosure of Invention

In view of this, the present invention provides a light supplement control method, device, system, device, and storage medium, which can control a plurality of light supplement lamps to supplement light at different times and can be applied to more scenes.

The invention provides a light supplement control method, which is applied to camera equipment, wherein a camera comprises N paths of light supplement lamps, and the method comprises the following steps:

generating a frame synchronization signal according to a set image frame rate, and sending the frame synchronization signal to an image sensor in a camera device to control the image sensor to perform exposure;

respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

According to an embodiment of the present invention, generating a frame synchronization signal according to a set video frame rate includes:

generating a frame synchronization signal when M times of continuous power supply synchronization signal high-low level jump is detected; and M is the high-low level jump times of the power supply synchronous signal in a single frame period, and the single frame period is determined according to the image frame rate.

In accordance with one embodiment of the present invention,

the exposure mode of the image sensor is rolling shutter exposure;

the N paths of light supplementing lamps comprise at least one path of first light supplementing lamp, and the light wave band of the first light supplementing lamp is a non-visible light wave band;

when the current frame is subjected to light supplement through the first light supplement lamp, the level of a light supplement lamp control signal of the first light supplement lamp is a first level at a first moment, the first level is maintained to a second moment, and the first level is adjusted to a second level at the second moment;

the first time is determined according to the frame synchronization signal and a time length t0, the time length t0 is determined according to a first exposure time and a second exposure time, the first exposure time is the exposure starting time of the first row image signal of the current frame, and the second exposure time is the exposure starting time of the last row image signal of the current frame;

the second time is determined according to the frame synchronization signal and a time length t1, wherein the time length t1 is an exposure time length required by any line of image signals of the current frame.

According to one embodiment of the invention, the N light supplement lamps include at least one second light supplement lamp and at least one third light supplement lamp, and the light wave bands corresponding to the second light supplement lamp and the third light supplement lamp are different;

the third light supplement lamp is started to supplement light in odd frames and is closed to supplement light in even frames, and the second light supplement lamp is started to supplement light in even frames and is closed to supplement light in odd frames;

or the third light supplement lamp starts light supplement in an even frame and turns off light supplement in an odd frame, and the second light supplement lamp starts light supplement in an odd frame and turns off light supplement in an even frame;

or the third supplementary lighting lamp starts supplementary lighting in odd frames and turns off supplementary lighting in even frames, and the second supplementary lighting lamp starts supplementary lighting in each frame;

or the third light supplement lamp starts light supplement in even frames and turns off light supplement in odd frames, and the second light supplement lamp starts light supplement in each frame.

In accordance with one embodiment of the present invention,

the light wave band corresponding to the second light supplementing lamp is a visible light wave band, the light wave band corresponding to the third light supplementing lamp is an infrared light wave band, and the infrared light wave band comprises a near infrared light wave band and/or a far infrared light wave band.

In accordance with one embodiment of the present invention,

the N paths of light supplementing lamps comprise at least one path of fourth light supplementing lamp, at least one path of fifth light supplementing lamp and at least one path of sixth light supplementing lamp, the light wave band corresponding to the fourth light supplementing lamp is a visible light wave band, the light wave bands corresponding to the fifth light supplementing lamp and the sixth light supplementing lamp are non-visible light wave bands, and the corresponding light wave bands are different;

in each L continuous frames, the fourth light supplement lamp starts light supplement in each frame, the fifth light supplement lamp starts light supplement in one frame, the rest frames are closed, the sixth light supplement lamp starts light supplement in the other frame, the rest frames are closed, and L is greater than or equal to 3;

alternatively, the first and second electrodes may be,

in each L continuous frames, the fourth light supplement lamp, the fifth light supplement lamp and the sixth light supplement lamp start light supplement at corresponding appointed frames, and start and stop light supplement at frames outside the corresponding appointed frames, the appointed frames corresponding to the fourth light supplement lamp, the fifth light supplement lamp and the sixth light supplement lamp are different, and L is greater than or equal to 3.

A second aspect of the present invention provides a light supplement control system, including: a plurality of camera devices and a plurality of power supplies respectively connected to the plurality of cameras; each camera device comprises N paths of light supplement lamps;

the plurality of power supplies are to: generating power supply synchronous signals with the same frequency and the same phase, and respectively inputting the power supply synchronous signals into the connected camera equipment;

each camera device of the plurality of camera devices is to: generating a frame synchronization signal according to the power synchronization signal and a set image frame rate, and sending the frame synchronization signal to an image sensor in camera equipment to control the image sensor to perform exposure; respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

According to an embodiment of the present invention, when the camera device is configured to generate the frame synchronization signal according to the power synchronization signal and the set image frame rate, the camera device is specifically configured to:

In accordance with one embodiment of the present invention,

the exposure mode of the image sensor is rolling shutter exposure;

In accordance with one embodiment of the present invention,

alternatively, the first and second electrodes may be,

The third aspect of the present invention provides a light supplement control device, which is applied to a camera device, where the camera includes N light supplement lamps, and the device includes:

a frame synchronization signal generation unit for generating a frame synchronization signal according to a set image frame rate and transmitting the frame synchronization signal to an image sensor in a camera apparatus to control the image sensor to perform exposure;

the light supplement lamp control signal generation unit is used for respectively sending light supplement lamp control signals to N light supplement lamps according to the frame synchronization signal, wherein N is larger than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

According to an embodiment of the present invention, when the frame synchronization signal generating unit generates the frame synchronization signal according to the set video frame rate, the frame synchronization signal generating unit is specifically configured to:

In accordance with one embodiment of the present invention,

the exposure mode of the image sensor is rolling shutter exposure;

In accordance with one embodiment of the present invention,

alternatively, the first and second electrodes may be,

A fourth aspect of the present invention provides an electronic device, comprising a processor and a memory; the memory stores a program that can be called by the processor; when the processor executes the program, the light supplement control method in the foregoing embodiment is implemented.

A fifth aspect of the present invention provides a machine-readable storage medium, on which a program is stored, the program, when executed by a processor, implementing the light supplement control method as described in the foregoing embodiments.

The embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, a frame synchronization signal can be generated according to a set image frame rate, the frame synchronization signal is sent to an image sensor in a camera device to control the image sensor to perform exposure, and a fill-in light signal is sent to N light fill-in lights of the camera device to control the on or off of each light fill-in light, according to the frame synchronization signal, the time relationship between the fill-in light and the exposure of the image sensor is ensured to be controllable, in addition, the fill-in light control signals sent to the N light fill-in lights control the timing sequence of the start of the fill-in light lamps to be different, when the level of the fill-in light control signal is a first level, fill-in light is indicated, and when the level is a second level, no fill-in light is indicated, in other words, the N light fill-in light is no longer simultaneously started and closed, different fill-in light lamps have different fill-in light timing sequences, and fill in light at different times can be filled, thereby obtaining images in different modes, for example, images under light supplement at different positions, images in different light bands, and the like can be applied to more scenes.

Drawings

Fig. 1 is a schematic flow chart illustrating a light supplement control method according to an embodiment of the present invention;

fig. 2 is a block diagram of a configuration of a camera apparatus according to an embodiment of the present invention;

FIG. 3 is a diagram illustrating a relationship between a frame synchronization signal and a power synchronization signal generated by a power supply according to an embodiment of the present invention;

fig. 4 is a block diagram of a fill-in light control system according to an embodiment of the present invention;

fig. 5 is a schematic diagram illustrating a relationship between one light supplement lamp control signal and a frame synchronization signal sent to a first light supplement lamp according to an embodiment of the present invention;

fig. 6 is a block diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one type of device from another. For example, a first device may also be referred to as a second device, and similarly, a second device may also be referred to as a first device, without departing from the scope of the present invention. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

In order to make the description of the present invention clearer and more concise, some technical terms in the present invention are explained below:

the image sensor is selected from the following modes: in this mode, the image sensor starts exposure, performs data transmission, and the like in accordance with a synchronization signal input from the outside (for example, a control unit in the camera apparatus). The main mode is to control the exposure operation by the image sensor.

In the related light supplement control mode, because the light supplement lamp of the camera equipment is always simultaneously turned on for light supplement and turned off for light supplement, the camera equipment can only obtain images under the light supplement in a single mode and cannot obtain images under different light supplement modes. For example, the camera device cannot obtain images under light supplement at different positions, and cannot be applied to scenes requiring images under light supplement at different positions. For another example, the camera device can only obtain one optical band image, and cannot be applied to scenes requiring different optical band images, such as scenes requiring both infrared light images and visible light images. Therefore, the applicable scenarios of the above method are greatly limited.

The light supplement control method provided by the embodiment of the invention can be applied to various monitoring scenes, such as entrance guard, gates, traffic, residential areas, parks, perimeter precaution, indoor public places (such as bank self-service points) and the like, and can be particularly applied to scenes requiring high-quality images, such as scenes requiring target detection, target identification and the like.

The light supplement control method according to the embodiment of the present invention is described in more detail below, but should not be limited thereto.

In one embodiment, referring to fig. 1, a light supplement control method may include the following steps:

s100: generating a frame synchronization signal according to a set image frame rate, and sending the frame synchronization signal to an image sensor in a camera device to control the image sensor to perform exposure;

s200: respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

In the embodiment of the present invention, the main execution body of the light supplement control method is a camera device, and more specifically, the light supplement control method may be a light supplement control device in the camera device. Optionally, the supplementary lighting control device may be an FPGA (Field Programmable Gate Array). Generally, an FPGA with a desired function can be formed by hardware programming, and the specific function is not limited, and other functions can be implemented besides the above method. It can be understood that the light supplement control device is not limited to the FPGA, and may also be a dedicated image processing chip with a corresponding function, such as a DSP processor, and the method may be implemented by the DSP processor running a corresponding program, which is not limited specifically.

Alternatively, referring to fig. 2, the camera apparatus may include a fill-in light control device 100 and an image sensor 200. The fill-in light control device 100 may include a frame synchronization signal generating unit 101 and a fill-in light control signal generating unit 102, which are connected to each other. The frame synchronization signal generation unit 101 is also connected to the image sensor 200, and may generate a frame synchronization signal and transmit the generated frame synchronization signal to the image sensor 200 and the fill-in light control signal generation unit 102. The light supplement lamp control signal generation unit 102 is connected to N light supplement lamps (two are shown in the figure, and there may be more paths in practice), and can send light supplement lamp control signals to the N light supplement lamps respectively according to the frame synchronization signal.

In one example, the frame synchronization signal generating unit 101 may perform the operation in step S100, and the fill light control signal generating unit 102 may perform the operation in step S200.

The image sensor described above may be in a slave mode such that the image sensor performs exposure under the control of the frame synchronization signal transmitted by the frame synchronization signal generation unit 101. Alternatively, the image sensor may enter the slave mode immediately after being turned on, or may enter the slave mode when acquisition is required.

It is to be understood that the camera device may of course also comprise other components, such as memory, filters, etc., in particular, but not exclusively. The following description will be made by taking the above-described camera device as an example, but the present invention is not limited thereto.

Alternatively, the camera apparatus may set two exposure modes, one is a low-light exposure mode, and the other is a non-low-light exposure mode, in which the ambient light level (for example, at night) corresponding to the low-light exposure mode is lower than the ambient light level (for example, at daytime) corresponding to the non-low-light exposure mode. The above-described steps S100 to S200 may be performed when the camera apparatus is in the low-illuminance exposure mode. When the camera equipment is in a non-low illumination exposure mode, each light supplementing lamp can not supplement light, and the camera equipment can shoot images with higher quality under sunshine.

In step S100, a frame synchronization signal is generated at a set image frame rate, and the frame synchronization signal is transmitted to an image sensor in the camera device to control the image sensor to perform exposure.

The frame synchronization signal may be used to constrain the temporal relationship between different operations of the camera device for the same frame, different frames corresponding to different frame synchronization signals. In this embodiment, the frame synchronization signal may be used to constrain a time relationship between the exposure of the image sensor and the fill-in light of the fill-in lamp.

When the image sensor receives the frame synchronization signal, the exposure may be performed immediately, or the exposure may be performed with a delay, which is not limited. In other words, the exposure timing of the image sensor is determined by the frame synchronization signal.

As shown in fig. 2, the frame synchronization signal may be generated by the frame synchronization signal generation unit 101 and transmitted to the image sensor 200 and the fill-in lamp control signal generation unit 102. The frame synchronization signal may be a rectangular wave signal having a rising edge and a falling edge, and the image sensor 200 and the fill-in light control signal generating unit 102 may determine whether the frame synchronization signal is received by detecting whether the respective frame synchronization receiving interfaces have the rising edge or the falling edge. In one example, the image sensor 200 may expose when a falling edge of the frame synchronization signal is detected.

In step S200, respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

The N light supplement lamps may be different in installation position, for example, in the N light supplement lamps, at least one light supplement lamp is installed on the left side of the camera device, one light supplement lamp is installed on the right side of the camera device, one light supplement lamp is installed above the camera device, and the other light supplement lamp is installed below the camera device; and/or, the N light supplement lamps may be different in corresponding optical bands, for example, in the N light supplement lamps, at least one corresponding optical band is a visible light band, one corresponding optical band is a near-infrared light band, and one corresponding optical band is a far-infrared light band. Of course, this is merely an example, and the number and the difference of the fill-in lamps are not limited thereto.

N may be 2, 3, 4, 5, and the like, and in this embodiment, the specific number of the fill-in lights included in the camera device is not limited, and may be multiple.

Optionally, a plurality of light supplement lamp groups can be divided into N light supplement lamps in advance, each light supplement lamp group can contain one or more light supplement lamps, light wave bands corresponding to the light supplement lamps in different light supplement lamp groups are different, and light wave bands corresponding to the light supplement lamps in the same light supplement lamp group are the same. Preferably, each fill-in light group includes a plurality of fill-in lights, which may be different in installation position (for example, located at the upper, lower, left, and right sides of the camera device, respectively), and/or may be different in light wavelength, but the light wavelength bands corresponding to the fill-in lights are the same. When the device works, the light supplementing lamps in the same light supplementing lamp group can be simultaneously started, and the light supplementing lamps in different light supplementing lamp groups are not simultaneously started for supplementing light. It is to be understood that the grouping manner and the control manner of the fill-in light are only examples and are not limiting.

Referring to fig. 2, the fill-in light control signal generation unit 102 may determine the levels of the N fill-in light control signals according to the frame synchronization signal when receiving the frame synchronization signal, and respectively send the fill-in light control signals to the N fill-in lights. For example, when it is determined that one light supplement lamp needs to supplement light to a current frame, the level of a light supplement lamp control signal for controlling the light supplement lamp may be determined to be a first level; when it is determined that one light supplement lamp does not need to supplement light to the current frame, the level of the light supplement lamp control signal for controlling the light supplement lamp can be determined to be the second level.

The first level may be a high level and correspondingly, the second level is a low level; alternatively, the first level may be a low level and, correspondingly, the second level is a high level. The specific light supplement lamp can be determined according to the light supplement lamp, and the light supplement lamp is turned on when the light supplement lamp control signal for controlling the light supplement lamp is at a first level, and the light supplement lamp is turned off when the light supplement lamp control signal for controlling the light supplement lamp is at a second level.

The specific light supplement of which way, not light supplement of which way do not do the injecing in the N way light supplement lamp can set up corresponding condition and confirm according to frame synchronization signal, as long as send to the light supplement lamp control signal control light supplement lamp of N way light supplement lamp open the chronogenesis of light supplement different can.

Because the time sequences that the light filling lamp opened the light filling are different to the light filling lamp control signal control light filling lamp of N way light filling lamp, N way light filling lamp no longer opens the light filling simultaneously, closes the light filling simultaneously, and different light filling lamps can have different light filling time sequences, and steerable multichannel light filling lamp is at different time light filling to can obtain the image under the different mode light filling, like image, different light wave band images etc. under the different positions light filling, can be applied to in more scenes.

In the above manner, it is ensured that the time relationship between the supplementary lighting and the exposure of the image sensor is controllable based on the frame synchronization signal, and it can be ensured that at least one path of supplementary lighting lamp can supplement lighting during the exposure of the image sensor, so as to obtain image data of exposure imaging under the supplementary lighting of the corresponding supplementary lighting lamp. For example, when the light band corresponding to the fill-in light for fill-in light is a near-infrared light band, the obtained image data is near-infrared image data; when the light band corresponding to the light supplement lamp for light supplement is the far infrared light band, the obtained image data is the far infrared image data.

In one embodiment, the step S100 of generating the frame synchronization signal according to the set image frame rate may include the steps of:

s101: generating a frame synchronization signal when M times of continuous power supply synchronization signal high-low level jump is detected; and M is the high-low level jump times of the power supply synchronous signal in a single frame period, and the single frame period is determined according to the image frame rate.

The power synchronization signal may be a periodic square wave signal, and may be output by a power supply connected to the camera device, and the power supply may be connected to an ac mains supply. With continued reference to fig. 2, the power supply 400 may output a power synchronization signal to the frame synchronization signal generation unit 101; the frame synchronization signal generating unit 101 generates a frame synchronization signal when M consecutive power synchronization signal high-low level transitions (or flips) are detected.

The image frame rate is the number of image frames generated in a unit time, and the unit time herein may be 1s, 1ms, or the like, and is not particularly limited. The single frame period is determined according to the image frame rate, which can be the reciprocal of the image frame rate, and the physical meaning is the time interval for generating two continuous images, or only one image is generated in the single frame period.

M may be determined according to the video frame rate and the frequency of the power synchronization signal, such as the ratio of the frequency of the power synchronization signal to the video frame rate. Taking the frequency of the power source synchronizing signal as 50Hz and the image frame rate as 25Hz as an example, M may be 50/25-2.

Taking M as the number of high and low level transitions of the power synchronization signal in a single frame period, referring to fig. 3, the frame synchronization signal generation unit generates a frame synchronization signal every time M consecutive high and low level transitions of the power synchronization signal are detected.

Specifically, the rising edge or the falling edge (taking the rising edge as an example below) of the received power synchronization signal may be counted to obtain a power synchronization signal count value; and generating a frame synchronization signal when the power synchronization signal count value reaches M. For example, when the power synchronization signal is received, the counting method increases the recorded power synchronization signal count value by 1.

Alternatively, with continuing reference to fig. 3, the frame synchronization signal generating unit may also wait for a period of time Tdelay when the power synchronization signal count value reaches M, and then generate the frame synchronization signal. The time Tdelay may be, for example, less than or equal to a duration of one power synchronization signal, and is not particularly limited. Further, when the power synchronization signal count value reaches M, the power synchronization signal count value may be reset to a set initial value, for example, 0, and counting of the rising edge of the power synchronization signal may be restarted.

In an example, the fill-in light control system where the camera device is located includes a plurality of camera devices, referring to fig. 4, power supplies connected to the camera devices may be connected to ac mains supplies with the same phase, and the types of the power supplies may be the same, where the ac mains supplies are, for example, ac power with a voltage of 220V and a frequency of 50Hz, and it is ensured that the power supplies can output power synchronization signals with the same frequency and the same phase, for example, square wave signals with a frequency of 50Hz may be generated, and each square wave signal serves as a power synchronization signal, and of course, the specific frequency is not limited thereto.

The multiple camera devices in fig. 4 may be located in the same designated area (e.g., the same cell, community, parking lot, etc.), and the power supplies connected to the multiple camera devices are connected to the same ac power source, so as to generate power synchronization signals with the same frequency and phase. Therefore, as the frequency and the phase of the power supply synchronous signal are the same, the multiple camera devices can generate the frame synchronous signal at the same time point by executing the light supplementing control method, so that light supplementing can be performed at the same time, the purpose of synchronously or even simultaneously supplementing light for the multiple camera devices is achieved, and light pollution is avoided.

In the related multi-camera device synchronous light supplement technology, synchronization is generally performed by adopting a GPS time service mode, a network time service mode, a multi-machine signal interconnection mode and the like. The GPS time service and the network time service are low in synchronization precision, and the control requirement of the light supplement lamp with accurate frames as units cannot be met. In the multi-machine signal interconnection mode, one camera is required to be used as a host, other machines are required to be used as slaves, and control lines are required to be connected with one another, so that the design and control complexity is greatly improved.

In this embodiment, on the basis that the power supply can generate the power synchronization signal with the same frequency and the same phase, the camera device generates the frame synchronization signal based on the power synchronization signal generated by the power supply, and can ensure that each camera generates the frame synchronization signal at the same time, so that light supplement can be performed at the same time, synchronization is achieved, even simultaneous light supplement is achieved, the synchronization effect is better, the synchronization precision is high, and the implementation complexity is low.

In one embodiment, the exposure mode of the image sensor is rolling shutter exposure;

Optionally, the first light supplement lamp is an infrared light supplement lamp; the light wave band corresponding to the first light supplement lamp is an infrared light wave band. Of course, the light band of the first fill-in light may also be other non-visible light bands, such as an ultraviolet band, and the like.

There are two common methods of operation of the camera device during image acquisition: rolling shutter exposure and global exposure. In global exposure, for each frame of image, the camera device completes the whole process of exposure and data readout (from the image sensor and saved into the memory) of the frame of image before the next image acquisition is started. While global exposure may be suitable in many cases, it is not the most efficient way. In order to increase the frame rate of the camera device, it is allowed to read out and store the previous frame image data at the time of exposure of the next frame image, which is the rolling shutter exposure mode.

In the roll-up exposure, because the image exposures of adjacent frames in the image sensor are time staggered, that is, when several lines of image signals behind the 1 st frame image are not exposed, several lines of image signals before the 2 nd frame image are exposed, if the optical band corresponding to the fill-in lamp during the exposure of the 1 st frame image is different from the optical band corresponding to the fill-in lamp during the exposure of the 2 nd frame image, the lights generated by the two fill-in lamps interfere with each other, especially the light generated by the infrared fill-in lamp seriously affects the fill-in effect of the visible light fill-in lamp (the acquired image data contains infrared illumination information and is difficult to filter).

Therefore, in this embodiment, when the current frame is light-supplemented by the first fill-in light lamp, the time (that is, the first time) of turning on the fill-in light of the first fill-in light lamp and the time (that is, the second time) of turning off the fill-in light are strictly controlled, so that the fill-in light of the first fill-in light lamp on the current frame is prevented from affecting the fill-in light of other fill-in light lamps on other frames.

Wherein the first time is determined according to the frame synchronization signal and the time duration t0, referring to fig. 5, it is assumed that the current frame is the second frame image, the time duration t0 is determined according to the first exposure time and the second exposure time, the first exposure time is the exposure starting time of the first line image signal of the 2 nd frame image, and the second exposure time is the exposure starting time of the last line image signal of the 2 nd frame image. Optionally, the duration t0 may be a time difference between the second exposure time and the first exposure time, but may actually be adjusted, for example, the duration is greater than the time difference and less than the exposure duration of any line of image signals.

Specifically, the time difference between the first time and the receiving time of the frame synchronization signal (specifically, for example, the time when the falling edge of the frame synchronization signal is detected) may be a time duration t0, that is, when the frame synchronization signal is received, after waiting for the time duration t0, the level of the fill-in light control signal of the first fill-in light is adjusted from the second level to the first level when the first time is reached, and the first level is maintained to the second time, so that the first fill-in light is turned on to fill in the time period from the first time to the second time.

With continued reference to fig. 5, the second time is determined according to the frame synchronization signal and the time duration t1, and the time duration t1 is the exposure time duration required by the image signal of any line of the current frame. Specifically, the time difference between the second time and the receiving time of the frame synchronization signal may be a time duration t1, that is, when the frame synchronization signal is received and the second time is reached after waiting for the time duration t1, the level of the fill light control signal of the first fill light is adjusted from the first level to the second level, so that the first fill light turns off the fill light after the second time. Of course, the time difference may actually be less than the time period t1, and is not limited specifically.

By the mode, under the condition of shutter exposure, light supplement of two adjacent frames can be prevented from interfering with each other, and the quality of obtained image data is guaranteed.

Optionally, the fill-in light control signal may be a PWM (pulse width modulation) signal. The higher the duty ratio of the PWM signal is, the higher the illuminance of the light supplement lamp is; the lower the duty ratio of the PWM signal, the lower the illuminance of the fill light. When the duty ratio of the PWM signal is 0, namely no PWM signal exists, the light supplement lamp is turned off at the moment.

In one embodiment, the N light supplement lamps include at least one second light supplement lamp and at least one third light supplement lamp, and the light bands corresponding to the second light supplement lamp and the third light supplement lamp are different;

In some cases, the odd frames and the even frames may be determined by counting frame synchronization signals, for example, when the fill-in light control signal generating unit receives a frame synchronization signal, the recorded frame synchronization signal count value may be increased by 1 to obtain a current frame synchronization signal count value; determining whether the current frame synchronous signal count value is 2, if so, determining that a second light supplement lamp starts light supplement; if not, it is determined that the third fill light lamp turns on the fill light (the time of turning on the fill light and turning off the fill light can be determined by referring to the determination method in the foregoing embodiment), and then: the second light supplement lamp is started to supplement light in an even frame and is closed to supplement light in an odd frame, and the third light supplement lamp is started to supplement light in an odd frame and is closed to supplement light in an even frame.

The above example is a description of a case where the third fill light lamp turns on fill light in an odd frame and turns off fill light in an even frame, and the second fill light lamp turns on fill light in an even frame and turns off fill light in an odd frame, and other cases are similar, and are not described herein again.

It is understood that the several aspects of the present embodiment are exemplary only, and are not limiting in nature. For example, M2 frames may be used as a cycle, M1>2, and the turn-on condition may be configured, so that only the second fill-in lamp is turned on to fill in one or several frames but not all frames in each cycle, and only the third fill-in lamp is turned on to fill in the remaining frames, which is not limited specifically.

In one embodiment, the light band corresponding to the second fill-in light is a visible light band, and the light band corresponding to the third fill-in light is an infrared light band, where the infrared light band includes a near-infrared light band and/or a far-infrared light band.

In this embodiment, the second light supplement lamp can maintain the light supplement all the time (i.e., normally bright), i.e., the second light supplement lamp can maintain the light supplement when the third light supplement lamp is controlled to be turned on for light supplement, and the second light supplement lamp also maintains the light supplement when the third light supplement lamp is turned off. Under the condition that the third light supplement lamp and the second light supplement lamp are simultaneously started, although the exposed image contains two kinds of illumination information, the infrared illumination information is stronger and easier to distinguish compared with the visible illumination information, and after the visible illumination information in the image is subsequently filtered, the light band image corresponding to the third light supplement lamp can be obtained, so that the method is feasible.

In this embodiment, when a visible light image needs to be obtained, only the second light supplement lamp is turned on and the third light supplement lamp needs to be in an off state under the condition that the light band corresponding to the second light supplement lamp is a visible light band and the light band corresponding to the third light supplement lamp is an infrared light band. Therefore, the problem that the required visible light illumination information is difficult to analyze due to the fact that the visible light illumination information in the obtained image is influenced by the infrared light illumination information can be avoided.

Through the embodiment, the visible light image can be obtained when the third light supplementing lamp supplements light for exposure, and the infrared light image can be obtained when the second light supplementing lamp supplements light for exposure, so that the same camera device can obtain images in different light wave bands.

In an example, the third fill-in light is not turned on for each frame of exposure, and a turn-on condition may be configured to determine which frames of exposure the third fill-in light is turned on for. Specifically, the P frame may be used as one cycle, and P > -2, the turn-on condition may be configured, so that the third fill-in lamp only fills in one or several frames but not all the exposures in each cycle. For example, taking 5 frames as an example of a cycle, the third fill-in lamp can be controlled to be turned on for fill-in during the exposure of the 1 st frame and the 4 th frame, and the second fill-in lamp can be used for fill-in without fill-in during the exposure of the 2 nd frame, the 3 rd frame and the 5 th frame. Taking 2 frames as an example of a cycle, the third fill light lamp may not be turned on during the exposure of the 1 st frame, the third fill light lamp may be turned on during the exposure of the 2 nd frame, the third fill light lamp may not be turned on during the exposure of the 3 rd frame, the third fill light lamp may be turned on during the exposure of the 4 th frame (refer to fig. 5), and so on, and the second fill light lamp may be normally on. Therefore, under the condition that the third light supplement lamp corresponds to the infrared light wave band and the second light supplement lamp corresponds to the visible light wave band, the camera equipment can alternately obtain visible light images and infrared light images.

In one embodiment, the image sensor is provided with a filter for transmitting visible light and infrared light, wherein the filter provided in the image sensor may be, for example, a visible light and infrared light double-peak filter, which can transmit visible light and infrared light, but can filter out light in other light bands, so that the light cannot enter into the photosensitive component of the image sensor. Of course, the present invention is not limited to this, and for example, two kinds of filters may be provided, and the corresponding filter may be selected to filter light as needed.

Then, when the third fill-in light is turned on, the infrared light enters the photosensitive member of the image sensor through the optical filter, and is filled in when the image sensor is exposed, so that an infrared light image is finally obtained. Under the conditions that the third light supplement lamp is turned off and the second light supplement lamp is turned on, visible light can penetrate through the optical filter and enter the photosensitive component of the image sensor, light supplement is carried out when the image sensor is exposed, and finally a visible light image is obtained.

Since the infrared image usually lacks color information, and the near-infrared image lacking color still cannot provide complete monitoring information for the user when being used for display, in some cases, it is very meaningful to combine the characteristics of visible light and near-infrared light, such as fusing the visible light and the near-infrared image. In the related art, the infrared camera and the visible light camera are usually combined to obtain the visible light image and the near-infrared image, but in the embodiment, only one camera device can obtain the infrared light image and the visible light image.

In one embodiment, the N light supplement lamps include at least one fourth light supplement lamp, at least one fifth light supplement lamp, and at least one sixth light supplement lamp, where a light band corresponding to the fourth light supplement lamp is a visible light band, light bands corresponding to the fifth light supplement lamp and the sixth light supplement lamp are non-visible light bands, and the corresponding light bands are different;

alternatively, the first and second electrodes may be,

Take L as 3 for example, i.e. 3 frames as a cycle: the fourth light supplement lamp can be turned on for the 1 st frame and turned off for the rest frames, the fifth light supplement lamp can be turned on for the 2 nd frame and turned off for the rest frames, and the sixth light supplement lamp can be turned on for the 3 rd frame and turned off for the rest frames; or, the fourth fill light lamp can all open the fill light in 3 frames, and the fifth fill light lamp can open the fill light in 2 nd frame, and the fill light is closed to all the other frames, and the sixth fill light lamp can open the fill light in 3 rd frame, and the fill light is closed to all the other frames. The rest of the cases are similar, and the description is omitted. It is to be understood that this is by way of example only and is not to be taken by way of limitation.

The present invention also provides a light supplement control system, referring to fig. 4, the system may include: a plurality of camera devices and a plurality of power supplies respectively connected to the plurality of cameras; each camera device comprises N light supplement lamps.

In one embodiment, the plurality of power supplies are for: the power synchronous signals with the same frequency and phase are generated and respectively input into the connected camera equipment. Each camera device of the plurality of camera devices is to: generating a frame synchronization signal according to the power synchronization signal and a set image frame rate, and sending the frame synchronization signal to an image sensor in camera equipment to control the image sensor to perform exposure; respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

In an embodiment, when the camera device is configured to generate the frame synchronization signal according to the power synchronization signal and the set image frame rate, the camera device is specifically configured to:

In one embodiment of the present invention,

the exposure mode of the image sensor is rolling shutter exposure;

In one embodiment of the present invention,

alternatively, the first and second electrodes may be,

The embodiments of the system described above correspond substantially to the method embodiments, so that reference may be made to the partial description of the method embodiments for relevant points.

The present invention also provides a light supplement control device, which is applied to a camera device, wherein the camera device includes N light supplement lamps, and referring to fig. 2, the device 100 includes:

a frame synchronization signal generation unit 101 configured to generate a frame synchronization signal according to a set image frame rate, and send the frame synchronization signal to an image sensor in a camera device to control the image sensor to perform exposure;

a light supplement lamp control signal generation unit 102, configured to send light supplement lamp control signals to N light supplement lamps according to the frame synchronization signal, where N is greater than 1; the light supplement lamp control signal sent to the N light supplement lamps controls the light supplement lamps to start different time sequences of light supplement, when the level of the light supplement lamp control signal is the first level, the light supplement is represented, and when the level of the light supplement lamp control signal is the second level, the light supplement is not represented.

In an embodiment, when the frame synchronization signal generating unit generates the frame synchronization signal according to the set video frame rate, the frame synchronization signal generating unit is specifically configured to:

In one embodiment of the present invention,

the exposure mode of the image sensor is rolling shutter exposure;

In one embodiment of the present invention,

alternatively, the first and second electrodes may be,

The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.

For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts shown as units may or may not be physical units.

The invention also provides an electronic device, which comprises a processor and a memory; the memory stores a program that can be called by the processor; when the processor executes the program, the light supplement control method in the foregoing embodiment is implemented.

The embodiment of the light supplement control device can be applied to electronic equipment. Taking a software implementation as an example, as a logical device, the device is formed by reading, by a processor of the electronic device where the device is located, a corresponding computer program instruction in the nonvolatile memory into the memory for operation. In terms of hardware, as shown in fig. 6, fig. 6 is a hardware structure diagram of an electronic device where the fill-in light control apparatus 100 is located according to an exemplary embodiment of the present invention, and except for the processor 510, the memory 530, the interface 520, and the nonvolatile memory 540 shown in fig. 6, the electronic device where the apparatus 100 is located in the embodiment may also include other hardware according to an actual function of the electronic device, which is not described again.

The present invention also provides a machine-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method for controlling fill-in light is implemented as described in the foregoing embodiments.

The present invention may take the form of a computer program product embodied on one or more storage media including, but not limited to, disk storage, CD-ROM, optical storage, and the like, having program code embodied therein. Machine-readable storage media include both permanent and non-permanent, removable and non-removable media, and the storage of information may be accomplished by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of machine-readable storage media include, but are not limited to: phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium may be used to store information that may be accessed by a computing device.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. A light supplement control method is characterized by being applied to camera equipment, wherein a camera comprises N paths of light supplement lamps, the N paths of light supplement lamps comprise at least one path of first light supplement lamp, and the light wave band of the first light supplement lamp is a non-visible light wave band, and the method comprises the following steps:

generating a frame synchronization signal according to a set image frame rate, and sending the frame synchronization signal to an image sensor in a camera device to control the image sensor to carry out rolling exposure;

respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the time sequences of the light supplement lamps controlled by light supplement lamp control signals sent to the N paths of light supplement lamps to start light supplement are different, when the level of the light supplement lamp control signals is a first level, light supplement is represented, and when the level of the light supplement lamp control signals is a second level, light supplement is not represented;

the first time is determined according to a frame synchronization signal and a time duration t0, the time duration t0 is determined according to a first exposure time and a second exposure time, the first exposure time is the exposure starting time of a first line image signal of the current frame, and the second exposure time is the exposure starting time of a last line image signal of the current frame; the second time is determined according to the frame synchronization signal and a time length t1, wherein the time length t1 is an exposure time length required by any line of image signals of the current frame.

2. The light supplement control method according to claim 1, wherein generating the frame synchronization signal according to the set video frame rate comprises:

3. A light supplement control method according to claim 1, wherein the N light supplement lamps further comprise at least one second light supplement lamp and at least one third light supplement lamp, and the second light supplement lamp and the third light supplement lamp have different corresponding optical bands;

4. The light supplement control method according to claim 3,

5. The light supplement control method according to claim 1,

the N paths of light supplementing lamps further comprise at least one path of fourth light supplementing lamp, at least one path of fifth light supplementing lamp and at least one path of sixth light supplementing lamp, the light wave band corresponding to the fourth light supplementing lamp is a visible light wave band, the light wave bands corresponding to the fifth light supplementing lamp and the sixth light supplementing lamp are non-visible light wave bands, and the corresponding light wave bands are different;

alternatively, the first and second electrodes may be,

6. A light supplement control system, comprising: a plurality of camera devices and a plurality of power supplies respectively connected to the plurality of cameras; each camera device comprises N paths of light supplementing lamps, each N path of light supplementing lamp comprises at least one path of first light supplementing lamp, and the light wave band of each first light supplementing lamp is a non-visible light wave band;

each camera device of the plurality of camera devices is to: generating a frame synchronization signal according to the power synchronization signal and a set image frame rate, and sending the frame synchronization signal to an image sensor in camera equipment to control the image sensor to carry out rolling exposure; respectively sending a light supplement lamp control signal to N light supplement lamps according to the frame synchronization signal, wherein N is greater than 1; the time sequences of the light supplement lamps controlled by light supplement lamp control signals sent to the N paths of light supplement lamps to start light supplement are different, when the level of the light supplement lamp control signals is a first level, light supplement is represented, and when the level of the light supplement lamp control signals is a second level, light supplement is not represented; when the current frame is subjected to light supplement through the first light supplement lamp, the level of a light supplement lamp control signal of the first light supplement lamp is a first level at a first moment, the first level is maintained to a second moment, and the first level is adjusted to a second level at the second moment; the first time is determined according to a frame synchronization signal and a time duration t0, the time duration t0 is determined according to a first exposure time and a second exposure time, the first exposure time is the exposure starting time of a first line image signal of the current frame, and the second exposure time is the exposure starting time of a last line image signal of the current frame; the second time is determined according to the frame synchronization signal and a time length t1, wherein the time length t1 is an exposure time length required by any line of image signals of the current frame.

7. The utility model provides a light filling controlling means, its characterized in that is applied to camera equipment, the camera includes N way light filling lamps, N way light filling lamps include first light filling lamp of at least the same way, the light wave band of first light filling lamp is the non-visible light wave band, and the device includes:

a frame synchronization signal generation unit for generating a frame synchronization signal according to a set image frame rate and transmitting the frame synchronization signal to an image sensor in a camera device to control the image sensor to perform a rolling exposure;

the light supplement lamp control signal generation unit is used for respectively sending light supplement lamp control signals to N light supplement lamps according to the frame synchronization signal, wherein N is larger than 1; the time sequences of the light supplement lamps controlled by light supplement lamp control signals sent to the N paths of light supplement lamps to start light supplement are different, when the level of the light supplement lamp control signals is a first level, light supplement is represented, and when the level of the light supplement lamp control signals is a second level, light supplement is not represented; when the current frame is subjected to light supplement through the first light supplement lamp, the level of a light supplement lamp control signal of the first light supplement lamp is a first level at a first moment, the first level is maintained to a second moment, and the first level is adjusted to a second level at the second moment;

8. The fill-in light control device according to claim 7, wherein the frame synchronization signal generating unit, when generating the frame synchronization signal according to the set video frame rate, is specifically configured to:

9. An electronic device comprising a processor and a memory; the memory stores a program that can be called by the processor; the processor, when executing the program, implements the light supplement control method according to any one of claims 1 to 6.

10. A machine-readable storage medium, having a program stored thereon, which when executed by a processor, implements the fill light control method according to any one of claims 1 to 6.