CN110536070B - Infrared lamp control method and device and four-eye adjustable camera - Google Patents

Infrared lamp control method and device and four-eye adjustable camera Download PDF

Info

Publication number
CN110536070B
CN110536070B CN201810501412.1A CN201810501412A CN110536070B CN 110536070 B CN110536070 B CN 110536070B CN 201810501412 A CN201810501412 A CN 201810501412A CN 110536070 B CN110536070 B CN 110536070B
Authority
CN
China
Prior art keywords
lens
infrared lamp
brightness
lenses
lamp group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810501412.1A
Other languages
Chinese (zh)
Other versions
CN110536070A (en
Inventor
邓贵涛
高海龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201810501412.1A priority Critical patent/CN110536070B/en
Priority to US16/767,447 priority patent/US10992875B2/en
Priority to PCT/CN2018/123954 priority patent/WO2019129083A1/en
Priority to EP18895808.6A priority patent/EP3734956B1/en
Publication of CN110536070A publication Critical patent/CN110536070A/en
Application granted granted Critical
Publication of CN110536070B publication Critical patent/CN110536070B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention provides an infrared lamp control method and device and a four-eye adjustable camera. The method comprises the following steps: respectively determining, for each of a plurality of lenses of the multi-view adjustable camera, a brightness change rate between a picture taken by the lens when a first infrared lamp group is not turned on and a picture taken by the lens when the first infrared lamp group is turned on, the first infrared lamp group being one of the infrared lamp groups of the multi-view adjustable camera; and determining the lens with the maximum brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group. According to the embodiment of the invention, the light supplement effect of the first infrared lamp group is improved on the premise that the position of the first infrared lamp group is fixed.

Description

Infrared lamp control method and device and four-eye adjustable camera
Technical Field
The invention relates to the technical field of network cameras, in particular to an infrared lamp control method and device and a four-eye adjustable camera.
Background
The multi-view camera is provided with a plurality of lenses, and in actual work, scenes with dark light, such as cloudy days, night or places with insufficient light, can be monitored by using the infrared lenses. In order to obtain a clearer image, the infrared light lens can be supplemented with light by an infrared lamp.
In the prior art, infrared light supplement is performed on infrared lenses on a multi-view camera, a group of infrared lamp sets can be preconfigured for each infrared lens, when one lens needs to perform infrared light supplement, the preconfigured infrared lamp sets corresponding to the lens are started, and the infrared lamp sets emit infrared light, so that the light intensity of the infrared light in a scene which can be irradiated by the infrared lamp sets is increased, and the obtained image is clearer.
However, in a multi-view adjustable camera in which the positions of a plurality of infrared lenses can be manually adjusted, the positions of the plurality of infrared lenses may be adjusted according to actual needs, and the scene monitored by the infrared lenses is changed along with the adjustment. And the infrared lamp group can not move along with the infrared lens due to optical and heat dissipation reasons, so that after adjustment, the overlapping area of the scene monitored by the infrared lens and the scene irradiated by the pre-configured infrared lamp group is smaller, and the light supplement effect of the pre-configured infrared lamp group on the infrared lens is poorer.
Disclosure of Invention
The embodiment of the invention aims to provide an infrared lamp control method to improve the light supplement effect of an infrared lamp group in a multi-view adjustable camera. The specific technical scheme is as follows:
in a first aspect of the embodiments of the present invention, there is provided an infrared lamp control method, including:
respectively determining, for each of a plurality of lenses of the multi-view adjustable camera, a brightness change rate between a picture taken by the lens when a first infrared lamp group is not turned on and a picture taken by the lens when the first infrared lamp group is turned on, the first infrared lamp group being one of the infrared lamp groups of the multi-view adjustable camera;
and determining the lens with the maximum brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
With reference to the first aspect, in a first possible implementation manner, the determining, for each of a plurality of lenses of the multi-view adjustable camera, a luminance change rate between a picture taken by the lens when the first infrared lamp group is not turned on and a picture taken by the lens when the first infrared lamp group is turned on includes:
turning off all infrared lamp groups in the multi-view adjustable camera;
respectively determining the brightness of a picture shot by each lens under the condition that all the infrared lamp groups are not started as the brightness of the lens without light supplement;
starting a first infrared lamp set;
respectively determining the brightness of a picture shot by each lens under the condition that the first infrared lamp group is started as the light supplement brightness of the lens aiming at each lens in the plurality of lenses;
and respectively calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens for each lens in the plurality of lenses to serve as the brightness change rate of the lens.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, after determining, for each of the multiple lenses, brightness of a picture captured by the lens when all the infrared lamp groups are not turned on as brightness of light not supplemented to the lens, the method further includes:
respectively counting the variance of the brightness of a picture shot by the lens in unit time under the condition that all infrared lamp groups are not started as the variance of the brightness of the lens without light supplement for each lens in the plurality of lenses;
if the lenses with the non-supplemented light brightness variance larger than a preset first variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of closing all infrared lamp groups in the multi-view adjustable camera;
and if no lens with the brightness variance of the light not supplemented is larger than the first variance threshold value exists in the plurality of lenses, continuing to execute the step of starting the first infrared lamp group.
With reference to the first possible implementation manner of the first aspect, in a third possible implementation manner, after determining, for each of the multiple lenses, brightness in a picture captured by the lens when the first infrared lamp group is turned on as fill-in brightness of the lens, the method further includes:
respectively counting the variance of the brightness of a picture shot by the lens in the unit time under the condition that the first infrared lamp group is started as the light supplement brightness variance of the lens aiming at each lens in the plurality of lenses;
if the lenses with the supplementary lighting brightness variance larger than a preset second variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of turning off all infrared lamp groups in the multi-view adjustable camera;
if the lens with the supplementary lighting brightness variance larger than the second variance threshold value does not exist in the plurality of lenses, continuing to execute the step of calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens as the brightness change rate of the lens respectively aiming at each lens in the plurality of lenses.
With reference to the first aspect, in a fourth possible implementation manner, after determining, for each of a plurality of lenses of the multi-view adjustable camera, a luminance change rate between a picture taken by the lens when the first infrared lamp group is not turned on and a picture taken by the lens when the first infrared lamp group is turned on, the method further includes:
determining whether a maximum value of the luminance change rates of the plurality of lenses is greater than a sum of a minimum value of the luminance change rates and a second smallest value of the luminance change rates;
if the maximum value is larger than the sum of the minimum value and the second minimum value, initializing the plurality of lenses, and executing a step of determining a brightness change rate between a picture shot by the lens when a first infrared lamp group is not started and a picture shot by the lens when the first infrared lamp group is started respectively for each lens in the plurality of lenses of the multi-view adjustable camera;
and if the maximum value is not larger than the sum of the minimum value and the second minimum value, continuing to execute the step of determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
With reference to any one of the second to fourth possible implementation manners of the first aspect, in a fifth possible implementation manner, the initializing the multiple shots includes:
an infrared light filter for retracting the plurality of lenses;
initializing gains and shutter speeds of the plurality of lenses.
With reference to the first implementation manner of the first aspect, in a sixth possible implementation manner, the determining, for each of the multiple lenses, brightness of a picture obtained by the lens when all the infrared lamp groups are not turned on as brightness of light not supplemented to the lens includes:
respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that all infrared lamp groups are not started for each lens in the plurality of lenses, and taking the average brightness as the brightness of the lens without light supplement;
the determining, for each of the plurality of lenses, a brightness in a picture captured by the lens when the first infrared lamp group is turned on as a fill-in brightness of the lens includes:
and respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that the first infrared lamp group is started for each lens in the plurality of lenses, and taking the average brightness as the fill-in brightness of the lens.
In a second aspect of embodiments of the present invention, there is provided an infrared lamp control apparatus, the apparatus including:
the brightness calculation module is used for respectively determining a brightness change rate between a picture shot by a lens when a first infrared lamp group is not started and a picture shot by the lens when the first infrared lamp group is started aiming at each lens in a plurality of lenses of the multi-view adjustable camera, wherein the first infrared lamp group is one infrared lamp group in the multi-view adjustable camera;
and the binding module is used for determining the lens with the maximum brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
With reference to the second aspect, in a first possible implementation manner, the luminance calculating module is specifically configured to:
turning off all infrared lamp groups in the multi-view adjustable camera;
respectively determining the brightness of a picture shot by each lens under the condition that all the infrared lamp groups are not started as the brightness of the lens without light supplement;
starting a first infrared lamp set;
respectively determining the brightness of a picture shot by each lens under the condition that the first infrared lamp group is started as the light supplement brightness of the lens aiming at each lens in the plurality of lenses;
and respectively calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens for each lens in the plurality of lenses to serve as the brightness change rate of the lens.
With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, the luminance calculating module, after determining, for each of the multiple lenses, the luminance of a picture obtained by the lens when all the infrared lamp groups are not turned on, and taking the luminance of the picture as the luminance of the lens without fill light, is further configured to:
respectively counting the variance of the brightness of a picture shot by the lens in unit time under the condition that all infrared lamp groups are not started as the variance of the brightness of the lens without light supplement for each lens in the plurality of lenses;
if the lenses with the non-supplemented light brightness variance larger than a preset first variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of closing all infrared lamp groups in the multi-view adjustable camera;
and if no lens with the brightness variance of the light not supplemented is larger than the first variance threshold value exists in the plurality of lenses, continuing to execute the step of starting the first infrared lamp group.
With reference to the first possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the luminance calculating module is further configured to, after determining, for each of the multiple lenses, luminance in a picture captured by the lens when the first infrared lamp group is turned on, as fill-in luminance of the lens, further:
counting the variances of the brightness in the pictures shot under the condition that the first infrared lamp group is started in unit time and taking the variances as the variances of the fill-in brightness;
respectively counting the variance of the brightness of a picture shot by the lens in the unit time under the condition that the first infrared lamp group is started as the light supplement brightness variance of the lens aiming at each lens in the plurality of lenses;
if the lenses with the supplementary lighting brightness variance larger than a preset second variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of turning off all infrared lamp groups in the multi-view adjustable camera;
if the lens with the supplementary lighting brightness variance larger than the second variance threshold value does not exist in the plurality of lenses, continuing to execute the step of calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens as the brightness change rate of the lens respectively aiming at each lens in the plurality of lenses.
With reference to the first possible implementation manner of the second aspect, in a fourth possible implementation manner, after the determining, for each of the multiple lenses of the multi-view adjustable camera, a luminance change rate between a picture taken by the lens when the first infrared lamp group is not turned on and a picture taken by the lens when the first infrared lamp group is turned on, the luminance calculation module is further configured to:
determining whether a maximum value of the luminance change rates of the plurality of lenses is greater than a sum of a minimum value of the luminance change rates and a second smallest value of the luminance change rates;
if the maximum value is larger than the sum of the minimum value and the second minimum value, initializing the plurality of lenses, and executing a step of determining a brightness change rate between a picture shot by the lens when a first infrared lamp group is not started and a picture shot by the lens when the first infrared lamp group is started respectively for each lens in the plurality of lenses of the multi-view adjustable camera;
and if the maximum value is not larger than the sum of the minimum value and the second minimum value, continuing to execute the step of determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
With reference to any possible implementation manner of the second to fourth possible implementation manners of the second aspect, in a fifth possible implementation manner, the luminance calculating module is specifically configured to:
an infrared light filter for retracting the plurality of lenses;
initializing gains and shutter speeds of the plurality of lenses.
With reference to the first possible implementation manner of the second aspect, in a sixth possible implementation manner, the luminance calculating module is specifically configured to:
respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that all infrared lamp groups are not started for each lens in the plurality of lenses, and taking the average brightness as the brightness of the lens without light supplement;
and respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that the first infrared lamp group is started for each lens in the plurality of lenses, and taking the average brightness as the fill-in brightness of the lens.
In a third aspect of the embodiments of the present invention, there is provided a multi-view adjustable camera, including:
the system comprises four lenses, four infrared lamp groups, a master processor, a slave processor and an exchange module;
the four lenses are movably arranged on the multi-view adjustable camera; two lenses of the four lenses are electrically connected with the master processor, and the other two lenses except the two lenses are electrically connected with the slave processor;
two infrared lamp groups in the four infrared lamp groups are electrically connected with the master processor, and the other two infrared lamp groups except the two infrared lamp groups are electrically connected with the slave processor;
the exchange module is electrically connected with the master processor and the slave processors and is used for realizing information interaction between the master processor and the slave processors;
the master processor is used for controlling the two lenses and the two infrared lamp sets which are electrically connected with the master processor and sending a control instruction to the slave processor; the slave processor is used for controlling the two lenses and the two infrared lamp groups which are electrically connected with the slave processor according to the control instruction;
the main processor is further used for controlling the multi-view adjustable camera to realize the following steps:
aiming at each lens in the four lenses, determining the brightness of a picture shot by the lens under the condition that the four infrared lamp groups are not started as the brightness of the lens without light supplement;
respectively determining, for each of the four lenses, the brightness of a picture taken by the lens when only a first infrared lamp group is turned on in the four infrared lamp groups as the light supplement brightness of the lens, where the first infrared lamp group is one of the four infrared lamp groups;
respectively calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens aiming at each lens in the Ge lenses to be used as the brightness change rate of the lens;
and determining the lens with the maximum brightness change rate in the four lenses as the lens bound with the first infrared lamp group.
In a fourth aspect of the embodiments of the present invention, there is provided a multi-view adjustable camera, including:
the infrared lamp group comprises a plurality of lenses, a plurality of infrared lamp groups and a control device;
the lenses are movably arranged in the multi-view adjustable camera;
the plurality of infrared lamp groups are used for supplementing light for the plurality of lenses;
the control device comprises at least one processor for controlling the multi-view adjustable camera to implement any of the method steps of the first aspect; determining whether the plurality of infrared lamp groups need to be started or not according to the working modes of the plurality of lenses and the binding relationship between the plurality of lenses and the infrared lamp groups to obtain the determination results of the plurality of infrared lamp groups; and controlling the plurality of infrared lamp groups to be switched on and off according to the determination result.
In a fifth aspect of embodiments of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, which, when being executed by a processor, carries out any of the above-mentioned method steps.
According to the infrared lamp control method and device and the four-eye adjustable camera provided by the embodiment of the invention, after the adjustment of the lenses in the multi-eye adjustable camera is finished, the lens with the best light supplement effect can be automatically selected according to the light supplement effect of the first infrared lamp group on the plurality of lenses to be used as the lens bound by the first infrared lamp group, so that the light supplement effect of the first infrared lamp group is improved on the premise that the position of the first infrared lamp group is fixed. Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of an infrared lamp control method according to an embodiment of the present invention;
fig. 2 is another schematic flow chart of an infrared lamp control method according to an embodiment of the present invention;
fig. 3 is another schematic flow chart of an infrared lamp control method according to an embodiment of the present invention;
fig. 4 is a schematic flow chart of an infrared lamp control method according to an embodiment of the present invention;
fig. 5 is a schematic flow chart of an infrared lamp control method according to an embodiment of the present invention;
fig. 6 is a schematic flow chart of an infrared lamp control method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an infrared lamp control device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a four-eye adjustable camera according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a multi-view adjustable camera according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic flow chart of an infrared lamp control method according to an embodiment of the present invention, which may include:
s101, respectively aiming at each lens in a plurality of lenses of the multi-view adjustable camera, determining a brightness change rate between a picture shot by the lens when the first infrared lamp group is not started and the picture shot when the first infrared lamp group is started, wherein the first infrared lamp group is one infrared lamp group in the multi-view adjustable camera.
The multi-view adjustable camera is provided with a plurality of infrared lamp groups, and each infrared lamp group can comprise one or more infrared lamps. For each lens in the multiple lenses of the multi-view adjustable camera, a picture obtained by shooting when the first infrared lamp group is not started and a picture obtained by shooting when the first infrared lamp group is started can be regarded as a group of comparison pictures, and in order to ensure that the brightness change rate can accurately reflect the light supplement effect of the first infrared lamp group on each lens, other variables except for the variable of whether the first infrared lamp group is started or not do not exist when two pictures are shot.
Further, in this embodiment, the step may be performed after the adjustment for the plurality of lenses in the multi-view adjustable camera is finished, where the adjustment may refer to adjusting the direction of the optical axis of the lens, adjusting the position of the lens, or adjusting the direction of the optical axis of the lens and the position of the lens at the same time. It can be understood that, after the camera lens in the adjustable camera of many meshes was adjusted, first infrared banks probably changed to the light filling effect of the camera lens that originally bound mutually, first infrared banks probably is less than the light filling effect to other camera lenses to the light filling effect of the camera lens that originally bound mutually, need bind the camera lens for first infrared banks this moment again, in order to improve the light filling effect of first infrared banks, for example first infrared banks originally binds mutually with first camera lens, after the position of first camera lens is adjusted, the light filling effect of first infrared banks to first camera lens probably is less than the light filling effect to the second camera lens, at this moment in the light filling effect's of promoting first infrared banks consideration, can bind first infrared banks mutually with the second camera lens.
And S102, determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
Wherein, a camera lens is bound mutually with first infrared banks and is meant, when this camera lens need carry out infrared lamp light filling, opens first infrared banks and carries out infrared lamp light filling for this camera lens, and in this embodiment, a camera lens can bind a plurality of infrared banks simultaneously, and under this condition, when this camera lens need carry out infrared lamp light filling, opens a plurality of infrared banks that bind mutually with this camera lens simultaneously.
If the brightness change rate of one lens is the largest, the light supplement effect of the first infrared lamp group on the lens can be understood to be superior to that of other lenses in the multi-view adjustable camera. The lens is determined to be the lens bound with the first infrared lamp group, so that the light supplement effect of the first infrared lamp group can be maximized.
Referring to fig. 2, fig. 2 is a schematic flow chart of another method for controlling an infrared lamp set according to an embodiment of the present invention, where the method may include:
s201, turning off all infrared lamp groups in the multi-view adjustable camera.
The signal source of the infrared lamp group can be controlled to output low level to each infrared lamp in all the infrared lamp groups, or the signal source of the infrared lamp group is controlled to stop outputting signals to each infrared lamp in all the infrared lamp groups, and at the moment, no current flows in each infrared lamp and the infrared lamp is in a closed state.
And S202, respectively aiming at each lens in the plurality of lenses, determining the brightness of a picture shot by the lens under the condition that all infrared lamp groups are not started, and taking the brightness as the brightness of the lens without light supplement.
The non-fill-in luminance of a lens may be the luminance of an image frame captured by the lens at a certain time, and in an alternative embodiment, the non-fill-in luminance may also be the average luminance of all bayer image frames captured by the lens in a unit time.
For example, assuming that the multi-view adjustable camera is a four-view adjustable camera, wherein there are four lenses, namely, the first lens, the second lens, the third lens and the fourth lens, the average value of the luminances of the 60 bayer image frames may be calculated according to the luminance of each bayer image frame (assuming that there are 60 frames) of the first lens within 1s, so as to obtain the unrefined luminance X of the first lens1Respectively calculating the luminance X of the second lens without supplementary lighting according to the step of calculating X12And the brightness X of the third lens without light supplement3And the brightness X of the fourth lens without light supplement4. It can be understood that the sequence of calculating the four non-light-supplemented luminances may be set according to actual requirements, or the four non-light-supplemented luminances may be obtained by parallel calculation under the condition that the operation capability of the device permits. It can be understood that the brightness of the picture obtained by the lens shooting may have fluctuation, if the brightness in one video frame obtained by the lens shooting is used as the brightness of the non-supplementary lighting, an error may be generated due to the fluctuation, and the average value of the brightness in a plurality of video frames is selected, so that the reason for the fluctuation can be effectively reducedErrors due to brightness fluctuations.
S203, turning on the first infrared lamp group.
Specifically, the signal source may be controlled to output a high level signal with a preset duty ratio to the first infrared lamp set, and at this time, the first infrared lamp set is activated by the high level signal.
And S204, respectively aiming at each lens in the plurality of lenses, determining the brightness of a picture shot by the lens under the condition that the first infrared lamp group is started, and taking the brightness as the fill-in brightness of the lens.
At the moment, only the first infrared lamp group is in an on state and other infrared lamp groups except the first infrared lamp group are in an off state in a plurality of infrared lamp groups of the multi-view adjustable camera. The fill-in luminance of a lens may be the luminance of an image frame captured by the lens at a certain time, and in an alternative embodiment, the fill-in luminance may also be the average luminance of all bayer image frames captured by the lens in a unit time.
For example, still taking the fourth-eye adjustable camera as an example, the average value of the luminances in the 60 bayer image frames may be calculated according to each bayer image frame (assuming a total of 60 frames) of the first lens within 1s, so as to obtain the fill-in luminance Y of the first lens1Respectively calculating the fill-in light brightness Y of the second lens according to the step of calculating Y12And the light supplement brightness Y of the third lens3And the fill-in luminance Y of the fourth lens4. It can be understood that the sequence of calculating the four non-fill-in luminances can be set according to actual requirements, or the four fill-in luminances can be obtained by parallel calculation under the condition that the computing capability of the device permits.
S205, calculating a change rate of the fill-in luminance of the lens relative to the non-fill-in luminance of the lens for each of the plurality of lenses as a luminance change rate of the lens.
The ratio of the supplementary lighting brightness to the non-supplementary lighting brightness of a lens is larger, the change rate of the brightness of the lens is larger, and the ratio of the supplementary lighting brightness to the non-supplementary lighting brightness of a lens is smaller, the change rate of the brightness of the lens is smaller. In an alternative embodiment, the rate of change of brightness of a lens is calculated as follows:
Figure BDA0001670458570000111
wherein Z is the brightness change rate of the lens, Y is the fill-in brightness of the lens, and X is the non-fill-in brightness of the lens. For each lens in the multi-view adjustable camera, the brightness change rate of the lens should be calculated according to the same calculation formula.
And S206, determining the lens with the maximum brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
The step is the same as S102, and reference may be made to the foregoing description about S102, which is not repeated herein.
Under ideal conditions, each lens in the multi-view adjustable camera is bound with one infrared lamp group, and taking the four-view adjustable camera as an example, under ideal conditions, four infrared lamp groups are arranged on the four-view adjustable camera and are respectively bound with four lenses in the four-view adjustable camera, and each infrared lamp group can be utilized to the maximum extent under the conditions. By adopting the embodiment, the brightness of the light not supplemented is determined when all the infrared lamp groups in the multi-view adjustable camera are not started, the brightness of the light supplemented is determined when only the first infrared lamp group is started, and the brightness change rate obtained by calculation based on the two brightness can avoid the interference of the non-first infrared lamp group and accurately reflect the light supplementing effect of the first infrared lamp group on the plurality of lenses when the first infrared lamp group works alone.
In an alternative embodiment, as shown in fig. 3, it may include:
and S301, turning off all infrared lamp groups in the multi-view adjustable camera.
The step is the same as S201, and reference may be made to the foregoing description about S201, which is not described herein again.
And S302, respectively aiming at each lens in the plurality of lenses, determining the brightness of a picture shot by the lens under the condition that all infrared lamp groups are not started, and taking the brightness as the brightness of the lens without light supplement.
The step is the same as S202, and reference may be made to the foregoing description about S202, which is not repeated herein.
And S303, respectively counting the variance of the brightness of the picture shot by the lens in the unit time under the condition that all the infrared lamp groups are not started, and taking the variance as the variance of the brightness of the lens without light supplement.
The variance of the brightness of the 60 bayer image frames may be calculated for each of the plurality of lenses according to the bayer image frames (assumed as 60 frames) captured by the lens within 1s with all the infrared lamp sets turned on.
S304, determining whether the non-fill lighting variance is greater than a preset first variance threshold, if the non-fill lighting variance is greater than the preset first variance threshold, executing S305, and if the non-fill lighting variance is not greater than the first variance threshold, executing 306.
S305 initializes a plurality of shots, and executes S301.
Initialization refers to restoring the multiple shots in the multi-view camera to a default state. In an alternative embodiment, initializing the plurality of lenses may be an infrared filter that retracts the plurality of lenses, and initializing the gain and shutter speed of the plurality of lenses.
The infrared light filter is used for cutting off infrared light, the infrared light filter has no or almost no cutting-off effect on light rays in a visible light wave band, and when the infrared light filter is folded, the infrared light can normally pass through, so that a sensor in an image acquisition unit to which the lens belongs can sense the infrared light. The gain refers to the multiplying factor of the signal amplification of the signal sensed by the sensor. The shutter speed refers to the effective time length of the shutter opening, and the faster the shutter speed is, the shorter the exposure time of each video frame obtained by shooting through the lens is.
It can be understood that, when the infrared light filter of the lens is not retracted, the infrared light filter can cut off infrared light, and the sensor in the image acquisition unit to which the lens belongs cannot normally sense the infrared light, so that the brightness of the image obtained by the lens may be abnormal. The magnitude of the lens gain and the speed of the shutter speed both directly affect the brightness of the picture obtained by the lens shooting, and when the two parameters are set to be too large or too small, the brightness of the picture obtained by the lens shooting can be abnormal.
S306, the first infrared lamp group is started.
The step is the same as S203, and reference may be made to the description of S203, which is not described herein again.
And S307, respectively determining the brightness of a picture shot by the lens under the condition that the first infrared lamp group is started for each lens in the plurality of lenses, and taking the brightness as the fill-in brightness of the lens.
The step is the same as S204, and reference may be made to the description of S204, which is not described herein again.
S308, calculating a change rate of the fill-in luminance of the lens relative to the non-fill-in luminance of the lens for each of the plurality of lenses as a luminance change rate of the lens.
The step is the same as S205, and reference may be made to the description of S205, which is not described herein again.
S309, determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
The step is the same as S102, and reference may be made to the foregoing description about S102, which is not repeated herein.
The variance of the brightness in the picture captured by a lens in a unit time can represent the stability degree of the brightness of the picture captured by the lens in the unit time, and the larger the variance is, the more unstable the brightness in the picture captured by the lens in the unit time is. When the variance of the luminance of the non-supplementary lighting is greater than the preset first variance threshold, the stability of the luminance of the picture obtained by the lens at the moment is considered to be poor, and the luminance of the picture obtained by the lens at the moment may be abnormal, so that the accuracy of the luminance of the non-supplementary lighting obtained at the moment is low. On the contrary, when the variance is not greater than the preset first variance threshold, the brightness of the picture shot by the lens in unit time is considered to be stable, the brightness of the picture shot by the lens is normal, and the accuracy of the brightness of the light not supplemented at this time is high. Therefore, the accuracy of the luminance without supplementary lighting can be improved by adopting the embodiment.
Referring to fig. 4, fig. 4 is a schematic flow chart of a method for determining a luminance change rate according to an embodiment of the present invention, where the method may include:
s401, all infrared lamp groups in the multi-view adjustable camera are turned off.
The step is the same as S201, and reference may be made to the description of S201, which is not described herein again.
S402, respectively aiming at each lens in the plurality of lenses, determining the brightness of a picture shot by the lens under the condition that all infrared lamp groups are not started, and taking the brightness as the brightness of the lens without light supplement.
The step is the same as S202, and reference may be made to the foregoing description about S202, which is not repeated herein.
And S403, turning on the first infrared lamp group.
The step is the same as S203, and reference may be made to the foregoing description about S203, which is not described herein again.
And S404, respectively aiming at each lens in the plurality of lenses, determining the brightness of a picture shot by the lens under the condition that the first infrared lamp group is started, and taking the brightness as the fill-in brightness of the lens.
The step is the same as S204, and reference may be made to the description of S204, which is not described herein again.
S405, respectively aiming at each lens in the plurality of lenses, counting the variance of the brightness of a picture shot by the lens in a unit time under the condition that the first infrared lamp group is started, and taking the variance as the fill-in brightness variance of the lens.
S406, determining whether the fill-in luminance variance is greater than a preset second variance threshold, if the fill-in luminance variance is greater than the preset second variance threshold, executing S407, and if the fill-in luminance variance is not greater than the preset second variance threshold, executing S408.
The preset second variance threshold may be set according to actual requirements, and may be equal to the first variance threshold, or may not be equal to the first variance threshold.
S407, a plurality of shots is initialized, and S401 is executed.
For details, reference may be made to the description of initializing multiple shots in S307, which is not described herein again.
S408, calculating a change rate of the fill-in luminance of the lens relative to the non-fill-in luminance of the lens for each of the plurality of lenses as a luminance change rate of the lens.
The step is the same as S308, and reference may be made to the description of S308, which is not described herein again.
And S409, determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
The step is the same as S102, and reference may be made to the foregoing description about S102, which is not repeated herein.
When the fill-in luminance variance is greater than the preset second variance threshold, the accuracy of the fill-in luminance obtained in S404 and the accuracy of the non-fill-in luminance obtained in S402 may be considered to be low, and when the fill-in luminance variance is not greater than the preset second variance threshold, the accuracy of the fill-in luminance obtained in S404 and the accuracy of the non-fill-in luminance obtained in S402 may be considered to be high. Therefore, the embodiment can improve the accuracy of the fill-in luminance and the fill-in luminance.
Referring to fig. 5, fig. 5 is another schematic flow chart of the brightness change rate determining method provided in this embodiment, which may include:
s501, respectively aiming at each lens in a plurality of lenses of the multi-view adjustable camera, determining a brightness change rate between a picture shot by the lens when the first infrared lamp group is not started and a picture shot by the lens when the first infrared lamp group is started.
The step is the same as S101, and reference may be made to the description of S101, which is not described herein again.
S502, determining whether a maximum value of the luminance change rates of the plurality of shots is greater than a sum of a minimum value of the luminance change rates and a next smallest value of the luminance change rates, if the maximum value is greater than the sum of the minimum value and the next smallest value, performing S503, and if the maximum value is not greater than the sum of the minimum value and the next smallest value, performing S504.
In this embodiment, the multi-view adjustable camera at least includes three lenses, and taking the multi-view adjustable camera as a four-view adjustable camera as an example, it is assumed that in S505, the calculated brightness change rate of the first lens is Z1The rate of change of the brightness of the second lens is Z2The rate of change of the brightness of the third lens is Z3The fourth lens has a brightness change rate of Z4And the four brightness change rates are Z in descending order1＞Z2＞Z3＞Z4As can be seen, the maximum value of the luminance change rate at this time is Z1The minimum value of the luminance change rate is Z4The second smallest value in the luminance change rate is Z3Determining Z1Whether or not it is greater than Z3And Z4And (4) summing.
S503 initializes the plurality of shots, and returns to the execution of S501.
Specifically, refer to the description of initializing multiple shots in S305, which is not described herein again.
S504, the lens with the largest brightness change rate in the plurality of lenses is determined as the lens bound with the first infrared lamp group.
The step is the same as S102, and reference may be made to the foregoing description about S102, which is not repeated herein.
It can be understood that, in the multi-view adjustable camera, the distance between the plurality of lenses is limited, and the difference of the light supplement effect of the first infrared lamp group to the plurality of lenses is not large. When the maximum value of the brightness change rate is greater than the sum of the minimum value of the brightness change rate and the second minimum value of the brightness change rate, it may be considered that the light supplement effect of the first infrared lamp set on each lens determined this time is abnormal, for example, a lens with too high gain exists among a plurality of lenses. Therefore, the obtained luminance change rates of the plurality of lenses are not accurate enough. If the lens bound with the first infrared lamp group is determined according to the obtained brightness change rates of the plurality of lenses, the light supplement effect of the first infrared lamp group may not be maximized. And the embodiment is selected, so that the occurrence probability of the problem can be effectively reduced.
In a preferred embodiment, as shown in fig. 6, it may include:
s601, retracting the infrared light filters of the plurality of lenses, and initializing the gains and the shutter speeds of the plurality of lenses.
Specifically, refer to the description of initializing multiple shots in S307, which is not described herein again. According to different monitored scenes, the multiple lenses in the multi-view adjustable camera may have part of infrared filters already retracted and part of infrared filters not yet retracted before the step, and the gains and shutter speeds of the lenses may also be different. The light supplement effect of the first infrared lamp set on the plurality of lenses may not be accurately determined in the subsequent step, so in this step, the infrared light filters of the plurality of lenses are uniformly folded, and the gain and the shutter speed of the plurality of lenses are initialized.
And S602, turning off all infrared lamp groups in the multi-view adjustable camera.
The step is the same as S201, and reference may be made to the description of S201, which is not described herein again.
And S603, respectively determining the brightness of a picture shot by each lens under the condition that all the infrared lamp groups are not started as the brightness of the lens without light supplement.
Specifically, see the description of determining the average brightness in S202, which is not described herein again.
S604, respectively aiming at each lens in the plurality of lenses, counting the variance of the brightness of the images shot by the lens in the unit time under the condition that all the infrared lamp groups are not started, and taking the variance as the variance of the brightness of the lens without supplementary lighting.
Where the unit time represents an equal length of time as the unit time in S603, for example, the unit time in S603 and the unit time in S604 may each represent 1 second. In this embodiment, the variance of the non-fill luminance of a plurality of shots is counted based on the video frame used when the non-fill luminance is determined in S603. For example, assuming that in S603, when determining the non-fill-in luminance of the first lens in the multi-view adjustable camera, the first lens is used, and 60 video frames obtained by shooting in 1S under the condition that all infrared lamp sets are not turned on, in this step, when counting the non-fill-in luminance variance of the first lens, the 60 video frames are also based on. It can be understood that when the luminance variance of the 60 video frames is counted, the average luminance of the 60 video frames needs to be obtained, and since the average luminance of the 60 video frames is already determined in S603, the average luminance of the 60 video frames does not need to be calculated in this step, so that a certain amount of calculation can be omitted.
And S605, determining whether the luminance variance of the non-supplementary lighting is greater than a preset first variance threshold, if the luminance variance of the non-supplementary lighting is greater than the preset first variance threshold, returning to the step S601, and if the luminance variance of the non-supplementary lighting is not greater than the preset first variance threshold, executing the step S606.
The step is the same as S304, and reference may be made to the description of S304, which is not described herein again.
S606, the first infrared lamp group is turned on.
The step is the same as S203, and reference may be made to the description of S203, which is not described herein again.
And S607, respectively determining the brightness of the picture shot by the lens under the condition that the first infrared lamp group is started for each lens in the plurality of lenses, and taking the brightness as the fill-in brightness of the lens.
The step is the same as S204, and reference may be made to the description of S204, which is not described herein again.
And S608, respectively counting the variance of the brightness of the picture shot by the lens in the unit time under the condition that the first infrared lamp group is turned on as the fill-in brightness variance of the lens for each lens.
And S609, determining whether the fill-in luminance variance is larger than a preset second variance threshold, if the fill-in luminance variance is not larger than the preset second variance threshold, returning to the step S601, and if the fill-in luminance variance is not larger than the preset second variance threshold, executing the step S610.
The step is the same as S406, and reference may be made to the description of S406, which is not described herein again.
S610, calculating a change rate of the fill-in luminance of the lens relative to the non-fill-in luminance of the lens for each of the plurality of lenses as a luminance change rate of the lens.
The step is the same as S308, and reference may be made to the foregoing description about S308, which is not described herein again.
And S611, determining whether the maximum value of the brightness change rates of the plurality of lenses is greater than the sum of the minimum value of the brightness change rates and the second smallest value of the brightness change rates, if the maximum value is greater than the sum of the minimum value and the second smallest value, returning to execute S601, and if the maximum value is not greater than the sum of the minimum value and the second smallest value, executing S612.
And S612, determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
The step is the same as S102, and reference may be made to the foregoing description about S102, which is not repeated herein.
By the aid of the method and the device, when the brightness of the picture obtained by shooting through the lens is determined to be abnormal, the light supplement effect of the first infrared lamp set on the plurality of lenses can be determined again, and accuracy of the determined light supplement effect of the first infrared lamp set on the plurality of lenses is improved.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an infrared lamp control device according to an embodiment of the present invention, which may include:
the brightness calculation module 701 is configured to determine, for each of multiple lenses of the multi-view adjustable camera, a brightness change rate between a picture captured by the lens when the first infrared lamp group is not turned on and a picture captured by the lens when the first infrared lamp group is turned on, where the first infrared lamp group is one infrared lamp group of the multi-view adjustable camera;
the binding module 702 is configured to determine a lens with a largest brightness change rate among the plurality of lenses as a lens bound with the first infrared lamp group.
Further, the luminance calculating module 701 is specifically configured to:
turning off all infrared lamp sets in the multi-view adjustable camera;
respectively determining the brightness of a picture shot by each lens under the condition that all infrared lamp groups are not started as the brightness of the lens without light supplement;
starting a first infrared lamp set;
respectively determining the brightness of a picture shot by each lens under the condition that the first infrared lamp group is started as the light supplement brightness of the lens aiming at each lens in the plurality of lenses;
and respectively calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens for each lens in the plurality of lenses to serve as the brightness change rate of the lens.
Further, the brightness calculating module 701, after determining, for each of the plurality of lenses, that the brightness of the picture obtained by the lens is taken as the brightness of the lens without light supplement when all the infrared lamp groups are not turned on, is further configured to:
respectively counting the variance of the brightness of a picture shot by the lens in unit time under the condition that all infrared lamp groups are not started for each lens in the plurality of lenses, and taking the variance as the variance of the brightness of the lens without light supplement;
if the lenses with the non-supplemented light brightness variance larger than a preset first variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of turning off all infrared lamp groups in the multi-view adjustable camera;
and if no lens with the brightness variance of the light not supplemented is larger than the first variance threshold value exists in the plurality of lenses, continuing to execute the step of starting the first infrared lamp group.
Further, the brightness calculating module 701 is further configured to, after determining, for each of the multiple lenses, that the brightness in the picture captured by the lens is obtained when the first infrared lamp group is turned on, and the brightness is used as the fill-in brightness of the lens, further:
counting variances of the brightness in the pictures shot under the condition that the first infrared lamp group is started in unit time and taking the variances as light supplement brightness variances;
respectively counting the variance of the brightness of a picture shot by the lens in the unit time under the condition that the first infrared lamp group is started as the light supplement brightness variance of the lens aiming at each lens in the plurality of lenses;
if the lenses with the supplementary lighting brightness variance larger than a preset second variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of turning off all infrared lamp groups in the multi-view adjustable camera;
and if the lens with the supplementary lighting brightness variance larger than the second variance threshold value does not exist in the plurality of lenses, continuing to execute the step of calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens as the brightness change rate of the lens respectively aiming at each lens in the plurality of lenses.
Further, the brightness calculating module 701, after determining, for each of the plurality of lenses of the multi-view adjustable camera, a brightness change rate between a picture taken by the lens when the first infrared lamp set is not turned on and a picture taken by the lens when the first infrared lamp set is turned on, is further configured to:
determining whether a maximum value of the luminance change rates of the plurality of lenses is greater than a sum of a minimum value of the luminance change rates and a second smallest value of the luminance change rates;
if the maximum value is larger than the sum of the minimum value and the second minimum value, initializing a plurality of lenses, and executing a step of determining a brightness change rate between a picture shot by the lens when the first infrared lamp group is not started and a picture shot when the first infrared lamp group is started aiming at each lens in the plurality of lenses of the multi-view adjustable camera;
and if the maximum value is not larger than the sum of the minimum value and the second minimum value, continuing to execute the step of determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
Further, the luminance calculating module 701 is specifically configured to:
an infrared light filter for retracting the plurality of lenses;
gains and shutter speeds for a plurality of lenses are initialized.
Further, the luminance calculating module 701 is specifically configured to:
respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that all infrared lamp groups are not started for each lens in the plurality of lenses, and taking the average brightness as the brightness of the lens without supplementary lighting;
and respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that the first infrared lamp group is started for each lens in the plurality of lenses, and taking the average brightness as the fill-in brightness of the lens.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a four-eye adjustable camera according to an embodiment of the present invention, which may include:
four lenses 810, four infrared lamp sets 820, a master processor 830, a slave processor 840 and a switching module 850;
the four lenses 810 are movably mounted to the monocular adjustable camera, and for example, the lenses 810 may be mounted to the monocular adjustable camera in one of three ways:
mode one, four mesh adjustable cameras can include the fixed disk to and four lens holders, be provided with the tooth's socket on the fixed disk, all be provided with the meshing tooth on four lens holders, also can be provided with the meshing tooth on the fixed disk, all be provided with the tooth's socket on four lens holders, fixed disk and four lens holders pass through the meshing of meshing tooth and tooth's socket and link to each other, and four camera lenses 810 are installed respectively on four lens holders.
In a second mode, the four-eye adjustable camera may include a top plate and a track shoe fastened to the top plate by a plurality of fasteners, the four lens holders may be movably disposed on the track shoe, each lens holder is mounted with a lens 810, and the four lens holders may move on the track shoe and may rotate on a plane where the track shoe is located. Reference is made to US20170299949a 1.
In a third mode, the four-eye adjustable camera is provided with a mounting rail, the four lenses 810 are respectively mounted on four lens holders, the four lens holders are arranged on the mounting rail, each of the four lens holders comprises a locking device, the lens holders are fixed on the mounting rail when the locking devices are in a locking state, and the lens holders can move on the mounting rail when the locking devices are in a releasing state. One of the locking device and the mounting rail comprises a magnet and the other comprises a ferromagnetic material, and illustratively, the locking device comprises a ferromagnetic material and the mounting rail comprises a magnet, and the lens holder can be fixed on the mounting rail by means of an attractive force between the magnet and the ferromagnetic material, as described in US20170031234a 1.
Two lenses 810 of the four lenses 810 are electrically connected to the main processor 830, and the other two lenses 810 except the two lenses 810 are electrically connected to the slave processor 840. Two of the four infrared lamp groups 820 are electrically connected to the main processor 830, and the other two infrared lamp groups 820 except the two infrared lamp groups 820 are electrically connected to the slave processor 840. In this embodiment, the master processor 830 and the slave processor 840 may respectively have two PWM (Pulse Width Modulation) interfaces, the master processor 830 and the slave processor 840 are electrically connected to the two ir lamp sets 820 through the two PWM interfaces, respectively, the PWM interface may send a PWM signal with a specific duty ratio to the ir lamp set 820 connected to the PWM interface, when the duty ratio of the PWM signal is 0, that is, when the whole signal is at a low level, the ir lamp set 820 connected to the PWM interface is in a closed state, when the duty ratio of the PWM signal is not 0, the ir lamp set 820 connected to the PWM interface is in an open state, and the brightness depends on the duty ratio of the PWM signal, and when the duty ratio of the PWM signal reaches 1, that is, when the whole signal is at a high level, the ir lamp set 820 connected to the PWM interface reaches the maximum brightness.
And the switching module 850 is electrically connected with the master processor 830 and the slave processors 840 and is used for realizing information interaction between the master processor and the slave processors, wherein the switching module 850 may be a network switching chip or a bus.
The main processor 830 is used for controlling the two lenses 810 and the two infrared lamp sets 820 electrically connected with the main processor 830 and sending a control instruction to the slave processor 840; and the slave processor 840 is used for controlling the two lenses 810 and the two infrared lamp groups 820 electrically connected with the slave processor 840 according to a control instruction, the control instruction is sent to the slave processor 840 by the master processor 830 through the switching module, and the master processor 830 can indirectly control the two lenses 810 and the two infrared lamp groups 820 electrically connected with the slave processor 840 through the control instruction.
The main processor 830 is further configured to control the multi-view adjustable camera, and implement the following steps:
the minute hand determines, for each lens 810, the brightness of a picture captured by the lens 810 when none of the four infrared lamp sets 820 is turned on, as the brightness of the lens 810 without light supplement, where the brightness of the lens 810 without light supplement may be the brightness of an image frame captured by the lens 810 at a certain time, and in an alternative embodiment, may also be the average brightness of all bayer image frames captured by the lens 810 in a unit time.
Respectively aiming at each lens 810, determining that only one infrared lamp group 820 in four infrared lamp groups 820 is turned on, recording the infrared lamp group 820 as a first infrared lamp group, and using the brightness of a picture obtained by shooting by the lens 810 as the fill-in brightness of the lens 810, wherein the fill-in brightness of the lens 810 may be the brightness of an image frame obtained by shooting by the lens 810 at a certain moment, and in an optional embodiment, may also be the average brightness of all bayer image frames obtained by shooting by the lens 810 within a unit time.
Respectively calculating the change rate of the supplementary lighting brightness of each lens 810 relative to the non-supplementary lighting brightness of the lens as the brightness change rate of the lens 810 for each lens 810;
and determining the lens with the highest brightness change rate in the four lenses 810 as the lens bound with the first infrared lamp group.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a multi-view adjustable camera according to an embodiment of the present invention, which may include:
a plurality of lenses 910, a plurality of infrared lamp sets 920, and a control device 930;
the lens 910 is movably installed in the multi-view adjustable camera, and the manner of installing the lens 910 in the multi-view adjustable camera can be seen in any one of the three manners in the aforementioned four-view adjustable camera embodiment, which only differs in the number of the lens holders.
A plurality of infrared lamp groups 920 for supplementing infrared lamps to the plurality of lenses 910;
a control device 930 comprising at least one processor for controlling the multi-view adjustable camera to implement any of the above infrared lamp control methods; determining whether the plurality of infrared lamp groups 920 need to be started or not according to the working modes of the plurality of lenses 910 and the binding relationship between the plurality of lenses 910 and the infrared lamp groups 920, so as to obtain the determination results of the plurality of infrared lamp groups 920; and controlling the plurality of infrared lamp groups to be switched on and off according to the determination result.
Only one processor may be included in control 930 and electrically coupled to each lens 910 in the multi-view adjustable camera and to each infrared light bank 920 in the multi-view adjustable camera. The control device 930 may also include a plurality of processors, each processor electrically connected to a portion of the lens 910 of the multipurpose adjustable camera and to a portion of the infrared light sets 920, each lens 910 electrically connected to and only connected to one processor, and each infrared light set 920 electrically connected to and only connected to one processor. The number of processors included in the control device 930 may depend on the number of interfaces of each processor, and the number of lenses 910 and infrared lamp sets 920 included in the multi-view adjustable camera.
In a further embodiment provided by the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the infrared lamp control method of any of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus, the four-view adjustable camera, the multi-view adjustable camera, and the computer program product embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and the relevant points can be referred to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (11)

1. An infrared lamp control method is applied to a multi-view adjustable camera, and is characterized by comprising the following steps:
respectively determining, for each of a plurality of lenses of the multi-view adjustable camera, a brightness change rate between a picture taken by the lens when a first infrared lamp group is not turned on and a picture taken by the lens when the first infrared lamp group is turned on, the first infrared lamp group being one of the infrared lamp groups of the multi-view adjustable camera;
and determining the lens with the maximum brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
2. The method of claim 1, wherein determining, for each of a plurality of shots of the multi-view adjustable camera, a rate of change in brightness between a picture taken by the shot when the first set of infrared lights is not on and a picture taken when the first set of infrared lights is on, comprises:
turning off all infrared lamp groups in the multi-view adjustable camera;
respectively determining the brightness of a picture shot by each lens under the condition that all the infrared lamp groups are not started as the brightness of the lens without light supplement;
starting a first infrared lamp set;
respectively determining the brightness of a picture shot by each lens under the condition that the first infrared lamp group is started as the light supplement brightness of the lens aiming at each lens in the plurality of lenses;
and respectively calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens for each lens in the plurality of lenses to serve as the brightness change rate of the lens.
3. The method according to claim 2, wherein after determining, for each of the plurality of lenses, brightness of a picture captured by the lens when all the infrared lamp sets are not turned on as the non-fill-in brightness of the lens, the method further comprises:
respectively counting the variance of the brightness of a picture shot by the lens in unit time under the condition that all infrared lamp groups are not started as the variance of the brightness of the lens without light supplement for each lens in the plurality of lenses;
if the lenses with the non-supplemented light brightness variance larger than a preset first variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of closing all infrared lamp groups in the multi-view adjustable camera;
and if no lens with the brightness variance of the light not supplemented is larger than the first variance threshold value exists in the plurality of lenses, continuing to execute the step of starting the first infrared lamp group.
4. The method according to claim 2, wherein after determining, for each of the plurality of lenses, brightness in a picture taken by the lens when the first infrared lamp group is turned on as fill-in brightness of the lens, the method further comprises:
respectively counting the variance of the brightness of a picture shot by the lens in the unit time under the condition that the first infrared lamp group is started as the light supplement brightness variance of the lens aiming at each lens in the plurality of lenses;
if the lenses with the supplementary lighting brightness variance larger than a preset second variance threshold exist in the plurality of lenses, initializing the plurality of lenses, and executing the step of turning off all infrared lamp groups in the multi-view adjustable camera;
if the lens with the supplementary lighting brightness variance larger than the second variance threshold value does not exist in the plurality of lenses, continuing to execute the step of calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens as the brightness change rate of the lens respectively aiming at each lens in the plurality of lenses.
5. The method of claim 1, wherein after determining, for each of the plurality of shots of the multi-view adjustable camera, a rate of change in brightness between a picture taken by the shot when the first set of infrared lights is not on and a picture taken when the first set of infrared lights is on, the method further comprises:
determining whether a maximum value of the luminance change rates of the plurality of lenses is greater than a sum of a minimum value of the luminance change rates and a second smallest value of the luminance change rates;
if the maximum value is larger than the sum of the minimum value and the second minimum value, initializing the plurality of lenses, and executing a step of determining a brightness change rate between a picture shot by the lens when a first infrared lamp group is not started and a picture shot by the lens when the first infrared lamp group is started respectively for each lens in the plurality of lenses of the multi-view adjustable camera;
and if the maximum value is not larger than the sum of the minimum value and the second minimum value, continuing to execute the step of determining the lens with the largest brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
6. The method according to any of claims 3-5, wherein said initializing said plurality of shots comprises:
an infrared light filter for retracting the plurality of lenses;
initializing gains and shutter speeds of the plurality of lenses.
7. The method according to claim 2, wherein the determining, for each of the plurality of lenses, brightness of a picture captured by the lens when all the infrared lamp sets are not turned on as non-fill-in brightness of the lens comprises:
respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that all infrared lamp groups are not started for each lens in the plurality of lenses, and taking the average brightness as the brightness of the lens without light supplement;
the determining, for each of the plurality of lenses, a brightness in a picture captured by the lens when the first infrared lamp group is turned on as a fill-in brightness of the lens includes:
and respectively determining the average brightness of all bayer image frames shot by the lens in unit time under the condition that the first infrared lamp group is started for each lens in the plurality of lenses, and taking the average brightness as the fill-in brightness of the lens.
8. An infrared lamp control device is applied to a multi-view adjustable camera, and is characterized by comprising:
the brightness calculation module is used for respectively determining a brightness change rate between a picture shot by a lens when a first infrared lamp group is not started and a picture shot by the lens when the first infrared lamp group is started aiming at each lens in a plurality of lenses of the multi-view adjustable camera, wherein the first infrared lamp group is one infrared lamp group in the multi-view adjustable camera;
and the binding module is used for determining the lens with the maximum brightness change rate in the plurality of lenses as the lens bound with the first infrared lamp group.
9. A quad adjustable camera, the quad adjustable camera comprising:
the system comprises four lenses, four infrared lamp groups, a master processor, a slave processor and an exchange module;
the four lenses are movably arranged on the four-eye adjustable camera; two lenses of the four lenses are electrically connected with the master processor, and the other two lenses except the two lenses are electrically connected with the slave processor;
two infrared lamp groups in the four infrared lamp groups are electrically connected with the master processor, and the other two lenses except the two infrared lamp groups are electrically connected with the slave processor;
the exchange module is electrically connected with the master processor and the slave processors and is used for realizing information interaction between the master processor and the slave processors;
the master processor is used for controlling the two lenses and the two infrared lamp sets which are electrically connected with the master processor and sending a control instruction to the slave processor; the slave processor is used for controlling the two lenses and the two infrared lamp groups which are electrically connected with the slave processor according to the control instruction;
the main processor is further used for controlling the four-eye adjustable camera to realize the following steps:
aiming at each lens in the four lenses, determining the brightness of a picture shot by the lens under the condition that the four infrared lamp groups are not started as the brightness of the lens without light supplement;
respectively determining, for each of the four lenses, the brightness of a picture taken by the lens when only a first infrared lamp group is turned on in the four infrared lamp groups as the light supplement brightness of the lens, where the first infrared lamp group is one of the four infrared lamp groups;
respectively calculating the change rate of the supplementary lighting brightness of the lens relative to the non-supplementary lighting brightness of the lens aiming at each lens in the four lenses to serve as the brightness change rate of the lens;
and determining the lens with the maximum brightness change rate in the four lenses as the lens bound with the first infrared lamp group.
10. A multi-view adjustable camera, comprising:
the infrared lamp group comprises a plurality of lenses, a plurality of infrared lamp groups and a control device;
the lenses are movably arranged in the multi-view adjustable camera;
the plurality of infrared lamp groups are used for supplementing light for the plurality of lenses;
the control device comprises at least one processor for controlling the multi-view adjustable camera to realize the method steps of any one of claims 1 to 7; determining whether the plurality of infrared lamp groups need to be started or not according to the working modes of the plurality of lenses and the binding relationship between the plurality of lenses and the infrared lamp groups to obtain the determination results of the plurality of infrared lamp groups; and controlling the plurality of infrared lamp groups to be switched on and off according to the determination result.
11. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 7.
CN201810501412.1A 2017-12-27 2018-05-23 Infrared lamp control method and device and four-eye adjustable camera Active CN110536070B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201810501412.1A CN110536070B (en) 2018-05-23 2018-05-23 Infrared lamp control method and device and four-eye adjustable camera
US16/767,447 US10992875B2 (en) 2017-12-27 2018-12-26 Method and apparatus for controlling infrared lamp, and four-lens adjustable camera
PCT/CN2018/123954 WO2019129083A1 (en) 2017-12-27 2018-12-26 Infrared light control method and device and four-eye adjustable camera
EP18895808.6A EP3734956B1 (en) 2017-12-27 2018-12-26 Infrared light control method and device and four-eye adjustable camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810501412.1A CN110536070B (en) 2018-05-23 2018-05-23 Infrared lamp control method and device and four-eye adjustable camera

Publications (2)

Publication Number Publication Date
CN110536070A CN110536070A (en) 2019-12-03
CN110536070B true CN110536070B (en) 2020-12-25

Family

ID=68657602

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810501412.1A Active CN110536070B (en) 2017-12-27 2018-05-23 Infrared lamp control method and device and four-eye adjustable camera

Country Status (1)

Country Link
CN (1) CN110536070B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111654609B (en) * 2020-06-12 2021-10-26 杭州海康威视数字技术股份有限公司 Control method for realizing low power consumption of camera and camera
CN111935415B (en) * 2020-08-18 2022-02-08 浙江大华技术股份有限公司 Brightness adjusting method and device, storage medium and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010044185A1 (en) * 2008-10-14 2010-04-22 パナソニック株式会社 Imaging element and imaging device
CN101846528A (en) * 2010-04-13 2010-09-29 中国科学院长春光学精密机械与物理研究所 Detection method for capture capability of photoelectric tracking equipment to target with low contrast
CN101872106A (en) * 2010-05-21 2010-10-27 深圳市艾威视数码科技有限公司 Intelligent infrared camera and intelligent infrared light intensity adjustment method thereof
CN101923402A (en) * 2009-06-11 2010-12-22 鼎亿数码科技(上海)有限公司 Positioning method based on infrared light spots
CN103118232A (en) * 2013-02-20 2013-05-22 浙江宇视科技有限公司 Device and method for controlling supplementary lighting
CN106331519A (en) * 2016-10-31 2017-01-11 维沃移动通信有限公司 Method for adjusting light-compensating lamp and mobile terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5702751B2 (en) * 2012-05-18 2015-04-15 株式会社ユニバーサルエンターテインメント Game equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010044185A1 (en) * 2008-10-14 2010-04-22 パナソニック株式会社 Imaging element and imaging device
CN101923402A (en) * 2009-06-11 2010-12-22 鼎亿数码科技(上海)有限公司 Positioning method based on infrared light spots
CN101846528A (en) * 2010-04-13 2010-09-29 中国科学院长春光学精密机械与物理研究所 Detection method for capture capability of photoelectric tracking equipment to target with low contrast
CN101872106A (en) * 2010-05-21 2010-10-27 深圳市艾威视数码科技有限公司 Intelligent infrared camera and intelligent infrared light intensity adjustment method thereof
CN103118232A (en) * 2013-02-20 2013-05-22 浙江宇视科技有限公司 Device and method for controlling supplementary lighting
CN106331519A (en) * 2016-10-31 2017-01-11 维沃移动通信有限公司 Method for adjusting light-compensating lamp and mobile terminal

Also Published As

Publication number Publication date
CN110536070A (en) 2019-12-03

Similar Documents

Publication Publication Date Title
US11363179B2 (en) System, method, and computer program for capturing a flash image based on ambient and flash metering
US7729607B2 (en) Camera glare reduction system and method
CN101540843B (en) Imaging device and signal processing method
CN110536070B (en) Infrared lamp control method and device and four-eye adjustable camera
CN103780840A (en) High-quality imaging double camera shooting and imaging device and method thereof
EP3241155B1 (en) Exposure computation via depth-based computational photography
CN108111731A (en) A kind of camera module
CN107846556A (en) imaging method, device, mobile terminal and storage medium
CN105657243A (en) Anti-jitter delay photographing method and device
CN104092955A (en) Flash control method and device, as well as image acquisition method and equipment
US20180213141A1 (en) Methods and apparatus for synchronizing camera flash and sensor blanking
CN104092956A (en) Flash control method, flash control device and image acquisition equipment
CN111050078A (en) Photographing method, mobile terminal and computer storage medium
CN112672027A (en) Camera module and electronic equipment
CN103890654A (en) Zooming viewfinder device and brightness changing method for display information
CN102893616B (en) Three-dimensional imaging device
CN104092954A (en) Flash control method and control device and image collection method and collection device
CN105430290A (en) Water ripple pre-elimination method and photographing device
EP3754970A1 (en) Electric apparatus, control method, and program
CN104601901A (en) Terminal picture taking control method and terminal
US9237275B2 (en) Flash photography
WO2022253299A1 (en) Image generation method, apparatus and device based on lcd apparatus, and storage medium
CN108886592A (en) Imaging sensor, chip, image processing equipment and correlation technique
CN105467741A (en) Panoramic shooting method and terminal
EP3734956B1 (en) Infrared light control method and device and four-eye adjustable camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant