CN112702489B

CN112702489B - Camera module, control method and device thereof, vehicle and storage medium

Info

Publication number: CN112702489B
Application number: CN202011553948.1A
Authority: CN
Inventors: 孙牵宇; 苏水静; 许亮
Original assignee: Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Current assignee: Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Priority date: 2020-12-24
Filing date: 2020-12-24
Publication date: 2022-12-23
Anticipated expiration: 2040-12-24
Also published as: CN112702489A; WO2022134630A1

Abstract

The embodiment of the disclosure provides a camera module, a control method and a control device thereof, a vehicle and a storage medium, wherein the camera module can comprise: the number of the light supplement lamps is less than a set value; and the processor is used for adjusting the shooting parameters of the camera module according to the image brightness of the imaging image collected by the camera module under the condition that the light supplement lamp is turned on. This disclosed embodiment makes the quantity that sets up the light filling lamp that can be more nimble in the module of making a video recording.

Description

Camera module, control method and device thereof, vehicle and storage medium

Technical Field

The disclosure relates to an intelligent vehicle cabin technology, in particular to a camera module, a control method and device thereof, a vehicle and a medium.

Background

The current intelligent cockpit has a camera module for realizing a Driver Monitoring System (DMS), wherein a camera of the DMS needs sufficient illumination when acquiring an image, so that the acquired image meets a requirement of image detection, for example, the brightness of the image can meet a brightness requirement identified by a Driver fatigue detection algorithm.

Disclosure of Invention

In view of this, the embodiments of the present disclosure provide at least a camera module, a control method and apparatus thereof, a vehicle, and a medium.

In a first aspect, a camera module is provided, which includes:

the number of the light supplement lamps is less than a set value;

and the processor is used for adjusting the shooting parameters of the camera module according to the image brightness of the imaging image collected by the camera module under the condition that the light supplement lamp is turned on.

In a second aspect, a vehicle is provided, which includes the camera module according to any embodiment of the disclosure.

In a third aspect, a method for controlling a camera module is provided, where the camera module includes light supplement lamps and a processor, and the number of the light supplement lamps is less than a set value; the control method comprises the following steps: detecting the image brightness of an imaging image acquired by the camera module; and under the condition that the light supplement lamp is turned on, adjusting shooting parameters of the camera module according to the image brightness of the imaging image collected by the camera module.

The fourth aspect provides a control device for a camera module, wherein the camera module comprises light supplementing lamps and a processor, and the number of the light supplementing lamps is smaller than a set value; the device comprises: the image detection module is used for detecting the image brightness of an imaging image acquired by the camera module; and the parameter adjusting module is used for adjusting shooting parameters of the camera module according to the image brightness of the imaging image acquired by the camera module under the condition that the light supplementing lamp is turned on.

In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and the program, when executed by a processor, implements a control method for an image pickup module according to any one of the embodiments of the present disclosure.

The camera module and the control method and device, the vehicle and the medium thereof provided by the embodiment of the disclosure adjust the shooting parameters of the camera module according to the image brightness of an imaging image under the condition that the light supplement lamp is turned on through the processor in the camera module, so that the number of the light supplement lamp can be set more flexibly in the camera module. For example, a small number of light supplement lamps can be arranged, and even if the illumination of the light source is insufficient due to the reduction of the number of the light supplement lamps, the influence of the brightness reduction of the light source on the brightness of the image can be corrected by adjusting the shooting parameters of the camera module; and the flexible activation that light filling lamp quantity set up also helps setting up the volume of the module of making a video recording in a flexible way according to the actual product demand, avoids great integrated degree of difficulty and cost.

Drawings

In order to more clearly illustrate one or more embodiments of the present disclosure or technical solutions in related arts, the drawings used in the description of the embodiments or related arts will be briefly described below, it is obvious that the drawings in the description below are only some embodiments described in one or more embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without inventive exercise.

Fig. 1 illustrates a schematic structural diagram of a camera module according to at least one embodiment of the present disclosure;

fig. 2 illustrates a flow of a control method of a camera module according to at least one embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a camera module according to at least one embodiment of the present disclosure;

FIG. 4 illustrates an exposure control flow provided by at least one embodiment of the present disclosure;

fig. 5 is a schematic flow chart illustrating parameter adjustment according to at least one embodiment of the present disclosure;

FIG. 6 illustrates a QE curve diagram of a sensor provided by at least one embodiment of the present disclosure;

fig. 7 illustrates a schematic structural diagram of a lens provided in at least one embodiment of the present disclosure;

fig. 8 illustrates a structure of a control device of a camera module according to at least one embodiment of the present disclosure.

Detailed Description

In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of the present disclosure, the technical solutions in one or more embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in one or more embodiments of the present disclosure, and it is apparent that the described embodiments are only a part of the embodiments of the present disclosure, and not all embodiments. All other embodiments that can be derived by one of ordinary skill in the art based on one or more embodiments of the disclosure without inventive faculty are intended to be within the scope of the disclosure.

The embodiment of the present disclosure provides a camera module, as shown in fig. 1, the camera module may include: a processor 11 and a fill light 12. The number of the fill-in lamps 12 may be less than a set value, where the set value is a positive integer, and the embodiment of the disclosure does not limit the specific value of the set value, for example, the set value may be 1, 2, 3, 4, and the specific value of the set value may be determined according to the actual product requirement of the camera module. For example, in a case where it is desired in actual product demand that the camera module volume be as small as possible, the set value may be 1.

This module of making a video recording can gather the formation of image of being detected the object under the condition that the light filling lamp was opened. The camera module can be arranged in various environments, and the detected object can be an entity object or a space area. For example, when the camera module is provided in a vehicle, the detected object may be an occupant of the vehicle, or at least one of a driver area, a passenger area, a front-seat area, a rear-seat area, a trunk area, and the like of the vehicle, and the camera module may capture an image of the occupant or the at least one area.

The processor 11 in the camera module may be a chip or processing circuit disposed on a PCB motherboard inside the module. The processor 11 can detect the image brightness of the imaging image collected by the camera module, and adjust the shooting parameters of the camera module according to the image brightness.

For example, when the processor 11 adjusts the shooting parameters of the module according to the image brightness, one way may be to compare the image brightness with a reference brightness, and adjust the shooting parameters according to the comparison result. The reference brightness can be used as a judgment reference for judging whether the image brightness of the imaging image collected by the camera module is proper or not, if the reference brightness can be reached, the image brightness of the imaging image collected by the camera module is in accordance with the requirement, otherwise, if the reference brightness cannot be reached, the image brightness is in accordance with the requirement, and the image brightness can be collected again. The reference brightness may be a priori product experience, for example, empirically, the image brightness of the imaged image needs to reach a certain value to meet the detection requirement, and then the value may be referred to as the reference brightness. For example, in an application scenario in which the driver of the vehicle is imaged, the reference brightness may be a brightness at which the face state of the driver can be clearly recognized. The reference brightness can be preset in the camera module. If the image brightness does not reach the preset reference brightness, the processor 11 can adjust the shooting parameters of the camera module, so that the image brightness reaches the reference brightness when the camera module collects an imaging image according to the adjusted shooting parameters. Wherein, the shooting parameter is the adjustable parameter of the camera module. For example, the shooting parameters of the camera module may include, but are not limited to, at least one of the following: exposure time, analog gain, or digital gain.

In addition, the adjustment of the shooting parameters of the module according to the reference brightness is only an example, and in practical implementation, the processor 11 may control the shooting parameters of the camera module according to other ways besides the reference brightness. For example, the processor 11 may preset a mapping relationship between image brightness and shooting parameters, and when it is detected that the image brightness of the imaging image captured by the camera module is within a certain brightness range, determine the shooting parameters corresponding to the brightness range, where the shooting parameters may be preset parameters suitable for being adopted when the image brightness is detected. For another example, when the detected image brightness of the imaged image is at a certain brightness value, the parameter adjustment amount of the corresponding module shooting parameter may be preset, for example, when the image brightness is S1, the exposure time is correspondingly increased by T1, or the analog gain is correspondingly increased by M1; when the image brightness is S2, the correspondence relationship between the image brightness and the above-described adjustment amount of S1/S2 and the like may be set corresponding to increasing the exposure time by T2, and the like.

Corresponding to fig. 1, fig. 2 illustrates a control method of a camera module, which describes an imaging process of the camera module shown in fig. 1, and an execution main body of the control method may be the processor in fig. 1, or an external processor or other electronic device, no matter the processor is inside or outside the module, as long as the processor establishes a communication connection with the camera module, so that the processor can detect an imaging image of the camera module, and can control shooting parameters of the camera module by executing an automatic exposure algorithm. For example, the external processor may establish a communication channel with a Circuit board in the camera module through an Inter-Integrated Circuit (IIC) bus, and control the shooting parameters of the sensor in the module. As shown in fig. 2, the method may include the following processes, wherein the following description takes the case where the processor is inside the module as an example:

in step 200, the image brightness of the imaging image collected by the camera module is detected.

In this embodiment, the camera module can include light filling lamp and treater, and wherein, the quantity of light filling lamp is less than the setting value. In this step, the module of making a video recording can gather the formation of image of being detected the object. For example, the detected object may be a human face, and the imaged image may include the human face. The processor can detect the image brightness of the imaging image collected by the camera module.

In step 202, under the condition that the light filling lamp is turned on, the processor adjusts shooting parameters of the camera module according to the image brightness of the imaging image collected by the camera module.

In this step, taking the example that the processor in the module controls the adjustment of the shooting parameters according to the reference brightness: under the condition that the light filling lamp was opened, the shooting parameter of the module of making a video recording can be adjusted to the treater according to the image brightness of the formation of image of the module collection of making a video recording. For example, one of the ways of adjusting the shooting parameters according to the image brightness may be according to a reference brightness, and whether the image brightness of the imaged image reaches a preset reference brightness may be determined. If the reference brightness is reached, the imaged image may be subjected to further image processing, for example, in the application of a vehicle DMS, driver fatigue or distraction detection may be performed based on the driver's face in the imaged image. And if the image brightness does not reach the reference brightness, the processor can adjust the shooting parameters of the camera module, such as the exposure time and the gain.

After the shooting parameters are adjusted by the processor, the camera module continues to acquire the imaging image of the detected object by using the adjusted shooting parameters, and similarly, the acquired imaging image is detected by the processor to determine whether the image brightness reaches the reference brightness. If the reference brightness is not reached, the processor may continue to adjust the shooting parameters, for example, continue to increase the exposure time or the digital gain, and return to step 200 to continue to perform image acquisition by the camera module according to the newly adjusted shooting parameters. Therefore,

steps

200 and 202 in the present embodiment may be executed in a loop until the image brightness of the obtained imaged image is sufficient.

The camera module that above-mentioned embodiment provided, through the treater by the camera module under the condition that the light filling lamp was opened in response to, according to the image brightness adjustment camera module's of the formation of image that the module of making a video recording gathered shooting parameter for can be more nimble in the camera module set up the quantity of light filling lamp.

For example, a small number of light supplement lamps can be arranged, and even if the brightness of the provided light source is reduced due to the reduction of the number of the light supplement lamps, the influence of the brightness reduction of the light source on the brightness of the image can be corrected by adjusting the shooting parameters of the camera module through the processor; the flexible activation that light filling lamp quantity set up also helps improving the installation degree of difficulty and the cost of the module of making a video recording. For example, in an example, can only set up the light filling lamp of less quantity in the module of making a video recording, for example set up single light filling lamp to make the module volume of the module of making a video recording reduce, install more easily and integrate, reduced whole car cost. For example, after reducing the quantity of light filling lamp in the module, can make the module volume of the module of making a video recording can be: the horizontal total length of the module of making a video recording is 30mm to 45mm, the vertical windowing dimension of the module of making a video recording is 20mm to 35mm, the vertical total length of the module of making a video recording is 30mm to 45mm.

In addition, it still needs to explain that this kind of mode of adjusting the image brightness that the module gathered the image is adjusted to the shooting parameter through the adjustment module, compares in the mode through the power of increase light filling lamp, can the radiating problem of more effective solution light filling lamp. If promote image brightness through the power that increases the light filling lamp, will lead to the light filling lamp heat to strengthen, bring the heat dissipation problem from this, and the scheme of this disclosed embodiment, on the basis that can not bring the heat dissipation problem, can allow the quantity of light filling lamp in the nimble module that sets up, for example set up less light filling lamp, also can guarantee the image brightness of the imaging image of gathering equally, and the cost is taken into account, luminance, the integrated degree of difficulty and the consideration of heat dissipation problem, the luminance requirement of the module collection image has been guaranteed when having realized reducing module volume and cost, can not bring the heat dissipation problem yet.

Referring to the camera module shown in fig. 3, the camera module may include:

light filling lamp 31, fixed setting is on lamp plate 32, and this lamp plate 32 can be used for providing light filling control signal to light filling lamp 31, and the material of this lamp plate 32 can be aluminium base board. The fill-in wavelength of the fill-in lamp 31 may be 850nm to 1000nm.

A cover plate 33, the cover plate 33 may be made of, for example, PMMA (polymethyl methacrylate), as shown in fig. 3, the cover plate 33 is equivalent to a protective cover of the camera module, and can cover the light supplement lamp 31 and other components inside the module.

A lens 34, the lens 34 including an infrared filter (IR filter, illustrated in subsequent fig. 7). Fig. 7 is a schematic structural diagram of the lens 34 in fig. 3, and in fig. 7, the left side of the lens may receive light transmitted by the cover plate 33, the light is incident to the infrared filter at the right end of the lens along the optical axis direction of the lens, and the light enters the photosensitive surface of the sensor after being filtered by the infrared filter. In addition, as can also be seen from fig. 3, a cover plate 33 may cover the lens 34 and the fill-in light 31. The lens 34 may be a visible-infrared integrated lens, or may be a single infrared lens.

The circuit board 35, this circuit board 35 can be provided with sensor (sensor), and this sensor sets up in the one end of camera lens along the optical axis direction for the sensing passes through the light that the camera lens got into the module of making a video recording. In addition, during image capturing, the light may reach the sensor on the circuit board 35 through the infrared filter in the cover plate 33 and the lens 34. The sensor can convert photons of received light into electrons, which are then converted into analog signals, which are amplified by processing of an analog gain. Then, after performing analog-to-digital conversion on the amplified analog signal to obtain a digital signal, and performing digital gain processing to amplify the digital signal, the image processing system performs image processing on the digital signal to obtain a final imaging image, where the imaging image includes the detected object, for example, the detected object may be a face of a driver of an automobile.

Further, the processor in the camera module may be, for example, a chip or a processing circuit on the circuit board 35.

In the camera module according to the embodiment of the present disclosure, the processor may execute an automatic exposure algorithm to perform exposure control on the camera module, specifically, perform exposure control on a sensor on a circuit board in the camera module, so as to ensure that the brightness of an imaging image generated by the module can stably reach a preset reference brightness, for example, the image brightness reaches an image detection requirement of a DMS (Driver Monitoring System). For example, when fatigue detection or dangerous motion detection is performed on a driver by a DMS system, it is required that sufficient image brightness is obtained for an imaged image of the driver to obtain a more accurate detection result.

It should be noted that, in the control method described in any embodiment of the present disclosure, the control method may be executed by a processor inside the module, or an external processor or other electronic control devices, and the processor inside the module is taken as an example in the description. Fig. 4 illustrates a flow of an exposure control method for a camera module by a processor in a vehicle-mounted camera module when the camera module is the vehicle-mounted camera module, wherein, as shown in fig. 4, the method may include:

in step 400, the image brightness of the imaging image of the vehicle-mounted camera module is detected.

For example, as described above, the vehicle-mounted camera module can capture an imaging image. The vehicle-mounted camera module can convert incident light into electrons, and processes the images after the electrons are digitized to obtain imaging images of detected objects.

In this step, the processor may obtain the image brightness of the imaged image, and in an exemplary implementation, specifically, may obtain the image brightness of a predetermined region in the imaged image, and use the image brightness of the predetermined region in the imaged image as the image brightness of the imaged image, where the predetermined region includes a region where a predetermined object in the imaged image is located.

For example, it is assumed that the predetermined object is a face of a driver to recognize whether the driver is in a fatigue state by face detection. Then, the region where the predetermined object is located may be an image region including a face of the driver. In specific implementation, the imaging image may be divided into a plurality of sub-images according to different areas, then a part of the sub-images of the central area are acquired as the area where the predetermined object is located, and the image brightness of the area is determined. The extent of the particular central region may be defined autonomously so long as it covers the predetermined object.

In step 402, when the fill-in light is turned on, if the image brightness is lower than a preset reference brightness, adjusting a shooting parameter of a sensor in the vehicle-mounted camera module, so as to obtain an imaging image reaching the reference brightness after adjustment.

In this step, the preset reference brightness may be a preset image brightness value, and the image brightness value may satisfy the brightness requirement detected by the DMS, and certainly, a brightness value required by the application scene other than the DMS detection may be set as the reference brightness.

If the image brightness is lower than the preset reference brightness, the shooting parameters of the sensor in the vehicle-mounted camera module can be adjusted. The shooting parameters include at least one of: exposure time, analog gain, or digital gain.

In one example, the processor adjusts the exposure time of the sensor, so that the vehicle-mounted camera module obtains an imaging image reaching the reference brightness according to the adjusted parameters.

In another example, the processor adjusts the exposure time of the sensor to make the image brightness reach the reference brightness, and adjusts the exposure time and at least one of the analog gain and the digital gain to make the vehicle-mounted camera module obtain the imaged image reaching the reference brightness according to the adjusted parameters.

Fig. 5 illustrates an exposure control method for enabling the camera module to obtain an imaged image with reference brightness by adjusting the exposure time, the analog gain, and the digital gain, and it can be understood that in actual implementation, all three parameters are not necessarily adjusted, and only some of the parameters may be adjusted.

In step 500, in the case where it is determined that the image brightness of the imaged image of the in-vehicle camera module does not reach the reference brightness, the exposure time of the sensor in the module is adjusted.

In this embodiment, the exposure time may be preferentially adjusted, and the longer the exposure time is, the more the light enters, which is more favorable for improving the image brightness of the imaged image. The embodiment also sets the maximum exposure time, for example, it can be set to 6ms, so as to avoid the negative impact on the image quality caused by too long exposure time.

In addition, the exposure time of the adjustment sensor described in the present embodiment is actually the exposure time of the shutter in the adjustment sensor.

In this step, the processor may repeatedly perform the first adjustment operation until the exposure time of the camera module reaches a preset maximum exposure time or the image brightness of the imaging image acquired by the module reaches a reference brightness. The first adjusting operation comprises: and increasing the exposure time of the camera module and utilizing the camera module to acquire the imaging image.

For example, the processor may increase a certain value of the exposure time, and then the camera module acquires an imaging image according to the increased exposure time. If the processor finds that the image brightness of the imaged image obtained at this time still cannot reach the reference brightness, the exposure time may be increased continuously until the image brightness satisfies the requirement.

If the image brightness of the imaging image collected by the camera module still does not reach the reference brightness under the condition that the exposure time of the camera module reaches the maximum exposure time, the processor can repeatedly execute the second adjustment operation until the image brightness reaches the reference brightness. Wherein the second adjusting operation may include: and adjusting at least one of analog gain and digital gain of the camera module, and acquiring an imaging image by using the camera module.

The following takes

steps

502 and 504 as an example to illustrate a process for adjusting the analog gain and the digital gain.

In step 502, when the exposure time reaches a preset maximum exposure time and the image brightness is lower than a preset reference brightness, the analog gain is continuously adjusted.

Assuming that the maximum exposure time has been reached, the imaging image generated after the exposure time is adjusted may be acquired, and it is determined whether the image brightness reaches the reference brightness. And if the judgment result is yes, obtaining an imaging image. If the judgment result is negative, the gain can be continuously adjusted.

This embodiment takes the preferential adjustment of the analog gain as an example.

In step 504, when the analog gain reaches the maximum analog gain and the image brightness is lower than the preset reference brightness, the digital gain is continuously adjusted until the imaged image reaching the reference brightness is obtained.

Usually, the gain also has the maximum value of adjustment, and if the image brightness is still lower than the preset reference brightness after the analog gain adjustment reaches the maximum analog gain, the digital gain is continuously adjusted until the imaged image reaching the reference brightness is obtained.

According to the exposure control method, when the image brightness is detected not to reach the reference brightness, the shooting parameters are adjusted, so that the adjusted vehicle-mounted camera module can obtain the image reaching the reference brightness, the camera module can be provided with a small number of light supplement lamps in the mode, and the sufficient image brightness is obtained by combining with exposure control.

Just because foretell exposure control method for the module of making a video recording can set up the light filling lamp that quantity is less, for example, the on-vehicle module of making a video recording can set up a light filling lamp. Although a fill-in light is provided, the processor can adjust the shooting parameters of the module through the exposure control method shown in fig. 4 or 5, so that the image brightness of the imaging image of the module can be still improved under the condition of the fill-in light.

For example, at night, a fill-in light can be turned on, and at this time, the image brightness of the imaging image of the vehicle-mounted camera module is low and does not reach the brightness requirement detected by the DMS. Then, when the processor determines that the image brightness is lower than the reference brightness, the exposure time of the sensor in the module can be increased, or the value of the analog gain or the digital gain of the sensor is increased, and the sufficient image brightness can still be achieved under the condition of one fill-in light by adjusting the shooting parameters. For the whole vehicle, the cost of the camera module is reduced by the arrangement of one light supplement lamp, and the integration difficulty of the light supplement lamp is also reduced. In addition, the design of a light filling lamp has reduced the volume of the module of making a video recording, when being applied to the DMS of car in the module of making a video recording, is favorable to reducing the influence of the module of making a video recording to the driver.

In still another embodiment, in order to save the consumption of light filling lamp, improve the life of light filling lamp, and then improve the reliability and the durability of whole on-vehicle module of making a video recording, this embodiment can also carry out following improvement to on-vehicle module of making a video recording:

the cover plate 33, and the infrared filter in the lens 34 may be provided so that the cover plate 33 and the infrared filter can transmit more near-infrared light. For example, the cut-off wavelength of the cover plate may be set to be smaller than a first wavelength threshold, which may be 750nm for example, by adjusting a mixing ratio of raw materials such as PMMA and NIR1 in the cover plate 33, so that the light transmitted by the cover plate includes near infrared light with a wavelength above 750 nm. The more light that is transmitted, the more electrons the sensor correspondingly converts, and the higher the brightness of the final image. Similarly, the cutoff wavelength of the infrared filter in the lens may be set to be smaller than a second wavelength threshold, which may be the same as the first wavelength threshold, for example, set to be 750nm, so as to transmit more near infrared light.

In addition, one of the performance metrics of the sensor on the circuit board may be QE (photo diode quantum efficiency), which is the ratio of the number of converted electrons to the number of incident photons. Generally, the more electrons that are converted, which helps to enhance the image brightness, the better the image quality will be. In addition, in the above process of digitally converting electrons, the Gain (Gain) is used to amplify the image signal and enhance the brightness of the image screen. The unit of gain can be generally expressed as a "multiple", such as 1x,2x,3x, etc.

The embodiment of the disclosure can further adjust the sensors on the circuit board, and select the sensor with higher QE performance. For example, the quantum efficiency of the sensor at the first wavelength may be set to not less than a first preset efficiency value. For example, the first wavelength does not exceed 750nm, and the first preset efficiency value is not lower than 50%; and setting the quantum efficiency of the sensor at a second wavelength to be not lower than a second preset efficiency value, wherein the second wavelength can be not less than 950nm, and the second preset efficiency value can be not lower than 10%.

For example, referring to fig. 6, fig. 6 illustrates a QE curve of a sensor selected according to the present embodiment, according to which it can be seen that the quantum efficiency of the sensor to light in the 750nm band is not less than 50%, i.e. at least half of the photons can be converted into electrons; the quantum efficiency of the quantum well structure is not less than 10% for light rays in 950nm wave band, namely, at least one tenth of photons in the light rays in 950nm wave band can be converted into electrons. In addition, the dashed curve in fig. 6 is the QE performance curve of the sensor used before adjustment, and the solid curve is the QE performance curve of the sensor used after adjustment, and it can be seen that the QE value of the sensor selected in this embodiment is improved as compared with that of the sensor used before adjustment. The QE performance of the sensor is improved, so that more electrons are obtained through conversion, and the imaging quality is improved.

After the cover plate, the lens, the sensor and the like of the camera module are improved by the measures of increasing the transmitted near infrared light or improving QE, the sensor can receive more light or convert more photons into electrons, so that more electrons can be obtained, and the brightness and the quality of an imaging image generated according to the signal processing after the electronic digitization are higher.

Due to the arrangement of the cover plate, the infrared filter and the sensor, the light supplementing lamp can be saved. For example, in the scene of daytime, the sun can produce the near-infrared luminous energy of considerable part, and this part light passes through apron, camera lens, reaches the sensor formation of image, if this part ambient light is strong enough, then also can the module finally obtain the image luminance can reach reference luminance, and the light filling lamp can not be opened. Thus, the consumption of the light supplement lamp can be saved. Under the condition that the light filling lamp in the module was not opened, the image brightness that the treater can be responded to the formation of image that the module of making a video recording was gathered does not reach reference luminance, adjusts the shooting parameter of the module of making a video recording, for example at least one in exposure time, digital gain or the analog gain of sensor in the adjustment module.

Of course, the processor can continuously execute exposure control and monitor the image brightness in real time no matter whether the fill light is turned on or not. And the camera module can be controlled according to the detected image brightness. Two control modes are illustrated as follows, and the processor may perform at least one of the following two examples: wherein, in an example, under the condition that the light filling lamp was not opened, if the image brightness of the formation of image that the module of making a video recording gathered does not reach preset reference luminance, can adjust the shooting parameter of the module of making a video recording. For example, if the image brightness of the imaged image is lower than the reference brightness, the exposure time of the camera module is increased, so that the brightness of the imaged image collected by the camera module is improved. In another example, under the condition that the light supplement lamp is not turned on, if the shooting parameter of the camera module has been adjusted to a preset threshold value, for example, the exposure duration has reached the maximum exposure duration, and the image brightness of the imaging image acquired by the camera module has not yet reached the reference brightness, the light supplement lamp in the camera module can be turned on. For example, if the processor adjusts the shooting parameters of the camera module to a preset threshold value, for example, the exposure time reaches the maximum exposure time, and the gain is also adjusted to the corresponding maximum gain, but the image brightness of the imaging image acquired by the camera module still does not reach the reference brightness, the processor can control the light supplement lamp in the camera module to be turned on.

In the scene at night, the near-infrared light energy in the environment weakens, and the required illumination of formation of image mainly derives from the light filling lamp of module self of making a video recording. Also, the processor monitors whether the image brightness of the imaged image can reach the reference brightness by performing the exposure control, and if not, adjusts at least one of the exposure time, the analog gain, or the digital gain to finally achieve the desired quality of the imaged image.

It can be seen from the above description that the module of making a video recording of this disclosed embodiment can set up the light filling lamp of less quantity, through the exposure control strategy of cooperation treater, just can make the light filling lamp of less quantity (for example, single light filling lamp) also can reach predetermined image reference luminance to make the cost reduction of the module of making a video recording, reduced the module volume, also reduced the integrated degree of difficulty of module.

Fig. 8 provides a control apparatus of a camera module, which may be applied to a device for controlling the camera module, for example, a processor inside the camera module or an external control device, so that the device can execute the method for controlling the camera module according to any embodiment of the present disclosure. The camera shooting end seat comprises light supplement lamps and a processor, and the number of the light supplement lamps is smaller than a set value. As shown in fig. 8, the apparatus may include: an image detection module 81 and a parameter adjustment module 82.

The image detection module 81 is used for detecting the image brightness of the imaging image acquired by the camera module;

and the parameter adjusting module 82 is used for adjusting shooting parameters of the camera module according to the image brightness of the imaging image acquired by the camera module under the condition that the light supplementing lamp is turned on.

In an example, the image detection module 81 is specifically configured to acquire image brightness of a predetermined area in the imaged image, and use the image brightness of the predetermined area in the imaged image as the image brightness of the imaged image, where the predetermined area includes an area where a predetermined object is located in the imaged image.

As shown in fig. 8, the apparatus may further include: and the lamp control module 83 is used for responding to the situation that the light supplement lamp is not started, adjusting the shooting parameters of the camera module to a preset threshold value, controlling the light supplement lamp in the camera module to be started when the image brightness of the imaging image collected by the camera module does not reach the reference brightness.

In some embodiments, the above apparatus may be configured to perform any of the methods described above, and for brevity, the description is omitted here.

The embodiment of the disclosure further provides a vehicle, and the vehicle comprises the camera module in any embodiment of the disclosure. The specific structure of the camera module can be seen in the foregoing embodiments, and is not described in detail. The camera module can be installed at the position of an A column at the driving side in a vehicle or below a front windshield at the driving side.

The embodiments of the present disclosure also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method of any embodiment of the present disclosure, and the method enables the method according to any embodiment of the present disclosure to execute control on a camera module.

One skilled in the art will appreciate that one or more embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, one or more embodiments of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, one or more embodiments of the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Wherein, the "and/or" described in the embodiments of the present disclosure means having at least one of the two, for example, "multiple and/or B" includes three schemes: poly, B, and "poly and B".

The embodiments in the disclosure are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the data processing apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to part of the description of the method embodiment.

The foregoing description of specific embodiments of the present disclosure has been described. Other embodiments are within the scope of the following claims. In some cases, the acts or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

Embodiments of the subject matter and functional operations described in this disclosure may be implemented in: digital electronic circuitry, tangibly embodied computer software or firmware, computer hardware including the structures disclosed in this disclosure and their structural equivalents, or a combination of one or more of them. Embodiments of the subject matter described in this disclosure can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on a tangible, non-transitory program carrier for execution by, or to control the operation of, data processing apparatus. Alternatively or additionally, the program instructions may be encoded on an artificially generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode and transmit information to suitable receiver apparatus for execution by the data processing apparatus. The computer storage medium may be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of them.

The processes and logic flows described in this disclosure can be performed by one or more programmable computers executing one or more computer programs to perform corresponding functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPG multi (field programmable gate array) or a SIC multi (application-specific integrated circuit).

Computers suitable for executing computer programs include, for example, general and/or special purpose microprocessors, or any other type of central processing unit. Generally, a central processing unit will receive instructions and data from a read-only memory and/or a random access memory. The basic components of a computer include a central processing unit for implementing or executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer does not necessarily have such a device. Further, the computer may be embedded in another device, e.g., a mobile telephone, a personal digital assistant (PD multi), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device such as a Universal Serial Bus (USB) flash drive, to name a few.

Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices), magnetic disks (e.g., internal hard disk or removable disks), magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.

Although this disclosure contains many specific implementation details, these should not be construed as limiting the scope of any disclosure or of what may be claimed, but rather as merely describing features of particular embodiments of the disclosure. Certain features that are described in this disclosure in the context of separate embodiments can also be implemented in combination in a single embodiment. In another aspect, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.

Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking and parallel processing may be advantageous. Moreover, the separation of various system modules and components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.

Thus, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. Further, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some implementations, multitasking and parallel processing may be advantageous.

The above description is only for the purpose of illustrating the preferred embodiments of the present disclosure, and is not intended to limit the scope of the present disclosure, which is to be construed as being limited by the appended claims.

Claims

1. The utility model provides a module of making a video recording, its characterized in that, the module of making a video recording is on-vehicle module of making a video recording, the module of making a video recording includes:

the number of the light supplement lamps is one;

the processor is used for adjusting shooting parameters of the camera module according to the image brightness of an imaging image acquired by the camera module under the condition that the light supplement lamp is turned on;

the camera module further comprises a lens and a cover plate, and the cover plate is covered on the lens and the light supplement lamp; the cutoff wavelength of the cover plate is smaller than a first wavelength threshold value; and/or

The lens comprises an infrared filter, and the cutoff wavelength of the infrared filter is smaller than a second wavelength threshold;

the first and second wavelength thresholds are 750nm;

the processor is configured to: in response to the module of making a video recording is in the image brightness of the formation of image that the light filling lamp was gathered under the circumstances that opens does not reach reference luminance, adjust according to following mode the shooting parameter of the module of making a video recording:

repeatedly executing the first adjustment operation until the exposure time of the camera module reaches a preset maximum exposure time or the image brightness of an imaging image acquired by the camera module reaches the reference brightness; the first adjusting operation comprises: increasing the exposure time of the camera module and acquiring the imaging image by using the camera module;

responding to the situation that the image brightness of the imaging image collected by the camera module does not reach the reference brightness under the condition that the exposure time of the camera module reaches the maximum exposure time, and repeatedly executing second adjustment operation until the image brightness of the imaging image collected by the camera module reaches the reference brightness; the second adjusting operation includes: and adjusting at least one of analog gain and digital gain of the camera module, and acquiring an imaging image by using the camera module.

2. The camera module of claim 1, further comprising a sensor disposed at an end of the lens along the optical axis for sensing light entering the camera module through the lens;

the quantum efficiency of the sensor at the first wavelength is not lower than a first preset efficiency value, and the quantum efficiency at the second wavelength is not lower than a second preset efficiency value;

the first wavelength is not more than 750nm, the second wavelength is not less than 950nm, the first preset efficiency value is not lower than 50%, and the second preset efficiency value is not lower than 10%.

3. The camera module of any of claims 1-2,

the camera module is characterized in that the camera module further comprises a lamp panel used for providing a light supplement control signal for the light supplement lamp, and the light supplement lamp is fixed on the lamp panel.

4. The camera module of claim 1,

the processor is configured to: respond to the module of making a video recording is in the image brightness of the imaging image that the light filling lamp was gathered under the circumstances that opens does not reach reference luminance, adjusts the module of making a video recording following at least one shooting parameter: exposure time, analog gain, digital gain.

5. The camera module of claim 1,

the processor is further configured to obtain image brightness of a predetermined area in the imaged image, and use the image brightness of the predetermined area in the imaged image as the image brightness of the imaged image, where the predetermined area includes an area where a predetermined object in the imaged image is located.

6. The camera module of claim 1,

the processor is further configured to:

under the condition that the light supplement lamp is not turned on, responding to the fact that the image brightness of an imaging image collected by the camera module does not reach the reference brightness, and adjusting the shooting parameters of the camera module; and/or the presence of a gas in the gas,

and responding to the situation that the light supplement lamp is not started, adjusting the shooting parameters of the camera module to a preset threshold value, and controlling the light supplement lamp in the camera module to be started when the image brightness of the imaging image collected by the camera module does not reach the reference brightness.

7. The camera module according to claim 1, wherein each of the fill-in light and the lens of the camera module are arranged in parallel along a diameter direction of the camera module; and/or

The light supplement wavelength of the light supplement lamp is 850nm to 1000nm; and/or

The transverse total length of the camera module is 30mm to 45mm, the longitudinal windowing size of the camera module is 20mm to 35mm, and the longitudinal total length of the camera module is 30mm to 45mm; and/or

The camera module comprises a vehicle-mounted camera module.

8. A vehicle, characterized in that,

the vehicle includes the camera module of any one of claims 1 to 7.

9. The control method of the camera module is characterized in that the camera module is a vehicle-mounted camera module, the camera module comprises a light supplement lamp and a processor, and the number of the light supplement lamp is one;

the control method comprises the following steps:

detecting the image brightness of an imaging image acquired by the camera module;

under the condition that the light supplement lamp is turned on, adjusting shooting parameters of the camera module according to the image brightness of an imaging image acquired by the camera module;

the camera module further comprises a lens and a cover plate, and the cover plate is covered on the lens and the light supplement lamp; the cutoff wavelength of the cover plate is smaller than a first wavelength threshold value; and/or the lens comprises an infrared filter, and the cutoff wavelength of the infrared filter is smaller than a second wavelength threshold; the first and second wavelength thresholds are 750nm;

according to the image brightness of the imaging image that the module of making a video recording was gathered, adjust the shooting parameter of the module of making a video recording, include:

repeatedly executing a first adjustment operation until the exposure time of the camera module reaches a preset maximum exposure time or the image brightness of an imaging image acquired by the camera module reaches a reference brightness; the first adjusting operation comprises: increasing the exposure time of the camera module and collecting the imaging image by using the camera module;

10. The method according to claim 9, wherein the adjusting the shooting parameters of the camera module according to the image brightness of the imaging image collected by the camera module comprises:

in response to detecting the module of making a video recording is in the image brightness of the formation of image that the light filling lamp was gathered under the circumstances that opens does not reach reference luminance, adjust the module of making a video recording following at least one shooting parameter: exposure time, analog gain, digital gain.

11. The method according to any one of claims 9 to 10, wherein the detecting the image brightness of the imaging image captured by the camera module comprises:

and acquiring the image brightness of a preset area in the imaged image, and taking the image brightness of the preset area in the imaged image as the image brightness of the imaged image, wherein the preset area comprises an area where a preset object in the imaged image is located.

12. The method of claim 9,

the method further comprises the following steps:

under the condition that the light supplement lamp is not turned on, responding to the fact that the image brightness of an imaging image collected by the camera module does not reach the reference brightness, and adjusting the shooting parameters of the camera module; and/or

13. The control device of the camera module is characterized in that the camera module is a vehicle-mounted camera module, the camera module comprises a light supplement lamp and a processor, and the number of the light supplement lamp is one;

the device comprises:

the image detection module is used for detecting the image brightness of an imaging image acquired by the camera module;

the parameter adjusting module is used for adjusting shooting parameters of the camera module according to the image brightness of an imaging image acquired by the camera module under the condition that the light supplementing lamp is turned on;

according to the image brightness of the image that the module of making a video recording was gathered, adjust the shooting parameter of the module of making a video recording, include:

repeatedly executing a first adjustment operation until the exposure time of the camera module reaches a preset maximum exposure time or the image brightness of an imaging image acquired by the camera module reaches a reference brightness; the first adjusting operation comprises: increasing the exposure time of the camera module and acquiring the imaging image by using the camera module;

14. The apparatus of claim 13,

the image detection module is specifically configured to acquire image brightness of a predetermined region in the imaged image, and use the image brightness of the predetermined region in the imaged image as the image brightness of the imaged image, where the predetermined region includes a region where a predetermined object in the imaged image is located.

15. The apparatus of claim 13 or 14, further comprising:

and the lamp control module is used for responding to the situation that the light supplement lamp is not started, adjusting the shooting parameters of the camera module to a preset threshold value, and controlling the light supplement lamp in the camera module to be started when the image brightness of the imaging image collected by the camera module does not reach the reference brightness.

16. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 9-12.