CN110519489A

CN110519489A - Image-pickup method and device

Info

Publication number: CN110519489A
Application number: CN201910539479.9A
Authority: CN
Inventors: 聂鑫鑫; 范蒙
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2019-06-20
Filing date: 2019-06-20
Publication date: 2019-11-29
Anticipated expiration: 2039-06-20
Also published as: CN110519489B

Abstract

It includes: filtering assembly, imaging sensor, light aid, image processing unit that the application, which provides a kind of image-pickup method and device, the device,；Imaging sensor is located at the light emission side of filtering assembly；Described image sensor, for being double exposed using global Exposure mode, obtaining two candid photograph picture signals according to grab signal；The light aid is used to carry out quick-fried sudden strain of a muscle light filling according to light filling signal in overall situation exposure；The filtering assembly includes the first optical filter and the second optical filter；First optical filter passes through visible light and part near infrared light；Second optical filter passes through visible light, stops near infrared light；Image processing unit, for according to described two candid photograph picture signals, it obtains capturing image, interior over any time period two candid photograph picture signals can be collected by double exposure, the subsequent candid photograph image that image signal acquisition outer scene is captured according to this two, equipment cost is reduced, and optimizes the effect for capturing image.

Description

Image-pickup method and device

Technical field

This application involves computer vision field more particularly to a kind of image-pickup methods and device.

Background technique

In traffic administration or security administration field, often through the auxiliary irradiation of near infrared light and visible light, to capture Object in scene, such as vehicle, pedestrian, roadblock etc..Currently used capture apparatus can be according to the difference of light in scene Different images is obtained, so as to not limited by visual intensity the acquisition of the information of scene, for example, capture apparatus is in scene Middle visual intensity obtains visible images when stronger, obtains near infrared light image when visual intensity is weaker in the scene, with Realize the information that scene can be obtained under different visual intensities.

Capture apparatus in the related technology includes two imaging sensors and a camera lens, and one two is provided on camera lens To color light splitting piece, the light for entering capture apparatus is divided into visible light and infrared light, it will be seen that light and infrared light project respectively Visible light sensor and infrared light transducer[sensor, then it will be seen that optical sensor and the image of infrared light transducer[sensor output merge.

However, the image that two sensors export is merged, it is higher to equipment production required precision, and above-mentioned bat Taking the photograph equipment has that structure is complicated, higher cost.

Summary of the invention

The application provides a kind of image-pickup method and device, to improve the candid photograph effect of outer scene, and solves existing In technology the problem of device structure complexity, higher cost.

In a first aspect, the application provides a kind of image collecting device, comprising:

Filtering assembly, imaging sensor, light aid, image processing unit, described image sensor are located at the optical filtering group The light emission side of part；

Described image sensor obtains two for being double exposed using global Exposure mode according to grab signal Capture picture signal；

The light aid is used to carry out quick-fried sudden strain of a muscle light filling according to light filling signal in overall situation exposure；

The filtering assembly includes the first optical filter and the second optical filter；First optical filter keeps visible light and part close Infrared light passes through；Second optical filter passes through visible light, stops near infrared light；

Image processing unit captures image for obtaining according to described two candid photograph picture signals.

Second aspect, the application provide a kind of image-pickup method,

Applied to image collecting device, described image acquisition device includes imaging sensor, light aid, filtering assembly and figure As processing unit, described image sensor is located at the light emission side of the filtering assembly, which comprises

Through the light aid in overall situation exposure, quick-fried sudden strain of a muscle light filling is carried out according to light filling signal；

Pass through visible light and part near infrared light by the first optical filter that the filtering assembly includes；Pass through the filter The second optical filter that optical assembly includes passes through visible light, stops near infrared light；

It by described image sensor according to grab signal, is double exposed using global Exposure mode, obtains two Capture picture signal；

By described image processing unit according to described two candid photograph picture signals, obtain capturing image.

Image-pickup method and device provided by the embodiments of the present application, comprising: filtering assembly, imaging sensor, light aid, Image processing unit, described image sensor are located at the light emission side of the filtering assembly；Described image sensor is grabbed for basis Signal is clapped, is double exposed using global Exposure mode, obtains two candid photograph picture signals；The light aid is used in the overall situation When exposure, quick-fried sudden strain of a muscle light filling is carried out according to light filling signal；The filtering assembly includes the first optical filter and the second optical filter；Described One optical filter passes through visible light and part near infrared light；Second optical filter passes through visible light, stops near infrared light；Figure As processing unit, image is captured for obtaining according to described two candid photograph picture signals, interior over any time period can pass through two Secondary exposure collects two candid photograph picture signals, the subsequent candid photograph figure that image signal acquisition outer scene is captured according to this two Picture reduces equipment cost, and optimizes the effect for capturing image.

Detailed description of the invention

The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure.

Fig. 1 is a kind of structural schematic diagram of image collecting device provided by the embodiments of the present application；

Fig. 2 is the structural schematic diagram of another image collecting device provided by the embodiments of the present application；

Fig. 3 is a kind of structural schematic diagram of image processing unit provided by the embodiments of the present application；

Fig. 4 is a kind of structural schematic diagram of image pre-processing unit provided by the embodiments of the present application；

Fig. 5 is a kind of image co-registration handling principle schematic diagram provided by the embodiments of the present application；

Fig. 6 is the structural schematic diagram of another image processing unit provided by the embodiments of the present application；

Fig. 7 is a kind of schematic illustration for removing reflector element provided by the embodiments of the present application；

Fig. 8 is a kind of flow diagram for removing reflector element provided by the embodiments of the present application；

Fig. 9 is the structural schematic diagram of another image processing unit provided by the embodiments of the present application；

Figure 10 is that a kind of first light compensating apparatus provided by the embodiments of the present application carries out the quick-fried wavelength and phase for dodging light filling of near-infrared To the relation schematic diagram between intensity；

Figure 11 is between the wavelength and percent of pass of a kind of light that first optical filter passes through provided by the embodiments of the present application Relation schematic diagram；

Figure 12 is a kind of schematic diagram of RGB sensor provided by the embodiments of the present application；

Figure 13 is a kind of schematic diagram of RGBW sensor provided by the embodiments of the present application；

Figure 14 is a kind of schematic diagram of RCCB sensor provided by the embodiments of the present application；

Figure 15 is a kind of schematic diagram of RYYB sensor provided by the embodiments of the present application；

Figure 16 is a kind of induction curve schematic diagram of imaging sensor provided by the embodiments of the present application；

Figure 17 is a kind of flow diagram of image-pickup method provided by the embodiments of the present application.

Specific embodiment

Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.

Term " includes " in the description and claims of this application and the attached drawing and " having " and they appoint What is deformed, it is intended that is covered and non-exclusive is included.Such as contain the process, method, system, production of a series of steps or units Product or equipment are not limited to listed step or unit, but optionally further comprising the step of not listing or unit, or Optionally further comprising the other step or units intrinsic for these process, methods, product or equipment.

Fig. 1 is a kind of structural schematic diagram of image collecting device provided by the embodiments of the present application, and referring to Fig. 1, which is adopted Acquisition means include imaging sensor 01, light aid 02, filtering assembly 03 and image processing unit, and imaging sensor 01 is located at filter The light emission side of optical assembly 03.Imaging sensor 01, for being double exposed using global Exposure mode according to grab signal, Obtain two candid photograph picture signals.Light aid 02 is used to carry out quick-fried sudden strain of a muscle light filling according to light filling signal in overall situation exposure.

Referring to fig. 2, filtering assembly 03 includes the first optical filter 031 and the second optical filter 032；First optical filter 031 makes can Light-exposed and part near infrared light passes through；Second optical filter 032 passes through visible light, stops near infrared light；

On the basis of the above embodiments, referring to fig. 2, the filtering assembly 03 further includes switching part 033, and described first Optical filter 031 and second optical filter 032 are connect with the switching part 033；The switching part 033 is used for institute The incident side that the second optical filter 032 is switched to described image sensor 01 is stated, alternatively, the first optical filter 031 is switched to the figure As the incident side of sensor 01.For example, waiting during the day, which is switched to entering for the imaging sensor 01 First optical filter 031 is switched to the incident side of the imaging sensor 01 at night by light side.

Wherein, grab signal and light filling signal can be the same signal.

In some embodiments, in the case where intensity of illumination is low, such as night, it is realized by the quick-fried sudden strain of a muscle light filling of near infrared light Candid photograph to outer scene, after the first optical filter 031 is switched to the incident side of imaging sensor 01:

Imaging sensor 01 is used to be double exposed according to grab signal using global Exposure mode, described to expose twice Light includes the first default exposure and the second default exposure, is generated by double exposure and exports the first candid photograph picture signal and second Capture picture signal.Wherein, the first candid photograph picture signal is the picture signal generated according to the first default exposure, and second captures figure As signal is to preset the picture signal that exposure generates according to second, also, the first default corresponding expose of all rows of exposure starts Moment is identical and all rows corresponding end exposure moment is identical, the corresponding exposure start time phase of second default all rows of exposure With and all rows corresponding end exposure moment it is identical.Light aid 02 includes the first light compensating apparatus 021, the first light compensating apparatus 021 For carrying out the quick-fried sudden strain of a muscle light filling of near-infrared according to light filling signal, wherein at least within the Partial exposure period of the first default exposure The quick-fried sudden strain of a muscle light filling of near-infrared is carried out, without the quick-fried sudden strain of a muscle light filling of near-infrared in the exposure period of the second default exposure.

Image processing unit, first for being exported according to imaging sensor, which captures picture signal and second, captures image letter Number, fusion obtains capturing image.

In further embodiments, the intensity of illumination in outer scene is preferable, such as daytime, then is mended by the quick-fried sudden strain of a muscle of visible light Light is captured, and after the second optical filter 032 is switched to the incident side of imaging sensor 01, imaging sensor 01 is used for root It according to grab signal, is double exposed using global Exposure mode, is generated by double exposure and export third and capture image letter Number and the 4th capture picture signal, wherein it is the picture signal generated according to the default exposure of third that third, which captures picture signal, the Four candid photograph picture signals are the picture signals generated according to the 4th default exposure, also, the default all rows of exposure of third are corresponding Expose that start time is identical and all rows corresponding end exposure moment is identical, the corresponding exposure of the 4th default all rows of exposure is opened Beginning, the moment is identical and all rows corresponding end exposure moment is identical.

Referring to fig. 2, light filling, 02 includes the second light compensating apparatus 022, and the second light compensating apparatus 022 is used for according to light filling signal, into The quick-fried sudden strain of a muscle light filling of row visible light, wherein at least carry out the quick-fried sudden strain of a muscle of visible light within the Partial exposure period of the default exposure of the third Light filling, without the quick-fried sudden strain of a muscle light filling of visible light in the exposure period of the described 4th default exposure.

Image processing unit is captured picture signal for capturing picture signal and the described 4th according to the third, is passed through Reflection is carried out to reflection position to obtain capturing image.

It should be noted that switching part 033 be used to the second optical filter 032 being switched to imaging sensor 01 enter light Side, it is understood that replace the first optical filter 031 in the position of the incident side of imaging sensor 01 for the second optical filter 032.In Second optical filter 032 is switched to after the incident side of imaging sensor 01, and the first light compensating apparatus 021 is for carrying out the quick-fried sudden strain of a muscle of visible light Light filling, wherein at least the quick-fried sudden strain of a muscle light filling of visible light is carried out within the Partial exposure period of the default exposure of third, in the 4th default exposure Without the quick-fried sudden strain of a muscle light filling of visible light in the exposure period of light.

In one embodiment of the application, referring to Fig. 3, image processing unit, comprising:

Image pre-processing unit and image fusion unit；

Wherein, described image pretreatment unit, for the first candid photograph picture signal to be generated gray scale after pretreatment The second candid photograph picture signal is generated color image by image after pretreatment；

Described image integrated unit obtains coloured silk for the color image and the gray level image to be carried out fusion treatment Color blending image, i.e. candid photograph image.

Specifically, get the first of sensor output capture picture signal and second capture picture signal after, can be with First the first candid photograph picture signal and the second candid photograph picture signal are pre-processed by image pre-processing unit, respectively obtained pre- Treated gray level image and color image, then carries out at fusion color image and gray level image by image fusion unit Reason, obtains color fusion image.

Interior over any time period exposure can be preset by the first default exposure and second while being collected comprising near-infrared The first of optical information captures picture signal and the second candid photograph picture signal comprising visible optical information, subsequent according to first candid photograph The quality for the image that picture signal and the second candid photograph picture signal are handled is higher, therefore imitates to the candid photograph of outer scene Fruit is preferable.

As shown in figure 4, described image pretreatment unit, comprising:

Joint noise reduction unit, and the first pretreatment unit being connect respectively with the joint noise reduction unit and the second pre- place Manage unit；

Wherein, the joint noise reduction unit captures image letter for capturing picture signal and described second to described first It number is filtered, first after obtaining noise reduction captures picture signal and second and capture picture signal；

First pretreatment unit carries out the first pretreatment operation for capturing picture signal to first after noise reduction, Obtain pretreated gray level image；Second pretreatment unit is carried out for capturing picture signal to second after noise reduction Second pretreatment operation, obtains color image.

Wherein, the first pretreatment operation is for example including at least one of following operation: black level processing, bad point correction, brightness Calculating, gamma correction, noise reduction and Edge contrast；

Second pretreatment operation is for example including at least one of following operation: black level processing, bad point correction, white balance school Just, color interpolation, gamma correction, colour correction, RGB turn YUV operation, noise reduction and Edge contrast.

Joint noise reduction unit captures the correlation of information between picture signal for capturing picture signal and second using first Property, joint noise reduction process, such as joint bilateral filtering processing are carried out to the first candid photograph picture signal or the second candid photograph picture signal, First after obtaining the noise reduction of signal-to-noise ratio promotion, which captures picture signal and second, captures picture signal.

It is right according to the correlation between the color image and the gray level image in some embodiments of the present application The color image and the gray level image carry out Federated filter processing respectively, color image and gray scale after obtaining the noise reduction Image；

Alternatively, the joint noise reduction unit, is specifically used for:

The correlation between picture signal is captured according to the first candid photograph picture signal and second, captures image to described first Signal and second candid photograph picture signal carry out Federated filter processing respectively, after obtaining the noise reduction first capture picture signal and Second captures picture signal.

Illustratively, in one embodiment of the application, when imaging sensor is the sensor arranged in a manner of bayer, The picture signal of output will be mosaic image signal.First pretreatment unit can also go the first candid photograph picture signal Mosaic processing, so that first after being repaired captures picture signal.

It should be noted that can be inserted using bilinearity when capturing picture signal progress demosaicing processing to first The methods of value method or adaptive-interpolation method are handled, and details are not described herein again.Further, image fusion unit includes: color Color extraction unit, brightness extraction unit merge place with what the Color Picking unit and the brightness extraction unit connected respectively Manage unit；

Wherein, the Color Picking unit, for extracting the chrominance signal of the color image；

The brightness extraction unit, for extracting the luminance signal of the color image；

The fusion treatment unit obtains filtered high-frequency signal for carrying out high-pass filtering to the gray level image；

Low-pass filtering is carried out to the luminance signal of the color image, obtains filtered low frequency signal；

Fusion treatment is carried out to the high-frequency signal, the low frequency signal and the chrominance signal, the colour is obtained and melts Close image.

Wherein, the fusion treatment unit, is specifically used for:

Fusion treatment is weighted to the high-frequency signal and the low frequency signal, obtains fusion luminance picture；

Fusion treatment is carried out to the chrominance signal of the fusion luminance picture and the color image, the colour is obtained and melts Close image.

Specifically, in Fig. 3 image fusion unit function, be the brightness by the luminance signal of color image and gray level image Signal is weighted fusion, obtains fusion luminance picture, then synthesizes again with the chrominance signal of color image, obtain color integration Image.

In Fig. 5, low-pass filtering can be carried out to luminance signal before Weighted Fusion and obtain low frequency signal, to gray level image It carries out High frequency filter and obtains high-frequency signal, low frequency signal and high-frequency signal are weighted fusion and obtain fusion luminance picture.

Illustratively, it is assumed that the luminance signal of gray level image Y, color image are W, utilize high-pass filtering and low pass filtered Wave extracts the high-frequency signal of the luminance signal W of color image and the low-frequency information of gray level image Y, as described in following formula,

W_high=HPF (W)

Y_low=LPF (Y)

Wherein, HPF indicates that high-pass filter, LPF indicate low-pass filter, W_highIndicate the high-frequency signal of gray level image, Y_lowIndicate the low frequency signal of the luminance signal of color image.By the low frequency signal and gray level image of the luminance signal of color image High-frequency signal be added, obtain fusion luminance picture, i.e. FUS'=W_high+Y_low.It finally will fusion luminance picture and color image Chrominance signal VIS_lowSynthesis, obtains color fusion image, i.e. candid photograph image.

In some embodiments, if light is stronger in currently used scene, such as when daytime, the first light compensating apparatus According to light filling signal, the progress quick-fried sudden strain of a muscle light filling of visible light in exposure period at least is preset in third, in the exposure of the 4th default exposure Without the quick-fried sudden strain of a muscle light filling of visible light in the light period, then imaging sensor generates according to grab signal and the third exported is captured Picture signal is that picture signal is captured in a kind of quick-fried sudden strain of a muscle of visible light, and imaging sensor generates and the 4th candid photograph picture signal exported is A kind of non-quick-fried sudden strain of a muscle candid photograph picture signal.As shown in fig. 6, image processing unit includes: detection registration unit and removes reflector element；

Wherein, registration unit is detected, picture signal is captured for capturing picture signal and the 4th according to third, using depth Learning algorithm detects the vehicle window region in third candid photograph picture signal and the 4th grab signal respectively, and captures image according to third Signal is registrated the vehicle window region in the 4th grab signal, obtains the non-flash vehicle window administrative division map in the 4th grab signal Picture, specifically, obtaining third by detection captures the flash of light vehicle window region of picture signal and the non-sudden strain of a muscle of the 4th candid photograph picture signal The window locations coordinate in light vehicle window region, further according to the non-flash vehicle window region in the 4th grab signal of window locations coordinate pair into Row coordinate transform obtains non-flash vehicle window area image.

Wherein, reflector element is removed, for capturing picture signal and non-flash vehicle window area image according to third, third is grabbed The flash of light vehicle window area image clapped in picture signal reflect, and obtains capturing image.

Specifically, third captures picture signal and the 4th candid photograph picture signal passes through image signal process (Image respectively Signal Processing, ISP), ISP mainly includes imaging sensor correct operation, interpolation operation and color correction operation. Imaging sensor correct operation mainly to the image that imaging sensor export do it is some preliminarily correct, mainly comprising black level Correct (Black Level Correction, BLC), bad point corrects (Defect Pixel Correction, DPC), green balance With four parts of digital gain.BLC is mainly used for subtracting corresponding offset, original linear data is restored, so as to subsequent Various processing.DPC is mainly used for being corrected the bad point of sensor.Bad point refers generally to show as in the picture dark or excessive Point, differ greatly with the response rate of surrounding pixel point.Green balance is mainly used for correcting the green adjacent with red component point Measure the unbalance of G1 and green component G2 two channels adjacent with blue component.Digital gain is mainly used for calculating automatic exposure The yield value obtained is multiplied with image, keeps image in appropriate brightness range.Interpolation operation is mainly used for realizing Bayer (Bayer) Image data is to the conversion of red green blue tricolor (RGB) image data, and main method is using gradient interpolation method.Color correction operation Mainly include white balance, colour correction, curve mapping and goes to pseudo- color four parts.White balance is mainly used for being increased according to the RGB of input Benefit carries out white balance processing to image data, corrects colour cast, image is made to be rendered as neither colder nor partially warm neutralc tint. Colour correction is mainly used for colour cast present in correction image and realizes realistic colour that is, by way of convolution color matrices Reduction.Gamma correct operation is mainly used for making to export image with suitable brightness, and meet people by curve mapping mode Eye subjective effect.In turn, the flash of light vehicle window area image of vehicle to be captured and non-flash is extracted using deep learning algorithm respectively Vehicle window area image.

In some embodiments, the flash of light vehicle window area image and non-flash vehicle window area image of vehicle to be captured are extracted, And the window locations coordinate of flash of light vehicle window area image and non-flash vehicle window area image is obtained by image registration, further according to vehicle Window position coordinate pair flash of light vehicle window area image and non-flash vehicle window area image are coordinately transformed.Optionally, characteristic point mentions Take algorithm multiple to extracting in quick-fried sudden strain of a muscle picture signal for Sift algorithm, Kaze algorithm, Fast algorithm and Surf algorithm etc. Fisrt feature point and after extracting multiple second feature points in non-quick-fried sudden strain of a muscle picture signal, by multiple fisrt feature points and multiple Second feature point is matched, in order to match characteristic point more effectively, usually with Feature Descriptor come Expressive Features point And surrounding information.The distance between two Feature Descriptors can reflect out its similar degree, i.e., characteristic point whether Match.For example, a fisrt feature point can be chosen from multiple fisrt feature points by detecting registration unit in this step, determine this Multiple distances between the Feature Descriptor of one characteristic point and the Feature Descriptor of multiple second feature point, then from multiple distances The corresponding second feature point of the middle the smallest Feature Descriptor of selected distance, the second feature point and the fisrt feature point are matched, Obtain a characteristic point pair.It detects registration unit and is carried out multiple fisrt feature points and multiple second feature point by the above method Pairing, obtains multiple characteristic points pair.According to obtained multiple characteristic points pair, the position coordinates of multiple characteristic point pair, root are determined According to the position coordinates, registration matrix is calculated, finally carrying out affine transformation registration can use the mathematical model of perspective transform Coordinate transform is completed, target detection coordinate is handled as follows:

Wherein, (x, y) is the coordinate after correction, (x1, y1) be without calibration coordinate,It is offline Demarcate the affine transformation matrix got.Transformed target position feeds back to registration module.

Further, referring to the flash of light vehicle window region of Fig. 7 same coordinate position obtained according to above-mentioned detection registration unit Image and non-flash vehicle window area image, carry out reflective operation, wherein flash of light vehicle window area image is not including when reflecting GradientWith the gradient of non-flash vehicle window area imageThere is identical gradient direction, however, what is actually obtained includes anti- The flash of light vehicle window area image gradient penetrated isTherefore, the gradient in order to go reflection to need to reflect

As shown in figure 8, Fig. 8 is a kind of flow diagram for going reflection provided in an embodiment of the present invention, it mainly include following Step:

S1 carries out Gaussian smoothing operation to flash of light vehicle window area image and non-flash vehicle window area image respectively, is glistened Image I1 and non-flash image I2 is extracted with reducing noise convenient for subsequent gradient.

S2 extracts I1 respectively, and the horizontal and vertical gradient of I2 obtains the knot of each pixel according to horizontal and vertical gradient Structure tensor, and calculate the eigenvalue λ of structure tensor corresponding to each pixel₁(λ₁₁>λ₁₂)、λ₂(λ₂₁>λ₂₂) and feature vector ξ₁(ξ₁₁,ξ₁₂) and ξ₂(ξ₂₁,ξ₂₂)。

Threshold value T is arranged in S3, according to λ₁₁、λ₂₁To the feature vector ξ of non-flash image I2₂It modifies.By λ₂₁Greater than T's It is parallel to the feature vector ξ of gradient direction₂₁0 is set, and removes λ₁₁、λ₂₁The feature vector ξ of respectively less than T₂Namely two images Smooth region.

S4 calculates the cross-diffusion matrix (2*2) of non-flash image I2 according to the feature vector after screening.

S5 carries out subchannel to image, traverses to each pixel, optimization processing is carried out by the way of iteration:

The both horizontally and vertically gradient (1*2) of each pixel of flashlight images I1 is passed through non-flash image I2 by S501 Cross-diffusion matrix (2*2) converted to obtain the gradient of I1 image reflective portion；

S502 obtains the image gradient after I1 image goes reflection according to the gradient of I1 image reflective portion；

The image gradient that the flashlight images I1 that S503 is obtained according to S502 is gone after reflection is rebuild by Poisson's equation solution To go reflection after image.

The image that S504 obtains reconstruction changes as new flashlight images I1, circulate operation S501~S503, setting cut-off For times N, finally obtain with non-flash image gradient almost it is consistent go reflection after flashlight images.

In the embodiment of the application, according to following formula (1) is referred to, noise reduction process is carried out to the color image, Color image after obtaining noise reduction；

Noise reduction process is carried out to gray level image itself, the gray level image after obtaining noise reduction.

Wherein, (i, j) indicates image coordinate,Indicate the gray scale of multiple pixels in the first neighborhood of pixel points Value,Indicate the gray value of updated first pixel.According in the corresponding neighborhood of current pixel point in color image The distance and difference of multiple pixels obtain the corresponding multiple weights of multiple pixelsSuch as remoter, the weight value of distance Smaller, difference is bigger, and weight value is smaller；According to current pixel point corresponding with color image in gray level image, the picture is calculated Vegetarian refreshments obtains the corresponding multiple weights of multiple pixels with the distance and difference of multiple pixels in its neighborhood

First candid photograph picture signal is that the first default exposure is generated and exported, and the second candid photograph picture signal is second default Exposure is generated and is exported, generate and export the first candid photograph picture signal and second capture picture signal after, can be to the One candid photograph picture signal and the second candid photograph picture signal are handled.In some cases, first picture signal and second is captured The purposes for capturing picture signal is possible different, so in some embodiments, the first default exposure presets exposure extremely with second A few exposure parameter can be different.As an example, when which can include but is not limited to exposure Between, one of analog gain, digital gain, aperture size or a variety of.Wherein, exposure gain includes analog gain and/or number Word gain.

In some embodiments.It is understood that carrying out the quick-fried sudden strain of a muscle light filling of near-infrared compared with the second default exposure When, the intensity for the near infrared light that imaging sensor 01 senses is stronger, the first candid photograph picture signal for correspondingly generating and exporting Including the brightness of near infrared light also can be higher.But the near infrared light of higher brightness is unfavorable for the acquisition of outer scene information. And in some embodiments, exposure gain is bigger, and the brightness for the picture signal that imaging sensor 01 exports is higher, exposure gain Smaller, the brightness for the picture signal that imaging sensor 01 exports is lower, therefore, in order to guarantee that the first candid photograph picture signal includes The brightness of near infrared light presets at least one exposure parameter of exposure not in suitable range, in the first default exposure and second With in the case where, as an example, the exposure gain of the first default exposure can be less than the exposure gain of the second default exposure. Imaging sensor 01 generation and the first candid photograph figure for exporting in this way, when the first light compensating apparatus 021 carries out quick-fried the sudden strains of a muscle light filling of near-infrared It, will not be excessively high because of the quick-fried sudden strain of a muscle light filling of the first light compensating apparatus 021 progress near-infrared as the brightness for the near infrared light that signal includes.

In further embodiments, the time for exposure is longer, and the brightness that the picture signal that imaging sensor 01 obtains includes is got over Height, and motion smear of the object of the movement in outer scene in picture signal is longer；Time for exposure is shorter, image sensing The brightness that the picture signal that device 01 obtains includes is lower, and movement of the object of the movement in outer scene in picture signal It trails shorter.Therefore, in order to guarantee the brightness of near infrared light that the first candid photograph picture signal includes in suitable range, and it is outer The motion smear that the object of movement in portion's scene is captured in picture signal first is shorter.It is pre- in the first default exposure and second If in the case that at least one exposure parameter of exposure is different, as an example, time for exposure of the first default exposure can be with Less than the time for exposure of the second default exposure.In this way, image passes in the first light compensating apparatus 021 progress near-infrared quick-fried sudden strain of a muscle light filling The brightness for the near infrared light that the generation of sensor 01 and the first candid photograph picture signal exported include, will not be because of the first light compensating apparatus 021 Carry out the quick-fried sudden strain of a muscle light filling of near-infrared and it is excessively high.And the shorter time for exposure captures the object of the movement in outer scene first The motion smear occurred in picture signal is shorter, to be conducive to the identification to Moving Objects.Illustratively, the first default exposure Time for exposure be 40 milliseconds, the time for exposure of the second default exposure is 60 milliseconds etc..

It is worth noting that, in some embodiments, when the exposure gain of the first default exposure is less than the second default exposure Exposure gain when, the time for exposure of the first default exposure not only can be less than the time for exposure of the second default exposure, can be with Equal to the time for exposure of the second default exposure.Similarly, when exposure of the time for exposure of the first default exposure less than the second default exposure When between the light time, the exposure gain of the first default exposure can also be equal to second less than the exposure gain of the second default exposure The exposure gain of default exposure.

In further embodiments, the purposes of the first candid photograph picture signal and the second candid photograph picture signal can be identical, example When being all used for intellectual analysis such as the first candid photograph picture signal and the second candid photograph picture signal, in order to make to carry out the people of intellectual analysis Face or target can have same clarity during exercise, at least one exposure of the first default exposure and the second default exposure is joined Number can be identical.As an example, the time for exposure of the first default exposure can be equal to the time for exposure of the second default exposure, If the time for exposure of the first default exposure is different with the time for exposure of the second default exposure, it may appear that the time for exposure longer one There are motion smears for road picture signal, cause the clarity of two-way picture signal different.Similarly, as another example, first The exposure gain of default exposure can be equal to the exposure gain of the second default exposure.

In some embodiments, in sudden strain of a muscle light filling quick-fried by light aid progress visible light, the default exposure of third and the 4th is in advance If at least one exposure parameter of exposure is identical, as an example, it is default that the exposure gain of the default exposure of third is equal to the 4th The exposure gain of exposure.

It is worth noting that, in some embodiments, being equal to the second default exposure when the time for exposure of the first default exposure Time for exposure when, the exposure gain of the first default exposure can also be equal to less than the exposure gain of the second default exposure The exposure gain of second default exposure.Similarly, when the exposure that the exposure gain of the first default exposure is equal to the second default exposure increases When beneficial, the time for exposure of the first default exposure it is default can also to be equal to second less than the time for exposure of the second default exposure The time for exposure of exposure.

Referring to fig. 2, imaging sensor 01 includes: photosensitive unit 011 and storage unit 012；

Photosensitive unit 011 is connect with storage unit 012；Storage unit 011 is for storing photosensitive unit 011 by exposing twice The the first candid photograph picture signal and second that light generates capture picture signal, and/or, storage photosensitive unit 011 passes through double exposure The third of generation captures picture signal and the 4th and captures picture signal.It is photosensitive in a kind of concrete implementation mode in conjunction with Fig. 9 Unit 011 is mountable in storage unit 012, and circuit layer is connected.

In some embodiments, referring to fig. 2, image collecting device further include: synchronous control unit, synchronous control unit point It is not connect with light aid 02 and imaging sensor 01, synchronous control unit is used to send grab signal to imaging sensor and to benefit Light device sends light filling signal, exposes imaging sensor 01, and makes Partial exposure of the light aid 02 at least in the first default exposure Infrared light filling is carried out in period, alternatively, synchronous control unit is used to send grab signal to imaging sensor and to light aid Light filling signal is sent, imaging sensor 01 is exposed, and makes Partial exposure time of the light aid 02 at least in the default exposure of third The quick-fried sudden strain of a muscle light filling of visible light is carried out in section.

Wherein, grab signal and light filling signal can be synchronous control unit generation, synchronize and are sent to imaging sensor And light aid, optionally, grab signal and light filling signal can be the same signal.

Referring to fig. 2, filtering assembly 03 includes the first optical filter 031, and the first optical filter 031 makes light and the portion of visible light wave range Near infrared light is divided to pass through, wherein the first light compensating apparatus 021 carries out passing through the close red of the first optical filter 031 when near infrared light light filling The intensity of outer light is higher than the first light compensating apparatus 021 and does not carry out when near-infrared is quick-fried to dodge light filling through the near-infrared of the first optical filter 031 The intensity of light.It can be part near infrared light wave band by the near infrared light wave band of first optical filter 031.

In the embodiment of the present application, referring to Fig. 1, image collecting device can also include camera lens 04, at this point, filtering assembly 03 Can be between camera lens 04 and imaging sensor 01, and imaging sensor 01 is located at the light emission side of filtering assembly 03.Alternatively, mirror First 04 between filtering assembly 03 and imaging sensor 01, and imaging sensor 01 is located at the light emission side of camera lens 04.As one Kind example, the first optical filter 031 can be light filter film, in this way, when filtering assembly 03 is located at camera lens 04 and imaging sensor 01 Between when, the first optical filter 031 can be attached to the surface of the light emission side of camera lens 04, alternatively, being located at filtering assembly 03 when camera lens 04 When between imaging sensor 01, the first optical filter 031 can be attached to the surface of the incident side of camera lens 04.

It should be noted is that light aid 02 can be located in image collecting device, image collector can also be located at The outside set.It that is to say, light aid 02 can be a part of image collecting device, or independently of image collecting device A device.When light aid 02 is located at the outside of image collecting device, light aid 02 can be carried out with image collecting device Communication connection, thereby may be ensured that the exposure time series of the imaging sensor 01 in image collecting device and light aid 02 includes the There are certain relationships for the quick-fried sudden strain of a muscle light filling timing of the near-infrared of one light compensating apparatus 021, such as at least expose in the part of the first default exposure The quick-fried sudden strain of a muscle light filling of near-infrared is carried out in the light period, is mended in the exposure period of the second default exposure without the quick-fried sudden strain of a muscle of near-infrared Light.

It can guarantee the exposure time series of the imaging sensor 01 in image collecting device and light aid 02 includes first mends There are certain relationships for the quick-fried sudden strain of a muscle light filling timing of the near-infrared of electro-optical device 021, such as at least in the Partial exposure of the first default exposure Between the quick-fried sudden strain of a muscle light filling of near-infrared is carried out in section, without the quick-fried sudden strain of a muscle light filling of near-infrared in the exposure period of the second default exposure.

In addition, the first light compensating apparatus 021 is the device that can issue near infrared light, such as the quick-fried sudden strain of a muscle light compensating lamp of near-infrared etc., First light compensating apparatus 021 can carry out the quick-fried sudden strain of a muscle light filling of near-infrared with strobe mode, can also with the other modes of similar stroboscopic into The quick-fried sudden strain of a muscle light filling of row near-infrared, the embodiment of the present application do not limit this.In some instances, when the first light compensating apparatus 021 is with frequency When sudden strain of a muscle mode carries out near-infrared quick-fried sudden strain of a muscle light filling, can manually control the first light compensating apparatus 021 with strobe mode into The quick-fried sudden strain of a muscle light filling of row near-infrared can also control the first light compensating apparatus 021 by software program or particular device with strobe mode The quick-fried sudden strain of a muscle light filling of near-infrared is carried out, the embodiment of the present application does not limit this.Wherein, it is quick-fried to carry out near-infrared for the first light compensating apparatus 021 The period for dodging light filling can be overlapped with the exposure period of the first default exposure, can also be greater than the exposure of the first default exposure As long as the period perhaps exposure default less than first exposure period the first default exposure entire exposure period or The quick-fried sudden strain of a muscle light filling of near-infrared is carried out in the Partial exposure period, and without near-infrared in the exposure period of the second default exposure Quick-fried sudden strain of a muscle light filling.

It should be noted that without the quick-fried sudden strain of a muscle light filling of near-infrared in the exposure period of the second default exposure, for the overall situation For Exposure mode, the exposure period of the second default exposure can be start the time of exposure and terminate the time of exposure between when Between section.

It needs to illustrate on the other hand, since the first light compensating apparatus 021 is carrying out the quick-fried sudden strain of a muscle light filling of near-infrared to outer scene When, the near infrared light for being incident on body surface may be reflected by the object, hence into the first optical filter 031.And by In under normal conditions, environment light may include visible light and near infrared light, and the near infrared light in environment light is incident on object table It can be also reflected by the object when face, hence into the first optical filter 031.Therefore, pass through in the quick-fried sudden strain of a muscle light filling of progress near-infrared The near infrared light of first optical filter 031 may include that the first light compensating apparatus 021 reflect when the quick-fried sudden strain of a muscle light filling of near-infrared through object Into the near infrared light of the first optical filter 031, pass through the near-infrared of the first optical filter 031 in sudden strain of a muscle light filling quick-fried without near-infrared Light may include being reflected into the first optical filter 031 through object when the first light compensating apparatus 021 does not carry out the quick-fried sudden strain of a muscle light filling of near-infrared Near infrared light.It that is to say, the first light filling is included by the near infrared light of the first optical filter 031 in the quick-fried sudden strain of a muscle light filling of progress near-infrared Near infrared light near infrared light and environment light that device 021 issues and after object reflects after object reflects, not When carrying out the quick-fried sudden strain of a muscle light filling of near-infrared by the near infrared light of the first optical filter 031 include in environment light it is close red after object reflects Outer light.

With in image collecting device, filtering assembly 03 can be between camera lens 04 and imaging sensor 01, and image passes Sensor 01 is located at for the structure feature of the light emission side of filtering assembly 03, image acquisition device first capture picture signal and Second captures the process of picture signal are as follows: when imaging sensor 01 carries out the first default exposure, the first light compensating apparatus 021 is carried out The quick-fried sudden strain of a muscle light filling of near-infrared, by scene when the environment light in photographed scene and the first light compensating apparatus carry out near-infrared quick-fried sudden strain of a muscle light filling at this time After the near infrared light of middle object reflection is via camera lens 04, the first optical filter 031, the first default exposure is passed through by imaging sensor 01 Light generates first and captures picture signal；When imaging sensor 01 carries out the second default exposure, the first light compensating apparatus 021 without The quick-fried sudden strain of a muscle light filling of near-infrared, after the environment light in photographed scene is via camera lens 04, the first optical filter 031 at this time, by image sensing Device 01 generates second by the second default exposure and captures picture signal, can there is M the within a frame period of Image Acquisition One default exposure and the N number of second default exposure, can be there are many combined row between the first default exposure and the second default exposure Sequence, in a frame period of Image Acquisition, the value and M of M and N and the size relation of N can be arranged according to actual needs, For example, the value of M and N can be equal, it can not also be identical.

In addition, since the intensity of the near infrared light in environment light is lower than the near infrared light that the first light compensating apparatus 021 issues Intensity, therefore, the first light compensating apparatus 021 carry out when near-infrared is quick-fried to dodge light filling through the strong of the near infrared light of the first optical filter 031 Degree is higher than the first light compensating apparatus 021 and does not carry out intensity when near-infrared is quick-fried to dodge light filling by the near infrared light of the first optical filter 031.

Wherein, the first light compensating apparatus 021, which carries out the quick-fried wavelength band for dodging light filling of near-infrared, can refer to wave band model for second It encloses, the second reference wavelength band can be 700 nanometers~800 nanometers or 900 nanometers~1000 nanometers, in this way, can mitigate It is interfered caused by 850 nanometers common of nearly red light.In addition, being incident on the wavelength band of the near infrared light of the first optical filter 031 Wavelength band can be referred to for first, the first reference wavelength band is 650 nanometers~1100 nanometers.

Since in the quick-fried sudden strain of a muscle light filling of progress near-infrared, the near infrared light by the first optical filter 031 may include the first benefit Electro-optical device 021 be reflected into the near infrared light and environment light of the first optical filter 031 when near infrared light light filling through object The near infrared light after object reflects.So stronger into the intensity of the near infrared light of filtering assembly 03 at this time.But not When carrying out the quick-fried sudden strain of a muscle light filling of near-infrared, the near infrared light by the first optical filter 031 includes being reflected into filter through object in environment light The near infrared light of optical assembly 03.Due to carrying out the near infrared light of light filling without the first light compensating apparatus 021, so passing through first at this time The intensity of the near infrared light of optical filter 031 is weaker.Therefore, first for generating and exporting according to the first default exposure captures image letter The intensity of number near infrared light for including, being higher than the second candid photograph picture signal for generating and exporting according to the second default exposure includes Near infrared light intensity.

First light compensating apparatus 021 carries out the quick-fried central wavelength for dodging light filling of near-infrared and/or wavelength band can there are many choosings It selects, it, can be to first in order to make the first light compensating apparatus 021 and the first optical filter 031 have better cooperation in the embodiment of the present application Light compensating apparatus 021 carries out the quick-fried central wavelength for dodging light filling of near-infrared and is designed, and carries out to the characteristic of the first optical filter 031 Selection so that the first light compensating apparatus 021 carry out near-infrared it is quick-fried dodge light filling central wavelength be setting characteristic wavelength or It, can be with by the central wavelength and/or waveband width of the near infrared light of the first optical filter 031 when falling in setting characteristic wavelength range Reach constraint condition.It is most by the central wavelength of the near infrared light of the first optical filter 031 that the constraint condition is primarily used to constraint May be accurate and as narrow as possible by the waveband width of the near infrared light of the first optical filter 031, to avoid the occurrence of because close red Outer optical band width is wide and introduces wavelength interference.

Wherein, it can be the first light compensating apparatus 021 that the first light compensating apparatus 021, which carries out the quick-fried central wavelength for dodging light filling of near-infrared, Average value in the spectrum of the near infrared light of sending in the maximum wave-length coverage of energy, it is understood that be the first light compensating apparatus Energy is more than the wavelength of the middle position in the wave-length coverage of certain threshold value in the spectrum of 021 near infrared light issued.

Wherein, setting characteristic wavelength or setting characteristic wavelength range can preset.As an example, it first mends Electro-optical device 021, which carries out the quick-fried central wavelength for dodging light filling of near-infrared, to be any wavelength in 750 ± 10 nanometers of wave-length coverage； Alternatively, the first light compensating apparatus 021 carries out appointing in the wave-length coverage that the quick-fried central wavelength for dodging light filling of near-infrared is 780 ± 10 nanometers One wavelength；Alternatively, the first light compensating apparatus 021 carries out the wavelength model that the quick-fried central wavelength for dodging light filling of near-infrared is 940 ± 10 nanometers Enclose interior any wavelength.It that is to say, setting characteristic wavelength may range from 750 ± 10 nanometers of wave-length coverage or 780 ± 10 The wave-length coverage or 940 ± 10 nanometers of wave-length coverage of nanometer.Illustratively, it is quick-fried to carry out near-infrared for the first light compensating apparatus 021 Dodge light filling central wavelength be 940 nanometers, the first light compensating apparatus 021 carry out near-infrared it is quick-fried dodge light filling wavelength and relative intensity it Between relationship it is as shown in Figure 10.From fig. 10 it can be seen that the first light compensating apparatus 021 carries out the quick-fried wavelength band for dodging light filling of near-infrared It is 900 nanometers~1000 nanometers, wherein in 940 nanometers, the relative intensity highest of near infrared light.

Since in the quick-fried sudden strain of a muscle light filling of progress near-infrared, the near infrared light by the first optical filter 031 is largely the first benefit Electro-optical device 021 carries out the near infrared light for being reflected into the first optical filter 031 when near-infrared is quick-fried to dodge light filling through object, therefore, one In a little embodiments, above-mentioned constraint condition may include: to be mended by the central wavelength of the near infrared light of the first optical filter 031 with first The difference that electro-optical device 021 carries out between the quick-fried central wavelength for dodging light filling of near-infrared is located within the scope of wavelength fluctuation, shows as one kind Example, wavelength fluctuation may range from 0~20 nanometer.

It wherein, can be the first optical filter 031 by the quick-fried central wavelength for dodging light filling of the near-infrared of the first optical filter 031 Wavelength within the scope of near infrared band near infrared light percent of pass curve at crest location, it is understood that be the first optical filter Percent of pass is more than the wave of the middle position within the scope of the near infrared band of certain threshold value in 031 near infrared light percent of pass curve It is long.

In order to avoid introducing wavelength interference by the way that the waveband width of the near infrared light of the first optical filter 031 is wide, one In a little embodiments, above-mentioned constraint condition may include: that first band width can be less than second band width.Wherein, first wave Duan Kuandu refers to that the waveband width of the near infrared light by the first optical filter 031, second band width refer to by the first optical filter The waveband width of 031 near infrared light stopped.It should be understood that waveband width refers to wave-length coverage locating for the wavelength of light Width.It is received for example, passing through wave-length coverage locating for the wavelength of the near infrared light of the first optical filter 031 for 700 nanometers~800 Rice, then first band width, which is 800 nanometers, subtracts 700 nanometers, i.e., 100 nanometers.In other words, pass through the first optical filter 031 Near infrared light waveband width less than the near infrared light that the first optical filter 031 stops waveband width.

For example, with reference to Figure 11, Figure 11 be the first optical filter 031 can by light wavelength and percent of pass between relationship A kind of schematic diagram.The wave band for being incident on the near infrared light of the first optical filter 031 is 650 nanometers~1100 nanometers, and first filters The visible light that piece 031 can make wavelength be located at 380 nanometers~650 nanometers passes through and wavelength is located at 900 nanometers~1100 nanometers Near infrared light pass through, stop wavelength to be located at 650 nanometers~900 nanometers of near infrared light.It that is to say, first band width is 1000 nanometers subtract 900 nanometers, i.e., 100 nanometers.Second band width is 900 nanometers and subtracts 650 nanometers, in addition 1100 nanometers subtract Remove 1000 nanometers, i.e., 350 nanometers.100 nanometers less than 350 nanometers, that is, pass through the wide waveband of the near infrared light of the first optical filter 031 Spend the waveband width of the near infrared light stopped less than the first optical filter 031.Relation above curve is only a kind of example, for difference Optical filter, can be different by the wavelength band of the nearly red spectral band of optical filter, by the close red of filter blocks The wavelength band of outer light can also be different.

In order to avoid passing through the wave of the near infrared light of the first optical filter 031 within the non-near-infrared quick-fried period for dodging light filling Duan Kuandu is wide and introduces wavelength interference, and in some embodiments, above-mentioned constraint condition may include: by the first optical filter The half-band width of 031 near infrared light is less than or equal to 50 nanometers.Wherein, half-band width refers to the near infrared light that percent of pass is greater than 50% Waveband width.

In order to avoid introducing wavelength interference by the way that the waveband width of the near infrared light of the first optical filter 031 is wide, one In a little embodiments, above-mentioned constraint condition may include: that third waveband width can be less than with reference to waveband width.Wherein, third wave Duan Kuandu refers to that percent of pass as an example can with reference to waveband width greater than the waveband width of the near infrared light of setting ratio Think any waveband width in 50 nanometers~100 nanometers of wavelength band.Setting ratio can be times in 30%~50% One ratio, certain setting ratio can also be set as other ratios according to use demand, and the embodiment of the present application does not limit this. In other words, the waveband width that percent of pass is greater than the near infrared light of setting ratio, which can be less than, refers to waveband width.

For example, with reference to Figure 11, the wave band for being incident on the near infrared light of the first optical filter 031 is 650 nanometers~1100 nanometers, Setting ratio is 30%, is 100 nanometers with reference to waveband width.It can be seen from figure 11 that close red at 650 nanometers~1100 nanometers In the wave band of outer light, the waveband width of near infrared light of the percent of pass greater than 30% is significantly less than 100 nanometers.

Since the first light compensating apparatus 021 at least provides the quick-fried sudden strain of a muscle of near-infrared within the Partial exposure period of the first default exposure Light filling does not provide near-infrared quick-fried sudden strain of a muscle light filling in the entire exposure period of the second default exposure, and the first default exposure and the Two default exposures are that is to say, the first light compensating apparatus 021 is in the portion of imaging sensor 01 in the double exposure of imaging sensor 01 Divide and near-infrared quick-fried sudden strain of a muscle light filling is provided in the exposure period of exposure, in the exposure that the another part of imaging sensor 01 exposes Between do not provide near-infrared quick-fried sudden strain of a muscle light filling in section.

Illustratively, since human eye is easy to carry out the first light compensating apparatus 021 into the color and traffic lights of near infrared light light filling In the color of red light obscure, so, referring to fig. 2, light aid 02 can also include third light compensating apparatus 023, third light filling dress 023 is set for carrying out visible light light filling.In this way, if third light compensating apparatus 023 is at least in the Partial exposure of the first default exposure Time provides visible light light filling, that is to say, at least there are the quick-fried sudden strains of a muscle of near-infrared within the Partial exposure period of the first default exposure Light filling and visible light light filling, the blend color of both light can be different from the color of the red light in traffic lights, so as to avoid Human eye obscures the color that light aid 02 carries out the red light in the quick-fried color and traffic lights for dodging light filling of near-infrared.In addition, if Three light compensating apparatus 023 provide visible light light filling in the exposure period of the second default exposure, due to the exposure of the second default exposure The intensity of visible light is not especially high in the light period, therefore, carries out visible light in the exposure period of the second default exposure When light filling, the brightness of the visible light in the second candid photograph picture signal can also be improved, and then guarantee the quality of Image Acquisition.

In some embodiments, third light compensating apparatus 023 can be used for carrying out visible light light filling in a manner of being always on；Alternatively, Third light compensating apparatus 023 can be used for carrying out visible light light filling with strobe mode, wherein at least in the part of the first default exposure Visible light light filling is carried out in exposure period, without visible light light filling in the entire exposure period of the second default exposure； Alternatively, third light compensating apparatus 023 can be used for carrying out visible light light filling with strobe mode, wherein in the portion of the first default exposure Divide and carry out visible light light filling in exposure period, at least there are visible light benefits within the Partial exposure period of the second default exposure Light.It, not only can be to avoid human eye by the first light compensating apparatus when third light compensating apparatus 023, which is always on mode, carries out visible light light filling The color of red light in the 021 quick-fried color and traffic lights for dodging light filling of progress near-infrared is obscured, and the second candid photograph image can also be improved The brightness of visible light in signal, and then guarantee the quality of Image Acquisition.When third light compensating apparatus 023 can with strobe mode progress When light-exposed light filling, the first light compensating apparatus 021 can be carried out in the quick-fried color and traffic lights for dodging light filling of near-infrared to avoid human eye The color of red light is obscured, alternatively, the brightness of the visible light in the second candid photograph picture signal can be improved, and then guarantees Image Acquisition Quality, but also the light filling number of third light compensating apparatus 023 can be reduced, to extend the use of third light compensating apparatus 023 Service life.

Preferably, end exposure moment to imaging sensor when imaging sensor 01 carries out the first default exposure carries out the The interval time of exposure start time when two default exposures is less than 40ms, similar, and it is default that imaging sensor 01 carries out third It is small that end exposure moment to imaging sensor when exposure carries out the interval time for exposing start time that the 4th presets when exposing In 40ms.

Wherein, imaging sensor 01 may include multiple photosensitive channels, and each photosensitive channel can be used for incuding at least one The light of kind visible light wave range, and the light of induction near infrared band.It that is to say, each photosensitive channel can incude at least one can The light of light-exposed wave band, and the light of near infrared band can be incuded, in this manner it is ensured that first captures picture signal and the second candid photograph figure There is complete resolution ratio in picture signal, not missing pixel values.Illustratively, multiple photosensitive channel can be used for incuding at least The light of two different visible light wave ranges.

In some embodiments, multiple photosensitive channel may include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, Y At least two in photosensitive channel, the photosensitive channel W and the photosensitive channel C.Wherein, the photosensitive channel R is for incuding red spectral band and close The light of infrared band, the photosensitive channel G are used to incude the light of green light band and near infrared band, and the photosensitive channel B is for incuding blue light The light of wave band and near infrared band, the photosensitive channel Y are used to incude the light of yellow band and near infrared band.Due in some implementations In example, the photosensitive channel for incuding full wave light can be indicated with W, in further embodiments, can be indicated with C For incuding the photosensitive channel of full wave light, so when multiple photosensitive channel includes for incuding the photosensitive of full wave light When channel, this photosensitive channel can be the photosensitive channel W, be also possible to the photosensitive channel C.It that is to say, it in practical applications, can be with The photosensitive channel for incuding full wave light is selected according to use demand.Illustratively, imaging sensor 01 can be RGB Sensor, RGBW sensor or RCCB sensor or RYYB sensor.Wherein, the photosensitive channel R in RGB sensor, G are photosensitive The distribution mode in channel and the photosensitive channel B may refer to Figure 12, and the photosensitive channel R, the photosensitive channel G in RGBW sensor, B are photosensitive The distribution mode in channel and the photosensitive channel W may refer to Figure 13, the photosensitive channel R, the photosensitive channel C and B sense in RCCB sensor Optical channel distribution mode may refer to Figure 14, the photosensitive channel R, the photosensitive channel Y and the photosensitive channel distribution side B in RYYB sensor Formula may refer to Figure 15.

In further embodiments, some photosensitive channels can also only incude the light of near infrared band, visible without incuding The light of optical band, in this manner it is ensured that first captures and have complete resolution ratio, not missing pixel values in picture signal.As A kind of example, multiple photosensitive channel may include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, in the photosensitive channel IR extremely It is two kinds few.Wherein, the photosensitive channel R is used to incude the light of red spectral band and near infrared band, and the photosensitive channel G is for incuding green light wave The light of section and near infrared band, the photosensitive channel B are used to incude the light of blue wave band and near infrared band, and the photosensitive channel IR is for feeling Answer the light of near infrared band.

Illustratively, imaging sensor 01 can be RGBIR sensor, wherein each IR in RGBIR sensor is photosensitive logical Road can incude the light of near infrared band, the light without incuding visible light wave range.

Wherein, when imaging sensor 01 is RGB sensor, compared to other imaging sensors, such as RGBIR sensor RGB information Deng the acquisition of, RGB sensor is more complete, some photosensitive channel of RGBIR sensor does not acquire visible light, So the color detail of the image of RGB sensor acquisition is more acurrate.

It is worth noting that, multiple photosensitive channels that imaging sensor 01 includes can correspond to a plurality of induction curve.Example Property, referring to Figure 16, R-curve representative image sensor 01 in Figure 16 represents the induction curve of the light of red spectral band, G curve Induction curve of the imaging sensor 01 to the light of green light band, sense of the B curve representative image sensor 01 to the light of blue wave band Curve is answered, W (or C) curve representative image sensor 01 incudes the induction curve of full wave light, NIR (Near Infrared, near infrared light) curve representative image sensor 01 incude near infrared band light induction curve.

As an example, imaging sensor 01 can refer to every a line using global Exposure mode, global Exposure mode The exposure start time of effective image is all the same, and the end exposure moment of every a line effective image is all the same.In other words, entirely Office's Exposure mode is all row effective images while being exposed and at the same time terminating a kind of Exposure mode of exposure.

In some embodiments, when imaging sensor 01 is double exposed using global Exposure mode, for any The exposure period of the quick-fried sudden strain of a muscle light filling of near-infrared, the near-infrared quick-fried period for dodging light filling and the second default exposure, which is not present, to be handed over Collection, the near-infrared quick-fried period for dodging light filling is the subset of the exposure period of the first default exposure, alternatively, the quick-fried sudden strain of a muscle light filling of near-infrared The exposure period of period and the first default exposure there are the exposure period of intersection or the first default exposure be close red The outer quick-fried subset for dodging light filling.In this way, can be realized at least within the Partial exposure period of the first default exposure, there are near-infrareds The quick-fried sudden strain of a muscle light filling of near-infrared is not present in the entire exposure period of the second default exposure, thus will not be to second in quick-fried sudden strain of a muscle light filling Default exposure impacts.

For example, for any quick-fried sudden strain of a muscle light filling of a near-infrared, the near-infrared quick-fried period for dodging light filling and the second default exposure Exposure period intersection is not present, the near-infrared quick-fried period for dodging light filling is the son of the exposure period of the first default exposure Collection.For any quick-fried sudden strain of a muscle light filling of a near-infrared, the time for exposure of the near-infrared quick-fried period for dodging light filling and the second default exposure Section is not present intersection, and there are intersections for the exposure period of the near-infrared quick-fried period for dodging light filling and the first default exposure.For appointing It anticipates the quick-fried sudden strain of a muscle light filling of a near-infrared, there is no hand over for the exposure period of the near-infrared quick-fried period for dodging light filling and the second default exposure Collection, the exposure period of the first default exposure are the quick-fried subsets for dodging light filling of near-infrared.Above content is only a kind of example, and first is pre- If the sequence of exposure and the second default exposure can be not limited to these examples.

When the visual intensity in environment light is weaker, such as night, the infrared quick-fried of the first light compensating apparatus 021 can be passed through Light filling is dodged, imaging sensor 01 is generated and exports the first candid photograph picture signal comprising near-infrared luminance information, and comprising Visible light luminance information second capture picture signal, and due to first capture picture signal and second capture picture signal by The same imaging sensor 01 obtains, so the viewpoint phase that the first viewpoint for capturing picture signal captures picture signal with second Together, so that capturing picture signal and second by first captures the information of the available complete outer scene of picture signal.In When visual intensity is stronger, such as daytime, daytime, the accounting of near infrared light was stronger, and the color rendition degree of the image of acquisition is not It is good, imaging sensor 01 can be made to generate and the third exported is captured by the quick-fried sudden strain of a muscle light filling of visible light of the second light compensating apparatus 022 Picture signal and the 4th captures picture signal, and captures picture signal and the 4th according to third by image processing unit and capture figure As signal obtains the candid photograph image comprising visible light luminance information, accordingly even when on daytime, can also collect color rendition degree ratio Preferable image, can be efficient, easy no matter daytime or night in other words no matter also can reach the power of visual intensity Ground obtains the realistic colour information of outer scene, improves the using flexible of image collecting device, and can also be easily It is carried out with other image collecting devices compatible.

A kind of image-pickup method is also provided in the embodiment of the present application, is provided based on embodiment shown in above-mentioned Fig. 1-16 Image collecting device is illustrated image-pickup method.Referring to Figure 17 this method comprises:

Step 240 passes through light aid in overall situation exposure, carries out quick-fried sudden strain of a muscle light filling according to light filling signal.

Step 241 passes through visible light and part near infrared light by the first optical filter that filtering assembly includes；Pass through filter The second optical filter that optical assembly includes passes through visible light, stops near infrared light.

Step 242 passes through imaging sensor according to grab signal, is double exposed, is obtained using global Exposure mode Two candid photograph picture signals.

Step 243, image processing unit obtain capturing image according to two candid photograph picture signals.

Illustratively, the filtering assembly further includes switching part, the method also includes:

First optical filter or second optical filter are switched to described image sensor by the switching part Incident side.

Illustratively, after first optical filter is switched to the incident side of described image sensor:

By described image sensor according to the grab signal, double exposed using global Exposure mode, it is described Double exposure includes the first default exposure and the second default exposure, is generated by the double exposure and exports the first candid photograph image Signal and second captures picture signal, wherein the first candid photograph picture signal is the image generated according to the first default exposure Signal, the second candid photograph picture signal are the picture signal generated according to the second default exposure, the described first default exposure institute Have that row corresponding exposure start time is identical and all rows corresponding end exposure moment is identical, the described second default exposure is owned Row corresponding exposure start time is identical and all rows corresponding end exposure moment is identical；

By first light compensating apparatus according to the light filling signal, the quick-fried sudden strain of a muscle light filling of near-infrared is carried out, wherein at least in institute It states in the Partial exposure period of the first default exposure and carries out the quick-fried sudden strain of a muscle light filling of near-infrared, in the exposure of the described second default exposure Between in section without the quick-fried sudden strain of a muscle light filling of near-infrared；

Picture signal and described second is captured according to described first by described image processing unit and captures picture signal, is melted Conjunction obtains the candid photograph image.

Illustratively, further includes:

After second optical filter is switched to the incident side of described image sensor:

By described image sensor according to the grab signal, double exposed using global Exposure mode, it is described Double exposure includes the default exposure of third and the 4th default exposure, is generated by the double exposure and exports third and captures image Signal and the 4th captures picture signal, wherein it is the image generated according to the default exposure of third that the third, which captures picture signal, Signal, the 4th candid photograph picture signal are the picture signal generated according to the 4th default exposure, the default exposure institute of the third Have that row corresponding exposure start time is identical and all rows corresponding end exposure moment is identical, the described 4th default exposure is owned Row corresponding exposure start time is identical and all rows corresponding end exposure moment is identical；

By second light compensating apparatus according to the light filling signal, the quick-fried sudden strain of a muscle light filling of visible light is carried out, wherein at least in institute It states in the Partial exposure period of the default exposure of third and carries out the quick-fried sudden strain of a muscle light filling of visible light, in the exposure of the described 4th default exposure Between in section without the quick-fried sudden strain of a muscle light filling of visible light；

Picture signal and the described 4th is captured according to the third by described image processing unit and captures picture signal, is led to It crosses that reflection position reflect and obtains the candid photograph image.

Illustratively, described image processing unit includes image pre-processing unit and image fusion unit, the method packet It includes:

The first candid photograph picture signal is generated into gray level image after pretreatment by described image pretreatment unit, it will The second candid photograph picture signal generates color image after pretreatment；

The color image and the gray level image are subjected to fusion treatment by described image integrated unit, captured Image.

Illustratively, the described first default exposure is different from least one exposure parameter of the described second default exposure, institute Stating at least one exposure parameter is one of time for exposure, exposure gain, aperture size or a variety of, and the exposure gain includes Analog gain, and/or, digital gain.

Illustratively, described image processing unit further includes detection registration unit and removes reflector element, the method packet It includes:

The detection registration unit captures picture signal and the described 4th according to the third and captures picture signal, obtains the Four capture the non-flash vehicle window area image in picture signal；

It is described that reflector element is gone to capture picture signal and the non-flash vehicle window area image according to the third, to described The flash of light vehicle window area image that third is captured in picture signal reflect, and obtains capturing image.

Illustratively, the default exposure of the third is identical with the exposure parameter of the described 4th default exposure, the exposure ginseng Number includes one of time for exposure, exposure gain, aperture size or a variety of, and the exposure gain includes analog gain, and/ Or, digital gain.

Illustratively, the grab signal and the light filling signal are the same signals.

Illustratively, described image sensor includes: photosensitive unit and storage unit, which comprises

The first candid photograph picture signal and second that the photosensitive unit is generated by double exposure is stored by storage unit Picture signal is captured, and/or, it stores the third candid photograph picture signal and the 4th that the photosensitive unit is generated by double exposure and grabs Clap picture signal.

Illustratively, described device further include: synchronous control unit, by synchronous control unit to described image sensor It sends the grab signal and sends the light filling signal to the light aid, expose described image sensor, and make described Light aid at least carries out the quick-fried sudden strain of a muscle light filling of near-infrared within the Partial exposure period of the first default exposure；

Alternatively,

The grab signal is sent to described image sensor by the synchronous control unit and is sent out to the light aid The light filling signal is sent, described image sensor is exposed, and exposes the light aid at least in the part of the default exposure of third The quick-fried sudden strain of a muscle light filling of visible light is carried out in the light period.

The first candid photograph picture signal is generated gray level image by image pre-processing unit after pretreatment, by described second It captures picture signal and generates color image gray scale after pretreatment, comprising:

Joint noise reduction unit is filtered the first candid photograph picture signal and the second candid photograph picture signal, First after obtaining noise reduction, which captures picture signal and second, captures picture signal；

First pretreatment unit captures picture signal to first after noise reduction and carries out the first pretreatment operation, is pre-processed Gray level image afterwards；

Second pretreatment unit captures picture signal to second after noise reduction and carries out the second pretreatment operation, obtains cromogram Picture.

Illustratively, the color image and the gray level image are carried out fusion treatment by image fusion unit, obtain coloured silk Color blending image, comprising:

The Color Picking unit extracts the chrominance signal of the color image；

The brightness extraction unit extracts the luminance signal of the color image；

The fusion treatment unit carries out high-pass filtering to the gray level image, obtains filtered high-frequency signal；To institute The luminance signal for stating color image carries out low-pass filtering, obtains filtered low frequency signal；To the high-frequency signal, the low frequency Signal and the chrominance signal carry out fusion treatment, obtain the color fusion image.

Illustratively, the fusion treatment unit to the high-frequency signal, the low frequency signal and the chrominance signal into Row fusion treatment obtains the color fusion image:

Illustratively, the joint noise reduction unit is filtered the color image and the gray level image, obtains Color image and gray level image after to noise reduction, comprising:

According to the correlation between the color image and the gray level image, to the color image and the grayscale image As carrying out Federated filter processing, color image and gray level image after obtaining the noise reduction respectively.

Illustratively, the joint noise reduction unit captures picture signal and described second to described first and captures picture signal It is filtered, first after obtaining noise reduction captures picture signal and second and capture picture signal, comprising:

The correlation between picture signal is captured according to the first candid photograph picture signal and second, is captured to described first Picture signal and the second candid photograph picture signal carry out Federated filter processing respectively, and first after obtaining the noise reduction captures image letter Number and second capture picture signal.

Optionally, the wavelength band for being incident on the near infrared light of the first optical filter is first with reference to wavelength band, the first ginseng Examining wavelength band is 650 nanometers~1100 nanometers.

Optionally, the first light compensating apparatus carries out the wavelength model that the quick-fried central wavelength for dodging light filling of near-infrared is 750 ± 10 nanometers Enclose interior any wavelength；Or

First light compensating apparatus carries out appointing in the wave-length coverage that the quick-fried central wavelength for dodging light filling of near-infrared is 780 ± 10 nanometers One wavelength；Or

First light compensating apparatus carries out appointing in the wave-length coverage that the quick-fried central wavelength for dodging light filling of near-infrared is 940 ± 10 nanometers One wavelength.

Optionally, constraint condition includes:

It is less than or equal to 50 nanometers by the half-band width of the near infrared light of the first optical filter.

Optionally, constraint condition includes:

First band width is less than second band width；Wherein, first band width refers to through the close of the first optical filter The waveband width of infrared light, second band width refer to by the waveband width of the near infrared light of the first filter blocks.

Optionally, constraint condition are as follows:

Third waveband width, which is less than, refers to waveband width, and third waveband width refers to that percent of pass is greater than the close red of setting ratio Any waveband width in wavelength band that the waveband width of outer light is 50 nanometers~150 nanometers with reference to waveband width.

Optionally, any proportion in proportional region that setting ratio is 30%~50%.

Optionally, imaging sensor includes multiple photosensitive channels, and each photosensitive channel is for incuding at least one visible light The light of wave band, and the light of induction near infrared band.

Optionally, multiple photosensitive channels are used to incude the light of at least two different visible light wave ranges.

Optionally, multiple photosensitive channels include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, the photosensitive channel Y, W photosensitive At least two in channel and the photosensitive channel C；

Wherein, the photosensitive channel R is used to incude the light of red spectral band and near infrared band, and the photosensitive channel G is for incuding green light The light of wave band and near infrared band, the photosensitive channel B are used to incude the light of blue wave band and near infrared band, and the photosensitive channel Y is used for Incude the light of yellow band and near infrared band, for incuding full wave light, the photosensitive channel C is complete for incuding in the photosensitive channel W The light of wave band.

Optionally, imaging sensor is RGB sensor, RGBW sensor or RCCB sensor or RYYB sensor.

Optionally, third light compensating apparatus in a manner of being always on for carrying out visible light light filling；Or

Third light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the described first default exposure The Partial exposure period in carry out visible light light filling, without visible light in the entire exposure period of the second default exposure Light filling；Or

Third light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the whole of the first default exposure Without visible light light filling in a exposure period, visible light benefit is carried out within the Partial exposure period of the second default exposure Light.

Optionally, imaging sensor is double exposed using global Exposure mode, for the quick-fried sudden strain of a muscle of any near-infrared Intersection is not present in the exposure period of light filling, the near-infrared quick-fried period for dodging light filling and the second default exposure, and the quick-fried sudden strain of a muscle of near-infrared is mended The period of light is the subset of the exposure period of the first default exposure, alternatively, the near-infrared quick-fried period and first for dodging light filling The exposure period of default exposure is the quick-fried son for dodging light filling of near-infrared there are the exposure period of intersection or the first default exposure Collection.

It should be noted that the embodiment as shown in the present embodiment and above-mentioned 1 to 17 can use same invention structure Think, the explanation of above-mentioned Fig. 1 related content into 17 illustrated embodiments can be referred to accordingly, with respect to the explanation of the present embodiment content, Details are not described herein again.

Those skilled in the art will readily occur to its of the disclosure after considering specification and practicing application disclosed herein Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claims are pointed out.

It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by appended claims.

Claims

1. a kind of image collecting device characterized by comprising

Filtering assembly, imaging sensor, light aid, image processing unit, described image sensor are located at the filtering assembly Light emission side；

Described image sensor, for being double exposed using global Exposure mode, obtaining two candid photographs according to grab signal Picture signal；

The filtering assembly includes the first optical filter and the second optical filter；First optical filter makes visible light and part near-infrared Light passes through；Second optical filter passes through visible light, stops near infrared light；

2. the apparatus according to claim 1, which is characterized in that the filtering assembly further includes switching part, and described first Optical filter and second optical filter are connect with the switching part；

The switching part, for first optical filter or second optical filter to be switched to entering for described image sensor Light side.

3. device according to claim 1 or 2, which is characterized in that be switched to described image in first optical filter and pass After the incident side of sensor:

Described image sensor is double exposed using global Exposure mode for according to the grab signal, it is described twice Exposure includes the first default exposure and the second default exposure, is generated by the double exposure and exports the first candid photograph picture signal Picture signal is captured with second, wherein the first candid photograph picture signal is the picture signal generated according to the first default exposure, The second candid photograph picture signal is the picture signal generated according to the second default exposure, described first default all rows pair of exposure The exposure start time answered is identical and all rows corresponding end exposure moment is identical, and described second default all rows of exposure are corresponding Exposure start time it is identical and all rows corresponding end exposure moment is identical；

The light aid includes the first light compensating apparatus, and first light compensating apparatus is used to be carried out close red according to the light filling signal Outer quick-fried sudden strain of a muscle light filling, wherein at least carry out the quick-fried sudden strain of a muscle light filling of near-infrared, In within the Partial exposure period of the described first default exposure Without the quick-fried sudden strain of a muscle light filling of near-infrared in the exposure period of described second default exposure；

Described image processing unit captures picture signal, fusion for capturing picture signal and described second according to described first Obtain the candid photograph image.

4. device according to claim 1 or 2, which is characterized in that be switched to described image in second optical filter and pass After the incident side of sensor:

Described image sensor is double exposed using global Exposure mode for according to the grab signal, it is described twice Exposure includes the default exposure of third and the 4th default exposure, is generated by the double exposure and exports third and captures picture signal Picture signal is captured with the 4th, wherein it is the picture signal generated according to the default exposure of third that the third, which captures picture signal, The 4th candid photograph picture signal is the picture signal generated according to the 4th default exposure, the default all rows pair of exposure of the third The exposure start time answered is identical and all rows corresponding end exposure moment is identical, and the described 4th default all rows of exposure are corresponding Exposure start time it is identical and all rows corresponding end exposure moment is identical；

The light aid includes the second light compensating apparatus, and second light compensating apparatus is used to be carried out visible according to the light filling signal The quick-fried sudden strain of a muscle light filling of light, wherein at least carry out the quick-fried sudden strain of a muscle light filling of visible light, In within the Partial exposure period of the default exposure of the third Without the quick-fried sudden strain of a muscle light filling of visible light in the exposure period of described 4th default exposure；

Described image processing unit is captured picture signal for capturing picture signal and the described 4th according to the third, is passed through Reflection is carried out to reflection position and obtains the candid photograph image.

5. device according to claim 3, which is characterized in that described image processing unit, comprising:

Image pre-processing unit, image fusion unit；

Wherein, described image pretreatment unit, for the first candid photograph picture signal to be generated gray level image after pretreatment, The second candid photograph picture signal is generated into color image after pretreatment；

Described image integrated unit obtains candid photograph figure for the color image and the gray level image to be carried out fusion treatment Picture.

6. device according to claim 3, which is characterized in that

Described first default exposure is different from least one exposure parameter of the described second default exposure, at least one described exposure Parameter is one of time for exposure, exposure gain, aperture size or a variety of, and the exposure gain includes analog gain, and/ Or, digital gain.

7. device according to claim 4, which is characterized in that described image processing unit, further includes:

It detects registration unit and removes reflector element；

Wherein, the detection registration unit captures picture signal for capturing picture signal and the described 4th according to the third, Obtain the non-flash vehicle window area image in the 4th candid photograph picture signal；

It is described to remove reflector element, for capturing picture signal and the non-flash vehicle window area image according to the third, to institute It states the flash of light vehicle window area image that third is captured in picture signal reflect, obtains capturing image.

8. device according to claim 4, which is characterized in that

The default exposure of the third is identical with the exposure parameter of the described 4th default exposure, when the exposure parameter includes exposure Between, one of exposure gain, aperture size or a variety of, the exposure gain includes analog gain, and/or, digital gain.

9. device according to any one of claims 1 to 8, which is characterized in that the grab signal and the light filling signal It is the same signal.

10. device according to any one of claims 1 to 8, which is characterized in that described image sensor includes: photosensitive list Member and storage unit；

The photosensitive unit is connect with the storage unit；The storage unit is for storing the photosensitive unit by exposing twice The the first candid photograph picture signal and second that light generates capture picture signal, and/or, it stores the photosensitive unit and passes through double exposure The third of generation captures picture signal and the 4th and captures picture signal.

11. device according to any one of claims 1 to 8, which is characterized in that described device further include:

Synchronous control unit, the synchronous control unit are connect with the light aid and described image sensor respectively；

The synchronous control unit is used to send the grab signal to described image sensor and sends institute to the light aid Light filling signal is stated, described image sensor is exposed, and makes the light aid at least in the Partial exposure of the first default exposure Between the quick-fried sudden strain of a muscle light filling of near-infrared is carried out in section；

Alternatively,

The synchronous control unit is used to send the grab signal to described image sensor and sends institute to the light aid Light filling signal is stated, described image sensor is exposed, and makes the light aid at least in the Partial exposure of the default exposure of third Between the quick-fried sudden strain of a muscle light filling of visible light is carried out in section.

12. device according to any one of claims 1 to 8, which is characterized in that described image sensor carries out described first End exposure moment to described image sensor when default exposure carries out exposure start time when the described second default exposure Interval time be less than 40ms.

13. device according to any one of claims 1 to 8, which is characterized in that first light compensating apparatus carries out near-infrared It is quick-fried first light compensating apparatus to be higher than by the intensity of the near infrared light of the filtering assembly when dodging light filling not carry out near-infrared quick-fried Pass through the near infrared light intensity of the filtering assembly when sudden strain of a muscle light filling.

14. device according to any one of claims 1 to 8, which is characterized in that the light aid further includes third light filling dress It sets, the third light compensating apparatus is for carrying out the quick-fried sudden strain of a muscle light filling of visible light.

15. device according to claim 14, which is characterized in that the third light compensating apparatus in a manner of being always on for being carried out The quick-fried sudden strain of a muscle light filling of visible light；

Or

The third light compensating apparatus is used to carry out the quick-fried sudden strain of a muscle light filling of visible light with strobe mode, wherein at least default described first The quick-fried sudden strain of a muscle light filling of visible light is carried out in the Partial exposure period of exposure, in the entire exposure period of the described second default exposure Without the quick-fried sudden strain of a muscle light filling of visible light；

Or

The third light compensating apparatus is used to carry out the quick-fried sudden strain of a muscle light filling of visible light with strobe mode, wherein in the described first default exposure The Partial exposure period in carry out the quick-fried sudden strain of a muscle light filling of visible light, at least within the Partial exposure period of the described second default exposure Carry out the quick-fried sudden strain of a muscle light filling of visible light.

16. device according to any one of claims 1 to 8, which is characterized in that sudden strain of a muscle quick-fried for any near-infrared is mended Intersection, the quick-fried sudden strain of a muscle of near-infrared is not present in light, the near-infrared quick-fried period for dodging light filling and the exposure period of the described second default exposure The period of light filling is the subset of the exposure period of the described first default exposure, alternatively, the near-infrared quick-fried period for dodging light filling It is close red for presetting the exposure period exposed there are intersection or described first with the exposure period of the described first default exposure The outer quick-fried subset for dodging light filling.

17. device according to any one of claims 1 to 8, which is characterized in that

The quick-fried central wavelength for dodging light filling of first light compensating apparatus progress near-infrared is to set characteristic wavelength or fall in set spy When levying wave-length coverage, constraint condition is reached by the waveband width of the near infrared light of the filtering assembly.

18. device according to claim 17, which is characterized in that the constraint condition include it is following any one:

It is less than or equal to 50 nanometers by the half-band width of the near infrared light of the filtering assembly；

Alternatively,

First band width is less than second band width；Wherein, the first band width refers to through the filtering assembly The waveband width of near infrared light, the second band width refer to the wide waveband of the near infrared light stopped by the filtering assembly Degree；

Alternatively,

Third waveband width, which is less than, refers to waveband width, and the third waveband width refers to that percent of pass is greater than the close red of setting ratio The waveband width of outer light, described with reference to waveband width is any waveband width in 50 nanometers~150 nanometers of wavelength band, institute State any proportion in the proportional region that setting ratio is 30%~50%.

19. device according to claim 5, which is characterized in that described image pretreatment unit, comprising:

Joint noise reduction unit, the first pretreatment unit and the second pretreatment unit；

Wherein, the joint noise reduction unit, for it is described first capture picture signal and it is described second capture picture signal into Row filtering processing, first after obtaining noise reduction, which captures picture signal and second, captures picture signal；

First pretreatment unit carries out the first pretreatment operation for capturing picture signal to first after noise reduction, obtains Pretreated gray level image；

Second pretreatment unit carries out the second pretreatment operation for capturing picture signal to second after noise reduction, obtains Color image.

20. device according to claim 5, which is characterized in that image fusion unit includes: Color Picking unit, brightness Extraction unit, the fusion treatment unit being connect respectively with the Color Picking unit and the brightness extraction unit；

Fusion treatment is carried out to the high-frequency signal, the low frequency signal and the chrominance signal, obtains the color integration figure Picture.

21. device according to claim 20, which is characterized in that the fusion treatment unit is specifically used for:

Fusion treatment is carried out to the chrominance signal of the fusion luminance picture and the color image, obtains the candid photograph image.

22. device according to claim 19, which is characterized in that the joint noise reduction unit is specifically used for:

23. a kind of image-pickup method, which is characterized in that be applied to image collecting device, described image acquisition device includes figure As sensor, light aid, filtering assembly and image processing unit, described image sensor is located at the light out of the filtering assembly Side, which comprises

Pass through visible light and part near infrared light by the first optical filter that the filtering assembly includes；Pass through the optical filtering group The second optical filter that part includes passes through visible light, stops near infrared light；

It by described image sensor according to grab signal, is double exposed using global Exposure mode, obtains two candid photographs Picture signal；

24. according to the method for claim 23, which is characterized in that the filtering assembly further includes switching part, the side Method further include:

First optical filter or second optical filter are switched to entering for described image sensor by the switching part Light side.

25. the method according to claim 23 or 24, which is characterized in that be switched to described image in first optical filter After the incident side of sensor:

By described image sensor according to the grab signal, double exposed using global Exposure mode, it is described twice Exposure includes the first default exposure and the second default exposure, is generated by the double exposure and exports the first candid photograph picture signal Picture signal is captured with second, wherein the first candid photograph picture signal is the picture signal generated according to the first default exposure, The second candid photograph picture signal is the picture signal generated according to the second default exposure, described first default all rows pair of exposure The exposure start time answered is identical and all rows corresponding end exposure moment is identical, and described second default all rows of exposure are corresponding Exposure start time it is identical and all rows corresponding end exposure moment is identical；

By first light compensating apparatus according to the light filling signal, the quick-fried sudden strain of a muscle light filling of near-infrared is carried out, wherein at least described the The quick-fried sudden strain of a muscle light filling of near-infrared is carried out in the Partial exposure period of one default exposure, in the exposure period of the described second default exposure It is interior without the quick-fried sudden strain of a muscle light filling of near-infrared；

Picture signal and described second is captured according to described first by described image processing unit and captures picture signal, is merged To the candid photograph image.

26. the method according to claim 23 or 24, which is characterized in that be switched to described image in second optical filter After the incident side of sensor:

By described image sensor according to the grab signal, double exposed using global Exposure mode, it is described twice Exposure includes the default exposure of third and the 4th default exposure, is generated by the double exposure and exports third and captures picture signal Picture signal is captured with the 4th, wherein it is the picture signal generated according to the default exposure of third that the third, which captures picture signal, The 4th candid photograph picture signal is the picture signal generated according to the 4th default exposure, the default all rows pair of exposure of the third The exposure start time answered is identical and all rows corresponding end exposure moment is identical, and the described 4th default all rows of exposure are corresponding Exposure start time it is identical and all rows corresponding end exposure moment is identical；

By second light compensating apparatus according to the light filling signal, the quick-fried sudden strain of a muscle light filling of visible light is carried out, wherein at least described the The quick-fried sudden strain of a muscle light filling of visible light is carried out in the Partial exposure period of three default exposures, in the exposure period of the described 4th default exposure It is interior without the quick-fried sudden strain of a muscle light filling of visible light；

Picture signal and the described 4th is captured according to the third by described image processing unit and captures picture signal, by right Reflection position carries out reflection and obtains the candid photograph image.

27. according to the method for claim 25, which is characterized in that described image processing unit includes image pre-processing unit And image fusion unit, which comprises

The first candid photograph picture signal is generated into gray level image after pretreatment by described image pretreatment unit, it will be described Second candid photograph picture signal generates color image after pretreatment；

The color image and the gray level image are subjected to fusion treatment by described image integrated unit, obtain candid photograph figure Picture.

28. according to the method for claim 25, which is characterized in that the described first default exposure and the described second default exposure At least one exposure parameter it is different, at least one described exposure parameter is time for exposure, exposure gain, one in aperture size Kind is a variety of, and the exposure gain includes analog gain, and/or, digital gain.

29. according to the method for claim 26, which is characterized in that described image processing unit further includes that detection registration is single Member and remove reflector element, which comprises

The detection registration unit captures picture signal and the described 4th according to the third and captures picture signal, obtains the 4th and grabs Clap the non-flash vehicle window area image in picture signal；

It is described that reflector element is gone to capture picture signal and the non-flash vehicle window area image according to the third, to the third The flash of light vehicle window area image captured in picture signal reflect, and obtains capturing image.

30. according to the method for claim 26, which is characterized in that the default exposure of the third and the described 4th default exposure Exposure parameter it is identical, the exposure parameter includes one of time for exposure, exposure gain, aperture size or a variety of, described Exposure gain includes analog gain, and/or, digital gain.

31. according to the described in any item methods of claim 23 to 30, which is characterized in that the grab signal and light filling letter It number is the same signal.