CN110493495A - The method of image collecting device and Image Acquisition - Google Patents

The method of image collecting device and Image Acquisition Download PDF

Info

Publication number
CN110493495A
CN110493495A CN201910473497.1A CN201910473497A CN110493495A CN 110493495 A CN110493495 A CN 110493495A CN 201910473497 A CN201910473497 A CN 201910473497A CN 110493495 A CN110493495 A CN 110493495A
Authority
CN
China
Prior art keywords
exposure
picture signal
moment
infrared light
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910473497.1A
Other languages
Chinese (zh)
Other versions
CN110493495B (en
Inventor
於敏杰
聂鑫鑫
罗丽红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201910473497.1A priority Critical patent/CN110493495B/en
Publication of CN110493495A publication Critical patent/CN110493495A/en
Application granted granted Critical
Publication of CN110493495B publication Critical patent/CN110493495B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/743Bracketing, i.e. taking a series of images with varying exposure conditions

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

Present disclose provides a kind of methods of image collecting device and Image Acquisition, belong to video technique field.Described image acquisition device includes image acquisition component and light filling component, image acquisition component includes filter part and imaging sensor, imaging sensor, for exposing induction by multiple belt-type shutter and exporting the first picture signal and the second picture signal, first picture signal is the picture signal generated according to the first exposure, second picture signal is the picture signal generated according to the second exposure, filter part includes the first filtering apparatus, for passing through visible light and part near infrared light, light filling component includes the first light compensating apparatus, for first exposure when without near-infrared light filling, and near-infrared light filling is carried out in the second exposure, it at the beginning of carrying out near-infrared light filling when the second exposure is determined according to the first moment, the finish time of near-infrared light filling is carried out when the second exposure to be determined according to the second moment.Using the disclosure, realization difficulty can be reduced.

Description

The method of image collecting device and Image Acquisition
Technical field
This disclosure relates to video technique field, the in particular to method of a kind of image collecting device and Image Acquisition.
Background technique
With the development of computer technology, relative to the figure and features feature such as fingerprint, iris, face is more intuitive, so face is examined Survey technology is gradually applied in the security systems such as gate inhibition.
In the related art, in order to prevent illegal user using the human face photo of legitimate user by the systems such as gate inhibition, one As be to connect human-face detection equipment with binocular camera, binocular camera includes a visible light camera and one infrared takes the photograph Camera.When carrying out Face datection, detection device obtains the visible images of synchronization visible light camera shooting and infrared takes the photograph Camera shooting infrared image, determine whether it is living body faces by infrared image, and determined whether by visible images be Legitimate user.
In this way, obtaining infrared image and visible images, two video cameras are needed, however the installation of two video cameras needs Higher machining accuracy, so causing to realize that difficulty is higher.
Summary of the invention
In order to solve the problems, such as to realize that difficulty is higher in the related technology, the embodiment of the present disclosure provides a kind of image collector Set the method with Image Acquisition.The technical solution is as follows:
In a first aspect, providing a kind of image collecting device, described image acquisition device includes:
Image acquisition component and light filling component, described image acquisition component include filter part and imaging sensor;
Described image sensor, for exposing induction by multiple belt-type shutter and exporting the first picture signal and second Picture signal, wherein the first image signal is the picture signal generated according to the first exposure, and second picture signal is According to the picture signal that the second exposure generates, first exposure and second exposure are the multiple belt-type shutter exposure In wherein double exposure;
The filter part, including the first filtering apparatus pass through visible light and part near infrared light;
The light filling component, including the first light compensating apparatus, first light compensating apparatus are used in the described first exposure, no Near-infrared light filling is carried out, and when carrying out the described second exposure, carry out near-infrared light filling, and carried out when second exposure close red It is to be determined according at least to the first moment at the beginning of outer light filling, at the end of described second carries out near-infrared light filling when exposing Quarter was determined according at least to the second moment;
Wherein, the first image signal includes multirow effective picture signal, and second picture signal includes that multirow has Imitate picture signal, it is described second exposure be current exposure when, first moment be the current exposure before the last time The end time of exposure of the last line effective picture signal for the first picture signal that first exposure generates, when described second Quarter is the first row effective image of the first picture signal of the last time the first exposure generation after the current exposure The beginning time of exposure of signal.
As a kind of possible implementation, described second carries out being no earlier than institute at the beginning of near-infrared light filling when exposing Stated for the first moment, the described second finish time that near-infrared light filling is carried out when exposing was not later than second moment.
As a kind of possible implementation, described second exposure when carry out near-infrared light filling at the beginning of be according to institute State what the first moment and third moment determined, the third moment is the first of the second picture signal that the current exposure generates The end time of exposure of row effective picture signal;First moment is not later than the third moment.
As a kind of possible implementation, described second carries out being no earlier than institute at the beginning of near-infrared light filling when exposing It stated for the first moment, and is not later than the third moment.
As a kind of possible implementation, described second exposure when carry out near-infrared light filling finish time be according to institute State what the second moment and the 4th moment determined, the 4th moment is the last of the second picture signal that the current exposure generates The beginning time of exposure of a line effective picture signal;4th moment is not later than second moment.
As a kind of possible implementation, the described second finish time that near-infrared light filling is carried out when exposing was no earlier than institute It stated for the 4th moment, and is not later than second moment.
It include multiple exposure cycles in the multiple belt-type shutter exposure, each as a kind of possible implementation It include first exposure at least once and second exposure at least once in exposure cycle.
As a kind of possible implementation, described image acquisition device further includes camera lens;
The filter part is between the camera lens and described image sensor, and described image sensor is positioned at described The light emission side of filter part;Alternatively,
The camera lens is between the filter part and imaging sensor, and described image sensor is located at the camera lens Light emission side.
As a kind of possible implementation, described image sensor includes multiple photosensitive channels, the multiple photosensitive logical Road includes at least one of the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, the photosensitive channel W, and the multiple photosensitive channel is logical The multiple belt-type shutter exposure is crossed to generate and export the first image signal and second picture signal;
Wherein, the photosensitive channel R, for incuding the light of red spectral band and near infrared band, the photosensitive channel G is green for incuding The light of optical band and near infrared band, the photosensitive channel B, for incuding the light of blue wave band and near infrared band, the photosensitive channel W, For incuding full wave light.
As a kind of possible implementation, described image sensor is red, green, blue and white RGBW sensor, red indigo plant in vain Any sensor in RCCB sensor, RGB RGB sensor or reddish yellow champac RYYB sensor;
Wherein, R indicates the photosensitive channel R, and G indicates the photosensitive channel G, and B indicates the photosensitive channel B, and W indicates the photosensitive channel W.
As a kind of possible implementation, the exposure parameter used when the described first exposure and progress described second are carried out The exposure parameter used when exposure is identical or not identical, the exposure parameter include the time for exposure, analog gain, digital gain, At least one of aperture scale.
As a kind of possible implementation, different exposure parameter includes time for exposure, analog gain, digital gain At least one.
As a kind of possible implementation, the filter part further includes the second filtering apparatus and switching part, described First filtering apparatus and second filtering apparatus are connect with the switching part;
The switching part, for second filtering apparatus to be switched to the incident side of described image sensor;
After second filtering apparatus is switched to the incident side of described image sensor, second filtering apparatus makes The light of visible light wave range passes through, and stops the light of near infrared light wave band, described image sensor, for generating and exporting by exposure Third picture signal.
As a kind of possible implementation, the light filling component further includes the second light compensating apparatus;
Second light compensating apparatus in a manner of being always on for carrying out visible light light filling;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in second exposure The Partial exposure period in there are visible light light filling, visible light is not present in the entire exposure period of first exposure Light filling;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in second exposure Entire exposure period in be not present visible light light filling, it is described first exposure the Partial exposure period in there are visible lights Light filling.
As a kind of possible implementation, the central wavelength that first light compensating apparatus carries out near-infrared light filling is setting Characteristic wavelength or fall in setting characteristic wavelength range when, pass through the central wavelength of the near infrared light of first filtering apparatus And/or waveband width reaches constraint condition.
As a kind of possible implementation, the central wavelength that first light compensating apparatus carries out near-infrared light filling is 750 Any wavelength in ± 10 nanometers of wave-length coverage;Or
First light compensating apparatus carries out appointing in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers One wavelength;Or
First light compensating apparatus carries out appointing in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers One wavelength.
As a kind of possible implementation, the constraint condition includes: the near-infrared by first filtering apparatus The difference that the central wavelength of light and first light compensating apparatus carry out between the central wavelength of near-infrared light filling is located at wavelength fluctuation In range, the wavelength fluctuation range is 0~20 nanometer;Alternatively,
It is less than or equal to 50 nanometers by the half-band width of the near infrared light of first filtering apparatus;Alternatively,
First band width is less than second band width;Wherein, the first band width refers to filters by described first The waveband width of the near infrared light of electro-optical device, the second band width refer to the near-infrared stopped by first filtering apparatus The waveband width of light;Alternatively,
Third waveband width, which is less than, refers to waveband width, and the third waveband width refers to that percent of pass is greater than setting ratio The waveband width of near infrared light, described with reference to waveband width is any wide waveband in 50 nanometers~150 nanometers of wavelength band Degree.
Second aspect provides a kind of method of Image Acquisition, and the method for Image Acquisition is applied to image collecting device, Described image acquisition device includes: imaging sensor, light aid component and filter part, and the light filling component includes the first light filling Device, the filter part include the first filtering apparatus, which is characterized in that the described method includes:
Pass through first light compensating apparatus and carries out near-infrared light filling, wherein in the first exposure without near-infrared light filling, Carry out near-infrared light filling in the second exposure, when the described second exposure carries out being according at least to the at the beginning of near-infrared light filling One moment determine, described second exposure when carry out near-infrared light filling finish time be to be determined according at least to the second moment;
Pass through visible light and part near infrared light by first filtering apparatus;
Multiple belt-type shutter exposure induction is carried out by described image sensor and exports the first picture signal and second Picture signal, wherein the first image signal is the picture signal generated according to first exposure, the second image letter It number is the picture signal generated according to second exposure;
The first image signal includes multirow effective picture signal, and second picture signal includes multirow effective image Signal, when second exposure is current exposure, first moment be the current exposure before the last time described the The end time of exposure of the last line effective picture signal for the first picture signal that one exposure generates, second moment is institute State the first row effective picture signal of the first picture signal of the last time the first exposure generation after current exposure Start the time of exposure.
As a kind of possible embodiment, it carries out being no earlier than institute at the beginning of near-infrared light filling when the described second exposure Stated for the first moment, the described second finish time that near-infrared light filling is carried out when exposing was not later than second moment.
It as a kind of possible embodiment, is according to institute at the beginning of near-infrared light filling is carried out when the described second exposure State what the first moment and third moment determined, the third moment is the first of the second picture signal that the current exposure generates The end time of exposure of row effective picture signal, wherein first moment is not later than the third moment.
As a kind of possible embodiment, it carries out being no earlier than institute at the beginning of near-infrared light filling when the described second exposure It stated for the first moment, and is not later than the third moment.
As a kind of possible embodiment, the finish time for near-infrared light filling being carried out when the described second exposure is according to institute State what the second moment and the 4th moment determined, the 4th moment is the last of the second picture signal that the current exposure generates The beginning time of exposure of a line effective picture signal, wherein the 4th moment is not later than second moment.
As a kind of possible embodiment, the finish time for near-infrared light filling being carried out when the described second exposure is no earlier than institute It stated for the 4th moment, and is not later than second moment.
The technical solution bring beneficial effect that the embodiment of the present disclosure provides includes at least:
In the embodiment of the present disclosure, when controlling the near-infrared light filling of light filling component using the exposure time series of imaging sensor Sequence, so as to there are passing through the second exposure when near-infrared light filling to generate the second picture signal, by the when near-infrared light filling is not present One exposure generates the first picture signal, such data acquisition modes, can it is simple in structure, directly adopt while reduce cost Collect the first picture signal and the second picture signal, namely two different images can be obtained by an imaging sensor Signal reduces so that the image collecting device is easier and realizes difficulty.Also, the first picture signal and the second picture signal It is generated and is exported by the same imaging sensor, so the corresponding viewpoint of the first picture signal is corresponding with the second picture signal Viewpoint is identical, therefore, can obtain the information of outer scene jointly by the first picture signal and the second picture signal, and will not In the presence of because the corresponding viewpoint of the first picture signal viewpoint corresponding with the second picture signal it is not identical, and cause according to the first image The image that signal and the second picture signal generate is misaligned.
Detailed description of the invention
Fig. 1 is a kind of schematic diagram for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 2 is a kind of schematic diagram for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 3 is a kind of structural schematic diagram for image collecting device that the embodiment of the present disclosure provides;
Fig. 4 is a kind of schematic diagram for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 5 is a kind of schematic diagram figure for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 6 is a kind of schematic diagram for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 7 is a kind of schematic diagram for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 8 is a kind of schematic diagram for belt-type shutter exposure that the embodiment of the present disclosure provides;
Fig. 9 is a kind of structural schematic diagram for image collecting device that the embodiment of the present disclosure provides;
Figure 10 is a kind of schematic diagram for light percent of pass that the embodiment of the present disclosure provides;
Figure 11 is a kind of structural schematic diagram for image collecting device that the embodiment of the present disclosure provides;
Figure 12 is a kind of structural schematic diagram for image collecting device that the embodiment of the present disclosure provides;
Figure 13 is a kind of channel design schematic diagram for RGBW sensor that the embodiment of the present disclosure provides;
Figure 14 is a kind of channel design schematic diagram for RCCB sensor that the embodiment of the present disclosure provides;
Figure 15 is a kind of channel design schematic diagram for RGB sensor that the embodiment of the present disclosure provides;
Figure 16 is a kind of channel design schematic diagram for RYYB sensor that the embodiment of the present disclosure provides;
Figure 17 is a kind of spectral response curve schematic diagram that the embodiment of the present disclosure provides;
Figure 18 is a kind of schematic diagram for exposure sequence that the embodiment of the present disclosure provides;
Figure 19 is a kind of schematic diagram for exposure sequence that the embodiment of the present disclosure provides;
Figure 20 is a kind of schematic diagram for exposure sequence that the embodiment of the present disclosure provides;
Figure 21 is a kind of flow diagram of the method for Image Acquisition that the embodiment of the present disclosure provides.
Marginal data
1 light filling component 2 of image acquisition component
11 imaging sensor 12 of filter part
13 first filtering apparatus 111 of camera lens
Second filtering apparatus, 112 switching part 113
First light compensating apparatus, 21 second light compensating apparatus 22
Specific embodiment
To keep the purposes, technical schemes and advantages of the disclosure clearer, below in conjunction with attached drawing to disclosure embodiment party Formula is described in further detail.
Technical term involved in the embodiment of the present disclosure is simply introduced first below.
Visible light is the appreciable electromagnetic wave of human eye, it is seen that spectrum does not have an accurate range, and the eyes of common people can be with The wavelength of the electromagnetic wave of perception is between 400nm (nanometer)~760nm.
Visible images refer to the color image for only perceiving visible light signal, and the color image is only to visible light wave range sense Light.
Infrared image refers to the luminance picture of perception near infrared light signal.
Belt-type shutter exposure, the time for exposure for referring to that imaging sensor is not gone together not exclusively are overlapped, the exposure of every a line Start time and end exposure moment elapse a period of time backward line by line.
As shown in Figure 1, horizontal axis indicates the time, vertical coordinate axle indicates the pixel column serial number of imaging sensor, right In every one-row pixels, soft dot indicates exposure start time, and black circle indicates the end exposure moment, the of imaging sensor One-row pixels start to expose at the T1 moment, terminate to expose at the T3 moment, and the second row pixel starts to expose at the T2 moment, at the T4 moment Terminate exposure, T2 has elapsed a period of time compared to T1 backward, and T4 has elapsed a period of time compared to T3 backward, other rows are with this Analogize.
Readout time refers to that belt-type shutter exposes every one-row pixels and terminates to will do it data output after exposing, therefore, from The first row pixel data terminates to expose, and one-row pixels terminate the time of exposure and output data to the end, indicates readout time.
As shown in Figure 1, the first row pixel terminates to expose at the T3 moment, start output data, terminates to export number at the T5 moment According to last line pixel terminates to expose at the T6 moment, and the T7 moment terminates output data, then the time of T3~T7 is when reading Between, as shown in figure 1 shown in rectangle.
As shown in Fig. 2, exposing rough schematic view for multiple belt-type shutter, wherein horizontal direction indicates time, dotted line table (since the beginning time of exposure of every one-row pixels is not identical, so exposure start time can shape at the beginning of showing exposure every time At an oblique line), solid line indicate expose every time finish time (since the end time of exposure of every one-row pixels is not identical, institute Will form an oblique line with the end exposure moment), rectangle indicates readout time.
In the related technology, the infrared image and visible images for obtaining an object need to cause using binocular camera Realize that difficulty is high, in order to reduce realization difficulty, present disclose provides the image collecting devices of such as flowering structure.
Fig. 3 is a kind of structural schematic diagram for image collecting device that the embodiment of the present disclosure provides, the image collecting device packet Image acquisition component 1 and light filling component 2 are included, image acquisition component 1 includes filter part 11, imaging sensor 12 and camera lens 13 (camera lens 13 is not shown in Fig. 3).Imaging sensor 12 is used to generate by the exposure of multiple belt-type shutter and exports the first figure As signal and the second picture signal, the first picture signal is the picture signal generated according to the first exposure, and the second picture signal is According to the picture signal that the second exposure generates, the first exposure and the second exposure be in the exposure of multiple belt-type shutter wherein twice Exposure.Filter part 11, including the first filtering apparatus 111, pass through visible light and part near infrared light.Light filling component 2, including First light compensating apparatus, 21 (not shown), the first light compensating apparatus 21 is used in the first exposure, without near-infrared light filling, and When carry out second exposes, near-infrared light filling is carried out, and carries out at the beginning of near-infrared light filling being at least root when the second exposure The finish time of near-infrared light filling is carried out when exposing according to the first moment determination, second to be determined according at least to the second moment. Wherein, the first picture signal includes multirow effective picture signal, and the second picture signal includes multirow effective picture signal, and second exposes Light be current exposure when, the first moment be current exposure before the last time first exposure generation the first picture signal most The end time of exposure of a line effective picture signal afterwards, the second moment are that the exposure of the last time first after current exposure generates The first picture signal the first row effective picture signal the beginning time of exposure.
Wherein, the first picture signal and the second picture signal include multirow effective picture signal, and effective picture signal refers to The picture signal finally read.For example, a belt-type shutter exposure has the photosensitive channel of 1000 rows, the image of final output The line number of pixel is 800 rows, then effective picture signal is exactly the wherein photosensitive channel of 800 rows in the photosensitive channel of 1000 rows The picture signal of output can be from the 1st row to the 800th row, be also possible to from the 100th row to the 900th row, the embodiment of the present disclosure It is not construed as limiting.
In an implementation, image collecting device may include image acquisition component 1 and light filling component 2, and image acquisition component 1 can To include filter part 11, imaging sensor 12 and camera lens 13.Light filling component 2 includes the first light compensating apparatus 21, the first light filling dress 21 are set for carrying out near-infrared light filling, filter part 11 includes the first filtering apparatus 111, and the first filtering apparatus 111 is for only making Visible light and near infrared light pass through, by the wave band of near infrared light can be the wave band of part near infrared light.
Filter part 11 can be by the filter set using coating technique at it is logical to may be used to visible light and near infrared light It crosses, or passes through visible light and part near infrared light, i.e., the first filtering apparatus 111 passes through visible light and near infrared light, or Person passes through visible light and part near infrared light.
Imaging sensor 12 can be used for multiple belt-type shutter exposure and incude and export the first picture signal and the second figure As signal, the first picture signal is the picture signal generated according to the first exposure, and the second picture signal is produced according to the second exposure Raw picture signal, the first exposure and the second exposure are the double exposure in the exposure of multiple belt-type shutter.
When carry out first exposes, light filling component 2 can be near-infrared benefit without near-infrared light filling, such as light filling component 2 Light lamp can close near infrared light light compensating lamp etc., make to be reflected into the exposure period of the first exposure by subject The light of filter part 11 is environment light, and at this moment imaging sensor 12 it is fast can to carry out roller shutter type with the exposure parameter of the first exposure Exposure gate exports the first picture signal.
When carry out second exposes, light filling component 2 can carry out infrared light filling, if light filling component 2 is near-infrared light compensating lamp, Near infrared light light compensating lamp etc. can be opened, when the second exposure is current exposure (referring to current time ongoing exposure), In Can be at the beginning of near-infrared light filling according to the determination of the first moment, the first moment can be before current exposure It the end time of exposure of the last line effective picture signal for the first picture signal that the first exposure of the last time generates, is carrying out The finish time of near-infrared light filling can be to be determined according to the second moment, and the second moment can be nearest one after current exposure The beginning time of exposure of the first row effective picture signal for the first picture signal that secondary first exposure generates.In this start time and Between finish time, light filling component 2 can carry out near-infrared light filling, and imaging sensor 12 can be with the exposure ginseng of the second exposure Number carries out belt-type shutter exposure, exports the second picture signal.
It should be noted that repeatedly belt-type shutter exposure includes multiple first exposure and multiple second exposure, for example, In Multiple first exposure should be carried out in one second, also to carry out multiple second exposure, the sequence that the first exposure and second expose can To configure in advance.
Light filling component 2 may include the first light compensating apparatus 21, and the first light compensating apparatus 21 can be located in image collecting device, The outside of image collecting device can also be located at.First light compensating apparatus 21 can be a part of image collecting device, can also be with For a device independently of image collecting device.When the first light compensating apparatus 21 is located at the outside of image collecting device, first Light compensating apparatus 21 can be communicatively coupled with image collecting device, thereby may be ensured that the image sensing in image collecting device There are certain relationships for the near-infrared light filling timing of the exposure time series of device 12 and the first light compensating apparatus 21.
When being exposed as a kind of possible implementation, second, without near-infrared light filling, institute when in order to make the first exposure It not can be carried out near-infrared light filling with the exposure period of the effective picture signal of the first picture signal generated in the first exposure, It carries out carrying out near-infrared light filling when cannot expose earlier than the first moment, second at the beginning of near-infrared light filling when the i.e. second exposure Finish time cannot be later than for the second moment.
For example, the first exposure of imaging sensor 12 and second exposes alternately, the first exposure as shown in (a) in Fig. 4 When corresponding first lighting state of the first light compensating apparatus 21, the first light compensating apparatus 21 corresponding second lighting state when the second exposure, the One lighting state is to close, and for the first light compensating apparatus 21 without near-infrared light filling, the second lighting state is to open, the first light filling dress 21 carry out near-infrared light fillings are set, previous frame image signal is the first picture signal, and (i.e. current exposure generates current frame image signal Picture signal) be the second picture signal, then current exposure be second expose and generate the second picture signal, the second picture signal When corresponding second lighting state opens close red outer smooth, the first light compensating apparatus 21 starts to be no earlier than at the time of near-infrared light filling The end time of exposure of its former frame last line effective picture signal.Further, the first light compensating apparatus 21 terminates near-infrared The beginning time of exposure of its a later frame the first row effective picture signal is not later than at the time of light filling.
As a kind of possible implementation, when in order to make the second exposure, every a line effective picture signal carries out close red Outer light filling, the second exposure can be used at the beginning of near-infrared light filling the first moment and third moment and determine, when third Quarter is the end time of exposure of the first row effective picture signal for the second picture signal that current exposure generates.In addition, in order to make Near-infrared light filling does not influence the first exposure, and the first moment was not later than the third moment.
As a kind of possible implementation, when current exposure is the second exposure, when in order to make the second exposure, the first row has Effect picture signal can also carry out near-infrared light filling, then when carrying out that third can be not later than at the beginning of near-infrared light filling It carves, if it is desired to which recent first before not influencing current exposure exposes, at the beginning of progress near-infrared light filling not Near-infrared benefit is not had earlier than the first moment, namely before the first last line effective image exposed of former frame terminates exposure Light.So carrying out being no earlier than for the first moment at the beginning of near-infrared light filling when the second exposure, and it is not later than the third moment.
For example, starting (between the first moment and third moment) within the scope of two vertical dotted lines as shown in (b) in Fig. 4 Near-infrared light filling, the dotted line close to the left side are the 5th millisecond, and the dotted line close to the right is the 30th millisecond, can be at the 10th millisecond Start near-infrared light filling.
As a kind of possible implementation, when in order to make the second exposure, every a line effective picture signal carries out close red Outer light filling can determine the finish time that the second exposure carries out near-infrared light filling using the second moment and the 4th moment, the 4th Moment is the beginning time of exposure of the last line effective picture signal for the second picture signal that current exposure generates.
As a kind of possible implementation, when current exposure is the second exposure, when in order to make the second exposure, last line Effective picture signal carries out near-infrared light filling, then carrying out the finish time of near-infrared light filling can be no earlier than for the 4th moment, If it is intended to recent first after current exposure exposes without near-infrared light filling, then carrying out near-infrared light filling Finish time be not later than for the second moment.So when the finish time for carrying out near-infrared light filling when the second exposure is no earlier than the 4th It carves, and was not later than for the second moment, wherein the 4th moment was not later than for the second moment.
For example, terminating (between the second moment and the 4th moment) within the scope of two articles of vertical dotted lines as shown in (c) in Fig. 4 Near-infrared light filling, the dotted line close to the left side are the 10th millisecond, and the dotted line close to the right is the 50th millisecond, can be at the 40th millisecond Terminate near-infrared light filling.
As a kind of possible implementation, as shown in figure 5, when current exposure is the second exposure, in order to make the second exposure When, every a line effective picture signal carry out near-infrared light filling (influence herein be current exposure the first row effective image letter Number near-infrared light filling), then carry out near-infrared light filling at the beginning of be not later than current exposure the first row effective image letter Number the end time of exposure (if being later than the end time of exposure of the first row effective picture signal, the first row effective image letter Number do not have near-infrared light filling), if it is desired to recent first exposure before not influencing current exposure carries out near-infrared The end time of exposure of the last line effective picture signal of its former frame first exposure can be no earlier than at the beginning of light filling If (earlier than the end time of exposure of the last line effective picture signal, the first of former frame can be made, which to expose, near infrared light Light filling).So carrying out being no earlier than for the first moment at the beginning of near-infrared light filling when the second exposure, and it is not later than the third moment. When in order to make the second exposure, every a line effective picture signal carry out near-infrared light filling (influence herein be current exposure most The near-infrared light filling of a line effective picture signal afterwards), then current exposure can be no earlier than by carrying out the finish time of near-infrared light filling The beginning time of exposure of the last line effective picture signal of light earlier than the last line effective picture signal (if start to expose Light time carves, and last line effective picture signal do not have near-infrared light filling), if it is desired to it does not influence nearest after current exposure One time first exposure, then carry out near-infrared light filling finish time be not later than its a later frame first exposure the first row it is effective The beginning time of exposure of picture signal (if being later than the beginning time of exposure of the first row effective picture signal, can make a later frame First exposure when have near infrared light light filling).So the finish time for carrying out near-infrared light filling when the second exposure is no earlier than the 4th Moment, and it was not later than for the second moment.In this way, for effective lighting time of every a line effective picture signal be not necessarily it is identical 's.
It should be noted that for the relationship of clearer description light filling and exposure, it is also believed that be the time for exposure with Lighting time meets certain constraint:
In the second exposure, the first light compensating apparatus 21 carries out near-infrared light filling, if the first exposure and the second exposure alternating It carries out, current exposure is the second exposure, carries out being no earlier than former frame last line effective image at the beginning of near-infrared light filling The end time of exposure of signal, and it is not later than the end time of exposure of the first row effective picture signal of current exposure.It carries out close The finish time of infrared light filling is no earlier than the beginning time of exposure of the last line effective picture signal of current exposure, and is not later than The beginning time of exposure of the first row effective picture signal of its a later frame.
It should be noted that above-mentioned first and second be only relative concept, can be exchanged with each other.
In a kind of example, as shown in fig. 6, imaging sensor 21 exposes (the first exposure) and B exposure (the second exposure) in A It under two kinds of exposures, is staggeredly exposed, within the A time for exposure, the first light compensating apparatus 21 is closed, and output does not carry out near-infrared light filling Picture signal (i.e. the first picture signal), within the B time for exposure, the first light compensating apparatus 21 open, export light compensating lamp near-infrared The picture signal (i.e. the second picture signal) of light filling.And the first light compensating apparatus 21 is being no earlier than former frame A exposure last line The end time of exposure of effective picture signal opens, and the end for being not later than a later frame B exposure the first row effective picture signal exposes Light time, which carves, closes.
Further, as shown in fig. 7, A exposure and the time for exposure of B exposure are 10 milliseconds, readout time is 10 milliseconds, The first row effective picture signal starts to expose when A is exposed on the 10th millisecond, the last line effective picture signal at the 30th millisecond Terminate exposure, the first row effective picture signal starts to expose at the 30th millisecond when B exposes, and last line has at the 50th millisecond Effect picture signal terminates to expose, and at the 32nd millisecond, the first light compensating apparatus 21 opens near-infrared light filling, at the 48th millisecond, first Light compensating apparatus 21 closes near-infrared light filling, and near-infrared lighting time is 16 milliseconds, so that the A for obtaining no near-infrared light filling exposes Light can really reflect the color information of environment, have near-infrared light filling B exposure can possess better brightness, clarity and Signal-to-noise ratio.
Further, as shown in figure 8, when environmental light brightness is poor, the time for exposure that appropriate can extend A and expose, contracting The lighting time of short B exposure, A time for exposure are 15 milliseconds, and the B time for exposure is 10 milliseconds, and readout time is 10 milliseconds, A exposure The first row effective picture signal starts to expose at 5 milliseconds of Shi, and at the 30th millisecond, last line effective picture signal terminates Exposure, B are exposed on the 30th millisecond of the first row effective image and start to expose, the last line effective picture signal knot at the 50th millisecond Beam exposure can open near-infrared light filling, the first light compensating apparatus at the 45th millisecond by the first light compensating apparatus 21 at the 35th millisecond 21 close near-infrared light fillings, and when light filling is 10 milliseconds a length of.By the exposure time of extension S exposure appropriate, A can be effectively promoted Expose obtained color, clarity and the signal-to-noise ratio of picture signal etc..
It should be noted that the interleaved order of above-mentioned AB exposure is a kind of implementation of the disclosure, can also use Other sequences, the conditions of exposure of two kinds of AB exposures can also be different, and above-mentioned conditions of exposure includes and is not limited to time for exposure, number Gain, analog gain etc. (are illustrated) later.In addition, above-mentioned exposure and the linkage control relationship of light filling component 2 are also A kind of implementation of the disclosure, can also be using other linkage control modes for meeting the disclosure.
As a kind of possible implementation, as shown in figure 9, image acquisition component 1 can also include camera lens 13, camera lens 13 It can be made of multi-disc eyeglass, for playing focussing force to light, Helpers are imaged on imaging sensor 12.In Fig. 9 (a) in, filter part 11 can between camera lens 13 and imaging sensor 12, and imaging sensor 12 can be located at filter The light emission side of component 11.As an example, filter part 11 can be light filter film, when filter part 11 be located at camera lens 13 with When between imaging sensor 12, filter part 11 can be attached to the surface of the light emission side of camera lens 13.
Alternatively, camera lens 13 can be by multi-disc lens set as shown in figure 9, image acquisition component 1 can also include camera lens 13 At for playing focussing force to light, Helpers are imaged on imaging sensor 12.In (b) of Fig. 9, camera lens 13 can With between filter part 11 and imaging sensor 12, imaging sensor 12 can be located at the light emission side of camera lens 13.As one Kind example, filter part 11 can be light filter film, when camera lens 13 is between filter part 11 and imaging sensor 12, filter Light component 11 can be attached to the surface of the incident side of camera lens 13.
By taking the structure of the image collecting device of (a) in above-mentioned Fig. 9 as an example, filter part 11 can be located at camera lens 13 and image Between sensor 12, and imaging sensor 12 is located at for the structure feature of the light emission side of filter part 11, image collecting device Acquire the process of the first picture signal and the second picture signal are as follows: when imaging sensor 12 carries out the first exposure, the first light filling Near-infrared light filling is not present in device 21, after the environment light in photographed scene is via camera lens 13, filter part 11 at this time, by image Sensor 12 generates the first picture signal by the first exposure, when imaging sensor 12 carries out the second exposure, the first light filling dress Setting 21, there are near-infrared light fillings, at this point, the environment light and the first light compensating apparatus 21 in photographed scene carry out quilt when near-infrared light filling The near infrared light that object reflects in scene passes through the second exposure by imaging sensor 12 after camera lens 13, filter part 11 The second picture signal is generated, can there is M first exposure and N number of second exposure in a unit interval of Image Acquisition, Can be there are many combined sequence, in a unit interval of Image Acquisition between first exposure and the second exposure, M and N Value and the size relation of M and N can be arranged according to actual needs, can not also phase for example, the value of M and N can be equal Together.
First light compensating apparatus 21 is the device that can issue near infrared light, for example, near-infrared light compensating lamp etc., the first light filling dress Near-infrared light filling can be carried out with strobe mode by setting 21, can also carry out near-infrared light filling with the other modes of similar stroboscopic, this Open embodiment does not limit this.In some instances, when the first light compensating apparatus 21 carries out near-infrared light filling with strobe mode When, the first light compensating apparatus 21 can be controlled manually with strobe mode and carry out near-infrared light filling, it can also be by soft Part program or particular device carry out near-infrared light filling to control the first light compensating apparatus 21 with strobe mode, and the embodiment of the present disclosure is to this Without limitation.
Wherein, the period that the first light compensating apparatus 21 carries out near-infrared light filling can be with the exposure period weight of the second exposure It closes, the exposure period of the second exposure or the exposure period less than the second exposure can also be greater than, as long as in the second exposure Entire exposure period or the Partial exposure period in carry out near-infrared light filling, and first exposure exposure period in Without near-infrared light filling.
As an example, the first light compensating apparatus 21 carries out near-infrared light filling in the second exposure, for roller shutter exposure side For formula, the exposure period of the second exposure can be the beginning time of exposure of the second picture signal the first row effective picture signal Period between the end time of exposure of last line effective picture signal, however, it is not limited to this.For example, the second exposure Exposure period be also possible to the corresponding exposure period of target image signal, target image signal in the second picture signal and be In second picture signal with several rows effective picture signal corresponding to target object or target area, this several row effective image Period between the beginning time of exposure and the end time of exposure of signal is considered as the exposure period of the second exposure.
It should be noted that being incident on object since the first light compensating apparatus 21 is when carrying out near-infrared light filling to outer scene The near infrared light in body surface face may be reflected by the object, hence into the first filtering apparatus 111.And due to usual situation Under, environment light may include visible light and near infrared light, and the near infrared light in environment light also can be by when being incident on body surface Object reflection, hence into the first filtering apparatus 111.Therefore, pass through the first filtering apparatus when carrying out near-infrared light filling 111 near infrared light may include being reflected into the first filtering apparatus through object when the first light compensating apparatus 21 carries out near-infrared light filling 111 near infrared light by the near infrared light of the first filtering apparatus 111 may include the first benefit when without near-infrared light filling The near infrared light of the first filtering apparatus 111 is reflected into when electro-optical device 21 does not carry out near-infrared light filling through object.That is to say, into When row near-infrared light filling by the near infrared light of the first filtering apparatus 111 include the first light compensating apparatus 21 issue and through object it is anti- Near infrared light near infrared light and environment light after penetrating after object reflects, by the when without near-infrared light filling The near infrared light of one filtering apparatus 111 includes the near infrared light in environment light after object reflects.
In addition, since the intensity of the near infrared light in environment light is strong lower than the near infrared light that the first light compensating apparatus 21 issues Degree, therefore, the first light compensating apparatus 21 be higher than when near-infrared light filling by the intensity of the near infrared light of the first filtering apparatus 111 Pass through the intensity of the near infrared light of the first filtering apparatus 111 when first light compensating apparatus 21 does not carry out near-infrared light filling.
Wherein, the wavelength band that the first light compensating apparatus 21 carries out near-infrared light filling can refer to wavelength band for second, the Two reference wavelength bands can be 700 nanometers~800 nanometers or 900 nanometers~1000 nanometers etc., and the embodiment of the present application is to this Without limitation.In addition, wave band model can be referred to for first by being incident on the wavelength band of the near infrared light of the first filtering apparatus 111 It encloses, the first reference wavelength band is 650 nanometers~1100 nanometers.
Since when there are near-infrared light filling, the near infrared light by the first filtering apparatus 111 may include the first light filling Device 21 be reflected into the near infrared light and environment light of the first filtering apparatus 111 when near infrared light light filling through object The near infrared light after object reflects.So stronger into the intensity of the near infrared light of the first filtering apparatus 111 at this time.But It is that, when near-infrared light filling is not present, the near infrared light by the first filtering apparatus 111 only includes reflecting in environment light through object Into the near infrared light of the first filtering apparatus 111.Due to carrying out the near infrared light of light filling without the first light compensating apparatus 21, so this When it is weaker by the intensity of the near infrared light of the first filtering apparatus 111.Therefore, the second figure for generating and exporting according to the second exposure As the intensity for the near infrared light that signal includes, it is higher than and is generated according to the first exposure and that the first picture signal for exporting includes is close The intensity of infrared light.
First light compensating apparatus 21 carries out the central wavelength of near-infrared light filling and/or wavelength band can be there are many selection, this Apply in embodiment, it, can be to the first light filling in order to make the first light compensating apparatus 21 and the first filtering apparatus 111 have better cooperation The central wavelength that device 21 carries out near-infrared light filling is designed, and is selected the characteristic of the first filtering apparatus 111, from And to carry out the central wavelength of near-infrared light filling in the first light compensating apparatus 21 as setting characteristic wavelength or fall in setting feature When wave-length coverage, constraint item can achieve by the central wavelength and/or waveband width of the near infrared light of the first filtering apparatus 111 Part.The central wavelength that the constraint condition is primarily used to the near infrared light that constraint passes through the first filtering apparatus 111 is as accurate as possible, And it is as narrow as possible by the waveband width of the near infrared light of the first filtering apparatus 111, to avoid the occurrence of because of near-infrared light waves Duan Kuandu is wide and introduces wavelength interference.
Wherein, what the central wavelength that the first light compensating apparatus 21 carries out near-infrared light filling can issue for the first light compensating apparatus 21 Average value in the spectrum of near infrared light in the maximum wave-length coverage of energy, it is understood that issued for the first light compensating apparatus 21 Energy is more than the wavelength of the middle position in the wave-length coverage of certain threshold value in the spectrum of near infrared light.
Wherein, setting characteristic wavelength or setting characteristic wavelength range can preset.As an example, it first mends The central wavelength that electro-optical device 21 carries out near-infrared light filling can be any wavelength in 750 ± 10 nanometers of wave-length coverage;Alternatively, First light compensating apparatus 21 carries out any wavelength in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers;Or Person, the first light compensating apparatus 21 carry out any wavelength in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers. That is to say, setting characteristic wavelength may range from 750 ± 10 nanometers of wave-length coverage or 780 ± 10 nanometers of wave-length coverage, Or 940 ± 10 nanometers of wave-length coverage.Illustratively, the central wavelength of the first light compensating apparatus 21 progress near-infrared light filling is 940 nanometers, the first light compensating apparatus 21 carries out the relationship between the wavelength and relative intensity of near-infrared light filling, the first light compensating apparatus 21 The wavelength band for carrying out near-infrared light filling is 900 nanometers~1000 nanometers, wherein in 940 nanometers, near infrared light it is relatively strong Spend highest.
Since when there are near-infrared light filling, the near infrared light by the first filtering apparatus 111 is largely the first light filling Device 21 carries out the near infrared light for being reflected into the first filtering apparatus 111 when near-infrared light filling through object, therefore, in some implementations In example, above-mentioned constraint condition may include: to be filled by the central wavelength of the near infrared light of the first filtering apparatus 111 and the first light filling The difference set between the central wavelength of 21 carry out near-infrared light fillings is located within the scope of wavelength fluctuation, as an example, wavelength wave It is dynamic to may range from 0~20 nanometer.
It wherein, can be the first filtering apparatus 111 by the central wavelength of the near-infrared light filling of the first filtering apparatus 111 Wavelength within the scope of near infrared band near infrared light percent of pass curve at crest location, it is understood that filter and fill for first Setting percent of pass in 111 near infrared light percent of pass curve is more than the middle position within the scope of the near infrared band of certain threshold value Wavelength.
In order to avoid introducing wavelength interference, In by the way that the waveband width of the near infrared light of the first filtering apparatus 111 is wide In some embodiments, above-mentioned constraint condition may include: that first band width can be less than second band width.Wherein, first Waveband width refers to that the waveband width of the near infrared light by the first filtering apparatus 111, second band width refer to by the first filter The waveband width for the near infrared light that electro-optical device 111 stops.It should be understood that waveband width refers to wave locating for the wavelength of light The width of long range.For example, passing through wave-length coverage locating for the wavelength of the near infrared light of the first filtering apparatus 111 is 700 nanometers ~800 nanometers, then first band width, which is 800 nanometers, subtracts 700 nanometers, i.e., 100 nanometers.In other words, pass through the first filter Waveband width of the waveband width of the near infrared light of electro-optical device 111 less than the near infrared light that the first filtering apparatus 111 stops.
For example, with reference to Figure 10, Figure 10 be the first filtering apparatus 111 can by light wavelength and percent of pass between pass A kind of schematic diagram of system.Be incident on the near infrared light of the first filtering apparatus 111 wave band be 650 nanometers~1100 nanometers, first Filtering apparatus 111 can make wavelength pass through positioned at 380 nanometers~650 nanometers of visible light and wavelength be located at 900 nanometers~ 1100 nanometers of near infrared light passes through, and wavelength is stopped to be located at 650 nanometers~900 nanometers of near infrared light.It that is to say, first band Width is 1000 nanometers and subtracts 900 nanometers, i.e., 100 nanometers.Second band width is 900 nanometers and subtracts 650 nanometers, in addition 1100 Nanometer subtracts 1000 nanometers, i.e., 350 nanometers.100 nanometers less than 350 nanometers, that is, pass through the near infrared light of the first filtering apparatus 111 Waveband width less than the near infrared light that the first filtering apparatus 111 stops waveband width.Relation above curve is only that one kind is shown Example, for different filter parts, can be different by the wavelength band of the nearly red spectral band of filter part, filtered The wavelength band of the near infrared light of light member obstruction can also be different.
In order to avoid passing through the wave band of the near infrared light of the first filtering apparatus 111 within the period of non-near-infrared light filling Width is wide and introduces wavelength interference, and in some embodiments, above-mentioned constraint condition may include: by the first filtering apparatus The half-band width of 111 near infrared light is less than or equal to 50 nanometers.Wherein, half-band width refers to the near infrared light that percent of pass is greater than 50% Waveband width.
In order to avoid introducing wavelength interference, In by the way that the waveband width of the near infrared light of the first filtering apparatus 111 is wide In some embodiments, above-mentioned constraint condition may include: that third waveband width can be less than with reference to waveband width.Wherein, third Waveband width refers to that percent of pass is greater than the waveband width of the near infrared light of setting ratio, as an example, with reference to waveband width It can be any waveband width in 50 nanometers~100 nanometers of wavelength band.Setting ratio can be in 30%~50% Any proportion, certain setting ratio can also be set as other ratios according to use demand, and the embodiment of the present application does not limit this It is fixed.In other words, the waveband width that percent of pass is greater than the near infrared light of setting ratio, which can be less than, refers to waveband width.
For example, with reference to Figure 10, it is incident on the wave band of the near infrared light of the first filtering apparatus 111 and is received for 650 nanometers~1100 Rice, setting ratio 30% are 100 nanometers with reference to waveband width.From fig. 10 it can be seen that at 650 nanometers~1100 nanometers In the wave band of near infrared light, the waveband width of near infrared light of the percent of pass greater than 30% is significantly less than 100 nanometers.
As a kind of possible implementation, since human eye is easy to carry out light filling component 2 into the color of near infrared light light filling Obscure with the color of the red light in traffic lights, so, as shown in figure 11, light filling component 2 can also include the second light compensating apparatus 22, Second light compensating apparatus 22 is for carrying out visible light light filling.In this way, if the second light compensating apparatus 22 is at least in the part of the second exposure Time for exposure provides visible light light filling, that is to say, at least there are near-infrared light fillings within the Partial exposure period of the second exposure With visible light light filling, the blend color of both light can be different from the color of the red light in traffic lights, so as to avoid human eye The color that light filling component 2 is carried out to the red light in the color and traffic lights of near-infrared light filling is obscured.In addition, if the second light filling fills It sets 22 and provides visible light light filling in the exposure period of the first exposure, due to visible light in the exposure period of the first exposure Intensity be not it is especially high, therefore, first exposure exposure period in carry out visible light light filling when, the first figure can also be improved As the brightness of the visible light in signal, and then guarantee the quality of Image Acquisition.
In some embodiments, the second light compensating apparatus 22 can be used for carrying out visible light light filling in a manner of being always on;Alternatively, the Two light compensating apparatus 22 can be used for carrying out visible light light filling with strobe mode, wherein at least in the Partial exposure of the second exposure Between there are visible light light fillings in section, visible light light filling is not present in the entire exposure period of the first exposure;Alternatively, second mends Electro-optical device 22 can be used for carrying out visible light light filling with strobe mode, wherein at least in the entire exposure period of the second exposure Interior that visible light light filling is not present, there are visible light light fillings within the Partial exposure period of the first exposure.When the second light compensating apparatus 22 in a manner of being always on when carrying out visible light light filling, not only the first light compensating apparatus 21 can be carried out near-infrared light filling to avoid human eye Color and the color of the red light in traffic lights are obscured, and can also improve with the brightness of the visible light in picture signal, Jin Erbao Demonstrate,prove the quality of Image Acquisition.It, can be to avoid human eye by the when the second light compensating apparatus 22 carries out visible light light filling with strobe mode The color that one light compensating apparatus 21 carries out the red light in the color and traffic lights of near-infrared light filling is obscured, alternatively, can be improved first The brightness of visible light in picture signal, and then guarantee the quality of Image Acquisition, but also can reduce by the second light compensating apparatus 22 Light filling number, thus extend the second light compensating apparatus 22 service life.
As a kind of possible implementation, as shown in figure 12, filter part 11 further includes the second filtering apparatus 112 and cuts 113 (not shown) of component is changed, the first filtering apparatus 111 and the second filtering apparatus 112 connect with switching part 113, cut Component 113 is changed, for the second filtering apparatus 112 to be switched to the incident side of imaging sensor 12;It is cut in the second filtering apparatus 112 It changes to after the incident side of imaging sensor 12, the second filtering apparatus 112 passes through the light of visible light wave range, stops near infrared light The light of wave band, imaging sensor 12, for being generated by exposure and exporting third picture signal.
In this way, when the visual intensity in environment light is weaker, such as night, 21 stroboscopic of the first light compensating apparatus can be passed through The light filling of formula, the first filter 111 can be such that visible light and part near infrared light passes through, make imaging sensor 12 generate and it is defeated Out comprising the second picture signal of near-infrared luminance information, and the first picture signal comprising visible light luminance information, and by It is obtained in the first picture signal and the second picture signal by the same imaging sensor 12, so the viewpoint of the first picture signal It is identical as the viewpoint of the second picture signal, to pass through the first picture signal and the available complete outside of the second picture signal The information of scene.When visual intensity is stronger, such as daytime, daytime, the accounting of near infrared light was relatively high, the image of acquisition Color rendition degree is bad, near infrared light can be prevented to pass through by the second filtering apparatus 112, imaging sensor 12 can produce simultaneously The third picture signal comprising visible light luminance information of output, accordingly even when on daytime, can also collect color rendition degree ratio Preferable image, can be efficient, easy no matter daytime or night in other words no matter also can reach the power of visual intensity The realistic colour information of ground acquisition outer scene.
As a kind of possible implementation, the first picture signal is that the first exposure is generated and exported, the second image letter It number can be the second exposure to generate and export, it, can be with after generating and exporting the second picture signal and the first picture signal Second picture signal and the first picture signal are handled.In some cases, the second picture signal and the first picture signal Purposes may be different, so in some embodiments, at least one exposure parameter of the second exposure and the first exposure can not Together.As an example, at least one exposure parameter can include but is not limited to the time for exposure, analog gain, digital gain, One of aperture size is a variety of.Wherein, exposure gain includes analog gain and/or digital gain.
In some embodiments, it is to be understood that compared with the first exposure, when there are near-infrared light filling, image is passed The intensity for the near infrared light that sensor 12 senses is stronger, correspondingly generates and near infrared light that the second picture signal for exporting includes Brightness also can be higher.But the near infrared light of higher brightness is unfavorable for the acquisition of outer scene information.And in some implementations In example, exposure gain is bigger, and the brightness for the picture signal that imaging sensor 12 exports is higher, and exposure gain is smaller, image sensing The brightness for the picture signal that device 12 exports is lower, therefore, in order to guarantee that the brightness of near infrared light that the second picture signal includes exists In suitable range, in the case where the second exposure is different at least one exposure parameter of the first exposure, as an example, The exposure gain of second exposure can be less than the exposure gain of the first exposure.In this way, carrying out near-infrared light filling in light filling component 2 When, the brightness for the near infrared light that imaging sensor 12 generates and the second picture signal for exporting includes, will not because light filling component 2 into Row near-infrared light filling and it is excessively high.
In further embodiments, the time for exposure is longer, and the brightness that the picture signal that imaging sensor 12 obtains includes is got over Height, and motion smear of the object of the movement in outer scene in picture signal is longer;Time for exposure is shorter, image sensing The brightness that the picture signal that device 12 obtains includes is lower, and movement of the object of the movement in outer scene in picture signal It trails shorter.Therefore, in order to guarantee the brightness of near infrared light that the second picture signal includes in suitable range, and external field Motion smear of the object of movement in scape in the second picture signal is shorter.In at least one of the second exposure and the first exposure In the case that exposure parameter is different, as an example, when the time for exposure of the second exposure can be less than the exposure of the first exposure Between.In this way, imaging sensor 12 generates and the second picture signal exported includes when light filling component 2 carries out near-infrared light filling Near infrared light brightness, will not because light filling component 2 carry out near-infrared light filling due to it is excessively high.And the shorter time for exposure makes outside The motion smear that the object of movement in scene occurs in the second picture signal is shorter, to be conducive to the knowledge to Moving Objects Not.Illustratively, the time for exposure of the second exposure is 40 milliseconds, and the time for exposure of the first exposure is 60 milliseconds etc..
It is worth noting that, in some embodiments, when exposure of the exposure gain of the second exposure less than the first exposure increases When beneficial, the time for exposure of the second exposure not only can also be equal to the exposure of the first exposure less than the time for exposure of the first exposure Between light time.Similarly, when time for exposure of the time for exposure of the second exposure less than the first exposure, the exposure gain of the second exposure can With the exposure gain less than the first exposure, the exposure gain of the first exposure can also be equal to.
In further embodiments, the purposes of the second picture signal and the first picture signal can be identical, such as the second figure When being all used for intellectual analysis as signal and the first picture signal, in order to make the face for carrying out intellectual analysis or target during exercise There can be same clarity, the second exposure can be identical at least one exposure parameter of the first exposure.As an example, The time for exposure of second exposure can be equal to the time for exposure of the first exposure, if the time for exposure of the second exposure and the first exposure Time for exposure it is different, it may appear that there are motion smears for time for exposure longer picture signal all the way, lead to two-way picture signal Clarity it is different.Similarly, as another example, the exposure that the exposure gain of the second exposure can be equal to the first exposure increases Benefit.
It is worth noting that, in some embodiments, when the time for exposure of the second exposure being equal to the exposure of the first exposure Between when, second exposure exposure gain can less than first exposure exposure gain, can also be equal to first exposure exposure increase Benefit.Similarly, when the exposure gain of the second exposure is equal to the exposure gain of the first exposure, the time for exposure of the second exposure can be small In the time for exposure of the first exposure, the time for exposure of the first exposure can also be equal to.
As a kind of possible implementation, image collecting device can be video camera, capture machine, face recognition cameras, Reading code camera, in-vehicle camera, panorama details camera etc..
As a kind of possible implementation, in the embodiment of the present disclosure, the description in the channel of imaging sensor 12 is provided:
Imaging sensor 12 includes multiple photosensitive channels, and multiple photosensitive channels include the photosensitive channel R, the photosensitive channel G, B sense At least one of photosensitive channel optical channel, W, multiple photosensitive channels are generated by the exposure of multiple belt-type shutter and export first Picture signal and the second picture signal.Wherein, the photosensitive channel R, for incuding the light of red spectral band and near infrared band, G is photosensitive Channel, for incuding the light of green light band and near infrared band, the photosensitive channel B, for incuding blue wave band and near infrared band Light, the photosensitive channel W, for incuding full wave light.In this way, due to the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, W sense Optical channel can incude the light of near infrared band, as long as so having at least one of above-mentioned photosensitive channel.
As a kind of possible implementation, imaging sensor 12 is red, green, blue and white RGBW sensor, red indigo plant RCCB in vain Any sensor in sensor, RGB RGB sensor or reddish yellow champac RYYB sensor;Wherein, R indicates that R is photosensitive logical Road, G indicate the photosensitive channel G, and B indicates the photosensitive channel B, and W indicates the photosensitive channel W.As shown in figure 13, imaging sensor 12 can be RGBW sensor, alternatively, as shown in figure 14, imaging sensor 12 can be RCCB sensor, alternatively, as shown in figure 15, image Sensor 12 can be RGB sensor, alternatively, as shown in figure 16, imaging sensor 16 can be RYYB sensor.
When carry out first exposes or carries out the second exposure, the photosensitive channel of each of channel array can be used for incuding one kind The light of color.Channel array for RGBW sensor includes red, green, blue, Bai Si kind color receptor channel, the photosensitive channel pair R The induced quantum efficiency of red light in red optical band is higher, induction of the photosensitive channel G to the green light in green optical band Quantum efficiency is higher, and the photosensitive channel B is higher to the induced quantum efficiency of the blue light in blue optical band, and the photosensitive channel W of W is to complete The induced quantum efficiency of white light in wave band is higher.
In further embodiments, some photosensitive channels can also only incude the light of near infrared band, visible without incuding The light of optical band.As an example, multiple photosensitive channel may include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, At least two in the photosensitive channel IR.Wherein, the photosensitive channel R is used to incude the light of red spectral band and near infrared band, and G is photosensitive logical Road is used to incude the light of green light band and near infrared band, and the photosensitive channel B is used to incude the light of blue wave band and near infrared band, The photosensitive channel IR is used to incude the light of near infrared band.
Illustratively, imaging sensor 12 can be RGBIR sensor, wherein each IR in RGBIR sensor is photosensitive logical Road can incude the light of near infrared band, the light without incuding visible light wave range.
Wherein, when imaging sensor 12 is RGB sensor, compared to other imaging sensors, such as RGBIR sensor RGB information Deng the acquisition of, RGB sensor is more complete, some photosensitive channel of RGBIR sensor does not acquire visible light, So the color detail of the image of RGB sensor acquisition is more acurrate.
It is worth noting that, multiple photosensitive channels that imaging sensor 01 includes can correspond to a plurality of induction curve.Example Property, referring to Figure 17, R-curve representative image sensor 12 in Figure 17 represents the induction curve of the light of red spectral band, G curve Induction curve of the imaging sensor 01 to the light of green light band, sense of the B curve representative image sensor 12 to the light of blue wave band Curve is answered, W (or C) curve representative image sensor 12 incudes the induction curve of full wave light, NIR (Near Infrared, near infrared light) curve representative image sensor 12 incude near infrared band light induction curve.
It include multiple exposure cycles, each exposure in multiple belt-type shutter exposure as a kind of possible implementation It include the first exposure and at least once the second exposure at least once in period, that is to say, that the first exposure can be handed over the second exposure For progress, it is also possible to the exposure of continuous several times first, then carries out the second exposure or continuous several times second expose, then carries out the One exposure.For example, exposure cycle is 1 second, imaging sensor 12 carries out multiple exposure in each exposure cycle, to generate extremely Few first picture signal of frame and at least second picture signal of frame, by the first picture signal generated in an exposure cycle with Second picture signal is known as one group of picture signal, in this way, will generate 25 groups of picture signals in 25 exposure cycles.
Wherein, when each exposure cycle includes one time first exposure and one time second exposure, multiple belt-type shutter exposure In first exposure and second exposure put in order including at least following several:
The first possible implementation includes one time first exposure and one time second exposure, row in each exposure cycle Column sequence is the first exposure, the second exposure.For example, as shown in figure 18, the 1st exposure, the 3rd in multiple belt-type shutter exposure The odd-times exposures such as secondary exposure, the 5th exposure are the first exposure, the even numbers such as the 2nd exposure, the 4th exposure, the 6th exposure Secondary exposure is the second exposure.
Second of possible implementation includes one time first exposure and one time second exposure, row in each exposure cycle Column sequence is the second exposure, the first exposure.For example, as shown in figure 19, the 1st exposure, the 3rd in multiple belt-type shutter exposure The odd-times exposures such as secondary exposure, the 5th exposure are the second exposure, the even numbers such as the 2nd exposure, the 4th exposure, the 6th exposure Secondary exposure is the first exposure.
Wherein, as shown in figure 20, each exposure cycle include twice first exposure and one time second exposure, put in order for First exposure, the first exposure, second expose, and the first exposure and the second putting in order for exposure can in multiple belt-type shutter exposure Think the first exposure, the first exposure, the second exposure, the first exposure, the first exposure, second exposure etc..
In addition, each exposure cycle includes the second exposure twice and one time first exposure, put in order as the second exposure, the Two exposures, the first exposure, the first exposure and putting in order for the second exposure can expose for second in the exposure of multiple belt-type shutter Light, the second exposure, the first exposure, the second exposure, the second exposure, first exposure etc..
It should be noted that the above-mentioned possible implementation for providing only several first exposures and the second exposure, practical In, above-mentioned several possible implementations are not limited to, the embodiment of the present disclosure does not limit this.
As a kind of possible implementation, it can be based on environment light, adjust the time for exposure, corresponding processing can be as Under:
When the brightness of environment light is less than the first numerical value, if carrying out the exposure in the exposure parameter used when the first exposure Time is not second value, then controls time for exposure when carrying out the first exposure in the exposure parameter that uses and be updated to the second number Value controls progress second and exposes if the time for exposure carried out in the exposure parameter used when the second exposure is not third value The time for exposure in exposure parameter that light time uses is updated to third value;When the brightness of environment light is greater than or equal to the first numerical value When, if the time for exposure carried out in the exposure parameter used when the first exposure is not the 4th numerical value, controls progress first and expose The time for exposure in exposure parameter that light time uses is updated to the 4th numerical value, if carrying out the exposure parameter used when the second exposure In time for exposure be not the 5th numerical value, then controlling time for exposure when carrying out the second exposure in the exposure parameter that uses is updated to 5th numerical value, wherein second value is greater than the 4th numerical value, and third value is less than the 5th numerical value.
Wherein, the first numerical value, second value, third value, the 4th numerical value and the 5th numerical value can be arranged in advance, storage In image collecting device.Second value is greater than the 4th numerical value, and third value is less than the 5th numerical value.
In an implementation, when being exposed, imaging sensor 12 can determine the brightness of current environment light, can be and pass through Light sensor detects to obtain, and judges the brightness of environment light and the size of the first numerical value.It is counted in the brightness of environment light less than first When value, if carrying out time for exposure for using when the first exposure is not second value, controls and used when the first exposure Time for exposure is updated to second value, and the time for exposure just used later is second value, and if carries out the second exposure The time for exposure of Shi Caiyong is not third value, then controls time for exposure for using when carrying out the second exposure and be updated to third number Value.For example, the time for exposure of general first exposure is 10 milliseconds, the time for exposure of the second exposure is 15 milliseconds, in environment light When brightness is less than the first numerical value, the time for exposure of the first exposure can be updated to 15 milliseconds, and time for exposure of the second exposure can be with 10 milliseconds are updated to, in this way, when environmental light brightness is lower the time for exposure of the first exposure appropriate can be extended, and fit When shortening second expose time for exposure, color, clarity and the signal-to-noise ratio of the first picture signal can be made to increase.It is above-mentioned It is updated to second value and third value, usually makes the total exposure time of multiple belt-type shutter exposure constant.
When the brightness of environment light is greater than or equal to the first numerical value, if carrying out the time for exposure used when the first exposure not It is the 4th numerical value, then controlling time for exposure for using when carrying out the first exposure is updated to the 4th numerical value, and if carries out second The time for exposure used when exposure is not the 5th numerical value, then controls time for exposure for using when carrying out the second exposure and be updated to the 5th Numerical value.
In this way, light than it is darker when, prolonging exposure time appropriate, can make obtain the first picture carrier ratio It is higher, it, the shortening time for exposure appropriate, can be to avoid overexposure when light is brighter.
As a kind of possible implementation, before carrying out image taking, divide in imaging sensor 12, light filling component 2 It has not been configured and when has carried out the first exposure, when carrying out the second exposure, and configuring good exposure every time, 2 He of light filling component The processing mode of imaging sensor 12 respectively, in this way, imaging sensor 12 and light filling component 2 can respectively in the first exposure, Respectively execute the processing of oneself.For example, light filling component 2 is closed at 10 milliseconds, and imaging sensor 12 acquires the first image Signal.
It can also include one in the image collecting device in the embodiment of the present disclosure as a kind of possible implementation Controller, controller is electrically connected respectively with image acquisition component 1, light filling component 2 namely controller can be adopted with image respectively Collect component 1, light filling component 2 is electrically connected.Controller can control when imaging sensor 12 starts the first exposure, when start Second exposure, to realize the first exposure and the second exposure.
As a kind of possible implementation, it can be controlled and when be opened by manually mode in the embodiment of the present disclosure When light filling component 2 closes light filling component 2.
It should be noted that the sensor is only for example, it is all to can be used for incuding at least one induction red, green, blue Middle a kind of visible light and for incuding near infrared light, can be applied to the embodiment of the present disclosure.
It should be noted that when the time for exposure mentioned in disclosure implementation each means the exposure of every row when each exposure Between namely second exposure time for exposure be 10 milliseconds when, second exposure generate the second picture signal every a line effectively figure As the time for exposure of signal is 10 milliseconds.
It should also be noted that, stroboscopic refers to light compensating lamp unlatching when the second exposure carries out near-infrared light filling, in the first exposure When close, the flashing of formation.
In the embodiment of the present disclosure, when controlling the near-infrared light filling of light filling component using the exposure time series of imaging sensor Sequence, so as to there are passing through the second exposure when near-infrared light filling to generate the second picture signal, by the when near-infrared light filling is not present One exposure generates the first picture signal, such data acquisition modes, can it is simple in structure, directly adopt while reduce cost Collect the first picture signal and the second picture signal, namely two different images can be obtained by an imaging sensor Signal reduces so that the image collecting device is easier and realizes difficulty.Also, the first picture signal and the second picture signal It is generated and is exported by the same imaging sensor, so the corresponding viewpoint of the first picture signal is corresponding with the second picture signal Viewpoint is identical, therefore, can obtain the information of outer scene jointly by the first picture signal and the second picture signal, and will not In the presence of because the corresponding viewpoint of the first picture signal viewpoint corresponding with the second picture signal it is not identical, and cause according to the first image The image that signal and the second picture signal generate is misaligned.
It should be noted that above-mentioned image collecting device can be applied to any the first picture signal of determination and the second image In the scene of signal, the embodiment of the present disclosure is without limitation.
In the embodiment of the present disclosure, a kind of method of Image Acquisition is additionally provided, is applied to above-mentioned image collecting device, image Acquisition device includes: imaging sensor, light aid component and filter part, and light filling component includes the first light compensating apparatus, optical filtering portion Part includes the first filtering apparatus, and as shown in figure 21, the execution process of this method can be such that
Step 2101, near-infrared light filling is carried out by the first light compensating apparatus, wherein in the first exposure without near-infrared Light filling, second exposure when carry out near-infrared light filling, second exposure when carry out near-infrared light filling at the beginning of be according at least to First moment determine, second exposure when carry out near-infrared light filling finish time be to be determined according at least to the second moment.
Step 2102, pass through visible light and part near infrared light by the first filtering apparatus.
Step 2103, by imaging sensor carry out the exposure of multiple belt-type shutter incude and export the first picture signal and Second picture signal, wherein the first picture signal is the picture signal generated according to the first exposure, and the second picture signal is basis The picture signal that second exposure generates;First picture signal includes multirow effective picture signal, and the second picture signal includes multirow Effective picture signal, second exposure be current exposure when, the first moment be current exposure before the last time first exposure production The end time of exposure of the last line effective picture signal of the first raw picture signal, after the second moment was current exposure The beginning time of exposure of the first row effective picture signal for the first picture signal that the first exposure of the last time generates.
As a kind of possible implementation, when the second exposure, is carried out at the beginning of near-infrared light filling when being no earlier than first It carves, the second finish time that near-infrared light filling is carried out when exposing was not later than for the second moment.
As a kind of possible implementation, when the second exposure, is carried out at the beginning of near-infrared light filling when being according to first What quarter and third moment determined, the third moment is the first row effective picture signal for the second picture signal that current exposure generates Terminate the time of exposure, wherein the first moment was not later than the third moment.
As a kind of possible implementation, when the second exposure, is carried out at the beginning of near-infrared light filling when being no earlier than first It carves, and is not later than the third moment.
As a kind of possible implementation, when the second exposure, carries out the finish time of near-infrared light filling when being according to second What quarter and the 4th moment determined, the 4th moment was the last line effective picture signal for the second picture signal that current exposure generates The beginning time of exposure, wherein the 4th moment was not later than for the second moment.
As a kind of possible implementation, when the second finish time for carrying out near-infrared light filling when exposing was no earlier than the 4th It carves, and was not later than for the second moment.
Include multiple exposure cycles in multiple belt-type shutter exposure, is exposed in each exposure cycle including at least once first Light and at least once the second exposure.
As a kind of possible implementation, image acquisition component further includes camera lens;
Filter part is between camera lens and imaging sensor, and imaging sensor is located at the light emission side of filter part;Or Person,
Camera lens is between filter part and imaging sensor, and imaging sensor is located at the light emission side of camera lens.
As a kind of possible implementation, imaging sensor includes multiple photosensitive channels, and multiple photosensitive channels include R sense At least one of the photosensitive channel optical channel, G, the photosensitive channel B, the photosensitive channel W, multiple photosensitive channels are fast by multiple roller shutter type Exposure gate generates and exports the first picture signal and the second picture signal;
Wherein, the photosensitive channel R, for incuding the light of red spectral band and near infrared band, the photosensitive channel G is green for incuding The light of optical band and near infrared band, the photosensitive channel B, for incuding the light of blue wave band and near infrared band, the photosensitive channel W, For incuding full wave light.
As a kind of possible implementation, imaging sensor is red, green, blue and white RGBW sensor, red indigo plant RCCB in vain biography Any sensor in sensor, RGB RGB sensor or reddish yellow champac RYYB sensor;
Wherein, R indicates the photosensitive channel R, and G indicates the photosensitive channel G, and B indicates the photosensitive channel B, and W indicates the photosensitive channel W.
As a kind of possible implementation, the first exposure is different from least one exposure parameter of the second exposure, at least One exposure parameter is one of time for exposure, exposure gain, aperture size or a variety of, and exposure gain includes analog gain, And/or digital gain.
As a kind of possible implementation, exposure gain of second exposure gain exposed less than the first exposure.
As a kind of possible implementation, the first exposure is identical at least one exposure parameter of the second exposure, at least One exposure parameter includes one of time for exposure, exposure gain, aperture size or a variety of, and exposure gain includes that simulation increases Benefit, and/or, digital gain.
As a kind of possible implementation, the time for exposure of the first exposure is equal to the time for exposure of the second exposure.
As a kind of possible implementation, filter part further includes the second filtering apparatus and switching part, and first filters Device and the second filtering apparatus are connect with switching part;
Switching part, for the second filtering apparatus to be switched to the incident side of imaging sensor;
After the second filtering apparatus is switched to the incident side of imaging sensor, the second filtering apparatus makes visible light wave range Light passes through, and stops the light of near infrared light wave band, imaging sensor, for generating by exposure and exporting third picture signal.
As a kind of possible implementation, light filling component further includes the second light compensating apparatus;
Second light compensating apparatus in a manner of being always on for carrying out visible light light filling;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least exposes in the part of the second exposure There are visible light light fillings in the light period, and visible light light filling is not present in the entire exposure period of the first exposure;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the entire exposure of the second exposure Visible light light filling is not present in the light period, there are visible light light fillings within the Partial exposure period of the first exposure.
As a kind of possible implementation, the central wavelength that the first light compensating apparatus carries out near-infrared light filling is setting feature Wavelength or fall in setting characteristic wavelength range when, pass through the central wavelength and/or wave band of the near infrared light of the first filtering apparatus Width reaches constraint condition.
As a kind of possible implementation, the central wavelength that the first light compensating apparatus carries out near-infrared light filling is 750 ± 10 Any wavelength in the wave-length coverage of nanometer;Or
First light compensating apparatus carries out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers It is long;Or
First light compensating apparatus carries out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers It is long.
As a kind of possible implementation, constraint condition includes: the center by the near infrared light of the first filtering apparatus The difference that wavelength and the first light compensating apparatus carry out between the central wavelength of near-infrared light filling is located within the scope of wavelength fluctuation, wavelength wave Dynamic range is 0~20 nanometer;Alternatively,
It is less than or equal to 50 nanometers by the half-band width of the near infrared light of the first filtering apparatus;Alternatively,
First band width is less than second band width;Wherein, first band width refers to through the first filtering apparatus The waveband width of near infrared light, second band width refer to the waveband width of the near infrared light stopped by the first filtering apparatus;Or Person,
Third waveband width, which is less than, refers to waveband width, and third waveband width refers to that percent of pass is greater than the close red of setting ratio Any waveband width in wavelength band that the waveband width of outer light is 50 nanometers~150 nanometers with reference to waveband width.
As a kind of possible implementation, setting ratio is any proportion in 30%~50% proportional region.
It should be noted that in processing in the method for Image Acquisition and front image collecting device shown in Fig. 3 into The processing of row exposure is identical, and details are not described herein again.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware Complete, relevant hardware can also be instructed to complete by program, program can store in a kind of computer-readable storage In medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The above is only the preferred embodiments of the disclosure, not to limit the disclosure, all spirit and principle in the disclosure Within, any modification, equivalent replacement, improvement and so on should be included within the protection scope of the disclosure.

Claims (25)

1. a kind of image collecting device, which is characterized in that described image acquisition device includes:
Image acquisition component and light filling component, described image acquisition component include filter part and imaging sensor;
Described image sensor, for exposing induction by multiple belt-type shutter and exporting the first picture signal and the second image Signal, wherein the first image signal is the picture signal generated according to the first exposure, and second picture signal is basis The picture signal that second exposure generates, first exposure and second exposure are in the multiple belt-type shutter exposure Wherein double expose;
The filter part, including the first filtering apparatus pass through visible light and part near infrared light;
The light filling component, including the first light compensating apparatus, first light compensating apparatus are used in the described first exposure, without Near-infrared light filling, and when carrying out the described second exposure, near-infrared light filling is carried out, and carry out near-infrared benefit when second exposure To be determined according at least to the first moment at the beginning of light, described second exposure when carry out near-infrared light filling finish time be It is determined according at least to the second moment;
Wherein, the first image signal includes multirow effective picture signal, and second picture signal includes multirow effectively figure As signal, when second exposure is current exposure, first moment be the current exposure before the last time described in The end time of exposure of the last line effective picture signal for the first picture signal that first exposure generates, second moment is The first row effective picture signal for the first picture signal that the last time first exposure after the current exposure generates The beginning time of exposure.
2. image collecting device according to claim 1, which is characterized in that carry out near-infrared light filling when the described second exposure At the beginning of be no earlier than first moment, the finish time that when the described second exposure carries out near-infrared light filling is not later than described Second moment.
3. image collecting device according to claim 1, which is characterized in that carry out near-infrared light filling when the described second exposure At the beginning of be to be determined according to first moment and third moment, the third moment is that the current exposure generates The end time of exposure of the first row effective picture signal of second picture signal;When first moment is not later than the third It carves.
4. image collecting device according to claim 3, which is characterized in that carry out near-infrared light filling when the described second exposure At the beginning of be no earlier than first moment, and be not later than the third moment.
5. image collecting device according to claim 1, which is characterized in that carry out near-infrared light filling when the described second exposure Finish time be to be determined according to second moment and the 4th moment, the 4th moment is that the current exposure generates The beginning time of exposure of the last line effective picture signal of second picture signal;When 4th moment is not later than described second It carves.
6. image collecting device according to claim 5, which is characterized in that carry out near-infrared light filling when the described second exposure Finish time be no earlier than the 4th moment, and be not later than second moment.
7. image collecting device according to any one of claims 1 to 6, which is characterized in that the multiple belt-type shutter exposes Include multiple exposure cycles in light, includes first exposure and at least once described second at least once in each exposure cycle Exposure.
8. image collecting device according to any one of claims 1 to 6, which is characterized in that described image acquisition component is also wrapped Include camera lens;
The filter part is between the camera lens and described image sensor, and described image sensor is located at the optical filtering The light emission side of component;Alternatively,
The camera lens is between the filter part and imaging sensor, and described image sensor is located at going out for the camera lens Light side.
9. image collecting device according to any one of claims 1 to 6, which is characterized in that described image sensor includes more A photosensitive channel, the multiple photosensitive channel include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, in the photosensitive channel W extremely Few one kind, the multiple photosensitive channel generated by the multiple belt-type shutter exposure and export the first image signal with Second picture signal;
Wherein, the photosensitive channel R, for incuding the light of red spectral band and near infrared band, the photosensitive channel G, for incuding green light wave The light of section and near infrared band, the photosensitive channel B, for incuding the light of blue wave band and near infrared band, the photosensitive channel W is used for Incude full wave light.
10. image collecting device according to claim 9, which is characterized in that described image sensor is red, green, blue and white Any one of RGBW sensor, the red sensor of indigo plant RCCB in vain, RGB RGB sensor or reddish yellow champac RYYB sensor Sensor;
Wherein, R indicates the photosensitive channel R, and G indicates the photosensitive channel G, and B indicates the photosensitive channel B, and W indicates the photosensitive channel W.
11. image collecting device according to any one of claims 1 to 6, which is characterized in that first exposure and described the At least one exposure parameter of two exposures is different, at least one described exposure parameter is time for exposure, exposure gain, aperture size One of or it is a variety of, the exposure gain includes analog gain, and/or, digital gain.
12. image collecting device according to claim 11, which is characterized in that the exposure gain of second exposure is less than The exposure gain of first exposure.
13. image collecting device according to any one of claims 1 to 6, which is characterized in that first exposure and described the At least one exposure parameter of two exposures is identical, at least one described exposure parameter includes that time for exposure, exposure gain, aperture are big One of small or a variety of, the exposure gain includes analog gain, and/or, digital gain.
14. image collecting device according to claim 13, which is characterized in that the time for exposure of first exposure is equal to The time for exposure of second exposure.
15. image collecting device according to any one of claims 1 to 6, which is characterized in that the filter part further includes Two filtering apparatus and switching part, first filtering apparatus and second filtering apparatus are connect with the switching part;
The switching part, for second filtering apparatus to be switched to the incident side of described image sensor;
After second filtering apparatus is switched to the incident side of described image sensor, second filtering apparatus makes visible The light of optical band passes through, and stops the light of near infrared light wave band, described image sensor, for generating by exposure and exporting third Picture signal.
16. image collecting device according to any one of claims 1 to 6, which is characterized in that the light filling component further includes Two light compensating apparatus;
Second light compensating apparatus in a manner of being always on for carrying out visible light light filling;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the portion of second exposure There are visible light light fillings in point exposure period, and there is no visible lights to mend in the entire exposure period of first exposure Light;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the whole of second exposure Visible light light filling is not present in a exposure period, there are visible light benefits within the Partial exposure period of first exposure Light.
17. image collecting device according to any one of claims 1 to 6, which is characterized in that first light compensating apparatus carries out When the central wavelength of near-infrared light filling is setting characteristic wavelength or falls in setting characteristic wavelength range, filter by described first The central wavelength and/or waveband width of the near infrared light of device reach constraint condition.
18. image collecting device according to claim 17, which is characterized in that first light compensating apparatus carries out near-infrared Any wavelength in wave-length coverage that the central wavelength of light filling is 750 ± 10 nanometers;Or
First light compensating apparatus carries out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers It is long;Or
First light compensating apparatus carries out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers It is long.
19. image collecting device according to claim 17, which is characterized in that the constraint condition includes: by described The central wavelength of the near infrared light of first filtering apparatus and first light compensating apparatus carry out near-infrared light filling central wavelength it Between difference be located within the scope of wavelength fluctuation, the wavelength fluctuation range be 0~20 nanometer;Alternatively,
It is less than or equal to 50 nanometers by the half-band width of the near infrared light of first filtering apparatus;Alternatively,
First band width is less than second band width;Wherein, the first band width refers to filter by described first and fill The waveband width for the near infrared light set, the second band width refer to the near infrared light stopped by first filtering apparatus Waveband width;Alternatively,
Third waveband width, which is less than, refers to waveband width, and the third waveband width refers to that percent of pass is greater than the close red of setting ratio The waveband width of outer light, described with reference to waveband width is any waveband width in 50 nanometers~150 nanometers of wavelength band.
20. a kind of method of Image Acquisition, be applied to image collecting device, described image acquisition device include: imaging sensor, Light aid component and filter part, the light filling component include the first light compensating apparatus, and the filter part includes the first optical filtering dress It sets, which is characterized in that the described method includes:
Pass through first light compensating apparatus and carry out near-infrared light filling, wherein in the first exposure without near-infrared light filling, the Carry out near-infrared light filling when two exposures, when the described second exposure carries out at the beginning of near-infrared light filling when being according at least to first Carve determining, when the described second exposure, which carries out the finish time of near-infrared light filling, to be determined according at least to the second moment;
Pass through visible light and part near infrared light by first filtering apparatus;
Multiple belt-type shutter exposure induction is carried out by described image sensor and exports the first picture signal and the second image Signal, wherein the first image signal is the picture signal generated according to first exposure, and second picture signal is The picture signal generated according to second exposure;
The first image signal includes multirow effective picture signal, and second picture signal includes multirow effective image letter Number, it is described second exposure be current exposure when, first moment be the current exposure before the last time described first The end time of exposure of the last line effective picture signal of the first picture signal generated is exposed, second moment is described The first row effective picture signal for the first picture signal that the last time first exposure after current exposure generates is opened Begin the time of exposure.
21. according to the method for claim 20, which is characterized in that carry out the beginning of near-infrared light filling when the described second exposure Moment is no earlier than first moment, when the described second finish time for carrying out near-infrared light filling when exposing was not later than described second It carves.
22. according to the method for claim 20, which is characterized in that carry out the beginning of near-infrared light filling when the described second exposure Moment was determined according to first moment and third moment, and the third moment is the second figure that the current exposure generates As the end time of exposure of the first row effective picture signal of signal, wherein first moment is not later than the third moment.
23. according to the method for claim 22, which is characterized in that carry out the beginning of near-infrared light filling when the described second exposure Moment is no earlier than first moment, and is not later than the third moment.
24. according to the method for claim 20, which is characterized in that carry out the end of near-infrared light filling when the described second exposure Moment was determined according to second moment and the 4th moment, and the 4th moment is the second figure that the current exposure generates As the beginning time of exposure of the last line effective picture signal of signal, wherein when the 4th moment is not later than described second It carves.
25. according to the method for claim 24, which is characterized in that carry out the end of near-infrared light filling when the described second exposure Moment is no earlier than the 4th moment, and is not later than second moment.
CN201910473497.1A 2019-05-31 2019-05-31 Image acquisition device and image acquisition method Active CN110493495B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910473497.1A CN110493495B (en) 2019-05-31 2019-05-31 Image acquisition device and image acquisition method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910473497.1A CN110493495B (en) 2019-05-31 2019-05-31 Image acquisition device and image acquisition method

Publications (2)

Publication Number Publication Date
CN110493495A true CN110493495A (en) 2019-11-22
CN110493495B CN110493495B (en) 2022-03-08

Family

ID=68545896

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910473497.1A Active CN110493495B (en) 2019-05-31 2019-05-31 Image acquisition device and image acquisition method

Country Status (1)

Country Link
CN (1) CN110493495B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020238806A1 (en) * 2019-05-31 2020-12-03 杭州海康威视数字技术股份有限公司 Image collection apparatus and photography method
WO2020238804A1 (en) * 2019-05-31 2020-12-03 杭州海康威视数字技术股份有限公司 Image acquisition apparatus and image acquisition method
CN113163124A (en) * 2020-01-22 2021-07-23 杭州海康威视数字技术股份有限公司 Imaging system and image processing method
CN113905184A (en) * 2021-09-18 2022-01-07 重庆紫光华山智安科技有限公司 Image acquisition method, device and medium

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202887451U (en) * 2012-10-26 2013-04-17 青岛海信网络科技股份有限公司 Infrared light and visible light filling blended electronic police system
CN203537486U (en) * 2013-11-08 2014-04-09 浙江大华技术股份有限公司 Camera
CN203870381U (en) * 2014-04-28 2014-10-08 浙江宇视科技有限公司 Light filtering device and gun-type camera using light filtering device
CN105144688A (en) * 2013-04-24 2015-12-09 日立麦克赛尔株式会社 Imaging device and imaging system
CN105452911A (en) * 2013-10-17 2016-03-30 Jsr株式会社 Optical filter, solid-state image pickup device, and camera module
CN107005639A (en) * 2014-12-10 2017-08-01 索尼公司 Image pick up equipment, image pickup method, program and image processing equipment
US20170237887A1 (en) * 2014-11-13 2017-08-17 Panasonic Intellectual Property Management Co. Ltd. Imaging device and imaging method
CN107566747A (en) * 2017-09-22 2018-01-09 浙江大华技术股份有限公司 A kind of brightness of image Enhancement Method and device
WO2018079372A1 (en) * 2016-10-28 2018-05-03 京セラ株式会社 Image pickup device, image pickup system, mobile body, and image pickup method
CN108810421A (en) * 2017-05-03 2018-11-13 福特全球技术公司 Improve the vehicle camera performance in low illumination scene using near-infrared luminaire
CN108965654A (en) * 2018-02-11 2018-12-07 浙江宇视科技有限公司 Double spectrum camera systems and image processing method based on single-sensor
CN109194873A (en) * 2018-10-29 2019-01-11 浙江大华技术股份有限公司 A kind of image processing method and device
CN109429001A (en) * 2017-08-25 2019-03-05 杭州海康威视数字技术股份有限公司 Image-pickup method, device, electronic equipment and computer readable storage medium
CN109474788A (en) * 2017-09-08 2019-03-15 超威半导体公司 For colored and IR camera sensor lighting control technique
CN109496424A (en) * 2017-09-30 2019-03-19 深圳市大疆创新科技有限公司 Light supplement control method, light filling control module and unmanned vehicle

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202887451U (en) * 2012-10-26 2013-04-17 青岛海信网络科技股份有限公司 Infrared light and visible light filling blended electronic police system
CN105144688A (en) * 2013-04-24 2015-12-09 日立麦克赛尔株式会社 Imaging device and imaging system
CN105452911A (en) * 2013-10-17 2016-03-30 Jsr株式会社 Optical filter, solid-state image pickup device, and camera module
CN203537486U (en) * 2013-11-08 2014-04-09 浙江大华技术股份有限公司 Camera
CN203870381U (en) * 2014-04-28 2014-10-08 浙江宇视科技有限公司 Light filtering device and gun-type camera using light filtering device
US20170237887A1 (en) * 2014-11-13 2017-08-17 Panasonic Intellectual Property Management Co. Ltd. Imaging device and imaging method
CN107005639A (en) * 2014-12-10 2017-08-01 索尼公司 Image pick up equipment, image pickup method, program and image processing equipment
WO2018079372A1 (en) * 2016-10-28 2018-05-03 京セラ株式会社 Image pickup device, image pickup system, mobile body, and image pickup method
CN108810421A (en) * 2017-05-03 2018-11-13 福特全球技术公司 Improve the vehicle camera performance in low illumination scene using near-infrared luminaire
CN109429001A (en) * 2017-08-25 2019-03-05 杭州海康威视数字技术股份有限公司 Image-pickup method, device, electronic equipment and computer readable storage medium
CN109474788A (en) * 2017-09-08 2019-03-15 超威半导体公司 For colored and IR camera sensor lighting control technique
CN107566747A (en) * 2017-09-22 2018-01-09 浙江大华技术股份有限公司 A kind of brightness of image Enhancement Method and device
CN109496424A (en) * 2017-09-30 2019-03-19 深圳市大疆创新科技有限公司 Light supplement control method, light filling control module and unmanned vehicle
CN108965654A (en) * 2018-02-11 2018-12-07 浙江宇视科技有限公司 Double spectrum camera systems and image processing method based on single-sensor
CN109194873A (en) * 2018-10-29 2019-01-11 浙江大华技术股份有限公司 A kind of image processing method and device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020238806A1 (en) * 2019-05-31 2020-12-03 杭州海康威视数字技术股份有限公司 Image collection apparatus and photography method
WO2020238804A1 (en) * 2019-05-31 2020-12-03 杭州海康威视数字技术股份有限公司 Image acquisition apparatus and image acquisition method
US11889032B2 (en) 2019-05-31 2024-01-30 Hangzhou Hikvision Digital Technology Co., Ltd. Apparatus for acquiring image and method for acquiring image
CN113163124A (en) * 2020-01-22 2021-07-23 杭州海康威视数字技术股份有限公司 Imaging system and image processing method
CN113905184A (en) * 2021-09-18 2022-01-07 重庆紫光华山智安科技有限公司 Image acquisition method, device and medium

Also Published As

Publication number Publication date
CN110493495B (en) 2022-03-08

Similar Documents

Publication Publication Date Title
CN110493536A (en) The method of image collecting device and Image Acquisition
CN110493535A (en) The method of image collecting device and Image Acquisition
CN110493495A (en) The method of image collecting device and Image Acquisition
US8358365B2 (en) Photo detecting device and image pickup device and method thereon
CN110493494A (en) Image fusion device and image interfusion method
CN110519489A (en) Image-pickup method and device
CN110490811A (en) Image noise reduction apparatus and image denoising method
CN110490041A (en) Human face image collecting device and method
CN110493491A (en) A kind of image collecting device and image capture method
CN102687502B (en) Reducing noise in a color image
CN110505377A (en) Image co-registration device and method
CN105046668B (en) The method for producing high dynamic range images
CN108419061A (en) Based on multispectral image co-registration equipment, method and imaging sensor
CN107438170A (en) A kind of image Penetrating Fog method and the image capture device for realizing image Penetrating Fog
CN110490187A (en) Car license recognition equipment and method
CN110490042B (en) Face recognition device and entrance guard's equipment
CN102783135A (en) Method and apparatus for providing a high resolution image using low resolution
CN110490044A (en) Face modelling apparatus and human face model building
CN110493496A (en) Image collecting device and method
JP2004228662A (en) Image pickup apparatus
CN110493537A (en) Image collecting device and image-pickup method
CN109218696A (en) Enhance the method for color image, and executes the component of this method
CN106911919A (en) Color image sensor and coloured image imaging method
CN110493492A (en) Image collecting device and image-pickup method
KR101679293B1 (en) Photo detecting device and image pickup device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant