CN110493496A - Image collecting device and method - Google Patents
Image collecting device and method Download PDFInfo
- Publication number
- CN110493496A CN110493496A CN201910517680.7A CN201910517680A CN110493496A CN 110493496 A CN110493496 A CN 110493496A CN 201910517680 A CN201910517680 A CN 201910517680A CN 110493496 A CN110493496 A CN 110493496A
- Authority
- CN
- China
- Prior art keywords
- exposure
- light
- picture signal
- image
- infrared light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
This application discloses a kind of image collecting device and method, which includes: imaging sensor, light aid and filtering assembly, and light aid includes the first light compensating apparatus, and filtering assembly includes the first optical filter.There are near-infrared light fillings at least within the Partial exposure period of the first default exposure for first light compensating apparatus, near-infrared light filling are not present in the exposure period of the second default exposure, the first optical filter passes through visible light and part near infrared light.Imaging sensor carries out multiple exposure using the global Exposure mode that starts, and generates and export the first picture signal in the exposure period of the first default exposure, generates in the exposure period of the second default exposure and exports the second picture signal.The present embodiment carries out multiple exposure by imaging sensor, so that the image collecting device is more flexible.
Description
Technical field
The invention relates to computer vision field more particularly to a kind of image collecting device and methods.
Background technique
With the rapid development of science and technology, security protection product has been applied to every field, for example, government department,
Large enterprise, community and family.Specifically, monitoring system belongs to the important component of security protection product, and Image Acquisition
Source can be provided for subsequent data analysis, to realize the different demands of various application scenarios.
Currently, image capturing system generally includes: camera lens, optical filter, light aid and imaging sensor, light pass through mirror
The filtering of light is carried out after head by switching device of optical fiber, and is imaged on the image sensor, image is generated by imaging sensor
Signal simultaneously exports, wherein when light compensating lamp is opened, optical filter is switched to all-pass optical filter, for acquiring near-infrared light filling image;
When light compensating lamp is closed, optical filter is switched to infrared fileter, for acquiring visible images.
However, switched between near-infrared light filling image and visible images by the image that optical filter acquires, so that
Two kinds of images can not be acquired in a period of time simultaneously, reduce the flexibility of Image Acquisition.
Summary of the invention
The embodiment of the present application provides a kind of image collecting device and method, can not be acquired simultaneously whithin a period of time with overcoming
The problem of near-infrared light filling image and visible images.
In a first aspect, the embodiment of the present application provides a kind of image collecting device, comprising: imaging sensor, light aid and filter
Optical assembly, described image sensor are located at the light emission side of the filtering assembly;
Described image sensor, at least first picture signal of frame and at least one to be generated and exported by multiple exposure
The second picture signal of frame, wherein the first image signal is that the picture signal for exposing generation is preset according to first, described second
Picture signal is the picture signal generated according to the second default exposure, and the described first default exposure and the described second default exposure are
Wherein double exposure in the multiple exposure, described image sensor are used to repeatedly be exposed using the global Exposure mode that starts
Light, described first presets in the exposure period of exposure, and the exposure of all row effective images of the first image signal starts
Moment is identical, and the end exposure moment of at least two row effective images of the first image signal is different, the described second default exposure
In the exposure period of light, the exposure start time of all row effective images of second picture signal is identical, and described second
The end exposure moment of at least two row effective images of picture signal is different;
The light aid includes the first light compensating apparatus, and first light compensating apparatus is for carrying out near-infrared light filling, wherein extremely
Few there are near-infrared light fillings within the Partial exposure period of the described first default exposure, in the entire of the described second default exposure
Near-infrared light filling is not present in exposure period;
The filtering assembly includes the first optical filter, and first optical filter passes through visible light and part near infrared light.
Optionally, the nearest frame before being later than present frame at the beginning of the near-infrared light filling of first light compensating apparatus
The end exposure moment of all row effective images of second picture signal, at the end of the near-infrared light filling of first light compensating apparatus
Carve the exposure start time earlier than nearest the second picture signal of frame any row effective image after present frame.
Optionally, the end exposure moment of all row effective images of the first image signal is different;
The end exposure moment of all row effective images of second picture signal is different.
Optionally, in the corresponding every frame image signal of described image sensor, the exposure knot between adjacent rows effective image
The difference at beam moment is less than 40 microseconds.
Optionally, the nearest frame before being later than present frame at the beginning of the near-infrared light filling of first light compensating apparatus
The end exposure moment of second picture signal last line effective image, the near-infrared light filling of first light compensating apparatus it is close red
The finish time of outer light filling is earlier than or equal to nearest the second picture signal of frame any row effective image after present frame
Expose start time.
Optionally, be later than at the beginning of the near-infrared light filling of first light compensating apparatus or equal to present frame before
The near-infrared at the end exposure moment of nearest the second picture signal of frame last line effective image, first light compensating apparatus is mended
The finish time of light earlier than or equal to nearest the second picture signal of frame any row effective image after present frame exposure
Start time and end exposure moment earlier than or equal to present frame the first picture signal the first row effective image.
Optionally, the described first default exposure is including continuous exposure twice to generate the first picture signal of two continuous frames, institute
Stating the second default exposure includes single exposure to generate second picture signal of frame;
It is later than or is equal to the current first default exposure at the beginning of the near-infrared light filling of first light compensating apparatus
The end exposure moment of preceding nearest the second picture signal of frame last line effective image, first light compensating apparatus it is close red
The finish time of outer light filling presets nearest the second picture signal of frame any row after exposure earlier than or equal to current first
The exposure start time of effective image.
Optionally, the described first default exposure is including continuous exposure twice to generate the first picture signal of two continuous frames, institute
Stating the second default exposure includes single exposure, to generate second picture signal of frame;
It is later than at the beginning of the near-infrared light filling that first light compensating apparatus exposes for the first time in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
Moment, finish time of the near-infrared light filling that first light compensating apparatus exposes for the first time in continuous exposure twice earlier than or
Equal to the end exposure moment of the first picture signal the first row effective image of the current first default exposure;And
First light compensating apparatus is later than at the beginning of the near-infrared light filling of second of exposure in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
The exposure knot of moment and nearest the first picture signal of the frame last line effective image being later than before the current first default exposure
The finish time at beam moment, first light compensating apparatus near-infrared light filling of second of exposure in the continuous exposure twice is early
In or equal to the current first default exposure the first picture signal the first row effective image the end exposure moment.
Optionally, pass through the near infrared light of first optical filter when first light compensating apparatus carries out near infrared light light filling
Intensity be higher than when first light compensating apparatus does not carry out near-infrared light filling through the strong of the near infrared light of first optical filter
Degree.
Optionally, the filtering assembly further includes the second optical filter and switching part, first optical filter and described
Two optical filters are connect with the switching part;
The switching part, for second optical filter to be switched to the incident side of described image sensor;
After second optical filter is switched to the incident side of described image sensor, second optical filter makes visible
The light of optical band passes through, and stops the light of near infrared light wave band, described image sensor, for generating by exposure and exporting third
Picture signal.
Optionally, the wavelength band for being incident on the near infrared light of first optical filter is first with reference to wavelength band, institute
It is 650 nanometers~1100 nanometers that first, which is stated, with reference to wavelength band.
Optionally, it is to set characteristic wavelength or fall in that first light compensating apparatus, which carries out the central wavelength of near-infrared light filling,
When setting characteristic wavelength range, reached about by the central wavelength and/or waveband width of the near infrared light of first optical filter
Beam condition.
Optionally, first light compensating apparatus carries out the wavelength model that the central wavelength of near-infrared light filling is 750 ± 10 nanometers
Enclose interior any wavelength;Or
First light compensating apparatus carries out appointing in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers
One wavelength;Or
First light compensating apparatus carries out appointing in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers
One wavelength;Or
First light compensating apparatus (021) carries out the wavelength that the central wavelength of near-infrared light filling is 810 ± 10 nanometers.
Optionally, the constraint condition includes:
It is less than or equal to 50 nanometers by the half-band width of the near infrared light of first optical filter;Or
First band width is less than second band width;Wherein, the first band width refers to filters by described first
The waveband width of the near infrared light of mating plate, the second band width refer to by the near infrared light of first filter blocks
Waveband width;Or
Third waveband width, which is less than, refers to waveband width, and the third waveband width refers to that percent of pass is greater than setting ratio
The waveband width of near infrared light, any wave band in the wavelength band that 50 nanometers~150 nanometers are referred to reference to waveband width
Width.
Optionally, any proportion in proportional region that the setting ratio is 30%~50%.
Optionally, the described first default exposure is different from least one exposure parameter of the described second default exposure, described
At least one exposure parameter is one of time for exposure, exposure gain, aperture size or a variety of, and the exposure gain includes mould
Quasi- gain, and/or, digital gain.
Optionally, the exposure gain of the described first default exposure is less than the exposure gain of the described second default exposure.
Optionally, described image sensor includes multiple photosensitive channels, and each photosensitive channel can for incuding at least one
The light of light-exposed wave band, and the light of induction near infrared band.
Optionally, the multiple photosensitive channel is used to incude the light of at least two different visible light wave ranges.
Optionally, described image sensor includes multiple photosensitive channels, and the multiple photosensitive channel includes the photosensitive channel R, G
At least two in photosensitive channel, the photosensitive channel B, the photosensitive channel Y, the photosensitive channel W and the photosensitive channel C;
Wherein, the photosensitive channel R is used to incude the light of red spectral band and near infrared band, and the photosensitive channel G is for incuding green light
The light of wave band and near infrared band, the photosensitive channel B are used to incude the light of blue wave band and near infrared band, and the photosensitive channel Y is used for
Incude the light of yellow band and near infrared band, for incuding full wave light, the photosensitive channel C is complete for incuding in the photosensitive channel W
The light of wave band.
Optionally, described image sensor is RGB RGB sensor, red, green, blue and white RGBW sensor or red blue in vain
RCCB sensor or reddish yellow champac RYYB sensor.
Optionally, the light aid further includes the second light compensating apparatus, and second light compensating apparatus is for carrying out visible light benefit
Light.
Optionally, second light compensating apparatus in a manner of being always on for carrying out visible light light filling;Alternatively,
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least default described first
There are visible light light fillings in the Partial exposure period of exposure, do not deposit in the entire exposure period of the described second default exposure
In visible light light filling;Or
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least default described first
Visible light light filling is not present in the entire exposure period of exposure, in the Partial exposure period memory of the described second default exposure
In visible light light filling.
Second aspect provides a kind of image-pickup method, is applied to image collecting device, described image acquisition device packet
Imaging sensor, light aid and filtering assembly are included, the light aid includes the first light compensating apparatus, and the filtering assembly includes first
Optical filter, described image sensor are located at the light emission side of the filtering assembly, which comprises
Near-infrared light filling is carried out by the first light compensating apparatus, the strobe mode refers at least in the portion of the first default exposure
There are near-infrared light fillings in point exposure period, and near-infrared light filling, institute is not present in the exposure period of the second default exposure
It states the first default exposure and the described second default exposure is the wherein double exposure in the multiple exposure;
Pass through visible light and part near infrared light by first optical filter;
Multiple exposure is carried out by described image sensor, to generate and export at least first picture signal of frame and at least
One the second picture signal of frame, the first image signal are the picture signals generated according to the described first default exposure, described the
Two picture signals are the picture signals generated according to the described second default exposure, and described image sensor using the overall situation for being started
Exposure mode carries out multiple exposure, and described first presets in the exposure period of exposure, all rows of the first image signal
The exposure start time of effective image is identical, and the end exposure moment of at least two row effective images of the first image signal is not
Together, in the exposure period of the described second default exposure, the exposure of all row effective images of second picture signal starts
Moment is identical, and the end exposure moment of at least two row effective images of second picture signal is different.
Optionally, the nearest frame before being later than present frame at the beginning of the near-infrared light filling of first light compensating apparatus
The end exposure moment of all row effective images of second picture signal, the finish time of the first light compensating apparatus near-infrared light filling
Earlier than the exposure start time of nearest the second picture signal of frame any row effective image after present frame.
Optionally, the end exposure moment of all row effective images of the first image signal is different;
The end exposure moment of all row effective images of second picture signal is different.
Optionally, in the corresponding every frame image signal of described image sensor, the exposure knot between adjacent rows effective image
The difference at beam moment is less than 40 microseconds.
Optionally, the nearest frame before being later than present frame at the beginning of the near-infrared light filling of first light compensating apparatus
The end exposure moment of second picture signal last line effective image, the near-infrared light filling of first light compensating apparatus it is close red
The finish time of outer light filling is earlier than or equal to nearest the second picture signal of frame any row effective image after present frame
Expose start time.
Optionally, be later than at the beginning of the near-infrared light filling of first light compensating apparatus or equal to present frame before
The near-infrared at the end exposure moment of nearest the second picture signal of frame last line effective image, first light compensating apparatus is mended
The finish time of light earlier than or equal to nearest the second picture signal of frame any row effective image after present frame exposure
Start time and end exposure moment earlier than or equal to present frame the first picture signal the first row effective image.
Optionally, the described first default exposure is including continuous exposure twice to generate the first picture signal of two continuous frames, institute
Stating the second default exposure includes single exposure to generate second picture signal of frame;
It is later than or is equal to the current first default exposure at the beginning of the near-infrared light filling of first light compensating apparatus
The end exposure moment of preceding nearest the second picture signal of frame last line effective image, first light compensating apparatus it is close red
The finish time of outer light filling presets nearest the second picture signal of frame any row after exposure earlier than or equal to current first
The exposure start time of effective image.
Optionally, the described first default exposure is including continuous exposure twice to generate the first picture signal of two continuous frames, institute
Stating the second default exposure includes single exposure, to generate second picture signal of frame;
It is later than at the beginning of the near-infrared light filling that first light compensating apparatus exposes for the first time in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
Moment, finish time of the near-infrared light filling that first light compensating apparatus exposes for the first time in continuous exposure twice earlier than or
Equal to the end exposure moment of the first picture signal the first row effective image of the current first default exposure;And
First light compensating apparatus is later than at the beginning of the near-infrared light filling of second of exposure in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
The exposure knot of moment and nearest the first picture signal of the frame last line effective image being later than before the current first default exposure
The finish time at beam moment, first light compensating apparatus near-infrared light filling of second of exposure in the continuous exposure twice is early
In or equal to the current first default exposure the first picture signal the first row effective image the end exposure moment.
Optionally, the filtering assembly further includes the second optical filter and switching part, the method also includes:
Second optical filter is switched to the incident side of described image sensor by the switching part;
After second optical filter is switched to the incident side of described image sensor, made by second optical filter
The light of visible light wave range passes through, and stops the light of near infrared light wave band;
In second optical filter by the light of visible light wave range and after stopping the light of near infrared light wave band, by described
Imaging sensor is exposed, to generate and export third picture signal.
Optionally, the light aid further includes the second light compensating apparatus, first filter for including by the filtering assembly
Before mating plate passes through the light of visible light wave range and the light of near infrared light wave band, further includes:
Visible light light filling is carried out by second light compensating apparatus.
The application provides a kind of image collecting device and method, by setting imaging sensor according to the first default exposure and
Second default exposure carries out multiple exposure, to carry out near-infrared light filling during the first default exposure and to generate the first figure
As signal, without near-infrared light filling and the second picture signal is generated during the second default exposure, such data are adopted
Mode set, can it is simple in structure, the first different picture signal of luminance information and the are directly collected while reduce cost
Two picture signals, namely whithin a period of time can simultaneously collected two different picture signals so that the Image Acquisition
Device is more flexible, so that it is also more efficient to obtain the first picture signal and the second picture signal.And according to the first figure
As the first light compensating apparatus is arranged in the end exposure moment of signal and the effective image of the second picture signal and exposure start time
The finish time of near-infrared light filling and start-up time so that without near-infrared light filling second preset exposure it is corresponding when
Between section export the second picture signal color it is accurate.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this Shen
Some embodiments please for those of ordinary skill in the art without any creative labor, can be with
It obtains other drawings based on these drawings.
Figure 1A is the structural schematic diagram of the first image collecting device provided by the embodiments of the present application;
Figure 1B is the schematic illustration that a kind of image collecting device provided by the embodiments of the present application generates the first picture signal;
Fig. 1 C is the schematic illustration that a kind of image collecting device provided by the embodiments of the present application generates the second picture signal;
Fig. 2 is the wavelength and relative intensity that a kind of first light compensating apparatus provided by the embodiments of the present application carries out near-infrared light filling
Between relation schematic diagram;
Fig. 3 is the structural schematic diagram of second of image collecting device provided by the embodiments of the present application;
Fig. 4 is a kind of schematic diagram of RGB sensor provided by the embodiments of the present application;
Fig. 5 is a kind of schematic diagram of RGBW sensor provided by the embodiments of the present application;
Fig. 6 is a kind of schematic diagram of RCCB sensor provided by the embodiments of the present application;.
Fig. 7 is a kind of schematic diagram of RYYB sensor provided by the embodiments of the present application;
Fig. 8 is a kind of induction curve schematic diagram of imaging sensor provided by the embodiments of the present application;
Fig. 9 is the pass between the wavelength and percent of pass of a kind of light that first optical filter passes through provided by the embodiments of the present application
It is schematic diagram;
Figure 10 is a kind of global schematic diagram for starting Exposure mode provided by the embodiments of the present application;
Figure 11 is the schematic diagram of the lighting time section of the first the first light compensating apparatus provided by the embodiments of the present application;
Figure 12 is the schematic diagram of the lighting time section of second of first light compensating apparatus provided by the embodiments of the present application;
Figure 13 is the schematic diagram of the lighting time section of the third the first light compensating apparatus provided by the embodiments of the present application;
Figure 14 is the schematic diagram of the lighting time section of the 4th kind of the first light compensating apparatus provided by the embodiments of the present application;
Figure 15 is a kind of flow chart of image-pickup method provided by the embodiments of the present application.
Specific embodiment
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application
In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall in the protection scope of this application.
Figure 1A is a kind of structural schematic diagram of image collecting device provided by the embodiments of the present application, referring to Figure 1A, the image
Acquisition device includes imaging sensor 01, light aid 02 and filtering assembly 03, and imaging sensor 01 is located at going out for filtering assembly 03
Light side.
Imaging sensor 01 by multiple exposure for being generated and exporting at least first picture signal of frame and an at least frame
Second picture signal.Wherein, the first picture signal is the picture signal generated according to the first default exposure, and the second picture signal is
According to the picture signal that the second default exposure generates, the first default exposure and the second default exposure be in the multiple exposure wherein
It double exposes, when imaging sensor is for presetting the exposure of exposure using global beginning Exposure mode progress multiple exposure, first
Between in section, the exposure start time of all row effective images of the first picture signal is identical, at least two rows of the first picture signal
The end exposure moment of effective image is different, and in the exposure period of the second default exposure, all rows of the second picture signal have
The exposure start time for imitating image is identical, and the end exposure moment of at least two row effective images of the second picture signal is different.It mends
Light device 02 includes the first light compensating apparatus 021, and the first light compensating apparatus 021 is for carrying out near-infrared light filling, wherein at least pre- first
If there are near-infrared light fillings in the Partial exposure period of exposure, there is no close red in the exposure period of the second default exposure
Outer light filling.Filtering assembly 03 includes the first optical filter 031, and the first optical filter 031 passes through visible light and part near infrared light,
In, it is higher than first by the intensity of the near infrared light of the first optical filter 031 when the first light filling fills 021 carry out near infrared light light filling and mends
Pass through the intensity of the near infrared light of the first optical filter 031 when electro-optical device 021 does not carry out near-infrared light filling.
In the embodiment of the present application, referring to Fig. 1, image collecting device can also include camera lens 04, at this point, filtering assembly 03
Can be between camera lens 04 and imaging sensor 01, and imaging sensor 01 is located at the light emission side of filtering assembly 03.Alternatively, mirror
First 04 between filtering assembly 03 and imaging sensor 01, and imaging sensor 01 is located at the light emission side of camera lens 04.
As an example, the first optical filter 031 can be light filter film, in this way, when filtering assembly 03 is located at camera lens 04
When between imaging sensor 01, the first optical filter 031 can be attached to the surface of the light emission side of camera lens 04, alternatively, working as camera lens 04
When between filtering assembly 03 and imaging sensor 01, the first optical filter 031 can be attached to the surface of the incident side of camera lens 04.
It should be noted is that light aid 02 can be located in image collecting device, image collector can also be located at
The outside set.Light aid 02 can be a part of image collecting device, or independently of one of image collecting device
Device.When light aid 02 is located at the outside of Image Acquisition, light aid 02 can be communicatively coupled with image collecting device, be made
For a kind of example, image collecting device can be image capture device, such as video camera, capture machine, face recognition cameras, reading code phase
Machine, in-vehicle camera, panorama details camera etc..It thereby may be ensured that the exposure time series of the imaging sensor 01 in image capture device
There are certain relationships for the near-infrared light filling timing for the first light compensating apparatus 021 for including with light aid 02, such as at least pre- first
If there are near-infrared light fillings in the Partial exposure period of exposure, there is no close red in the exposure period of the second default exposure
Outer light filling.
In addition, the first light compensating apparatus 021 is that can issue device, such as near-infrared light compensating lamp of near infrared light etc., first
Light compensating apparatus 021 can carry out near-infrared light filling with strobe mode, can also carry out near-infrared with the other modes of similar stroboscopic
Light filling, the embodiment of the present application do not limit this.
It in some instances, can be by manual when the first light compensating apparatus 021 carries out near-infrared light filling with strobe mode
Mode carries out near-infrared light filling to control the first light compensating apparatus 021 with strobe mode, by software program or specific can also set
Standby to carry out near-infrared light filling to control the first light compensating apparatus 021 with strobe mode, the embodiment of the present application does not limit this.
Wherein, when the period that the first light compensating apparatus 021 carries out near-infrared light filling can be with the exposure of the first default exposure
Between Duan Chonghe, the exposure period of the first default exposure or the exposure period less than the first default exposure can also be greater than,
As long as in the first default entire exposure period exposed or there are near-infrared light fillings in the Partial exposure period, and second
Near-infrared light filling is not present in the exposure period of default exposure.
It should be noted that near-infrared light filling is not present in the exposure period of the second default exposure, the overall situation is exposed
For mode, the exposure period of the second default exposure, which can be, to be started the time of exposure and terminates the time between the time of exposure
Section, however, it is not limited to this.For example, the exposure period of the second default exposure is also possible to target image in the second picture signal
Corresponding exposure period, target image are to have in the second picture signal with several rows corresponding to target object or target area
Image is imitated, it is pre- that the period between the beginning time of exposure and the end time of exposure of this several row effective image is considered as second
If the exposure period of exposure.
Wherein, the first picture signal and the second picture signal are exposed according to mode one by one, specifically
, imaging sensor is actually the chip assembly for including pixel array, and wherein pixel array is made of pixel one by one, with
Each pixel in the image finally showed is corresponding, and pixel array is specifically used for photoelectric conversion and (converts optical signals to
Electric signal), single exposure, which is completed, when pixel array has obtained a frame image signal.
As an example, in pixel array include multiple rows, wherein every a line correspond to respective exposure start time with
At the end exposure moment, specifically, exposure period is often referred to valid pixel exposure period, valid pixel refers to that picture signal is passed through
The pixel that can be exported after processing is later than current at the beginning of the near-infrared light filling of the first light compensating apparatus 021 in the present embodiment
The end exposure moment of nearest all row effective images of the second picture signal of a frame before frame, the first light compensating apparatus 021 it is close
Exposure of the finish time of infrared light filling earlier than nearest the second picture signal of frame any row effective image after present frame is opened
Begin the moment.
In the present embodiment, imaging sensor is used to carry out multiple exposure using the global Exposure mode that starts, wherein first
The end exposure moment of all row effective images of picture signal is different, the exposure of all row effective images of the second picture signal
Finish time is different, and wherein the difference at the end exposure moment between adjacent rows effective image is less than 40 microseconds, art technology
Personnel are appreciated that wherein 40 microseconds are the empirical values obtained according to practical operation, can be replaced according to actual needs,
This is not absolutely limited herein.
It illustratively, is a kind of global schematic diagram for starting Exposure mode referring to Figure 10, Figure 10.Specifically, the overall situation starts
The exposure start time of all effective rows of every frame image is identical in exposure, and in every frame image all effective rows end exposure
Moment may not be identical, and two kinds of possible implementations for starting the end exposure moment of exposure to the overall situation below are illustrated.
In one possible implementation, the end exposure moment of all rows is all different in every frame image, alternatively, In
In alternatively possible implementation, wherein preset quantity effectively row can be used as one group (such as adjacent 2 effective rows at
It is one group), wherein the end exposure moment between each group is all different, and the end exposure moment of effective row in same group
It is identical, wherein how to be grouped to effective row to set according to actual needs, such as 3 phases can also be set
Adjacent one group of vaild act, or 4 equidistant one group of vaild act etc. of setting, the present embodiment is without limitation.
Start exposure to the overall situation so that the end exposure moment of all effective rows is all different as an example below to be illustrated, from figure
10 as can be seen that the effective image of all rows starts to expose at the T1 moment, and the 1st row effective image terminates to expose at the T2 moment
Light, the 2nd row effective image T3 moment terminate to expose, and the T3 moment has elapsed a period, T4 moment compared to the T2 moment backward
A period has been elapsed backward compared to the T3 moment.
In addition, the 1st row effective image terminated to expose and start output data at the T2 moment, terminate the defeated of data at the T4 moment
Out, line n effective image terminated to expose and start output data at the T5 moment, terminated the output of data at the T6 moment, then T2~
Time between the T6 moment is readout time.
In the present embodiment, imaging sensor 01 carries out multiple exposure using global Exposure mode, the first default exposure
The exposure period alternate cycles arrangement of exposure period and the second default exposure, for any near-infrared light filling, first
Nearest the second picture signal of frame last line before being later than present frame at the beginning of the near-infrared light filling of light compensating apparatus 021
The end exposure moment of effective image, after the finish time of the near-infrared light filling of the first light compensating apparatus 021 is earlier than present frame
The exposure start time of nearest the second picture signal of frame the first row effective image.In this way, can be realized at least default first
There are near-infrared light fillings in the Partial exposure period of exposure, and there is no close in the entire exposure period of the second default exposure
Infrared light filling, thus the problem of alleviating light pollution, and the start-up time by the way that near-infrared light compensating lamp is arranged and finish time,
To guarantee the color of the second picture signal generated in the exposure period for presetting exposure without the second of near-infrared light filling
Accurately, it will not be influenced by infrared light filling.
For example, with reference to Figure 11, wherein 1-n respectively indicates n row effective image, and N-1, N-1, N+1, N and N+2 are respectively indicated
Different frames is carried out it is found that illustratively giving 5 frames in Figure 11 using the global Exposure mode that starts in conjunction with Figure 10 and Figure 11
The picture signal of exposure, wherein the exposure starting time of the n of each frame effectively rows is identical, the end exposure time is different, with the
For N-2 frame, wherein part indicated by light grey shade is that each effective row exposure starts to the part of the 1st row end exposure,
Part indicated by its Oxford gray shade is the part of each effective row end exposure, wherein the exposure of the effectively row of n of each frame
The light time started is identical to enable to fast-moving target offset lighter.
It is illustrated below with reference to implementation of Figure 11-Figure 14 for any near-infrared light filling, wherein with high electricity
The flat unlatching for indicating the first light compensating apparatus, the closing of the first light compensating apparatus is indicated with low level, specifically, in the first light compensating apparatus
When unlatching, the exposure period of corresponding first default exposure is corresponding to generate the first picture signal, closes in the first light compensating apparatus
When, the exposure period of corresponding second default exposure is corresponding to generate the second picture signal.
Referring to Figure 11, in an optional implementation manner, it is assumed that the corresponding N-1 frame of the first picture signal of present frame, the
It is later than at the beginning of the near-infrared light filling of one light compensating apparatus 021 or equal to the nearest frame (N-2 frame) before present frame
The end exposure moment of two picture signal last line effective images, at the end of the near-infrared light filling of the first light compensating apparatus 021
It carves when starting earlier than or equal to the exposure of the second picture signal any row effective image of a nearest frame (N frame) after present frame
It carves, in an alternate embodiment of the invention, the finish time of the near-infrared light filling of the first light compensating apparatus 021 can be later than present frame (N-1
Frame) the first picture signal last line effective image the end exposure moment.
Referring to Figure 12, in another optional implementation, for any near-infrared light filling, the first light compensating apparatus
It is later than at the beginning of 021 near-infrared light filling or equal to a nearest frame (N-2 frame) second picture signal before present frame
The end exposure moment of last line effective image, finish time of the near-infrared light filling of the first light compensating apparatus 021 earlier than or
Equal to the second picture signal any row effective image of a nearest frame (N frame) after present frame exposure start time and earlier than or
Person is equal to the end exposure moment of present frame (N-1 frame) first picture signal the first row effective image, by all effective rows
Lighting time it is identical, to guarantee that the light filling of picture signal is uniform.
Referring to Figure 13, in another possible implementation, the first default exposure is including continuous exposure twice to generate
The first picture signal of two continuous frames, the second default exposure include single exposure to generate second picture signal of frame.
It is later than at the beginning of the near-infrared light filling of first light compensating apparatus 021 or is equal to before the current first default exposure
The second picture signal last line effective image of a nearest frame (N-3 frame) the end exposure moment, the first light compensating apparatus 021
The finish time of near-infrared light filling presets a nearest frame (N frame) the second image letter after exposure earlier than or equal to current first
The exposure start time of number any row effective image, in an optional implementation manner, the near-infrared of the first light compensating apparatus 021
Frame (N-1 frame) first picture signal where the finish time of light filling can be later than or be equal to the current first default exposure last
The end exposure moment of row effective image, alternatively, the finish time of the near-infrared light filling of the first light compensating apparatus 021 can not also be late
The end exposure moment of frame (N-1 frame) first picture signal last line effective image where the current first default exposure, this
Embodiment to this with no restriction.
Referring to Figure 14, in another possible implementation, the first default exposure is including continuous exposure twice to generate
The first picture signal of two continuous frames, the second default exposure includes single exposure, to generate second picture signal of frame;
It is later than at the beginning of the near-infrared light filling of first light compensating apparatus 021 exposed for the first time in continuous exposure twice
Or the exposure equal to the second picture signal last line effective image of a nearest frame (N-3 frame) before the current first default exposure
The finish time of light finish time, the near-infrared light filling that the first light compensating apparatus 021 exposes for the first time in continuous exposure twice are early
In or equal to the current first default end exposure moment for exposing (N-2 frame) first picture signal the first row effective image.
First light compensating apparatus 021 is later than at the beginning of the near-infrared light filling of second of exposure in continuous exposure twice
Or the exposure equal to the second picture signal last line effective image of a nearest frame (N-3 frame) before the current first default exposure
A light finish time and nearest frame (N-2 frame) first picture signal last line before being later than the current first default exposure is effective
The end exposure moment of image, the knot of the first light compensating apparatus 021 near-infrared light filling of second of exposure in continuous exposure twice
The exposure of frame (N-1 frame) first picture signal the first row effective image where the beam moment presets exposure earlier than or equal to current first
Light finish time.
Figure 11 to Figure 14 is only a kind of example, at the beginning of the near-infrared light filling of the first light compensating apparatus 021 and at the end of
The implementation at quarter can be not limited to these examples.
At the beginning of the above-mentioned near-infrared light filling for providing only four kind of first light compensating apparatus 021 and the possibility of close moment
Implementation, in practical application, be not limited to above-mentioned four kinds of possible implementations, the embodiment of the present application does not limit this.
It needs to illustrate on the other hand, since the first light compensating apparatus 021 is when carrying out near-infrared light filling to outer scene, to enter
The near infrared light for being mapped to body surface may be reflected by the object, hence into the first optical filter 031.And due to usual
In the case of, environment light may include visible light and near infrared light, and when the near infrared light in environment light is incident on body surface
It can be reflected by the object, hence into the first optical filter 031.
It therefore, may include the first light filling dress by the near infrared light of the first optical filter 031 when there are near-infrared light filling
The near infrared light of the first optical filter 031 is reflected into when setting 021 carry out near-infrared light filling through object, near-infrared light filling is being not present
When by the near infrared light of the first optical filter 031 may include when the first light compensating apparatus 021 does not carry out near-infrared light filling through object
It is reflected into the near infrared light of the first optical filter 031.It that is to say, pass through the first optical filter 031 when there are near-infrared light filling
Near infrared light include that the first light compensating apparatus 021 issues and near infrared light and environment light after object reflects in through object
Near infrared light after reflection by the near infrared light of the first optical filter 031 includes in environment light when near-infrared light filling is not present
Near infrared light after object reflects.
With in image collecting device, filtering assembly 03 can be between camera lens 04 and imaging sensor 01, and image passes
Sensor 01 is located at for the structure feature of the light emission side of filtering assembly 03, the first picture signal of image acquisition device and second
The process of picture signal are as follows: referring to Figure 1B, when imaging sensor 01 carries out the first default exposure, the first light compensating apparatus 021 is deposited
In near-infrared light filling, by object in scene when the environment light in photographed scene and the first light compensating apparatus carry out near-infrared light filling at this time
After the near infrared light of reflection is via camera lens 04, the first optical filter 031, generated by imaging sensor 01 by the first default exposure
First picture signal;Referring to Fig. 1 C, when imaging sensor 01 carries out the second default exposure, the first light compensating apparatus 021 is not present
Near-infrared light filling, after the environment light in photographed scene is via camera lens 04, the first optical filter 031 at this time, by imaging sensor 01
The second picture signal is generated by the second default exposure, there can be M first to preset within a frame period of Image Acquisition and expose
Light and N number of second default exposure, between the first default exposure and the second default exposure can there are many combined sequences, in image
In one frame period of acquisition, the value and M of M and N and the size relation of N can be arranged according to actual needs, for example, M and N
Value can be equal, can not also be identical.
It should be noted that the first optical filter 031 can be such that part near infrared light passes through, pass through the first optical filter 031
Near infrared light can not limit this near infrared light the embodiment of the present application of subband.
In addition, since the intensity of the near infrared light in environment light is lower than the near infrared light that the first light compensating apparatus 021 issues
Intensity, therefore, the first light compensating apparatus 021 carry out high by the intensity of the near infrared light of the first optical filter 031 when near-infrared light filling
Pass through the intensity of the near infrared light of the first optical filter 031 when the first light compensating apparatus 021 does not carry out near-infrared light filling.
Wherein, the wavelength band that the first light compensating apparatus 021 carries out near-infrared light filling can refer to wavelength band for second, the
Two reference wavelength bands can be 700 nanometers~800 nanometers or 900 nanometers~1000 nanometers, in this way, can mitigate common
850 nanometers of nearly red light caused by interfere, guarantee color accuracy.In addition, being incident on the near infrared light of the first optical filter 031
Wavelength band can for first refer to wavelength band, first with reference to wavelength band be 650 nanometers~1100 nanometers.
Since when there are near-infrared light filling, the near infrared light by the first optical filter 031 may include the first light filling dress
The warp in the near infrared light and environment light of the first optical filter 031 is reflected into through object when setting 021 carry out near infrared light light filling
Near infrared light after object reflection.So stronger into the intensity of the near infrared light of filtering assembly 03 at this time.
But when near-infrared light filling is not present, the near infrared light by the first optical filter 031 includes in environment light through object
Body is reflected into the near infrared light of filtering assembly 03.Due to carrying out the near infrared light of light filling without the first light compensating apparatus 021, so
Intensity at this time by the near infrared light of the first optical filter 031 is weaker.Therefore, for generating and exporting according to the first default exposure
The intensity for the near infrared light that one picture signal includes is higher than the second picture signal for generating and exporting according to the second default exposure
Including near infrared light intensity.
First light compensating apparatus 021 carries out the central wavelength of near-infrared light filling and/or wavelength band can be there are many selection, this
Apply in embodiment, it, can be to the first light filling in order to make the first light compensating apparatus 021 and the first optical filter 031 have better cooperation
The central wavelength that device 021 carries out near-infrared light filling is designed, and is selected the characteristic of the first optical filter 031, from
And to carry out the central wavelength of near-infrared light filling in the first light compensating apparatus 021 as setting characteristic wavelength or fall in setting feature
When wave-length coverage, constraint item can achieve by the central wavelength and/or waveband width of the near infrared light of the first optical filter 031
Part.
It is as quasi- as possible by the central wavelength of the near infrared light of the first optical filter 031 that the constraint condition is primarily used to constraint
Really, and it is as narrow as possible by the waveband width of the near infrared light of the first optical filter 031, to avoid the occurrence of because of near-infrared light waves
Duan Kuandu is wide and introduces wavelength interference.
Wherein, the central wavelength that the first light compensating apparatus 021 carries out near-infrared light filling can issue for the first light compensating apparatus 021
Near infrared light spectrum in average value in the maximum wave-length coverage of energy, it is understood that sent out for the first light compensating apparatus 021
Energy is more than the wavelength of the middle position in the wave-length coverage of certain threshold value in the spectrum of near infrared light out.
Wherein, setting characteristic wavelength or setting characteristic wavelength range can preset.As an example, it first mends
The central wavelength that electro-optical device 021 carries out near-infrared light filling can be any wavelength in 750 ± 10 nanometers of wave-length coverage;Or
Person, the first light compensating apparatus 021 carry out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers
It is long;Alternatively, the first light compensating apparatus 021 carries out appointing in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers
One wavelength;Alternatively, the first light compensating apparatus 021 carries out the wavelength that the central wavelength of near-infrared light filling is 810 ± 10 nanometers, namely
Be, setting characteristic wavelength may range from 750 ± 10 nanometers of wave-length coverage or 780 ± 10 nanometers of wave-length coverage or
940 ± 10 nanometers of wave-length coverage or 810 ± 10 nanometers of wavelength.Illustratively, the first light compensating apparatus 021 carries out close red
The central wavelength of outer light filling is 940 nanometers, and the first light compensating apparatus 021 carries out between the wavelength and relative intensity of near-infrared light filling
Relationship is as shown in Figure 2.Figure it is seen that the wavelength band that the first light compensating apparatus 021 carries out near-infrared light filling is 900 nanometers
~1000 nanometers, wherein in 940 nanometers, the relative intensity highest of near infrared light.
Since when there are near-infrared light filling, the near infrared light by the first optical filter 031 is largely the first light filling dress
The near infrared light of the first optical filter 031 is reflected into when setting 021 carry out near-infrared light filling through object, therefore, in some embodiments
In, above-mentioned constraint condition may include: the central wavelength and the first light compensating apparatus by the near infrared light of the first optical filter 031
Difference between the central wavelength of 021 progress near-infrared light filling is located within the scope of wavelength fluctuation, as an example, wavelength fluctuation
It may range from 0~20 nanometer.
It wherein, can be the close red of the first optical filter 031 by the central wavelength of the near-infrared light filling of the first optical filter 031
Wavelength within the scope of near infrared band in outer smooth percent of pass curve at crest location, it is understood that be the first optical filter 031
Near infrared light percent of pass curve in percent of pass be more than certain threshold value near infrared band within the scope of middle position wavelength.
In order to avoid introducing wavelength interference by the way that the waveband width of the near infrared light of the first optical filter 031 is wide, one
In a little embodiments, above-mentioned constraint condition may include: that first band width can be less than second band width.Wherein, first wave
Duan Kuandu refers to that the waveband width of the near infrared light by the first optical filter 031, second band width refer to by the first optical filter
The waveband width of 031 near infrared light stopped.It should be understood that waveband width refers to wave-length coverage locating for the wavelength of light
Width.It is received for example, passing through wave-length coverage locating for the wavelength of the near infrared light of the first optical filter 031 for 700 nanometers~800
Rice, then first band width, which is 800 nanometers, subtracts 700 nanometers, i.e., 100 nanometers.In other words, pass through the first optical filter 031
Near infrared light waveband width less than the near infrared light that the first optical filter 031 stops waveband width.
For example, with reference to Fig. 3, Fig. 3 be the first optical filter 031 can by light wavelength and percent of pass between relationship
A kind of schematic diagram.The wave band for being incident on the near infrared light of the first optical filter 031 is 650 nanometers~1100 nanometers, the first optical filter
031 visible light that wavelength can be made to be located at 380 nanometers~650 nanometers passes through and wavelength is positioned at 900 nanometers~1100 nanometers
Near infrared light passes through, and wavelength is stopped to be located at 650 nanometers~900 nanometers of near infrared light.It that is to say, first band width is 1000
Nanometer subtracts 900 nanometers, i.e., 100 nanometers.Second band width is 900 nanometers and subtracts 650 nanometers, in addition 1100 nanometers subtract
1000 nanometers, i.e., 350 nanometers.100 nanometers less than 350 nanometers, that is, pass through the waveband width of the near infrared light of the first optical filter 031
Less than the waveband width for the near infrared light that the first optical filter 031 stops.Relation above curve is only a kind of example, for different
Optical filter, can be different by the wavelength band of the nearly red spectral band of optical filter, by the near-infrared of filter blocks
The wavelength band of light can also be different.
In order to avoid passing through the wide waveband of the near infrared light of the first optical filter 031 within the period of non-near-infrared light filling
It spends wide and introduces wavelength interference, in some embodiments, above-mentioned constraint condition may include: by the first optical filter 031
The half-band width of near infrared light is less than or equal to 50 nanometers.Wherein, half-band width refers to the wave of near infrared light of the percent of pass greater than 50%
Duan Kuandu.
In order to avoid introducing wavelength interference by the way that the waveband width of the near infrared light of the first optical filter 031 is wide, one
In a little embodiments, above-mentioned constraint condition may include: that third waveband width can be less than with reference to waveband width.Wherein, third wave
Duan Kuandu refers to that percent of pass as an example can with reference to waveband width greater than the waveband width of the near infrared light of setting ratio
Think any waveband width in 50 nanometers~100 nanometers of wavelength band.Setting ratio can be times in 30%~50%
One ratio, certain setting ratio can also be set as other ratios according to use demand, and the embodiment of the present application does not limit this.
In other words, the waveband width that percent of pass is greater than the near infrared light of setting ratio, which can be less than, refers to waveband width.
For example, with reference to Fig. 3, the wave band for being incident on the near infrared light of the first optical filter 031 is 650 nanometers~1100 nanometers,
Setting ratio is 30%, is 100 nanometers with reference to waveband width.From figure 3, it can be seen that close red at 650 nanometers~1100 nanometers
In the wave band of outer light, the waveband width of near infrared light of the percent of pass greater than 30% is significantly less than 100 nanometers.
It is mended since the first light compensating apparatus 021 at least provides near-infrared within the Partial exposure period of the first default exposure
Light does not provide near-infrared light filling in the entire exposure period that second presets exposure, and the first default exposure and second is preset
Exposure is the wherein double exposure in the multiple exposure of imaging sensor 01, be that is to say, the first light compensating apparatus 021 is in image sensing
Near-infrared light filling is provided in the exposure period of the Partial exposure of device 01, in the exposure that the another part of imaging sensor 01 exposes
Near-infrared light filling is not provided in the light period.So light filling number of first light compensating apparatus 021 in unit time length can be with
Lower than exposure frequency of the imaging sensor 01 in the unit time length, wherein the interval time section per adjacent light filling twice
It is interior, it is spaced one or many exposures.
In one possible implementation, since human eye is easy the first light compensating apparatus 021 carrying out near infrared light light filling
Color and traffic lights in the color of red light obscure, so, referring to fig. 4, light aid 02 can also include the second light compensating apparatus
022, the second light compensating apparatus 022 is for carrying out visible light light filling.In this way, if the second light compensating apparatus 022 is at least default first
The Partial exposure time of exposure provides visible light light filling, that is to say, at least within the Partial exposure period of the first default exposure
There are near-infrared light filling and visible light light filling, the blend color of both light can be different from the color of the red light in traffic lights,
The color that light aid 02 is carried out to the red light in the color and traffic lights of near-infrared light filling so as to avoid human eye is obscured.In addition,
If the second light compensating apparatus 022 provides visible light light filling in the exposure period of the second default exposure, due to the second default exposure
The intensity of visible light is not especially high in the exposure period of light, therefore, is carried out in the exposure period of the second default exposure
When visible light light filling, the brightness of the visible light in the second picture signal can also be improved, and then guarantee the quality of Image Acquisition.
In some embodiments, the second light compensating apparatus 022 can be used for carrying out visible light light filling in a manner of being always on;Alternatively,
Second light compensating apparatus 022 can be used for carrying out visible light light filling with strobe mode, wherein at least in the part of the first default exposure
There are visible light light fillings in exposure period, and visible light light filling is not present in the entire exposure period of the second default exposure;
Alternatively, the second light compensating apparatus 022 can be used for carrying out visible light light filling with strobe mode, wherein at least in the first default exposure
Entire exposure period in visible light light filling is not present, there are visible lights within the Partial exposure period of the second default exposure
Light filling.It, not only can be to avoid human eye by the first light compensating apparatus when the second light compensating apparatus 022, which is always on mode, carries out visible light light filling
The color of red light in the color and traffic lights of 021 progress near-infrared light filling is obscured, and can also improve in the second picture signal
The brightness of visible light, and then guarantee the quality of Image Acquisition.When the second light compensating apparatus 022 carries out visible light light filling with strobe mode
When, the color that the first light compensating apparatus 021 can be carried out to the red light in the color and traffic lights of near-infrared light filling to avoid human eye is mixed
Confuse, alternatively, the brightness of the visible light in the second picture signal can be improved, and then guarantees the quality of Image Acquisition, but also can
To reduce the light filling number of the second light compensating apparatus 022, to extend the service life of the second light compensating apparatus 022.
In some embodiments, above-mentioned multiple exposure refers to the multiple exposure in a frame period, that is to say, image sensing
Device 01 carries out multiple exposure within a frame period, to generate and export at least first picture signal of frame and an at least frame
Two picture signals.For example, including 25 frame periods in 1 second, imaging sensor 01 carries out multiple exposure within each frame period, from
And at least first picture signal of frame and at least second picture signal of frame are generated, the first image that will be generated in a frame period
Signal and the second picture signal are known as one group of picture signal, in this way, will generate 25 groups of picture signals in 25 frame periods.Its
In, the first default exposure and the second default exposure can be double exposure adjacent in multiple exposure in a frame period, can also
To be that non-conterminous double exposure in multiple exposure, the embodiment of the present application do not limit this in a frame period.
First picture signal is that the first default exposure is generated and exported, and the second picture signal is that the second default exposure generates
And export, it, can be to the first picture signal and second after generating and exporting the first picture signal and the second picture signal
Picture signal is handled.In some cases, the purposes of the first picture signal and the second picture signal may be different, so
In some embodiments, the first default exposure can be different from least one exposure parameter of the second default exposure.Show as one kind
Example, at least one exposure parameter can include but is not limited to the time for exposure, analog gain, digital gain, in aperture size
It is one or more.Wherein, exposure gain includes analog gain and/or digital gain.
In some embodiments.It is understood that compared with the second default exposure, when there are near-infrared light filling, figure
The intensity of the near infrared light sensed as sensor 01 is stronger, and the first picture signal for correspondingly generating and exporting includes close red
The brightness of outer light also can be higher.But the near infrared light of higher brightness is unfavorable for the acquisition of outer scene information.And some
In embodiment, exposure gain is bigger, and the brightness for the picture signal that imaging sensor 01 exports is higher, and exposure gain is smaller, image
The brightness for the picture signal that sensor 01 exports is lower, therefore, in order to guarantee the bright of near infrared light that the first picture signal includes
Degree is in suitable range, in the case where the first default exposure is different at least one exposure parameter of the second default exposure,
As an example, the exposure gain of the first default exposure can be less than the exposure gain of the second default exposure.In this way, first
When light compensating apparatus 021 carries out near-infrared light filling, imaging sensor 01 generates and the first picture signal for exporting includes near-infrared
The brightness of light, will not be excessively high because of the first light compensating apparatus 021 progress near-infrared light filling.
In further embodiments, the time for exposure is longer, and the brightness that the picture signal that imaging sensor 01 obtains includes is got over
Height, and motion smear of the object of the movement in outer scene in picture signal is longer;Time for exposure is shorter, image sensing
The brightness that the picture signal that device 01 obtains includes is lower, and movement of the object of the movement in outer scene in picture signal
It trails shorter.Therefore, in order to guarantee the brightness of near infrared light that the first picture signal includes in suitable range, and external field
Motion smear of the object of movement in scape in the first picture signal is shorter.Exposure is preset in the first default exposure and second
In the case that at least one exposure parameter is different, as an example, the time for exposure of the first default exposure can be less than second
The time for exposure of default exposure.In this way, imaging sensor 01 generates simultaneously when the first light compensating apparatus 021 carries out near-infrared light filling
The brightness for the near infrared light that first picture signal of output includes, will not be due to the first light compensating apparatus 021 carries out near-infrared light filling
It is excessively high.And the motion smear that the shorter time for exposure occurs the object of the movement in outer scene in the first picture signal
It is shorter, to be conducive to the identification to Moving Objects.Illustratively, the time for exposure of the first default exposure is 40 milliseconds, second
The time for exposure of default exposure is 60 milliseconds etc..
It is worth noting that, in some embodiments, when the exposure gain of the first default exposure is less than the second default exposure
Exposure gain when, the time for exposure of the first default exposure not only can be less than the time for exposure of the second default exposure, can be with
Equal to the time for exposure of the second default exposure.Similarly, when exposure of the time for exposure of the first default exposure less than the second default exposure
When between the light time, the exposure gain of the first default exposure can also be equal to second less than the exposure gain of the second default exposure
The exposure gain of default exposure.
In further embodiments, the purposes of the first picture signal and the second picture signal can be identical, such as the first figure
When being all used for intellectual analysis as signal and the second picture signal, in order to make the face for carrying out intellectual analysis or target during exercise
There can be same clarity, the first default exposure can be identical at least one exposure parameter of the second default exposure.As
A kind of example, the first default time for exposure exposed can be equal to the time for exposure of the second default exposure, if the first default exposure
The time for exposure of light is different with the time for exposure of the second default exposure, it may appear that the time for exposure, longer picture signal all the way existed
Motion smear causes the clarity of two-way picture signal different.Similarly, as another example, the exposure of the first default exposure
Gain can be equal to the exposure gain of the second default exposure.
It is worth noting that, in some embodiments, being equal to the second default exposure when the time for exposure of the first default exposure
Time for exposure when, the exposure gain of the first default exposure can also be equal to less than the exposure gain of the second default exposure
The exposure gain of second default exposure.Similarly, when the exposure that the exposure gain of the first default exposure is equal to the second default exposure increases
When beneficial, the time for exposure of the first default exposure it is default can also to be equal to second less than the time for exposure of the second default exposure
The time for exposure of exposure.
Wherein, imaging sensor 01 may include multiple photosensitive channels, and each photosensitive channel can be used for incuding at least one
The light of kind visible light wave range, and the light of induction near infrared band.It that is to say, each photosensitive channel can incude at least one can
The light of light-exposed wave band, and the light of near infrared band can be incuded, in this manner it is ensured that in the first picture signal and the second picture signal
With complete resolution ratio, not missing pixel values.In one possible implementation, multiple photosensitive channel can be used for feeling
Answer the light of at least two different visible light wave ranges.
In some embodiments, multiple photosensitive channel may include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, Y
At least two in photosensitive channel, the photosensitive channel W and the photosensitive channel C.Wherein, the photosensitive channel R is for incuding red spectral band and close
The light of infrared band, the photosensitive channel G are used to incude the light of green light band and near infrared band, and the photosensitive channel B is for incuding blue light
The light of wave band and near infrared band, the photosensitive channel Y are used to incude the light of yellow band and near infrared band.Due in some implementations
In example, the photosensitive channel for incuding full wave light can be indicated with W, in further embodiments, can be indicated with C
For incuding the photosensitive channel of full wave light, so when multiple photosensitive channel includes for incuding the photosensitive of full wave light
When channel, this photosensitive channel can be the photosensitive channel W, be also possible to the photosensitive channel C.It that is to say, it in practical applications, can be with
The photosensitive channel for incuding full wave light is selected according to use demand.Illustratively, imaging sensor 01 can be RGB
Sensor, RGBW sensor or RCCB sensor or RYYB sensor.Wherein, the photosensitive channel R in RGB sensor, G are photosensitive
The distribution mode in channel and the photosensitive channel B may refer to Fig. 5, and the photosensitive channel R, the photosensitive channel G in RGBW sensor, B are photosensitive
The distribution mode in channel and the photosensitive channel W may refer to Fig. 6, and the photosensitive channel R, the photosensitive channel C and B in RCCB sensor are photosensitive
Channel distribution mode may refer to Fig. 7, the photosensitive channel R, the photosensitive channel Y and the photosensitive channel distribution mode of B in RYYB sensor
It may refer to Fig. 8.
In further embodiments, some photosensitive channels can also only incude the light of near infrared band, visible without incuding
The light of optical band, in this manner it is ensured that having complete resolution ratio, not missing pixel values in the first picture signal.As one kind
Example, multiple photosensitive channel may include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, at least two in the photosensitive channel IR
Kind.Wherein, the photosensitive channel R is used to incude the light of red spectral band and near infrared band, the photosensitive channel G for incude green light band and
The light of near infrared band, the photosensitive channel B are used to incude the light of blue wave band and near infrared band, and the photosensitive channel IR is close for incuding
The light of infrared band.
Illustratively, imaging sensor 01 can be RGBIR sensor, wherein each IR in RGBIR sensor is photosensitive logical
Road can incude the light of near infrared band, the light without incuding visible light wave range.
Wherein, when imaging sensor 01 is RGB sensor, compared to other imaging sensors, such as RGBIR sensor
RGB information Deng the acquisition of, RGB sensor is more complete, some photosensitive channel of RGBIR sensor does not acquire visible light,
So the color detail of the image of RGB sensor acquisition is more acurrate.
It is worth noting that, multiple photosensitive channels that imaging sensor 01 includes can correspond to a plurality of induction curve.Example
Property, referring to Fig. 9, R-curve representative image sensor 01 in Fig. 9 represents figure to the induction curve of the light of red spectral band, G curve
As sensor 01 is to the induction curve of the light of green light band, induction of the B curve representative image sensor 01 to the light of blue wave band
Curve, W (or C) curve representative image sensor 01 incude the induction curve of full wave light, NIR (Near infrared,
Near infrared light) curve representative image sensor 01 incude near infrared band light induction curve.
To sum up, when the visual intensity in environment light is weaker, such as night, 021 frequency of the first light compensating apparatus can be passed through
Flash light filling generates imaging sensor 01 and exports the first picture signal comprising near-infrared luminance information, and comprising
Second picture signal of visible light luminance information, and since the first picture signal and the second picture signal are passed by the same image
Sensor 01 obtains, so the viewpoint of the first picture signal is identical as the viewpoint of the second picture signal, to be believed by the first image
Number and the available complete outer scene of the second picture signal information.When visual intensity is stronger, for example, daytime, daytime
The accounting of near infrared light is stronger, and the color rendition degree of the image of acquisition is bad, can be generated by imaging sensor 01 and defeated
The third picture signal comprising visible light luminance information out, accordingly even when on daytime, can also collect color rendition degree and compare
Good image, can efficiently, easily no matter daytime or night in other words no matter also can reach the power of visual intensity
The realistic colour information for obtaining outer scene, improves the using flexible of image collecting device, and can also easily with
Other image collecting devices are compatible with.
The application carries out multiple exposure according to the first default exposure and the second default exposure by setting imaging sensor, with
Just near-infrared light filling is carried out during the first default exposure and generates the first picture signal, in the process of the second default exposure
In without near-infrared light filling and generate the second picture signal, such data acquisition modes, can it is simple in structure, reduce at
This while, directly collects different the first picture signals and the second picture signal of luminance information, namely whithin a period of time may be used
With collected two different picture signals simultaneously, so that the image collecting device is more flexible, so that obtaining first
Picture signal and the second picture signal are also more efficient.And according to the effective image of the first picture signal and the second picture signal
The end exposure moment and exposure start time be arranged the first light compensating apparatus near-infrared light filling finish time and near-infrared mend
At the beginning of light, so that the second image for presetting the corresponding period output of exposure without the second of near-infrared light filling
The color of signal is accurate.
Based on the above-mentioned description to image collecting device, which can be generated and be exported by multiple exposure
First picture signal and the second picture signal.Next, with the Image Acquisition provided based on embodiment shown in above-mentioned Fig. 1-14
Device is illustrated image-pickup method.Referring to Figure 15, this method comprises:
Step 1501: near-infrared light filling being carried out by the first light compensating apparatus that light aid includes, wherein at least pre- first
If there are near-infrared light fillings in the Partial exposure period of exposure, there is no close red in the exposure period of the second default exposure
Outer light filling, the first default exposure and the second default exposure are the wherein double exposure in the multiple exposure.
Step 1502: passing through visible light and part near infrared light by the first optical filter that filtering assembly includes.
Step 1503: multiple exposure being carried out by imaging sensor, to generate and export at least first picture signal of frame
At least second picture signal of frame, the first picture signal are the picture signal generated according to the first default exposure, the second image
Signal is according to the second default picture signal for exposing generation, and imaging sensor is used for more using global beginning Exposure mode progress
Secondary exposure, first presets in the exposure period of exposure, the exposure start time of all row effective images of the first picture signal
Identical, the end exposure moment of at least two row effective images of the first picture signal is different, the time for exposure of the second default exposure
In section, the exposure start time of all row effective images of the second picture signal is identical, and at least two rows of the second picture signal have
The end exposure moment for imitating image is different.
Optionally, the nearest frame second before being later than present frame at the beginning of the near-infrared light filling of the first light compensating apparatus
The end exposure moment of all row effective images of picture signal, finish time of the first light compensating apparatus near-infrared light filling earlier than
The exposure start time of nearest the second picture signal of frame any row effective image after present frame.
Optionally, the end exposure moment of all row effective images of the first picture signal is different;
The end exposure moment of all row effective images of second picture signal is different.
Optionally, in the corresponding every frame image signal of imaging sensor, when end exposure between adjacent rows effective image
The difference at quarter is less than 40 microseconds.
Optionally, the nearest frame second before being later than present frame at the beginning of the near-infrared light filling of the first light compensating apparatus
The end exposure moment of picture signal last line effective image, the near-infrared light filling of the near-infrared light filling of the first light compensating apparatus
Finish time starts earlier than or equal to the exposure of nearest the second picture signal of frame any row effective image after present frame
Moment.
Optionally, it is later than at the beginning of the near-infrared light filling of the first light compensating apparatus or equal to nearest before present frame
The end exposure moment of one frame the second picture signal last line effective image, the end of the near-infrared light filling of the first light compensating apparatus
Moment earlier than or equal to nearest the second picture signal of frame any row effective image after present frame exposure start time
And earlier than or equal to present frame the first picture signal the first row effective image the end exposure moment.
Optionally, the first default exposure includes that for continuous exposure to generate the first picture signal of two continuous frames, second is pre- twice
If exposure includes single exposure to generate second picture signal of frame;
Be later than at the beginning of the near-infrared light filling of first light compensating apparatus or equal to the current first default exposure before
The near-infrared at the end exposure moment of nearest the second picture signal of frame last line effective image, first light compensating apparatus is mended
Nearest the second picture signal of frame any row that the finish time of light is preset earlier than or equal to current first after exposure is effective
The exposure start time of image.
Optionally, the first default exposure includes that for continuous exposure to generate the first picture signal of two continuous frames, second is pre- twice
If exposure includes single exposure, to generate second picture signal of frame;
Be later than at the beginning of the near-infrared light filling that first light compensating apparatus exposes for the first time in continuous exposure twice or
The end exposure moment of nearest the second picture signal of frame last line effective image before exposure is preset equal to current first,
The finish time for the near-infrared light filling that first light compensating apparatus exposes for the first time in continuous exposure twice is earlier than or equal to currently
The end exposure moment of first picture signal the first row effective image of the first default exposure;And
First light compensating apparatus be later than at the beginning of the near-infrared light filling of second exposure in continuous exposure twice or
Equal to the end exposure moment of nearest the second picture signal of frame last line effective image before the current first default exposure
And when being later than the end exposure of nearest the first picture signal of frame last line effective image before the current first default exposure
It carves, finish time of the first light compensating apparatus near-infrared light filling of second exposure in continuous exposure twice is earlier than or equal to working as
The end exposure moment of first picture signal the first row effective image of the preceding first default exposure.
Optionally, filtering assembly can also include the second optical filter and switching part, at this point, can also pass through switching part
Second optical filter is switched to the incident side of imaging sensor.The second optical filter be switched to imaging sensor incident side it
Afterwards, pass through the light of visible light wave range by the second optical filter, stop the light of near infrared light wave band, passing through in the second optical filter can
The light of light-exposed wave band and after stopping the light of near infrared light wave band, is exposed by imaging sensor, to generate and export the
Three picture signals.
Optionally, light aid can also include the second light compensating apparatus, at this point, the first optical filter for including by filtering assembly
Before the light of the light and near infrared light wave band that make visible light wave range passes through, visible light light filling is also carried out by the second light compensating apparatus.
Optionally, the first light compensating apparatus carries out high by the intensity of the near infrared light of the first optical filter when near infrared light light filling
Pass through the intensity of the near infrared light of the first optical filter when the first light compensating apparatus does not carry out near-infrared light filling.
Optionally, the exposure period alternate cycles row of the exposure period of the first default exposure and the second default exposure
Column.
Optionally, the wavelength band for being incident on the near infrared light of the first optical filter is first with reference to wavelength band, the first ginseng
Examining wavelength band is 650 nanometers~1100 nanometers.
Optionally, the first light compensating apparatus carries out the central wavelength of near-infrared light filling as setting characteristic wavelength or falls in setting
When characteristic wavelength range, constraint condition is reached by the central wavelength and/or waveband width of the near infrared light of the first optical filter.
Optionally, the first light compensating apparatus carries out in the wave-length coverage that the central wavelength of near-infrared light filling is 750 ± 10 nanometers
Any wavelength;Or
First light compensating apparatus carries out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers
It is long;Or
First light compensating apparatus carries out any wave in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers
It is long;Or
First light compensating apparatus carries out the wavelength that the central wavelength of near-infrared light filling is 810 ± 10 nanometers.
Optionally, constraint condition includes:
It is less than or equal to 50 nanometers by the half-band width of the near infrared light of the first optical filter;Or
First band width is less than second band width;Wherein, first band width refers to through the close of the first optical filter
The waveband width of infrared light, second band width refer to by the waveband width of the near infrared light of the first filter blocks;Or
Third waveband width, which is less than, refers to waveband width, and third waveband width refers to that percent of pass is greater than the close red of setting ratio
Any waveband width in wavelength band that the waveband width of outer light is 50 nanometers~150 nanometers with reference to waveband width.
Optionally, any proportion in proportional region that setting ratio is 30%~50%.
Optionally, the first default exposure is different from least one exposure parameter of the second default exposure, at least one exposure
Parameter is one of time for exposure, exposure gain, aperture size or a variety of, and exposure gain includes analog gain, and/or, number
Word gain.
Optionally, exposure gain of the exposure gain of the first default exposure less than the second default exposure.
Optionally, imaging sensor includes multiple photosensitive channels, and each photosensitive channel is for incuding at least one visible light
The light of wave band, and the light of induction near infrared band.
Optionally, multiple photosensitive channels are used to incude the light of at least two different visible light wave ranges.
Optionally, multiple photosensitive channels include the photosensitive channel R, the photosensitive channel G, the photosensitive channel B, the photosensitive channel Y, W photosensitive
At least two in channel and the photosensitive channel C;
Wherein, the photosensitive channel R is used to incude the light of red spectral band and near infrared band, and the photosensitive channel G is for incuding green light
The light of wave band and near infrared band, the photosensitive channel B are used to incude the light of blue wave band and near infrared band, and the photosensitive channel Y is used for
Incude the light of yellow band and near infrared band, for incuding full wave light, the photosensitive channel C is complete for incuding in the photosensitive channel W
The light of wave band.
Optionally, imaging sensor is RGB sensor, RGBW sensor or RCCB sensor or RYYB sensor.
Optionally, the second light compensating apparatus in a manner of being always on for carrying out visible light light filling;Or
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the described first default exposure
The Partial exposure period in there are visible light light filling, visible light is not present in the entire exposure period of the second default exposure
Light filling;Or
Second light compensating apparatus is used to carry out visible light light filling with strobe mode, wherein at least in the whole of the first default exposure
Visible light light filling is not present in a exposure period, there are visible light benefits within the Partial exposure period of the second default exposure
Light.
It should be noted that the embodiment as shown in the present embodiment and above-mentioned Fig. 1-14 can be using same application structure
Think, can be with reference to the explanation of related content in above-mentioned Fig. 1-14 illustrated embodiment accordingly, with respect to explaining for the present embodiment content, this
Place repeats no more.
In the embodiment of the present application, it is carried out by setting imaging sensor according to the first default exposure and the second default exposure
Multiple exposure, it is pre- second to carry out near-infrared light filling during the first default exposure and to generate the first picture signal
If without near-infrared light filling and generating the second picture signal during exposure, such data acquisition modes can tied
Structure is simple, directly collects luminance information different the first picture signal and the second picture signal while reduce cost, namely
Whithin a period of time can collected two different picture signals simultaneously so that the image collecting device is more flexible, into
And to obtain the first picture signal and the second picture signal also more efficiently.And according to the first picture signal and the second image
The end of the near-infrared light filling of the first light compensating apparatus is arranged in the end exposure moment and exposure start time of the effective image of signal
Moment and start time, so that the second figure for presetting the corresponding period output of exposure without the second of near-infrared light filling
As the color of signal is accurate.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.For example, apparatus embodiments described above are merely indicative, for example, the division of the module, only
Only a kind of logical function partition, there may be another division manner in actual implementation, for example, multiple modules can combine or
It is desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed it is mutual it
Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or module
It connects, can be electrical property, mechanical or other forms.
The above-mentioned integrated module realized in the form of software function module, can store and computer-readable deposit at one
In storage media.Above-mentioned software function module is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) or processor (English: processor) execute this Shen
Please each embodiment the method part steps.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to
The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey
When being executed, execution includes the steps that above-mentioned each method embodiment to sequence;And storage medium above-mentioned include: ROM, RAM, magnetic disk or
The various media that can store program code such as person's CD.
Finally, it should be noted that the above various embodiments is only to illustrate the technical solution of the application, rather than its limitations;To the greatest extent
Pipe is described in detail the application referring to foregoing embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement;And these are modified or replaceed, each embodiment technology of the application that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (26)
1. a kind of image collecting device, which is characterized in that described image acquisition device includes: imaging sensor (01), light aid
(02) and filtering assembly (03), described image sensor (01) are located at the light emission side of the filtering assembly (03);
Described image sensor (01), at least first picture signal of frame and at least one to be generated and exported by multiple exposure
The second picture signal of frame, wherein the first image signal is that the picture signal for exposing generation is preset according to first, described second
Picture signal is the picture signal generated according to the second default exposure, and the described first default exposure and the described second default exposure are
Wherein double exposure in the multiple exposure, described image sensor are used to repeatedly be exposed using the global Exposure mode that starts
Light, described first presets in the exposure period of exposure, and the exposure of all row effective images of the first image signal starts
Moment is identical, and the end exposure moment of at least two row effective images of the first image signal is different, the described second default exposure
In the exposure period of light, the exposure start time of all row effective images of second picture signal is identical, and described second
The end exposure moment of at least two row effective images of picture signal is different;
The light aid (02) includes the first light compensating apparatus (021), and first light compensating apparatus (021) is for carrying out near-infrared benefit
Light, wherein there are near-infrared light fillings at least in the exposure period of the described first default exposure, in the described second default exposure
Exposure period in be not present near-infrared light filling;
The filtering assembly (03) includes the first optical filter (031), and first optical filter (031) keeps visible light and part close red
Outer light passes through.
2. image collecting device as described in claim 1, which is characterized in that the near-infrared of first light compensating apparatus (021)
When the end exposure of nearest all row effective images of the second picture signal of a frame before being later than present frame at the beginning of light filling
It carves, the finish time of the first light compensating apparatus (021) near-infrared light filling is earlier than nearest the second image of a frame after present frame
The exposure start time of signal any row effective image.
3. image collecting device as described in claim 1, which is characterized in that all row effectively figures of the first image signal
The end exposure moment of picture is different;
The end exposure moment of all row effective images of second picture signal is different.
4. image collecting device according to claim 1, which is characterized in that the corresponding every frame image of described image sensor
In signal, the difference at the end exposure moment between adjacent rows effective image is less than 40 microseconds.
5. image collecting device as described in claim 1, which is characterized in that the near-infrared of first light compensating apparatus (021)
The end exposure of nearest the second picture signal of frame last line effective image before being later than present frame at the beginning of light filling
At the moment, the finish time of the near-infrared light filling of the near-infrared light filling of first light compensating apparatus (021) is earlier than or equal to currently
The exposure start time of nearest the second picture signal of frame any row effective image after frame.
6. device as described in claim 1, which is characterized in that the near-infrared light filling of first light compensating apparatus (021) is opened
Begin the moment be later than or equal to nearest the second picture signal of frame last line effective image before present frame end exposure
At the moment, finish time of the near-infrared light filling of first light compensating apparatus (021) is earlier than or equal to nearest after present frame
The exposure start time of one frame the second picture signal any row effective image and earlier than or be equal to the first picture signal of present frame
The end exposure moment of the first row effective image.
7. device as described in claim 1, which is characterized in that the described first default exposure is including continuous exposure twice to generate
The first picture signal of two continuous frames, the described second default exposure include single exposure to generate second picture signal of frame;
It is later than or is equal to the current first default exposure at the beginning of the near-infrared light filling of first light compensating apparatus (021)
The end exposure moment of preceding nearest the second picture signal of frame last line effective image, first light compensating apparatus (021)
Near-infrared light filling finish time earlier than or equal to nearest the second picture signal of a frame after the current first default exposure
The exposure start time of any row effective image.
8. device as described in claim 1, which is characterized in that the described first default exposure is including continuous exposure twice to generate
The first picture signal of two continuous frames, the described second default exposure includes single exposure, to generate second picture signal of frame;
It is later than at the beginning of the near-infrared light filling that first light compensating apparatus (021) exposes for the first time in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
The finish time at moment, the near-infrared light filling that first light compensating apparatus (021) exposes for the first time in continuous exposure twice is early
In or equal to the current first default exposure the first picture signal the first row effective image the end exposure moment;And
First light compensating apparatus (021) is later than at the beginning of the near-infrared light filling of second of exposure in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
The exposure knot of moment and nearest the first picture signal of the frame last line effective image being later than before the current first default exposure
Beam moment, the end of first light compensating apparatus (021) near-infrared light filling of second of exposure in the continuous exposure twice
Moment presets the end exposure moment of the first picture signal the first row effective image of exposure earlier than or equal to current first.
9. image collecting device as described in claim 1, which is characterized in that the filtering assembly (03) further includes the second optical filtering
Piece (032) and switching part (033), first optical filter (031) and second optical filter (032) with the switching part
Part (033) connection;
The switching part (033), be used to for second optical filter (032) being switched to described image sensor (01) enters light
Side;
After second optical filter (032) is switched to the incident side of described image sensor (01), second optical filter
(032) pass through the light of visible light wave range, stop the light of near infrared light wave band, described image sensor (01) is exposed for passing through
Light generates and exports third picture signal.
10. image collecting device as described in claim 1, which is characterized in that
The central wavelength that first light compensating apparatus (021) carries out near-infrared light filling is to set characteristic wavelength or fall in set spy
When levying wave-length coverage, constraint is reached by the central wavelength and/or waveband width of the near infrared light of first optical filter (031)
Condition.
11. image collecting device as claimed in claim 10, which is characterized in that first light compensating apparatus (021) carries out close
Any wavelength in wave-length coverage that the central wavelength of infrared light filling is 750 ± 10 nanometers;Or
First light compensating apparatus (021) carries out in the wave-length coverage that the central wavelength of near-infrared light filling is 780 ± 10 nanometers
Any wavelength;Or
First light compensating apparatus (021) carries out in the wave-length coverage that the central wavelength of near-infrared light filling is 940 ± 10 nanometers
Any wavelength;Or
First light compensating apparatus (021) carries out the wavelength that the central wavelength of near-infrared light filling is 810 ± 10 nanometers.
12. image collecting device as claimed in claim 10, which is characterized in that the constraint condition includes:
It is less than or equal to 50 nanometers by the half-band width of the near infrared light of first optical filter (031);Or
First band width is less than second band width;Wherein, the first band width refers to through first optical filter
(031) waveband width of near infrared light, the second band width refer to by the close red of first optical filter (031) blocking
The waveband width of outer light;Or
Third waveband width, which is less than, refers to waveband width, and the third waveband width refers to that percent of pass is greater than the close red of setting ratio
The waveband width of outer light, described with reference to waveband width is any waveband width in 50 nanometers~150 nanometers of wavelength band.
13. image collecting device as described in claim 1, which is characterized in that
Described first default exposure is different from least one exposure parameter of the described second default exposure, at least one described exposure
Parameter is one of time for exposure, exposure gain, aperture size or a variety of, and the exposure gain includes analog gain, and/
Or, digital gain.
14. image collecting device as claimed in claim 13, which is characterized in that the exposure gain of the described first default exposure is small
In the exposure gain of the described second default exposure.
15. image collecting device as described in claim 1, which is characterized in that described image sensor (01) includes multiple senses
Optical channel, each photosensitive channel are used to incude the light of at least one visible light wave range, and the light of induction near infrared band.
16. image collecting device a method as claimed in any one of claims 1 to 5, which is characterized in that the light aid (02) further includes
Two light compensating apparatus (022), second light compensating apparatus (022) is for carrying out visible light light filling;Or
Second light compensating apparatus (022) in a manner of being always on for carrying out visible light light filling;Or
Second light compensating apparatus (022) is used to carry out visible light light filling with strobe mode, wherein at least default described first
There are visible light light fillings in the Partial exposure period of exposure, do not deposit in the entire exposure period of the described second default exposure
In visible light light filling;Or
Second light compensating apparatus (022) is used to carry out visible light light filling with strobe mode, wherein at least default described first
Visible light light filling is not present in the entire exposure period of exposure, in the Partial exposure period memory of the described second default exposure
In visible light light filling.
17. a kind of method of Image Acquisition, be applied to image collecting device, described image acquisition device include: imaging sensor,
Light aid and filtering assembly, the light aid include the first light compensating apparatus, and the filtering assembly includes the first optical filter, the figure
As sensor (01) is located at the light emission side of the filtering assembly (03), which is characterized in that the described method includes:
Near-infrared light filling is carried out by the first light compensating apparatus that light aid includes, wherein at least in the part of the first default exposure
There are near-infrared light fillings in exposure period, and near-infrared light filling is not present in the exposure period of the second default exposure, described
First default exposure and the described second default exposure are the wherein double exposure in multiple exposure;
Pass through visible light and part near infrared light by the first optical filter that the filtering assembly includes;
Multiple exposure is carried out by described image sensor, to generate and export at least first picture signal of frame and an at least frame
Second picture signal, the first image signal are the picture signal generated according to the described first default exposure, second figure
As signal is the picture signal generated according to the described second default exposure, described image sensor is used to start to expose using the overall situation
Mode carries out multiple exposure, and described first presets in the exposure period of exposure, and all rows of the first image signal are effective
The exposure start time of image is identical, and the end exposure moment of at least two row effective images of the first image signal is different,
In the exposure period of described second default exposure, the exposure start time of all row effective images of second picture signal
Identical, the end exposure moment of at least two row effective images of second picture signal is different.
18. method as claimed in claim 17, which is characterized in that at the beginning of the near-infrared light filling of first light compensating apparatus
It carves the end exposure moment of nearest all row effective images of the second picture signal of a frame before being later than present frame, described first mends
The finish time of electro-optical device near-infrared light filling is earlier than nearest the second picture signal of frame any row effective image after present frame
Exposure start time.
19. method as claimed in claim 17, which is characterized in that the exposure of all row effective images of the first image signal
Light finish time is different;
The end exposure moment of all row effective images of second picture signal is different.
20. method as claimed in claim 17, which is characterized in that in the corresponding every frame image signal of described image sensor,
The difference at the end exposure moment between adjacent rows effective image is less than 40 microseconds.
21. method as claimed in claim 17, which is characterized in that the near-infrared light filling of first light compensating apparatus (021)
Start time be later than present frame before nearest the second picture signal of frame last line effective image the end exposure moment, institute
The finish time of the near-infrared light filling of the near-infrared light filling of the first light compensating apparatus (021) is stated earlier than or equal to after present frame
The exposure start time of nearest the second picture signal of frame any row effective image.
22. method as claimed in claim 17, which is characterized in that the near-infrared light filling of first light compensating apparatus (021)
Start time be later than or equal to nearest the second picture signal of frame last line effective image before present frame exposure knot
The beam moment, finish time of the near-infrared light filling of first light compensating apparatus (021) earlier than or equal to after present frame most
The exposure start time of nearly the second picture signal of frame any row effective image and earlier than or be equal to the first image of present frame believe
The end exposure moment of number the first row effective image.
23. method as claimed in claim 17, which is characterized in that the described first default exposure is including continuous exposure twice to produce
Raw the first picture signal of two continuous frames, the described second default exposure include single exposure to generate second picture signal of frame;
It is later than or is equal to the current first default exposure at the beginning of the near-infrared light filling of first light compensating apparatus (021)
The end exposure moment of preceding nearest the second picture signal of frame last line effective image, first light compensating apparatus (021)
Near-infrared light filling finish time earlier than or equal to nearest the second picture signal of a frame after the current first default exposure
The exposure start time of any row effective image.
24. method as claimed in claim 17, which is characterized in that the described first default exposure is including continuous exposure twice to produce
Raw the first picture signal of two continuous frames, the described second default exposure includes single exposure, to generate second picture signal of frame;
It is later than at the beginning of the near-infrared light filling that first light compensating apparatus (021) exposes for the first time in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
The finish time at moment, the near-infrared light filling that first light compensating apparatus (021) exposes for the first time in continuous exposure twice is early
In or equal to the current first default exposure the first picture signal the first row effective image the end exposure moment;And
First light compensating apparatus (021) is later than at the beginning of the near-infrared light filling of second of exposure in continuous exposure twice
Or the end exposure equal to nearest the second picture signal of frame last line effective image before the current first default exposure
The exposure knot of moment and nearest the first picture signal of the frame last line effective image being later than before the current first default exposure
Beam moment, the end of first light compensating apparatus (021) near-infrared light filling of second of exposure in the continuous exposure twice
Moment presets the end exposure moment of the first picture signal the first row effective image of exposure earlier than or equal to current first.
25. method as claimed in claim 17, which is characterized in that the filtering assembly further includes the second optical filter and switching part
Part, the method also includes:
Second optical filter is switched to the incident side of described image sensor by the switching part;
After second optical filter is switched to the incident side of described image sensor, made by second optical filter visible
The light of optical band passes through, and stops the light of near infrared light wave band;
By the light of visible light wave range and after stopping the light of near infrared light wave band, pass through described image in second optical filter
Sensor is exposed, to generate and export third picture signal.
26. method as claimed in claim 17, which is characterized in that the light aid further includes the second light compensating apparatus, described logical
Before crossing the first optical filter that the filtering assembly includes and passing through the light of visible light wave range and the light of near infrared light wave band, also wrap
It includes:
Visible light light filling is carried out by second light compensating apparatus.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910517680.7A CN110493496B (en) | 2019-06-14 | 2019-06-14 | Image acquisition device and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910517680.7A CN110493496B (en) | 2019-06-14 | 2019-06-14 | Image acquisition device and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110493496A true CN110493496A (en) | 2019-11-22 |
CN110493496B CN110493496B (en) | 2021-11-09 |
Family
ID=68545881
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910517680.7A Active CN110493496B (en) | 2019-06-14 | 2019-06-14 | Image acquisition device and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110493496B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111541873A (en) * | 2020-05-08 | 2020-08-14 | 北京嘀嘀无限科技发展有限公司 | Control method and system for vehicle monitoring and computer readable storage medium |
CN111741185A (en) * | 2020-06-24 | 2020-10-02 | 杭州海康威视数字技术股份有限公司 | Light supplement control method, device, system and equipment and storage medium |
WO2020238804A1 (en) * | 2019-05-31 | 2020-12-03 | 杭州海康威视数字技术股份有限公司 | Image acquisition apparatus and image acquisition method |
WO2020238806A1 (en) * | 2019-05-31 | 2020-12-03 | 杭州海康威视数字技术股份有限公司 | Image collection apparatus and photography method |
WO2022078036A1 (en) * | 2020-10-15 | 2022-04-21 | 华为技术有限公司 | Camera and control method therefor |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101064792A (en) * | 2006-04-28 | 2007-10-31 | 三星Techwin株式会社 | Photographing apparatus and method |
CN102111558A (en) * | 2011-02-15 | 2011-06-29 | 杭州海康威视数字技术股份有限公司 | Method and device for automatically switching over optical filter of video camera |
CN202887451U (en) * | 2012-10-26 | 2013-04-17 | 青岛海信网络科技股份有限公司 | Infrared light and visible light filling blended electronic police system |
CN103870805A (en) * | 2014-02-17 | 2014-06-18 | 北京释码大华科技有限公司 | Mobile terminal biological characteristic imaging method and device |
KR20160067694A (en) * | 2014-12-04 | 2016-06-14 | 현대모비스 주식회사 | System for monitoring the driver status and method thereof |
CN106464850A (en) * | 2014-06-24 | 2017-02-22 | 日立麦克赛尔株式会社 | Image pickup sensor and image pickup device |
US20170237887A1 (en) * | 2014-11-13 | 2017-08-17 | Panasonic Intellectual Property Management Co. Ltd. | Imaging device and imaging method |
CN107566747A (en) * | 2017-09-22 | 2018-01-09 | 浙江大华技术股份有限公司 | A kind of brightness of image Enhancement Method and device |
CN108133494A (en) * | 2018-01-17 | 2018-06-08 | 南京华捷艾米软件科技有限公司 | The system and method for generating depth map and cromogram simultaneously using RGB-IR |
CN109640009A (en) * | 2017-10-09 | 2019-04-16 | 比亚迪股份有限公司 | Pixel circuit, pixel array, imaging sensor and its exposal control method |
-
2019
- 2019-06-14 CN CN201910517680.7A patent/CN110493496B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101064792A (en) * | 2006-04-28 | 2007-10-31 | 三星Techwin株式会社 | Photographing apparatus and method |
CN102111558A (en) * | 2011-02-15 | 2011-06-29 | 杭州海康威视数字技术股份有限公司 | Method and device for automatically switching over optical filter of video camera |
CN202887451U (en) * | 2012-10-26 | 2013-04-17 | 青岛海信网络科技股份有限公司 | Infrared light and visible light filling blended electronic police system |
CN103870805A (en) * | 2014-02-17 | 2014-06-18 | 北京释码大华科技有限公司 | Mobile terminal biological characteristic imaging method and device |
CN106464850A (en) * | 2014-06-24 | 2017-02-22 | 日立麦克赛尔株式会社 | Image pickup sensor and image pickup device |
US20170237887A1 (en) * | 2014-11-13 | 2017-08-17 | Panasonic Intellectual Property Management Co. Ltd. | Imaging device and imaging method |
KR20160067694A (en) * | 2014-12-04 | 2016-06-14 | 현대모비스 주식회사 | System for monitoring the driver status and method thereof |
CN107566747A (en) * | 2017-09-22 | 2018-01-09 | 浙江大华技术股份有限公司 | A kind of brightness of image Enhancement Method and device |
CN109640009A (en) * | 2017-10-09 | 2019-04-16 | 比亚迪股份有限公司 | Pixel circuit, pixel array, imaging sensor and its exposal control method |
CN108133494A (en) * | 2018-01-17 | 2018-06-08 | 南京华捷艾米软件科技有限公司 | The system and method for generating depth map and cromogram simultaneously using RGB-IR |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020238804A1 (en) * | 2019-05-31 | 2020-12-03 | 杭州海康威视数字技术股份有限公司 | Image acquisition apparatus and image acquisition method |
WO2020238806A1 (en) * | 2019-05-31 | 2020-12-03 | 杭州海康威视数字技术股份有限公司 | Image collection apparatus and photography method |
US11889032B2 (en) | 2019-05-31 | 2024-01-30 | Hangzhou Hikvision Digital Technology Co., Ltd. | Apparatus for acquiring image and method for acquiring image |
CN111541873A (en) * | 2020-05-08 | 2020-08-14 | 北京嘀嘀无限科技发展有限公司 | Control method and system for vehicle monitoring and computer readable storage medium |
CN111741185A (en) * | 2020-06-24 | 2020-10-02 | 杭州海康威视数字技术股份有限公司 | Light supplement control method, device, system and equipment and storage medium |
CN111741185B (en) * | 2020-06-24 | 2022-04-26 | 杭州海康威视数字技术股份有限公司 | Light supplement control method, device, system and equipment and storage medium |
WO2022078036A1 (en) * | 2020-10-15 | 2022-04-21 | 华为技术有限公司 | Camera and control method therefor |
Also Published As
Publication number | Publication date |
---|---|
CN110493496B (en) | 2021-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110493496A (en) | Image collecting device and method | |
CN110493494A (en) | Image fusion device and image interfusion method | |
CN110493491A (en) | A kind of image collecting device and image capture method | |
CN110519489A (en) | Image-pickup method and device | |
CN110490041A (en) | Human face image collecting device and method | |
CN110493537A (en) | Image collecting device and image-pickup method | |
CN102474627B (en) | Image capturing device and image capturing method | |
CN108419061A (en) | Based on multispectral image co-registration equipment, method and imaging sensor | |
CN110505377A (en) | Image co-registration device and method | |
CN105981377B (en) | Camera device, endoscope apparatus and microscopie unit | |
CN110490811A (en) | Image noise reduction apparatus and image denoising method | |
CN110490042A (en) | Face identification device and access control equipment | |
CN101983510B (en) | The System and method for of adaptive local white balance adjusting | |
JP2004228662A (en) | Image pickup apparatus | |
CN110490187A (en) | Car license recognition equipment and method | |
CN106101549A (en) | Automatic switching method, Apparatus and system round the clock | |
CN102783135A (en) | Method and apparatus for providing a high resolution image using low resolution | |
CN110490044B (en) | Face modeling device and face modeling method | |
CN110493536A (en) | The method of image collecting device and Image Acquisition | |
CN110706178A (en) | Image fusion device, method, equipment and storage medium | |
CN103999458A (en) | Image pickup device | |
CN113676628B (en) | Image forming apparatus and image processing method | |
CN110493535A (en) | The method of image collecting device and Image Acquisition | |
CN110493492A (en) | Image collecting device and image-pickup method | |
CN110493533A (en) | Image collecting device and image-pickup method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |