WO2012032916A1 - Système de surveillance - Google Patents

Système de surveillance Download PDF

Info

Publication number
WO2012032916A1
WO2012032916A1 PCT/JP2011/068758 JP2011068758W WO2012032916A1 WO 2012032916 A1 WO2012032916 A1 WO 2012032916A1 JP 2011068758 W JP2011068758 W JP 2011068758W WO 2012032916 A1 WO2012032916 A1 WO 2012032916A1
Authority
WO
WIPO (PCT)
Prior art keywords
correction
monitoring system
pixel
line
light
Prior art date
Application number
PCT/JP2011/068758
Other languages
English (en)
Japanese (ja)
Inventor
道輝 柴原
中村　和彦
Original Assignee
株式会社日立国際電気
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立国際電気 filed Critical 株式会社日立国際電気
Priority to CN2011900007316U priority Critical patent/CN203301595U/zh
Publication of WO2012032916A1 publication Critical patent/WO2012032916A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof

Definitions

  • the present invention relates to an object monitoring system.
  • Oxygen in the air slightly absorbs and attenuates about 680 nm of red and attenuates to 1/2 that of short wavelength visible light. It absorbs near-infrared light of about 760 nm and attenuates to 1/10 compared to short-wavelength visible light. Sunlight is absorbed and absorbed by water vapor etc. on the ground and the sea where the altitude is low, and red of about 700 nm is slightly absorbed and attenuated.
  • near-infrared light of about 820 nm, about 900 nm to about 1000 nm, about 1120 nm to about 1160 nm, and about 1300 nm to about 1500 nm.
  • the transmittance of near infrared light in the vicinity of about 970 nm and about 1130 nm in the atmosphere is as small as 1/20 or less compared to visible light. Therefore, a bottle with water vapor absorbs near-infrared light, and the near-infrared light of a long-distance subject does not reach the camera (see Non-Patent Document 1).
  • yellow-orange illumination near 600 nm such as a sodium lamp 590 nm
  • the imaging device removes haze and other irregular reflections when imaging in the atmosphere in which fog or fog is generated.
  • a target object is irradiated with a visible light short-time pulse LED (Light Emitting Diode), and irregularly reflected light other than a predetermined distance is removed by electronic shutter exposure, and only reflected light of the target object at a predetermined distance is photographed. It has been proposed (see Patent Document 1).
  • Time synchronization can be achieved with the accuracy of the mounted atomic clock.
  • GPS Global Positioning System
  • QZS Quasi-Zenith Satellites
  • DSP Digital Signal Processor
  • FPGA Field Programmable Gate
  • Array can be realized easily.
  • CDS Correlated Double Sampling
  • AGC Automatic Gain Control
  • AFE Analog Front End
  • ADC Analog Digital Converter
  • an electron multiplying CCD image sensor for example, Electron Multiplying-CCD: EM-CCD
  • an imaging device electron multiplying CCD imaging device
  • an image pickup device such as a CCD image pickup device in which the thickness from the surface of the on-chip lens to the photodiode is thinned to be highly sensitive to visible light is also commercially available.
  • An image sensor that incorporates a light guide from the surface of an on-chip lens such as a CMOS image sensor to a photodiode and has high sensitivity to short wavelength light is also commercially available.
  • An image sensor having a high sensitivity to short wavelength light by reducing the thickness from the surface of the on-chip lens to the photodiode as backside illumination of a CMOS image sensor or the like is also commercially available.
  • an imaging device including a deep photodiode or a photodiode having a fine structure that reflects near infrared light and having high sensitivity to near infrared light is also commercially available.
  • Non-Patent Document 2 High-speed global electronic shutter CMOS and CCD image sensors are also commercially available (see Non-Patent Document 2 to Non-Patent Document 4). Further, an electron multiplying CMOS image sensor has been developed. A CCD imaging device using InGaAs or the like and sensitive to near infrared light up to 1700 nm is also commercially available (see Non-Patent Document 5).
  • CMOS and CCD image sensors are also commercially available (see Non-Patent Document 2 to Non-Patent Document 4).
  • An electron multiplying CMOS image sensor has been developed.
  • a CCD imaging device using InGaAs or the like and sensitive to near infrared light up to 1700 nm is also commercially available (see Non-Patent Document 5).
  • the above-described prior art if there are particles having a diameter of about 1000 nm in the air, whether it is fog or dust, the short wavelength of visible light is irregularly reflected, the black of a long-d
  • an object of the present invention is to capture an image capable of specifying an intruding object in a monitoring target region having particles having a diameter of about 1000 nm in the air.
  • the present invention has a lens that transmits at least visible light or near infrared light, and an imaging device that is sensitive to at least visible light or near infrared light, and picks up at least visible light or near infrared light of a subject.
  • an imaging device that is sensitive to at least visible light or near infrared light, and picks up at least visible light or near infrared light of a subject.
  • yellow-orange, red, or near-infrared LEDs that transmit gas molecules in the air emit time-synchronized light with a narrow ON ratio by transmitting synchronization information.
  • a monitoring system that outputs a video imaged by performing a global electronic shutter synchronized with the transmitted synchronization information by the imaging device.
  • the monitoring system includes horizontal contour correction generated from seven or more pixel delayed video signals and vertical contour correction generated from seven or more scanning line delays, and captures at least visible light and near infrared light of a subject. If the effective contrast of the video signal (such as a decrease in the highlight level or an increase in the black level) falls below the expected value, the black contour is lowered and a horizontal contour generated from seven or more pixel delayed video signals.
  • the monitoring system is characterized by lowering the correction emphasis frequency and increasing the number of emphasized scanning lines for vertical contour correction generated from seven or more scanning line delays.
  • the imaging device is a CCD imaging device in which an emission wavelength band pass optical filter of the LED is inserted in an incident optical path.
  • the synchronization information may be a leaky coaxial cable laid in the vicinity of a long-distance line or row monitoring target area such as a railroad track, a road, a transmission line site, or a wind turbine row of wind power generation.
  • the monitoring system is characterized by being transmitted by at least one of radio waves including an accuracy synchronization function.
  • the power source of the near-infrared LED is laid on the line, the superimposed power source of the leaky transmission line such as the leaky coaxial cable laid near the monitored region, the power line of the optical cable with the power line, and the line Supplied by at least one of a power line charged with a power line charged in the vicinity of the monitored area, an electric power line laid in the vicinity of the monitoring target area, and solar power generation, solar thermal power generation, wind power generation, or vibration of passing objects. It is a monitoring system.
  • a power supply (DC 36V or less direct current) is superimposed on the leaky transmission line of the leaky coaxial cable or the like.
  • LEDs that drive the LEDs with individual phase pulses based on the power supply and synchronization information along the line at a predetermined interval
  • global electronics that synchronize with the synchronization information of the leaky transmission line such as the leaky coaxial cable.
  • a solid-state imaging device having a solid-state imaging device that varies the shutter phase, and synchronization of a leaky transmission line such as the leaky coaxial cable (as in the case of photographing an intruder illuminated by an LED driven by the pulse of the individual phase)
  • the monitoring system is characterized in that the global electronic shutter phase is varied in synchronization with information. Further, in the monitoring system, the LED transmits oxygen and water vapor at a yellow-orange wavelength (about 600 nm), a red wavelength (about 660 nm) or near infrared light wavelength other than the oxygen absorption wavelength and the water vapor absorption wavelength.
  • the present invention it is possible to capture an image capable of specifying an intruding object in a monitoring target region where particles having a diameter of about 1000 nm are present in the air.
  • 1 is a block diagram (EM-CCD) showing a configuration of a line monitoring system according to an embodiment of the present invention.
  • 1 is a block diagram (FIT-CCD) showing a configuration of a line monitoring system according to an embodiment of the present invention.
  • 1 is a block diagram (IT-CCD) showing a configuration of a line monitoring system according to an embodiment of the present invention.
  • Timing chart (FIT-CCD or EM-CCD) showing the operation of the line monitoring system of one embodiment of the present invention
  • the flowchart which shows operation
  • Block diagram showing the configuration of wrinkle correction in a conventional monitoring system Timing chart showing operation of electronic shutter for wrinkle correction of conventional monitoring system
  • the block diagram which shows the structure of the video signal processing part of one Example of this invention.
  • the block diagram which shows the structure of the multi-pixel outline correction
  • the schematic diagram which shows operation
  • FIG. 1 is a block diagram showing the configuration of a line monitoring system according to one embodiment of the present invention and a leaky coaxial cable of the line monitoring system according to one embodiment of the present invention.
  • 2A FIT-CCD or EM-CCD
  • FIG. 2B IT-CCD
  • FIG. 1A of the block diagram showing the configuration of the line monitoring system of one embodiment of the present invention and FIG. 3 of the block diagram showing the configuration of wrinkle correction of the conventional monitoring system is that transmission is performed with a leaky coaxial cable or ground plane.
  • multiple LEDs are driven in multiple phases on the subject side in the air Emits yellow-orange (about 600 nm) or red (about 660 nm) or near-infrared (about 740 nm, about 780 nm, about 860 nm, about 1040 nm, about 1200 to about 1250 nm, about 1550 to about 1650 nm) that transmits a gas molecule of And that the imaging element drive phase is advanced from the output video signal based on the synchronization information of the leaky coaxial cable.
  • FIG. 1 1 is a lens
  • 2 is an EM-CCD
  • 3 is a FIT-CCD
  • 4 is a video signal with memory.
  • Processing unit 5 is a CPU
  • 6 is an OD drive unit
  • 7 is a vertical transfer drive unit of an imaging unit
  • 8 is a vertical transfer drive unit of a storage unit
  • 9 is a TG
  • 10 is a CMG drive unit
  • 11 is a CDS, AGC, and A AFE including / D, 12 LED, 13 LED drive unit, 14 leaky transmission line such as leaky coaxial cable, and 15 IT-CCD.
  • Reference numeral 16 is a temperature sensor
  • 17 is a cooling unit
  • 18 is a cooling drive unit.
  • Reference numeral 39 denotes an insertion / removal optical filter that inserts or removes the light emission wavelength band-pass optical filter of the LED into or from the incident optical path.
  • the insertion / removal optical filter 39 is required when there is very strong external light such as foggy morning direct sunlight, and there are particles with a diameter of about 1000 nm in the air, whether it is fog or dust.
  • the CDS, AGC, and AFE including A / D may be integrated into a high-sensitivity solid-state imaging device that changes the global electronic shutter phase, for example, a CMOS imaging device having a global electronic shutter function.
  • the EM-CCD 2 may be integrated into a CMOS image sensor having a global electronic shutter function and an electron multiplication function.
  • the imaging device is preferably an imaging device that is highly sensitive to visible light or near infrared rays, such as Non-Patent Document 2 to Non-Patent Document 5.
  • Reference numerals 21, 22 and 23 denote antennas, 24 denotes synchronization information radio waves, 25 denotes an overhead line, 26 denotes an optical fiber, and 27 denotes a lamp line.
  • the combination of each element of FIG. 1A, FIG. 1B, and FIG. 1C is not restricted to illustration, Any combination may be sufficient.
  • FIG. 2A FIT-CCD or EM-CCD
  • FIG. 2B I-CCD of timing charts showing the operation of the line monitoring system according to one embodiment of the present invention, and an electronic shutter for correcting wrinkles of a conventional monitoring system.
  • the timing chart showing the operation is different from FIG. 4 in that the LED emission is on the subject side, corresponding to the synchronous phase of the leaky coaxial cable laid along the railway line, and in a plurality of phases corresponding to the position of the railway line. This means that the CCD drive phase is advanced from the output video signal.
  • FIG. 4 shows that the LED emission is on the subject side, corresponding to the synchronous phase of the leaky coaxial cable laid along the railway line, and in a plurality of phases corresponding to the position of the railway line. This means that the CCD drive phase is advanced from the output video signal.
  • 2A (FIT-CCD or EM-CCD) of the timing chart showing the operation of the line monitoring system according to the embodiment of the present invention
  • the LED and the attenuated sun rather than the subject signal charge due to the attenuated sunlight.
  • the subject signal charge due to light is large, and the subject can be photographed even when fog is generated at night or at night.
  • FIG. 2B (IT-CCD) of the timing chart showing the operation of the track monitoring system according to the embodiment of the present invention
  • the subject signal charge due to the attenuated sunlight on the previous screen is caused by the attenuated sunlight on the current screen.
  • the result of subtracting the video signal of the subject signal charge due to the attenuated sunlight on the previous screen from the video signal of the subject signal charge due to the current screen LED and the attenuated sunlight is It becomes an electric charge. Therefore, if the subject does not move quickly, the subject can be photographed even when fog is generated at night or at night.
  • a power supply and synchronization information are superimposed on the leaky coaxial cable (DC 36V or less) and the synchronization information
  • a solid-state imaging device that has a plurality of LEDs driven by individual phase pulses and a plurality of LEDs along the line at predetermined intervals, and changes the global electronic shutter phase in synchronization with the synchronization information of the leaky coaxial cable. And the global electronic shutter phase is varied in synchronization with synchronization information of the leaky coaxial cable (as in the case of photographing an intruder illuminated by the LED driven by the individual phase pulse). It is a monitoring system.
  • the position of the railway track, etc. corresponds to the synchronous phase of the leaky coaxial cable laid along either the railroad track or road or transmission line site or wind turbine row of wind power generation. Since a plurality of LEDs emit light at a plurality of phases corresponding to the above, a subject such as a railway track at a position corresponding to the global electronic shutter phase can be photographed.
  • FIG. 2C of the flowchart of one embodiment of the present invention FIG. 5 of a block diagram showing the configuration of the video signal processing section of the first embodiment of the present invention, and multi-pixel contour correction and correlation averaging section of one embodiment of the present invention
  • FIG. 6 is a block diagram showing the configuration of FIG. 6
  • FIG. 7 is a schematic diagram showing the operation of multi-pixel contour correction and correlation averaging in one embodiment of the present invention, and the operation of the black level correction unit in one embodiment of the present invention.
  • Example 2 is demonstrated using FIG. 8A and FIG. 8B of the schematic diagram shown.
  • FIG. 2C is a flowchart of one embodiment of the present invention.
  • the determination of 42 “whether the dark part of the imaged video signal is greater than or equal to the first predetermined value” is No. Take an image and go to the end of 47. If the determination of 42 is Yes, the determination of 42 “is the highlight of the imaged video signal equal to or greater than the second predetermined value”? If Yes, the black level of the output video signal VideoOut of 46 is lowered and 48 multi-pixel contours are determined. The horizontal / vertical frequency of correction is lowered and the multi-pixel contour correction amount is increased, and the process goes to 47.
  • leaky coaxial-synchronized LED wavelength bandpass optical filters are inserted, and leaky coaxial-synchronized electronic shutter operation is performed to reduce the black level of 46 output video signal VideoOut and 48 multi-pixel contour correction
  • the horizontal / vertical frequency is decreased and the multi-pixel contour correction amount is increased.
  • FIG. 5 is a block diagram showing the configuration of the video signal processing unit of one embodiment of the present invention, and the video signals of FIG. 1B and FIG. 1C of the monitoring system using the solid-state imaging device of the first embodiment of the present invention. This corresponds to the processing unit 4A. 5A of FIG. 5 may be used for the video signal processing unit 4 of FIG. 1A.
  • FIG. 6 is a block diagram showing the configuration of the multi-pixel contour correction and correlation average unit according to one embodiment of the present invention, which corresponds to 31 in FIG.
  • FIG. 7 is a schematic diagram showing operations of multi-pixel contour correction and correlation averaging according to one embodiment of the present invention
  • FIG. 8A is a schematic diagram showing operations of a black level correction unit according to one embodiment of the present invention. 8B is a schematic diagram illustrating the operation of the black level correction unit according to the first embodiment of the present invention.
  • the difference between the video signal processing unit 4 of one embodiment of the present invention and the block diagram of the monitoring system using the conventional solid-state imaging device in FIG. 7 is that there are 8 hygrometers and 10 optical filter pass wavelengths. And all-pixel dark current variation correction, correlation average, multi-pixel contour correction, black level is lowered and the gamma correction of the dark part is weakened, the compression of the dark part is restricted (dark part correction), or the highlight compression is weakened (highlight correction). 4 of the video signal processing unit including contrast enhancement for performing at least one of the above.
  • noise reduction by all-pixel dark current variation correction and correlation average, multi-pixel contour correction and black level are lowered to weaken the gamma correction of the dark area or to limit the compression of the dark area (dark area correction).
  • the contrast enhancement that performs at least one of reducing the highlight compression (highlight correction) is processed in 14 bits in the video signal processing unit 4.
  • FIG. 3 shows an image pickup unit 3 using a CCD of a solid-state image pickup device, all-pixel dark current variation correction, correlation average, multi-pixel contour correction, black level is lowered, and dark portion gamma correction is weakened or the dark portion is compression limited (
  • This is an example of the video signal processing unit 4 including contrast enhancement that performs at least one of dark portion correction) and weakening highlight compression (highlight correction).
  • a CMOS image sensor including all functions of the imaging unit 3 and the video signal processing unit 4 is provided. It may be used.
  • 6 is a CPU
  • 12 is a vertical transfer drive unit
  • 22 is a cooling unit
  • 23 is a cooling drive unit
  • 24 is a temperature sensor.
  • the video signal processing unit 4 including contrast enhancement for performing at least one of the above 25 is a contrast detection unit including OB detection, 26 is an all-pixel reference dark current screen memory, 27 is a multiplier, 28 is a subtractor, and 29 is a peripheral pixel 30 is a multi-pixel contour correction unit including a correlation average between the pixel and the surrounding pixels of the previous screen, and 30 reduces the black level and weakens the gamma correction of the dark part, restricts the compression of the dark part (dark part correction), or weakens the highlight compression ( A video signal processing unit including a contrast enhancement unit that performs at least one of (highlight correction).
  • the incident light Lin in FIG. 1A passes through an optical filter, is converted into an electric signal by the CCD 11 in FIG. 3, and is converted into an image signal Vi inside the imaging apparatus of about 14 bits by an analog front end (AFE) 13.
  • the temperature sensor 24 in FIG. 3 detects the temperature of the CCD 11 and calculates the amount of change in dark current.
  • the CCD 11 is an EM-CCD
  • the amount of change in dark current is determined by the product of temperature and charge multiplication.
  • the contrast detection unit 25 that includes OB detection uses a dark current from the H-OB average value of V-OB. Is calculated.
  • the reference dark current dispersed in all pixels stored in the all pixel reference dark current screen memory 26 is multiplied by the amount of change in dark current by the multiplier 27 to calculate the dark current varied in all pixels. Subtract from the signal Vi to correct the dark current variation of all pixels.
  • the correlation average and the multi-pixel contour correction are performed in the multi-pixel contour correction unit 29 including the correlation average between the peripheral pixels and the peripheral pixels in the previous screen, and the black level is lowered to reduce the dark portion gamma correction or the dark portion.
  • Contrast is enhanced by limiting the compression of the dark part (dark part correction) or weakening the highlight compression (highlight correction), and the output video signal Vo of about 8 bits is obtained by performing gamma correction and knee correction.
  • FIG. 4A and FIG. 4B showing the correspondence between the brightness enhancement distribution of the incident light, the luminance distribution of the internal video signal Vi, and the luminance distribution of the output video signal Vo in the solid-state imaging device according to the embodiment of the present invention. And will be described.
  • the contrast of the output video signal Vo can be secured by increasing the gamma correction by lowering the black level of the video signal. If the dark part of the incident light rises to around 25% of the rating (50-60% of the output signal), the contrast of the output can be secured without lowering the black level of the video signal and increasing the gamma correction. When the dark part of the incident light rises to around 30% of the rating (55 to 65% of the output signal), the dark part correction that reduces the black level of the video signal to reduce the gamma correction of the dark part and compresses and restricts the dark part is more output. Contrast can be secured.
  • Video signal processing that reduces the black level of the video signal to reduce the gamma correction in the dark part and compresses and restricts the dark part is more effective when performed on each part of the screen or on a pixel basis than on the entire screen. Also, if the iris control output is generated using a video signal with a constant dark part level, the iris will not be narrowed down, the highlight level will not decrease much, and it will recover to about 85% of the rating (85 to 95% of the output signal). To do.
  • FIG. 4A and 4B show the correspondence between the luminance distribution of the incident light, the luminance distribution of the internal video signal Vi, and the luminance distribution of the output video signal Vo for the contrast enhancement of a predetermined portion of the screen of the imaging apparatus according to the embodiment of the present invention.
  • the black level of the video signal is greatly lowered to around ⁇ 50% of the rating to reduce the gamma correction in the dark part, and the dark part level of the video signal is lowered from about 55% to about 15% of the output signal.
  • the amplitude of the luminance output signal is about 70% 105 gradations and about 6.8 bits. Further enhances the edge enhancement.
  • FIG. 2B shows correspondence between the luminance distribution of incident light and the luminance distribution of the output video signal Vo of an imaging apparatus according to another embodiment of the present invention.
  • an increase in the dark level of the input video signal is detected, the black level of the video signal is greatly reduced to around ⁇ 100% of the rated value, dark portion compression and dark portion restriction are performed, gamma correction in the dark portion is reduced, Edge enhancement is strengthened to make the dark level of the output video signal constant (about 5% in FIG. 2B).
  • An iris control output is generated using a video signal in which the dark level of the video signal is constant, and the highlight of the output signal is restored.
  • FIG. 5 is a block diagram showing the configuration of the multi-pixel contour correction and correlation average unit of one embodiment of the present invention, and a schematic diagram showing the operation of multi-pixel contour correction and correlation average of one embodiment of the present invention.
  • 28 is an OB detection unit
  • 29 is an all pixel reference dark current frame memory
  • 30 is a video signal processing unit including black level detection
  • 31 is a pixel delay of 6 or more, line memory of 6 or more, and peripheral pixels including a frame memory.
  • 32 to 38 are pixel delay units
  • 59 is a video level determination unit
  • 41 and 42 are contour signal generation units
  • 44 is a correlation averaging unit
  • 50 to 58 are adders
  • 53 is positive / negative and amplification degree.
  • a multiplier, P1 is a positive multiplier.
  • the pre-correction signal is delayed by the scanning line (H) period in the line memory units M1 to M6 in the in-screen delay unit 31, and becomes a total 7H signal from 0H to 6H.
  • the 3H signal further becomes a total of 7 sets of delayed signals by pixel time, that is, CCD clock time, in 6 pixel delay portions of 38 pixels.
  • the total 7H signal and the total seven delay signals enter the contour signal generation unit 41 and 42, become a vertical contour signal and a horizontal contour signal, are added by the adder 51, and have a small amplitude and large amplitude compression limit.
  • the small amplitude and the large amplitude are compressed and limited by the unit 61, and a contour correction signal is generated by the positive / negative multiplier 53 under the control of the video level determination unit 40 to which the 3H3 pixel delay signal is input, and the 3H3 pixel delay signal or the correlation average addition 3H3
  • the corrected signal is added to the pixel delay signal.
  • the modulation factor decreases from the low frequency as shown in FIG. 7A of the schematic diagram showing the multi-pixel contour correction and correlation average operation of the embodiment of the present invention, as in the signal before correction from the low frequency to the low modulation factor.
  • contour correction 7 pixel component (b) the contour correction 7 pixel component, (c) the contour correction 5 pixel component, and (d) the contour correction 3 pixel component are combined, and (e) the signal after the present invention correction,
  • the contour can be corrected.
  • the contour can be reproduced even when the modulation degree is reduced from a low frequency.
  • a total of 7H signals are delayed by a pixel time, that is, a CCD clock time by 6 to 32 pixel delays, and a total of 49 delay signals are obtained for each H by 7 sets.
  • the pre-correction signal is delayed in the vertical scan (V) period by M7 of the screen memory, and is delayed in the scanning line (H) period in the in-screen delay unit 43 in the same manner as in the in-screen delay unit 31.
  • a total of 49 delay signals are obtained by delaying the pixel time, that is, the CCD clock time, and a total of 7 sets for each H.
  • a total of 98 delay signals of 49 delay signals from the in-screen delay unit 31 and 49 delay signals from the in-screen delay unit 43 are calculated by the correlation averaging unit 44 to correlate with the 3H3 pixel delay signal. Then, the signals with high correlation among the 98 delayed signals are weighted and averaged. As a result, noise is reduced. Further, as shown in FIG. 7A of the schematic diagram illustrating the multi-pixel contour correction and the correlation average operation of the embodiment of the present invention, a dark current called a white defect is generated as in the signal before correction of a low modulation frequency from a low frequency. Even if there are abnormally large pixels or pixels with dark currents called black scratches, the left and right pixels rarely become white scratches or black scratches.
  • the video signal processing unit 4 including contrast enhancement that performs at least one of (dark part correction) and highlight compression (highlight correction) is the video signal processing of FIG. 2 without increasing the AFE 13 amplification.
  • contrast enhancement that performs at least one of (dark part correction) and highlight compression (highlight correction) is the video signal processing of FIG. 2 without increasing the AFE 13 amplification.
  • at least 8 bits + 2 bits and 10 bits or more are necessary, and 12 bits or more are preferable.
  • the AFE amplification of 13 is increased by 4 bits (16 times), the AFE needs 10 bits + 4 bits and 14 bits or more to secure S / N.
  • Example 1 about 600 nm, about 660 nm, about 740 nm, about 780 nm, about 860 nm, about 1040 nm, about 600 nm, about 660 nm, about 740 nm of visible light or near-infrared light having a wavelength that passes through molecules (water vapor and oxygen) in air.
  • the band passes through a narrow band of 1200 to about 1250 nm and about 1550 to about 1650 nm, and the energy of incident light is attenuated. Therefore, one of the following effective sensitivity improvement measures is required.
  • Incident light is increased using a lens with a large aperture stop. A lens with a large aperture is large and expensive.
  • Non-Patent Document 3 a high sensitivity (about +4.5 dB) is obtained by using a photodiode Si imaging device having a depth of about 5.6 ⁇ m or more.
  • a Si imaging element that increases the absorption rate by confining near-infrared light by forming a fine structure that reflects near-infrared light under the photodiode (about +9 dB) is used.
  • High sensitivity A high-sensitivity imaging of about 400 to 1200 nm is possible even with a Si imaging element having a fine structure.
  • Non-Patent Document 4 a high sensitivity (+40 dB or more) is obtained by using an image pickup device having a charge multiplication electrode. Improvements in image sensors are advancing due to advances in microfabrication. In any case, since the dark current is conspicuous, it is necessary to cool the image sensor or to correct the dark current variation in units of pixels.
  • the dark current of the image sensor is proportional to the exponential function of temperature. Specifically, the dark current of the Si image sensor doubles with a 6 ° C. temperature rise. Therefore, the temperature of the image sensor is detected by the temperature sensor, and the value obtained by subtracting the image sensor temperature at the time of measuring the reference dark current of all pixels on the imaging surface at the time of non-multiplication stored from the detected temperature is 2 By calculating the power and multiplying the stored reference dark current of all the pixels on the imaging surface at the time of non-multiplication and the amplification factor of 11 of the AFE, all the pixels on the imaging surface at the time of the current non-multiplication are calculated. A dark current correction value can be calculated.
  • the amount of change in dark current is determined by the product of temperature and charge multiplication. Therefore, a value obtained by averaging H-OBs in the vertical optical black pixel (V-OB) line of the CCD image sensor or a minimum value of H-OB in the V-OB line is This is a representative value of the dark current of H-OB in the V-OB line.
  • the H-OB in the V-OB line has neither a vertical smear component nor a horizontal smear component. Therefore, the video signal processing unit detects the representative value of H-OB in the current V-OB line and stores the detected representative value of H-OB in the current V-OB line.
  • a correction value for dark current of all pixels can be calculated.
  • variations in dark current for all pixels on the imaging surface can be corrected, S / N can be improved, and sensitivity can be effectively improved.
  • amplification of AFE 11 is increased, noise is reduced by adaptive averaging of peripheral pixels and previous screen pixels using a multi-line memory and a field memory, and effective (about 12 dB) high sensitivity is obtained.
  • AFE When increasing the amplification of AFE 11 by 4 bits (16 times), AFE needs 8 bits + 4 bits, 12 bits or more, and 14 bits or more is preferable to secure S / N. All-pixel dark current variation correction, correlation average, multi-pixel contour correction, black level is lowered to weaken gamma correction in dark areas, to limit compression of dark areas (dark area correction), or to weaken highlight compression (highlight correction) It is preferable that the video signal processing unit 4 including the contrast enhancement that performs at least one of them is equal to or more than the same bit as the AFE.
  • Non-Patent Document 2 If the backside illumination structure in which the short-wavelength light described in Non-Patent Document 2 reaches the photodiode without being attenuated is applied to an imaging device having at least the photodiode made of InGaAs, high-sensitivity imaging of about 400 to 1700 nm is possible. If a light guide built-in structure in which short-wavelength light reaches the photodiode without being attenuated at least is applied to an imaging device made of InGaAs at least, high-sensitivity imaging of about 600 to 1700 nm is possible.
  • a light guide with good transmittance of short wavelength light and a light guide built-in structure is applied to an image sensor made of at least a photodiode of InGaAs, high-sensitivity imaging of about 400 to 1700 nm is possible.
  • the photodiode is made of InGaAs, high-sensitivity imaging with a wavelength of about 900 to 1700 nm is easy, and with Si other than the photodiode, microfabrication is easier.
  • the present invention superimposes the power source and the synchronization information on the leaky coaxial cable, and the LED has a narrow band of only wavelengths that transmit oxygen and water vapor (about 600 nm, about 660 nm, about 740 nm, about 780 nm, about 860 nm). Passing, the energy of the incident light is attenuated. Therefore, a high-sensitivity image is taken with the above-described effective sensitivity improvement measure using a Si image sensor, and the dark current is conspicuous, so the image sensor is cooled or the variation in dark current is corrected on a pixel basis. Then, in the fog, the signal charges of the incident light of the fog other than the line position to be monitored are swept away by the electronic shutter, so that only the subject image signal emitted by the LED at the line position to be monitored is output.
  • the present invention superimposes power supply and synchronization information on a leaky coaxial cable, and narrow band pass of only the near infrared emission wavelength (about 1040 nm, about 1200 to about 1250 nm, about 1550 to about 1650 nm) of the LED.
  • the energy of the incident light is attenuated. Therefore, an InGaAs imaging device is used to capture an image with high sensitivity by the above-described effective sensitivity improvement measure. Since the dark current is conspicuous, the imaging device is cooled or the variation in dark current is corrected on a pixel basis. Then, in the fog, the signal charges of the incident light of the fog other than the line position to be monitored are swept away by the electronic shutter, so that only the subject image signal emitted by the LED at the line position to be monitored is output.
  • the LED in response to the synchronous phase of the leaky coaxial cable laid along either the railroad track or road or power transmission line site or wind turbine row, multiple phases with multiple phases corresponding to the position of the railroad track etc. Since the LED emits light, the above-described plurality of phases can be obtained by combining the above-described third embodiment of the effective sensitivity improvement measure with the first embodiment in which the subject such as the railway line at the position corresponding to the global electronic shutter phase is photographed. The light emission intensity of the LED that emits light can be reduced, and the degree of freedom of power supply increases.
  • the compression of the dark portion is restricted (dark portion correction), or the highlight compression is weakened (highlight correction).
  • the power is superimposed on the leaky coaxial cable, or the overhead cable of the train, the power transmission line, and the optical cable with the power supply line.
  • LED that emits light in the above-mentioned multiple phases can be obtained simply by charging vibration power generation of passing objects such as solar power generation, solar thermal power generation, wind power generation, trains or automobiles without supplying power from It becomes possible to drive.
  • each illuminator has a radio wave part such as a GPS satellite having a high-accuracy position detection function and a high-accuracy synchronization function by receiving a radio wave such as a GPS satellite, and each illumination also has an illumination driving part having a reception pulse lighting phase control function. Then, since a plurality of lights emit light at a plurality of phases corresponding to the position, it is possible to photograph a subject at a position corresponding to the global electronic shutter phase. As a result, the present invention can be applied to monitoring an object at an arbitrary point within the line-of-sight range.
  • each illumination is for visual confirmation. Shared with surveillance shooting.
  • each illumination is pulsed in the near infrared, it can be applied to monitoring that is difficult to see. Specifically, it is difficult to see if the near-infrared wavelength of each illumination is about 850 nm, almost difficult to see if it is about 900 nm, and not visible if it is about 950 nm or more.
  • the present invention can be applied to the monitoring of an object existing in a long-distance line or row monitoring target area such as a railroad track, a road, a transmission line site, or a wind turbine row of wind power generation. Furthermore, if each illumination has a high-accuracy position detection function such as GPS and quasi-zenith satellite, a high-accuracy synchronization function, and a pulse lighting phase control function, it can be applied to monitoring an object at an arbitrary point within the line-of-sight range. . Further, the present invention can be applied to monitoring by pulse lighting of yellow-orange illumination for visual confirmation, or monitoring by pulse lighting of near infrared so as not to be visually confirmed.
  • a high-accuracy position detection function such as GPS and quasi-zenith satellite, a high-accuracy synchronization function, and a pulse lighting phase control function

Abstract

La présente invention concerne la capture d'une image vidéo dans laquelle un objet peut être identifié dans une zone linéaire ou colonnaire à surveiller qui couvre ​​une longue distance, où des particules d'un diamètre d'environ 1000 nm sont présentes dans l'air. Dans un système de surveillance dans lequel une voie de transmission de fuite, telle qu'un câble coaxial de fuite, une combinaison d'un plan de masse et d'une ligne de transmission, une ligne de transmission à paire torsadée, une voie de transmission planaire, une voie de transmission diélectrique, ou un guide d'onde, a été disposée le long d'une ligne de chemin de fer, un courant continu inférieur ou égal à 36 Vcc et des informations de synchronisation sont superposés sur la voie de transmission de fuite de sorte que, sur la base d'une source d'alimentation et des informations de synchronisation, une pluralité de circuits pour attaquer des LED avec des impulsions phasées individuellement et des LED d'une longueur d'onde qui passe à travers la vapeur d'eau sont placés le long de la ligne de chemin de fer à des intervalles prédéterminés, et la phase de l'obturateur électronique de la caméra CCD est modifiée en synchronisation avec les informations de synchronisation de la voie de transmission de fuite pour effectuer la capture d'image.
PCT/JP2011/068758 2010-09-09 2011-08-19 Système de surveillance WO2012032916A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011900007316U CN203301595U (zh) 2010-09-09 2011-08-19 监视系统

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010202140 2010-09-09
JP2010-202140 2010-09-09

Publications (1)

Publication Number Publication Date
WO2012032916A1 true WO2012032916A1 (fr) 2012-03-15

Family

ID=45810519

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/068758 WO2012032916A1 (fr) 2010-09-09 2011-08-19 Système de surveillance

Country Status (3)

Country Link
JP (1) JP2012080524A (fr)
CN (1) CN203301595U (fr)
WO (1) WO2012032916A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019036889A (ja) * 2017-08-18 2019-03-07 三菱重工業株式会社 画像処理装置及び画像処理方法
EP3719300A1 (fr) * 2019-04-01 2020-10-07 Siemens Gamesa Renewable Energy A/S Détection de jeu de pale de rotor dans une éolienne utilisant l'effet doppler et un modèle mathématique
WO2020200765A1 (fr) * 2019-04-01 2020-10-08 Siemens Gamesa Renewable Energy A/S Appareil et procédé de détection d'une ou plusieurs propriétés d'une pale de rotor pendant le fonctionnement d'une turbine éolienne

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016210209A (ja) * 2015-04-30 2016-12-15 Ntn株式会社 車軸軸受使用状況管理システム
JP2019126853A (ja) * 2018-01-22 2019-08-01 オムロン株式会社 安全監視システム、安全監視方法、安全監視プログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003185421A (ja) * 2001-08-31 2003-07-03 Pentax Corp ３次元画像入力装置
JP2006171147A (ja) * 2004-12-14 2006-06-29 Canon Inc カメラの焦点検出用補助光装置
JP2006218104A (ja) * 2005-02-10 2006-08-24 Olympus Corp 手術用顕微鏡
JP2007114641A (ja) * 2005-10-24 2007-05-10 Fujifilm Corp デジタルカメラ

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3084695B2 (ja) * 1992-07-09 2000-09-04 富士写真フイルム株式会社 輪郭補正装置
JP2601166Y2 (ja) * 1992-11-06 1999-11-08 住友電装株式会社 照明装置
JP4019182B2 (ja) * 1995-07-19 2007-12-12 本田技研工業株式会社 視覚装置
JPH10191065A (ja) * 1996-12-26 1998-07-21 Dainippon Screen Mfg Co Ltd 画像フィルタリング方法及び装置
JP2000099846A (ja) * 1998-09-18 2000-04-07 Oki Electric Ind Co Ltd 無線電波を使用したトンネル防災システム
JP2002050488A (ja) * 2000-08-04 2002-02-15 Fujitsu Ltd 照明装置
JP2003259385A (ja) * 2002-02-28 2003-09-12 Hitachi Kokusai Electric Inc カラーカメラ
KR100679689B1 (ko) * 2005-01-26 2007-02-06 주식회사 에스티월 Ｇｐｓ 수신기를 이용한 점등 시스템
JP4915314B2 (ja) * 2007-08-23 2012-04-11 オムロン株式会社 撮像装置および撮像制御方法
JP5279605B2 (ja) * 2008-05-13 2013-09-04 株式会社日立国際電気 個体撮像装置及び監視システム
US9578722B2 (en) * 2008-12-04 2017-02-21 Philips Lighting Holding B.V. Methods for selecting and controlling devices

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003185421A (ja) * 2001-08-31 2003-07-03 Pentax Corp ３次元画像入力装置
JP2006171147A (ja) * 2004-12-14 2006-06-29 Canon Inc カメラの焦点検出用補助光装置
JP2006218104A (ja) * 2005-02-10 2006-08-24 Olympus Corp 手術用顕微鏡
JP2007114641A (ja) * 2005-10-24 2007-05-10 Fujifilm Corp デジタルカメラ

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019036889A (ja) * 2017-08-18 2019-03-07 三菱重工業株式会社 画像処理装置及び画像処理方法
EP3719300A1 (fr) * 2019-04-01 2020-10-07 Siemens Gamesa Renewable Energy A/S Détection de jeu de pale de rotor dans une éolienne utilisant l'effet doppler et un modèle mathématique
WO2020200765A1 (fr) * 2019-04-01 2020-10-08 Siemens Gamesa Renewable Energy A/S Appareil et procédé de détection d'une ou plusieurs propriétés d'une pale de rotor pendant le fonctionnement d'une turbine éolienne
WO2020200723A1 (fr) * 2019-04-01 2020-10-08 Siemens Gamesa Renewable Energy A/S Détection de jeu de pale de rotor dans une éolienne à l'aide d'un décalage doppler et d'un modèle mathématique

Also Published As

Publication number Publication date
CN203301595U (zh) 2013-11-20
JP2012080524A (ja) 2012-04-19

Similar Documents

Publication Publication Date Title
JP6243402B2 (ja) 読み出し毎の複数のゲーテッド画素
US9787911B2 (en) Systems and methods for photometric normalization in array cameras
JP5605904B2 (ja) 撮像装置
US8290301B2 (en) Optimized imaging system for collection of high resolution imagery
US8577183B2 (en) Resolution on demand
US9294690B1 (en) System and method for using filtering and pixel correlation to increase sensitivity in image sensors
WO2012032916A1 (fr) Système de surveillance
US11099008B2 (en) Capture device assembly, three-dimensional shape measurement device, and motion detection device
Mei et al. Noise modeling, evaluation and reduction for the atmospheric lidar technique employing an image sensor
EP3043549B1 (fr) Procédés et systèmes de détection de flash
Garanin et al. Daytime observation of low-brightness stars (7 m–8 m) from level terrain
Schreer et al. Dual-band camera system with advanced image processing capability
Kumar et al. A novel algorithm and FPGA based adaptable architecture for correcting sensor non-uniformities in infrared system
Khare et al. Real time non-uniformity correction algorithm and implementation in reconfigurable architecture for infrared imaging systems
Ralph et al. Smart imaging in the infrared
CN212181029U (zh) 基于数字异元累加技术的短波红外成像装置
EP4044587A1 (fr) Systèmes et procédés d'atténuation de non-uniformité d'image
JP5528094B2 (ja) 撮像方法および撮像装置
Hilton et al. High-definition broad-band visible-SWIR sensors for laser mark detection
KR101950436B1 (ko) 중적외선 영상에서의 물체 검출 장치
Miller et al. Camera performance considerations for automotive applications
Argueta-Diaz et al. Range sensing using photometric differentiation
CN111565265A (zh) 一种频率差值摄像器件
JP2013153380A (ja) 撮像装置および撮像方法
CN114593894A (zh) 点源目标成像的探测距离计算方法

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201190000731.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11823395

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11823395

Country of ref document: EP

Kind code of ref document: A1