KR101279374B1 - Fog reduction image enhancer and method for compensating for video of cctv camera - Google Patents

Abstract

PURPOSE: A fog removal image correcting apparatus and a method capable of enhancing the image of a camera are provided to correct the faint color of a low intensity of illumination image into a clear image and are provided to remove fog from the information which is photographed or stored on a real-time basis from a CCTV camera; thereby, obtaining an image of the improved quality. CONSTITUTION: A micro controller unit (MCU) (320) automatically determines the concentration of mist which is distributed to the atmosphere within an image, which is provided from a camera, and produces a control signal for the fog removal. A video decoder (300) receives an input of a digital image signal according to the control signal, and decodes the signal. A fog correction image integrated circuit (IC) (310) prepares a luminance histogram of a faint image and determines the fog. The fog correction image IC corrects the low intensity of illumination image by the weather effect into a clear image quality. [Reference numerals] (300) Video decoder; (310) Fog image correction integrated circuit

Description

Fog reduction image enhancer and method for compensating for video of CCTV camera}

The present invention relates to an apparatus and method for removing fog image correction for improving the image of the camera, in particular fog, haze, haze distributed in the atmosphere to the subject using the fog removal image correction device for improving the image connected to the CCTV camera The fog, image, snow, rain, yellow dust, and smoke are automatically determined by the fog image correction IC to create a histogram of the brightness of the cloudy image caused by rain or fog.The contrast ratio, color correction, and gamma correction greatly improve the contrast ratio. It corrects the faint color of low light image due to fog to clear image quality, so it has good image quality during rain, fog, night or rainy weather, underwater exploration in areas where fog such as airports, harbors, and roads frequently occur from real-time or stored image information from CCTV cameras. Defogging image correction chapter to improve the image of the camera to acquire images and increase visibility And a method.

The CCTV system consists of a plurality of CCTV cameras, DVRs (Digital Video Recorders, digital video storage devices, video servers), and monitoring systems that can monitor video from multiple channels in the control room.

An image color correction device and method for correcting color imbalances in addition to maintaining existing color homeostasis, and a recording medium on which a program for implementing the method are recorded, compare an image with a reference image. An area extracting unit for extracting the extract; A first compensation value estimator estimating a first compensation value for each color channel for compensating for the difference in color characteristic values of the target channel region selected from the achromatic region in consideration of the color characteristic values of the reference channel region selected from the achromatic region; A second compensation value for each color channel which is the same channel as the first channel and compensates for the difference in color characteristic values of the second channel region selected from the achromatic region by considering the color characteristic value of the first channel region selected from the reference image; A compensation value estimator; And a color correction unit that corrects colors in the input image with gain values obtained from the first compensation value and the second compensation value.

Existing image color correction devices and methods can eliminate color rolling, obtain consistent images without changing brightness or color, and improve image quality.

When an image is acquired through a device such as a camera in a fog state, even if the object has the same color, the image obtained by the fog concentration has a different color.

However, when shooting in a foggy climatic situation, the image taken by the camera increases the ratio of fog as the fog density increases, so the objects in the image lost from the CCTV camera or CMOS image sensor lose much of their original color and the There was a problem of having a value close to color (or light).

Therefore, the general vision algorithm using the color information of the image may not provide a good result in the region of high fog concentration. Therefore, a lot of techniques and polarization methods have been disclosed to create a similar image in comparison with the image when there is no fog when a fog image is obtained.

An object of the present invention for solving the problems of the prior art is the fog, haze, haze that is distributed in the atmosphere to the subject using a real time image enhancement device (RTIE: Real Time Image Enhancer) for improving the image connected to the CCTV camera Automatically detects concentrations of snow, rain, yellow dust, smoke, etc., creates a histogram of luminance of cloudy images due to rain or fog, and detects edges of outlines of objects included in the image. Color enhancement, removing noise from the weather effects of snow, rain, and fog, and performing contrast correction, color correction, and gamma correction to significantly improve contrast ratio to correct faint colors in low-light images with clear image quality Areas where fog occurs frequently, such as airports, harbors, and roads, from real-time or saved image information of images taken from CCTV cameras Rain or fog, to provide a night or rainy weather, the sea floor exploration when the image quality is getting an improved video increase the visibility, fog removing image stabilizer for improving the image of the camera device.

Another object of the present invention is to provide a method for correcting a fog image for improving an image of a camera.

In order to achieve the object of the present invention, the fog removal image correction device for improving the image of the camera, at least one analog camera; A coaxial cable (75Ω, BNC cable) is connected to the analog camera through a video input terminal (Video In), and an ADC converts the analog video signal photographed by each analog camera into a digital video signal, and a fog image correction IC and EEPROM. Y of the luminance histogram of the YCbCr value of the image to correct the noise generated in the image by snow, rain, fog, mist, haze, yellow dust, smoke according to weather effects Determining the presence of fog according to the value (luminance), detecting edges of the contours of the objects included in the image, which is the basic image, emphasizing the edges clearly, and luminance histogram of the cloudy image caused by rain or fog To create contrast correction, color correction and gamma correction to improve contrast ratio Defogging image correction device for correcting the faint color of the low light image according to the clear image quality; And a digital image storage device connected to the mist elimination image correction device and storing and displaying an image of each channel of at least one camera through a wired or wireless connection.

The camera uses a CCD camera or a CMOS image sensor, the digital video storage device uses a DVR (Digital Video Recorder) or NVR (Network Video Recorder), characterized in that further comprising a server when building a CCTV system.

The apparatus further includes a monitoring system for displaying a multi-channel image with improved image quality and de-fogging recorded in real time from the plurality of cameras.

In order to achieve another object of the present invention, a method for removing fog image correction for improving the image of the camera, (a) receiving the digital image signal (NTSC, PAL) taken by the camera to the fog removal unit, the fog removal unit Frames of cloudy images due to rain or fog for images containing fog by snow, rain, fog, mist, haze, haze, yellow dust, and smoke due to weather effects by (8bit YUV = 4: 2: 2) A luminance histogram is created every time, and if the luminance histogram exceeds the reference value, an 8-bit color image per pixel of each frame of the sequence of the image frame is automatically determined to minimize the effect of the faint fog included in the image. Converting a bit color enlarged image to fill an empty space with an average value of adjacent pixels using interpolation; (b) The edge of the contour of the object included in the image, which is the basic image (Bayer) generated in the image by snow, rain, fog, mist, haze, yellow dust, and smoke by the image quality improvement unit, It further enhances the contrast ratio by emphasizing the color of the edge more and by performing the color correction and gamma correction to adjust the contrast and RGB values according to the adjustment level set by the user. Correcting the faint color of the image into an image of clear image quality; (c) Emphasizes the edge color of high frequency components so that the edges of the image with improved image quality of the fog are improved by the edge emphasis and gamma correction unit, and corrects the brightness and distortion on the input and output through exponential conversion. Performing gamma correction to provide an image having an improved image quality; (d) encoding the image having the improved image quality by the video encoder from the edge emphasis and gamma correction unit; And (e) converting the digital video signal having improved image quality by the video DAC into an analog video signal and outputting the analog video signal.

The fog removing image correction device and method for improving the image of the camera according to the present invention using the fog removal image correction device connected to a plurality of CCTV cameras fog, haze, haze, snow, rain, Automatically determine the concentration of yellow dust, smoke, etc., create luminance histogram of cloudy images due to rain or fog, determine whether fog is detected, and detect edges of contours of objects included in the image. Emphasizes dark colors, removes noise from climatic effects of snow, rain, and fog. Contrast correction and color correction greatly improve contrast ratio, correcting the faint colors of low-light images into clear images. Save image information from rain, fog, or other areas where fog occurs frequently, such as airports, ports, and roads. Removal of the liver, or in case of rain, fog during seabed exploration obtain an image with improved image quality has an effect to increase the visibility.

The Mist Image Correction Unit (RTIE) provides automatic fog identification to automatically identify snow, rain, fog, smog, sea fog, fire smoke, etc., and improves image quality and provides fog removal images using the fog removal process. It reproduces high visibility and vivid image quality in low light and backlight, and provides vivid image quality by color and contrast image correction.

In addition, the RTIE includes a low light including fog captured by a CCTV camera in low light and backlight due to weather effects such as snow, rain, fog, haze, yellow dust, smog and smoke. Improved image quality by sharpening the image to remove the fog, and using CCTV cameras such as airports, shipping ports, misty roads, military operation areas, fire prevention areas, smoky forest fire disaster areas, and underwater exploration. It can be used in areas where fog frequently occurs in difficult-to-identify special environments and surveillance areas that are difficult to identify due to frequent weather changes, and it has the effect of improving visibility by obtaining surveillance video with improved image quality by removing fog.

The Mist Elimination Image Correction System (RTIE) can be applied to existing CCTV cameras and pre-stored image corrections, and is simple to install and commission by plug-and-plug method, saving money by eliminating the need for additional equipment, and purchasing expensive imported equipment. Economic burden and import substitution effect are expected.

FIG. 1A is a screen illustrating noise generated in an image due to weather effects such as snow, rain, and fog.
FIG. 1B is a view illustrating a fog image removed from a fog image by minimizing a climate effect by removing noise caused by snow, rain, and fog weather effects using an image processing algorithm. Compared screen.
1C is an edge detection comparison screen of a misted image and a mist-free image.
FIG. 2 is a perspective view illustrating a real time image enhancer (RTIE) and an adapter.
3 is a front view and a rear view of a fog removing image correcting apparatus RTIE.
4A is a 2.4 GHz wireless communication device, an NVR / server, and a situation room monitoring system for a wireless network type CCTV camera, a fog elimination image correction device (RTIE), and a 2.4 GHz wireless communication device according to a first embodiment of the present invention through a wireless communication network. This is a schematic diagram of CCTV system.
4B is a schematic diagram of a CCTV system including a wired network type CCTV camera and a fog elimination device (RTIE) according to a second embodiment of the present invention and connected to an NVR / server and a situation room monitoring system through a LAN.
FIG. 5A shows an analog network type 1 / P, T, Z Dome Camera (P, T, Z Dome Camera) according to the third embodiment of the present invention, a fog removal image correcting apparatus (RTIE), and a NVR / This is a schematic diagram of a CCTV system connected to a server and a situation room monitoring system.
Figure 5b is equipped with an analog network type 2 / P, T, Z dome camera, fog elimination device (RTIE) according to a fourth embodiment of the present invention and connected to the DVR / network server, the situation room monitoring system via LAN It is a schematic diagram of CCTV system.
FIG. 6A shows an analog network type 3 / P, T, Z Dome Camera (P, T, Z Dome Camera) according to a fifth embodiment of the present invention, a fog removal image correction device (RTIE), and an NVR / This is a schematic diagram of a CCTV system connected to a server and a situation room monitoring system.
FIG. 6B shows an analog network type 4 / P, T, Z Dome Camera (P, T, Z Dome Camera) according to a sixth embodiment of the present invention, a fog removal image correction device (RTIE), and an NVR / This is a schematic diagram of a CCTV system connected to a server and a situation room monitoring system.
7 is a diagram illustrating an internal configuration of a fog removing image correcting apparatus RTIE.
8 is an internal block diagram of a video processing IC (fog image correction IC) of a fog elimination image correcting apparatus (RTIE).
9 illustrates a principle of adjusting the intensity of an image quality according to an adjustment level of a fog removing imager RTIE.
FIG. 10 detects edges of contours of objects included in a fog image to emphasize edges of high frequency components, and adjusts gamma values through color correction and gamma correction by adjusting RGB values. It is a screen to improve the low-light image generated by the fog to a clear image.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The fog removing image correction device for improving the image of the camera of the present invention using the fog removal image correction device connected to a plurality of CCTV cameras fog, haze, mist, snow, rain, yellow dust, smoke distributed in the atmosphere to the subject Automatically detects the density of light, etc., creates a histogram of luminance of cloudy images due to rain or fog, detects edges of the contours of objects included in the image, and highlights edges of high frequency components. By removing the noise from the weather effect, contrast contrast, color correction and gamma correction are greatly improved to improve the contrast ratio, and to correct the faint color of low light image into a clear image. Rain, fog, night or rainy weather, seabed exploration in areas with frequent fog such as ports and roads This is to remove the fog and obtain an image with improved image quality.

FIG. 1A is a screen illustrating noise generated in an image due to weather effects such as snow, rain, and fog.

FIG. 1B is a view illustrating an image in which fog is removed by correcting an image of a fog image by removing noise caused by snow / rain / fog weather effects using an image processing algorithm. This is a screen comparing Enhanced Image.

1C is an edge detection comparison screen of a misted image and a mist-free image.

FIG. 2 is a perspective view illustrating a real time image enhancer (RTIE) and an adapter.

The Mist Elimination Video Compensator (RTIE) is used by connecting an adapter (5.0Vdc, 0.3A standard) to a DC 5V component at the rear, and coaxial cable (75Ω) through an analog camera (CCTV camera) and video input , BNC cable), to a monitor or digital video storage device (DVR), network video storage device (NVR), or a server computer via a coaxial cable (75Ω, BNC cable) through the Video Out. An input terminal includes an ADC for converting an analog video signal photographed by each analog camera into a digital video signal, and an output terminal includes a DAC for converting a digital video signal into an analog video signal.

3 is a front view and a rear view of a fog removing image correcting apparatus RTIE.

The Mist Image Correction Unit (RTIE) provides automatic fog identification to automatically identify snow, rain, fog, smog, sea fog, fire smoke, etc., and improves image quality and provides fog removal images using the fog removal process. It reproduces high visibility and vivid image quality in low light and backlight, and provides vivid image quality by color and contrast image correction.

The Mist Elimination Image Corrector (RTIE) is a low light image including fog captured by CCTV cameras in low light and backlight due to weather effects such as snow, rain, fog, haze, dust, smog and smoke. Improved image quality by sharpening the image of mist elimination, and identifying it with CCTV camera images such as airports, shipping ports, misty roads, military operations, fire prevention areas, smoky forest fire disaster areas, and underwater exploration. It can be used in areas where fog occurs frequently in difficult special environments and in areas that are difficult to identify due to frequent weather changes, and it provides surveillance video with improved image quality by removing fog. The Mist Elimination Image Correction Device (RTIE) can be applied to existing CCTV cameras and pre-stored image corrections.

Table 1 and Table 2 show the product specifications of the fog elimination image correction device (RTIE).

     division                   standard    product composition 1 channel single type    Video system NTSC / PAL selection method      video Video Input: 1.0Vp-p 75Ohm (BNC) Analog Video
Video output: 1.0Vp-p 75Ohm (BNC)  Resolution 720x480 (NTSC), 720x576 (PAL)  Sensitivity selection (4 steps) Step 0: Fog Reduction and AIE Sensisitivity OFF
Stage 1: Normal (Recommended)
Stage 2: slightly sensitive
Stage 3: Sensitive
Step 4: very sensitive  Input power, current + 5V dc, 0.3A    Operating temperature -10 ℃ ~ 60 ℃     size 104mm x 125mm x 35mm      weight 230 g

     division                     standard Image correction
(Reduction) Fog Reduction
AIE (Adaptive Image Enhancer)
Fog Reduction and AIE Sensitivity Control
Edge Emphasis
Noise Filter
Pre Gamma Control Operation
Mode Fog Reduction Operation: AUTO
Fog Reduction Area: Full Screen   Connection Input: Analog Video (BNC Connector)
Output: Analog Video (BNC Connector)   Power source 5Vdc 300mA (DC Jack)

The present invention converts the image output through a CCTV camera or CCD image sensor, that is, the analog image signal into a digital image signal, and recognizes each pixel of the frame sequence of the image to read the brightness value for each red, green, blue image Serve The brightness of each pixel of the previous frame and the current frame of the image is measured, and the information obtained by the subject is transmitted to the discriminator, and the discriminator determines the brightness of the pixels configured at regular intervals as the target of the brightest value among the average values. It is an image correction technology that improves image quality by compensating for faint low light image.

The embodiment of the present invention has been described as an example of the fog in the weather (weather effect) such as snow, rain, fog, haze, yellow dust, smog, smoke. Applicable to other climate factors, but not limited to this.

The codec can be applied to MPEG-4 Visual and H.264 (MPEG-4 AVC).

The most important part of the image correction process is the edge of each subject (object), which has a high frequency component and needs to be processed very finely.

The contour processing of the objects included in the image is primarily represented by 8-bit gray of Bayer data (Unit Pixel) to have a mosaic pattern, and the obtained 8-bit gray data is extracted by RGRB .... etc. according to the extraction order. Convert to Format. Here, the obtained data is converted from contrast and color information from 8bit / pixel to 24bit / pixel color image, and processed into 24bit color magnification image for each frame, and 24bit color magnification image using interpolation. Color is filled for each area, and the pixel information per pixel of the frame sequence of the image is read to emphasize the edge of the outline included in the object included in the image, and the RGB value is adjusted to adjust the color. Color correction and gamma correction are performed to output clear images with improved image quality.

Y / Cb / Cr = 4: 4: 2, 4: 2: 2, 4: 2: 0

Bayer-> Interpolation-> Color correction-> Gamma correction

8bit YUV, Y / Cb / Cr = 4: 2: 2 (ITU-R BT 601/656), when converting from 12bit / pixel to 24bit / pixel Y / Cb / Cr, interpolation When detecting, the edges of the high frequency components of the critical portions of the contours of the objects included in the image are detected to emphasize the edges of the contours of the objects, and the color correction adjusts the RGB value so that blue Blue red corrects colors more red, and gamma correction adjusts the gamma value included in the image to improve the brightness of low-light images caused by fog for clearer picture quality.

Based on this technology, the Mist Elimination Image Corrector (RTIE) provides automatic detection of fog and automatic determination of fog concentration.

The Mist Elimination Image Corrector (RTIE) creates a histogram of the luminance of cloudy images caused by rain or fog, and performs contrast correction and color correction to improve contrast ratio, making it possible to produce a clear picture of faint colors of low-light images due to weather effects caused by rain or fog. To correct the image.

The fog automatic discrimination function of the RTIE is automatically determined by the fog image correction IC and the controller to determine the fog and the density, and performs contrast correction and color correction to automatically correct the fog density. By greatly improving the performance of the camera, correction is performed so that the image quality is corrected even if the fog density changes, and high visibility in dark or backlight is achieved.

The fog removing image correcting apparatus (RTIE) may be implemented using, for example, an image fog removing algorithm using Dark Channel Prior or another fog removing image correcting algorithm in a fog image correcting IC.

An apparatus for correcting a fog removing image for improving an image of a camera according to the present invention includes at least one analog camera; The analog camera is connected with a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and a coaxial cable (Video Out) is connected to a monitor or a digital video storage device (DVR) or a server computer. 75Ω, BNC cable), and having an analog-to-digital converter (ADC) for converting analog video signals taken by each analog camera to digital video signals, and receiving the digital video signals according to weather effects (snow, rain, and fog). Detect the edges of the contours of the objects included in the image, which is the base image, to remove the noise generated by the sea, fog, haze, yellow dust, and smoke. Contrast of image quality by creating a histogram of luminance of images and performing contrast correction, color correction, and gamma correction Mist removal apparatus for image correction for increasing the ratio correcting a faint color of the low-illuminance image according to a gas phase effective to projection of clear image quality; A digital image storage device (DVR) and a server connected to the fog elimination image corrector (RTIE) and storing and displaying an image of each channel of at least one camera through wired or wireless; And a monitoring system for displaying a multi-channel image of which image quality is improved from the plurality of cameras in real time and image quality of which fog is removed is improved.

The camera uses a CCD camera or a CMOS image sensor.

4A is a 2.4 GHz wireless communication device, an NVR / server, and a situation room monitoring system for a wireless network type CCTV camera, a fog elimination image correction device (RTIE), and a 2.4 GHz wireless communication device according to a first embodiment of the present invention through a wireless communication network. This is a schematic diagram of CCTV system.

The wireless network type CCTV system according to the first embodiment of the present invention comprises at least one analog camera 101; The analog camera 101 is connected to a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and is connected to a monitor or a digital video storage device (DVR) and a server computer through a video output terminal (Video Out). Connected by coaxial cable (75Ω, BNC cable), and equipped with an ADC for converting the analog video signal photographed by each analog camera to a digital video signal, and a fog image correction IC and EEPROM, and receives the digital video signal Determination of the presence or absence of fog according to the Y value (luminance, luminance) of the luminance histogram among the YCbCr values of the image to compensate for noise caused by snow, rain, fog, mist, haze, haze, yellow dust, and smoke according to the weather effect. It detects the edges of the contours of the objects included in the image, which is the basic image, and highlights the edges well. Converts a full color image into a 24-bit color magnified image, fills the empty space with the average value of adjacent pixels using interpolation, and creates a histogram of the luminance image of the blurry image caused by rain or fog, resulting in contrast correction and color correction. A fog removal image correcting device (RTIE) 102 for greatly improving the contrast ratio by performing gamma correction to correct a faint color of a low light image according to a weather effect to an image of clear image quality; The fog removing image correction device (RTIE) 102 is connected with a coaxial cable (75Ω, BNC cable) and is connected to the dome camera 101 with an RS 485 communication cable, and through wired / wireless communication of each channel of at least one camera. An IP server 103 for storing and displaying an image; A 2.4 GHz wireless communication unit 104 which modulates and transmits an image signal having improved image quality in which fog is removed through wireless communication; And a 2.4 GHz wireless communication unit 201 which demodulates and receives an image signal having improved image quality, from which a fog is removed, from the transmitting end through wireless communication. And a network video storage device / server (NVR / Server) 202 connected to the 2.4 GHz wireless communication unit 201 to store the video signal of the improved image quality in which the fog is removed. And a monitoring system 203 connected to a network video storage device / server (NVR / Server) 202 and displaying a multi-channel image having improved image quality recorded in real time and de-fogging from a plurality of cameras. It includes.

4B is a schematic diagram of a CCTV system including a wired network type CCTV camera and a fog elimination device (RTIE) according to a second embodiment of the present invention and connected to an NVR / server and a situation room monitoring system through a LAN.

Wired network type CCTV system according to a second embodiment of the present invention includes at least one analog camera (111); The analog camera 111 is connected to a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and is connected to a monitor or a digital video storage device (DVR) or a server computer through a video output terminal (Video Out). Connected by coaxial cable (75Ω, BNC cable), it is equipped with ADC which converts analog video signal shot by each analog camera into digital video signal, and fog image correction IC and EEPROM. Among the YCbCr values of the image, the presence or absence of fog is determined according to the Y value (luminance, luminance) of the luminance histogram, and the edges of the contours of the objects included in the image, which is the basic image, are detected to make the edges visible. By creating a histogram of luminance of cloudy images caused by rain or fog, it is possible to perform contrast correction, color correction, and gamma correction. Improve the contrast ratio dramatically by fog removal image correction device for correcting the color of the low-illuminance image into the faint image of the clear image quality (RTIE) according to the vapor effect (112); The fog removing image correction device (RTIE) 112 and the video output terminal (Video Out) is connected via a coaxial cable (75Ω, BNC cable), the dome camera 111 and RS 485 communication cable, at least one or more An IP server 113 for storing and displaying an image of each channel of the camera; A network video storage device / server (NVR / Server) 211 for receiving and storing an image signal having improved image quality in which the fog is removed, and receiving the image signal having improved image quality in which the fog has been removed; And a monitoring system 212 connected to a network video storage device / server 211 and displaying a multi-channel image of which image quality is improved in real time and de-fogging from the plurality of cameras. It includes.

FIG. 5A shows an analog network type 1 / P, T, Z Dome Camera (P, T, Z Dome Camera) according to the third embodiment of the present invention, a fog removal image correcting apparatus (RTIE), and a NVR / This is a schematic diagram of a CCTV system connected to a server and a situation room monitoring system.

CCTV system of the analog network type 1 according to a third embodiment of the present invention comprises at least one analog camera 121; The analog camera 121 is connected to a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and is connected to a monitor, a digital video storage device (DVR), and a server computer through a video output terminal (Video Out). Connected by coaxial cable (75Ω, BNC cable), it is equipped with ADC which converts analog video signal shot by each analog camera into digital video signal, and fog image correction IC and EEPROM. Among the YCbCr values of the image, the presence or absence of fog is determined according to the Y value (luminance, luminance) of the luminance histogram, and the edges of the contours of the objects included in the image, which is the basic image, are detected to make the edges visible. Emphasizes and converts an 8-bit color image per pixel into a 24-bit color magnification for each frame of a sequence of video frames, using interpolation of empty space. Fill in the average value of the adjacent pixels, create a histogram of the luminance of the cloudy image due to rain or fog, and perform contrast correction, color correction, and gamma correction to greatly improve the contrast ratio, resulting in low-light images due to weather effects. A fog elimination image corrector (RTIE) 122 for correcting a faint color of the image with a clear image quality; It is connected to the coaxial cable (75Ω, BNC cable) through the fog elimination device (RTIE) 122 and the video output terminal (Video Out), the camera 121 is connected to the RS 485 communication cable, the fog is removed A network video storage device / server (NVR / Server) 221 for receiving and storing an image signal having an improved image quality in which fog has been removed through the LAN; And a monitoring system 222 configured to display a multi-channel image of which image quality is recorded in real time from the plurality of cameras and mist is removed.

Figure 5b is equipped with an analog network type 2 / P, T, Z dome camera, fog elimination device (RTIE) according to a fourth embodiment of the present invention and connected to the DVR / network server, the situation room monitoring system via LAN It is a schematic diagram of CCTV system.

The CCTV system of the analog network type 2 according to the fourth embodiment of the present invention includes at least one analog camera 131; The analog camera 131 is connected to a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and is connected to a monitor or a digital video storage device (DVR) and a server computer through a video output terminal (Video Out). Connected by coaxial cable (75Ω, BNC cable), it is equipped with ADC which converts analog video signal shot by each analog camera into digital video signal, and fog image correction IC and EEPROM. Among the YCbCr values of the image, the presence or absence of fog is determined according to the Y value (luminance, luminance) of the luminance histogram, and the edges of the contours of the objects included in the image, which is the basic image, are detected to make the edges visible. Emphasizes and converts an 8-bit color image per pixel into a 24-bit color magnification for each frame of a sequence of video frames, using interpolation of empty space. Fill in the average value of the adjacent pixels, create a histogram of the luminance of the cloudy image due to rain or fog, and perform contrast correction, color correction, and gamma correction to greatly improve the contrast ratio, resulting in low-light images due to weather effects. A mist elimination image correction device (RTIE) 132 for correcting a faint color of the image with a clear image quality; Defogging is connected via coaxial cable (75Ω, BNC cable) through video correction device (RTIE) 132 and Video Out, and dome camera 131 is connected with RS 485 communication cable. A network video storage device / server (NVR / Server) 231 configured to receive and store a video signal having improved image quality, wherein the image signal having improved fog quality is removed through a LAN; And a monitoring system 232 connected to a network video storage device / server (NVR / Server) 231 and displaying a multi-channel image having improved image quality removed from fog.

FIG. 6A shows an analog network type 3 / P, T, Z Dome Camera (P, T, Z Dome Camera) according to a fifth embodiment of the present invention, a fog removal image correction device (RTIE), and an NVR / This is a schematic diagram of a CCTV system connected to a server and a situation room monitoring system.

CCTV system of the analog network type 3 according to a fifth embodiment of the present invention comprises at least one analog camera 141; The analog camera 141 is connected to a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and is connected to a monitor or a digital video storage device (DVR) and a server computer through a video output terminal (Video Out). Connected by coaxial cable (75Ω, BNC cable), it is equipped with ADC which converts analog video signal shot by each analog camera into digital video signal, and fog image correction IC and EEPROM. Among the YCbCr values of the image, the presence or absence of fog is determined according to the Y value (luminance, luminance) of the luminance histogram, and the edges of the contours of the objects included in the image, which is the basic image, are detected to make the edges visible. Emphasizes and converts an 8-bit color image per pixel into a 24-bit color magnification for each frame of a sequence of video frames, using interpolation of empty space. Fill in the average value of the adjacent pixels, create a histogram of the luminance of the cloudy image due to rain or fog, and perform contrast correction, color correction, and gamma correction to greatly improve the contrast ratio, resulting in low-light images due to weather effects. A mist elimination image corrector (RTIE) 142 for correcting a faint color of the image into a clear image quality; It is connected to the coaxial cable (75Ω, BNC cable) through the fog elimination device (RTIE) 142 and the video output terminal (Video Out), the camera 131 and the RS 485 communication cable, the fog is removed A network video storage device / server (NVR / Server) 241 for receiving and storing an image signal having an improved image quality in which fog has been removed through a LAN; And a monitoring system 242 connected to a network video storage device / server (NVR / Server) 231 and displaying a multi-channel image having improved image quality in which fog is removed.

FIG. 6B shows an analog network type 4 / P, T, Z Dome Camera (P, T, Z Dome Camera) according to a sixth embodiment of the present invention, a fog removal image correction device (RTIE), and an NVR / This is a schematic diagram of a CCTV system connected to a server and a situation room monitoring system.

CCTV system of analog network type 4 according to a sixth embodiment of the present invention comprises at least one analog camera (171); The analog camera 171 is connected to a coaxial cable (75Ω, BNC cable) through a video input terminal (Video In), and is connected to a monitor or a digital video storage device (DVR) or a server computer through a video output terminal (Video Out). Connected by coaxial cable (75Ω, BNC cable), it is equipped with ADC which converts analog video signal shot by each analog camera into digital video signal, and fog image correction IC and EEPROM. Among the YCbCr values of the image, the presence or absence of fog is determined according to the Y value (luminance, luminance) of the luminance histogram, and the edges of the contours of the objects included in the image, which is the basic image, are detected to make the edges visible. Emphasizes and converts an 8-bit color image per pixel into a 24-bit color magnification image for each frame of a sequence of video frames. Fill in the average value of the adjacent pixels, create a histogram of the luminance of the cloudy image due to rain or fog, and perform contrast correction, color correction, and gamma correction to greatly improve the contrast ratio, resulting in low-light images due to weather effects. A fog elimination image corrector (RTIE) 172 for correcting a faint color of the image into a clear image quality; It is connected to the fog elimination image correction device (RTIE) 172 and coaxial cable (75Ω, BNC cable), and is connected to the camera 171 with the RS 485 communication cable. A network video storage device / server (NVR / Server) 231 for receiving and storing an image signal having improved image quality through which fog is removed; And a monitoring system 232 connected to a network video storage device / server (NVR / Server) 231 and displaying a multi-channel image having improved image quality removed from fog.

7 is a diagram illustrating an internal configuration of a fog removing image correcting apparatus RTIE.

A real time image enhancer (RTIE) includes: an ADC for converting an analog video signal photographed from an analog camera from each analog camera into a digital video signal; In order to improve the image quality of the image provided from the camera, a control signal is generated to automatically determine the concentration of snow, rain, fog, haze, haze, yellow dust, and smoke according to a weather effect distributed in the atmosphere to remove the fog. A control unit (MCU) 320; A video decoder (300) for receiving and decoding the digital video signal according to a control signal of the controller (320); The luminance histogram of cloudy images caused by rain or fog is removed by receiving digital video signals taken by the camera to remove noise caused by snow, rain, fog, mist, haze, haze, yellow dust, and smoke according to weather effects. When it exceeds the standard value of the luminance histogram of the image, it is determined that the fog exists, and the edge of the contour of the objects included in the image, which is the basic image, is detected to emphasize the edge of the high frequency component well. Converts 12-bit color images per pixel into 24-bit color magnified images for each frame of the sequence of video frames, fills the empty space with the average value of adjacent pixels using interpolation, and sets the level (0,1,2) set by the user. Contrast, color correction, and gamma correction are greatly increased in accordance with (3,4). A fog correction image IC 310 for correcting a faint color of a low light image according to a weather effect to a clear image quality; And a power switch, a display unit, and a fog display unit 330 for selecting power ON / OFF and outputting a power indicator (Power ON) and a fog indicator (Fog ON).

Fig. 8 is an internal block diagram of a video processing IC (fog image correction IC) of a fog removing image correcting apparatus (RTIE, DSP processor).

The fog correction image IC is connected to the control unit (MCU) through the I2C BUS and receives digital image signals (NTSC, PAL) captured by the camera through the IC chip of the DSP processor according to the weather effect (snow, rain, If the luminance histogram exceeds the threshold by creating a luminance histogram for each frame of a cloudy image caused by rain or fog for an image containing fog due to fog, sea fog, haze, yellow dust, and smoke (8bit YUV = 4: 2: 2). Interpolation of empty space by converting an 8-bit color image per pixel into a 24-bit color magnification image for each frame of a sequence of image frames to automatically determine the image containing the fog and to minimize the effects of the faint fog included in the image. A fog removing unit 312 which fills with the average value of adjacent pixels using? The edges of the edges of the high frequency components are further emphasized by detecting the edges of the contours of the objects included in the image, which are the basic images (Bayer) generated in the image by snow, rain, fog, mist, haze, haze, yellow dust, and smoke. Contrast correction and color correction and gamma correction are performed according to the adjustment level set by the user, which greatly improves the contrast ratio. An image quality improvement unit 313 for correcting with; Emphasizes the edges of objects in the image with improved image quality by removing the fog, and performs gamma correction to correct the brightness and distortion on the input and output through exponential conversion. Providing an edge emphasis and gamma correction unit 314; A video encoder (315) for encoding the image having the improved image quality from the edge emphasis and gamma correction unit; And a video DAC 316 for converting the digital video signal having the improved image quality into an analog video signal and outputting the same, and comprising an EEPROM 317, an SPI 318, an I ² C 319, and a register 320. do.

The fog correction image IC uses the common digital image interface 8bit YUV = 4: 2: 2 ITU-R BT 601/656 to provide fog image detection and fog image correction without changing the system in existing video encoders.

The fog correction image IC uses the BU6521KV, and provides fog automatic detection function and fog image correction function. General digital image interface 8bit YUV = 4: 2: 2, ITU-R BT. Using 601/656, it is compatible with existing video encoders without any system changes. The fog image correction function creates a histogram of luminance of cloudy images caused by rain or fog, and greatly improves the contrast ratio by performing contrast correction and color correction by adjusting RGB values, thereby clearly correcting a faint color of an image caused by rain or fog. do. In addition, the fog automatic discrimination function can determine the degree of 'dimness' of the presence of fog using the Y value of the luminance histogram of the image, and perform color correction and gamma correction processing to correct a clear image even if the fog density changes. .

  Product Name Power supply voltage (V) Image input interface Control interface burn
size Operating temperature range package  BU6521KV 1.45-1.55 (V _DD Core)
2.7 to 3.6 (V _DD I / O, AV _DD ) 8bit YUV = 4: 2: 2 I ^ 2C / Serial EEPROM Interface NTSC
PAL -40 to +85 VQFP48C
9.0x9.0mm

9 illustrates a principle of adjusting the intensity of an image quality according to an adjustment level of a fog removing imager RTIE. The mist elimination imaging apparatus adjusts the intensity of the image quality according to the 0, 1, 2, 3, 4 contrast brightness adjustment level set by the user.

FIG. 10 detects edges of contours of objects included in a fog image to emphasize edges of high frequency components, and adjusts gamma values through color correction and gamma correction by adjusting RGB values. It is a screen to improve the low-light image generated by the fog to a clear image.

In the fog removal image correction method for improving the image of the camera, (a) receiving the digital image signal (NTSC, PAL) taken by the camera to the fog remover, according to the weather effect (weather effect) by the fog remover A luminance histogram is created for each frame of a cloudy image caused by rain or fog with respect to an image (8bit YUV = 4: 2: 2) containing fog by snow, rain, fog, mist, haze, yellow dust, and smoke. When the threshold is exceeded, the 8-bit color image per pixel is converted to 24-bit color magnification for each frame of the sequence of video frames to automatically determine the image containing the fog and minimize the effect of the faint fog included in the image. Filling with an average value of adjacent pixels using interpolation; (b) The edge of the contour of the object included in the image, which is the basic image (Bayer) generated in the image by snow, rain, fog, mist, haze, yellow dust, and smoke by the image quality improvement unit, Emphasizes the color of the edge more and performs contrast correction, color correction and gamma correction according to the adjustment level set by the user, greatly improving the contrast ratio according to the weather effect. Correcting the faint color of the low light image to a clear image quality; (c) Emphasizes the edge color of high frequency components so that the edges of the image with improved image quality of the fog are improved by the edge emphasis and gamma correction unit, and corrects the brightness and distortion on the input and output through exponential conversion. Performing gamma correction to provide an image having an improved image quality; (d) encoding the image having the improved image quality by the video encoder from the edge emphasis and gamma correction unit; And (e) converting the digital video signal having improved image quality by the video DAC into an analog video signal and outputting the analog video signal.

As described above, the method of the present invention may be implemented as a program and read to a recording medium (CD-ROM, RAM, ROM, memory card, hard disk, magneto-optical disk, storage device, etc.) in a form readable by software of a computer. Can be stored.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken in conjunction with the present invention. The present invention can be variously modified or modified.

101: camera 102: fog control image correction device
103: IP server 104: wireless communication unit (2.4GHz RF)
201: wireless communication unit 202: NVR / server
203: situation room monitoring system

Claims (8)

In the fog elimination image correction device for improving the image of the camera
At least one analog camera;
It is equipped with an ADC which converts the analog video signal photographed from each analog camera into a digital video signal, and a fog image correction IC and an EEPROM, and receives the digital video signal according to a weather effect (snow, rain, fog). Determination of fog based on the Y value (luminance, luminance) of the luminance histogram among the YCbCr values of the image to correct the noise generated by the image, sea fog, haze, yellow dust, and smoke, and included in the image The edges of the contours of the objects are detected to emphasize the edges of the high frequency components, and the interpolation of empty space is performed by converting an 8-bit color image per pixel into a 24-bit color magnification image for each frame of a sequence of image frames. Fills with the average value of adjacent pixels, and creates a histogram of the luminance of the cloudy image due to rain or fog. A fog elimination image correcting apparatus (RTIE) for improving contrast ratio by performing color correction and gamma correction to correct a faint color of a low light image according to a weather effect to an image of clear image quality (RTIE); And
A digital image storage device connected to the fog elimination image corrector for storing and displaying an image of each channel of at least one camera through wired or wireless;
Defogging image correction apparatus for improving the image of the camera comprising a. The method of claim 1,
The camera uses a CCD camera or a CMOS image sensor, the digital video storage device uses a DVR (Digital Video Recorder) or NVR (Network Video Recorder), the camera further comprises a server when building a CCTV system Defogging image correction device for improving the image. The method of claim 1,
And a monitoring system configured to display a multi-channel image of which image quality is improved in real time from the at least one or more cameras and the fog is removed. The method of claim 1,
The mist elimination image correction device (RTIE),
It is used by connecting an adapter (5.0Vdc, 0.3A standard) to DC 5V component at the rear, and connected by coaxial cable (75Ω, BNC cable) through analog camera (CCTV camera) and video input terminal (Video In), monitor Or digital video storage device (DVR), network video storage device (NVR), or a server computer are connected to the coaxial cable (75Ω, BNC cable) through the video output terminal (Video Out), and the analog recorded by each analog camera at the input terminal. And a DAC for converting a video signal into a digital video signal, and a DAC for converting the digital video signal into an analog video signal at an output terminal. The method of claim 1,
The mist elimination image correction device (RTIE),
An ADC for converting the analog video signal photographed from each analog camera into a digital video signal;
In order to improve the image quality of the image provided from the camera, a control signal is generated to automatically determine the concentration of snow, rain, fog, haze, haze, yellow dust, and smoke according to a weather effect distributed in the atmosphere to remove the fog. A control unit (MCU);
A video decoder configured to receive and decode the digital video signal according to a control signal of the controller;
Histogram of the blurry image caused by rain or fog to remove noise generated in the image by snow, rain, fog, mist, haze, yellow dust, and smoke according to the weather effect by receiving the digital video signal photographed by the camera If it exceeds the threshold value of the luminance histogram of the image, it is judged that the fog exists and detects the edge of the contour of the objects included in the image, which is the basic image, and emphasizes the edge of the high frequency component. Converts a 12-bit color image per pixel into a 24-bit color magnification image for each frame of the sequence of video frames, filling the empty space with the average value of adjacent pixels using interpolation, contrast correction, color correction, Gamma correction improves contrast ratio, resulting in blurring of low-light images due to weather effects IC fog correction image to correct the color to a clear picture; And
A power switch, a display unit, and a fog display unit for selecting power ON / OFF and outputting a power indicator (Power ON) and a fog indicator (Fog ON);
Defogging image correction apparatus for improving the image of the camera comprising a. 5. The method of claim 4,
The fog correction image IC
Using the general digital video interface 8bit YUV = 4: 2: 2 ITU-R BT 601/656, the existing video encoder provides fog image discrimination and fog image correction without system changes. Defogging Image Correction Device. 5. The method of claim 4,
The fog correction image IC
It is connected to the control unit (MCU) through the I2C BUS and receives digital video signals (NTSC, PAL) captured by the camera through the IC chip of the DSP processor.It can snow, rain, fog, haze, haze, A luminance histogram is created for each frame of a cloudy image due to rain or fog by using yellow dust and smoke (8bit YUV = 4: 2: 2), and when the luminance histogram exceeds a reference value, the image includes fog. In order to automatically determine and minimize the effect of the faint fog included in the image, an 8-bit color image per pixel is converted into a 24-bit color magnification for each frame of the sequence of the image frame, and the empty space is interpolated using interpolation. A mist removing unit filling the average value;
The edges of the edges of the high frequency components are further emphasized by detecting the edges of the contours of the objects included in the image, which are the basic images (Bayer) generated in the image by snow, rain, fog, mist, haze, haze, yellow dust, and smoke. Contrast correction and color correction and gamma correction are performed according to the adjustment level set by the user, which greatly improves the contrast ratio. Image quality improvement unit for correcting the image of the;
Emphasizes the edge color of high frequency components to show the contours of objects with improved image quality for fog, and performs gamma correction to correct the brightness and distortion of input and output through exponential conversion. An edge emphasis and gamma correction unit providing this improved image;
A video encoder for encoding the image having the improved image quality from the edge emphasis and gamma correction unit; And
A video DAC converting the digital video signal having improved image quality into an analog video signal and outputting the analog video signal;
Defogging image correction apparatus for improving the image of the camera comprising a. In the fog removal image correction method for improving the image of the camera,
(a) Receiving digital image signals (NTSC, PAL) taken by the camera to the mist eliminator, snow, rain, fog, haze, haze, yellow dust, smoke according to the weather effect (weather effect) by the mist eliminator Luminance histogram is created for each frame of misty image due to rain or fog by using fog (8bit YUV = 4: 2: 2), and the image is automatically identified as fog when the luminance histogram exceeds the reference value. In order to minimize the effect of the faint fog included in the image, an 8-bit color image per pixel is converted into a 24-bit color magnified image for each frame of the sequence of image frames, and the empty space is filled with the average value of adjacent pixels using interpolation. step;
(b) The edge of the contour of the object included in the image, which is the basic image (Bayer) generated in the image by snow, rain, fog, mist, haze, yellow dust, and smoke by the image quality improvement unit, It further enhances the contrast ratio by emphasizing the color of the edge more and by performing the color correction and gamma correction to adjust the contrast and RGB values according to the adjustment level set by the user. Correcting the faint color of the image into an image of clear image quality;
(c) Emphasizes the edge color of high frequency components so that the edges of the image with improved image quality of the fog are improved by the edge emphasis and gamma correction unit, and corrects the brightness and distortion on the input and output through exponential conversion. Performing gamma correction to provide an image having an improved image quality;
(d) encoding the image having the improved image quality by the video encoder from the edge emphasis and gamma correction unit; And
(e) converting the digital video signal having improved image quality by the video DAC into an analog video signal and outputting the analog video signal;
Defogging image correction method for improving the image of the camera comprising a.

Images