KR20100018998A - Omnidirectional monitoring camera system and an image processing method using the same - Google Patents

Abstract

PURPOSE: An omnidirectional monitor camera system is provided to monitor everywhere using the camera having broadband lens. CONSTITUTION: A display(320) displays on a monitor image which is modified in DSP(300). A codec(500) compresses the image controlled in DSP. A wireless transmission unit(800) transmits compressed video data to radio signal. A wireless receiver(810) decompresses by demodulating received data from the wireless transmission unit.

Description

OMNIDIRECTIONAL MONITORING CAMERA SYSTEM AND AN IMAGE PROCESSING METHOD USING THE SAME}

The present invention relates to an omnidirectional surveillance camera system and an image processing method using the same, and more particularly, converts an image signal photographed from a surveillance camera using a wideband lens into a screen that is familiar to an original screen or a human vision, or displays the image signal. All cameras can be stored and played back, and the captured video signal can be compressed and transmitted wirelessly, and the wireless receiver can display the original screen or the screen familiar to human vision, display it, or save and play it. A system and an image processing method using the same.

 A general surveillance system is composed of a surveillance camera having an angle of view of 105 ° or less, a monitor connected thereto to display an image signal, and a storage medium for storing the image signal.

Such a conventional monitoring system has a problem that the field of view is limited to about 105 ° left and right in the case of a vehicle, and the field of view is limited to 80 ° or less in the left and right in the case of general monitoring. In addition, in the case of the rotary monitoring system, the field of view is limited to about 180 degrees, and the field of view of the monitoring is still present because the field of view of 180 degrees cannot be simultaneously monitored. In order to eliminate such blind spots, at least four or five cameras are required, and thus an increase in installation costs is inevitable, and space is inefficiently utilized.

In addition, when the conventional monitoring system is installed in a river or a remote, it is inevitably difficult to install or costly.

The present invention has been proposed in order to solve the problems in the prior art as described above, and an object of the present invention is to perform surveillance without blind spots using a single camera equipped with a wideband lens and simultaneously record and play a function. The present invention provides an omnidirectional surveillance camera system and an image processing method using the same, which enable monitoring using a Ethernet and a wireless transmission function.

According to a preferred embodiment of the present invention for achieving the above object, an omnidirectional surveillance camera system comprising: a wideband lens capable of photographing a subject from all directions; An image sensor which detects an image received by the wideband lens and converts the image into an electrical signal; A DS for receiving a video signal transmitted from the image sensor and controlling an image or transforming an original image into an image familiar to human vision; A display in charge of displaying a video modified in the DPS on a monitor, and a codec for compressing the image controlled in the DPS; Ethernet for transmitting a video data compressed by the codec to a remote place through a network, a USB interface for storing the compressed video data, and modulating and transmitting the compressed video data into a wireless signal. A wireless transmission unit in charge of a function; A wireless receiver configured to receive, demodulate, decompress, decompress, and display data transmitted wirelessly from the wireless transmitter; An omnidirectional surveillance camera system is provided that includes a CAPIU in charge of controlling the operation of the entire system.

Preferably, the wideband lens is a panoramic lens for photographing an omnidirectional subject having a convex surface formed on one side, and is a mirror positioned behind the panoramic lens and reflecting an image of a subject captured within a screen angle And a relay lens, which is reflected by the mirror and relays an image reflected on the convex surface of the lens Lens in front of the panoramic lens.

Also preferably, the image received by the image sensor is characterized in that it takes the form of a ring-shaped original image.

In addition, the wideband lens used in the present invention also includes a general fisheye lens without using a reflector. In the case of using a general fisheye lens that does not use the reflector, the image received by the image sensor has a shape of a circular original image filled with an inside.

Also preferably, the image sensor may use a CCD or CMOS image sensor, and when a CCD is used, a video decoder may be added between the image sensor and the DSP.

Also preferably, the DSP converts the ring-shaped or circle-shaped original image into a perspectively normal image, splits it into two images, splits it into four images, or first converts the divided image and the divided image. Arrange them together, enlarge or reduce a specific screen, or control a digital image signal to control the color, contrast, etc. of the image to deliver the image signal to the display.

At the same time, the DSP transfers the original video signal to Codec.

Also preferably, the FPGA converts the ring-shaped or circle-shaped original image into a transparently normal image when the DSP is insufficient in function to convert the original image into a transparent normal image; It divides it into two images, divides it into four images, arranges the first converted image and the divided images together, or enlarges / reduces a specific screen on behalf of the DSP.

Also preferably, the Codec may be MPEG-2 based on the original video signal received from the DSP; MPEG4 scheme; In H.263 mode; Compression of the H.264 method or the like to reduce the data capacity, and conversely, the MPEG2 method; MPEG4 scheme; In H.263 mode; And decompresses the data compressed by the H.264 method and converts the data into an original video signal.

Also preferably, the display may display an original image transferred from the DSP or a transparently converted image on a monitor.

Also preferably, the Ethernet is responsible for receiving the compressed video data and transmitting to a remote PC.

Also preferably, the USB I / F may receive the compressed image data and store the same in a storage device such as a USB method or an SD card, and the USB may use USB 2.0.

Also preferably, the wireless transmission unit may receive the compressed image data and modulate the compressed image data into a wireless signal to transmit the wireless signal.

As described above, according to the omnidirectional surveillance camera system according to the present invention and an image processing method using the same, one surveillance camera can be used to monitor a photographing area from all directions without a blind spot and simultaneously perform a recording function. It is effective, and the installation cost is much reduced compared to the conventional one, and there is a space utilization effect to efficiently utilize other space due to the small installation space, and it has a wireless transmission and reception function, so it is difficult to use in areas where wiring is difficult or impossible. You can remove the restriction.

Although the present invention has been described based on the above-described preferred embodiment, the present invention is not limited thereto, and those skilled in the art will be able to perform various modifications based on the appended claims.

Hereinafter, with reference to the accompanying drawings will be described a preferred embodiment of the omni-directional surveillance camera system and an image processing method using the same.

1 is a schematic block diagram of a omnidirectional surveillance camera system according to the present invention, FIG. 2 is a block diagram showing in detail the structure of the wireless receiver of FIG. 1, and FIG. 3 is a omnidirectional surveillance camera system according to the present invention. 4 is a block diagram illustrating a detailed structure of a block for reproducing a recorded image. FIG. 4 is a real-time display or storage of a client PC by transmitting an image captured by the omnidirectional surveillance camera system to a network. FIG. 5 is a flowchart illustrating the operation of software that plays a role of playing a recorded image on a device. FIG. 5 is a diagram illustrating in detail the structure of the wideband lens and the image sensor of FIG. 1, and FIG. Illustrates the difference between the environment and the surveillance environment when the wired / wireless omnidirectional surveillance camera system according to the present invention is applied. 7 is a view illustrating a field of view of a camera when the omnidirectional surveillance camera system according to the present invention is applied, and FIG. 8 is a view illustrating a field of view of the camera when the omnidirectional surveillance camera system according to the present invention is applied. FIG. 9 is a diagram illustrating exemplary images obtained by converting the image captured in FIG. 1 into a transparently normal image by software.

Referring to FIG. 1, the omnidirectional surveillance camera system according to the present invention includes a wideband lens 100 capable of photographing an omnidirectional subject; An image sensor 200 for detecting an image received by the wideband lens 100 and converting the image into an electrical signal; A digital signal processor (DSP) 300 for controlling the image by receiving the image signal transmitted from the image sensor 200 or transforming the original image into an image familiar to human vision; A display (320) for displaying a video modified by the DSP (300) on a monitor, and a codec (500) for compressing the image controlled by the DSP (300); An Ethernet 600 for transmitting a video data compressed by the Codec 500 to a remote place through a network; The client PC stores the image data transmitted to the remote site in a built-in hard disk drive (HDD), or decompresses the image data and transforms the image data into an image familiar to human vision and displays it on a monitor. 610; A USB transmission interface (USB I / F) 700 for storing the compressed image data, and a wireless transmitter 800 for transmitting a function of modulating the compressed image data into a wireless signal; A wireless receiver 810 responsible for receiving, demodulating, decompressing, and displaying the data transmitted by the wireless transmitter 800 on a monitor; It includes a CPU 400 that is responsible for controlling the operation of the entire system according to the present invention.

In addition, it is a feature of the present invention that the USB I / F 700 is applied to USB 2.0. By using USB 2.0, compatibility with existing USB 1.1 is possible and data can be transferred quickly at up to 480Mbps.

With reference to FIG. 2, a process of receiving a radio (RF) signal from the wireless receiver, decompressing the signal, and encoding the image signal into a monitor screen will be described. The wireless signal received from the omnidirectional surveillance camera system under the control of the CPU 314 is demodulated into a digital video signal compressed by the RF Module 811. The compressed digital video signal is decompressed by the video decompress 812. The decompressed digital video signal may be encoded as a video signal by the video encoder 813 and displayed on the monitor screen 317. Reference numerals 315 and 316 denote flash memory and SDRAM, respectively.

Referring to FIG. 3, a process of playing or backing up an image recorded in the storage device 710 on the client PC 610 will be described. In the omnidirectional surveillance camera system, the image may be stored in the connected storage device 710 in the form of compressed data. The compressed image data may be transmitted to a client PC 610 remotely connected using dedicated software according to a user's selection and stored in an HDD built in the client PC. In addition, the compressed image data is transmitted to a remotely connected Client PC 610 according to a user's selection, and the image data is decompressed through a dedicated software to be transformed into a form of an original image or an image familiar to human vision. In real time. In addition, since the storage device 710 uses a removable USB type or SD card, the storage device is detached from the omnidirectional surveillance camera system and directly connected to the PC to store the image data stored in the storage device on the user's PC. Can be played back using software.

The storage device may be a USB type memory, an HDD, an SD card, or the like.

Referring to FIG. 4, the captured image of the omnidirectional surveillance camera is displayed through the following steps.

That is, the real-time image data received by the PC or the data recorded by the omnidirectional surveillance camera system by accessing the omnidirectional surveillance camera system is loaded from the program installed in the PC (S2).

Thereafter, in step S2, the lens type used for the received image data or the loaded recorded image is selected in real time (S4).

Thereafter, the center of the image and the region of the image inputted by the program installed in the PC are input (S6).

Subsequently, a screen configuration for displaying an image in a program installed in the PC is selected from an original image and an image transformed into an image familiar to human vision in various forms (S8).

Subsequently, an algorithm for correcting the distorted image based on the selected lens type, the center of the image, the region, and the screen configuration is performed to display or reproduce a transparent image in real time (S10). The interface screens that are displayed together when executing each step programmatically are stored in the CPU of the PC, and such a program is the same as that stored in the CPU of the omnidirectional surveillance camera system. Of course, the same is stored in the CPU of the omnidirectional surveillance camera system.

Referring to FIG. 5, a schematic view of one of the wideband lenses 100 photographing an omnidirectional subject may be seen. The subject captured in the screen angle of FIG. 3 is reflected by a mirror 101 behind the lens and reflected on the convex surface of the lens 102 in front of the broadband lens 100, and then a relay lens. An image signal is sent to the image sensor (image sensor 200) of the camera through the 103. Here, the image received by the image sensor 200 is as shown in FIG. The image sensor 200 is a high-definition image using an image sensor of 41 million pixels, 1.3 million pixels, 2 million pixels, and 5 million pixels (not limited thereto). The ability to transmit images is also a feature of the present invention.

On the other hand, as the image sensor (Charged Coupled Division (CCD)) image sensor (CCD) or CMOS image sensor may be used.

Referring to FIG. 7, an example of an angle of view of a lens using a reflector, which is one of the wideband lenses 100, for photographing an omnidirectional object may be seen. In the case of using an omnidirectional lens using a reflector, it is possible to monitor a constant angle between the front and rear of the lens as shown in FIG. 7, and the image received by the image sensor through the omnidirectional lens has an annular shape. do.

Referring to FIG. 8, an example of an angle of view of a fisheye lens, which is one of the omnidirectional lenses 110 for photographing an omnidirectional subject, is shown in the ceiling of an office. As in the case of using a fisheye lens, all angles in front of the lens can be monitored without a blind spot, and the image received by the image sensor through the omnidirectional lens has a circular shape.

Referring to FIG. 9, the central processing unit 300 shows screens processed into images that are normally normal (users can check the contents of the photographed images) and display full, two, four, or enlarged screens, respectively. Indicates.

1 is a schematic block diagram of an omnidirectional surveillance camera system according to the present invention.

2 is a view showing in detail the structure of the wireless receiver of FIG.

Figure 3 is a block diagram showing in detail the structure of the block for reproducing the recorded video in the omni-directional surveillance camera system according to the present invention.

4 is a flowchart illustrating the operation of the software that plays a role of displaying the image captured by the omnidirectional surveillance camera system according to the present invention to a network in real time on a client PC or playing a recorded image on a storage device. to be.

FIG. 5 is a block diagram illustrating in detail the structure of the omnidirectional lens and the image sensor of FIG. 1.

6 is a view showing a comparison between the conventional surveillance system and the surveillance environment to which the omnidirectional surveillance camera system according to the present invention is applied.

7 is a diagram illustrating a field of view of a camera when the wired / wireless omnidirectional surveillance camera system according to the present invention is applied.

8 is a view showing another example of the field of view of the camera when the omnidirectional surveillance camera system according to the present invention is applied.

FIG. 9 is a diagram illustrating exemplary images obtained by converting the image captured in FIG. 1 into a transparent image by converting the image captured in FIG.

Explanation of symbols on the main parts of the drawings

100: omnidirectional lens

200: image sensor

300: Digital Signal Processor (DSP)

320: display

400: CPI

500: Codec

600: Ethernet

700: USB interface (USB I / F)

800: wireless transmitter

810: wireless receiver

Claims (13)

A broadband lens 100 capable of capturing an omnidirectional subject; An image sensor 200 for detecting an image received by the wideband lens 100 and converting the image into an electrical signal; A digital signal processor (DSP) 300 for controlling the image by receiving the image signal transmitted from the image sensor 200 or transforming the original image into an image familiar to human vision; A display 320 for displaying a video modified by the DSP 300 on a monitor, and a codec 500 for compressing a video controlled by the DSP 300; A wireless transmitter 800 responsible for modulating and transmitting the compressed image data into a wireless signal; A wireless receiver 810 responsible for receiving, demodulating and decompressing data transmitted wirelessly from the wireless transmitter 800 to display on a monitor; The omnidirectional surveillance camera system comprising a CPU 400 for the function of controlling the operation of the entire system. A broadband lens 100 capable of capturing an omnidirectional subject; An image sensor 200 for detecting an image received by the wideband lens 100 and converting the image into an electrical signal; A digital signal processor (DSP) 300 for controlling the image by receiving the image signal transmitted from the image sensor 200 or transforming the original image into an image familiar to human vision; A display (320) for displaying a video modified by the DSP (300) on a monitor, and a codec (500) for compressing the video controlled by the DSP (300); An Ethernet 600 for transmitting a video data compressed by the Codec 500 to a remote place through a network; The omnidirectional surveillance camera system comprising a CPU 400 for the function of controlling the operation of the entire system. The omnidirectional surveillance camera system according to claim 1 or 2, further comprising a USB I / F (700) for storing compressed image data in the Codec (500). According to claim 1 or 2, The wideband lens 100 is a panoramic lens (100) to photograph the object of the omnidirectional that is formed with a convex surface on one side, is located behind the panoramic lens A mirror 101 for reflecting an image of a subject captured in the screen angle, and a relay lens for relaying an image reflected by the mirror and reflected on the convex surface of the lens 102 in front of the panoramic lens; (Relay Lens) 103, characterized in that the omnidirectional surveillance camera system. The omnidirectional surveillance camera system according to claim 1 or 2, wherein the image received by the image sensor is in the form of a ring-shaped original image. The omnidirectional surveillance camera system according to claim 1 or 2, wherein the wideband lens is a fisheye lens without using a reflector. The omnidirectional surveillance camera system according to claim 1 or 2, wherein the image sensor is one of a CCD and a CMOS image sensor. 3. The DSP 300 according to claim 1 or 2, wherein the DSP 300 converts the ring-shaped or circle-shaped original image into a perspectively normal image, divides it into two images, divides it into four images, or first. It is responsible for arranging the converted image and the divided image together, enlarge / reduce a specific screen, or control the digital image signal to control the color, contrast, etc. of the image to deliver the image signal to the display 320 and At the same time the omnidirectional surveillance camera system, characterized in that to perform the function of transmitting a video signal to the Codec (400). The method according to claim 1 or 2, wherein the DSP converts the original image in a ring shape or a circle shape into a transparently normal image when the DSP lacks the capability to convert the original image into a transparent image. It further includes an FPGA that divides it into two images, splits it into four images, arranges the first converted image and the divided images together, or performs a function of replacing a DSP with a DSP. 360-degree surveillance camera system, characterized in that. The method according to claim 1 or 2, wherein the codec 400 compresses the original video signal received from the DSP 300 by one of the MPEG2 method, the MPEG4 method, the H.263 method, and the H.264 method. It can reduce the capacity of data and conversely decompress the compressed data by MPEG2 method, MPEG4 method, H.263 method or H.264 method and convert the data into original video signal. Surveillance camera system. The method of claim 3, wherein the USB I / F 700 receives the compressed image data and stores the compressed image data in a storage device such as a USB method or an SD card, and the USB uses USB 2.0. Surveillance camera system. According to claim 1, wherein the wireless receiver receives a radio signal (RF) to decompress and perform the process of encoding the video signal to show on the monitor screen, but received from the omnidirectional surveillance camera system under the control of the CPU (314) An RF module 811 for demodulating a wireless signal into a compressed digital video signal, a video decompressor 812 for receiving and decompressing the compressed digital video signal, and a decompressed digital video image. And a video encoder (813) for encoding a signal into a video signal in a video encoder (813) and displaying the same on a monitor screen, and a flash and esdram for storing the image. Real time connection with the omnidirectional surveillance camera system or the first step of importing recorded data from the omnidirectional surveillance camera system, A second step of selecting a lens type used for a live connection or a loaded recorded image; A third step of inputting the center of the image and the region of the image input to the PC; A fourth step of selecting a screen configuration for displaying an image from an original image and an image transformed into an image familiar to various types of human vision; And performing a algorithm for correcting the distorted image based on the selected lens type, the center of the image, the region, and the screen configuration, to display or reproduce a transparent image in real time in real time. An image processing method using the omnidirectional surveillance camera system according to claim 12.

Images