KR20180022327A - Image transforming device of a 360-degree revolution in CCTV camera - Google Patents

Abstract

The present invention relates to a 360-degree image converter for a CCTV camera, and more particularly,
A 360-degree view of a CCTV camera that converts a curved surface image captured through a 360-degree lens used for inverse imaging into a flat image
And more particularly, to a planar image conversion apparatus for an image.
The apparatus for converting a plane image of a 360-degree image of a CCTV camera according to the present invention comprises a 360-degree lens,
An image sensor which is a kind of a photoelectric conversion device that detects information of an image and converts it into an electrical image signal,
An image processor for converting the image signal transmitted from the sensor into image information; Connected to the image processor
A frame buffer for temporarily storing the converted image information,
A video processor for planarizing information and recording the planarized image in connection with the video processor
And a display for displaying the flattened image in the video processor.
The apparatus for converting a plane image of a 360-degree image of a CCTV camera according to the present invention comprises a CCTV camera
Since the images are collected simultaneously in the wide area, it is possible to monitor a wide area at the same time without a square.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a CCTV camera,

The present invention relates to a planar image conversion apparatus for a 360-degree image of a CCTV camera, and more particularly,

A CCTV camera that converts a curved surface image captured through a 360-degree lens used for wide-area imaging into a flat image

And more particularly, to a planar image conversion apparatus for a 360-degree image.

Generally, surveillance cameras are installed and operated in banks, department stores, 24-hour convenience stores,

Most of these places use fixed cameras, which are in independent configuration,

It is configured to record images delivered from the camera to the monitor in real time and simultaneously record to VCR

have.

However, conventional cameras that have been used for such applications have limited viewing angles,

In turn, a wide angle lens (e.g., a 360 degree lens) is used to obtain a wider viewing angle. In addition,

In the field of the visual sensor applied to the conventional camera, an omnidirectional image obtained by the optical system and the imaging device is displayed on a panoramic image

A car that is processed using software used by a computer such that the image is converted into a human-friendly image such as an image

Omnidirectional surveillance system including camera has recently been spotlighted.

Here, the 360-degree lens described above is a lens in which the original image is distorted by a light beam that does not pass through the center of the screen

Light) is distorted and is shot in a round shape. In particular, as the distance from the center of the screen increases, the object is distorted into a round shape

Because the screen is rounded, it is inconvenient because it is not common.

As a method of correcting the distortion, there are a forward mapping method and an inverse mapping method

In the former, a correction coefficient to obtain a corrected image is obtained from the distorted image, and then the corrected coefficient is directly applied to the distorted image

The latter method assumes a previously corrected image and determines which points of the image are matched with the distorted image

How to find it.

Referring to an example of a conventional omnidirectional monitoring system 10 as shown in Fig. 1, a camera using a 360 degree lens 11

(12); An imaging section (13) for converting the optical image obtained by the camera (12) into image data; The image pickup section

And a computer 15 for converting the image data sent from the image forming apparatus 13 and displaying the image data on the monitor 14.

[0008] The operation of the conventional omni-directional surveillance system 10 will now be described. First, a circular light

The image is converted into circular image data by the image pickup section 13. [ Then, the image pickup section 13 performs image pick-

And outputs the data to the computer 15. Then, the computer 15 converts the input image data into a rectangular panorama image or a two-

And displays the image on the monitor 14 by processing the human image such as a time image with a more easily viewable image.

However, the optical device of the conventional omnidirectional monitoring system 10 as described above has a curved surface designed to capture an image 360 degrees in all directions

If you install this system in a school zone or park and watch it,

Since the image captured by the camera is distorted, it must be corrected to a flat image.

In order to convert such a curved surface image into a plane image, the geometric shape of the coordinate transformation as shown in FIG. 2 is known

I have to.

In order to convert an image on a spherical surface having a mathematical radius r into a plane, a point of a curved surface image 21 shown in Fig. 2

Dimensional coordinates (x, y, z) of the two-dimensional coordinates (a, b).

At this time, in the process of converting the curved surface image 21 captured and transmitted by the 360 degree lens into the plane image by the computer 15

The number of polynomials of the transformed plane image is reduced,

A phenomenon that appears as a still image on the screen is generated. That is, there is a problem that the movement of the image is cut off.

SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to solve the above problems by providing a computer-

The algorithm is implemented as a circuit, the circuit is attached to the camera, and the image captured by the camera is monitored

The present invention provides a 360-degree plane image conversion apparatus of a CCTV camera that allows a user to view a plane image directly from

It is enemy.

The CCTV camera's 360-degree image plane conversion apparatus according to the present invention includes a 360-degree lens,

An image sensor, which is a kind of photoelectric conversion device for detecting information of an object and converting it into an electric image signal; The

An image processor for converting the image signal transmitted from the paper sensor into image information; The image processor

A frame buffer for temporarily storing the converted image information; Wherein the image processor

A video processor for planarizing the image information; And recording the planarized image in connection with the video processor

And a display for displaying a flattened image in the video processor

do.

In addition, the video processor includes a color space converter for converting YCbCr422 to RGB,

A memory controller for controlling the frame buffer, a color converting unit for converting RGB into YCbCr422,

Space converter.

Further, the target address calculator is characterized by a planarization algorithm for converting a 360-degree projection image into a planar image using a planarization algorithm.

As described above, the plane image conversion apparatus for a 360-degree image of a CCTV camera according to the present invention is characterized in that a curved-

Since the CCTV cameras convert the wide-area images at the same time, it is possible to simultaneously monitor large areas without a square.

There is a dot.

1 is a block diagram of a conventional multi-region monitoring system.
Figure 2 is a geometric form of a conventional coordinate transform and a transformed image sample map.
3 is an overall system block diagram of a 360-degree plane image converter of a CCTV camera according to the present invention.
4 is a block diagram showing signal processing of the image sensor of Fig. 3;
Figure 5 is an internal block diagram of the video processor of Figure 3;

Hereinafter, a planar image conversion apparatus for a 360-degree image of a CCTV camera according to the present invention will be described in more detail with reference to the drawings.

. In describing the present invention, it is to be understood that the detailed description of known technologies and configurations,

In the case where it is judged that it may be unnecessarily blurred, a detailed description thereof will be omitted. In addition,

It is a term defined in consideration of the functions of the invention, and it may be defined in accordance with the intention or custom of the client, operator,

It can be different. Therefore, the definition should be based on the contents throughout this specification.

Like numbers refer to like elements throughout the drawings.

3 is an overall system block diagram of a 360-degree image plane conversion apparatus for a CCTV camera according to the present invention.

FIG. 5 is an internal block diagram of the video processor of FIG. 3. FIG. 5 is a block diagram illustrating signal processing of the image sensor of FIG.

Hereinafter, the apparatus for converting a plane image of a 360-degree image of a CCTV camera according to the present invention includes:

Is converted into a planar image by a computer, which can reduce the calculation amount of an algorithm to be processed by the computer

A new computerized flattening algorithm is used.

In order to implement such a flattening algorithm in hardware, the result of FPGA circuitization is shown in FIG. 3

And is a whole system of a 360-degree image plane conversion apparatus of a CCTV camera according to the present invention.

In order to implement such a flattening algorithm in hardware, the result of FPGA circuitization is shown in FIG. 3

And is a whole system of a 360-degree image plane conversion apparatus of a CCTV camera according to the present invention.

Referring to FIG. 3, a 360-degree plane image converter 30 of a CCTV camera according to the present invention includes a 360-degree lens 11

A type of photoelectric conversion device that detects the information of a visible object at a wide angle and converts it into an electrical image signal

An image sensor 31 for converting the image signal transmitted from the image sensor 31 into image information;

(32), a frame buffer for temporarily storing the converted image information in association with the image processor (32)

A video processor 34 for plane imaging the image information transmitted from the image processor 32,

A DVR 35 or the video processor 34 for recording a flattened image in connection with the video processor 34,

And a display 36 for displaying the flattened image.

Here, the format from the image sensor 31 is 8-bit YCbCr422 for SD (normal image quality) resolution, and HD resolution

And the bit depth of the input video signal is a 16-bit YCbCr422 for the performance of the image sensor 31

Can vary. In addition, the frame buffer 33 is generally constituted by using a DRAM,

SDRAM, DDR SDRAM, DDR2 SDRAM, DDR3 SDRAM, etc.

have.

4, which is a more detailed illustration of the image sensor 31 shown in FIG. 3, the image sensor 31 includes a 2-

2-wire serial interface registers 41, an image signal processing section 42,

A control unit 43, a column decoder 44, an ADC 45, a CDS 46, a pixel array 690x512 47, a Bias / ADC control unit 48,

(49).

The digital control signal transmitted from the timing controller 43 is transmitted to the column decoder 44 and the decoder 49,

The analog control signal is transmitted to the Bias / ADC control unit 48.

In addition, the pixel array of the image sensor 31 is 690x512, and the output signal of the image sensor 32 is an NTSC or PAL signal

, The maximum frame rate is 30 fps, and the format of the output signal can be selected from among CCIR656, 8-bit YCbCr422, 8-bit RGB565, 9-bit RGB Bayer and 9-bit Mono. Further, the operation of this image sensor 31 is not limited to the known one

The detailed description thereof will be omitted.

The image signal transmitted from the image sensor 31 is converted into image information through the image processor 32,

The image information is imaged in a plane by the video processor 34,

5, the video processor 34 includes a color space converter 34 for converting YCbCr 422 to RGB,

A target address calculator 52 for calculating coordinates of a target, a memory controller 51 for controlling the frame buffer 33,

And a color space converter 51-2 for converting RGB to YCbCr422.

Here, the camera 12 receives the video signal of the CIR 656 or the 8-bit YCbCr 422,

One luminance signal Y per pixel and one color signal per two pixels. In order to perform a flat image,

The color space converter 51-1 converts the CIR 656 or the 8-bit YCbCr422 video signal into one pixel

Into a color signal of an RGB format having independent pixel information.

In addition, the target address calculator 52 converts the 360-degree image into a flat image by the above-described planarization algorithm

Calculating a coordinate required for the transformation, and using the coordinate data calculated by the planarization algorithm,

The read address of the frame buffer 33 necessary for reading 360 degrees of the image input from the camera 12 stored in the buffer 33

Address.

Further, the signal data on 360 degrees input from the camera 12 passes through the color space converter 51-1,

And stored in the frame buffer memory. The memory controller 53 converts the input image data into frame data

In the frame buffer 33; The target address calculator 52 calculates the target address

And writes the resultant value into the frame buffer 33; The result of the planarization algorithm stored in the frame buffer 33

Of the input image data stored in the frame buffer 33 on a frame-by-frame basis,

Determines the address, and reads the image data of the corresponding address.

Further, since the input video signal format of the normal video decoder IC is YCbCr422 or CCIR656 format,

The video signal can not be normally encoded, resulting in an abnormal video signal

So that the color space converter 51-2 performs color space conversion by the planarization algorithm,

And converts the RGB pixel data output from the YCbCr 422 pixel data into YCbCr422 pixel data.

The analog video signal output from the video processor 34 is supplied to a DVR or a video display (TV,

Monitor, etc.).

The apparatus for converting a plane image of a 360-degree image of a CCTV camera according to the present invention comprises a CCTV camera

Since the images are collected simultaneously in the RARO wide area, large areas can be monitored simultaneously without a square.

Although in the embodiment of the present invention, CIR656 or 8-bit YCbCr422 is used as a video signal input from a camera,

In addition, 8-bit RGB565, 9-bit RGB Bayer, and 9-bit Mono can be used.

Further, in the embodiment of the present invention, one or two frame buffers are used, but the number of such frame buffers is limited

Of course not.

Although the present invention has been described based on the preferred embodiments, it is to be understood that the present invention is not limited thereto

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit of the present invention.

Various changes, modifications or adjustments to the embodiments will be possible. Therefore, the protection scope of the present invention is not limited to the

It is to be understood that the invention is intended to cover all modifications, alterations, or embodiments, which fall within the scope of technical thought.

10: Conventional omnidirectional monitoring system (10) 11: 360 degree lens
12: camera 13:
14: Monitor 15: Computer
30: 360 degree image of CCTV camera
31: image sensor 32: image processor
33: frame buffer 34: video processor
35: DVR 36: Display
41: 2-wire serial interface register
42: image signal processing unit 43: timing control unit
44: column decoder 45: ADC
46: CDS 47: pixel array
48: Bias / ADC control unit 49:
51-1, 51-2: Color space converter
52: target address calculation section 52 53: memory controller

Claims (3)

A 360 degree lens is used to detect the information of a subject that can be seen at a wide angle and to convert it into an electrical image signal.
Image sensor, which is a type of circulation device
An image processor for converting the image signal transmitted from the image sensor into image information;
A frame buffer connected to the image processor for temporarily storing the converted image information;
A video processor for planarizing the image information transmitted from the image processor,
A DVR for recording a flattened image in connection with the video processor,
And a display unit for displaying an image of the 360-degree image of the CCTV camera. The video processor of claim 1, wherein the video processor comprises: a color space converter for converting YCbCr422 to RGB;
A memory controller for controlling the frame buffer, and a controller for converting RGB into YCbCr422
And a color space converter for converting a 360-degree image of the CCTV camera into a color space converter. 4. The apparatus of claim 3, wherein the target address calculator uses a planarization algorithm to convert a 360-degree projection image into a planar image
Lt; RTI ID = 0.0 > 360 < / RTI > image of a CCTV camera featuring a planarization algorithm
Phase converter.

Images