KR101436231B1 - An omnidirectional recording system without black image in display screen and the recording method. - Google Patents

Abstract

The present invention relates to a omnidirectional imaging apparatus, and more particularly, to a omnidirectional camera capable of omni-directional imaging and a plurality of unidirectional cameras in addition to the same, Thereby making it possible to utilize the entire area of the final display screen, thereby eliminating waste space on the screen of the final display unit.
In particular, it is possible to position the omnidirectional camera at the center of the omnidirectional imaging device and freely position a plurality of unidirectional cameras at a certain distance from the omnidirectional camera. The unidirectional cameras can be connected to the signal processing module by a signal transmission cable, As shown in Fig.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an omnidirectional recording system and a recording method therefor. }

The present invention relates to a omnidirectional imaging apparatus, and more particularly, to a omnidirectional camera capable of omni-directional imaging and a plurality of unidirectional cameras in addition to the same, Thereby making it possible to utilize the entire area of the final display screen, thereby eliminating waste space on the screen of the final display unit.

The image sensor is an image sensing device typified by a CCD (Charge Coupled Device). In the case of a CCD (Charge Coupled Device), a coin-sized chip has more than 100,000 detection elements. Lt; RTI ID = 0.0 > of < / RTI > These packets are output at a high speed by the charge transfer mechanism, converted and displayed as an image. Elements in a CCD (Charge Coupled Device) are used as a detection array and divided into regions for accumulation and output.

In recent years, techniques have been actively developed to photograph 360 degrees of each direction by using such image sensors and spherical lenses. CCTVs for crime prevention such as outside alleys and vehicles for recording accident or crime The demand for surveillance cameras such as boxes has increased sharply.

Generally, a surveillance camera is installed in one direction to capture images within a limited angle. However, since only the image within a limited angle is photographed as described above, a blind spot is generated and it is impossible to monitor the crime that occurs in the blind spot.

Therefore, an omnidirectional photographing apparatus capable of photographing mainly 360 degrees is widely applied to a surveillance camera. Conventionally, an image in all directions is obtained by a plurality of photographing apparatuses or by rotating the photographing apparatus. However, the omnidirectional imaging apparatus as described above has a disadvantage that it is difficult to apply to a black box or the like of a vehicle which requires a small size because the module itself has a large size.

In recent years, it has been equipped with a spherical lens,

A photographing device capable of obtaining an omnidirectional image has been developed. Here, the forward direction refers to the 360 degree direction.

However, as can be seen from FIG. 1, the 360-degree photographed image that is input using the current spherical lens is limited to a ratio of 1: 1. An image photographed with the spherical lens is sensed by the image sensor and stored as information, which is displayed on the display unit. Most of the screens that are currently used have a ratio of 16: 9. There is a problem that the ratio is not matched with the image photographed through the spherical lens.

Accordingly, as shown in FIG. 2, when the spherical lens is adjusted and converted into a size corresponding to the short axis of the image sensor, the image taken through the spherical lens has a ratio of 9: 9, The black screen is displayed because the screen area can not store any information, and this is a waste area which can not display the screen in the actual display area.

Korean Patent Laid-Open Publication No. 2001-0072917 provides an omniazimensional imaging apparatus capable of reducing the amount of information transferred when an omni-directional image is cut and reproduced from an omni-directional image, when the omni-directional image is stored in another apparatus. Only the position information from the omnidirectional image position storage means is displayed on the imaging position display means of the terminal device via the bidirectional communication means and the necessary viewpoint position is specified by the viewpoint position designation means, The present invention also relates to a system for extracting a necessary image from omnidirectional image position storage means in accordance with a pointed position of the pointed position and sending the extracted image to a terminal device via bidirectional communication means, There is a problem that a screen with a ratio of 7: 9 is displayed in black on a video display screen.

The omnidirectional photographing apparatus of the present invention is devised to solve the problems of the conventional art described above, and a first object of the present invention is to eliminate a closed area that can not display an image on a final display screen.

A second object of the present invention is to provide an image display apparatus and a method for displaying a plurality of images photographed by a unidirectional camera in an omnidirectional image having a ratio of 9: 9 and an area of the remaining 7: 9, In order to display them on one screen.

In addition, the third object of the present invention is to position the unidirectional photographing camera at a desired position in an integrated or separated manner in addition to the image of the omnidirectional photographing camera, so that the manager can easily photograph the desired image and provide the image to the manager.

In order to achieve the above object, the present invention includes the following configuration.

That is, the omnidirectional photographing apparatus which removes the closed space in the image display unit according to the embodiment of the present invention includes a 360 ° spherical lens capable of omnidirectional photographing, a omnidirectional photographing camera capable of omnidirectional photographing including a CMOS image sensor, Way camera capable of photographing in one direction, a one-directional camera in a closed circuit, and a CMOS image sensor capable of one-way photographing in a desired position, and a directional camera capable of photographing in the forward direction, a unidirectional camera in the plurality of closed circuits, The video signal from the plurality of unidirectional cameras capable of being obtained is aligned and synchronized in the signal processing module so as to be formed into a single screen, and a plurality of video signals output from the signal processing module are combined into one final screen And a display unit for displaying the image, So that the entire screen area of 16: 9 can be used.

The omnidirectional photographing apparatus which removes the closed space in the image display unit of the present invention eliminates the closed area where the image can not be displayed on the final display screen, thereby providing a first effect that enables more efficient management of the manager.

In addition, the present invention can display and manage an image photographed at various positions on one screen by dividing and displaying a panoramic radiographing image and a unidirectional radiographing image on one screen, thereby achieving a second effect .

In addition, the present invention allows a plurality of unidirectional cameras to be located at desired positions in addition to a panoramic camera fixed at a predetermined position, thereby enabling not only a panoramic image but also a third effect that a manager can freely view a desired image through a one- .

1 is a view showing the principle of photography of a conventional omnidirectional photographing camera.
2 is a view showing a display screen of a conventional omnidirectional camera.
3 is a view showing a screen including a panoramic image of the present invention and a plurality of unidirectional images.
4 is a view showing an omnidirectional photographing apparatus in which a omnidirectional photographing camera and a unidirectional photographing camera are integrally formed according to an embodiment of the present invention.
FIG. 5 is a view showing an omnidirectional photographing apparatus constructed by separating a omnidirectional photographing camera and a unidirectional photographing camera according to another embodiment of the present invention, compared with an integrated model.
6 is a diagram showing an example of the signal processing module of the present invention.
7 is a diagram showing an original image acquired by the present invention.
FIG. 8 is an embodiment showing a result image obtained by image processing according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a view showing the principle of photography of a conventional omnidirectional camera, wherein the ratio of the width to the length of a 360-degree photographed image input using a spherical lens is limited to 1: 1. An image photographed by the spherical lens is sensed by the image sensor unit and is stored as information, which is displayed as a screen on a display unit. The portion corresponding to the reflection unit is represented by a black region, which is a black region of the panoramic image itself. Also, in the final display screen, a screen displaying a currently used image has a ratio of the aspect ratio of 16: 9, and the ratio of the image to the image photographed through the spherical lens is incompatible.

Therefore, as shown in FIG. 2, when the spherical lens is adjusted and converted into a size that matches the short axis of the image sensor, the screen displaying the image has a ratio of L: H (16: 9) The image 100 captured through the lens has a ratio of 9: 9, so that the screen area 220 of the aspect ratio of 7: 9 can not store any information, It is a waste area which can not display a screen in the actual display part, and thus it is not utilized. A portion corresponding to the reflection portion in the panoramic image is represented by black regions 200 and 210.

On the contrary, when viewing the image screen obtained by the temporal example of the present invention, an area A displaying the omnidirectional image exists in a ratio of 9: 9, A plurality of unidirectionally captured images are divided and displayed. This eliminates the closed area 220 that can not display the screen shown in FIG. 2, and displays multiple image images on one final screen, thereby enabling more efficient management.

4 is a view illustrating an omnidirectional photographing apparatus having a combination omnidirectional photographing camera and a unidirectional photographing camera according to an embodiment of the present invention. (a) is a perspective view of the omnidirectional photographing apparatus 300, and the unidirectional photographing cameras 301 and 302 are disposed on both sides of the omnidirectional photographing apparatus 300, It is possible. (b) is a view from the front side of the unidirectional photographing camera, and (c) is a top view of the omnidirectional photographing apparatus of the present invention.

In FIG. 4, two unidirectional photographing cameras are disposed on both sides, but this is only an example. It goes without saying that the number and arrangement of unidirectional photographing cameras can be selected according to the intention of the user.

5 is a view showing a comparison between a omnidirectional photographing camera and a omnidirectional photographing camera constructed by separating a omnidirectional photographing camera according to an embodiment of the present invention. (b) is a detachment type omnidirectional photographing device in which unidirectional photographing cameras 301, 302, and 303 are freely arranged around the omnidirectional photographing camera.

In FIG. 5, only three unidirectional photographing cameras are arranged, but this is only an example, and it goes without saying that the number and position of the unidirectional photographing cameras can be selected according to the user's intention.

The omnidirectional photographing apparatus includes a 360 ° spherical lens capable of omni-directional photographing and a CMOS image sensor. The omnidirectional camera 300 is capable of omnidirectional photographing. The omnidirectional camera 300 includes a plurality of A plurality of unidirectional cameras (301, 302, 303) including a one-way camera (301, 302, 303) for a closed circuit or a CMOS image sensor capable of unidirectional photographing, a bidirectional camera A signal processing module 400 for aligning signals of a plurality of unidirectional cameras as much as possible and synchronizing the signals to form a single screen, and a plurality of video signals output from the signal processing module 400, And a display unit for displaying the image on a screen.

In particular, it is possible to position the omnidirectional camera 300 at the center of the omnidirectional photographing apparatus and position the plurality of unidirectional cameras 301, 302, and 303 freely at a distance from the omnidirectional camera, And may be connected to the signal processing module 400 or fixedly attached by a mechanism.

In addition, the process of driving the omnidirectional photographing apparatus and displaying a screen may include the steps of positioning an omnidirectional camera 300 capable of omni-directional photographing including a 360 ° spherical lens and a CMOS image sensor capable of omni-directional photographing at a place to be imaged, The method comprising the steps of: positioning a plurality of unidirectional cameras (301, 302, 303) capable of photographing, operating the omnidirectional camera and the plurality of unidirectional cameras to obtain a plurality of digital video signals and a plurality of analog video signals photographed therefrom, A method of processing a video signal and a plurality of analog video signals in a signal processing module (400) to synchronize them temporally and reconstructing an image according to an aspect ratio, the method comprising: And displaying it on the final screen .

FIG. 6 is a block diagram of a signal processing module according to an embodiment of the present invention. The signal processing module 403 includes a plurality of signal converters 403 for converting an analog signal received from the plurality of unidirectional cameras 402 for a closed circuit into digital signals, A serializer 404 for sequentially converting the signals received from the omnidirectional and unidirectional cameras including the CMOS image sensor into serial signals in time and a serializer 404 for converting the digital signals converted by the signal converter 403 and the CMOS image sensor A micro-controller 405 for synchronizing the signals received from the omnidirectional and unidirectional cameras in time, a field-programmable gate array (FPGA) 406 for distributing the synchronized video signals to one screen, array, 406).

The operation of the signal processing module may include converting the plurality of analog video signals from the signal converter 403 to digital video signals, ordering the digital video signals from the omnidirectional camera with a serializer 404 Synchronizing the converted digital video signals with a micro-controller 405, synchronizing the plurality of synchronized video signals with a field-programmable gate array (FPGA) 406, So as to be displayed on the screen.

7 shows an original image obtained by the above method. The original image has a contour image opposite to that of the actual image, and the image of the wide-angle lens, which is rotationally symmetric about the optical axis, has mathematically accurate values. These mathematical values are designed from the lens design stage to form the output of the lens, and these values are very important for image processing to obtain accurate images. In addition, software image processing is possible by arranging sensor pixels of the correct size to correspond. FIG. 8 is a view showing an image obtained by the image processing. In order to obtain a rectangular image as shown in FIG. 8, the signal processing module of the present invention may include an image processor for converting the distorted image projected on the CMOS pixel into a rectangular image. The image processing unit may be implemented in software as described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it should be understood that various changes and modifications will be apparent to those skilled in the art. Obviously, the invention is not limited to the embodiments described above. Accordingly, the scope of protection of the present invention should be construed according to the following claims, and all technical ideas which fall within the scope of equivalence by alteration, substitution, substitution, Range. In addition, it should be clarified that some of the constituent elements of the drawings are intended to explain the constitution of the invention more clearly and are provided in an exaggerated or reduced form than the actual one.

L: Horizontal of screen H: Vertical of screen
L1: Landscape of the panoramic image
L2: Landscape of the lung screen where no image is displayed
100: omnidirectional shooting screen area
200: Black image by reflection part of 360 ° spherical lens
210: Black screen area other than the omnidirectional shooting screen
220: Lung screen area where no image is displayed
300: 360 ° omnidirectional camera
301, 302, 303: One-way camera
A: omnidirectional image display area
B: One-way shooting image display area
400: signal processing module
401: Digital CMOS Image Sensor
402: Analog camera
403: Decoder
404: Serializer
405: Microcontroller
406: Field-programmable gate array (FPGA)
407: Camera interface
408: IP camera module

Claims (9)

1. An omnidirectional photographing apparatus having no screen space on its screen,
Omni-directional omnidirectional camera including a 360 ° spherical lens capable of omnidirectional imaging and a CMOS image sensor;
A plurality of unidirectional cameras for a closed circuit capable of one-directional imaging;
A plurality of unidirectional cameras including a CMOS image sensor capable of one-directional shooting;
A signal processing module for aligning signals of the omnidirectional camera capable of taking an omnidirectional image, the unidirectional camera for the plurality of closed circuits, and the plurality of unidirectional cameras capable of one-directional imaging, ;
A display unit for displaying a plurality of video signals output from the signal processing module as one final screen;
/ RTI >
The CMOS image sensor of the omnidirectional camera has a CMOS pixel of an exact size matching the mathematical shape of the lens given from the design stage of the 360 ° spherical lens,
The signal processing module comprises:
A plurality of signal converters converting an analog signal received from the unidirectional camera for the plurality of closed circuits into a digital signal;
A serializer for sequentially converting signals received from the omnidirectional and unidirectional cameras including the CMOS image sensor into signals in time and converting the signals into serial signals;
A micro-controller for temporally synchronizing the digital signal converted by the signal conversion unit and the signals received from the omnidirectional and unidirectional cameras including the CMOS image sensor;
A field-programmable gate array (FPGA) functioning to distribute and display the plurality of synchronized video signals on one screen;
An image processor for converting the distorted image projected on the CMOS pixel into a rectangular image;
Lt; / RTI >
A display unit for displaying a plurality of video signals output from the signal processing module as one final screen has a width to height ratio of 16: 9, and the final screen displayed by the display unit is divided into a main screen and a sub screen And,
Wherein the main screen is an image of a 360 ° omnidirectional camera and the sub screen is divided into images of a plurality of unidirectional cameras.
delete delete delete The method according to claim 1,
Wherein the omnidirectional camera is positioned at the center of the omnidirectional photographing device and the plurality of unidirectional cameras are integrally attached to the periphery of the omnidirectional camera and fixed.
The method according to claim 1,
The directional camera may be located at the center of the omnidirectional imaging device and the plurality of unidirectional cameras may be freely positioned at a distance from the omnidirectional camera. The unidirectional cameras may be connected to the signal processing module Wherein the image pickup device is an image pickup device.
A method of displaying a screen including a panoramic image,
(i) positioning an omnidirectional camera capable of omnidirectional imaging including a 360 ° spherical lens and a CMOS image sensor capable of omni-directional imaging at a location to be imaged;
(ii) positioning a plurality of unidirectional cameras capable of one-directional imaging;
(iii) operating the omnidirectional camera and the plurality of unidirectional cameras to obtain a plurality of digital video signals and a plurality of analog video signals photographed therefrom;
(iv) processing the plurality of digital video signals and the plurality of analog video signals in a signal processing module to synchronize them in time, and reconstructing an image according to an aspect ratio;
(v) displaying the reconstructed image on the display unit as one final screen configured to have no closed space in the screen;
Lt; / RTI >
The omnidirectional camera in the step (i) is an omnidirectional camera in which CMOS pixels of an exact size matching the mathematical shape of the lens provided from the designing stage of the 360 ° spherical lens are arranged,
The step (iv)
Converting the plurality of analog video signals into digital video signals in a signal converting unit;
An image processing step of converting a digital image signal of a distorted image projected on a CMOS pixel of the omnidirectional camera into a rectangular image;
Ordering digital image signals obtained from the omnidirectional camera with time using a serializer and converting them into serial;
Synchronizing the converted digital video signals with a micro-controller in time;
Distributing the plurality of synchronized video signals so as to be displayed on one screen in a field-programmable gate array (FPGA);
And displaying the panorama image on the screen.
delete delete

Images