KR100923233B1 - The omnidirectional superpanorama monitor advanced visual angles - Google Patents

Abstract

PURPOSE: An omnidirectional superpanorama monitor advanced visual angles is provided to reduce distortion of image by decreasing and increasing visual angles. CONSTITUTION: The omnidirectional superpanorama monitor advanced visual angles includes the monitoring camera, the image processor, the digital recording storage unit, and the monitor. The monitoring camera takes an image. The image processor deletes the image which is over the reference line and reduces the image. The image processor makes the panoramic image by deleting the image which is over the left and right and by editing the image photographed in the left and right monitoring camera.

Description

The omnidirectional superpanorama monitor advanced visual angles}

The present invention relates to a surveillance camera used for the purpose of CCTV, a rain zone using a web camera, forest fire monitoring, disaster monitoring, etc. Recently, the importance of security increases and the need to remotely control the violation of regulations, various surveillance systems It is emerging, and the general trend is to monitor the surrounding environment in real time by installing surveillance cameras not only in the main buildings, apartments, but also homes and roads.

The surveillance camera according to the prior art is connected with a divider and a monitor.

The plurality of surveillance cameras are supplied with power through a power supply controller, and convert the light signal into an electrical signal through a CCD (charge coupled device) installed inside the surveillance camera and output it to the splitter.

The conventional divider divides the number of images inputted from the surveillance camera by the number and the ratios, and the images captured by the plurality of cameras are divided into four in the four-split, nine in the nine-split and 16 in the six-split. Allows the image to be displayed on one monitor.

On the other hand, in the case of the surveillance camera installation configuration using a DVR according to the prior art, DVR (Digital Videl Recorder, digital recording storage device) is a device that converts and stores the video signal to a digital signal, unlike the conventional VCR, through this In recent years, there is a growing trend in that images can be edited and transmitted, and the functions of the 4, 9 and 16 splitters described above are convenient.

However, surveillance cameras photograph areas that are not adjacent to each other, and images of each zone are simply displayed on one monitor. In general, surveillance cameras have a view angle limited to approximately 60 ° to 90 °. In the case of monitoring a specific area, there was a problem in that blind spots could not be generated to closely monitor a specific area.

In addition, the conventional display through the divider has a problem in that the panorama image display function of combining two or more images is not provided only by displaying a separate image on a single monitor.

According to another conventional example, at least two surveillance cameras are installed adjacent to monitor a specific area widely, and the signals input from each surveillance camera are image-processed by an image processor and displayed on a monitor.

A general surveillance camera has a preset angle of view according to a lens and a CCD specification. In a conventional surveillance camera, when an adjacent surveillance camera is installed, an area where an image incident line overlaps each other exists, and the image processor presets an overlapping region with an image processing algorithm. According to the calculation process, two images are displayed on the monitor as one screen.

The image captured by each of the surveillance cameras causes distortion of the image as it goes to the periphery of the two images.

Therefore, the conventional image processor uses an image processing algorithm to remove one of the overlapped areas b of FIG. 1 and to eliminate distortion of the remaining overlapped areas b.

The conventional image processor has a function of artificially changing an irregular image while having a CPU, and an image processing algorithm used in the image processor is independently according to two adjacent surveillance camera environments, that is, each surveillance camera. Is set.

In order to solve the above problems, Patent No. 10-2005-0017413 'Surveillance camera device using the image combiner' to minimize the distortion of the lens to provide an image combiner that can provide a panoramic image without expensive image processing algorithm and image processor The proposed surveillance camera device is provided, and a surveillance camera device using an image combiner that does not need to set a separate algorithm even when the surveillance camera is out of the initial position is provided.

Applicant No. 10-2002-0004726 Looking at the original text of the 'panorama photographing monitoring method and photographing monitoring device', in the case of claim 1 "In the photographing method for photographing a panoramic image, a plurality of lenses to shoot a limited area of a certain angle. Arranged in a circular shape, the angle of image incidence of each lens divided by 360 ° divided by the number of lenses, and a barrel made of a polyhedron corresponding to the number of lenses so that the shooting boundary of each lens is parallel to the shooting boundary of a neighboring lens. Installing a lens, acquiring images captured by each lens on a CCD image sensor, transmitting an image captured on the CCD image sensor to an image processing apparatus, and transmitting each image Capturing a panorama and arranging the images horizontally on a monitor to express a panoramic image. Specifications law. "

According to claim 4, "A photographing apparatus for photographing a panoramic image, comprising: a plurality of lenses having an image incidence angle equally divided by 360 ° and arranged so that the photographing boundary of each lens is parallel to the photographing boundary of a neighboring lens; The lens is formed of a polyhedron corresponding to the number of lenses so that the plurality of lenses are fixed to each surface, and a lens insertion hole is formed on each surface, and the CCD IMAGE SENSOR is inserted to position the CCD IMAGE SENSOR inside the lens. And a barrel having a fastening groove to be inserted therein, and an image processing apparatus installed at a lower portion of the barrel to horizontally arrange each image captured by a plurality of CCD image sensors and processing the image as a panoramic image. Device ".

Patent No. 10-2005-0017413 claims of the 'surveillance camera device using an image combiner' refers to the "surveillance camera device for the front surveillance of 85 to 285 °, the lens and the light signal having an optical distortion of less than 15% Two or more surveillance cameras comprising a CCD sensor for converting the signal and the two or more surveillance cameras are mounted, and includes a bracket that rotates up and down, the image combiner rearranges the group of images captured by the two or more surveillance cameras In the surveillance camera device, characterized in that to display a panoramic image, the power of the front group is -0.024, the rear group is +0.183 and has an optical distortion of less than -10%, the two or more surveillance cameras are adjacent to each other Surveillance camera device, characterized in that disposed on the bracket so that the image incident line of the surveillance camera is parallel. .

Looking at the original claim of the application No. 10-2001-0015360 'Panorama photographing sector lens and its arrangement method' Claim 1 is the outermost due to the phenomenon that when the spherical body is deployed in a plane gradually narrowed by a certain ratio with respect to the center line A lens in which a portion of the lens is cut out, and the center of the plurality of concave convex lenses is aligned in a straight line and the image is taken by a photographing element (CCD), wherein the objective is based on an image incident line passing through the outermost objective lens. The lens is formed in a vertically, right, left, and right cut configuration, wherein the optical path of the image incident line that passes through the optical path to form a visible range coincides with the range of the sensing face plate of the CCD sensor, and the extension line of the image incident line includes all parts of the CCD sensor. Consisting of three sector lenses III;

Coupling means consisting of a plurality of first and second boundary surfaces for fixing and protecting the plurality of lenses and blocking the incoming external light, and a plurality of coupling grooves and protrusion pieces or magnetic connecting bodies formed on the boundary surface so that the coupling can be continuously coupled. Sector lens for panoramic shooting, characterized in that the configuration is included

The method of claim 3, further comprising: "Step 1 of combining sector lens II such that the entrance diameter is formed behind the objective lens, step 2 of dividing 360 degrees into various angles by vertical and horizontal incidence angles caused by the entrance diameter of the sector lens II, A third step of continuously arranging the sector lens II horizontally by a corresponding number on a plane at various angles divided after the second step, and after the step 3, the horizontally arranged (basic sequence) to further view the lower part or the upper part "4. A method of arranging a sector lens for panoramic shooting, characterized in that there are four steps of attaching the sector lens III as many as the number of the sector lenses II at the bottom (lower row) or the upper part (upper row)."

The method of claim 4, wherein the first step of dividing the sector lens III made in accordance with claim 1 into a horizontal incidence angle at various angles, and after the first step, the sector lenses III are continuously arranged horizontally by the corresponding number for each of the divided angles. Step 2 of fixing, attaching the number of sector lenses III to the lower part or the upper part of the sector lens III arranged by the second step again to further view the lower part or the upper part after the second step. "A method of arranging a sector lens for panoramic photography, characterized by three steps".

Application No. 10-2004-0091945 Looking at the technical problem that the invention of the '360 ° panoramic camera device' is to achieve, "It can mechanically drive the lens to expand the visible range on the vertical plane, and adjust the projection angle of the lens up and down It is to provide a 360 ° panoramic camera device for maximizing the efficiency of surveillance by minimizing the blind spot of the lower part of the camera device. " Looking at the original text of claim 1, "In order to take a 360-degree 360-degree image panoramic view and unfold it on a monitor screen, it has an image incidence angle of 90 ° and two pairs are installed symmetrically with each other, each independently Four sets of lenses, each of which is fixed to the horizontal plane and the four CPU board to process the transferred image by shooting the image with four lenses installed to be tilted up and down with respect to the vertical plane, and the four CPU In a panoramic camera device comprising an image input device consisting of a four-divided board that integrates and outputs the image divided into a board and an image processing device for recognizing the input image and processing the signal as a signal, the bottom and top surfaces are right angled isosceles triangles, respectively. And both sides connecting the isosceles are installed toward the outside, and the inclined surfaces connecting the hypotenuses face toward the inside. Camera device for 360 ° panoramic shooting characterized by the mounting cover of each columnar shape.

Application number 10-2005-0075578 Referring to the summary of the configuration and operation of the invention of the 'pan tilt camera device having an auxiliary camera' in part, "the image combination circuit unit displays only the image of the main camera module on the monitor, or front auxiliary camera Only an image of the module and the rear auxiliary camera module may be displayed, respectively.The image combination circuit unit may display an image of the main camera module and an image of the front auxiliary camera module or the rear auxiliary camera module on a single screen in a picture in picture (PIP) manner. In addition, the main camera module image and the front and rear auxiliary camera module images may be displayed in a PIP manner, on the other hand, the image combination circuit unit may display an image of each camera by a selector method, for example, a main camera module. Beams formed on the front and back while displaying images It can be displayed by switching to the image of the original camera module or by switching to the image of the auxiliary camera module formed on the front side. "

Application No. 10-2003-0079667 The claim of "360 ° panoramic camera device and its operation method" refers to the "4 cameras and four lenses with a horizontal angle of 90 ° on the monitor screen in a panoramic camera device using a CCD sensor Photographing each image transmitted through the four CCD sensors and the CPU board; inputting the four photographed images to the four-split board; four-split four images by the four-split board Combining and outputting the combined image into one image; transmitting the outputted one image to the monitor by wire and wireless; and displaying a total 360 ° image by 180 ° on each of the two upper and lower layers, respectively. Each of the four lenses is grouped into two adjacent lens units so that the image taken by each group is a continuous 180 ° image on the screen of the monitor unit. A phase of the respective parts of the monitor, of the 360 ° panorama photographing camera apparatus characterized by including the step of displaying each of the two-layer method of operation ".

Prior art literature

[Document 1] Application number 10-2005-0017413 Surveillance camera device using an image combiner

[Document 2] Application No. 10-2002-0004726 'Panorama recording monitoring method and recording monitoring device

[Document 3] Application No. 10-2001-0015360 'Sector lens for panorama shooting and its arrangement method'

[Document 4] Application No. 10-2004-0091945 '360 ° panoramic camera device'

[Document 5] Application No. 10-2005-0075578 'Pan tilt camera device having a secondary camera'

[Document 6] Application No. 10-2003-0079667 'Camera device for 360 ° panoramic shooting and its operation method'

1. In the center (center) screen, the video recorded 360 degrees with the four surveillance cameras has a short vertical viewing distance, and the screens of the far left and right are wide viewing distances up and down, but the subject (the person moving to an example) moves to the center. As the object became larger as it moved, the screen distortion phenomenon became shorter.

2. To further view the bottom part or the upper part by further stacking the sector lens, such as' No. 10-2001-0015360 'Panorama Shot Sector Lens and the Arrangement Method thereof,' 10-2005-0017413 Two or more surveillance cameras including a lens having an optical distortion of 15% or less, such as a surveillance camera device using an image combiner, and a CCD sensor for converting light signals into electrical signals. To the upper and lower parts, including the bracket that rotates up and down, to view the bottom or upper part wider, or to apply a vertical plane (bottom or top) such as' No. 10-2004-0091945 '360 ° panoramic camera device' Part of the lens by mechanically driving the lens to enlarge the field of view (the area of view on the vertical plane for a wider view of the bottom or top). There was a method of expanding the viewing range on the vertical plane by stacking vertically like the 360 ° panoramic camera device to maximize the efficiency of surveillance by minimizing the blind spot under the camera device by adjusting the projection angle up and down.

However, the present invention has the following differences.

1. The center (center) uses a method to reduce the image after stacking the cameras up and down to expand the viewing range on the vertical plane. In addition, the distortion of the screen becomes more severe from the center to the far left and right.

2. When the panoramic image is output to the monitor, severe distortion occurs in the speed and shape of the object moving from the periphery to the center due to the optical path difference. In the case of a general panorama picture, there is no distortion when a plurality of pictures are taken while connecting little by little, but when a wide area of 180 degrees is taken by two cameras from the center, distortion due to the optical path occurs, but in the present invention, the center (center) is The upper and lower viewing range is widened to the center, and the far left and right are images that minimize the optical path difference, and the upper and lower visible range is wide.

1. The present invention does not require expensive lens manufacturing cost according to the lens with low distortion according to the precise lens design with optical distortion of -0.024, rear power of +0.183 and -10% or less. Utilizes lenses that have a common distortion.

2. Roll up and down additional sector lenses to see the bottom or top part more, and rotate it up and down to make the bottom or top part wider, including a bracket that rotates up and down to see the bottom or top part wider. In order to enlarge the viewing range on the vertical plane (bottom or upper part) (the vertical viewing range on the vertical plane to see the lower part or upper part), the lens is mechanically driven to adjust the projection angle of the lens up and down. Unlike extending the visible range on the vertical plane, it is not a method of stacking the lens group (two or three lens groups for photographing a panoramic image monitoring 180 degrees) up and down. The panorama image made by combining the left and right images with the optical path difference reduced after shooting with the vertical stacking type is centered on the center (center). And where distant visibility is wide shooting range, and the right and left were also has a wide upper and lower visible range to minimize the optical path difference image, to minimize difference in optical path is significantly reduced, the screen distortion.

That is, the fundamental purpose of the invention differs from widening the upper and lower visible ranges as in the prior art by minimizing the screen distortion, which increases as the speed and size of the object moving from the left and right peripheral parts to the center approaches the center.

The present invention uses a precise lens having an optical distortion of less than -10% of the expensive to shoot and display the shooting angle in parallel, or to stack the camera (lens group) twice as uniformly to extend the visible range on the vertical plane In addition, the upper and lower viewing range is centered on the center (center), and then zoomed out to match the ratio of the left and right screens, and the far left and right areas also obtain an image that minimizes the optical path difference. By minimizing the optical path difference, the picture distortion is greatly reduced.

That is, as shown in (A) of FIG. 2, since the 60-degree image of the center is vertically stacked and photographed, the upper and lower visible range of the center becomes wider, and the object becomes larger while the object approaching from the peripheral edge comes to the center. Screen distortion, which is faster and reduces the upper and lower visible range, is reduced by expanding the visible range in the center and then reducing it.

When explaining the general description and the basic background of the present invention, the angle of view (image angle) of the surveillance camera is different from the basic angle of view according to the size of the lens, the maximum angle of view and the minimum angle of view depends on the focal length (normal) If the standard is an angle of view of 60 degrees, an image angle of up to 120 degrees may be obtained depending on the focal length.

The image of a camera having a wide angle of view (image angle) of about 90 degrees has a relatively larger distortion toward the periphery than an image having a small angle of view of 60 degrees.

Conventionally, there are screen capture as a program for correcting a picture in a personal computer, and there are a number of known freeware softwares. Currently, representative screen captures include an eye camera, a capture, a print screen, an easy capture, a screen block grabber, and a capture screen.

The image processor of the present invention is a well-known image processor used for a surveillance camera for making a general panoramic image. The image processor corrects overlapping portions of the image by software, so that the screen can be reduced or enlarged.

In one embodiment, it consists of a surveillance camera, an image processor, a digital recording storage device, a monitor.

Surveillance cameras are attached to the left and right centered around the surveillance cameras stacked up and down with two of the four surveillance cameras in four centers, and photograph 180 degrees forward as shown in FIG.

When the image processor becomes the same size as the image on the left and right after deleting the image left and right over the base line from the overlapping portion of the center stacked upper and lower images as shown in FIG. 2 to (c) to reduce the overlapping portion of the upper and lower stacked images in the center of the baseline to remove the image that comes from the top and bottom to leave this image which is the remaining image, As shown below, when the image taken with the angle of view of A is captured by the surveillance camera next to B, it is a reference line that deletes the area of C, and the two cameras are shot and pasted in parallel without overlapping. Since the angle of view taken by a camera with a 90 degree angle of view and the angle of view taken by E with a camera with an angle of view of 60 degrees, two cameras are overlapped. The angle of view is as high as H and at this time, the F and G angles of view are deleted based on the reference line.

In the same principle, the image processor creates a panoramic image of the left and right surveillance cameras, which are captured at the center, followed by the reduced images, and then deleted from the left and right centers of the overlapping baseline. It is an omnidirectional super panoramic monitoring device with improved visibility.

In an embodiment, the surveillance cameras stacked at the top and bottom of the center have an image angle of 90 degrees, and the surveillance cameras arranged to the left and right of the center surveillance camera have an image angle of 60. It is a monitoring device.

In an embodiment, the surveillance cameras stacked at the top and bottom of the center have an image angle of 60 degrees, and the surveillance cameras arranged to the left and right of the center surveillance camera have an image angle of 90 degrees. It is a monitoring device.

In one embodiment, it consists of eight surveillance cameras, an image processor, a digital recording storage device, and a monitor.

In the middle, two surveillance cameras are stacked up and down, and the surveillance cameras are arranged on the left and right. On the contrary, four surveillance cameras are arranged in the same arrangement. It includes an image processor that creates a 360-degree panoramic image by deleting images from the top, bottom, left, and right around the baseline of the overlapping part of the captured image by joining the captured images. For example, overlapping parts are generated because they cannot be taken in parallel. For example, if four fan-shaped pieces having an angle of 90 degrees are connected to each other, 360 circles can be created without overlapping parts. This is because it requires a high degree of optics.

The panoramic image is an omnidirectional super panoramic surveillance device with enhanced viewing range that is stored and displayed on the digital recording storage.

That is, as shown in (A) of FIG. 2, since the 60-degree image in the center is vertically stacked and photographed, the upper and lower visible range of the center is widened by that, and the screen is enlarged while the object approaching from the peripheral edge comes to the center. Screen distortion, which is faster and reduces the upper and lower visible range, is reduced by expanding the visible range in the center and then reducing it.

3 illustrates an example of an overlapping image and a reference line.

That is, when the image captured by the surveillance camera next to the image taken with the angle of view of A is invaded by B, the reference line for deleting the area by C is described.

In addition, when the angle of view of D is 90 degrees and the angle of view of E is 60 degrees, the overlapping portion is as much as H. In this case, the reference line is a region where the 90 degree angle of view with severe peripheral distortion is deleted (F) and the overlapping area of the 60 degree of view (G) A reference line that is less deleted is formed so that F is deleted from the image of the 90 degree angle of view, and G is deleted from the image of the 60 degree angle of view, thereby deleting a relatively small angle of view (overlapping portion).

In one embodiment, it consists of a surveillance camera, an image processor, a digital recording storage device, and a monitor. The surveillance cameras are composed of six surveillance cameras, each of which has four surveillance cameras stacked up and down, as shown in FIG. To the left and right side to shoot 180 degrees forward, and the image processor to delete the overlapping part of the top and bottom stacked image centered on the baseline, and the left over image left behind this image It reduces and reduces the number of images captured by the left and right surveillance cameras to the image captured in the center, and then creates a panoramic image by deleting images from the left and right around the overlapping baseline. It is an omnidirectional super panoramic monitoring device with improved visibility.

As an example, as shown in (D) of FIG. 2, the surveillance cameras stacked at the top and bottom of the center are four surveillance cameras having an image angle of 90 degrees, and the surveillance cameras arranged to the left and right of the central surveillance camera have an image angle of 60 degrees. It is an omnidirectional super panoramic monitoring device with improved visibility.

In one embodiment, the upper and lower superimposed surveillance camera in the center is 60 degrees video angle of maximum shooting angle, the surveillance camera arranged to the left and right of the central surveillance camera is 90 degrees super-visible supervision range, characterized in that 90 degrees It is a panoramic monitoring device.

In one embodiment, it consists of 12 surveillance cameras, image processor, digital recording storage device, and monitor, and two surveillance cameras are stacked up and down and two surveillance cameras are arranged in the opposite direction, and two surveillance cameras are arranged in the opposite direction. 6 surveillance cameras are arranged, and the images captured by the upper and lower stacked surveillance cameras are reduced by the image processor, and then the images captured from the left and right are connected to the baseline of the overlapping part of the captured images. The panoramic image created by 360-degree panoramic image by deleting the image from left and right is the omnidirectional super panoramic monitoring device which is saved in the digital recording storage and displayed through the monitor. For example, overlapping part occurs because it is not possible. You can make 360 circles without overlapping parts, but when you shoot with a real camera, it is difficult to accurately match 90 degrees, so making parallel rays requires a high degree of optics.

1 is a simplified diagram of a process of creating a panoramic image by correction with an image processor

2 is a view illustrating an image processing of an upper, lower, left, and right superimposed image

3 is an explanatory example of overlapping images and a baseline

4 is a simplified view for explaining the optical path difference

Claims (8)

It consists of surveillance camera, image processor, digital recording storage device and monitor; Surveillance camera shoots 180 degrees forward by attaching left and right around two surveillance cameras stacked up and down among four cameras; An image processor deletes an image from above and below with respect to a reference line as an overlapping portion of an image stacked at the center, and leaves the present image and then reduces the image; Visibility range characterized by an image processor that combines the images taken from the left and right surveillance cameras with the images taken from the center, and then creates a panoramic image from the left and right over the baseline of the overlapping part. Super panoramic monitor with enhanced performance 2. The surveillance camera of claim 1, wherein the surveillance cameras stacked at the top and the bottom have a visual angle of 90 degrees at the maximum shooting angle, and the surveillance cameras arranged at the left and right sides of the central surveillance camera have a maximum imaging angle of 60. Omni Range Super Panoramic Monitoring with Enhanced Range The surveillance camera of claim 1, wherein the surveillance cameras stacked at the top and bottom of the center have an image angle of 60 degrees as the maximum photographing angle, and the surveillance camera arranged to the left and right of the center surveillance camera has an image angle of 90 as the maximum photographing angle. Omni Range Super Panoramic Monitoring with Enhanced Range It consists of eight surveillance cameras, image processor, digital recording storage and monitor; A total of eight surveillance cameras in which two surveillance cameras are stacked up and down in the middle and two surveillance cameras are disposed on the left and right, and four surveillance cameras are arranged in the same arrangement; The images taken from the top and bottom surveillance cameras are reduced by the image processor, and the images taken from left and right are connected, and the images from the top, bottom, left and right are deleted based on the baseline of the overlapping part of the captured image. An image processor for creating a 360 degree panoramic image; Panoramic images are stored in the digital recording storage and displayed on the monitor. It consists of surveillance camera, image processor, digital recording storage device and monitor; Surveillance cameras consist of six surveillance cameras, two horizontally, two vertically, and four surveillance cameras stacked up, down, left, and right. Photographing 180 degrees; An image processor deletes an image from above and below with respect to a reference line as an overlapping portion of an image stacked at the center, and leaves the present image and then reduces the image; Visibility range characterized by an image processor that combines the images taken from the left and right surveillance cameras with the images taken from the center, and then creates a panoramic image from the left and right over the baseline of the overlapping part. Super panoramic monitor with enhanced performance 6. The surveillance camera according to claim 5, wherein the surveillance cameras stacked at the top and bottom of the center are four surveillance cameras having a maximum photographic angle of 90 degrees; Surveillance cameras arranged to the left and right of the surveillance camera in the center has a maximum angle of view of 60 degrees super wide range super panoramic monitoring device, characterized in that 6. The surveillance camera according to claim 5, wherein the surveillance cameras stacked at the top and bottom of the center have an image angle of 60 degrees as the maximum photographing angle, and the surveillance camera arranged to the left and right at the center surveillance camera has an image angle of 90 as the maximum photographing angle. Omni Range Super Panoramic Monitoring with Enhanced Range 12 surveillance cameras, image processor, digital recording storage and monitor; The four surveillance cameras in the middle are stacked two horizontally and two vertically, and then the left and right surveillance cameras are arranged to be six surveillance cameras, and six surveillance cameras are arranged in the same direction in the opposite direction; The images taken from the top and bottom surveillance cameras are reduced by the image processor, and the images taken from left and right are connected, and the images from the top, bottom, left and right are deleted based on the baseline of the overlapping part of the captured image. An image processor for creating a 360 degree panoramic image; Panoramic images are stored in the digital recording storage and displayed on the monitor.

Images