KR100978721B1 - Omni-directional Camera and PTZ Camera Linkage Possible Photographing Apparatus and Method Therewith, and a Computer-Readable Medium thereof - Google Patents

Abstract

The present invention is a omnidirectional camera capable of shooting a omnidirectional camera; A PTZ camera installed at a position close to the omnidirectional camera; And a controller for controlling the omnidirectional camera and the PTZ camera.

As another category of the present invention, the present invention provides a first step of installing a omnidirectional camera, a PTZ camera and a control unit; A second step of dividing the image photographed by the omnidirectional camera into a plurality of areas by the controller; A third step of setting, by the controller, the shooting direction of the PTZ camera according to the shooting area of the omnidirectional camera divided in the second step; A fourth step of photographing the surrounding situation in the omnidirectional camera; A fifth step of designating a specific area of the image of the omnidirectional camera captured in the fourth step; A sixth step of rotating the PTZ camera in the shooting direction of the PTZ camera set in the third step so as to fit the area of the omnidirectional camera designated in the fifth step; A seventh step of photographing the area designated in the fifth step by the PTZ camera; And an eighth step of displaying the image photographed in the fourth step or the seventh step on the image display unit. The image capturing method may be implemented through the omni-directional camera. And, it is possible to correct the distorted image photographed by the omnidirectional camera to watch as a general image.

In addition, by replacing the deterioration of the image quality generated in the process of correcting the distorted image with an image captured by the PTZ camera, there is an effect that can obtain a clear image quality. In addition, by using a PTZ camera as a PTZ camera, there is an effect that the user can enlarge the desired screen to shoot.

Omnidirectional, PTZ, PTZ, interlock, control, shooting

Description

OMNI-directional Camera and PTZ Camera Linkage Possible Photographing Apparatus and Method Therewith, and a Computer-Readable Medium

The present invention relates to a photographing apparatus and a photographing method for interlocking a omnidirectional camera and a PTZ camera, and more particularly, by interlocking a omnidirectional camera and a PTZ camera, observing surrounding conditions through an omnidirectional camera, and requiring a more accurate image. The present invention relates to a photographing apparatus, a photographing method, and a recording medium for capturing an omnidirectional camera and a PTZ camera which can be photographed using a PTZ camera.

Generally, banks, department stores, convenience stores, and government offices install and operate surveillance cameras to prevent theft and safety of customers, and monitor cameras are installed throughout the roads to check road conditions in real time. Such a surveillance camera provides a convenience of life by replacing the work that a person has conventionally monitored with his own eyes.

However, these cameras have a problem in that blind spots occur in shooting because only a limited angle is photographed. In order to solve this problem, a large number of cameras need to be installed at various locations in order to photograph the surveillance cameras at various angles.

In order to solve this problem, studies are being actively conducted to practically use a rotating mirror such as a conical mirror, a spherical mirror, and a hyperbolic mirror to secure a wide viewing angle. In addition, in the field of visual sensors applied to such a camera, an omnidirectional surveillance system including a camera for processing the omnidirectional image obtained by the optical system and the image pickup device into a user-confirmable image such as a panoramic image has been spotlighted. .

In recent years, a camera has been developed in which an CCTV or a fisheye lens is attached to a CCTV camera to enlarge a CCTV camera's shooting area. However, a camera using an optical mirror or a fisheye lens has a problem in that the captured image generates severe image distortion, and the farther away from the center of the screen, the subject is distorted in a round shape and the screen is rounded.

As a method of correcting the distortion of the image, a method of correcting the distortion image by obtaining a correction coefficient for obtaining the corrected image and then applying it directly to the distortion image, and assuming that the image is corrected in advance, There is a method of finding which point in the distorted image matches.

In the above-described correction method, the former is not mapped by the correction coefficient correctly and there are gaps between the corrections. In this case, a process of calculating the values of the gap points by using interpolation is necessary. And, even after correction there is a problem that the quality of the image falls.

In addition, the camera using the optical mirror or fisheye lens can see all the omnidirectional, there is a problem that can not be seen to enlarge any particular point.

Therefore, the present invention was created in order to solve the above problems, by interlocking the omnidirectional camera and the PTZ (Pan, Tilt, Zoom) camera, to observe the surrounding situation through the omnidirectional camera, and when more accurate images are required, the PTZ It is possible to shoot using a camera, and the user provides a photographing apparatus, a photographing method, and a recording medium for interlocking a omnidirectional camera and a PTZ camera that can clearly see a desired image without the distinction between the omnidirectional camera and the PTZ camera. There is this.

An object of the present invention as described above is a omnidirectional camera capable of shooting the omnidirectional; A PTZ camera installed at a position close to the omnidirectional camera; And a control unit for controlling the omnidirectional camera and the PTZ camera; can be achieved by a photographing device comprising a.

As another category of the present invention, an object of the present invention is the first step of installing a omnidirectional camera, a PTZ camera and a control unit; A second step of dividing the image photographed by the omnidirectional camera into a plurality of areas by the controller; A third step of setting, by the controller, the shooting direction of the PTZ camera according to the shooting area of the omnidirectional camera divided in the second step; A fourth step of photographing the surrounding situation in the omnidirectional camera; A fifth step of designating a specific area of the image of the omnidirectional camera captured in the fourth step; A sixth step of rotating the PTZ camera in the shooting direction of the PTZ camera set in the third step so as to fit the area of the omnidirectional camera designated in the fifth step; A seventh step of photographing the area designated in the fifth step by the PTZ camera; And an eighth step of displaying the image photographed in the fourth or seventh step on the image display unit.

According to the present invention, it is possible to observe the surrounding environment of the camera installation position through the omnidirectional camera, and to correct the distorted image photographed by the omnidirectional camera to watch a general image.

In addition, by replacing the degradation of the image quality generated in the process of correcting the distorted image with the image captured by the PTZ camera capable of high-speed rotation, there is an effect that can obtain a clear image quality. In addition, by using a dome-type camera or a box-type PTZ camera as a PTZ camera, the user can enlarge and capture a desired screen, so that the user can clearly see the desired image without distinguishing between the omnidirectional camera and the PTZ camera. By controlling the omnidirectional camera and the PTZ camera in conjunction with the control unit, the image captured by the omnidirectional camera and the enlarged image captured by the PTZ camera can be displayed on the selective image display unit according to the user's selection. Thus, the user can obtain the same effect as obtaining a captured image of the entire area and the enlarged image of the specific area in one camera.

Therefore, by using a crime prevention camera, a road surveillance camera has the effect of identifying and dealing with a smooth accident situation in the event of criminal arrest and accident occurrence.

In addition, by using the omni-directional camera using the fish-eye lens as the omnidirectional camera, there is an effect that can reduce the size of the product.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

<Configuration of the recording device>

(First embodiment)

FIG. 1 shows a bottom perspective view of a photographing apparatus according to a first embodiment of the present invention, and FIG. 2 shows a schematic side cross-sectional view of the photographing apparatus 10 according to the first embodiment of the present invention. As shown in FIG. 1 and FIG. 2, the photographing apparatus 10 according to the first embodiment of the present invention generally includes an omnidirectional camera 100, a PTZ camera 200, and a controller 300.

The omnidirectional camera 100 according to the first embodiment of the present invention is a curved surface in which the far-field image is reflected to the front over the omnidirectional camera 360 around the omnidirectional camera 100 and the far-field image is collected more smoothly than the near-field image. It is composed of a camera 120 for capturing the surrounding image reflected by the mirror 110 and the curved mirror (110). At this time, the curved mirror 110 has a through-hole 111 is formed on one side of the center of the curved mirror 110 so that the camera 120 for shooting the curved mirror 110 is not photographed. In addition, the housing 130 is made of a semi-spherical transparent glass or acrylic material for protecting the curved mirror 110 from the external environment such as rain water or dust in a place spaced from the curved mirror 110 by a predetermined distance. This is further provided.

The PTZ camera 200 according to the first embodiment of the present invention is installed in the vicinity of the place where the omnidirectional camera 100 is installed to more clearly capture a screen requested by the user among the images captured by the omnidirectional camera 100. Device. The PTZ camera 200 may be any camera, but preferably can be moved quickly at the request of the user, and in order to clearly capture the image desired by the user than the omnidirectional camera 100, up, down, It's a good idea to use a dome camera that can pan and zoom left and right. The PTZ camera 200 is preferably installed at the lower end of the omnidirectional camera 100 so that the center axis and the rotation center axis of the omnidirectional camera 100 coincide.

The control unit 300 according to the first embodiment of the present invention is installed in the vicinity of the camera 100 and the PTZ camera 200 in order to control the aforementioned omnidirectional camera 100 and the PTZ camera 200. The controller 300 divides the image photographed by the omnidirectional camera 100 into 4 to 40 regions and sends the divided image to the image display unit 400. In addition, the controller 300 matches the segmented image photographed by the omnidirectional camera 100 with the photographing direction of the PTZ camera 200. Then, at the request of the user, the image captured by the omnidirectional camera 100 and the PTZ camera 200 is selectively displayed on the image display unit 400.

(Second embodiment)

3 shows a schematic side cross-sectional view of a photographing apparatus 10 according to a second embodiment of the present invention. As shown in FIG. 3, the photographing apparatus 10 according to the second exemplary embodiment of the present invention includes an omnidirectional camera 100, a PTZ camera 200, and a controller 300.

The omnidirectional camera 100 according to the second embodiment of the present invention includes a camera 120 for capturing an image and a fisheye lens 140 provided in the lens unit of the camera 120 to capture a wide range.

The PTZ camera 200 according to the present invention is installed in the vicinity of the place where the omnidirectional camera 100 is installed, and is a device for more clearly capturing a screen requested by the user among images captured by the omnidirectional camera 100. The PTZ camera 200 may be any camera, but preferably can be moved quickly at the request of the user, and in order to clearly capture the image desired by the user than the omnidirectional camera 100, up, down, We recommend using a boxed PTZ camera that can move left and right and zoom in and out. The PTZ camera 200 is preferably installed on the upper end of the omnidirectional camera 100 so that the center axis and the rotation center axis of the omnidirectional camera 100 coincide.

The controller 300 according to the present invention is installed in the vicinity of the camera 100 and the PTZ camera 200 to control the omnidirectional camera 100 and the PTZ camera 200 described above. The controller 300 divides the image photographed by the omnidirectional camera 100 into 4 to 40 regions and sends the divided image to the image display unit 400. In addition, the controller 300 matches the segmented image photographed by the omnidirectional camera 100 with the photographing direction of the PTZ camera 200. Then, at the request of the user, the image captured by the omnidirectional camera 100 and the PTZ camera 200 is selectively displayed on the image display unit 400.

<How to shoot with the shooting device>

4 is a flowchart illustrating a photographing method according to the present invention. As shown in FIG. 4, first, in the first step S100, the omnidirectional camera 100, the PTZ camera 200, and the controller 300 are installed at an installation place such as a road, a park, a toll gate or a public office (S100). S100). At this time, the omnidirectional camera 100 is installed on the wall, ceiling, telephone pole, or prop 700 of the building, the PTZ camera 200 is installed with the same axis of rotation as the center axis of the omnidirectional camera 100. In addition, the control unit may be installed in a position adjacent to the omnidirectional camera 100 and the PTZ camera 200 to control the omnidirectional camera 100 and the PTZ camera 200, preferably the omnidirectional camera 100 and the PTZ It is installed between the camera 200. Here, the omnidirectional camera 200 is installed, it is preferable to use the omnidirectional camera 200 using the curved mirror 110 or fisheye lens 140, the PTZ camera 200 is rotated up, down, left, right. It is recommended to use a dome-type camera or a box-type PTZ camera that can be used to enlarge the screen.

Next, in the second step (S200), the image reflected by the curved mirror 110 of the omnidirectional camera 100 through the control unit 300 is divided into 4 to 40 images (S200). This is because the curved image photographed by the curved mirror 110 or the fisheye lens 140 is not smooth for the user to view, and thus the plurality of distorted images captured by the curved mirror 110 or the fisheye lens 140 are multiple. This is to provide the user with the distorted image by plane.

Next, in the third step S300, the divided screen to be photographed by the omnidirectional camera 100 through the control unit 300 so that the PTZ camera 200 can capture the screen divided in the second step S200 described above. Control to match the shooting direction of the PTZ camera 200 and (S300). At this time, the shooting direction of the PTZ camera 200 is set to correspond to the divided areas of the omnidirectional camera 100 by the number divided in the second step (S200).

5 is a view illustrating an image display unit displaying a divided image photographed by the omnidirectional camera according to the present invention. Next, in the fourth step (S400), the surrounding situation of the omnidirectional camera 100 of the camera device 100 of the camera device that has completed the control in the second step (S200) and the third step (S300) and the control unit 300 is photographed. (S400). In this case, the image captured by the omnidirectional camera 100 is divided into a plurality of parts through the controller 300 and displayed on the image display unit 400 as shown in FIG. 5. At this time, the screen displayed on the image display unit 400 is a Cartesian coordinate system composed of the x-axis and y-axis by mapping the image captured by the circular coordinate system consisting of the radius r and the rotation angle θ in the omnidirectional camera 100 in the control unit 300 By changing to a planar image by the image display unit 400 is displayed.

Next, in a fifth step S500, a user designates an arbitrary screen A among images captured by the omnidirectional camera 100 in a fourth step S200 (S500). The designated screen may be recognized by the controller 300.

5 shows a schematic bottom view of a photographing apparatus according to the present invention.

Next, in the sixth step (S600), as shown in Figure 5, the PTZ camera 200 is rotated to the area corresponding to the screen (A) specified in the fifth step (S500) (S600). At this time, the rotation of the PTZ camera 200 rotates the PTZ camera 200 to match the area A recognized by the control unit 300 in the fifth step S500 by a preset value in the third step S300. Let's do it.

7 illustrates a portion of an image display unit displaying an enlarged image of a PTZ camera according to the present invention. Next, in the seventh step (S700) it starts shooting in the PTZ camera 200 at the request of the user (S700). In this case, the PTZ camera 200 may obtain a desired screen large and clear as shown in FIG. 7 by utilizing a zoom function according to a user's need.

Next, in the eighth step S800, images captured by the omnidirectional camera 100 and the PTZ camera 200 are selectively displayed on the image display unit as necessary by the user (S800).

In the above-described embodiment has been described as a structure in which the PTZ camera 200 is installed below the omnidirectional camera 100, the reverse may be installed.

<Recording medium>

The recording medium according to the present invention is loaded with a program executable on a computer. The recording medium has a function of dividing a plurality of shooting areas of the omnidirectional camera 100 through the control unit 300, and sets a shooting area of the PTZ camera 200 to correspond to the divided shooting areas of the omnidirectional camera 100. A function, a function of controlling the surrounding situation over the omnidirectional camera 100 to photograph, and a function of displaying the image photographed by the omnidirectional camera 100 on the image display unit 400, respectively.

In addition, when a specific area (A) is input from the user among a plurality of images displayed on the image display unit 400, a function of rotating the PTZ camera 200 to the designated shooting area according to the input value, and the specified area is PTZ. The camera 200 includes a function of controlling to shoot.

The image display unit may display at least one of the image photographed by the omnidirectional camera 100 and the image photographed by the PTZ camera 200 according to a value selected by the user.

In addition, it is also possible to mount and use a program on a recording medium for executing a photographing method for interlocking the omnidirectional camera 100 and the PTZ camera 200 according to the present invention on a computer. In addition, the recording method of shooting in conjunction with the omnidirectional camera 100 and the PTZ camera 200 can be implemented in a computer-readable code to be recorded on the recording medium. Here, the recording medium includes all kinds of recording devices capable of storing data that can be read by a computer system. Examples include ROM, RAM, CD-ROM, magnetic tape, floppy disk, USB memory or optical data device.

<Use Mode>

8 is a view showing the use of the photographing apparatus for shooting in conjunction with the omnidirectional camera and the PTZ camera according to the present invention. The photographing apparatus 10 having the above-described configuration is installed to be spaced apart at regular intervals by using the holding post 700, a telephone pole, a street lamp, etc. in a city road, highway, or rest area. The photographing apparatuses 10 installed as described above are connected to a network to collect images photographed by the integrated server 500 and display the images on the image display unit 400. Here, the images displayed on the image display unit 400 may be set and changed by the user PC 600, and control the shooting of the PTZ camera 200. At this time, the photographing apparatus 10 photographs by the photographing method and the recording medium described above.

As described above, those skilled in the art will understand that the present invention can be implemented in other specific forms without changing the technical spirit or essential features. It is therefore to be understood that the above-described embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included within the scope of the present invention.

The following drawings, which are attached in this specification, illustrate the preferred embodiments of the present invention, and together with the detailed description thereof, serve to further understand the technical spirit of the present invention, and therefore, the present invention is limited only to the matters described in the drawings. It should not be interpreted.

1 is a bottom perspective view of a photographing apparatus according to a first embodiment of the present invention;

2 is a schematic side sectional view of a photographing apparatus according to a first embodiment of the present invention;

3 is a schematic side sectional view of a photographing apparatus according to a second embodiment of the present invention;

4 is a flowchart showing a photographing method according to the present invention;

5 is a view showing an image display unit for displaying a segmented image taken by the omnidirectional camera according to the present invention;

6 is a schematic bottom view of a photographing apparatus according to the present invention;

7 is a view showing a portion of an image display unit for displaying an image captured by a PTZ camera according to the present invention;

8 is a view showing the use of the photographing apparatus for shooting in conjunction with the omnidirectional camera and the PTZ camera according to the present invention.

<Explanation of symbols for the main parts of the drawings>

10: recording device 100: omnidirectional camera

110: curved diameter 111: through hole

120: camera 140: fisheye lens

200: PTZ camera 300: control unit

400: video display unit 500: integrated server

600: user PC 700: holding table

Claims (14)

An omnidirectional camera 100 capable of capturing omnidirectional; A PTZ camera 200 installed at a position close to the omnidirectional camera 100; And And a controller 300 for controlling the PTZ camera 200 to be linked with a designated area of the image captured by the omnidirectional camera 100. The omnidirectional camera 100, A curved mirror 110 in which the omnidirectional image is reflected; And And a camera 120 for capturing an image displayed on the curved mirror 110. The curved mirror 110 has a through hole 111 is formed in the center area so that the camera 120 is not photographed, The PTZ camera 200 is interlocked with the omnidirectional camera and the PTZ camera, characterized in that installed on the bottom or top of the omnidirectional camera 100 so that the axis of rotation of the camera coincides with the central axis of the omnidirectional camera 100. Shooting device. delete delete The method of claim 1, Around the curved mirror 110, a photographing apparatus for shooting in conjunction with the omnidirectional camera and the PTZ camera, characterized in that the hemispherical transparent housing 130 for protecting the curved mirror 110 is further provided. The method of claim 1, The omnidirectional camera 100, Camera 120 for taking an image; And And a fisheye lens (140) provided in the lens portion of the camera (120) and having a wide range of blind spots. The method of claim 1, The PTZ camera 200 is a photographing apparatus for shooting in conjunction with the omnidirectional camera and the PTZ camera, characterized in that the dome-shaped camera. The method of claim 1, The PTZ camera 200 is a shooting device for shooting in conjunction with the omnidirectional camera and the PTZ camera, characterized in that the box-type PTZ camera. delete A first step (S100) of installing the omnidirectional camera 100, the PTZ camera 200, and the controller 300; A second step of setting the control unit 300 to divide the image to be photographed by the omnidirectional camera 100 into a plurality of areas (S200); A third step (S300) of setting the photographing direction of the PTZ camera (200) according to the photographing area of the omnidirectional camera (100) divided in the second step (S200); A fourth step (S400) of photographing the surrounding situation over the omnidirectional camera (100); A fifth step (S500) of rotating the PTZ camera 200 in a designated photographing direction when a designation of a specific region is input from the image of the omnidirectional camera 100 by a user; A sixth step (S600) of capturing a region designated in the fifth step (S500) by the PTZ camera (200); And a seventh step (S700) of displaying the image photographed in the fourth step (S400) or the sixth step (S600) on the image display unit (400). In the seventh step S700, the controller 300 maps an image photographed by a circular coordinate system having a radius r and a rotation angle θ in the omnidirectional camera 100 of the fourth step S400 in the x and y axes. Shooting method for interlocking with the omnidirectional camera and the PTZ camera, characterized in that to change the planar image by the rectangular coordinate system consisting of the display on the image display unit 400. The method of claim 9, In the first step (S100), the PTZ camera is a shooting method for interlocking with the omnidirectional camera and the PTZ camera, characterized in that installed on the lower end of the omnidirectional camera so that the rotation axis of the camera coincides with the central axis of the omnidirectional camera. The method of claim 9, In the third step (S300), the omnidirectional camera and the PTZ camera, characterized in that the setting direction of the number of the PTZ camera 200, the same number as the shooting area of the omnidirectional camera 100 divided in the second step (S200) How to shoot in conjunction. delete The method of claim 9, In the seventh step S700, the image displayed on the image display unit 400 displays at least one of an image captured by the omnidirectional camera 100 and an image captured by the PTZ camera 200 according to a user's request. Shooting method for shooting in conjunction with the omnidirectional camera and the PTZ camera, characterized in that controlled by the control unit (300). A function of dividing the photographing area of the omnidirectional camera 100 into a plurality of areas through the control unit 300; Setting a shooting area of the PTZ camera 200 to correspond to the divided area of the omnidirectional camera 100; A function of controlling the camera to photograph surrounding situations in all directions; A function of displaying an image photographed by the omnidirectional camera 100 on an image display unit 400; A function of rotating the PTZ camera 200 to a designated shooting area according to the input value when a designation of a specific area is input from a user among the images displayed on the image display unit 400; A function of controlling the PTZ camera 200 to capture an area designated by the user; And displaying at least one of the image captured by the omnidirectional camera 100 and the image captured by the PTZ camera 200 on the image display unit 400 according to a value selected by the user. Record medium on which possible programs are recorded.

Images