WO2012108577A1

WO2012108577A1 - Monitoring device and method

Info

Publication number: WO2012108577A1
Application number: PCT/KR2011/002121
Authority: WO
Inventors: 제인아닐쿠마; 박운상; 최현철
Original assignee: 고려대학교 산학협력단
Priority date: 2011-02-07
Filing date: 2011-03-28
Publication date: 2012-08-16

Abstract

Proposed is a monitoring device and method for accurately indicating a target regardless of the distance between the target and a camera. The proposed monitoring device includes: a rotating capturing module capturing a target in a monitoring area; a first fixed capturing module installed in the vertical direction with respect to the rotating capturing module, and capturing the target monitoring area; a second fixed capturing module installed in the horizontal direction with respect to the rotating capturing module, and capturing the target monitoring area; and a control module which generates position information of the target of a virtual fixed capturing module where the central point of rotation of the rotating capturing module and the focal position are identical on the basis of image information including the target from the first and second fixed capturing modules, and which controls the rotating capturing module on the basis of virtual position information. By using a fixed camera and a PTZ camera, broad-range monitoring is performed and a high-resolution image of an intruder or a target in the monitoring zone is accurately and simultaneously captured regardless of distance. The reliability of a security system using face detection and object recognition may thereby be drastically increased. Regardless of the distance between a camera and a target, a PTZ camera is controlled to accurately indicate the target such that a monitoring distance may be expanded.

Description

Surveillance device and method

The present invention relates to a monitoring apparatus and method, and more particularly, to a monitoring apparatus and method for precisely facing a target using a fixed camera and a PTZ camera.

Nowadays, due to the development of the industry, technology or information possessed by a company is often leaked or stolen. To prevent this, the interest in surveillance cameras has increased greatly, and the demand has also increased greatly.

In particular, surveillance cameras are installed in dark alleys, parking lots, or indoor entrances to prevent various crimes and track criminals.

Due to this rapid increase in demand, many efforts and researches are being conducted to provide improved security. However, the low magnification image problem remains a challenge to be solved. The problem of low magnification images is that objects or people occupy a small percentage of the total image when monitored using a conventional wide area camera (also called a "fixed camera").

Due to these problems, even if the image of the criminal was taken by the surveillance camera at the actual crime scene, the image is taken so small that the face cannot be discerned, which is often not helpful for the arrest.

To solve this problem, a combination of a fixed camera and a PTZ (Pan / Tilt / Zoom) camera is often used. The fixed camera captures a wide angle region. The PTZ camera captures the details of the target through Pan, Tilt and Zoom functions. When the fixed camera captures a target present in the area to be monitored, the PTZ camera pans / tilts to focus the desired position of the captured target (e.g., a specific position, such as a face), thereby increasing the magnification of the target. To get an image.

Systems using one PTZ camera and multiple fixed cameras (see [Stillman et al., 1999], [Hapmapur et al., 2003]) allow for the calculation of the distance between an object and a camera. The system generates three-dimensional coordinates of a target by stereo compositing using a number of fixed cameras, just as a person obtains three-dimensional information of an object with two eyes. The system can theoretically calculate the pan and tilt angles of a PTZ camera using three-dimensional coordinates. However, such a system is disadvantageous in terms of cost since it uses a large number of fixed cameras. In addition, the stereo synthesis method requires complex computations. In addition, the stereo synthesis method shows a lot of errors due to inaccuracies due to acquiring corresponding points between stereo images. In particular, the system limits the distance between the camera and the object that can be calculated depending on the resolution and configuration of the camera used.

On the other hand, systems using one PTZ camera and one fixed camera (see [Marchesotti et al., 2005], [Prince et al., 2006]) measure the position of objects in the fixed camera and adjust the PTZ camera. Obtain a high magnification image. This system places the images 12 of the targets "a" and "b" taken by the fixed camera at the same point on the imaging plane (image plane) 10 of the fixed camera as shown in FIG. However, the PTZ camera 14 must move to different pan and tilt angle values according to the distance so that the target camera “a” and the target “b” can be accurately indicated. In other words, the system does not coincide with the focal point of the fixed camera and the center of rotation of the PTZ camera 14. Accordingly, the targets "a" and "b" photographed at the same image coordinates by the fixed camera correspond to different pan and tilt angle values.

Therefore, it is important to calibrate the pan and tilt angle values that control the two-dimensional coordinates of the target and the PTZ camera to the target in the image taken from the fixed camera.

Due to the fact that the focal point (focus) of the fixed camera and the center of rotation of the PTZ camera do not coincide, the correlation between the image coordinates of the fixed camera and the pan and tilt angle values of the PTZ camera obtained during the calibration process is determined by the distance between the camera and the object. Results in dependence. That is, even an object observed at the same coordinates on the image of the fixed camera may require different pan and tilt angle values according to the actual three-dimensional coordinates of the object.

This distance dependency requires the camera calibration process to be performed at the distance at which the object is expected to be observed. However, since the distance at which an object is viewed is not known in advance and the object is observed over a wide range of distances, distance dependence acts as an obstacle to accurate adjustment of the PTZ camera.

Accordingly, most conventional systems using PTZ cameras and fixed cameras are used assuming a constant between the target and the camera.

However, if the target comes too close to the camera or moves away from the camera, the PTZ camera may not point exactly at the target and out of the shooting area.

The present invention has been proposed to solve the above-described problems, and an object thereof is to provide a monitoring apparatus and method capable of accurately pointing a target regardless of the distance between the target and the camera.

In order to achieve the above object, a monitoring apparatus according to a preferred embodiment of the present invention, the image pickup module for imaging a target in the area to be monitored; A first fixed imaging module provided in the longitudinal direction with respect to the rotation imaging module, and configured to image an area to be monitored; A second fixed imaging module provided in the transverse direction with respect to the rotation imaging module, and configured to image an area to be monitored; And generating position information of the target of the virtual fixed imaging module whose position of focus coincides with the rotation center point of the rotating imaging module based on the image information including the targets from the first and second fixed imaging modules. And a control module for controlling the rotation imaging module based on the information.

Preferably, the respective direction axes of the first fixed imaging module, the second fixed imaging module, and the rotary imaging module are parallel to each other.

The control module provides one rotation angle value to the rotation imaging module regardless of the distance to the target. In this case, one rotation angle value includes one or more of the pan and tilt angle values.

The control module includes a position calculating unit that calculates a position of a target in the area to be monitored from image information from the first and second fixed imaging modules; And generating position information of a target of the virtual fixed imaging module in which the rotation center point of the rotation imaging module and the position of the focus coincide based on the position information from the position calculating unit, and adjusting the rotation angle of the rotation imaging module based on the virtual position information. It includes a control unit for controlling.

The position calculating unit may include: a first position calculating unit that calculates a position of a target in the area to be monitored from image information from the first fixed imaging module; And a second position calculator configured to calculate a position of a target in the area to be monitored in the image information from the second fixed imaging module.

The position calculating unit calculates the position of the target in the area to be monitored using the background difference image.

The controller generates virtual position information by combining the horizontal coordinates of the position information of the target in the monitoring target area photographed by the first fixed imaging module and the vertical coordinates of the position information of the target in the monitoring target area photographed by the second fixed imaging module. do.

According to another preferred embodiment of the present invention, there is provided a surveillance apparatus comprising: first and second fixed imaging modules for imaging an area to be monitored; And a rotational imaging module installed in the longitudinal direction with respect to the first fixed imaging module and provided in the horizontal direction with respect to the second fixed imaging module, for imaging a target in the area to be monitored.

The rotation imaging module generates position information of the target of the virtual fixed imaging module whose position of the focal point coincides with the rotation center point of the rotation imaging module based on the image information including the targets from the first and second fixed imaging modules. And a control module that controls the rotation of the rotation imaging module based on the virtual position information.

Monitoring device according to another embodiment of the present invention, the spectrometer; A rotation imaging module for imaging a target in the area to be monitored through a spectroscope; A fixed imaging module which is provided at a coaxial concentric position with the rotation imaging module with the spectroscope interposed therebetween, and captures an image of a surveillance target region reflected by the spectroscope; And a control module generating position information of the target from an image of the fixed imaging module and controlling the rotation imaging module based on the position information.

The control module controls the angle formed by the spectroscope and the direction axis of the rotating imaging module toward the target and the angle formed by the spectroscope and the straight line that is refracted by the spectroscope at the target to the focal point of the fixed imaging module to be equal to each other. .

The control module provides the rotating imaging module with one rotation angle value corresponding to the position of the target in the image information from the fixed imaging module regardless of the distance to the target.

One rotation angle value includes one or more of the pan and tilt angle values.

The control module includes a position calculating unit that calculates a position of a target in the area to be monitored from the image information from the fixed imaging module; And a controller configured to control a rotation angle of the rotation imaging module based on the position information from the position calculation unit.

Preferably, the apparatus further includes a container having an accommodation space and having an opening formed at one side thereof, and having a spectrometer installed at the opening.

The inner surface of the container is black, and a rotation imaging module is installed in the receiving space of the container.

Monitoring device according to another embodiment of the present invention, the spectrometer; A rotation imaging module for imaging a target in the area to be monitored through a spectroscope; And a fixed imaging module configured to capture an image of a surveillance target region reflected by the spectroscope.

The angle formed by the direction axis of the rotating imaging module toward the target and the spectroscope and the angle formed by the spectroscope and the straight line that are refracted by the spectroscope at the target and reach the focal point of the fixed imaging module are the same.

The container further includes a container having an accommodation space and having an opening formed at one side thereof, and having a spectrometer installed at the opening.

A monitoring method according to a preferred embodiment of the present invention is a monitoring method for a monitoring apparatus including a rotational imaging module for imaging a target in a region to be monitored, first and second fixed imaging modules for imaging a region to be monitored, and a control module. As

Generating, by the control module, the position information of the target of the virtual fixed imaging module whose position of the focal point coincides with the rotation center point of the rotating imaging module based on the image information including the targets from the first and second fixed imaging modules ; And controlling, by the control module, the rotation imaging module based on the virtual position information.

The virtual position information generation step may be performed by combining the horizontal coordinates of the position information of the target in the monitoring target area photographed by the first fixed imaging module and the vertical coordinates of the position information of the target in the monitoring target area photographed by the second fixed imaging module. Create location information.

The virtual position information generating step may include calculating a position of a target in the area to be monitored in the image information from the first and second fixed imaging modules; And generating position information of a target of the virtual fixed imaging module whose position of the focal point and the rotation center point of the rotation imaging module coincide based on the position information from the position calculating step.

The position calculating step calculates the position of the target in the area to be monitored using a background subtraction image.

The rotation imaging module control step provides the rotation imaging module with one rotation angle value regardless of the distance to the target. In this case, one rotation angle value includes one or more of the pan and tilt angle values.

Preferably, the first fixed imaging module is installed in the longitudinal direction with respect to the rotary imaging module, and the second fixed imaging module is installed in the horizontal direction with respect to the rotary imaging module.

According to another aspect of the present invention, a monitoring method includes a spectroscope, a rotation imaging module for imaging a target in a surveillance target area through a spectroscope, a fixed imaging module for imaging an image of a surveillance target area reflected from a spectroscope, and a control module. As a monitoring method of the monitoring device to include,

Generating, by the control module, position information of the target in the image of the fixed imaging module; And controlling, by the control module, the rotation imaging module based on the position information.

The location information generation step generates location information of the target by using the background difference image.

The rotating imaging module control step provides the rotating imaging module with one rotation angle value corresponding to the position of the target in the image information from the fixed imaging module regardless of the distance to the target.

One rotation angle value includes one or more of the pan and tilt angle values.

In the rotating imaging module control step, the direction of the rotational imaging module toward the target and the angle formed by the spectroscope and the straight line from the target to the focal point of the fixed imaging module are refracted by the spectroscope are equal to each other. Control to lose.

The spectroscope is installed in an opening formed in one side of the container having a storage space.

The inner side of the container is made black.

The rotation imaging module is installed in the storage space of the container.

Monitoring device according to another embodiment of the present invention, the spectrometer; A rotation imaging module for imaging a target in the area to be monitored through a spectroscope; And a fixed imaging module installed at a coaxial concentric position with the rotating imaging module with the spectrometer interposed therebetween, for capturing an image of a surveillance target region reflected by the spectroscope.

The rotation imaging module includes a control module that generates position information of a target from an image of the fixed imaging module and controls rotation of the corresponding rotation imaging module based on the position information.

One rotation angle value includes one or more of the pan and tilt angle values.

Using a fixed camera and a PTZ camera, a wide range of surveillance can be performed, and high-resolution images of intruders and targets in the surveillance area can be accurately captured regardless of distance. As a result, the reliability of the security system through face recognition and object recognition can be significantly increased.

By using a fixed camera and a PTZ camera to automatically track, detect, and zoom in on an object, an unmanned and automated AI video security system can be implemented at low cost.

Regardless of the distance between the camera and the target, the PTZ camera can be controlled to precisely point at the target, thus increasing the surveillance distance.

Since the fixed camera is always waiting for the appearance of another monitoring object, when a new target is captured from the fixed camera, it can be quickly moved / tracked from the current PTZ camera position to the newly detected target.

By using a spectrometer, one fixed imaging module and a rotating scratch module have a coaxial concentric structure, so that a plurality of targets photographed at the same coordinates in the fixed imaging module correspond to the same pan and tilt angle values regardless of the distance between the camera and the target. . As a result, the rotation imaging module can accurately point the target.

1 is a diagram illustrating a monitoring apparatus using a conventional PTZ camera and a fixed camera.

2 is a block diagram of a monitoring apparatus according to a first embodiment of the present invention.

FIG. 3 is a diagram illustrating an installation example of the first fixed imaging module, the second fixed imaging module, and the rotary imaging module of FIG. 2.

4 is a flowchart for explaining the operation of the monitoring apparatus according to the first embodiment of the present invention.

FIG. 5 is a view for explaining position data output from a position calculating unit in the monitoring apparatus according to the first embodiment of the present invention.

6 is a view for explaining an operation of generating position information of a virtual fixed imaging module in the monitoring apparatus according to the first embodiment of the present invention.

FIG. 7 is a diagram for explaining the features of the monitoring device of FIG. 2.

8 is a schematic view illustrating an operation region of the monitoring device of FIG. 2.

FIG. 9 is a diagram illustrating a difference between a final image for each distance between the monitoring device and the target of FIG. 2 and a final image for each distance between the existing monitoring device and the target.

10 is a block diagram of a monitoring apparatus according to a second embodiment of the present invention.

11 to 13 are diagrams showing examples of installation of the fixed imaging module, the rotating imaging module, and the spectroscope of FIG.

14 is a view for explaining the features of the monitoring apparatus according to the second embodiment of the present invention.

15 is a flowchart for explaining a monitoring method according to a second embodiment of the present invention.

The present invention provides a coaxial concentric structure by adjusting the structure of a PTZ camera and a fixed camera to control the PTZ camera so that the target is accurately directed to the target regardless of the distance between the target and the camera (or surveillance apparatus) with a simple calculation. do.

On the other hand, the present invention implements a coaxial concentric structure by adjusting the structure of the PTZ camera and the fixed camera by using a spectroscope (for example, a beam splitter) to implement a coaxial concentric structure, regardless of the distance between the target and the camera (or surveillance apparatus) with a simple calculation. It is a second feature to control so that the target points precisely to the target.

Hereinafter, a monitoring apparatus and a method according to an embodiment of the present invention will be described with reference to the accompanying drawings. Prior to the detailed description of the invention, the terms or words used in the specification and claims described below should not be construed as limiting in their usual or dictionary meanings. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only one of the most preferred embodiments of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

(First embodiment)

2 is a block diagram of a monitoring apparatus according to a first embodiment of the present invention. FIG. 3 is a diagram illustrating an installation example of the first fixed imaging module, the second fixed imaging module, and the rotary imaging module of FIG. 2.

The monitoring apparatus according to the first embodiment of the present invention includes a first fixed imaging module 20, a second fixed imaging module 24, a rotation imaging module 30, and a control module 60.

The first fixed imaging module 20 is installed in the longitudinal direction (see FIG. 3) with respect to the rotation imaging module 30. The first fixed imaging module 20 picks up a large area while being fixed with respect to the monitoring target area. That is, the first fixed imaging module 20 is fixed to be imageable in the zoom-out state so as to cover the entire surveillance target area. An example of the first fixed imaging module 20 is a wide area camera (also referred to as a "fixed camera").

The second fixed imaging module 24 is provided in the horizontal direction (see FIG. 3) with respect to the rotation imaging module 30. The second fixed imaging module 24 picks up a large area while being fixed with respect to the monitoring target area. That is, the second fixed imaging module 24 is fixed to be imageable in the zoom-out state so as to cover the entire surveillance target area. An example of the second fixed imaging module 24 may be a fixed camera.

The rotation imaging module 30 picks up an image of the target in the area to be monitored. For example, one example of the rotation imaging module 30 may be a PTZ camera.

Preferably, the direction axes of the first fixed imaging module 20 and the second fixed imaging module 24 are parallel to the rotation axes of the initial rotation imaging module 30 in which the pan and tilt angle values are set to zero. In the focal point of the first fixed imaging module 20 and the second fixed imaging module 24, two lines were drawn in a direction perpendicular to the direction axis of the initial rotation imaging module 30 in which the pan and tilt angle values were set to zero. Assume The two straight lines then lie in a perpendicular relationship to each other and comprise the center of rotation of the rotation imaging module 30. The surface perpendicular to the direction axis of the rotation imaging module 30 includes the focal points of the first fixed imaging module 20 and the second fixed imaging module 24. This is based on the position of the targets of the first fixed imaging module 20 and the second fixed imaging module 24 in the control module 60 in the virtual fixed imaging module coinciding with the rotation center point of the rotation imaging module 30. This is to allow the location information of the target to be generated.

In FIG. 3, the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30 are supported by the fastening members (not shown) to support frames 32, 34, 36, 38, and 40. It is fixedly installed on. Preferably, the distance between the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30 may be reduced as much as possible.

In the embodiment of the present invention, as shown in FIG. 3, the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30 are slightly spaced apart from each other. Since the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30 are hard to be implemented as a single module in hardware, they are installed as shown in FIG. 3. Of course, the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30 may be implemented as one module in hardware.

The control module 60 is a target of the virtual fixed imaging module coinciding with the rotation center point of the rotary imaging module 30 based on the image information including the targets from the first fixed imaging module 20 and the second fixed imaging module. Create location information. The control module 60 controls the rotation imaging module 30 based on the virtual position information.

The control module 60 has one rotation angle value irrespective of the distance (for example, the distance between the rotation imaging module 30 and the target) with respect to the target in the image captured by the first and second

fixed imaging modules

20 and 24. To the rotating imaging module 30. Here, one rotation angle value includes at least one or more of the pan, tilt angle value. Of course, the control module 60 may perform zoom control of the rotation imaging module 30. The embodiment of the present invention does not include a zoom because it is important to point the rotation imaging module 30 accurately to the target. However, the size of the target can be confirmed as shown in FIG. Therefore, it is natural that a high magnification image can be obtained by using an appropriate zoom.

The control module 60 includes a position calculator 70 and a controller 28.

The position calculating unit 70 calculates the position of the target in the monitoring target area from the image information from the first and second

fixed imaging modules

20 and 24. The position calculating unit 70 calculates the position of the target in the monitoring target area by using the background subtraction image.

The position calculating unit 70 calculates the position of the target in the surveillance target area from the image information from the first fixed imaging module 20, and the image from the second fixed imaging module 24. And a second position calculating section 26 for calculating a position with respect to the target in the surveillance region from the information.

The control unit 28 generates the position information of the target of the virtual fixed imaging module that coincides with the rotation center point of the rotation imaging module 30 based on the position information from the position calculating unit 70. Preferably, the controller 28 monitors the horizontal coordinates (for example, X coordinates) of the position information of the target in the surveillance target region captured by the first fixed imaging module 20 and the surveillance target captured by the second fixed imaging module 24. Virtual position information is generated by combining vertical coordinates (for example, Y coordinates) among the position information of the target in the area. The control unit 28 controls (adjusts) the rotation angle (eg, pan and tilt angle values) of the rotation imaging module 30 based on the virtual position information.

In the above description, the control module 60 is configured separately from the rotation imaging module 30. However, the control module 60 may be provided inside the rotation imaging module 30 as necessary. Even if the description of the configuration for this case is not separately, those who are engaged in the same industry will be fully understood by the above description.

Next, an operation of the monitoring apparatus according to the first embodiment of the present invention will be described with reference to the flowchart of FIG. 4. FIG. 5 is a view for explaining position data output from a position calculating unit in the monitoring apparatus according to the first embodiment of the present invention. 6 is a view for explaining an operation of generating position information of a virtual fixed imaging module in the monitoring apparatus according to the first embodiment of the present invention.

First, an image captured by the first fixed imaging module 20 and the second fixed imaging module 24 (that is, an image including a target in the area to be monitored) is transmitted to the control module 60.

The control module 60 calculates the position of the target in the monitoring target area from the image information from the first and second fixed imaging modules 20 and 24 (S10). The position calculating unit 70 in the control module 60 performs position calculation. When a target is detected, the position calculator 70 calculates a position of the target, and transmits the calculated position data of the target to the controller 28.

The position calculation process in the position calculation unit 70 will be described in more detail as follows. Hereinafter, since the first position calculating unit 22 and the second position calculating unit 26 of the position calculating unit 70 perform the same position calculating operation, only the operation of the first position calculating unit 22 will be described. The operation description of the second position calculation unit 26 is sufficiently understood as the operation description of the first position calculation unit 22 described later.

The first position calculating unit 22 calculates the position of the target in the area to be monitored using the background difference image. That is, the first position calculator 22 uses the pre-photographed background image (refer to FIG. 5A) and the input image (refer to FIG. 5B) to target the area of the target (FIG. 5C). See In other words, the first position calculating unit 22 is a pixel of the background image (see (a) of FIG. 5) already photographed and the image (see (b) of FIG. 5) transmitted from the first fixed imaging module 20. Find the difference between units. The first position calculating unit 22 knows the presence or absence of the target of the surveillance target region and the region of the intrusion target through the difference for each pixel unit. For example, suppose the target is a person. Since most people stand and move, the center point of the uppermost block can be regarded as the image coordinate of the target's face by dividing the height approximately 7 times in the region of the target (FIG. 5 (c)) obtained by the background difference image. Accordingly, the first position calculator 22 transmits the image coordinates of the face of the target as the position data to the controller 28.

Subsequently, the controller 28 obtains the target position information in the image of the virtual fixed imaging module that coincides with the rotation center point of the rotation imaging module 30 based on the position information from the first and second position calculation units 22 and 26. It generates (S22). Assume that the three fixed cameras are arranged in the letter "L" shape as shown in FIG. The position coordinates of the target photographed by the center stationary camera (that is, installed at the position of the rotation imaging module 30 of FIG. 3) are positioned at the top of the stationary camera (that is, the position of the first fixed imaging module 20 of FIG. 3). Can be inferred from the combination of the horizontal and vertical position information of the position coordinates of the target object photographed by the fixed camera of the side and the fixed camera (that is, installed at the position of the second fixed imaging module 24 of FIG. 3). . That is, the horizontal axis (X coordinate) of the position information of the target photographed by the fixed camera at the top and the center is the same. The positional information of the target photographed from the fixed camera at the side and center coincides with the vertical axis (Y coordinate). By using the horizontal axis information on the target position from the fixed camera at the top and the vertical axis information from the side fixed camera, even if there is no fixed camera in the center, location information of the target that has been taken by the fixed camera in the center can be extracted. In addition, when there are many movements of the target from side to side and up and down depending on the characteristics of the target, one of the first fixed imaging module 20 and the second fixed imaging module 24 may be selectively applied.

In this way, the control unit 28 provides position information (( x _s ^h , y _s ^h ), ( x _s ^v , y _s ^v ) with respect to the targets in the images of the first and second

fixed imaging modules

20 and 24. )), The target position information ( x _s ^h , y _s ^v ) in the image of the virtual fixed imaging module coaxial with the rotation imaging module 30 is extracted. Here, ( x _s ^h , y _s ^h ) is positional information of an image plane (see 20a in FIG. 6) scratched in the first fixed imaging module 20. ( x _s ^v , y _s ^v ) is positional information of an image plane (see 24A in FIG. 6) scratched on the second fixed imaging module 24.

The control unit 28 is a horizontal coordinate (X coordinate; x _s ^h ) of the position information of the target photographed by the first fixed imaging module 20 and the vertical coordinate of the position information of the target photographed by the second fixed imaging module 24. (Y coordinates; y _s ^v ) are combined to generate positional information ( x _s ^h , y _s ^v ) of the target of the virtual fixed imaging module. ( x _s ^h , y _s ^v ) is positional information of the target in the image plane (see 28A in FIG. 6) of the virtual fixed imaging module. In FIG. 6, reference numeral K denotes a point where the focal point of the virtual fixed imaging module and the rotation center point of the rotation imaging module 30 coincide with each other. Reference numeral 5 indicates a target.

When the virtual position information ( x _s ^h , y _s ^v ) is generated as described above, the controller 28 controls the pan of the rotation imaging module 30 based on the virtual position information ( x _s ^h , y _s ^v ). ), The angle value of the tilt is controlled (S30).

Thereby, the rotation imaging module 30 is adjusted so that it may exactly face a target. The rotation imaging module 30 enlarges the image to recognize the target and captures a high resolution image (see 30a in FIG. 6) of the monitoring target.

As a result, the manager may easily recognize the face or the clothing worn by the person by analyzing the monitoring object through the image captured by the rotation imaging module 30. On the other hand, the manager can take follow-up measures such as simply extracting the vehicle number if the analyzed monitoring object is a vehicle.

The existing monitoring device (see FIG. 1) does not coincide with the focal point of the fixed camera and the center of rotation of the PTZ camera 14. Accordingly, the targets "a" and "b" photographed at the same image coordinates by the fixed camera correspond to different pan and tilt angle values. In other words, the existing monitoring device has a disadvantage in that the target must be accurately measured when the target is observed at a wide range of distance values from the monitoring camera.

However, in the monitoring apparatus of the first embodiment of the present invention described above, the position of the image photographed by the fixed camera and the pan and tilt angle values of the PTZ camera are matched one-to-one by a coaxial concentric structure. That is, the monitoring apparatus according to the first embodiment of the present invention performs one pan and tilt angle value correction even if many targets exist at different positions, even if they are photographed with the same image coordinates. Therefore, in the first embodiment of the present invention, the PTZ camera can accurately point to the target by a simple calculation regardless of the distance between the target and the camera (or the monitoring device).

FIG. 7 is a diagram for explaining the features of the monitoring device of FIG. 2. In FIG. 7, reference numeral 50 denotes an image plane (image plane) of a virtual fixed camera. 52 denotes images of targets “a” and “b” photographed by a virtual fixed camera. 54 means a PTZ camera.

It is difficult to implement hardware in coaxial concentricity using one fixed camera and one PTZ camera. In the first embodiment of the present invention, a virtual fixed camera image (including a target) having a coaxial concentric relationship with a PTZ camera using two fixed cameras (the first fixed imaging module 20 and the second fixed imaging module 24). ).

Therefore, the imaging surface 50 of the virtual fixed camera of FIG. 7 can be understood as the imaging surface of one fixed camera. Thereby, the embodiment of the present invention coincides the focal point of one fixed camera with the rotation center point of one PTZ camera.

Referring to FIG. 7, it can be seen that the first embodiment of the present invention can match one-to-one the position of an image captured by a virtual fixed camera with a pan and tilt angle value of a PTZ camera by a coaxial concentric structure.

8 is a schematic view illustrating an operation region of the monitoring device of FIG. 2. Reference numeral 42 in FIG. 8 denotes an operation region. The operation region 42 is an intersection portion of the imageable surveillance subject area of the first fixed imaging module 20 and the imageable surveillance subject region of the second fixed imaging module 24. The rotation imaging module 30 is provided in proximity to the first and second

fixed imaging modules

20 and 24 so that the target 5 photographed by the rotation imaging module 30 is located in the operation region 42. In FIG. 8, it is assumed that the target 5 and the camera (that is, the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30) are spaced apart from each other by a predetermined distance.

Here, it is preferable to reduce the separation distance between the first fixed imaging module 20, the second fixed imaging module 24, and the rotation imaging module 30 as much as possible. Thus, the operation region 42 becomes wider, and the target 5 photographed by the rotation imaging module 30 does not leave the operation region 42.

In the conventional monitoring apparatus, as shown in (a) of FIG. 9, as the distance between the camera and the target moves away from the fixed camera image coordinates and the distance where the pan and tilt angle values are corrected, the target image acquired is different. 9 (a) shows that the PTZ camera cannot shoot the target when the distance between the target and the camera is far from the initial correction distance.

The monitoring apparatus according to the first exemplary embodiment of the present invention acquires a high resolution image of the target regardless of the distance between the target and the camera (or the monitoring apparatus) as shown in FIG.

That is, since the monitoring apparatus according to the first embodiment of the present invention implements a coaxial concentric structure, even if the distance between the camera and the target is different from the initial correction distance, the target of the high resolution obtained by the rotation imaging module 30 is changed. There is no distance invariance.

(Second embodiment)

10 is a block diagram of a monitoring apparatus according to a second embodiment of the present invention. 11 to 13 are diagrams showing examples of installation of the fixed imaging module, the rotating imaging module, and the spectroscope of FIG.

The monitoring apparatus according to the second embodiment of the present invention includes a fixed imaging module 61, a rotation imaging module 66, a control module 90, and a spectroscope 72.

The fixed imaging module 61 is provided to face the spectroscope 72. In particular, the fixed imaging module 61 is installed at a position coaxial with the rotary imaging module 66 via the spectroscope 72. In other words, the position of the focus 61a of the fixed imaging module 61 with respect to the spectroscope 72 is made to be symmetrical with the rotation center point 66a of the rotation imaging module 66, and the image axis of the fixed imaging module 61 is fixed. The 85 is fixed to be symmetrical with the rotation axis 86 of the rotation imaging module 66. The fixed imaging module 61 picks up an image of the surveillance subject area reflected by the spectroscope 72. The fixed imaging module 61 is fixed to be imageable in the zoom-out state so as to cover the entire monitoring target region through the spectroscope 72. An example of the fixed imaging module 61 is a fixed camera (also referred to as a "wide camera").

The rotation imaging module 66 picks up the target in the area to be monitored through the spectroscope 72. For example, an example of the rotation imaging module 66 may be a PTZ camera.

The control module 90 generates position information of the target in the image from the fixed imaging module 61. The control module 90 controls the rotation imaging module 66 based on the positional information of the target.

The control module 90 rotates one rotation angle value with respect to the target in the image captured by the fixed imaging module 61 (for example, the distance between the rotation imaging module 66 and the target). To give. Here, one rotation angle value includes at least one or more of the pan, tilt angle value. Of course, the control module 90 may perform zoom control of the rotation imaging module 66. In the second embodiment of the present invention, since it is important to point the rotation imaging module 66 accurately to the target, it does not necessarily include a zoom. However, the size of the target can be confirmed as shown in FIG. Therefore, it is natural that a high magnification image can be obtained by using an appropriate zoom.

The control module 90 includes a position calculator 62 and a controller 64.

The position calculating part 62 calculates the position of the target object in a monitoring object area | region from the image information from the fixed imaging module 61. FIG. The position calculating unit 62 calculates the position of the target in the monitoring target area by using the background subtraction image.

The control part 64 controls (adjusts) the rotation angle (for example, pan and tilt angle values) of the rotation imaging module 66 based on the positional information from the position calculating part 62.

The spectrometer 72 is installed between the fixed imaging module 61 and the rotary imaging module 66. The spectrometer 72 reflects an image of the incident target 65 and transmits the reflected image to the fixed imaging module 61. The spectrometer 72 transmits the image of the target 65 to the rotation imaging module 66. Preferably, the spectrometer 72 is inclinedly installed in the opening of the container 37 of a predetermined form. For example, the spectrometer 72 consists of a flat beam splitter of predetermined thickness.

The container 74 has a receiving space. In order to maximize the light splitting effect, the rotation imaging module 66 is installed in the accommodation space of the container 74. Inner surface of the container 74 in order to maximize the contrast between the inside (ie, the receiving space) and the outside of the container 74 so that the fixed imaging module 61 and the rotating imaging module 66 can obtain a clear image. It is preferable to make the color black. If necessary, the outer surface of the container 74 may also be black.

One fixed camera and one PTZ camera can be used to install one fixed camera and one PTZ camera in order to implement a coaxial concentric structure, but it is difficult to realize such a coaxial concentric structure in hardware.

Accordingly, in the second embodiment of the present invention, a spectrometer 72 is disposed between the fixed imaging module 61 and the rotary imaging module 66, so that the coaxial concentric structure can be installed without installing the two

modules

61 and 66 in hardware. Realized. That is, in order to realize the coaxial concentric structure, the rotary imaging module 66 and the fixed imaging module 61 are provided so as to be symmetrical with respect to the surface of the spectroscope 62. In other words, the angle θ1 formed by the direction axis 82 and the spectroscope 72 of the initial rotation imaging module 66 with the pan and tilt angle values set to 0, and the direction axis of the fixed imaging module 61 ( The angle θ2 formed by the 80 and the spectrometer 72 is made equal to each other. The line 83 connecting the rotation center point 66a of the rotation imaging module 66 and the focal point 61a of the fixed imaging module 61 is perpendicular to the plane of the spectrometer 72.

As a result, no matter where the target 65 is located within the area to be monitored, the angle θ3 formed with the spectrometer 72 by rotating (pan, tilting) the rotating imaging module 66 toward the target 65 is obtained. The image of the target 65 is always the same as the straight line 84 that is refracted by the spectroscope 72 and reaches the focus 61a of the fixed imaging module 61 and the angle θ4 formed with the spectroscope 72. Thereby, the fixed imaging module 61 and the rotation scratch module 66 always operate coaxially concentrically.

14 is a view for explaining the features of the monitoring apparatus according to the second embodiment of the present invention. In Fig. 14, reference numeral 50 denotes an image plane (image plane) of the fixed image pickup module 61, and reference numeral 52 denotes an image of targets "a" and "b" captured by the fixed image pickup module 61.

In the second embodiment of the present invention, the fixed imaging module 61 and the rotation scratch module 66 have a coaxial concentric structure by using the spectroscope 72. This means that the targets a and b captured by the same coordinates in the fixed imaging module 61 correspond to the same pan and tilt angle values regardless of the distance between the camera and the target. As a result, the rotation imaging module 66 can accurately point the target.

In the above description, the control module 90 is configured separately from the rotation imaging module 66. However, the control module 90 may be provided inside the rotation imaging module 66 as necessary. Even if the description of the configuration for this case is not separately, those who are engaged in the same industry will be fully understood by the above description.

Next, the operation of the monitoring apparatus according to the second embodiment of the present invention will be described with reference to the flowchart of FIG. 15.

The fixed imaging module 61 picks up an image of the surveillance target region reflected by the spectroscope 72 (that is, an image including a target in the surveillance target region) (S100). The fixed imaging module 61 transmits the captured image to the control module 90.

The control module 90 calculates the position of the target in the monitoring target area from the image information from the fixed imaging module 61 (S200). The position calculating part 62 in the control module 90 performs a position calculation. If the target is detected, the position calculator 62 calculates the position of the target and transmits the calculated position data of the target to the controller 64. The position calculation process in the position calculation unit 62 will be described in more detail as follows. The position calculating unit 62 calculates the position of the target in the area to be monitored using the background difference image. That is, the position calculating unit 62 uses the pre-photographed background image (see FIG. 5 (a)) and the input image (see FIG. 5 (b)) to target the region of the target (see FIG. 5 (c)). Obtain In other words, the position calculating unit 62 determines the difference of the pixel unit between the background image (see FIG. 5A) and the image transmitted from the fixed imaging module 61 (see FIG. 5B). Obtain The position calculating unit 62 knows the presence or absence of the target of the surveillance target region and the region of the intrusion target through the difference for each pixel unit. For example, suppose the target is a person. Since most people stand and move, the center point of the uppermost block can be regarded as the image coordinate of the target's face by dividing the height approximately 7 times in the region of the target (FIG. 5 (c)) obtained by the background difference image. Therefore, the position calculator 62 transmits the image coordinates of the face of the target as the position data to the controller 64.

Thereafter, the controller 64 controls (adjusts) the pan and tilt angle values of the rotation imaging module 66 based on the input position data (that is, image coordinates of the face of the target). The pan and tilt angle adjustments of the control unit 64 match the direction data of the rotation imaging module 66 with the position in the image captured by the fixed imaging module 61 to adjust a specific position of the corresponding image. May be determined, and the direction data of the rotation imaging module 66 matched thereto may be inverted. This is possible because the coaxial concentric structure matches the position of the image photographed by the fixed imaging module 61 and the pan and tilt angle values of the rotation imaging module 66 one-to-one regardless of the distance to the target.

The pan and tilt angle values in the control unit 64 are transmitted to the rotation imaging module 66.

The rotation imaging module 66 rotates based on the pan and tilt angle values from the control unit 64 so as to accurately face the target (S400). The rotation imaging module 66 enlarges the image to recognize the target and captures a high resolution image of the monitoring target.

As a result, the manager can easily recognize the face or clothing worn by the person by analyzing the monitored object through the image captured by the rotation imaging module 66. On the other hand, the manager can take follow-up measures such as simply extracting the vehicle number if the analyzed monitoring object is a vehicle.

On the other hand, the present invention is not limited only to the above-described embodiments can be carried out by modifying and modifying within the scope not departing from the gist of the present invention, the technical idea that such modifications and variations are also within the scope of the claims Must see

Claims

A rotation imaging module for imaging an object in the area to be monitored;

A first fixed imaging module provided in the longitudinal direction with respect to the rotation imaging module and configured to image the surveillance target region;

A second fixed imaging module installed in the transverse direction with respect to the rotation imaging module and configured to image the surveillance target area; And

Generating position information of a target of the virtual fixed imaging module whose position of the focal point coincides with the rotation center point of the rotating imaging module based on the image information including the targets from the first and second fixed imaging modules; And a control module for controlling the rotation imaging module based on virtual position information.
The method according to claim 1,

And said first fixed imaging module, said second fixed imaging module and said rotational imaging module are parallel to each other.
The method according to claim 1,

And the control module provides one rotation angle value to the rotation imaging module regardless of the distance to the target.
The method according to claim 3,

And said one rotation angle value comprises at least one of a pan and a tilt angle value.
The method according to claim 1,

The control module,

A position calculating unit that calculates a position of a target in the area to be monitored from image information from the first and second fixed imaging modules; And

Based on the position information from the position calculating unit, the position information of the target of the virtual fixed imaging module in which the position of the center of rotation and the focal point of the rotation imaging module coincide with each other is generated and based on the virtual position information of the rotation imaging module. And a control unit for controlling the rotation angle.
The method according to claim 5,

The position calculation unit,

A first position calculator for calculating a position of a target in the surveillance region from the image information from the first fixed imaging module; And

And a second position calculator configured to calculate a position of a target in the surveillance target area from the image information from the second fixed imaging module.
The method according to claim 5,

And the position calculator calculates a position of a target in the surveillance target area using a background difference image.
The method according to claim 5,

The controller is configured to combine the horizontal coordinates of the positional information of the target in the monitored area photographed by the first fixed imaging module with the vertical coordinates of the positional information of the target in the monitored area photographed by the second fixed imaging module. Surveillance apparatus for generating virtual location information.
A monitoring method of a monitoring apparatus including a rotational imaging module for imaging a target in a surveillance target area, first and second fixed imaging modules for imaging the surveillance target area, and a control module,

The position information of the target of the virtual fixed imaging module in which the control module coincides with the rotation center point of the rotary imaging module and the focus position based on the image information including the targets from the first and second fixed imaging modules. Generating a; And

And controlling, by the control module, the rotation imaging module based on the virtual positional information.
The method according to claim 9,

The virtual position information generating step may include a horizontal coordinate of position information of the target object in the surveillance target area photographed by the first fixed imaging module and a vertical position of position information of the target object in the surveillance target area photographed by the second fixed imaging module. And combining coordinates to generate the virtual location information.
The method according to claim 9,

The virtual location information generation step,

Calculating a position of a target in the area to be monitored in the image information from the first and second fixed imaging modules; And

And generating position information of a target of the virtual fixed imaging module whose position of focus and the rotation center point of the rotation imaging module coincide based on the position information from the position calculating step.
The method according to claim 11,

And the position calculating step calculates a position of a target in the area to be monitored using a background difference image.
The method according to claim 9,

And wherein the controlling of the rotation imaging module provides one rotation angle value to the rotation imaging module irrespective of the distance to the target.
The method according to claim 13,

And said one rotation angle value comprises at least one of pan and tilt angle values.
The method according to claim 9,

And the first fixed imaging module is installed in a longitudinal direction with respect to the rotary imaging module, and the second fixed imaging module is installed in a horizontal direction with respect to the rotary imaging module.
The method according to claim 9,

And said first fixed imaging module, said second fixed imaging module, and said rotary imaging module are each axial axes parallel to each other.
First and second fixed imaging modules configured to capture an area to be monitored; And

A rotational imaging module installed in the longitudinal direction with respect to the first fixed imaging module and installed in the horizontal direction with respect to the second fixed imaging module, for imaging a target in the area to be monitored;

The rotation imaging module is a position of a target of the virtual fixed imaging module whose position of the focal point coincides with the rotation center point of the rotation imaging module based on the image information including the targets from the first and second fixed imaging modules. And a control module for generating information and controlling rotation of the rotation imaging module based on the virtual positional information.
The method according to claim 17,

And the control module provides one rotation angle value to the rotation imaging module regardless of the distance to the target.
The method according to claim 17,

The control module,

A position calculating unit that calculates a position of a target in the area to be monitored from image information from the first and second fixed imaging modules; And

Based on the position information from the position calculating unit, the position information of the target of the virtual fixed imaging module in which the position of the center of rotation and the focal point of the rotation imaging module coincide with each other is generated and based on the virtual position information of the rotation imaging module. And a control unit for controlling the rotation angle.
The method according to claim 19,

The controller is configured to combine the horizontal coordinates of the positional information of the target in the monitored area photographed by the first fixed imaging module with the vertical coordinates of the positional information of the target in the monitored area photographed by the second fixed imaging module. Surveillance apparatus for generating virtual location information.