KR101851539B1 - Monitoring system using a drone - Google Patents

Abstract

The present invention relates to a surveillance system using a drone to obtain a detailed image of a region where an event has occurred. The system comprises: a surveillance camera part photographing and transmitting an image of a surveillance region in real time; an image analyzing part analyzing the image of the surveillance region collected from the surveillance camera part to determine whether an event has occurred; at least one on-site surveillance drone dispatched to the surveillance region in accordance with presence of the event to photograph a detailed image of the surveillance region and transmit the photographed image to the image analyzing part; and a drone control part controlling a moving route and a status of whether the on-site surveillance drone is dispatched.

Description

{MONITORING SYSTEM USING A DRONE}

The present invention relates to a surveillance system using a drone, and more particularly, to a system for acquiring detailed images of an event occurrence area through a drone dispatch when an event situation is received from a surveillance camera.

Conventional surveillance systems have a problem in that they can not perform a high-performance vision algorithm because a camera is fixed and a blind spot is generated, and a large number of cameras have almost no computation ability other than image transmission.

Korean Unexamined Patent Publication No. 10-2015-0100589 (May 2015, 09.02) discloses a configuration in which an unmanned robot dron can be dispatched when an emergency situation occurs so that a situation can be maintained and tracked, thereby overcoming the disadvantages of the conventional fixed type surveillance camera And how to do it.

However, in the conventional system, the recognition of the emergency situation still depends on the monitor personnel.

Patent Document 1: Korean Patent Publication No. 10-2017-0070713 [Surveillance System Using Drone] Patent Document 2: Korean Unexamined Patent Application No. 10-1756603 [Unmanned Guard System Using Drone]

An object of the present invention is to provide a system for securing a detailed image of an event occurrence area through dispatch of a drones upon receipt of an event situation from a surveillance camera.

According to an aspect of the present invention, there is provided a surveillance system using a drone, the surveillance system comprising: a surveillance camera unit for capturing and transmitting surveillance region images in real time; An image analyzer for analyzing the surveillance region image collected from the surveillance camera unit and determining whether the surveillance region image is an event; At least one on-site monitoring drones dispatched to the surveillance area in accordance with the presence or absence of the event to capture a detailed image of the surveillance area and transmit the captured image to the image analyzer; And a dron controller for controlling whether or not the on-site monitoring drones are dispatched and a movement route.

At this time, the surveillance camera unit may include at least one fixed camera in the monitoring area, and the fixed camera may be connected to the image analysis unit through a local area network (LAN).

At this time, the image analyzing unit may perform the determination of the event based on the instantaneous change of the data of the surveillance region image received.

Further, the drones control unit may include: a hangar for receiving the site monitoring drones; A route DB storing coordinates of the surveillance area and a flight path from the hangar to the surveillance area; And a communication module for performing communication for transmission of the detailed image photographed by the site monitoring drones and control of the site monitoring drones.

The surveillance camera unit may include at least one access point disposed adjacent to the fixed camera and connected to the local area network.

In addition, the on-site monitoring drones may receive the flight path from the hangar to the surveillance area from the route DB when moving, move along the received flight path, and when the movement to the surveillance area is completed, And transmits the detailed image to the image analysis unit.

In addition, the arrival position of the flight path may be a position at which the angle of photographing of the image photographed by the drone is the same as the angle of view of the image of the monitoring area photographed by the fixed camera.

According to the monitoring system using the drones according to the present invention,

First, since the site monitoring drones are dispatched when an event occurs in the surveillance area, it is possible to acquire detailed images closer to the site.

Second, since the surveillance camera unit has an access point, and the field surveillance drones are connected to the access point rather than directly communicating with the drones and the drones control unit, detailed video images of the surveillance area are transmitted. .

Third, the arrival position of the flight path is a position at which the angle of view of the image photographed by the drone is the same as the angle of view of the image of the surveillance region photographed by the fixed camera. Therefore, It is possible to perform dron control more effectively.

1 is a block diagram of a monitoring system using a drones according to the present invention.
2 is a schematic diagram for explaining the dispatch of drones upon occurrence of an event.
3 is a flowchart illustrating a process of transmitting a detailed image of a surveillance area through a surveillance drones access point of a surveillance camera unit.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference symbols as possible. Further, the detailed description of known functions and configurations that may obscure the gist of the present invention will be omitted. For the same reason, some of the components in the drawings are exaggerated, omitted, or schematically illustrated.

FIG. 1 is a block diagram of a surveillance system using a dron according to the present invention. FIG. 2 is a schematic diagram illustrating the dispatch of drones when an event occurs. FIG.

1 to 3, a monitoring system 1000 using a dron according to the present invention includes a surveillance camera unit 100, an image analysis unit 200, a site monitoring drones 300, and a drones control unit 400 .

The surveillance camera unit 100 captures surveillance area images in real time and transmits them.

The surveillance camera unit 100 includes at least one fixed camera 110 disposed in an area to be monitored.

In the illustrated example, the surveillance camera unit 100 includes one fixed camera 110. However, this is for convenience of explanation, and in consideration of a photographing angle of view of the camera, It can be placed in the area you want to monitor.

In addition, one monitoring system 1000 may include a plurality of surveillance camera units 100. That is, a plurality of surveillance camera units 100 may be provided in the surveillance system 1000 to monitor a plurality of surveillance areas.

According to the drawings, the monitoring system 1000 monitors forest fires, but is merely an example of monitoring. Therefore, the present invention is not limited to monitoring forest fires. It can be applied to the monitoring of objects.

The 'fixed' of the fixed camera 110 is meant to be compared with the on-site monitoring drones 300, which is another movable structure of the present invention, and is meant to be fixedly disposed in one place,

That is, according to the embodiment, the fixed camera 110 may be a PTZ (pan tilt zoom) camera including a function of a pan, a tilt zoom, and the like.

The surveillance region image photographed by the fixed camera 110 is transmitted to the image analysis unit 200. At this time, the transmission of the image may be performed through a dedicated closed circuit interposed between the fixed camera 110 and the image analysis unit 200.

Alternatively, a wire local area network (LAN) may be installed between the fixed camera 110 and the image analysis unit 200 to perform image transmission. That is, the fixed camera 110 may be implemented by an IP camera according to the embodiment.

Meanwhile, the connection between the fixed camera 110 and the image analysis unit 200 may be connected to a Virtual Private Network (VPN).

When it is difficult to directly connect the wired network between the fixed camera 110 and the image analysis unit 200 due to cost or maintenance problems when the fixed camera 110 is implemented by the IP camera, And the image analysis unit 200 may be connected through a VPN.

The image analysis unit 200 analyzes the surveillance region image collected from the surveillance camera unit 100 to determine whether the event is an event.

The image analysis unit 200 includes an event detection module 210 and a video output module 200. And may further include a DVR (Digital Video Recorder) that stores surveillance region images as needed.

The event detection module 210 analyzes the surveillance region image captured and received from the fixed camera 110 to detect whether an event has occurred.

The 'event' used in the present invention means that a motion has occurred in an area to be monitored. That is, when the surveillance system 1000 is used for the purpose of building expense, an event occurs when an intruder moves on a photographed image.

That is, the determination as to whether or not an event occurs is made by recognizing a situation in which a motion occurs in an image in which the same screen is repeated in the surveillance region image. The determination of the event of an image may be made by analyzing the image in units of frames and comparing changes in similarity between one frame and the next frame.

Since the load of the image analysis server increases in proportion to the number of the fixed cameras 110 in the frame-by-frame analysis, in the present invention, the event detection module 210 detects an event ≪ / RTI >

The surveillance region image photographed by the fixed camera 110 is compressed by the image compression codec and transmitted in a streaming manner. The event detection module 210 checks the streaming bandwidth of the surveillance area image received from each fixed camera 110. When an instantaneous change occurs in the streaming bandwidth, the event detection module 210 analyzes the image frame by frame, It is possible to judge whether the event is an event by comparing the change.

Alternatively, if an instantaneous change occurs in the streaming bandwidth, a screen informing the occurrence of an event may be displayed on the display unit 500 so that the monitoring agent can recognize the event.

The video output module 220 is an interface module that combines the respective surveillance region images received from the fixed cameras 110 and outputs them to a display unit or a display unit 500 including a plurality of display screens.

The field surveillance drones 300 are dispatched to the surveillance area along the flight path set in accordance with the event detection, and photographs the detailed images of the surveillance area and transmits them to the image analysis unit 200.

The field surveillance drones 300 for capturing and transmitting images include a photographing camera and a communication module. Also, it includes a positioning function through GPS (Global Positioning System) for movement according to a preset flight path.

The drones control unit 400 controls the movement of the field monitoring drones 300 and the movement route and includes a hangar 410, a route DB 420, a communication module 430 and a manual control module 440 .

The hangar 410 receives the site monitoring drones 300 in a waiting state. The hangar 410 is a typical site for explaining the hangar 410. The hangar 410 is used to detect the location of the hangar 410, It can be simply performed in the form of a charging dock for charging the drones 300.

The route DB 420 is a database for storing the coordinates of the surveillance area and the flight path from the hangar 410 to the surveillance area.

The field monitoring drones 300 receive the flight path from the route DB 420 to the surveillance area where the event occurs, upon dispatch according to the event detection, and then dispatch.

When the on-site monitoring drones 300 have sufficient flight path storage space, the on-site monitoring drones 300 wait for all the flight paths to the respective monitoring areas and store the identification information And perform the movement through the built-in flight path.

At this time, the movement of the field monitoring drones 300 to the monitoring area where the event occurs can be performed by automatic guided flight through GPS position confirmation.

On the other hand, the flight path from the hangar 410 to the surveillance area can be appropriately changed according to the weather environment. Since the field monitoring drones 300 are driven by a battery, a path that can reduce the battery usage depending on the weather environment, especially the wind direction, can be adopted.

The route DB 420 stores various flight paths according to the wind direction for the same surveillance area and can use the battery in the field surveillance drones 300 on the basis of the directly measured wind direction information or the wind direction information received from the weather station The flight path can be transmitted.

That is, since the flight path from the hangar 410 to the surveillance area stores not only the shortest straight line, but also a plurality of flight paths capable of using the longest battery according to the wind direction and the wind speed, And the field surveillance drones 300 can select an appropriate flight path to move according to the wind direction information.

The communication module 430 is a module that communicates with the site monitoring drones 300 for the transmission of images photographed by the site monitoring drones 300 and the control of the site monitoring drones 300 .

The communication module 430 may be connected to a communication module provided in the field monitoring drones 300 through a direct communication system (for example, ISM (Industrial Scientific and Medical), connection using a band) For example, 3G or LTE).

That is, the drones control unit 400 may be directly connected to the field monitoring drones 300 using the ISM band, or they may be connected through a commercial 3G or LTE network.

At this time, when the distance between the drone control unit 400 and the on-site monitoring drones 300 that are dispatched in the event occurrence monitoring area is long, due to the limitation of the direct communication distance of the ISM band and the weak crosstalk characteristics of the ISM band, The transmission of the detailed image may be restricted. In addition, when the connection between the drones control unit 400 and the site monitoring drones 300 is performed through the 3G or LTE network, there may arise a problem of charges for the commercial network.

The surveillance camera unit 100 includes an access point 110 which is disposed adjacent to the fixed camera 110 and is connected to a local area network (LAN) connected to the fixed camera 110 to overcome the limitation of transmission of the detailed image of the surveillance area, ).

When the site monitoring drones 300 are moved to the monitoring area, the site monitoring drones 300 perform a connection with the access points 110 to detect the location of the monitoring sites To the image analysis unit 200 through a local area network (LAN).

Preferably, the arrival position of the flight path is a position at which the angle of view of the image photographed by the field surveillance drones 300 is the same as the angle of view of the image of the surveillance region photographed by the fixed camera 110.

The manual control module 440 is a module for controlling the movement of the field monitoring drones 300 according to the monitor personnel when the field monitoring drones 300 arrive at the monitoring area in which the event occurs, (For example, a joystick type interface) in a system control console (not shown) of the system control console (not shown), and may be operated through a normal interface (for example, a keyboard and a mouse) Lt; RTI ID = 0.0 > interface. ≪ / RTI >

When the field surveillance drones 300 are dispatched to the surveillance area according to the event event and a connection with the access point 110 is performed,

The video output module 220 converts an image of the surveillance region output to the display unit 500 from the image received from the fixed camera 110 to the detailed image of the surveillance region captured and collected by the surveillance drones 300 do.

According to this embodiment, the monitor agent can continuously check the detailed image photographed by the field monitoring drones 300 from the image by the fixed camera 110, so that the drones can be controlled more effectively.

3 is a flowchart illustrating a process of transmitting a detailed image of a surveillance area through a surveillance drones access point of a surveillance camera unit.

In step S100, the surveillance camera unit 100 captures an image of the surveillance area through the fixed camera 110 and transmits the surveillance image to the image analysis unit 200 in real time.

In step S200, the image analysis unit 200 analyzes the shape of the received surveillance area to analyze whether or not an event occurs in the surveillance area. When the event detection module 210 detects the occurrence of an event, it transmits the detection status to the drone control unit 400.

In step S300, the drone control unit 400 inputs the flight path to the monitoring area where the event occurs to the site monitoring drones 300. [

In step S400, the field surveillance drones 300 complete the movement to the surveillance area along the input flight path. Movement to the surveillance area can be performed by automatically guiding the movement of the surveillance drones 300 to the surveillance area where the event occurs, by confirming the GPS position.

In step S500, the site monitoring drones 300 that have completed the movement to the monitoring area attempt to access the access point 110 located in the monitoring area. When the connection with the access point 110 is performed, the field surveillance drones 300 transmit the detailed image of the surveillance area to the image analysis unit 200 through the local area network (LAN) in step S600.

If the connection with the access point 110 fails, the detailed image of the surveillance area is transmitted through the communication module 430 provided in the drone control unit 400.

The video transmission method of FIG. 3 corresponds to the case where the monitoring system 1000 using the drone described in FIGS. 1 and 2 is implemented in a time-series manner. Therefore, the video camera 100, the video analysis unit 200, (300) and the drone control unit (400) are applied to the present embodiment as they are, the repeated description will be omitted.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

1000: Surveillance system using drone
100: surveillance camera part
200: Image analysis section
300: Field Surveillance Drones
400: Drone control unit

Claims (7)

As a monitoring system using a drone,
A surveillance camera unit that captures and transmits surveillance area images in real time;
An image analyzer for analyzing the surveillance region image collected from the surveillance camera unit and determining whether the surveillance region image is an event;
At least one on-site monitoring drones dispatched to the surveillance area in accordance with the presence or absence of the event to capture a detailed image of the surveillance area and transmit the captured image to the image analyzer; And
And a dron controller for controlling the dispatch and movement path of the field monitoring drones,
The surveillance camera unit,
Wherein the layout in the surveillance area includes at least one fixed camera,
The fixed camera is connected to the image analysis unit through a local area network (LAN)
Wherein the image analyzing unit comprises:
Based on the instantaneous change of the data of the surveillance region image received,
The drone control unit,
A hangar for receiving the site monitoring drones;
A route DB storing coordinates of the surveillance area and a flight path from the hangar to the surveillance area; And
And a communication module for performing communication for transmission of the detailed image photographed by the site monitoring drones and control of the site monitoring drones,
In the route DB,
Wherein a plurality of flight paths corresponding to the wind direction are stored for the same monitoring area and a flight path capable of optimally using the battery is transmitted to the field monitoring drones based on the wind direction information. delete delete delete The method according to claim 1,
The surveillance camera unit,
And at least one access point disposed adjacent to the fixed camera and connected to the local area network. The method of claim 5,
The on-
Receives the flight path from the hangar to the surveillance area from the route DB, moves along the received flight path,
And when the movement to the surveillance area is completed, transmits the detailed image photographed through connection with the access point to the image analysis unit. The method of claim 6,
Wherein the arrival position of the flight path
Wherein the shooting angle of the image photographed by the drone is the same as the angle of view of the image of the monitoring area captured by the fixed camera.

Images