KR101698500B1 - System for monitoring surveillance object using intelligent security camera - Google Patents

Abstract

According to the present invention, disclosed are a system and a method to analyze a monitoring image by using a beacon and an intelligent surveillance camera. The system comprises: a sensor tag attached or worn on an object to be monitored, and sensing environment information around the object to be monitored to generate sensing data; an intelligent surveillance camera collecting the sensing data, and identification (ID) information and location information of the sensing tag from the sensor tag located within the communication coverage, capturing a predetermined region including the object to be monitored to generate a surveillance image, discriminating an object corresponding to the object to be monitored from one or more objects included in the surveillance image based on the ID and location information of the sensor tag, and analyzing a variance trend of the sensing data for the object classified as the object to be monitored in accordance with an operation mode set by a control signal to determine occurrence of an event; and a manager terminal to transmit the control signal for controlling the operation mode to the intelligent surveillance camera, to output the surveillance image received from the intelligent surveillance camera as video information, and to transfer a notification message to a predetermined terminal when the occurrence of an event is determined.

Description

TECHNICAL FIELD [0001] The present invention relates to a surveillance system using an intelligent surveillance camera,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a surveillance system using an intelligent surveillance camera, and more particularly, to a surveillance system using an intelligent surveillance camera for analyzing images of a surveillance target by using a wireless communication device such as a sensor tag and an intelligent surveillance camera .

Conventional general CCTV cameras have only taken the function of capturing a certain area and transmitting the image. In recent years, with the development of the related technology, an intelligent image analysis system has been developed and an analysis task such as classification of objects in photographed images It became possible.

The existing object analysis function is a technology that automatically detects an action using image information, and consists of a background region separation step, an object identification step, and an object tracking step as shown in the following figure.

The background region separation step is a process of detecting an active object by separating the foreground region and the background region of interest from the input image. In the initial stage, a method of calculating brightness difference between the current image and the previous image is used .

However, in recent years, there have been many methods of delineating the background information by using a Gaussian or Gaussian Mixture Model (GMM), and then distinguishing the foreground and background regions.

The object identification step is a process of distinguishing whether a detected object is a human or an object among the objects judged as a foreground area in the background area. Currently, the intelligent image analysis technique mainly distinguishes a person (one person, a group), an animal, and an object.

Object tracking is a process of finding the movement path of an identified object in successive images. It is based on various algorithms such as Kalman filter, particle filter, CAMSHIFT (Continuously Adaptive Mean Shift) Algorithm is used.

Since the conventional intelligent image analysis system can perform only the function of distinguishing objects from a photographed image and detecting a simple specific pattern, it is possible to perform only counting of the number of entrances, Such as the ability to identify a person as a person, a function to capture a person, or a person who actually enters or exits through a route.

Korean Patent No. 10-1492059 Korean Patent Publication No. 10-2016-0100723

One aspect of the present invention relates to a surveillance image analysis system using beacons and intelligent surveillance cameras capable of performing enhanced image analysis by combining information collected using beacons attached to a surveillance object and information obtained through image analysis of an intelligent surveillance camera, ≪ / RTI >

The technical problem of the present invention is not limited to the technical problems mentioned above, and other technical problems which are not mentioned can be understood by those skilled in the art from the following description.

The monitoring image analyzing system using the beacon and the intelligent surveillance camera according to an embodiment of the present invention generates sensing data for the monitored object attached or worn to the monitored object and periodically transmits the signal including the sensed data A sensor tag provided in the monitoring target, registering the sensor tag through a pairing process, receiving the sensing data and the identification information of the sensor tag from the paired sensor tag, A mobile terminal for communicating with at least one wireless AP which is fixedly arranged to calculate positional information, data for collecting the sensing data, the identification information of the sensor tag, and the data including the positional information from the mobile terminal, And generates the surveillance image using the identifier information and the positional information, An intelligent surveillance camera for distinguishing an object corresponding to the surveillance object from one object and determining whether an event of the object classified as the surveillance target is generated in accordance with the set operation mode and an intelligent surveillance camera for controlling the operation mode with the intelligent surveillance camera And an administrator terminal for transmitting the control signal and outputting the monitoring watermark received from the intelligent monitoring camera as image information.

The intelligent surveillance camera extracts an object included in the surveillance image and a positional coordinate of the object, and if the positional coordinate of the object matches the positional information, the intelligent surveillance camera can determine the object as a surveillance object to which the sensor tag is attached have.

Wherein the manager terminal generates matching information by matching the identification information of the mobile terminal and the identification information of the sensor tag when it is confirmed that the mobile terminal and the sensor tag are paired, registers the matching information in the approval list Updating the approval list, transmitting the updated approval list to the intelligent surveillance camera, and when the intelligent surveillance camera receives the data from the mobile terminal, It is possible to confirm whether or not it is an authorized mobile terminal.

Wherein the intelligent monitoring camera determines that the data is received from the mobile terminal included in the approval list, the mobile terminal determines that the mobile terminal is the mobile terminal permitted by the administrator terminal and stores the data, Is not received from another mobile terminal not included in the approval list, the other mobile terminal determines that the mobile terminal is not a mobile terminal that is not permitted by the manager terminal, ignores the data, It can be judged by the sensor tag that has been detected.

The intelligent surveillance camera can classify the object corresponding to the other mobile terminal paired with the sensor tag determined to be stolen or lost as an additional monitoring target.

The mobile terminal counts a time when the connection is interrupted when the pairing connection with the sensor tag is interrupted and transmits a notification signal to the administrator terminal when the time when the connection is interrupted exceeds a preset reference time, Upon receiving the notification signal, delete the matching information from the approval list.

The mobile terminal may transmit the data to the mobile communication network when it is determined that the intelligent surveillance camera does not exist within the communication radius of the short range wireless communication.

If the intelligent surveillance camera is operated in the first operation mode for detecting whether the surveillance target is located within the surveillance area, the intelligent surveillance camera determines that the surveillance surveillance camera is in a normal state when the surveillance target object is detected If it is determined that the object to be monitored is not detected in the surveillance video and that the data is received through the short range wireless communication, it is determined that the surveillance state is in the state of caution, If it is confirmed that the data is received through the mobile communication network, it can be determined as a warning state.

When the intelligent surveillance camera is operated in a second operation mode in which the surveillance object senses an event of entering / exiting the surveillance area, if the intelligent surveillance camera detects that the object classified as the surveillance target appears in the surveillance area, It can be determined that a disconnection event has occurred when it is detected that the object classified as the object to be monitored has disappeared in the surveillance area.

If it is determined that the radius of the wireless AP is out of the radius of the wireless AP, the mobile terminal can calculate the location information using GPS information.

The administrator terminal can display each of the objects included in the supervisory image and the sensing data corresponding to the respective objects by the identification information of the sensor tag in the output image information.

The administrator terminal may convert a part or all of the objects classified as the monitoring target into a previously stored image and display the converted image.

According to an aspect of the present invention, an object to be monitored can be easily identified in a monitoring image using a sensor tag attached to the object to be monitored. .

FIG. 1 is a diagram showing a schematic configuration of a monitoring image analysis system using beacons and an intelligent surveillance camera according to an embodiment of the present invention.
Fig. 2 is a block diagram showing a specific configuration of the intelligent surveillance camera of Fig. 1;
FIG. 3 is a diagram showing a specific function of the administrator terminal of FIG. 1. FIG.
FIG. 4 is a diagram illustrating an example of a method of transmitting and receiving data through pairing of the sensor tag mobile terminal of FIG. 1;
5 is a diagram showing an example of a communication method between the mobile terminal and the intelligent surveillance camera of FIG.
6 is a diagram showing another example of a communication method between the mobile terminal and the intelligent surveillance camera of FIG.
7 is a flowchart illustrating a method of analyzing a surveillance image using a beacon and an intelligent surveillance camera according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

FIG. 1 is a diagram showing a schematic configuration of a monitoring image analysis system 1000 using a beacon and an intelligent surveillance camera according to an embodiment of the present invention.

The monitoring image analysis system 1000 using the beacon and the intelligent surveillance camera according to the present embodiment is provided with the sensor tag 10, the wireless AP 20, the mobile terminal 30, the intelligent surveillance camera 40, .

The sensor tag 10 is an electronic device attached to or worn on an object to be monitored. The object to be monitored is an object to be monitored by the administrator through the intelligent surveillance camera 40, and does not limit the kinds of people, animals, objects, and the like. The sensor tag 10 can transmit and receive data using short-range wireless communication. The short-range wireless communication used by the sensor tag 10 may be any one of various well-known short-range wireless communications such as Bluetooth, Zigbee, RFID, Wi-Fi, and UWB. Hereinafter, for convenience of description, a short range wireless communication method will be described as a Bluetooth method. However, the present invention is not limited to the short-range wireless communication mode Bluetooth, and it is needless to say that various short-range wireless communication techniques can be applied as described above.

The sensor tag 10 may have unique identification information for distinguishing itself from other sensor tags. The identification information may be a manufacturing number given at the time of manufacture or an identification symbol arbitrarily set by the manager.

Also, the sensor tag 10 may be provided with a sensor module. The sensor module can sense the monitoring target or the surrounding environment of the monitoring target, and can generate sensing data as a result. One example of the sensing data for the monitored object may be body temperature, acceleration, pulse, activity (movement) amount, and the sensing data for the monitored environment may include temperature, humidity, smoke, The sensing data is not limited to these. The type and number of the sensor module included in the sensor tag can be variously adopted depending on the use environment. The sensor tag 10 may periodically transmit a signal including sensing data and an identifier of the sensor tag 10. [

A wireless AP (Access Point) 20 is at least one signal transmitting device fixedly arranged around the monitored object. The wireless AP 20 can periodically transmit a beacon signal for communication. The wireless AP 20 can transmit the beacon signal including information about its own position or its position together with its identification information.

The mobile terminal 30 may be a device carried by the monitoring target or attached to the monitoring target. The mobile terminal 30 may be in the form of a smart phone, a wearable device, a notebook computer, a tablet PC, or the like.

The mobile terminal 30 can calculate position information by communicating with the wireless AP 20 located within the communication radius. More specifically, the mobile terminal 30 can receive a signal periodically transmitted from the wireless AP 20. At this time, the mobile terminal 30 can calculate its own location information using the strength of a signal received from different wireless APs 20 and the location of the wireless AP 20. [ A specific technique for calculating the location information of the sensor tag 10 is a well-known technology in a real-time locating system (RTLS) using a beacon, and a detailed description thereof will be omitted.

The mobile terminal 30 can communicate with the sensor tag 10 and receive the sensing data and the identification information of the sensor tag 10 from the sensor tag 10. [ The mobile terminal 30 may perform a pairing process with the sensor tag 10 to perform communication via short-range wireless communication with the sensor tag 10. The mobile terminal 30 can receive the sensing data and the identification information of the sensor tag 10 periodically from the paired sensor tags 10 when the sensor tag 10 is registered through the pairing. The specific function of the mobile terminal 30 through the pairing with the sensor tag 10 will be described later with reference to FIGS.

The intelligent surveillance camera 40 is a device having communication means and information processing means in a conventional surveillance camera device. That is, the intelligent surveillance camera 40 according to the present invention can basically capture a surveillance area and generate a surveillance image.

At the same time, the intelligent surveillance camera 40 further performs a function of receiving the sensing data, the location information, and the identification information of the sensor tag 10 from the mobile terminal 30 and transmitting it to the manager terminal 50 to be described later .

Further, the operation mode of the intelligent surveillance camera 40 can be changed according to the control signal received from the administrator terminal 50. [ The operation mode is a mode for controlling the method of monitoring the monitored object. The intelligent surveillance camera 40 can determine whether an event to be monitored is generated according to the operation mode. For example, when the access control mode is activated, the intelligent surveillance camera 40 can monitor an event that a monitored object worn by the sensor tag 10 enters or exits the surveillance zone. As another example, when the trespasser monitoring mode is activated, an object is extracted from the photographed image, and an object to which the sensor tag 10 is not attached or an object to which the unregistered sensor tag 10 is attached enters the monitoring area Can be determined. As another example, when the anti-theft mode is activated, it can be determined whether or not a monitored object such as a noble metal leaves the monitored zone. It is needless to say that the operation mode is not limited to the above-described example, and may be variously set according to the user environment including other embodiments to be described later.

In this manner, the intelligent surveillance camera 40 can monitor the monitored object and determine whether an event is generated according to the operation mode. The specific configuration and function of the intelligent surveillance camera 40 will be described later with reference to Fig.

The administrator terminal 50 is a terminal provided at the manager side for monitoring or managing the monitoring target. For this purpose, the administrator terminal 50 can receive the surveillance video from the intelligent surveillance camera 40. The administrator terminal 50 can output the received supervisory image as image information. The administrator terminal 50 can divide a plurality of monitoring images received from different intelligent monitoring cameras 40 into N screens and simultaneously display them. The administrator terminal 50 may generate a control signal for controlling the operation mode of the intelligent surveillance camera 40 and transmit the control signal to the intelligent surveillance camera 40. The specific function of the administrator terminal 50 will be described later with reference to Fig.

The administrator terminal 50 and the intelligent surveillance camera 40 can transmit and receive data through the relay server 60. [ The relay server 60 may be composed of one or more networks. For example, the intelligent surveillance camera 40 can transmit the sensing data, the location information, the identifier information of the sensor tag 10 and the self-generated surveillance image received from the mobile terminal 30 using the LTE network . The transmitted information is transmitted to an IDC (Internet Data Center) through a backbone network, and the administrator terminal 50 can receive information from the IDC through the wired and wireless Internet. However, the above-described example is merely an embodiment, and the relay server 60 can connect the manager terminal 50 and the intelligent surveillance camera 40 using various well-known wire / wireless communication technologies.

Referring to Fig. 2, a specific configuration of the intelligent surveillance camera 40 of Fig. 1 is shown.

The intelligent surveillance camera 40 according to the present invention includes a communication unit 41, a camera unit 42, an object extraction unit 43, an image analysis unit 44, and an object tracking unit 45.

The wireless AP unit 41 can collect the sensing data, the identifier information and the location information from the mobile terminal 30 located within the communication radius. As described above, the sensing data can be generated by the sensor module included in the sensor tag 10, and the mobile terminal 30 can acquire the identification information and the sensing data received from the sensor tag 10, To the communication unit 41, together with the positional information of the positional information.

The communication unit 31 can communicate with the administrator terminal 50 via the relay server 50. [ The communication unit 41 can transmit the supervisory image generated from the camera unit 42 to be described later and the sensing data received from the mobile terminal 30, the identifier information of the sensor tag 10 and the position information to the manager terminal 50 have.

The communication unit 41 may be provided with a different communication module. Specifically, the communication unit 31 may include a local area wireless communication module for communicating with the mobile terminal 30 and a wired / wireless Internet communication module for communicating with the administrator terminal or the relay server 50.

In some other embodiments, the communication unit 41 can receive data transmitted from the mobile terminal 30 using different communication modules provided therebetween through different communication methods. For example, when the mobile terminal 30 is positioned within the communication radius of the short-range wireless communication, the communication unit 41 receives the data through the short-range wireless communication. If the mobile terminal 30 is not located within the communication radius of the short- Data can be received by the communication network.

The camera unit 42 can capture a predetermined area (surveillance area) including the surveillance target to generate a surveillance image. The camera unit 42 can adjust the position and angle of the photographing unit such as a lens or the like so that the monitored object is photographed.

The object extracting unit 43 may extract at least one object included in the surveillance image generated by the camera unit 42. The object extracting unit 43 can extract the object by separating the background area from the supervised image. In addition, the object extracting unit 43 can extract the position information of the object included in the surveillance image. Specifically, the object extracting unit 43 stores the position information of the surveillance region for the surveillance image, and can extract the location information of the object located in the surveillance region using the surveillance region location information. For example, the object extracting unit 43 can extract position information by coordinateizing the position information of the surveillance region and determining where the extracted object is located in the coordinateized surveillance region.

The image analyzer 44 may compare the position information of the object with the position information received from the mobile terminal 30 to identify the object corresponding to the monitored object. That is, when the position information of the object and the position information of the mobile terminal 30 are simultaneously detected within a predetermined reference radius, the image analyzer 44 can determine the object as a target to which the sensor tag 10 is attached have. Alternatively, if the position information of the object and the position information of the mobile terminal 30 indicate the same position, the image analyzer 44 may determine the object as a target to which the sensor tag 10 is attached.

The object tracking unit 45 can track and monitor the object determined as a monitoring target. The object tracking unit 45 can track an object determined as a monitoring target by distinguishing it from other objects.

In addition, the object tracking unit 45 can determine whether an event has occurred by observing the trend of the variation of the sensing data corresponding to the object determined to be the object of monitoring. Specifically, the object tracking unit 45 monitors the sensing data and monitors whether the object classified as the monitoring target satisfies predetermined event generation conditions according to the operation mode of the intelligent monitoring camera 40. [

For example, when the operation mode of the intelligent surveillance camera 40 is set to the emergency monitoring mode, the object tracking unit 45 monitors body temperature or heart rate-related sensing data in the sensing data measured from the sensor tag 10, Or if the heart rate is observed to deviate from a predetermined threshold interval, the object can determine that the event has occurred.

As another example, if the operation mode of the intelligent surveillance camera 40 is set to the access management mode, the object tracking unit 45 can determine whether or not the object tracking unit 45 is divided into objects according to the identification information, If it is confirmed that this entry or exit has occurred, it can be determined that the event has occurred.

As another example, when the operation mode of the intelligent surveillance camera 40 is set to the intruder intruder detection mode, the object tracking unit 45 does not wear the object or the sensor tag 10 worn with the unregistered sensor tag 10 It can be determined that an event is generated when an object judged to be not included is extracted from the surveillance image.

As another example, when the emergency button included in the sensor tag 10 is operated, the object tracking unit 45 can determine that an emergency event has occurred regardless of the operation mode of the intelligent surveillance camera 40. [ Alternatively, the sensing data received from the acceleration sensor may be monitored, and if it is determined that an impact greater than a predetermined amount of impact is applied, the object may be determined to have generated a collision event regardless of the operation mode.

On the other hand, the communication unit 41 described above can transmit the supervisory image generated by the camera unit 32 to the manager terminal 50. At the same time, the communication unit 41 transmits information for identifying the object included in the surveillance image, that is, identification information and position information of the sensor tag 10, position information of the object, sensing data, Can be included in the meta information of the manager terminal 50 and transmitted to the manager terminal 50.

In Fig. 3, the specific functions of the administrator terminal 50 of Fig. 1 are shown.

The administrator terminal 50 can receive meta information about the surveillance image and the surveillance image from the intelligent surveillance camera 40. [ The administrator terminal 50 can display the received supervisory image on the screen of the administrator terminal 50. [ At this time, the administrator terminal 50 can display the objects displayed on the screen by using the meta information, and display the classified objects. More specifically, the administrator terminal 50 outputs the monitoring image received from the intelligent surveillance camera 40 on the screen. If the specific object included in the surveillance image is an object corresponding to the registered identification information in advance, And the color can be displayed by applying a preset color to the display. That is, the administrator terminal 50 can display objects classified as objects to be monitored in colors distinguished from other objects. In addition, the manager terminal 50 can output the sensing data corresponding to the monitored object displayed in different colors as image information. Therefore, the administrator can easily distinguish the monitoring target within the monitoring image, and can monitor the sensing data of the monitoring target in real time.

As another example, the administrator terminal 50 may convert a part or all of the objects classified as objects to be monitored into a previously stored image and display the converted images. Specifically, the manager terminal 50 may store the face image of the monitoring target in advance, and convert the head portion of the object classified as the monitoring target into a face image, and display the face image on the screen. Therefore, the administrator can more clearly distinguish the characters in the surveillance image.

In addition, the manager terminal 50 can transmit a notification message to a contact stored in advance when an event occurs. The manager terminal 50 can generate a control signal for controlling the operation mode of the intelligent surveillance camera 40 by the input of the manager and transmit the control signal to the intelligent surveillance camera 40. [ The intelligent surveillance camera 40 may receive the control signal and be driven in an operation mode corresponding to the control signal. Thereafter, the intelligent surveillance camera 40 may determine whether an event to be monitored is generated according to the event generation rule set by the operation mode. The intelligent surveillance camera 40 may determine that an event has occurred when the sensing data of the monitoring object is out of a predetermined threshold section and inform the administrator terminal 50 of the occurrence of the event. In this case, the administrator terminal 50 may transmit a notification message to the user related to the monitored object to inform that the event has occurred.

For example, if the object to be monitored is a noble metal, and the intelligent surveillance camera 40 is operating in the anti-theft mode, it can be determined that a robbery event has occurred when the noble metal disappears from the surveillance image. At this time, the administrator terminal 50 can transmit a text message indicating that theft occurred to the mobile terminal of the owner of the precious metal. At the same time, it is possible to transmit a notification message that the theft occurred to the nearest police station from the position where the precious metal is stored.

4 shows a specific example of a data communication method between the sensor tag 10 and the mobile terminal 30 in Fig.

In order to provide a surveillance service using the surveillance system 1000 using the intelligent surveillance camera according to the present invention, the surveillance target can be provided with the sensor tag 10 from the administrator.

Thereafter, the object to be monitored can be paired with the sensor tag 10 through the mobile terminal 30 carried by the object to be monitored. When the sensor tag 10 is registered in the mobile terminal 30 through the pairing process, the mobile terminal 30 can perform Bluetooth communication with the paired sensor tag 10. The mobile terminal 30 can receive the sensing data and the identification information of the sensor tag 10 from the paired sensor tags 10 through Bluetooth. That is, the mobile terminal 30 performs data communication with the sensor tag 10 registered in the mobile terminal 30 through the pairing process, and can ignore signals transmitted from other sensor tags that are not paired.

When the mobile terminal 30 and the sensor tag 10 are connected through the pairing process, the mobile terminal 30 can transmit a notification message to the manager terminal 50 indicating that the pairing process is completed. When the mobile terminal 30 and the sensor tag 10 are confirmed to have been paired with each other by receiving the notification message, the administrator terminal 50 performs matching by matching the identification information of the mobile terminal 30 with the identification information of the sensor tag 10 Information can be generated. The administrator terminal 50 may register the generated matching information in the approval list and update the approval list so that the matching information is reflected. The administrator terminal 50 can transmit the updated approval list to the intelligent surveillance camera 40. [

When the intelligent surveillance camera 40 receives data including the identification information of the sensor tag 10, the identification information of the mobile terminal 30, the sensing data, and the location information from the mobile terminal 30, It is possible to confirm whether or not the mobile terminal 30 is the terminal authorized by the manager terminal 50. [ A method for confirming whether the intelligent surveillance camera 40 is an authorized mobile terminal is as follows.

The intelligent surveillance camera 40 analyzes the identification information of the sensor tag 10 and the identification information of the mobile terminal 30 included in the received data so that the identification information of the mobile terminal 30 is included in the approval list, If the identification information of the mobile terminal 30 and the identification information of the sensor tag 10 included in the data match the matching information, the received data can be stored. That is, if the intelligent surveillance camera 40 determines that the received data is received from the mobile terminal 30 included in the approval list, the mobile terminal 30 determines that the mobile terminal 30 is the mobile terminal authorized by the administrator terminal, Can be received and stored.

On the other hand, the identification information of the sensor tag 10 and the identification information of the mobile terminal 30 included in the data received by the intelligent surveillance camera 40 are analyzed, and identification information of the mobile terminal 30 is included in the approval list Or if the identification information of the mobile terminal 30 included in the data does not match the identification information of the sensor tag 10 and the matching information does not match the matching information, . ≪ / RTI >

For example, another user acquires the sensor tag 10 paid for the initial monitoring target, and the stolen sensor tag 10 is paired with another user's mobile terminal. At this time, when the intelligent surveillance camera 40 receives data from the mobile terminal of another user, the intelligent surveillance camera 40 can determine whether the corresponding mobile terminal is the terminal authorized by the administrator terminal 50 by using the approval list. As a result, if it is determined that the identification information of the mobile terminal of another user and the identification information of the lost or stolen sensor tag 10 do not match with the matching information, the intelligent surveillance camera 40 transmits the identification information of the other user's mobile terminal And the sensor tag 10 paired with the mobile terminal of another user can be determined as a stolen or lost sensor tag. Thereafter, the intelligent surveillance camera 40 analyzes the surveillance image, and divides the object corresponding to the mobile terminal of the other user paired with the sensor tag determined to be stolen or lost into an additional surveillance object (a dangerous object or a stolen object) can do.

Meanwhile, the mobile terminal 30 can confirm whether or not the pairing with the sensor tag 10 is normally connected. At this time, if the distance between the mobile terminal 30 and the sensor tag 10 is too long to perform Bluetooth communication, the pairing between the mobile terminal 30 and the sensor tag 10 is interrupted.

The mobile terminal 30 may count the time when the connection with the sensor tag 10 is interrupted when the connection with the sensor tag 10 is interrupted. If it is confirmed that the time when the connection is interrupted exceeds the predetermined reference time, the notification signal may be transmitted to the administrator terminal 50. When the manager terminal 50 receives the notification signal, the manager terminal 50 deletes the matching information in the approval list and processes the sensor tag 10 as an unregistered sensor tag. Thereafter, if the identification information of the unregistered sensor tag is received from another mobile terminal, the user having another mobile terminal that has transmitted the identification tag of the unregistered sensor tag can be determined as a theft.

5 shows a specific example of a data communication method between the mobile terminal 30 and the intelligent surveillance camera 40 in Fig.

As described above, the mobile terminal 30 can transmit the data including the identification information of the sensor tag 10, the identification information of the mobile terminal 30, the sensing data, and the position information to the intelligent surveillance camera 40 . The method by which the mobile terminal 30 transmits data can be classified into two types.

First, when the mobile terminal 30 is located within the communication radius of the short range wireless communication of the intelligent surveillance camera 40, the mobile terminal 30 can transmit data using the short distance wireless communication.

When the mobile terminal 30 is not located within the communication radius of the short range wireless communication of the intelligent surveillance camera 40 or is located in an area where the short range wireless communication is impossible, the mobile terminal 30 can transmit data using the mobile communication network have. That is, the mobile terminal 30 can indirectly transmit data to the intelligent surveillance camera 40 by bypassing the relay server 60. [

Meanwhile, the intelligent surveillance camera 40 can determine the current state of the monitored object according to the method of receiving data from the mobile terminal 30 and the set operation mode.

In one example, the intelligent surveillance camera 40 may be operated in a first mode of operation in accordance with a control signal received from the administrator terminal 50. Here, the first operation mode may be an operation mode for detecting whether the monitored object is located in the surveillance area, such as an anti-theft mode or an anti-theft mode.

The intelligent surveillance camera 40 can determine that the object classified as the surveillance object is in a normal state when it is detected in the surveillance area. If the monitoring target is located within the monitoring area and the image can be photographed by the intelligent monitoring camera 40, the manager can confirm the monitoring target through the administrator terminal 50, and thus can determine the current status of the monitoring target as a normal status . In this case, the mobile terminal 30 provided in the monitored object is located within the communication radius of the near-field wireless communication (Bluetooth) of the intelligent surveillance camera 40, Lt; / RTI >

If it is confirmed that the object to be monitored is not detected in the monitoring image but receives data transmitted from the mobile terminal 30 via the Bluetooth, the intelligent surveillance camera 40 displays the current state of the monitored object It can be judged as a state of caution. For example, during the movement of the object to be monitored, the object may not be detected in the monitoring image because the object is located in the shooting blind spot of the intelligent surveillance camera 40. At this time, if it is confirmed that the data received from the mobile terminal 30 is received via the Bluetooth, the intelligent surveillance camera 40 exists at a relatively short distance from the intelligent surveillance camera 40 even if the surveillance target is located in the shooting blind spot It can be judged. However, since the object to be monitored is not identified as the surveillance image, the current state can be determined as a state of attention so that the manager can pay attention to the object to be monitored.

If the intelligent surveillance camera 40 determines that the object to be monitored is not detected in the surveillance image but receives data transmitted from the mobile terminal 30 through the mobile communication network, As a warning state. The fact that the intelligent surveillance camera 40 receives data through the mobile communication network means that the monitored mobile terminal 30 is out of the radius of the short range wireless communication, And may be an indicator indicating that it is located at a relatively long distance. Accordingly, the intelligent surveillance camera 40 can determine the current state of the surveillance target as a warning state when the surveillance camera 40 does not detect the surveillance target and receives data through the mobile communication network. The intelligent surveillance camera 40 may determine that a caution or warning event has occurred and inform the administrator terminal 50 of the event.

As another example, the intelligent surveillance camera 40 may be operated in the second mode of operation according to the control signal received from the administrator terminal 50. [ Here, the second operation mode may be an operation mode in which the monitored object is detected as entering or exiting the monitoring area, such as access control mode.

Specifically, when the intelligent surveillance camera 40 is operated in the second operation mode and photographs the surveillance region, if it is detected that an object classified as a surveillance target has appeared, it is determined that an entrance event has occurred, It can be determined that a disconnection event has occurred. The intelligent surveillance camera 40 can inform the administrator terminal 50 of the occurrence of an entry or exit event.

In some other embodiments, the intelligent surveillance camera 40 may utilize the received sensing data in the process of determining the current state. For example, even if an object classified as a monitoring object is detected in the monitoring area and is determined as a normal state, it can be switched to a warning state when the sensing data of the monitored body temperature or heart rate is out of a preset critical interval.

In some other embodiments with reference to Figure 6, the sensor tag 10 may communicate directly with the intelligent monitoring camera 40. [

Generally, the sensor tag 10 is located within the communication radius of the intelligent surveillance camera 40, and the sensor tag 10 uses the short-range wireless communication such as Bluetooth to transmit the sensing data and the identifier information to the intelligent surveillance camera 40 You can send it directly. In this case, the mobile terminal 30 can transmit only the self-calculated location information to the intelligent monitoring camera 40. The intelligent surveillance camera 40 can collect the information received from the sensor terminal 10 and the information received from the mobile terminal 30 using the matching information included in the approval list. As described above, since the information on the type of the sensor tag 10 paired with the mobile terminal 30 is recorded in the matching information, the information transmitted from the different transmitting entity can be matched using the matching information .

On the other hand, when the object to which the sensor tag 10 is attached moves out of the communication radius of the intelligent surveillance camera 40, it may occur. The sensor tag 10 can transmit and receive data only in the short distance wireless communication so that when the sensor tag 10 is distant from the intelligent surveillance camera 40 by a predetermined distance or more, Lt; / RTI > In this case, the paired mobile terminal 30 can be replaced with an existing transmission method of receiving the information of the sensor tag 10 and transmitting the calculated position information together with the intelligent surveillance camera 40 together.

That is, according to another embodiment of the present invention, the mobile terminal 30 ignores data transmitted from the paired sensor tags 10 in a general situation, and the sensor tag 10 transmits data to the intelligent surveillance camera 40 And can start receiving data from the sensor tag 10 if it is determined that the communication radius is out of the range.

The method for determining whether the sensor tag 10 is out of the communication radius of the intelligent surveillance camera 40 can be roughly divided into two methods.

First, there is a method of confirming on the mobile terminal 30 side. The mobile terminal 30 can confirm whether the intelligent surveillance camera 40 exists within a predetermined radius at predetermined time intervals. If it is confirmed that the intelligent surveillance camera 40 exists within a predetermined radius, the data transmitted from the sensor tag 10 is ignored. On the other hand, if it is confirmed that the intelligent surveillance camera 40 does not exist within a predetermined radius, it can start to receive data transmitted from the sensor tag 10.

Next, there is a method of confirming by the manager terminal 50 side. The manager terminal 50 tracks the positional information of the sensor tag 10 at predetermined time intervals and generates a warning message when it is determined that the sensor tag 10 is out of the communication radius of the intelligent monitoring camera 40, To the mobile terminal 30 possessed by the mobile terminal 30. Upon receiving the warning message from the administrator terminal 50, the mobile terminal 30 may start to receive data from the sensor tag 10. [

Then, the mobile terminal 30 can transmit the received information to the intelligent surveillance camera 30 through the relay server 50. For example, when the mobile terminal 30 is a smart phone, data can be transmitted to the intelligent surveillance camera 30 using a mobile communication network such as an LTE network. When the manager terminal 50 requests information, the intelligent surveillance camera 40 can transmit the identifier information, the sensing data, and the location information received from the mobile terminal 30 together with the surveillance image.

FIG. 5 shows an example of a method of performing communication with the intelligent monitoring camera 40 when the mobile terminal 30 of FIG. 1 is out of the communication radius of the wireless AP 20. FIG.

As described above, the mobile terminal 30 can communicate with the surrounding wireless AP 20 to calculate its own location information. However, it may happen that the position information can not be calculated because the moving object (monitoring target) having the mobile terminal 30 moves away from the surrounding wireless AP 20 in the process of moving.

In this case, the mobile terminal 30 can collect the current location information of the mobile terminal 30 by using GPS or the like. The mobile terminal 30 can transmit its own collected location information to the intelligent surveillance camera 40. [ Therefore, even if the mobile terminal 30 moves beyond the communication radius of the wireless AP 20, the location information of the monitored object can be calculated.

FIG. 7 is a flowchart illustrating a method of analyzing a surveillance image using a beacon and an intelligent surveillance camera according to an exemplary embodiment of the present invention. Referring to FIG.

First, the administrator terminal 50 generates a control signal for controlling the operation mode of the intelligent surveillance camera 40 and transmits the control signal to the intelligent surveillance camera 40 (110).

The intelligent surveillance camera 40 receives the control signal through the relay server 50 and can drive the operation mode based on the control signal (120).

The intelligent surveillance camera 40 may generate a surveillance image by photographing a predetermined area (surveillance area) including the surveillance target, and may extract the objects included in the surveillance image and the location information of each object (130).

At the same time, the intelligent surveillance camera 40 may collect sensing data, identifier information, and location information from the mobile terminal 30 (140).

The intelligent surveillance camera 40 compares the position information of the extracted object with the position information of the sensor tag 10 and if the two position information are coincident or are simultaneously included within the predetermined reference radius, (150).

Next, the intelligent surveillance camera 40 can determine whether an event has occurred by observing a variation of sensing data of an object classified as a monitoring object according to an operation mode (160).

Thereafter, the intelligent surveillance camera 40 may transmit the generated meta information about the surveillance image and the surveillance image to the administrator terminal 50 through the relay server 50 (170). The meta information may include identifier information of the sensor tag 10, position information, sensing data, and information on whether or not an event is generated.

The administrator terminal 50 can monitor the monitored object by displaying the received monitoring image on the screen (180). The administrator terminal 50 can display the objects included in the surveillance image by the identifier information (target of monitoring). In addition, the administrator terminal 50 may convert some or all of the objects classified as objects to be monitored into a previously stored image related to the object to be monitored, and display the same together with the sensing data for the object to be monitored.

Thereafter, if it is determined that an event has occurred for the object classified as the monitoring target, the administrator terminal 50 may transmit a notification message to notify that the event has occurred to the contacts of the users associated with the monitored object (190).

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

10: Sensor tag
20: Wireless AP
30:
40: Intelligent surveillance camera
50:
60: Relay server

Claims (12)

A sensor tag attached to or worn on an object to be monitored to generate sensing data for the object to be monitored and periodically transmitting a signal including the sensing data;
Wherein the sensor tag is provided in the monitoring object, registers the sensor tag through a pairing process, receives the sensing data and the identification information of the sensor tag from the paired sensor tag, A mobile terminal for communicating with one wireless AP to calculate location information;
The method includes the steps of: collecting the sensing data, the identification information of the sensor tag, and the data including the position information from the mobile terminal, generating a surveillance image by photographing the surveillance region, An intelligent surveillance camera for distinguishing an object corresponding to the surveillance object from at least one object included in the surveillance image and determining whether an event of the object classified as the surveillance target is generated according to a set operation mode; And
And an administrator terminal for transmitting a control signal for controlling the operation mode to the intelligent surveillance camera and outputting the surveillance image received from the intelligent surveillance camera as image information.
The method according to claim 1,
The intelligent surveillance camera includes:
And a monitoring unit for monitoring the object by using an intelligent surveillance camera, the object being included in the surveillance image and the positional coordinates of the object are extracted, and when the positional coordinates of the object coincide with the positional information, system.
The method according to claim 1,
The administrative terminal,
If it is determined that the mobile terminal and the sensor tag are paired, the mobile terminal generates matching information that matches the identification information of the mobile terminal and the identification information of the sensor tag, registers the matching information in the approval list, and updates the approval list Transmits the updated approval list to the intelligent surveillance camera,
The intelligent surveillance camera includes:
Upon receipt of the data from the mobile terminal, confirms whether the mobile terminal is a mobile terminal authorized by the manager terminal based on the approval list.
The method of claim 3,
The intelligent surveillance camera includes:
If it is confirmed that the data is received from the mobile terminal included in the approval list, the mobile terminal determines that the mobile terminal is the mobile terminal permitted by the manager terminal, stores the data,
If it is determined that the data is received from another mobile terminal not included in the approval list, the other mobile terminal determines that the other mobile terminal is a mobile terminal that is not permitted by the administrator terminal, and transmits the sensor tag to the stolen or lost sensor tag , The monitoring system using the intelligent surveillance camera.
5. The method of claim 4,
The intelligent surveillance camera includes:
And the object corresponding to the other mobile terminal paired with the sensor tag determined to be stolen or lost is classified as an additional monitoring object.
The method of claim 3,
The mobile terminal,
Counting a time at which the connection is interrupted when the pairing connection with the sensor tag is interrupted, and transmitting a notification signal to the administrator terminal when the time at which the connection is interrupted exceeds a preset reference time,
The administrative terminal,
And deletes the matching information from the approval list upon receiving the notification signal.
The method according to claim 1,
Wherein the mobile terminal transmits the data through short-range wireless communication and transmits the data to a mobile communication network when it is determined that the intelligent surveillance camera does not exist within a communication radius of short-range wireless communication.
8. The method of claim 7,
When the intelligent surveillance camera is operated in the first operation mode for detecting whether the surveillance target is located within the surveillance area,
The intelligent surveillance camera includes:
When it is detected within the surveillance area,
If it is confirmed that the object to be monitored is not detected in the surveillance video and the data is received through the short-distance wireless communication,
Wherein the control unit determines that the object is not detected in the monitoring image and that the data is received through the mobile communication network.
8. The method of claim 7,
When the intelligent surveillance camera is operated in a second operation mode for sensing an event in which the surveillance target enters and exits the surveillance area,
The intelligent surveillance camera includes:
If it is detected that an object classified as the monitoring target appears in the monitoring area, it is determined that an entry event has occurred,
Wherein the control unit determines that a disconnection event has occurred when it is detected that the object identified as the object to be monitored disappears in the surveillance area.
The method according to claim 1,
The mobile terminal,
Wherein the location information is calculated using GPS information when it is determined that the communication radius of the wireless AP is out of the predetermined range.
The method according to claim 1,
The administrative terminal,
Wherein each of the objects included in the supervised image and the sensing data corresponding to each of the objects are separately displayed for the identification information of the sensor tag in the output image information.
12. The method of claim 11,
The administrative terminal,
Wherein a part or all of the objects classified as the objects to be monitored are converted into a previously stored image and displayed.

Images