KR101497814B1 - Apparatus and Method for Pedestrian Surveillance using Short-range Wireless Communications - Google Patents

Abstract

The present invention relates to a method and apparatus for receiving a photographed image through a camera device, analyzing a photographed image to confirm presence of a passenger, and identifying identification information of terminals located within a short- The wireless communication base station receives the information from the wireless communication base station, analyzes the photographed image and the collected identification information to determine whether or not to monitor the passenger, generates monitoring information on the passenger determined as a monitoring target, To a monitoring server, and a method thereof.

Description

[0001] The present invention relates to an apparatus and method for monitoring a passenger using short-range wireless communication,

TECHNICAL FIELD The present invention relates to a technology for monitoring a passenger, and more particularly, to a passenger monitoring device for monitoring a passenger using short-range wireless communication and image capture.

In recent years, image data of video camera system installed in the elements have been contributing to the detection of incident and accident, and it is expected to be installed continuously in the future. On the other hand, today, mobile communication terminals have become popular all over the world, and many people live with mobile phones or smart phones. Almost all mobile phones and smart phones have built-in short-range wireless communication modules such as wireless LAN and Bluetooth, so they can communicate with nearby devices from time to time.

Korean Patent No. 1056018 entitled "Streetlight Integrated Intelligent Surveillance System" has been proposed as an example of surveillance technology including a conventional camera. In the prior art, an integrated monitoring unit including a local server is configured on a light pole, and a PTZ (Pan / Tilt / Zoom) surveillance camera is controlled through the integrated monitoring unit to obtain a reliable image of a wide area A technique has been disclosed in which a light amount of a streetlight lamp is controlled to improve efficiency and a user interface for emergency response and an access point (AP) for wireless communication are integrated.

However, in the case of the prior art, the surveillance system is not suitable to be applied to a technique of detecting a passenger because the surveillance system does not actively detect a danger or an emergency situation but detects a danger or an emergency only after receiving a user's request.

Therefore, there is a need for a technique of determining whether a person is a critical passenger and notifying a manager or a monitoring server if the person is determined to be a critical passenger, and storing the image.

Korean Patent No. 1056018 (Published on Aug. 10, 2011)

SUMMARY OF THE INVENTION It is an object of the present invention to provide a device and method for monitoring a passenger using short range wireless communication.

Specifically, the present invention aims to provide a passenger monitoring apparatus and method thereof for monitoring a passenger using short-range wireless communication and image capturing.

In addition, the present invention is characterized in that a short-range wireless communication base station automatically recognizes a near-field wireless communication terminal carried by a nearby user, collects identification information of the terminal, compares the identification information with a list of previously- And the monitoring information is transmitted to the manager or the monitoring server, and the high-quality image data is stored when the monitoring information is not available, and a method thereof.

According to another aspect of the present invention, there is provided an occupant monitoring apparatus comprising: an image analyzer for receiving an image captured by a camera device and analyzing the captured image to confirm presence of a passer; An identification information receiver for receiving identification information of terminals located within a short range communication range of the short range wireless communication base station collected by the short range wireless communication base station from the short range wireless communication base station; And a control unit for determining whether to monitor the passenger using the information obtained by analyzing the photographed image and the collected identification information, generating monitoring information on the passenger determined as the monitoring target, To the monitoring server.

In this case, the passer-by surveillance apparatus further includes a user database for storing identification information on an authorized user, and the monitoring processing unit may be configured to determine whether the collected identification information matches the identification information stored in the user database, The passenger can be determined as a surveillance object if at least one of the presence of a passenger who is present in the image and the identification information is not collected is satisfied.

On the other hand, the monitoring information includes at least one of a time at which the passenger determined to be the monitoring target is detected, an image of the passenger determined to be the monitoring target, identification information of the passenger determined as the monitoring target, a position of the passenger determined as the monitoring target, And a moving direction of the determined passer.

In this case, if the short-range wireless communication base station includes a directional antenna, the passenger monitoring apparatus may further include a camera adjustment request unit for requesting the camera apparatus to photograph the image in the same direction as the directional direction of the directional antenna.

Meanwhile, the monitoring processor may request the camera device to raise the image quality of the image taken by the camera device to a predetermined high image quality if the passenger is determined to be a monitored object.

Receiving an image photographed through a camera according to an embodiment of the present invention; Analyzing the photographed image to confirm presence of a passer; Receiving identification information of terminals located within a short-range communication region of the short-range wireless communication base station collected by the short-range wireless communication base station from the short-range wireless communication base station; Determining whether to monitor the passenger using information obtained by analyzing the photographed image and the collected identification information; And generating monitoring information on the passenger determined as the monitoring target, and transmitting the generated monitoring information to the monitoring server.

According to the present invention, it is possible to confirm the identity of passers passing through the main point where the camera is installed, and when the identification is not confirmed, the situation can be grasped through the video image. Further, in the present invention, when only an authorized user such as an apartment entrance or a front gate of a school can access, it is possible to acquire image information for the passer, as well as to confirm the identity. In particular, a passenger can detect his / her terminal without intentionally connecting to the wireless LAN router.

1 is a diagram showing a schematic configuration of a passenger monitoring system according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a traffic jam monitoring apparatus according to an embodiment of the present invention. Referring to FIG.
3 is a diagram showing a schematic configuration of a passenger monitoring system according to another embodiment of the present invention.
4 is a diagram illustrating a traffic jam monitoring apparatus according to another embodiment of the present invention.
5 is a flowchart illustrating a process of monitoring a passenger according to an embodiment of the present invention.
6 is a flowchart illustrating a process of monitoring a passenger according to another embodiment of the present invention.
7 is a diagram illustrating an example of a high-quality image and a low-quality image according to an embodiment of the present invention.

Other objects and features of the present invention will become apparent from the following description of embodiments with reference to the accompanying drawings.

Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

Hereinafter, a system and method for monitoring a passenger using a short-distance wireless communication according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 7. FIG.

1 is a diagram showing a schematic configuration of a passenger monitoring system according to an embodiment of the present invention.

1, the passenger monitoring device 100 of the present invention monitors a passenger 190 using short-range wireless communication and image capturing, and detects monitoring information on a passenger 190 determined as a monitoring target To the monitoring server 20 via the communication network 10 to monitor the passenger.

At this time, the terminal 191 can search the short-range wireless communication base station 100 and transmit the identification information so that the short-range wireless communication base station 100 can collect the identification information of the terminal.

The occupant monitoring apparatus 100 may be configured such that the identification information of the terminal 191 owned by the passenger 190 does not match with the identification information stored in the user database storing the identification information on the user whose identification information is permitted, It is possible to determine, as a surveillance target, a corresponding passenger present in the image but a passenger whose identification information is not collected.

A more detailed description of the occupant monitoring apparatus 100 will be described later with reference to FIG.

FIG. 2 is a diagram illustrating a traffic jam monitoring apparatus according to an embodiment of the present invention. Referring to FIG.

2, the passenger monitoring apparatus 100 operates in cooperation with a camera apparatus and a short-distance wireless communication base station and includes a control unit 110, an image analysis unit 111, an identification information collection unit 112 , A camera control unit 115, an antenna control unit 116, a camera 121, an antenna 122, a short range communication unit 123, an internet connection unit 124, a storage unit 125, A user database 126, and a monitoring target database 127. [0035] FIG.

The camera 121 transmits the image photographed by the image capturing device to the image analyzing unit 111. At this time, the photographed image may be corrected through image correction before transmission to the image analysis unit 111. [

When the camera 121 receives a request to adjust the image quality of the image to be photographed from the monitoring processing unit 113, the camera 121 can adjust the image quality of the image to be photographed. At this time, the request to adjust the image quality of the image may be a request to shoot at a predetermined high image quality when a passenger of the monitoring target is sensed, and a request to shoot at a low image quality when the passenger to be monitored is not sensed.

The short-range communication unit 123 is a device that provides a pico cell for increasing the coverage of a macro cell and improving the throughput of a macro cell. Both supported local and future developable local communications are available. Here, the picocell may be referred to as a pemtocell, a microcell, or a small base station. In the present invention, "cell" can be used in the same sense as "base station ".

In addition, the short-range communication unit 123 scans a radio signal transmitted from a terminal existing in the short-range communication area through the antenna 122 according to the present invention and receives identification information of the terminal from the terminal.

Meanwhile, in order to collect the identification information of the terminal from the short range communication unit 123, the terminal must be powered on. However, when the user intentionally turns off the power, the local communication unit 123 can not collect the identification information of the terminal.

Accordingly, if a wireless communication technology such as an RF tag capable of providing identification information can be applied to the terminal even when the power of the terminal is turned off, it will be easier to collect the identification information of the terminal in the passenger monitoring device 100. In addition, if a low-power technology for separately managing the power provided to the local communication unit included in the terminal is applied to the terminal, the terminal can provide the identification information even if the user turns off the terminal, 100, it will be easier to collect the identification information of the terminal.

In the case of the current femto base station, it may be difficult to acquire the identification information of the terminal directly from the femto base station for security purpose. However, the wireless signal of the terminal included in the corresponding fomto cell is transmitted as a macro cell, The identification information of the included terminal may be provided

At this time, the femto cell that can request the identification information of the terminal may be separately managed for security.

The Internet connection unit 124 is a communication interface device including a receiver and a transmitter. The communication interface unit 124 is connected to a macro cell and the Internet via a wired or wireless network, and is used to perform a function as a short- Data is transmitted and received. In addition, the Internet connection unit 124 communicates with an administrator and a monitoring server through wired or wireless communication to transmit and receive data.

The storage unit 125 may store an operating system and an application program for controlling the overall operation of the passer-by monitoring device 100, and may also store images photographed according to the present invention. Here, the storage unit 125 may be a storage device including a flash memory, a hard disk drive, and the like.

The user database 126 stores identification information for terminals owned by authorized users. At this time, when an authorized user owns a plurality of terminals, one authorized user may have a plurality of identification information.

The monitoring target database 127 stores the identification information of the terminal owned by the user registered as the monitoring target. At this time, the information about the object to be monitored may be information of criminals or ex-offenders, such as murder, robbery, child sexual assault, etc., which are managed by the police, prosecutors,

The database management unit 114 accesses the user database 126 or the monitoring target database 127 and performs registration, update, and deletion upon receiving a request for registration, update, and deletion of a user or monitoring target permitted by the administrator or the monitoring server And manages the user database 126 and the monitoring target database 127.

The database management unit 114 may collect information on criminals or ex-offenders disclosed to the police server, the prosecution server, and the like, and store them in the monitoring object database 127. [

At this time, the user database 126 and the monitoring target database 127 may be included in the passenger monitoring device 120, but may be stored and managed in a separate database management server.

The image analysis unit 111 analyzes the images photographed by the camera 121 to confirm existence of the passers 170, 180 and 190.

The identification information collection unit 112 collects the identification information of the terminals located in the local communication area received through the local communication unit 141.

At this time, since the identification information collecting unit 112 collects identification information of the user terminal arbitrarily, it may be a problem in terms of protection of personal information, so that it may be allowed to collect identification information through a mutual authentication process with the terminal.

Here, the identification information may include a telephone number of the terminals, a MAC address of the terminals, a data link number, a network layer address, a port number, an electronic serial number (ESN) And an International Mobile Equipment Identity (IMEI).

The monitoring processing unit 113 can request the camera 121 to raise the image quality of the image photographed by the camera 121 to a preset high image quality. The monitoring processing unit 113 may request the camera 121 to lower the image quality of the image photographed by the camera 121 to a low image quality if there is no passenger determined as the monitoring target.

7 is a diagram illustrating an example of a high-quality image and a low-quality image according to an embodiment of the present invention.

7, the monitoring processing unit 113 may request the camera 121 to capture a high-quality image 720 when a monitoring object is determined during the shooting with the low-quality image 710. [

The monitoring processing unit 113 stores the photographed image only when the monitored object exists, or stores the photographed image of high image quality when the monitored object exists, and stores the photographed image of low image quality when the monitored object does not exist, The resource efficiency of the memory 125 can be increased.

On the other hand, in order to more efficiently monitor the monitoring target, the monitoring processing unit 113 notifies other neighboring monitoring devices or other traffic monitoring devices located in the direction in which the monitoring target is moving that the monitored target is present Can be transmitted.

The camera adjusting unit 115 is an apparatus for adjusting the photographing direction of the camera 121 and adjusts the photographing direction of the camera 121 so as to photograph the image in the same direction as the direction of the antenna 122. [

The antenna adjusting unit 116 adjusts the direction of the antenna 122 when the antenna 122 is a directional antenna having a direction of the antenna 122. The antenna adjusting unit 116 adjusts the direction of the antenna 122, Adjust the direction.

The control unit 110 can control the overall operation of the occupant monitoring apparatus 100. [ The control unit 110 performs functions of the image analysis unit 111, the identification information collection unit 112, the monitoring processing unit 113, the database management unit 114, the camera adjustment unit 115, and the antenna adjustment unit 116 . The control unit 110, the image analysis unit 111, the identification information collection unit 112, the monitoring processing unit 113, the database management unit 114, the camera adjustment unit 115, and the antenna adjustment unit 116 are shown separately This is to explain the functions separately. Accordingly, the control unit 110 performs functions of the image analysis unit 111, the identification information collection unit 112, the monitoring processing unit 113, the database management unit 114, the camera adjustment unit 115, and the antenna adjustment unit 116 And may comprise at least one processor configured. In addition, the control unit 110 may include functions of the image analysis unit 111, the identification information collection unit 112, the monitoring processing unit 113, the database management unit 114, the camera adjustment unit 115, and the antenna adjustment unit 116 And at least one processor configured to perform the method.

The passenger monitoring apparatus 100 of FIG. 2 includes both a camera and a short-range wireless communication base station. However, the camera and the short-range wireless communication base station may be configured as separate apparatuses as shown in FIG.

3 is a diagram showing a schematic configuration of a passenger monitoring system according to another embodiment of the present invention.

3, the transit person monitoring apparatus 300 of the present invention is configured to monitor the photographed image received from the camera apparatus 330 and the collected identification information received from the local area wireless communication base station 340, And monitoring information on the passenger 390 determined as the monitoring target is transmitted to the monitoring server 20 through the communication network 10 to monitor the passenger.

At this time, the terminal 391 can search the short-range wireless communication base station 300 and transmit the identification information so that the short-range wireless communication base station 300 can collect the identification information of the terminal.

The passenger monitoring device 300 may be configured such that the identification information of the terminal 391 owned by the passer 390 does not match the identification information stored in the user database storing the identification information about the user whose identification information is permitted, It is possible to determine, as a surveillance target, a corresponding passenger present in the image but a passenger whose identification information is not collected.

A more detailed description of the occupant monitoring apparatus 300 will be described later with reference to FIG.

4 is a diagram illustrating a traffic jam monitoring apparatus according to another embodiment of the present invention.

Referring to FIG. 4, a system for monitoring a passenger may include a passenger monitoring device 300, a camera device 330, and a short-range wireless communication base station 340.

First, the camera device 330 may include a camera 331, a communication unit 332, and a camera adjustment unit 333.

The communication unit 332 is a communication interface device including a receiver and a transmitter. The communication unit 332 communicates wired or wirelessly with the passer-by monitoring device 300 to transmit the photographed data and control it from the passer-by monitoring device 300 Signal can be received. At this time, the control signal may be a signal for adjusting the image quality of the image to be photographed or a camera adjustment request signal for adjusting the direction in which the camera 331 photographs.

The camera 331 transmits the image photographed by the image capturing device to the passenger monitoring device 300 through the communication unit 332. [ At this time, the photographed image can be corrected through image correction before transmission to the passer-by monitoring device 300.

When the camera 331 receives a signal for adjusting the image quality of the image to be photographed from the passer-by monitoring device 300 through the communication unit 332, the camera 331 can adjust the image quality of the image to be photographed according to the received signal. At this time, the signal for controlling the image quality of the image may be a signal for requesting to shoot at a predetermined high image quality when a passenger of the monitoring target is sensed, and a signal for requesting to shoot at a low image quality when the passenger to be monitored is not detected.

The camera adjusting unit 333 is a device for adjusting the photographing direction of the camera 331. When the adjusting request signal for adjusting the photographing direction of the camera 331 is received from the occupant monitoring device 300 via the communication unit 332, And adjusts the photographing direction of the camera 331 according to the request signal.

The short range wireless communication base station 340 may include a short range communication unit 341, an antenna 342, a communication unit 343, an identification information collection unit 344, and an antenna adjustment unit 345.

The short-range communication unit 341 is a device for providing a pico cell for increasing the coverage of a macro cell and improving the throughput of a macro cell. Both supported local and future developable local communications are available. Here, the picocell may be referred to as a pemtocell, a microcell or a small base station. In the present invention, "cell" can be used in the same sense as "base station ".

In addition, the short-range communication unit 341 scans a radio signal transmitted from a terminal existing within the short-range communication region through the antenna 342 according to the present invention and receives identification information of the terminal from the terminal.

The Internet connection unit 343 is a communication interface device including a receiver and a transmitter and is connected to a macro cell and the Internet via a wired or wireless network to perform a function of the short- As shown in FIG. In addition, the Internet connection unit 343 communicates with the passer-by monitoring device 300 by wire or wireless, and transmits the identification information collected through the identification information collection unit 344.

The identification information collection unit 344 collects the identification information of the terminals located in the short range communication area received through the short range communication unit 341 and transmits the collected identification information to the passenger monitoring apparatus 300 through the Internet connection unit 343.

At this time, since the identification information collection unit 344 collects the identification information of the user's terminal arbitrarily, it may be a problem in terms of protection of personal information, so that it may be allowed to collect the identification information through the mutual authentication process with the terminal.

Here, the identification information includes at least one of a telephone number of the terminals, a MAC address of the terminals, an electronic serial number (ESN) of the terminals, or an International Mobile Equipment Identity (IMEI) It can be one.

In addition, there is no problem in the case where the near-field communication base station receives the identification information from the terminal. However, in many cases, the base station actively generates a signal and the terminal manually receives the signal. The terminal must have a function of searching for the short-range wireless communication base station and transmitting its identification information if it is recognized.

Therefore, it may be necessary to search for the short-range wireless communication base station among various types of short-range wireless communication base stations existing in the vicinity of the terminal. If there is the short-range wireless communication base station, To the corresponding short-range wireless communication base station.

Or the short-range wireless communication function of the terminal is turned off, the search of the short-range wireless communication base station and the function of transmitting the identification information must be in operation when the passenger monitoring function is installed in the terminal.

The antenna adjusting unit 345 is an apparatus for adjusting the direction of the antenna 342 when the antenna 342 is a directional antenna having a direction of the antenna 342. The antenna adjusting unit 345 controls the direction of the antenna 342 through the internet connection unit 343, And adjusts the direction of the antenna 342 in accordance with the adjustment request signal.

Lastly, the passenger monitoring device 300 includes a control unit 310, an image analysis unit 311, an identification information receiving unit 312, a monitoring processing unit 313, a database management unit 314, a camera adjustment request unit 315, An antenna adjustment request unit 316, a communication unit 324, a storage unit 325, a user database 326, and a monitoring target database 327. [

The communication unit 324 is a communication interface device including a receiver and a transmitter. The communication unit 324 communicates with a camera device 330, a short range wireless communication base station 340, an administrator, and a monitoring server by wire or wireless, Lt; / RTI >

The storage unit 325, the user database 326, the monitoring target database 327 and the database management unit 314 correspond to the storage unit 125, the user database 126, the monitoring target database 127, 114, and the detailed description thereof will be omitted.

The image analysis unit 311 receives the image photographed by the camera apparatus 330 through the communication unit 324 and analyzes the photographed image to confirm the presence of the passers 370, 380, and 390.

The identification information receiving unit 312 receives the identification information of the terminals 371 and 391 located in the local communication area of the local area wireless communication base station 340 collected by the local area wireless communication base station 340 through the communication unit 324, (340).

The monitoring processing unit 313 determines whether or not to be monitored for a passenger by using the information obtained by analyzing the photographed image and the collected identification information, generates monitoring information about a passenger determined as a monitoring target, To the administrator or the monitoring server. At this time, the monitoring information includes at least one of a time at which the passenger determined to be monitored is detected, a video of a passenger determined to be a monitoring target, identification information of a passenger determined to be a monitoring target, a position of a passenger determined to be a monitoring target, One can be included.

A method for determining the monitoring target in the monitoring processing unit 313 will be described in detail as follows.

If the collected identification information does not match with the identification information stored in the user database 326, the monitoring processing unit 313 determines the corresponding passer as a monitoring target. That is, when a passenger who owns a terminal that is not registered in the user database 326 is detected, it is determined to be a monitoring target.

When the collected identification information is matched with the identification information stored in the monitoring target database 327, the monitoring processing unit 313 determines the corresponding passenger as the monitoring target.

Also, the surveillance processor 313 determines the passenger 380 as a surveillance target even if the passenger 380 exists in the photographed image but the identification information is not collected.

The monitoring processor 313 can request the camera device 330 to increase the image quality of the image taken by the camera device 330 to a preset high image quality. In addition, the monitoring processing unit 313 can request the camera device 330 to lower the image quality of the image taken by the camera device 330 to a low quality if there is no passenger determined to be a monitoring target.

The monitoring processing unit 313 stores the photographed image only when the monitored object exists, or stores the photographed image of high image quality when the monitored object exists, and stores the photographed image of low image quality when the monitored object does not exist, It is possible to increase the resource efficiency of the memory 325.

On the other hand, in order to more efficiently monitor the monitoring target, the monitoring processing unit 313 notifies the existence of the passenger determined as the monitoring target to the adjacent passenger monitoring devices or the passenger monitoring device located in the direction in which the monitored passer moves can do.

The camera adjustment requesting unit 315 can request the camera device 330 to photograph an image in the same direction as the direction of the directivity antenna 342 when the short range wireless communication base station 340 includes the directional antenna 342 have.

The antenna adjustment requesting unit 316 determines whether or not the short range wireless communication base station 340 includes a directional antenna 342 so as to adjust the directing direction of the directional antenna 342 in the same direction as the direction in which the camera 331 photographs, To the wireless communication base station 340. [

The reason why the traveling direction of the antenna 342 and the photographing direction of the camera 331 are matched through the camera adjustment request unit 315 and the antenna adjustment request unit 316 is that the range of the image photographed through the camera 331 is close to the range The communication area of the communication unit 341 is maximized to minimize the error that can be generated when the surveillance object is determined through the captured image and the collected identification information.

The control unit 310 can control the overall operation of the passenger monitoring device 300. [ The control unit 310 controls the functions of the image analysis unit 311, the identification information reception unit 312, the monitoring processing unit 313, the database management unit 314, the camera adjustment request unit 315, and the antenna adjustment request unit 316 Can be performed. A camera control unit 315, and an antenna control request unit 316. The control unit 310 includes an image analysis unit 311, an identification information receiving unit 312, a monitoring processing unit 313, a database management unit 314, The purpose is to explain each function separately. Accordingly, the control unit 310 controls the functions of the image analysis unit 311, the identification information reception unit 312, the monitoring processing unit 313, the database management unit 314, the camera adjustment request unit 315, and the antenna adjustment request unit 316 And at least one processor configured to perform the processing. The control unit 310 includes an image analysis unit 311, an identification information reception unit 312, a monitoring processing unit 313, a database management unit 314, a camera adjustment request unit 315, and an antenna adjustment request unit 316 And at least one processor configured to perform some of the functions.

2, the passenger monitoring device 300, the camera device 330, and the short-range wireless communication base station 340 are separately formed. However, the present invention is not limited to this, have.

Hereinafter, a method of monitoring a passenger in the passenger monitoring system according to the present invention will be described with reference to FIGS. 5 to 6. FIG.

5 is a flowchart illustrating a process of monitoring a passenger according to an embodiment of the present invention.

Referring to FIG. 5, the passenger monitoring apparatus 300 receives an image photographed through a camera (S510), analyzes the photographed image, and confirms presence of a passenger (S512).

The passenger monitoring device 300 receives the identification information of the terminals located in the local communication area of the local area wireless communication base station 340 collected by the local area wireless communication base station 340 from the local area wireless communication base station 340 ). At this time, the identification information includes at least one of a telephone number of the terminals, a MAC address of the terminals, an electronic serial number (ESN) of the terminals, or an International Mobile Equipment Identity (IMEI) It can be one.

Then, the passenger monitoring apparatus 300 confirms whether or not the passenger is to be monitored using the information obtained by analyzing the photographed image and the collected identification information (S516).

If the collected identification information is not matched with the identification information stored in the user database 326 that stores the identification information for the authorized user in step S516, the identification information is present in the captured image, Or when the collected identification information is matched with the identification information stored in the monitoring target database 327 storing the identification information to the user registered as the monitoring target, .

If it is determined in step S516 that there is a passenger determined to be a monitoring target, the passenger monitoring device 300 transmits monitoring information on the passenger determined as a monitoring target to the monitoring server (S518). At this time, the monitoring information includes at least one of a time at which the passenger determined to be monitored is detected, a video of a passenger determined to be a monitoring target, identification information of a passenger determined to be a monitoring target, a position of a passenger determined to be a monitoring target, One can be included.

Then, the passenger monitoring device 300 stores the photographed image (S520).

6 is a flowchart illustrating a process of monitoring a passenger according to another embodiment of the present invention.

Referring to FIG. 6, the passenger monitoring device 300 receives an image photographed through a camera (S610), analyzes the photographed image, and confirms presence of a passenger (S612).

The passenger monitoring device 300 receives the identification information of the terminals located in the local communication area of the local wireless communication base station 340 collected by the local wireless communication base station 340 from the local wireless communication base station 340 ). At this time, the identification information includes at least one of a telephone number of the terminals, a MAC address of the terminals, an electronic serial number (ESN) of the terminals, or an International Mobile Equipment Identity (IMEI) It can be one.

Then, the passenger monitoring device 300 confirms whether the passenger is to be monitored using the information obtained by analyzing the photographed image and the collected identification information (S616).

If the collected identification information is not matched with the identification information stored in the user database 326 storing the identification information for the authorized user in step S616, the identification information is present in the captured image, Or when the collected identification information is matched with the identification information stored in the monitoring target database 327 storing the identification information to the user registered as the monitoring target, .

If it is determined in step S616 that there is a passenger determined to be a monitoring target, the passer-by monitoring device 300 transmits monitoring information on the passer determined as a monitoring target to the monitoring server (S618). At this time, the monitoring information includes at least one of a time at which the passenger determined to be monitored is detected, a video of a passenger determined to be a monitoring target, identification information of a passenger determined to be a monitoring target, a position of a passenger determined to be a monitoring target, One can be included.

Then, the passenger monitoring apparatus 300 requests the camera apparatus 330 to raise the image quality of the image to be photographed to a predetermined high image quality (S620). Then, the passenger monitoring device 300 stores the photographed image (S622).

On the other hand, if it is determined in step S616 that there is no passenger determined to be a monitoring target, the passenger monitoring device 300 requests the camera device 330 to set the image quality of the image to be photographed to a predetermined low quality (S624). In other words, the passenger monitoring device 300 requests the camera device 330 to continuously shoot a low quality image while shooting with a low image quality, and to lower the image quality to a low image quality when shooting with a high image quality

Then, the passenger monitoring device 300 stores the photographed image (S626).

A method for monitoring a passenger in a passenger monitoring system according to an exemplary embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and specific embodiments and drawings. However, it should be understood that the present invention is not limited to the above- And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

300; Passenger monitoring system
330; Camera device
340; Short-range wireless communication base station
10; communications network
20; Monitoring Server

Claims (16)

An image analyzer receiving an image photographed by a camera device at a predetermined position and analyzing the photographed image to confirm presence of a passer;
An identification information receiver for receiving identification information of terminals located within a short range communication range of the short range wireless communication base station collected by the short range wireless communication base station from the short range wireless communication base station; And
Determining whether to monitor the passenger using the information obtained by analyzing the photographed image and the collected identification information, generating monitoring information on the passenger determined as the monitoring target, To the monitoring server,
The surveillance processing unit analyzes the photographed image to confirm the direction of movement of the passenger determined as the surveillance target, and transmits the surveillance information to the other passageway monitoring apparatuses or other passageways located in the direction in which the passageways determined as the surveillance targets move And transmits it to the self-
Wherein the monitoring information includes a moving direction of the passenger determined to be the monitoring target
Passenger monitoring device. The method according to claim 1,
Wherein,
(ESN), a mobile phone number, or an international mobile device number, such as a telephone number of the terminals, a MAC address of the terminals, a data link number, a network layer address, a port number, And an International Mobile Equipment Identity (IMEI).
Passenger monitoring device. The method according to claim 1,
Further comprising a user database for storing identification information for an authorized user,
The monitoring processing unit,
If the collected identification information is not matched with the identification information stored in the user database or
If there is a passenger who is present in the photographed image but whose identification information is not collected
If at least one of the passers is satisfied,
Passenger monitoring device. The method according to claim 1,
Further comprising a monitoring target database for storing identification information in a user registered as a monitoring target,
The monitoring processing unit,
When the collected identification information is matched with the identification information stored in the monitoring target database, the passenger is determined as a monitoring target
Passenger monitoring device. The method according to claim 1,
The monitoring information includes:
A moving image of a passer determined to be a monitoring target, an image of a passer determined to be a monitoring target, identification information of a passer determined to be a monitoring target, a position of a passenger determined to be a monitoring target, Containing one
Passenger monitoring device. The method according to claim 1,
Further comprising a camera adjustment request unit requesting the camera apparatus to photograph an image in the same direction as the direction of the directional antenna when the short range wireless communication base station includes a directional antenna
Passenger monitoring device. The method according to claim 1,
Further comprising an antenna adjustment request unit for requesting the short range wireless communication base station to adjust the direction of the directional antenna in the same direction as the direction in which the camera captures when the short range wireless communication base station includes the directional antenna
Passenger monitoring device. The method according to claim 1,
The monitoring processing unit,
When the passenger is determined as an object to be monitored, requests the camera device to raise the image quality of the image taken by the camera device to a preset high image quality
Passenger monitoring device. The method according to claim 1,
The terminal comprises:
The short range wireless communication base station searches for the short range wireless communication base station and transmits the identification information so that the short range wireless communication base station can collect the identification information of the terminal
Passenger monitoring device. Receiving an image photographed through a camera device at a predetermined position;
Analyzing the photographed image to confirm presence of a passer;
Receiving identification information of terminals located within a short-range communication region of the short-range wireless communication base station collected by the short-range wireless communication base station from the short-range wireless communication base station;
Determining whether to monitor the passenger using information obtained by analyzing the photographed image and the collected identification information;
Analyzing the photographed image and confirming a moving direction of the passenger determined as the monitoring target;
Generating monitoring information on the passenger determined as the monitoring target, and transmitting the generated monitoring information to the monitoring server; And
And transmitting the monitoring information to the other occupant monitoring devices located adjacent to the other occupant monitoring devices or in a direction in which the occupant determined to be the monitoring object moves,
Wherein the monitoring information includes a moving direction of the passenger determined to be the monitoring target
A method of monitoring a passer in a passenger monitoring system. 11. The method of claim 10,
Wherein,
(ESN), a mobile phone number, or an international mobile device number, such as a telephone number of the terminals, a MAC address of the terminals, a data link number, a network layer address, a port number, And an International Mobile Equipment Identity (IMEI).
A method of monitoring a passer in a passenger monitoring system. 11. The method of claim 10,
Wherein the step of determining whether to monitor the passenger includes:
If the collected identification information does not match the identification information stored in the user database storing the identification information for the authorized user,
When there is a passenger who is present in the photographed image but whose identification information is not collected, or
When the collected identification information is matched with the identification information stored in the monitoring target database storing the identification information to the user registered as the monitoring target
If at least one of the passers is satisfied,
A method of monitoring a passer in a passenger monitoring system. 11. The method of claim 10,
The monitoring information includes:
A moving image of a passer determined to be a monitoring target, an image of a passer determined to be a monitoring target, identification information of a passer determined to be a monitoring target, a position of a passenger determined to be a monitoring target, Containing one
A method of monitoring a passer in a passenger monitoring system. 11. The method of claim 10,
The photographed image,
And the direction of the antenna is the same as the direction of the antenna for collecting the identification information of the terminal.
A method of monitoring a passer in a passenger monitoring system. 11. The method of claim 10,
And requesting the camera apparatus to raise the image quality of the image to be photographed to a predetermined high image quality if there is a passenger determined to be the monitoring target
A method of monitoring a passer in a passenger monitoring system. 11. The method of claim 10,
The terminal comprises:
Further comprising the step of searching for the short-range wireless communication base station and transmitting the identification information so that the short-range wireless communication base station can collect the identification information of the terminal
A method of monitoring a passer in a passenger monitoring system.

Images