JP7118806B2 - Suspicious person monitoring system - Google Patents

Description

The present invention is intended to detect when an abnormal situation such as a suspicious person entering a specific monitoring area is more likely to occur, and to notify a security guard or the like to prevent the occurrence of an abnormal situation. related to the suspicious person monitoring system.

In the event of an emergency such as an injured person due to the intrusion of a suspicious person into a specific area, a security light pole equipped with a reporting device, a loudspeaker, and a warning light can be used as a system to notify security personnel. is installed in a specific area and reported (see Patent Document 1, for example). A plurality of security light poles are installed in specific areas where unspecified people can enter, such as public facilities and university campuses. A call was made to the connected telephone device.
Therefore, security personnel can quickly recognize the occurrence of an abnormal situation, and if necessary, take necessary measures such as sounding an alarm from the loudspeaker installed on the security light pole or issuing a warning message. I was able to do it, and I was able to call attention to people around me.
On the other hand, there is a technique disclosed in Japanese Patent Application Laid-Open No. 2002-300002 as a technique for analyzing a person's movement and vibration based on an image captured by a camera and detecting a suspicious person in advance before he/she behaves abnormally.

JP 2010-282316 A JP 2017-169987 A

However, the system equipped with an emergency notification device such as the security light pole described above only enables prompt action in the event of an abnormal situation such as the occurrence of a crime, and cannot prevent an abnormal situation in advance. I didn't.

Therefore, in view of such problems, the present invention detects a suspicious person who may commit a crime from a camera-captured image, and furthermore, notifies the detected person to the security personnel so that it can be confirmed. An object of the present invention is to provide a suspicious person monitoring system capable of preventing the occurrence of an abnormal situation.

In order to solve the above-mentioned problems, the invention of claim 1 provides a monitoring device equipped with a plurality of cameras arranged in a monitoring area, a display for displaying images captured by the cameras, and a suspicious person detected from the images captured by the cameras. and a suspicious person notification device for notifying the suspicious person information to the outside. When the suspicious person determination unit monitors images captured by a plurality of cameras and detects a suspicious person from one of the images captured by one of the cameras, the image captured by the camera capturing the suspicious person is sent to the monitoring device. At the same time, a suspicious person detection signal is transmitted to the suspicious person notification device, and the suspicious person notification device receives the suspicious person detection signal and transmits suspicious person occurrence information to a pre-registered mobile phone. When a suspicious person is detected, the unit for judging a suspicious person selects a camera that captures the largest image of the suspicious person from the images captured by each camera. A map information storage unit that switches to the image captured by the selected camera and holds a map of the monitoring area in which the positions of the individual cameras are arranged on the map, and information on the camera selected by the suspicious person determination unit. and a trajectory display unit for displaying the map of the monitoring area in which the trajectory is generated .
According to this configuration, when a suspicious person who is highly likely to commit a crime is detected, the image of the detected camera is displayed on the display. Suspicious persons can be quickly monitored without Since the presence of a suspicious person is notified to a predetermined destination, the concerned parties can quickly recognize it and take measures before an abnormal situation occurs.
In addition, since the camera is automatically switched according to the movement of the suspicious person, the security guard or the like who is monitoring can continue monitoring without switching the displayed camera.
Furthermore, since the movement trajectory of the suspicious person is displayed on the trajectory display section, it is easy to predict the next action and to deal with the suspicious person.

According to the invention of claim 2, in the configuration of claim 1, the suspicious person occurrence information transmitted from the suspicious person notification device to the mobile phone includes an image that the suspicious person detection device is transmitting to the monitoring device. It is characterized in that URL information to be sent is also transmitted, and a captured image of a suspicious person captured by a camera can be obtained from a mobile phone that receives suspicious person occurrence information.
According to this configuration, since the image of the suspicious person can be obtained from the mobile phone to which the information of the suspicious person has been notified, the situation of the suspicious person can be confirmed by the image, and appropriate instructions can be issued even if the person is not at the scene. It becomes possible to respond.

According to the invention of claim 3, in the configuration of claim 1 or 2, the suspicious person detection device has an image processing unit for highlighting the detected suspicious person on the image, and the image displayed on the display is characterized in that the detected suspicious person is highlighted.
According to this configuration, the suspicious person is highlighted and displayed on the display in a display mode different from that of the surrounding persons, so that even if a plurality of persons appear in the image, the suspicious person can be easily identified.

According to the present invention, when a suspicious person is detected, the image captured by the detected camera is displayed on the display. It can be monitored quickly. Since the presence of a suspicious person is notified to a predetermined destination, the concerned parties can quickly recognize it and take measures before an abnormal situation occurs.

1 shows an example of a suspicious person monitoring system according to the present invention, and is a configuration diagram of a suspicious person monitoring system using an emergency reporting system for notifying the occurrence of an abnormality; FIG. It is a functional block diagram of a reporting device. It is a functional block diagram of a monitoring device. It is a functional block diagram of a suspicious person detection device. It is a functional block diagram of a broadcast device. FIG. 10 is an explanatory diagram of a map showing the movement trajectory of a suspicious person displayed on the monitoring device;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments embodying the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing an example of a suspicious person monitoring system according to the present invention, showing a configuration in which an emergency notification system for notifying an abnormal situation when it occurs in a specific area is provided with a suspicious person monitoring function. there is
1 is an emergency notification device for notifying the occurrence of an abnormality, 2 is a monitoring device for responding to a notification from the emergency notification device 1, 3 is a general notification device for making a general notification, and 4 is for paging for broadcasting. Speaker 5 is a paging device that controls the speaker 4 for paging.
6a is a signal conversion adapter for enabling communication between the monitoring device 2 and the general notification device 3, 6b is a paging adapter for enabling communication between the paging device 5 and the general communication device 3, and 7 is a camera. 8 is a mobile phone such as a smart phone.

A plurality of emergency call devices 1 and paging speakers 4 are installed in a specific area (monitoring area) such as a park or university campus. In addition, the monitoring device 2 is installed in a security room S provided in the area, and if there are a plurality of security rooms S according to the size of the monitoring area, the monitoring device 2 is installed at a plurality of locations.

The emergency call device 1 has a column-shaped housing 10 that is installed independently, and in addition to the function of notifying the occurrence of an abnormality in the housing 10, the call device 11 has the function of making a call, a speaker for broadcasting (loudspeaker) ) 12, a paging device 13 for controlling the broadcasting of the speaker 12, and a warning light 14 consisting of a revolving light for notifying the surroundings of the occurrence of an abnormality.
The paging device 13 is connected to the notification device 11 in addition to the speaker 12 and the warning light 14, and the warning sound from the speaker 12 and the warning operation of the warning light 14 are also activated by the operation of the notification device 11 in addition to the signal from the outside. be implemented.

The reporting device 11 is connected to the monitoring device 2 via the transmission line L1, and the monitoring device 2 is connected to the signal conversion adapter 6a via the transmission line L2. The signal conversion adapter 6a is connected to the LAN 9 via the transmission line L3, and is connected to the broadcast device 3 via the LAN9.
The paging speaker 4 is connected to the paging device 5 via the transmission line L4, and the paging device 5 is connected to the paging adapter 6b via the transmission line L5. The paging adapter 6b is connected to the LAN 9 via the transmission line L6, and is connected to the broadcast device 3 via the LAN9.

The simultaneous notification device 3 is connected to the communication network N and is configured to be able to communicate with the mobile phone 8 via the communication network N, and the paging adapter 6b is connected to the paging device 13 of the emergency notification device 1 via the transmission line L7. It is Moreover, the suspicious person detection device 7 is arranged on the cloud C and enables communication with each device via the LAN 9 .

FIG. 2 shows a functional block diagram of the reporting device 11. As shown in FIG. As shown in FIG. 2, an emergency call button 41, a call button 42, a call unit 43 equipped with a microphone and a speaker, a camera 44 for capturing an image of the surroundings in addition to capturing an image of the caller, and a camera 44 for transmitting images to the outside. A video processing unit 45 for performing processing such as modulation, a reporting device CPU 46 for controlling the reporting device 11, a reporting device communication IF 47 for communicating with the monitoring device 2, and the like are provided.
The call button 42 has the same function as the call button of a conventional intercom, and when pressed, a call signal is transmitted to the monitoring device 2, and when the monitoring device 2 is operated (answered) to make a call, a call can be made. . In addition, an image picked up by the camera 44 is displayed on the monitoring device 2 in conjunction with the reception of the call signal.

FIG. 3 shows a functional block diagram of the monitoring device 2. As shown in FIG. As shown in FIG. 3, the monitoring device 2 has a display 21 for displaying various information such as the image captured by the camera 44, and performs processing such as demodulation of the transmitted video signal to generate an image to be displayed on the display 21. An image processing unit 22, an operation unit 23 for performing various operations, a call unit 24 having a handset 24a, an image storage unit 25 for storing images, and a location information storage unit 27 for storing location information of each emergency call device 1. , a monitoring device CPU 28 for controlling the monitoring device 2, a monitoring device communication IF 29 for communicating with the reporting device 11 and the general reporting device 3, and the like.

FIG. 4 shows a functional block diagram of the suspicious person detection device 7. As shown in FIG. The suspicious person detection device 7 includes a display unit 71 for displaying images captured by a camera during detection of a suspicious person, a storage unit (camera position storage unit) 72a for the installed position of the camera 44 to be monitored, and a map information storage of the monitoring area. (map information storage unit) 72b, etc., a suspicious person determination unit 73 that determines a suspicious person from an image, an image processing unit 74 that processes a suspicious person image displayed on the display unit 71, and movement of a person to be monitored. A trajectory generation unit 75 that generates a trajectory, a suspicious person detection device CPU 76 that controls the suspicious person detection device 7, a network communication IF 77 that communicates with each device via the cloud C and LAN 9, and the like are provided.

FIG. 5 shows a functional block diagram of the broadcast device 3. As shown in FIG. The broadcast device 3 includes a message storage unit 31 for storing messages to be broadcast and messages to be reported, a report destination storage unit 32 in which destinations for broadcast reports including the number or address of the mobile phone 8 are registered, and the broadcast device 3 , a first communication IF 34 for connecting to the LAN 9, a second communication IF 35 for communicating with the mobile phone 8 and connected to the communication network N, and the like.

The operation of the suspicious person monitoring system (emergency notification system) configured as described above is as follows. First, the operation as an emergency call system will be briefly described.
When the emergency call button 41 of the emergency call device 1 is pressed, an emergency signal is transmitted from the call device 11 to the monitoring device 2, and an emergency call is made. In addition, an emergency signal is also transmitted from the notification device 11 to the paging device 13 by this operation. Upon receiving the emergency signal, the paging device 13 emits a warning sound from the speaker 12, and the warning light 14 starts rotating and emitting light.

On the other hand, in the monitoring device 2 that has received the emergency signal, a ringing tone is generated under the control of the monitoring device CPU 28, and an image captured by the camera 44 that transmitted the emergency signal is displayed on the display 21. FIG. Also, from the identification information of the notification device 11 included in the emergency signal, the location information of the notification device 11 is obtained by referring to the location information storage unit 27, and the emergency signal is transmitted from the monitoring device 2 to the simultaneous notification device 3 via the LAN 9. An anomaly notification signal is sent that includes the original location information.

Upon receiving the abnormality notification signal, the general notification device 3 transmits abnormality occurrence information including location information to the other emergency notification devices 1 and the paging speaker 4 in the monitored area, and causes them to sound an alarm. The abnormality occurrence information is transmitted to each emergency call device 1 via the paging adapter 6b, and each emergency call device 1 issues an alarm sound, and at the same time, the warning light 14 starts rotating and emitting light. Also, the paging speaker 4 issues an alarm sound through the paging device 5 .
After that, the speaker 12 of the emergency call device 1 and the paging speaker 4 sound a message including location information, such as a voice message based on the abnormality occurrence information, such as "Emergency call button for XX has been pressed."

In addition, the simultaneous notification device 3 that has received the abnormality notification signal also transmits abnormality occurrence information including location information to the mobile phones 8 registered in the notification destination storage unit 32 .
A message of anomaly occurrence information including location information such as, for example, "An emergency call has just been issued from an emergency call device installed at XX" is transmitted to the mobile phone of the report destination. This transmission is sent by e-mail, for example.

If the monitoring device 2, which receives an emergency signal and sounds a ringing tone, performs a response operation such as picking up the handset 2a, a communication path is formed with the emergency call device 1, and a call is made with the caller. can do. Also, when the call button 42 of the reporting device 11 is pressed, a calling signal is transmitted to the monitoring device 2 and a ringing tone sounds. No signal is sent to and the lighting state of the warning light 14 does not change.

Next, the operation of the suspicious person monitoring system will be described.
The suspicious person detection device 7 obtains images captured by the cameras 44 of all the emergency notification devices 1 within the monitoring area, and the suspicious person determination unit 73 detects the suspicious person. The suspicious person discriminating unit 73 first extracts a person from all captured images obtained, monitors the movement and expression of the extracted person, and detects a suspicious person.
When the emergency report button 41 of the reporting device 11 is pressed, the monitoring is interrupted with priority given to the emergency report.

The suspicious person detection device 7 detects a suspicious person by applying the technique of Patent Document 2, for example. For example, a large number of behaviors unique to a suspicious person are stored in advance, and the behavior of a person detected from a captured image is compared with the stored behavior. to decide. In addition, if facial expressions can be recognized, a large number of facial expressions (extracted vibration components) unique to a suspicious person are stored, and the human facial expressions (extracted vibration components) detected from the captured video are added to the stored numerical values. If the values are close to each other, or if they match, it is determined that the person is suspicious.

When a suspicious person is detected by this monitoring, the image is displayed on the display unit 71 under the control of the suspicious person detection device CPU 76 . That is, the image captured by the camera 44 that has detected the suspicious person is displayed on the display section 71 . Also, this image is transmitted to the monitoring device 2 via the LAN 9 and displayed on the display 21 of the monitoring device 2 .
However, when a suspicious person is detected, the image is processed by the image processing unit 74, and the suspicious person is highlighted. For example, an image is generated in which the entire suspicious person is surrounded by a rectangular frame and can be distinguished from other persons at a glance, and is displayed on the display unit 71 and the display 21 (not shown).

Also, a suspicious person detection signal is transmitted from the suspicious person detection device 7 to the simultaneous notification device 3 . Upon receiving the suspicious person detection signal, the simultaneous notification device 3 transmits suspicious person occurrence information including location information to the mobile phones 8 registered in the destination storage unit 32 .
A suspicious person occurrence information message including location information such as, for example, "A suspicious person has just been detected by the emergency call device installed in XX" is transmitted to the mobile phone 8 of the report destination. This transmission is sent by e-mail, for example.
The URL information of the suspicious person image displayed on the display unit 71 is attached to this e-mail, and the suspicious person image can be confirmed by the mobile phone 8 by performing a predetermined display operation.

The suspicious person determination unit 73 that has detected the suspicious person continues to monitor the images captured by the cameras 44 of all the emergency notification devices 1, and determines the camera 44 in which the detected suspicious person is captured. The camera 44 with the largest image is selected, and the image captured by the camera 44 is displayed on the display unit 71 and the display 21 .
By this switching, even if the suspicious person moves within the monitoring area, the camera 44 that captures the largest image of the suspicious person is switched to continue the display, and the moving suspicious person can be continuously confirmed.

Further, in response to the detection of the suspicious person, the trajectory of the detected suspicious person is generated by the trajectory generation unit 75 . Based on the information of the camera 44 switched by the suspicious person determination unit 73 and the position information of the camera 44 and the map information of the monitored area stored in the storage unit 72, the movement trajectory of the suspicious person is calculated and displayed on the map of the monitored area. generated.

FIG. 6 shows a map of the monitoring area displaying the moving trajectory of the suspicious person thus displayed. Q is the movement trajectory, Q1 is the first detected location, Q2 is the current location, and the interim movement trajectory obtained by calculation is indicated by the dotted line Q3.
Incidentally, icons A1 to A4 shown in FIG. 6 indicate the emergency call device 1 and indicate the positions of the four installed emergency call devices. That is, it indicates the location of the camera 44 to be monitored. Further, B1, B2, and B3 indicate buildings such as buildings, and S indicates a guard room in which the monitoring device 2 is installed. Also, D indicates a monitor camera installed separately.

The map displaying the generated movement trajectory is displayed on the display unit 71 and the display 21 together with the image of the suspicious person on two screens, or is displayed instead of the image of the suspicious person. Incidentally, the image displayed on the display 21 may be switched and displayed by the display operation of the monitoring device 2 .
Further, the map on which the movement locus Q is displayed can be obtained from the cellular phone 8 that has received the suspicious person occurrence information by performing a predetermined obtaining operation in the same manner as the suspicious person image, and can be displayed.

In this way, when a suspicious person who is highly likely to commit a crime is detected, the image captured by the detected camera 44 is displayed on the display 21, so that a security guard or other observer selects the camera 44 capturing the suspicious person. A suspicious person can be quickly monitored without any operation. Since the existence of a suspicious person is notified to a predetermined destination, the concerned parties can quickly recognize it and take measures before an abnormal situation occurs.
In addition, since the image of the suspicious person can be obtained from the cellular phone 8 notified of the suspicious person information, the situation of the suspicious person can be confirmed by the image, and appropriate instructions can be issued to respond to the suspicious person even if the person is not at the scene. becomes possible.
Furthermore, the suspicious person is highlighted and displayed on the display 21 in a display mode different from that of the surrounding persons. Therefore, even if a plurality of persons appear in the image, the suspicious person can be easily identified.
In addition, since the camera 44 is automatically switched according to the movement of the suspicious person, the guard or the like who is monitoring can continue monitoring without switching the camera 44 to be displayed. Furthermore, since the movement miracle of the suspicious person can be displayed on the display 21 and the mobile phone 8, it is easy to predict the next action and to deal with the suspicious person.

In the above-described embodiment, the case where only one suspicious person is detected has been described, but it is also possible to detect a plurality of suspicious persons at the same time.
In addition, the camera 44 of the emergency notification device 1 is used as the camera for monitoring the image for detecting a suspicious person, but the monitoring camera D may be added to this.
In addition, notification of abnormal occurrence and notification of suspicious person detection are performed by e-mail, but notification may be performed by short mail or by using SNS (Social Networking Service) represented by LINE (registered trademark). You can In particular, LINE (registered trademark) is easy to attach video data and can be used easily.

1 Emergency notification device 2 Monitoring device 3 Simultaneous notification device (Suspicious person notification device) 7 Suspicious person detection device 8 Mobile phone (trajectory display unit) 9 LAN 10 . Housing 11. Notification device 21. Display (trajectory display unit) 24. Call unit 27. Location information storage unit 28. Monitoring device CPU 31.. Message storage unit 32. Report destination storage unit 33 Simultaneous reporting device CPU 44 Camera 71 Display unit 72 Storage unit 72a Camera position storage unit 72b Map information storage unit 73 Suspicious person determination unit 74 Video processing unit 75 Trajectory generation unit 76 Suspicious person detection device CPU N Communication network C Cloud.

Claims (3)

A plurality of cameras arranged in a monitoring area, a monitoring device equipped with a display for displaying images taken by the cameras, a suspicious person detection device for detecting a suspicious person from the images taken by the cameras, and transmitting suspicious person information to the outside. and a suspicious person notification device that notifies
The suspicious person detection device has a suspicious person determination unit that detects a suspicious person who is highly likely to commit a crime based on their actions or facial expressions,
When the suspicious person determination unit monitors images captured by a plurality of cameras and detects a suspicious person from the images captured by any one of the cameras, the image captured by the camera capturing the suspicious person is transmitted to the monitoring device. together with, transmitting a suspicious person detection signal to the suspicious person notification device,
The suspicious person notification device receives the suspicious person detection signal and transmits suspicious person occurrence information to a pre-registered mobile phone ,
When a suspicious person is detected, the suspicious person determination unit selects a camera in which the suspicious person is captured in the largest size from the images captured by each camera, and
The suspicious person detection device switches an image to be transmitted to the monitoring device to an image captured by the camera selected by the suspicious person determination unit,
Furthermore, a map information storage unit that holds a map of the monitoring area in which the positions of the individual cameras are arranged on the map;
a trajectory generation unit that generates a movement trajectory of the suspicious person on the map of the monitoring area based on the information of the camera selected by the suspicious person determination unit;
and a trajectory display unit for displaying a map of the monitoring area for which the movement trajectory is generated . The suspicious person occurrence information transmitted from the suspicious person notification device to the mobile phone is transmitted together with URL information that makes it possible to obtain the image transmitted from the suspicious person detection device to the monitoring device,
2. A suspicious person monitoring system according to claim 1, wherein a video captured by a camera in which said suspicious person is imaged can be obtained from a cellular phone that has received said suspicious person occurrence information. The suspicious person detection device has an image processing unit for highlighting the detected suspicious person on the image,
3. A suspicious person monitoring system according to claim 1, wherein the image displayed on said display highlights the detected suspicious person.

Images