JP2018136758A - Monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a monitoring system by which occurrence of abnormality is transmitted to a person concerned, even when a monitor that finds the abnormality does not communicate therewith.SOLUTION: According to a monitoring system 1, a video image acquisition unit 221 in a monitor center server device 20 acquires a video image that has been transmitted from a monitoring person's terminal 10. An acceleration information acquisition unit 222 acquires acceleration information that has been transmitted from the monitoring person's terminal 10. An abnormality determination unit 224 determines occurrence of an abnormal event (recognition abnormality) around a monitor, based on the acquired video image and acceleration information. A responder specifying unit 226 specifies the monitor that is dealing with the abnormal event (detection abnormality) detected by an abnormality detection unit 212. A second notification unit 225 notifies an operator of the occurrence of the abnormal event around the monitoring person wearing the monitoring person's terminal 10 used for detecting the abnormality in a case where a wearer wearing the monitoring person's terminal 10 at which the occurrence of the recognition abnormality is determined is not specified as the monitor that is dealing with the detection abnormality.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a technique for monitoring.

  Conventionally, a monitoring system that detects an abnormal event that has occurred in a monitoring area using a monitoring camera or the like installed in the monitoring area has been used. As another monitoring technique, for example, Patent Document 1 discloses that a wearer can record a video signal and an audio signal from a camera mounted on a helmet and an intercom by an encoding server stored in a waist pouch. A technique for recording video and audio while moving is disclosed.

JP 2006-148842 A

When a supervisor discovers an abnormality, it is desirable to immediately notify the occurrence of the abnormality to an appropriate partner (person in charge, person in charge, etc.) such as an operator of the monitoring center. In some cases, it is necessary to deal with the abnormality. At this time, if the monitoring center does not recognize the abnormal event, the monitoring system cannot be accurately grasped.
Therefore, an object of the present invention is to allow the occurrence of an abnormality to be transmitted to related parties even if a monitor who has found the abnormality does not contact the person concerned.

In order to achieve the above object, the present invention provides a monitoring system that detects an abnormal event that occurs in the vicinity of a supervisor using a mobile terminal possessed by the supervisor in the surveillance area, and is based on the movement of the supervisor. When the movement information acquisition means for acquiring the movement information of the mobile terminal and the movement of the monitor based on the acquired movement information deviate from the standard action that can be taken during normal monitoring, the monitor recognizes An abnormality determining means for determining that a supervisor cognitive abnormality that is an abnormal event has occurred; an informing means for informing the occurrence of the recognized supervisor cognitive abnormality;
A monitoring system is provided.

The monitoring system further includes an abnormality detection unit that detects an abnormal event based on an image captured by the monitoring device installed in the monitoring area, and the notification unit detects the supervisor cognitive abnormality as the abnormality detection unit. You may alert | report so that it can distinguish from the detection abnormality detected by.
In the above monitoring system, the monitoring system further includes storage means for storing a response status of the monitor to the abnormal event, and the notification unit deviates from the reference operation in response to the monitor responding to the abnormal event. In this case, the abnormal event recognized by the monitor may not be reported as a monitor cognitive abnormality.

In the above monitoring system, when the movement of the monitoring person deviates from the reference action for the monitoring person who owns the mobile terminal that exists in the vicinity of the monitoring person who is dealing with the abnormal event, the notification unit The abnormal event recognized by the monitor may not be reported as the monitor cognitive abnormality.
In the above monitoring system, further comprising a position acquisition means for acquiring the position of the mobile terminal, the notification means for a monitor possessing the mobile terminal existing in the abnormality occurrence area where the abnormal event is detected, When the motion of the monitor deviates from the reference motion, the abnormal event recognized by the monitor may not be notified as the monitor cognitive abnormality.

In the monitoring system, the movement information acquisition unit acquires an acceleration detected by the portable terminal in accordance with the movement of the monitor, and the abnormality determination unit determines that the monitor is in a case where the acceleration is equal to or greater than a threshold value. It may be determined that the movement of the movement deviates from the reference movement.
In the above monitoring system, the motion information acquisition unit acquires a video around the monitor imaged by the mobile terminal, and the abnormality determination unit detects a position of the object recognized from the video in the video. When the acceleration at the time of movement is equal to or greater than a threshold value, it may be determined that the movement of the observer deviates from the reference movement.
In the monitoring system, the motion information acquisition unit acquires the position of the mobile terminal, and the abnormality determination unit possesses the mobile terminal when the position of the mobile terminal deviates from a predetermined monitoring point. It may be determined that the movement of the observer deviates from the reference action.

  According to the present invention, the occurrence of an abnormality can be transmitted to the related parties without contacting a supervisor who has found the abnormality.

The figure showing the whole structure of the monitoring system which concerns on an Example A figure showing the monitor terminal attached to the monitor A diagram showing the hardware configuration of an observer terminal Diagram showing the functional configuration realized by the monitoring system The figure showing an example of the alerting | reporting information displayed The figure showing an example of the displayed surrounding map A figure showing an example of a monitor specification screen The figure showing an example of the correspondence situation memorized The figure showing an example of the operation screen of correspondence end The figure showing an example of the alerting | reporting information displayed The figure showing an example of the operation | movement procedure of each apparatus in a 1st alerting | reporting process. The figure showing an example of the operation | movement procedure of each apparatus in a 2nd alerting | reporting process. The figure showing the functional structure which the monitoring system 1a of a modification implement | achieves. A diagram representing an example of a collaborative area The figure showing the functional structure which the monitoring center server apparatus 20b of a modification implement | achieves.

[1] Embodiment FIG. 1 shows an overall configuration of a monitoring system 1 according to an embodiment. The monitoring system 1 is a system that supports the monitoring staff arranged in a defined monitoring area and the operator in the monitoring center in cooperation to monitor the monitoring area. As the monitoring area, in addition to an area in a facility where people gather such as department stores, amusement parks, concert venues, etc., a wide area such as a marathon or a parade course and its surroundings are determined. In addition, the observer means a person who has been given the role of monitoring the monitoring area on site for the purpose of ensuring the safety of surrounding people and things. The monitor is an example of the “monitor” according to the present invention.

  The monitoring system 1 includes a network 2, an intranet 3, a plurality of fixed cameras 4, a plurality of monitor terminals 10, a monitoring center server device 20, and an operator terminal 30. The network 2 is a communication system including a mobile communication network and the Internet, and mediates exchange of data between devices connected to the own system. The monitor terminal 10 is connected to the network 2 by wireless communication such as mobile communication or wireless local area network (LAN) communication, and the fixed camera 4 is connected by wired communication (or wireless communication).

  The intranet 3 is a communication system including, for example, a LAN and a WAN (Wide Area Network), and mediates data exchange between devices connected to the own system. The intranet 3 is connected to the network 2. A monitoring center server device 20 and an operator terminal 30 are connected to the intranet 3. The connection with the intranet 3 may be either wired communication or wireless communication.

  The fixed camera 4 is an imaging unit that is installed at the site of the monitoring area and captures surrounding images, and is an example of the “monitoring device” of the present invention. The fixed camera 4 transmits a video indicating the captured video to the monitoring center server device 20. Note that transmitting video means transmitting data indicating the video. In the following, performing processing such as transmission on various types of information means performing processing on data indicating the information. The fixed camera 4 may have a pan / tilt / zoom function and can be controlled by remote operation from the operator terminal 30 or the monitor terminal 10.

The supervisor terminal 10 is a terminal that is carried and carried by a supervisor arranged at the site of the surveillance area. The supervisor terminal 10 is an example of the “portable terminal” in the present invention. The supervisor terminal 10 is, for example, a smartphone, but may be a terminal made exclusively for this system.
FIG. 2 shows the monitor terminal 10 attached to the monitor. In FIG. 2, the supervisor A1 fixes the terminal case 5 to the body. The terminal case 5 is a container for storing the monitor terminal 10, and is fixed to the body (in detail, the chest) of the monitor by a band.

  The monitor terminal 10 includes a surrounding image capturing unit, and the terminal case 5 has a transparent portion where the lens of the capturing unit is located when the monitor terminal 10 is stored in its own case ( May be perforated). The monitor terminal 10 attached to the chest of the monitor takes a video in front of the monitor. In addition, the monitor terminal 10 includes acceleration measuring means. The monitor terminal 10 transmits the video imaged by the imaging unit and the acceleration measurement result by the measurement unit to the monitoring center server device 20.

  The monitoring center server device 20 is an information processing device that executes processing for managing the monitoring status of the monitoring area. The monitoring center server device 20 detects the occurrence of an abnormal event in the monitoring area using each transmitted information. An abnormal event here refers to an event that occurs in the monitoring area, which threatens the safety of surrounding people or is annoyed by the monitoring personnel (for example, convergence of the communication with related parties and the situation) Event, etc.), and may simply be called an abnormality or a case. Specifically, for example, the appearance of a suspicious person, the discovery of a suspicious object, the entry to a prohibited entry area, the jump to the road, the occurrence of an injured person, the occurrence of an accident, the occurrence of a fight, etc. are included in the abnormal events. When the monitoring center server device 20 detects the occurrence of an abnormal event, the monitoring center server device 20 notifies the operator by transmitting notification information indicating that fact to the operator terminal 30.

  The operator terminal 30 is a terminal used by the operator of the monitoring center. The operator terminal 30 notifies the operator of the occurrence of an abnormal event in the monitoring area by displaying notification information transmitted from the monitoring center server device 20 on, for example, a display unit. The operator who notices the occurrence of the abnormal event by this notification notifies the person in charge of the monitoring of the occurrence of the abnormal event, or contacts the monitor to instruct the response to the generated abnormal event. In this way, the monitoring system 1 detects an abnormal event that has occurred in the vicinity of the monitor using the monitor terminal 10 worn by the monitor in the monitor area, and detects the abnormal event that has occurred in the monitor area. To the operator, monitoring personnel, and the person in charge of monitoring) to support quick response to abnormal events.

  FIG. 3 shows the hardware configuration of the supervisor terminal 10. The supervisor terminal 10 is a computer including a processor 11, a memory 12, a storage 13, a communication device 14, an input device 15, an output device 16, a photographing device 17, and an acceleration sensor 18. The processor 11 includes a CPU (Central Processing Unit) and the like, and operates an operating system to control the entire computer. The processor 11 reads a program, data, and the like from the storage 13 and the communication device 14 to the memory 12, and executes various processes according to these.

  The memory 12 is a computer-readable recording medium such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage 13 is a computer-readable recording medium such as a hard disk drive and a flash memory. The communication device 14 performs communication between computers via a wireless network. The communication device 14 performs wireless communication based on, for example, mobile communication or wireless LAN standards.

  The input device 15 is an input device that accepts input from the outside. In the supervisor terminal 10, for example, it is a touch sensor, a button, a microphone, or the like. The output device 16 is an output device that performs output to the outside, such as a display and a speaker. The supervisor terminal 10 includes a touch screen in which the touch sensor of the input device 15 and the display of the output device 16 are integrated.

  The photographing device 17 includes a lens, an image sensor, a microphone, and the like, and photographs a surrounding person and a scene represented by light incident from the lens. The image sensor is a sensor that detects an image of the surroundings, and the microphone is a sensor that outputs information indicating ambient sounds. The photographing device 17 supplies the photographed video to the processor 11.

  In the present embodiment, the acceleration sensor 18 is a triaxial acceleration sensor, and supplies acceleration information indicating XYZ triaxial acceleration orthogonal to each other to the processor 11. As described with reference to FIG. 2, the monitor terminal 10 is used by being attached to the monitor. For this reason, the acceleration sensor 18 functions as a sensor that outputs information indicating the acceleration caused by the movement (behavior) of the observer.

  The monitoring center server device 20 is a computer including a processor, a memory, a storage, and a communication device. These are all hardware common to the devices having the same names shown in FIG. In the monitoring center server device 20, the communication device performs communication between computers via a wired or wireless network.

  The operator terminal 30 is a computer that includes a processor, a memory, a storage, a communication device, an input device, and an output device. These are all hardware common to the devices having the same names shown in FIG. In the operator terminal 30, the communication device performs communication between computers via a wired or wireless network, and a keyboard, a mouse, a microphone, and the like are used as the input device.

The functions described below are realized by the processor of each device included in the monitoring system 1 executing a program to control each unit.
FIG. 4 shows a functional configuration realized by the monitoring system 1. In FIG. 4, only one fixed camera 4 and one monitor terminal 10 are shown, but the other fixed cameras 4 and monitor terminals 10 have the same functional configuration.

  The fixed camera 4 includes an imaging unit 401 and a video transmission unit 402. The monitor terminal 10 includes an imaging unit 101, a video transmission unit 102, an acceleration measurement unit 103, and an acceleration information transmission unit 104. The monitoring center server device 20 includes a video acquisition unit 211, an abnormality detection unit 212, a first notification unit 213, a video storage unit 214, a video transmission unit 215, a correspondence status storage unit 216, and a video acquisition unit 221. , An acceleration information acquisition unit 222, a motion detection unit 223, an abnormality determination unit 224, a second notification unit 225, and a responder identification unit 226. The operator terminal 30 includes a notification information display unit 301, a surrounding map display unit 302, a video display unit 303, and an abnormality handling operation reception unit 304.

  The imaging unit 401 of the fixed camera 4 captures a video of the monitoring area, and supplies the captured video to the video transmission unit 402 in parallel while continuing the imaging. The fixed camera 4 stores a destination (IP (Internet Protocol) address or the like) of the monitoring center server device 20 and, for example, a camera ID (Identification) as identification information for identifying the own device. The video transmission unit 402 receives the video supplied from the imaging unit 401 using streaming technology, and transmits the received video to the monitoring center server device 20 in association with the camera ID of the own device in parallel. .

  The video acquisition unit 211 of the monitoring center server device 20 acquires the video and camera ID transmitted from the fixed camera 4. The video acquisition unit 211 supplies the acquired video and camera ID to the abnormality detection unit 212 and the video storage unit 214. The video storage unit 214 stores the video supplied from the video acquisition unit 211, that is, the video shot by the fixed camera 4 in association with the camera ID.

  The anomaly detection unit 212 is reflected in the video based on the video supplied from the video acquisition unit 211, that is, the video taken by the fixed camera 4 installed in the monitoring area (video from a fixed point where the fixed camera 4 is installed). An abnormal event (such as the appearance of a suspicious person described above) that occurs in a monitored area is detected. The abnormality detection unit 212 is an example of the “abnormality detection unit” in the present invention. The abnormality detection unit 212 applies, for example, techniques disclosed in Japanese Patent Application Laid-Open Nos. 2002-262282 and 2012-004720, analyzes the captured video, and detects these abnormal events (described later). "Detection error") is detected.

  When detecting the abnormal event, the abnormality detection unit 212 issues a detection ID for identifying the detected abnormal event, and determines the issued detection ID and the camera ID associated with the video used for detecting the abnormal event. 1 is supplied to the notification unit 213. In addition, the abnormality detection unit 212 supplies information (reproduction time, etc.) indicating a reproduction position when an abnormal event is detected to the video storage unit 214 together with the detection ID and the camera ID. The video storage unit 214 stores the information indicating the reproduction position and the detection ID in association with the video stored in association with the same camera ID.

  When the camera ID and the detection ID are supplied from the abnormality detection unit 212, the first notification unit 213 notifies the operator that an abnormal event has occurred around the fixed camera 4 with the supplied camera ID. The first notification unit 213 stores, for example, information in which the name of the fixed camera 4 that can be recognized by the operator (for example, “first camera”, “second camera”, etc.) and the camera ID are associated with each other. : "+ Name associated with the supplied camera ID + information indicating the character string" occurrence around! "And the camera ID and detection ID are generated as notification information. The 1st alerting | reporting part 213 alert | reports to an operator by outputting the produced | generated alerting | reporting information toward the operator terminal 30. FIG.

The notification information display unit 301 of the operator terminal 30 displays the notification information output from the monitoring center server device 20.
FIG. 5 shows an example of the displayed notification information. In the example of FIG. 5, the notification information display unit 301 displays a character string E1 “Warning: Abnormality around the first camera!” Indicated by the output notification information on the monitoring system screen. The operator can grasp that an abnormal event has occurred around the first camera installed in the monitoring area by viewing the notification information displayed in this way.

  In addition, the notification information display unit 301 displays a display button B <b> 1 written as “Display surrounding map”. When an operation of pressing the display button B <b> 1 is performed, the notification information display unit 301 supplies the camera ID indicated by the notification information to the surrounding map display unit 302. The surrounding map display unit 302 displays a surrounding map of the fixed camera 4 having the supplied camera ID.

  FIG. 6 shows an example of the displayed surrounding map. In the example of FIG. 6, the surrounding map display unit 302 includes K1 street and K3 street running north and south, K2 street and K4 street running east and west, K5 intersection where K1 street and K2 street intersect, and K2 street and K3 street. A map M1 showing a crossing K6 crest is displayed as a surrounding map. In addition, the surrounding map display unit 302 displays a camera image C1 indicating the position of the first camera and a range image C2 indicating the shooting range of the first camera on the map M1.

  The peripheral map display unit 302 stores, for example, the position, camera image, and range image of each fixed camera 4 in advance, and the position of the fixed camera 4 identified by the camera ID supplied from the notification information display unit 301 is stored. The corresponding camera image and range image are displayed. The operator can grasp the place where the abnormal event has occurred by viewing the surrounding map displayed in this way, and can give an instruction to direct the supervisor there.

  In addition, the notification information display unit 301 displays a display button B2 in which “display video” is written. When an operation of pressing the display button B <b> 2 is performed, the notification information display unit 301 supplies the camera ID and the detection ID indicated by the notification information to the video display unit 303. The video display unit 303 displays a video shot by the fixed camera 4 having the supplied camera ID. The video display unit 303 transmits, to the monitoring center server device 20, request data for requesting a portion including the reproduction position indicated by the information associated with the supplied detection ID in the video associated with the supplied camera ID. To do.

  When the video transmission unit 215 of the monitoring center server device 20 receives the transmitted request data, the video transmission unit 215 corresponds to the detection ID indicated by the request data among the videos stored in association with the camera ID indicated by the request data. A portion including the reproduction position indicated by the attached information and from the reproduction position to the present is read from the video storage unit 214. The video transmission unit 215 transmits the video read in this way to the requesting operator terminal 30. The video display unit 303 displays the transmitted video.

In addition, the notification information display unit 301 displays a display button B <b> 3 written “Specify corresponding monitor”. When the operation of pressing the display button B3 is performed, the notification information display unit 301 displays a screen for designating a monitor.
FIG. 7 shows an example of a monitor designation screen. In the example of FIG. 7, the notification information display unit 301 displays a character string “Please specify a corresponding monitor” and each monitor such as “monitor A1”, “monitor A2”,. A designation button group B5 for designation is displayed. The monitor designation screen is not limited to the example shown in FIG. 7. For example, the current state (for example, guarding, resting, handling, etc.) and the current position of the monitor are displayed in the list of the monitor. An icon indicating the position and state of each monitor may be plotted and displayed on the map of the monitoring area.

  When the operator performs an operation of pressing any one of the designated button group B5, the abnormality handling operation accepting unit 304 accepts this operation as a handling operation for dealing with the detected abnormal event. The notification information display unit 301 supplies the camera ID and detection ID indicated by the notification information to the abnormality handling operation reception unit 304. When the abnormality handling operation accepting unit 304 accepts an operation for designating a monitoring person as a handling operation, the monitoring center server apparatus 20 associates the monitoring person ID of the designated monitoring person with the supplied camera ID and detection ID. Send.

When the response status storage unit 216 of the monitoring center server device 20 receives each transmitted ID, the detected detection ID, camera ID, and monitoring person ID, and the time when these IDs are received are detected. It is stored as the response status (information indicating the response status) of the observer to the event. The correspondence status storage unit 216 is an example of the “storage unit” in the present invention.
FIG. 8 shows an example of the stored correspondence status. In the example of FIG. 8, the response status storage unit 216 stores a detection ID, a device ID, a corresponding monitor ID, a response start time, and a response end time as the response status.

  The device ID represents a terminal ID that identifies a monitor terminal 10 described later in addition to a camera ID. The corresponding start time is the time when the ID is received. The response status storage unit 216 stores character string information “in response” if the response is not yet completed as the response end time, and when the operator performs an operation to end the response, the operation is performed. Remember the time.

  FIG. 9 shows an example of an operation screen for ending correspondence. In the example of FIG. 9, the notification information display unit 301 displays a character string “Is the response by the supervisor A1 completed?” And a yes button B6. When the operator receives a notification from the supervisor A1 that the response to the abnormal event has ended, the operator performs an operation of pressing the Yes button B6. When the abnormality handling operation accepting unit 304 accepts this operation, the detection ID, camera ID, and monitoring person ID corresponding to the abnormal event that the monitoring person A1 has responded to the monitoring center server apparatus 20 together with the time when the operation is accepted. Send. The response status storage unit 216 updates the response end time associated with each transmitted ID to the transmitted time.

  The imaging unit 101 of the monitor terminal 10 captures a video of the monitoring area, and supplies the captured video to the video transmission unit 102 in parallel while continuing the imaging. The video transmission unit 102 receives the video supplied from the imaging unit 101 using streaming technology, and transmits the received video to the monitoring center server device 20 in association with the terminal ID of the terminal itself. .

  The acceleration measuring unit 103 of the monitor terminal 10 measures the triaxial acceleration of the terminal itself and supplies acceleration information indicating the measured acceleration to the acceleration information transmitting unit 104. The acceleration information transmitting unit 104 transmits the supplied acceleration information to the monitoring center server device 20 in association with the terminal ID of the own terminal. Measurement by the acceleration measuring unit 103 and transmission of acceleration information by the acceleration information transmitting unit 104 are repeatedly performed at regular time intervals (such as every second), for example.

  For example, each of the process of capturing an image by the image capturing unit 101, transmitting an image by the image transmitting unit 102, measuring an acceleration by the acceleration measuring unit 103, and transmitting an acceleration information by the acceleration information transmitting unit 104 is performed by a monitor. By performing a start operation for starting these processes for 10, until the end operation for ending these processes is performed, the monitor is repeatedly performed without performing any operation.

  The video acquisition unit 221 of the monitoring center server device 20 acquires the video transmitted from the supervisor terminal 10 (video around the supervisor taken by the supervisor terminal 10) and the terminal ID. When the monitor moves, one or both of the position and orientation of the monitor terminal 10 change accordingly, so that the display position of the photographing target included in this video also changes. That is, the acquired video is information representing the movement of the supervisor terminal 10 associated with the movement of the supervisor, and is an example of “motion information” in the present invention.

  The video acquisition unit 221 that acquires this video (or includes the imaging unit 101 and the video transmission unit 102) is an example of the “motion information acquisition unit” in the present invention. The video acquisition unit 221 supplies the acquired video to the video storage unit 214 and the motion detection unit 223 in association with the terminal ID. The video storage unit 214 stores the video supplied from the video acquisition unit 221, that is, the video shot by the supervisor terminal 10 in association with the terminal ID.

  The acceleration information acquisition unit 222 acquires acceleration information (acceleration detected by the monitor terminal 10 accompanying the movement of the monitor) and a terminal ID transmitted from the monitor terminal 10. This acceleration information is information representing the movement of the monitor terminal 10 accompanying the movement of the monitor, and is an example of “movement information” in the present invention. The acceleration information acquisition unit 222 that acquires the acceleration information (or includes the acceleration measurement unit 103 and the acceleration information transmission unit 104) is an example of the “motion information acquisition unit” in the present invention. The acceleration information acquisition unit 222 supplies the acquired acceleration information to the motion detection unit 223 in association with the terminal ID.

  As described above, since the transmission of video and the transmission of acceleration information from the supervisor terminal 10 are repeatedly performed, the acquisition of the video by the video acquisition unit 221 and the acquisition of acceleration information by the acceleration information acquisition unit 222 are also repeatedly performed. . The motion detection unit 223 detects the motion of the monitor through the motion of the monitor terminal 10 based on the video and acceleration information repeatedly acquired in this way, that is, the output of the sensor attached to the monitor.

  In the present embodiment, the motion detection unit 223 detects the motion of the monitor who deviates from the reference motion that can be taken during normal monitoring. The motion detection unit 223 detects the motion of such a monitor by the following two methods. In the first method, the motion detection unit 223 detects the above-described motion of the monitor when the acceleration indicated by the acquired acceleration information (acceleration detected by the acceleration sensor 18 included in the monitor terminal 10) is equal to or greater than a threshold value. To do.

  If a monitor wearing the monitor terminal 10 notices an abnormal event that has occurred in the surrounding area and changes the direction of the body toward the point of occurrence of the abnormal event or rushes to the point of occurrence, The position in space changes rapidly. Therefore, when the acceleration indicated by the acceleration information is greater than or equal to the threshold value, the motion detection unit 223 determines the position of the monitor terminal 10 based on the movement when the monitor notices the abnormal event or the action to deal with the abnormal event. The movement of the monitoring person is detected by assuming that it has changed suddenly, that is, deviated from the standard action that can be taken during normal monitoring.

  In the second method, the motion detection unit 223 detects the acceleration when the position of the object recognized from the acquired image (the surrounding image detected by the image sensor included in the observer terminal 10) moves in the image. When it is equal to or greater than the threshold value, the above-mentioned movement of the observer is detected. The motion detection unit 223 recognizes an object shown in the video using, for example, a well-known face recognition technology, vehicle recognition technology, sign recognition technology, white line recognition technology, or the like.

  The motion detection unit 223 repeatedly detects the position of the recognized object in the video at regular intervals, and calculates the acceleration when the position moves. As described above, when a monitor who notices an abnormal event changes the body direction toward the occurrence point of the abnormal event or rushes to the occurrence point, the direction of the monitor terminal 10 changes abruptly. For this reason, the position of the object reflected in the video taken by the supervisor terminal 10 also changes abruptly in the video.

  Accordingly, when the acceleration when the position of the object shown in the image moves is greater than or equal to the threshold value, the motion detection unit 223 detects the image of the object based on the movement when the observer notices an abnormal event. The above-mentioned movement of the observer is detected on the assumption that the position of the inside has suddenly changed, that is, deviated from the standard action that can be taken during normal monitoring. That is, in the second method, as in the first method, a motion for coping with the monitoring person is detected as a motion deviating from a reference motion that can be taken during normal monitoring. When the motion detection unit 223 detects the movement of the monitoring person, the motion detection unit 223 notifies the abnormality determination unit 224 to that effect.

  The abnormality determination unit 224 is a motion of the observer represented based on the video acquired by the video acquisition unit 221 and the acceleration information acquired by the acceleration information acquisition unit 222 (both are examples of “motion information” of the present invention). However, when it deviates from the standard action that can be taken during normal monitoring, it is determined that an abnormal event recognized by the observer has occurred. The function realized by the motion detection unit 223 and the abnormality determination unit 224 is an example of the “abnormality determination unit” in the present invention, and the determined abnormal event is an example of the “monitorer cognitive abnormality” in the present invention.

  In the present embodiment, since the motion detection unit 223 detects the motion of the monitor deviating from the reference motion, the abnormality determination unit 224 determines that the motion of the monitor is the reference when the notification from the motion detection unit 223 is received. It is determined that the operation deviates, and it is determined that an abnormal event has occurred. The motion detection unit 223 may detect the motion of the monitor when the monitor moves even a little. In that case, the motion detection unit 223 supplies the abnormality determination unit 224 with information indicating that the monitor has moved and information indicating the motion. Then, the abnormality determination unit 224 uses the first method and the second method described above in the same manner as the motion detection unit 223 to determine whether or not the monitor's motion deviates from the reference operation that can be taken during normal monitoring. To determine whether an abnormal event has occurred.

  As described above, the abnormality determination unit 224 determines the occurrence of an abnormal event (an abnormality that has occurred in the vicinity of the monitor) that the monitor has discovered and recognized by herself and has taken action for coping. Hereinafter, the abnormal event determined by the abnormality determination unit 224 is referred to as “cognitive abnormality”, and the abnormal event detected by the abnormality detection unit 212 is referred to as “detection abnormality”.

  When the abnormality determination unit 224 determines the occurrence of the cognitive abnormality, the abnormality determination unit 224 issues a determination ID for identifying the determined cognitive abnormality, the issued determination ID, and the terminal ID associated with the video used to detect the abnormal event, Is supplied to the second notification unit 225. This terminal ID is identification information for identifying the monitor terminal 10 worn by the wearer of the sensor used for detecting the cognitive abnormality.

  In addition, the abnormality determination unit 224 supplies information (reproduction time and the like) indicating the reproduction position of the video when the occurrence of the cognitive abnormality is determined to the video accumulation unit 214 together with the determination ID and the terminal ID. The video storage unit 214 stores information indicating the reproduction position and the determination ID in association with the video stored in association with the same terminal ID. The video thus stored is also transmitted by the video transmission unit 215 and displayed on the operator terminal 30.

  When the terminal ID and the determination ID are supplied from the abnormality determination unit 224, the second notification unit 225 generates an abnormal event recognized by a monitor (wearer) wearing the monitor terminal 10 of the supplied terminal ID. The operator is notified of this. The second notification unit 225 stores, for example, information that associates the names of monitoring personnel (for example, “monitoring personnel A1”, “monitoring personnel A2”, etc.) that can be recognized by the operator with terminal IDs. "+ Name associated with the supplied terminal ID + information indicating the character string" abnormality occurs around! ", The terminal D, and the determination ID are generated as notification information. The second notification unit 225 performs notification to the operator by outputting the generated notification information to the operator.

The notification information display unit 301 of the operator terminal 30 displays the notification information output from the monitoring center server device 20.
FIG. 10 shows an example of the displayed notification information. In the example of FIG. 10, the notification information display unit 301 displays a character string E3 “Warning: Abnormality around the monitor A1!” Indicated by the output notification information on the monitoring system screen.

  The notification information shown in FIG. 10 includes information on the name of the monitor, and is therefore distinguishable from the notification information shown in FIG. In this way, the second notification unit 225 notifies the cognitive abnormality determined to have occurred by the abnormality determination unit 224 so as to be distinguishable from the detection abnormality detected by the abnormality detection unit 212. The second notification unit 225 is an example of the “notification unit” in the present invention. The operator can grasp that an abnormal event has occurred in the vicinity of the monitor in the monitoring area by looking at the notification information indicating the occurrence of the cognitive abnormality displayed in this way.

  As described above, the monitoring center server device 20 detects the abnormal event by distinguishing the detection abnormality detected by the abnormality detection unit 212 from the cognitive abnormality determined by the abnormality determination unit 224, and makes the contents distinguishable from each other. The notification information is output to the operator terminal 30. For this reason, the operator is notified that a new abnormal event (cognitive abnormality) discovered by the supervisor on the spot is displayed separately from the abnormal event (detected abnormality) detected based on the video of the fixed camera 4. It can be grasped from the information.

  In addition, the notification information display unit 301 displays a display button B2 in which “display video” is displayed, as in the example of FIG. When the operation of pressing the display button B2 is performed, the video display unit 303 and the video transmission unit 215 perform the same operation as the example of FIGS. 5 and 9 using the terminal ID instead of the camera ID. The video display unit 303 displays video captured by the monitor terminal 10 having the supplied terminal ID. Thereby, the operator can confirm the state of the monitoring area when an abnormal event is detected from the video, and can also confirm the current state of the monitoring area.

  In addition, the 2nd alerting | reporting part 225 does not always alert | report, even when generation | occurrence | production of the cognitive abnormality mentioned above is determined. Even when the occurrence of a cognitive abnormality is determined, the second notification unit 225 responds to a detection abnormality detected by the abnormality detection unit 212 or a cognitive abnormality that has already been grasped by the wearer of the sensor used for the determination. When the person is an inside supervisor (hereinafter referred to as “responder”), the notification is not performed. That is, when the movement of the monitoring person who is coping with the detected abnormal event deviates from the reference action, the second notification unit 225 does not notify the abnormal event recognized by the monitoring person as a cognitive abnormality.

  When the terminal ID and the determination ID are supplied from the abnormality determination unit 224, the second notification unit 225 inquires the responder identification unit 226 about the responder in the detected detection abnormality. The responder specifying unit 226 specifies the responder in the detection abnormality detected by the abnormality detection unit 212. Upon receiving the inquiry from the second notification unit 225, the responder specifying unit 226 refers to the response status stored in the response status storage unit 216, and is associated with the response end time “corresponding”. The monitoring person identified by the monitoring person ID is identified as the corresponding person.

  The responder specifying unit 226 reads out the device ID associated with the monitor ID of the specified responder (for example, in the example of FIG. 8, the terminal ID “C01” is read out), and the read terminal The ID is supplied to the second notification unit 225. When the terminal ID supplied from the responder identification unit 226 matches the terminal ID supplied from the abnormality determination unit 224, the second notification unit 225 uses the monitor terminal 10 used for determination of cognitive abnormality. Since the wearer is identified as the responder (the monitor who is responding to the detection abnormality), no notification is made.

Each device provided in the monitoring system 1 performs a first notification process for notifying a detection abnormality occurring in the monitoring area and a second notification process for notifying a recognition abnormality occurring in the monitoring area, based on the above configuration.
FIG. 11 shows an example of the operation procedure of each device in the first notification process. This operation procedure is started, for example, when the fixed camera 4 is turned on and the operator performs an operation to display the monitoring system screen.

  First, the fixed camera 4 (image capturing unit 401) captures an image around the device itself (step S11). Next, the fixed camera 4 (video transmission unit 402) transmits the captured video to the monitoring center server device 20 (step S12). The monitoring center server device 20 (video acquisition unit 211) acquires the video transmitted from the fixed camera 4 (step S13). Next, the monitoring center server device 20 (video storage unit 214) stores the acquired video (step S14). The operations from step S11 to S14 are repeated.

  Subsequently, the monitoring center server device 20 (abnormality detection unit 212) analyzes the acquired video and detects an abnormal event (“detection abnormality” described above) that has occurred in the monitoring area shown in the video (step). S21). However, since an abnormal event may not be detected in step S21, in that case, the monitoring center server device 20 returns to step S12 and continues to operate.

  When an abnormal event is detected in step S21, the monitoring center server device 20 (first notification unit 213) indicates that an abnormal event has occurred around the fixed camera 4 that has transmitted the video in which the abnormal event has been detected. Notification information to be notified is generated (step S22), and the generated notification information is output to the operator terminal 30 (step S23). The operator terminal 30 (notification information display unit 301) displays the notification information output from the monitoring center server device 20 (step S24).

  Thereafter, when the operator performs an operation for designating a monitor corresponding to the abnormal event, the operator terminal 30 (abnormality response operation accepting unit 304) accepts this operation as a corresponding operation for responding to the detected abnormal event. (Step S31), the ID of the designated supervisor is transmitted to the monitoring center server device 20 (Step S32). The monitoring center server device 20 (response status storage unit 216) stores the transmitted ID and the like as the response status to the detected abnormal event (step S33).

  FIG. 12 illustrates an example of an operation procedure of each device in the second notification process. This operation procedure is started, for example, when the monitor attaches the monitor terminal 10 that has started the program and the operator performs an operation to display the monitor system screen. First, the monitor terminal 10 (shooting unit 101) captures an image of a monitoring area around the monitor (step S41). Next, the monitor terminal 10 (video transmission unit 102) transmits a video indicating the captured surrounding video to the monitoring center server device 20 (step S42).

  The monitoring center server device 20 (video acquisition unit 221) acquires the video transmitted from the supervisor terminal 10 (step S43). Next, the monitoring center server device 20 (video storage unit 214) stores the acquired video (step S44). The monitor terminal 10 (acceleration measuring unit 103) measures the triaxial acceleration of the terminal itself (step S51). Next, the monitor terminal 10 (acceleration information transmitting unit 104) transmits acceleration information indicating the measured acceleration to the monitoring center server device 20 (step S52).

  The monitoring center server device 20 (acceleration information acquisition unit 222) acquires the acceleration information transmitted from the monitor terminal 10 (step S53). The operations from step S41 to S53 are repeated. In addition, the operation | movement from step S41 to S44 and the operation | movement from step S51 to S53 may be performed in the reverse order, and may be performed in parallel. Next, the monitoring center server device 20 (motion detection unit 223) detects the motion of the monitor based on the acquired video and acceleration information, that is, the output of the sensor worn by the monitor (step S61). . Subsequently, the monitoring center server device 20 (abnormality determination unit 224) determines the occurrence of an abnormal event (“cognitive abnormality” described above) that occurs in the vicinity of the supervisor based on the detected movement (step S62). .

  However, since occurrence of an abnormal event may not be determined in step S62, in that case, the monitoring center server device 20 returns to before step S52 and continues to operate. If it is determined in step S61 that an abnormal event has occurred, the monitoring center server device 20 (corresponding person specifying unit 226) is responding to the abnormal event detected in step S21 of FIG. If there is a monitor, the monitor is specified as a corresponding person (step S63). And the monitoring center server apparatus 20 (2nd alerting | reporting part 225) judges whether the wearer of the monitoring person terminal 10 used for determination of cognitive abnormality was identified as the responder to detection abnormality (step S64). ).

  If it is determined in step S63 that the wearer has been identified as a corresponding person (YES), the monitoring center server device 20 returns to the operation before step S52 and continues the operation. If the monitoring center server device 20 (second notification unit 225) determines in step S63 that the wearer is not identified as a corresponding person (NO), the monitoring center server device 20 (second notification unit 225) uses the monitoring terminal 10 used to determine the cognitive abnormality. Notification information for notifying the operator that an abnormal event has occurred around the wearer is generated (step S65), and the generated notification information is output toward the operator terminal 30 (step S66). The operator terminal 30 (notification information display unit 301) displays the notification information output from the monitoring center server device 20 (step S67).

  In the present embodiment, the occurrence of an abnormal event is determined based on the output of a sensor (image sensor, microphone, acceleration sensor) included in the monitor terminal 10 worn by the monitor, and notification is made. At that time, the monitor does not need to operate the monitor terminal 10. Therefore, for example, when a monitor who discovers an abnormal event has to respond immediately to the abnormal event, even if the monitor does not contact the monitoring system 1, the occurrence of the abnormal event is transmitted to related parties such as operators. Can be.

  Specifically, for example, the occurrence of an abnormal event is determined when the acceleration indicated by the sensor output is greater than or equal to a threshold value. As a result, when the monitoring person finds an abnormal event and suddenly starts moving to the location, the operator can be notified of the occurrence of the abnormal event. The occurrence of an abnormal event is determined when the acceleration of the movement of the position of the object in the image indicated by the sensor output is equal to or greater than a threshold value. Thereby, even if the monitoring person who discovered the abnormal event does not move, for example, when the body suddenly changes direction, the occurrence of the abnormal event can be notified to the operator.

  However, if a detection abnormality is detected and the supervisor is instructed to respond to the abnormal event, the corresponding person (the supervisor who is responding to the detection abnormality) may rush to the place where the abnormal event occurs. The occurrence of cognitive abnormality may be determined by the movement of the responder by suddenly changing the direction with respect to the direction of occurrence of the abnormal event or running toward the location of occurrence of the abnormal event. Even in this case, when the notification is made, the operator misunderstands that, in addition to the detection abnormality, another cognitive abnormality has actually occurred, but the operator misunderstood, an inappropriate instruction (for example, detection abnormality) There is a risk that instructions will be sent to the place of occurrence excessively. In this embodiment, even if it is determined that a cognitive abnormality occurs based on the output of the sensor, if the wearer of the monitor terminal 10 equipped with the sensor is a person who responds to the detection abnormality, no notification is made. It is possible to prevent misunderstandings.

[2] Modifications The above-described embodiments are merely examples of the present invention, and may be modified as follows. Moreover, you may implement an Example and each modification in combination as needed.

[2-1] Cooperating to cope with abnormal events In the above-described embodiment, the monitoring person instructed by the operator to deal with the detected abnormality is identified as the responding person (the monitoring person who is handling the abnormal event). However, for example, if the scale of an abnormal event is larger than expected and the responder asks another monitor for support at his / her own discretion, the monitor who has been asked for support cooperates with the responder to respond to the abnormal event. It is possible that a sudden movement or sudden change in body orientation is detected, and a cognitive abnormality is detected from the output of the attached sensor. And since the request for support is made suddenly at the judgment of the site, there is a possibility that the operator does not grasp it and misunderstands that an abnormal event different from the detected abnormality has occurred. In this modification, the presence / absence of notification is determined so as to avoid such a situation.

  FIG. 13 shows a functional configuration realized by the monitoring system 1a of the present modification. In FIG. 13, the functions relating to the fixed point type abnormality detection shown in FIG. 4 are omitted. The monitoring system 1a includes a plurality of supervisor terminals 10a (only one is described because the functions are common) and a monitoring center server device 20a. The monitor terminal 10a includes a position measurement unit 105 and a position information transmission unit 106 in addition to the units illustrated in FIG. The monitoring center server device 20a includes a position information acquisition unit 227 and a cooperator determination unit 228 in addition to the units illustrated in FIG.

  The position measuring unit 105 measures the position of the terminal itself. The position measuring unit 105 supplies terminal position information (for example, latitude and longitude information) indicating the measured position of the terminal itself to the position information transmitting unit 106. The location information transmission unit 106 transmits the supplied terminal location information to the monitoring center server device 20 in association with the terminal ID of the terminal itself. The measurement by the position measurement unit 105 and the transmission by the position information transmission unit 106 are repeatedly performed without any operation by the monitor as in the case of the image and acceleration information of the embodiment.

  The position information acquisition unit 227 acquires the position of the monitor terminal 10a (specifically, position information indicating the position). The position information acquisition unit 227 is an example of the “position acquisition unit” in the present invention. The position of the monitor terminal 10a measured by the position measuring unit 105 represents the position of the monitor who wears the monitor terminal 10a. Therefore, the position information acquisition unit 227 acquires the plurality of terminal position information and the terminal ID respectively transmitted from the plurality of monitor terminals 10a as the respective positions of the plurality of monitor terminals 10a. The position information acquisition unit 227 supplies the acquired plurality of terminal position information and terminal ID to the collaborator determination unit 228.

  The collaborator determination unit 228 is provided with a position when the monitor (that is, the responder) specified by the responder specifying unit 226 as being in response to the detection abnormality is not the wearer of the monitor terminal 10a used for the determination of the cognitive abnormality. Based on the position information acquired by the information acquisition unit 227, it is determined whether or not the corresponding person and the wearer cooperate.

  Cooperation here means working together for the same purpose. Since the identified responder is a monitor who is responding to the detection abnormality, it is used for the purpose of responding to the detection abnormality. Hereinafter, a person who is dealing with a detection abnormality in the same manner as the responder, that is, a person who cooperates with the responder and responds to the detection abnormality is referred to as a cooperator. It can be said that the cooperator determination unit 228 determines whether or not the wearer is a cooperator.

  In this modification, the second notification unit 225 includes the terminal ID supplied from the abnormality determination unit 224 (the terminal ID of the monitor terminal 10a used by the wearer of the sensor used for detecting the cognitive abnormality) and the responder. When the terminal ID supplied from the specifying unit 226 (the terminal ID of the monitor terminal 10a used by the specified responder) is different, the terminal ID is supplied to the collaborator determining unit 228.

  First, the first determination method will be described. The collaborator determination unit 228 includes a terminal position associated with the same terminal ID as the two terminal IDs supplied from the second notification unit 225 among the latest plurality of terminal position information supplied from the position information acquisition unit 227. The distance between the positions indicated by the information is calculated. The distance thus calculated indicates the current distance between the counterpart and the wearer. The cooperator determination unit 228 determines that the cooperator and the wearer are cooperating when the calculated distance is less than the predetermined distance (that is, when the wearer is in the vicinity of the cooperator). As the predetermined distance, for example, a distance (for example, several meters) that allows the monitoring staff to talk with each other is determined.

  When the collaborator determination unit 228 performs the determination as described above, the collaborator determination unit 228 supplies the second notification unit 225 with determination result information indicating the determination result and the terminal IDs of the responder and the wearer. Even when a cognitive abnormality is detected, the second notification unit 225 does not perform notification when the supplied determination result information indicates a determination result. In other words, the second notifying unit 225 detects a monitoring person wearing the monitoring terminal 10a that is closer than a predetermined distance from the monitoring person who is dealing with the abnormal event while the monitoring person's movement is normal. When deviating from the obtained standard action, the abnormal event recognized by the monitor is not reported as a cognitive abnormality. Moreover, the 2nd alerting | reporting part 225 alert | reports to an operator that the abnormal event generate | occur | produced around a wearer, when the determination result information shows the determination result that it does not cooperate.

  For example, as described above, when the responder asks another monitor for support, the responder and the other monitor may cooperate with the detection abnormality while maintaining a distance that allows conversation. In this modification, in this case, since it is determined that the other monitor is cooperating with the responder, notification is not performed even if the occurrence of cognitive abnormality is determined by the movement of the monitor. As a result, as described above, it is possible to avoid a situation in which the operator misunderstands that an abnormal event (cognitive abnormality) other than the detection abnormality has occurred.

  Next, the second determination method will be described. Even if the distance between the wearer and the corresponding person calculated from the latest plurality of terminal position information is equal to or greater than the first threshold and the distance is less than the second threshold, the collaborator determination unit 228 has passed a predetermined time. The distance between the wearer and the corresponding person is calculated again from the above, and when the distance is less than the first threshold, it is determined that the corresponding person and the wearer are cooperating. As the second threshold value, for example, a distance (for example, several tens of meters) is set such that the monitoring partners can notice the other party if they make a loud voice or wave their hands. Further, as the predetermined time, a time (for example, several seconds to several tens of seconds) required for the wearer in a remote place to move to the corresponding person is determined.

  For example, if a responder who arrived at a location where a detection error occurred calls out to a monitor at a remote location or shakes his hand and asks for support, the monitor who is at a location that is at or above the first threshold at that time However, it will suddenly rush to approach the responder to a distance less than the first threshold. In this case, even if the occurrence of cognitive abnormality is determined at a position more than the first threshold distance from the corresponding person, the wearer is less than the first threshold after a predetermined time if the second determination method is used. When approaching the responder to the distance, it is determined that the responder and the wearer are cooperating. Also in this case, it is possible to avoid a situation in which the above misunderstanding occurs.

  Next, a third determination method will be described. The cooperating person determination unit 228 determines the cooperating person and the wearing person when the position of the corresponding person indicated by the latest plurality of terminal position information and the position of the wearing person are included in the same area (hereinafter referred to as “cooperative area”). Is determined to be cooperating. As the cooperation area, for example, an area is considered in which if an abnormal event occurs in the area, any monitoring person in the area can notice the abnormal event.

  FIG. 14 shows an example of a cooperative area. In the example of FIG. 14, in the map M <b> 1 shown in FIG. 6, a cooperative area F <b> 1 including four corners around the K5 intersection, a cooperative area F <b> 2 including two corners of the K6 crossing and a sidewalk opposite to the corner, A cooperative area F3 sandwiched between the intersection of K1 street and the K3 street of K4 street is shown. In any cooperative area, the entire area can be viewed at any position within the area. In addition to the above, the cooperative area may be defined at each intersection or each street.

  When the determination by the third determination method is performed, the second notification unit 225 determines the monitoring person (monitoring person other than the corresponding person) wearing the monitoring terminal 10a existing in the cooperative area where the corresponding person is located. When the movement of the monitor deviates from the standard action that can be taken during normal monitoring, the abnormal event recognized by the monitor is not reported as a cognitive abnormality.

  Depending on the contents of the abnormal event that occurred, the responder responded at the location where the abnormal event occurred, and asked other monitoring personnel at a distant location to keep people away from the location where the abnormal event occurred. The distance between the responder and the collaborator is the predetermined distance used in the first determination method or the second determination method used, such as catching a suspicious person who escapes from the place where the abnormal event occurred. There is a case where it does not approach until it becomes less than one threshold value. If the 3rd determination method is used, even in that case, a collaborator can be determined and the situation where said misunderstanding may arise can be avoided.

  Further, if the abnormal event discovered by the monitoring person is in the area where the abnormal event already known by the monitoring center has occurred, it can be considered that the same abnormal event is targeted. Therefore, the collaborator determination unit 228 stores the area where the abnormal event has occurred, and if the movement of the monitoring person is detected, the position of the monitoring person is included in the stored abnormality occurrence area. It may be determined that the wearer and the wearer are cooperating.

  In this case, the second notification unit 225 has a normal movement of the monitoring staff (corresponding person and other monitoring staff) wearing the monitoring staff terminal 10a existing in the abnormality occurrence area where the abnormal event is detected. When deviating from the standard action that can be taken during the time monitoring, it is determined that the cognitive abnormality by the monitor is not a new abnormal event, and the abnormal event recognized by the monitor is not reported as a cognitive abnormality. When the second notification unit 225 makes this determination, the second notification unit 225 may output notification information including the content indicating that the abnormal event has been grasped, and notify the operator to that effect.

[2-2] Utilization of Fixed Camera Video The method for avoiding the above-described misunderstanding by the operator (the misunderstanding that an abnormal event different from the detected abnormality has occurred) is not limited to the above. For example, you may utilize the image | video which the fixed camera 4 image | photographed.

  FIG. 15 shows a functional configuration realized by the monitoring center server device 20b of the present modification. The monitoring center server device 20b includes an in-video monitor specifying unit 229 in addition to the units shown in FIG. When detecting an abnormal event based on the video captured by the fixed camera 4, the abnormality detection unit 212 according to the present modification supplies the video that has detected the abnormal event to the in-video monitor identifying unit 229. The in-video monitor specifying unit 229 specifies a monitor shown in the video of the fixed camera 4.

  The in-video monitor specifying unit 229 stores, for example, feature quantities in images such as the face, height, physique, and clothes of each monitor. When the video is supplied from the abnormality detection unit 212, the in-video monitor specifying unit 229 calculates the feature amount at each point of the video, and the similarity with the feature amount of any of the monitor exceeds a threshold value In this case, the monitor is identified as the monitor shown in the video. The in-video monitor specifying unit 229 supplies the terminal ID of the monitor terminal 10 used by the specified monitor to the second notification unit 225.

  When the terminal ID supplied from the abnormality determination unit 224 is the same as the terminal ID supplied from the in-video monitor specifying unit 229, the second notification unit 225, that is, the video of the camera used to detect the detection abnormality When the wearer of the monitor terminal 10 used for determining the cognitive abnormality is identified, no notification is performed. There is a high possibility that the monitoring person shown in the video of the camera used to detect the detection abnormality is aware of the detected detection abnormality compared to the monitoring person who is not shown in the video.

  Therefore, even if the occurrence of a cognitive abnormality is determined based on the output of the sensor of the monitor shown in the video, it is considered that it is determined by the movement of the monitor who noticed the detection abnormality. In this modification, in this case, it is possible to avoid a situation in which the operator misunderstands that a cognitive abnormality has occurred separately from the detection abnormality. Moreover, even if the position information indicating the positions of a plurality of monitoring personnel is not acquired as in the above-described example, this situation can be avoided by utilizing the video used for detecting the detection abnormality.

[2-3] Method for Determining Occurrence of Cognitive Abnormality The abnormality determining unit 224 may determine the occurrence of a cognitive abnormality by a method different from the above embodiment. For example, when the position of the monitor terminal 10a acquired by the position information acquisition unit 227 shown in FIG. 13 deviates from a predetermined monitoring point, the abnormality determination unit 224 moves the monitor who wears the monitor terminal 10a. Is determined to deviate from the standard action that can be taken during normal monitoring, and it is determined that a cognitive abnormality has occurred. The predetermined monitoring point is, for example, a position determined so that a monitoring person stands up.

  In the present modification, the position of the supervisor terminal 10a is information representing the movement of the supervisor terminal 10a accompanying the movement of the supervisor, and is an example of “movement information” in the present invention. The position information acquisition unit 227 that acquires the position is an example of the “motion information acquisition unit” in the present invention. According to this modification, for example, even if a standing monitor heads to the place of occurrence of an abnormal event recognized by a motion that does not involve a rapid change in acceleration or video, the occurrence of the abnormal event can be determined. it can. The abnormality determination unit 224 may determine the occurrence of a cognitive abnormality by combining a plurality of types of information acquired from the monitor terminal, such as the above-described acceleration, video (change in imaging target), position information, and the like.

[2-4] Possession of a supervisor terminal A supervisor does not necessarily have to wear a supervisor terminal, and may be put in a pocket or held by hand. In short, it is only necessary for the monitor to carry the monitor terminal. Even in that case, if the observer who discovers the abnormal event makes a sudden movement / behavior, the observer terminal will also make a sudden movement, so it is possible to detect the movement of the observer through the movement of the observer terminal. It is.

[2-5] Monitoring Area Monitor In the above embodiment, the monitoring staff arranged in the monitoring area is a monitoring role playing a role of monitoring in the monitoring area, but this is not restrictive. For example, the staff other than the supervisor working in the surveillance area may be the supervisor. Specifically, for example, when the marathon venue is a monitoring area, the staff is a venue guide, course organizer, water supply staff, spectator guide, etc., and when an amusement park or department store is a monitoring area, In addition to security guards equivalent to surveillance personnel, they are ticket sales staff, store clerk, and cleaning staff.

  Moreover, it is not limited to humans, and may be, for example, a self-propelled robot with a built-in monitoring camera or an animal (such as a dog trained like a police dog) equipped with a monitor terminal. Each of these persons has the ability and role to inform the appropriate person in charge or responsible person that the abnormal event has occurred when any abnormal event occurs in the monitoring area. Can act as a watcher.

  These supervisors may be equipped with terminals such as the supervisor terminal 10, or by using a fixed camera as in the example of FIG. 11, without attaching a terminal such as the supervisor terminal 10. However, it may be possible to fulfill the role of a supervisor. Even if the supervisor himself / herself does not have the ability to convey the occurrence of an abnormal event, by attaching a terminal such as the observer terminal 10, the occurrence of the abnormal event can be conveyed by the function of the terminal. If you can, you can act as a watcher.

[2-6] Sensor The sensors provided in the monitor terminal worn by the monitor are not limited to those described above (image sensor and acceleration sensor). For example, an angular velocity sensor, a geomagnetic sensor, a positioning sensor (GPS (Global Positioning System), etc.) may be attached. In addition to these, any sensor may be used as long as a sudden change in output appears when a supervisor who notices an abnormal event makes a sudden movement. In any case, the abnormality determination unit 224 determines the occurrence of a cognitive abnormality when, for example, the amount of change in sensor output is greater than or equal to a threshold value.

[2-7] Detection Abnormality Detection Method In the above embodiment, the detection abnormality is detected based on the video (fixed-point video) taken by the fixed camera, but the detection abnormality detection method is not limited to this. For example, a detection abnormality detection unit (an example of the “second detection unit” of the present invention) detects a detection abnormality (for example, entry into a restricted area) based on the output of an infrared sensor provided in the prohibited area. .

[2-8] Corresponding Person Identification Method The corresponding person specifying unit 226 may specify the corresponding person by a method different from the embodiment. For example, when the monitoring person instructed to respond to the detection abnormality performs an operation for starting the response, the monitoring center server apparatus 20 displays the corresponding start information indicating that the monitoring terminal 10 has started the correspondence with the terminal ID of the own terminal. When the monitoring person performs an operation to end the response, the monitoring person terminal 10 transmits to the monitoring center server device 20 the response end information indicating that the terminal ID of the own terminal and the response is ended.

  The responder specifying unit 226 receives these pieces of information, and specifies, as a responder, a monitor who wears the monitor terminal 10 that has received the response start information but has not yet received the response end information. In addition, the responder specifying unit 226 acquires the position information of each monitor from the position information acquisition unit 227 shown in FIG. 13, and is included in the position of the fixed camera 4 that captured the video where the detection abnormality was detected or the shooting range thereof. A monitor who has a distance to the area that is less than the threshold may be identified as a counterpart.

  Further, the response instruction received from the monitoring center server device 20 is stored in the monitor terminal 10 during response, and the responder specifying unit 226 responds when the monitoring center server device 20 detects (determines) a cognitive abnormality. It may be specified whether the monitoring person is a responder by inquiring to the monitoring person terminal 10 that has received a countermeasure instruction. Furthermore, in the above embodiment, when the monitoring person who has found an abnormal event is a responder, the second notification unit 225 is configured not to perform abnormality notification for the cognitive abnormality. A configuration may be adopted in which it is determined whether or not the monitoring person is a responder at the stage of occurrence occurrence determination, and the occurrence of a new abnormal event (that is, cognitive abnormality) is determined when the person is not a responder.

[2-9] Notification Information The notification information output by the first notification unit 213 and the second notification unit 225 is not limited to that described in the embodiment. For example, the 1st alerting | reporting part 213 and the 2nd alerting | reporting part 225 may output the information which shows the content to alert | report with an audio | voice as alerting | reporting information. In that case, the operator terminal 30 outputs the notification information by voice from the speaker.

  In addition, when the operator terminal 30 includes an alarm device that issues an alarm by sound or light, the first notification unit 213 and the second notification unit 225 output information indicating an instruction to operate the alarm device as notification information. May be. In that case, when the operator terminal 30 receives the notification information, the operator terminal 30 operates the alarm device to generate sound or light. If the operator knows that the operation of the alarm device indicates the occurrence of an abnormal event, the operator can notice the occurrence of the abnormal event and instruct the monitor to take a response. Thus, the 1st alerting | reporting part 213 and the 2nd alerting | reporting part 225 should just output the information which can make an operator notice generation | occurrence | production of an abnormal event as alerting | reporting information.

[2-10] Output destination of the notification information The output destination of the notification information by the first notification unit 213 and the second notification unit 225 is not limited to the operator terminal. For example, the monitor terminal may be the output destination of the notification information. In this case, the monitor terminal displays the notification information, and the monitor notices the occurrence of the abnormal event by this display. Further, when the monitoring center server device includes an output device having a display or the like, the output device may be the output destination.

  Further, instead of the operator, the e-mail address of the person in charge of monitoring or the terminal used by this person may be used as the output destination. In any case, if you notice the occurrence of an abnormal event to the monitoring personnel such as the operator, monitor, or supervisor, you can respond quickly to the abnormal event. It may be the destination.

[2-11] Apparatus for Realizing Each Function The apparatus for realizing the functions shown in FIG. 4 and the like is not limited to the above-described apparatuses. For example, the monitoring center server device may include an input device and an output device, and each unit included in the operator terminal 30 may be realized. On the contrary, the operator terminal may realize each unit included in the monitoring center server device 20.

  Further, a function realized by the monitoring center server device may be realized by sharing a plurality of information processing devices. For example, the first device realizes the function from the video acquisition unit 211 to the response status storage unit 216, and the second device realizes the function from the video acquisition unit 221 to the responder specifying unit 226. In addition, another information processing apparatus may realize the motion detection unit 223 and the abnormality determination unit 224, and the second notification unit 225 and the responder identification unit 226. In any case, the above-described functions may be realized by the entire apparatus included in the monitoring system.

  In addition, the motion detection unit 223 may be provided in the monitor terminal. In this case, the motion detection unit 223 of the monitor terminal is based on the image captured by the image capturing unit 101 and the measurement value by the acceleration measurement unit 103, and the motion (behavior / behavior deviating from the actions that can be taken during normal monitoring). ) And the detected abnormal behavior is transmitted to the monitoring center server device 20. The monitoring center server device 20 that has received the notification that the abnormal behavior has been detected determines whether or not the monitoring person wearing the monitoring terminal 10 that is the transmission source is responding to the abnormality. Determine occurrence.

  In addition, it is good also as a structure which memorize | stores in the monitoring person terminal 10 to the response state of a monitoring person, and performs by a monitoring person terminal until determination of whether it is a response person, and determination of generation | occurrence | production of cognitive abnormality. Further, the fixed camera 4 may have a function of detecting a detection abnormality (at least a part of the function of the abnormality detection unit 212). In this case, the fixed camera 4 analyzes the video imaged by the imaging unit 401 to detect an abnormal event that has occurred in the monitoring area, and transmits the detected abnormal event to the monitoring center server device 20.

[2-12] Automation of instruction In the embodiment, an operator who uses the operator terminal 30 gives an instruction to the monitoring staff. However, in the future, an operator's work including this instruction may be automated. For example, using AI (Artificial Intelligence), if an abnormal event is detected based on the video captured by the fixed camera 4, a responder is selected from the monitoring personnel who can respond to the abnormal event. Then, necessary information (information indicating the location of occurrence of an abnormal event) is transmitted to the selected monitor. At this time, the response status shown in FIG. 8 is reflected in the status of “in response”, and when the responder notifies that the response to the abnormal event has ended, the response end time is reflected. In this way, work that can be realized by processing based on certain rules may be automated.

[2-13] Category of Invention The present invention can also be understood as a monitoring system including the monitoring terminal 10, the monitoring center server device 20, and the operator terminal 30, as well as these devices and the fixed camera 4. The present invention can also be understood as an information processing method for realizing processing performed by each device. It can also be understood as a program for causing a computer that controls each device to function. This program may be provided in the form of a recording medium such as an optical disk in which it is stored, or may be provided in the form of being downloaded to a computer via a network such as the Internet, installed and made available for use. May be.

DESCRIPTION OF SYMBOLS 1 ... Surveillance system, 4 ... Fixed camera, 10 ... Surveillance terminal, 20 ... Monitoring center server apparatus, 30 ... Operator terminal, 101 ... Imaging | photography part, 102 ... Image | video transmission part, 103 ... Acceleration measurement part, 104 ... Acceleration information transmission , 105 ... Position measuring section, 106 ... Position information transmitting section, 211 ... Video acquisition section, 212 ... Abnormality detection section, 213 ... First notification section, 214 ... Video storage section, 215 ... Video transmission section, 216 ... Corresponding situation Storage unit, 221 ... Image acquisition unit, 222 ... Acceleration information acquisition unit, 223 ... Motion detection unit, 224 ... Abnormality determination unit, 225 ... Second notification unit, 226 ... Corresponding person specifying unit, 227 ... Location information acquisition unit, 228 ... cooperator determination unit, 229 ... in-video monitor specifying unit, 301 ... notification information display unit, 302 ... peripheral map display unit, 303 ... video display unit, 304 ... abnormality handling operation reception unit.

Claims (8)

A monitoring system that detects an abnormal event that occurs in the vicinity of a monitor using a mobile terminal possessed by the monitor in the monitoring area,
Movement information acquisition means for acquiring movement information of the mobile terminal accompanying the movement of the monitor;
An abnormality determination that determines that a supervisor cognitive abnormality, which is an abnormal event recognized by the supervisor, has occurred when the movement of the supervisor based on the acquired movement information deviates from a reference action that can be taken during normal monitoring. Means,
Informing means for informing the occurrence of the recognized supervisor cognitive abnormality,
A monitoring system comprising: Furthermore, an abnormality detection means for detecting an abnormal event based on the video taken by the monitoring device installed in the monitoring area,
The notification means notifies the monitor cognitive abnormality in a distinguishable manner from the detection abnormality detected by the abnormality detection means,
The monitoring system according to claim 1. Furthermore, the storage means for storing the response status of the monitor to the abnormal event,
The notification means does not notify the abnormal event recognized by the monitor as a monitor recognition abnormality when the movement of the monitor currently dealing with the abnormal event deviates from the reference action,
The monitoring system according to claim 2. The informing means recognizes, when the movement of the monitoring person deviates from the reference action for the monitoring person who owns the mobile terminal existing in the vicinity of the monitoring person who is dealing with the abnormal event, Does not report the abnormal event as a monitor cognitive abnormality,
The monitoring system according to claim 3. Furthermore, it comprises a position acquisition means for acquiring the position of the mobile terminal,
The informing means recognizes, when the movement of the monitoring person deviates from the reference action, the monitoring person who has the mobile terminal existing in the abnormality occurrence area where the abnormal event is detected. Do not report an abnormal event as the observer cognitive abnormality,
The monitoring system according to any one of claims 1 to 4. The movement information acquisition means acquires an acceleration detected by the portable terminal along with the movement of the observer,
The monitoring system according to any one of claims 1 to 5, wherein the abnormality determination unit determines that the motion of the monitor deviates from the reference motion when the acceleration is equal to or greater than a threshold value. The movement information acquisition means acquires a video around the monitor imaged by the mobile terminal,
2. The abnormality determination unit determines that the movement of the observer deviates from the reference operation when an acceleration when a position of an object recognized from the image moves in a video is greater than or equal to a threshold value. 7. The monitoring system according to any one of 1 to 6. The movement information acquisition means acquires the position of the mobile terminal,
The abnormality determining means determines that the movement of a monitor carrying the mobile terminal deviates from the reference operation when the position of the mobile terminal deviates from a predetermined monitoring point.
The monitoring system according to any one of claims 1 to 7.

Images