JP2016066314A - Security service system and security service method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve an efficient security service in a circumstance in which the number of installed information acquisition devices such as an imaging device and a sensor, is insufficient.SOLUTION: The security service system is configured in such a manner that: upon detecting that a security guard pays special attention different from that in a normal time to a person or an object, on the basis of information acquired by various information acquisition devices worn by the security guard, such as a wearable camera 10, a motion sensor 21, a biological information sensor 22, and an environmental information sensor 23, determination of whether or not the person or the object, to which the security guard pays the special attention, is an object to be watched is performed; and the security guard is notified of the determination result and a handling process according to the determination result.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a security system and a security method for realizing security in cooperation with a security guard.

  2. Description of the Related Art Conventionally, a technique for detecting a suspicious person based on image information of a predetermined monitoring area acquired by an imaging device is known. For example, in Patent Document 1, an image of a visitor is captured by an imaging device that is fixedly installed in an apartment house or the like, and the face image of the visitor extracted from the captured image, and the behavior of the visitor analyzed from the captured image Based on the above, a technique for determining whether or not the visitor is a suspicious person is disclosed. Specifically, the extracted face image of the visitor is collated with the face image of a resident such as a housing complex, and among the visitors determined not to be resident, the visitors whose behavior is determined to be suspicious A technique for determining a suspicious person is disclosed.

JP 2006-120084 A

  However, in the technique of Patent Document 1, it is necessary that the imaging device is fixedly installed, and it is not possible to detect a suspicious person in an area where the imaging device is not installed. Even if an imaging device is installed, a large number of face images may be detected when a place where a large number of persons are subject to suspicious person detection, such as a theme park, is to be monitored. A collation process is performed, and a large-scale system corresponding to the processing amount is required. On the other hand, it is possible to reduce the size of the system by narrowing down the number of installed imaging devices, but narrowing down the number of installed imaging devices increases blind spots and cannot detect suspicious persons appropriately. Become.

  As described above, in the conventional technique, there is a problem that the security efficiency is remarkably reduced in a situation where the number of image pickup apparatuses installed is insufficient. Such a problem is not limited to security using an imaging device, but occurs in common when a sensor is installed to protect a target area.

  For these reasons, an important issue is how to realize a system that can efficiently perform security even when the number of information acquisition devices such as imaging devices and sensors is insufficient. Yes.

  The present invention is intended to solve the above-described problems of the prior art, and a security system and a security method for realizing efficient security in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient. The purpose is to provide.

  In order to solve the above-described problems and achieve the object, the invention according to claim 1 is an information acquisition unit that is carried or worn by a guard and acquires information around the guard, and the state of the guard A guard state determination means for detecting the object, a detection means for detecting an object existing around the guard as an evaluation target based on the information acquired by the information acquisition means, and the guard state determination means A security target evaluation unit that evaluates the object as a security target using the information acquired by the information acquisition unit related to the object detected as the evaluation target by the detection unit. It is characterized by that.

  The invention according to claim 2 is the invention according to claim 1, wherein the information acquisition means acquires at least image information in a direction in which the face of the guard is facing, and the guard state determination means. Uses the image information acquired by the information acquisition means to determine a state in which the guard is paying special attention to an object included in the image of the image information, and the detection means includes the security An object to which the guard is paying special attention is detected as the evaluation target by a guard state determination unit, and the guard target evaluation unit is included in the image of the image information by the guard state determination unit. When it is determined that the object is in a state of special attention, the image information acquired by the information acquisition unit related to the object is used to evaluate the object as a warning target. Toss .

  In addition, the invention according to claim 3 is the evaluation result for the guard in the invention according to claim 1 or 2, when the guard object evaluation means evaluates that the object to be evaluated is required to be warned. It is further characterized by further comprising an evaluation result notifying means for notifying.

  Further, in the invention according to claim 4, in the invention according to claim 1, 2, or 3, when it is evaluated by the guard target evaluation means that it is necessary to deal with the object to be evaluated, It is characterized by further comprising procedure notifying means for notifying information relating to the handling procedure.

  The invention according to claim 5 is the invention according to any one of claims 1 to 4, wherein the information acquired by the information acquisition means includes audio information, position information, and security, in addition to image information. It includes one or a plurality of pieces of information relating to an operation of a worker, information relating to the living body of the security guard, and information relating to the environment.

  Moreover, the invention according to claim 6 is the invention according to any one of claims 1 to 5, wherein the security object evaluation means is an image of the image information by the security guard state determination means. When it is determined that the person in the image is in a state of special attention, the similarity between the image information related to the person acquired by the information acquisition unit and the image information of the person who needs to be alerted is determined. When the similarity is high, the person is evaluated as a person who needs to be alert.

  The invention according to claim 7 is an information acquisition step of acquiring information around the guard by means of a device carried or attached to the guard, and a guard state determination step of determining the state of the guard And a detection step of detecting an object existing around the guard based on the information acquired by the information acquisition step as an evaluation target, a state of the guard determined by the guard state determination step, and And a security target evaluation step for evaluating the object as a security target using the evaluation target and the information acquired in the information acquisition step relating to the object detected in the detection step.

  According to the present invention, information around the guard is acquired by a device carried or attached to the guard, the state of the guard is determined, and the guard's surroundings are determined based on the obtained information around the guard. Detecting an existing object as an evaluation target, using the state of the determined security guard, and information about the guard's surroundings acquired by a device carried or attached to the security guard on the object detected as the evaluation target, Since an object detected as an evaluation target is evaluated as a warning target, efficient security can be realized in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient.

FIG. 1 is a diagram for explaining an outline of processing related to detection of a suspicious person in security realized by a security system in cooperation with a security guard according to the present embodiment. FIG. 2 is a system configuration diagram of the security system according to the present embodiment. FIG. 3 is a block diagram showing a functional internal configuration according to the present embodiment of the mobile terminal device shown in FIG. FIG. 4 is an explanatory diagram for explaining a data configuration according to the present embodiment of the mobile terminal device shown in FIG. FIG. 5 is a block diagram showing a functional internal configuration according to the present embodiment of the control center server shown in FIG. FIG. 6 is an explanatory diagram (part 1) for explaining the data configuration according to the present embodiment of the control center server shown in FIG. FIG. 7 is an explanatory diagram (part 2) for explaining the data configuration according to the present embodiment of the control center server shown in FIG. FIG. 8 is a flowchart showing a processing procedure when the control center server receives information from the mobile terminal device. FIG. 9 is a flowchart showing the procedure of the blacklist search incident detection process in the received data analysis process shown in FIG. FIG. 10 is a flowchart showing a processing procedure of blacklist search processing in the output data generation processing shown in FIG. FIG. 11 is a flowchart showing the procedure of the guide process for the procedure for the guard when the procedure information in the mobile terminal device shown in FIG. 2 is received.

  Exemplary embodiments of a security system and a security method according to the present invention will be described below in detail with reference to the accompanying drawings.

  First, an outline of processing related to detection of a suspicious person in security realized by a security system in cooperation with a security guard according to the present embodiment will be described with reference to FIG. Figure 1 shows a person who was identified by the security system when the security system automatically detected that the security officer identified a person suspected of being a suspicious person in the security of an area where a large number of unspecified people come and go. It is a figure for demonstrating a series of process outline | summary which performs the search whether it corresponds with the person listed on the black list etc., and notifies the search result and the procedure of the action which a guard should perform.

  As shown in FIG. 1, the security guard wears a wearable camera 10, a motion sensor 21, a biological information sensor 22, and an environmental information sensor 23. The wearable camera 10 not only can acquire an image and sound in a direction in which the guard is facing the face when worn, but also a display 12 that outputs an image to a part of the field of view of the guard when worn and It includes an earphone 14 that outputs sound. The motion sensor 21 is a device that detects the movement of the guards wearing the motion sensor 21. The biometric information sensor 22 is a device that acquires biometric information such as the body temperature, heart rate, and acceleration of the guards wearing the biometric information sensor 22. The environmental information sensor 23 is a device that acquires environmental information such as temperature, humidity, altitude, and position.

  Moreover, the security guard carries the portable terminal device 40 separately from the device for acquiring various information. Devices such as the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23 transmit various information acquired to the mobile terminal device 40 by short-range wireless communication such as Bluetooth (registered trademark). If the portable terminal device 40 receives information acquired by devices such as the wearable camera 10, motion sensor 21, biological information sensor 22, and environmental information sensor 23, the received image data, audio data, and others Are transmitted to the control center server 50 installed in the control center.

  When the control center server 50 receives the information acquired by the various information acquisition devices worn by the security guard via the mobile terminal device 40, the control center server 50 performs security based on the analysis result obtained by analyzing the received information and a predetermined criterion. It is determined whether or not an employee is paying attention to a specific person. In this determination, for example, a person appearing in an image acquired by the wearable camera 10 is identified based on clothes color, height, etc., and the image of the person is displayed in an image within a predetermined time for each person appearing in the image. The appearance rate is calculated, and if there is a person whose appearance rate is equal to or higher than a predetermined ratio, it is determined that the guard is paying special attention to the person. In addition, when a security guard detects a person suspected of being a suspicious person, a biological reaction such as heart rate or sweating often appears compared to the case where the person is not suspected. The acquired information may be used for determining that the security guard has detected some abnormality. In addition, assuming the behavior of the security guard such as the security guard tracking a person suspected of being a suspicious person, the position information obtained by the environmental information sensor 23 that the security guard has deviated from the normal patrol route is obtained. It may be used for the determination that the security guard has detected some abnormality that it has been detected by using it and has deviated from the normal route.

  In this way, if it is detected that the security guard is paying attention to a specific person, the control center server 50 determines that the person from the image of the person paying attention from the image information acquired by the wearable camera 10. The face image is extracted, and the black list DB 54m including information such as feature data of the suspicious person's face is searched using the extracted face image. When there is a corresponding person in the search process of the black list DB 54m, the control center server 50 transmits information on the corresponding person included in the black list DB 54m to the portable terminal device 40 as suspicious person information. In addition, the control center server 50 selects, from the procedure DB 54n, the procedure information relating to the countermeasure to be taken by the security guard and transmits it to the portable terminal device 40.

  When the portable terminal device 40 receives the suspicious person information from the control center server 50, the portable terminal device 40 outputs the received suspicious person information to the display 12 or the earphone 14 of the wearable camera 10 to notify the security guard of the processing result of the control center server 50. To do. Moreover, the portable terminal device 40 can guide the procedure of the countermeasure to the guard by sequentially outputting the procedure information received from the control center server 50 as a sound from the earphone 14 of the wearable camera 10 or the like.

  Although the outline of processing related to detection of a suspicious person has been described with reference to FIG. 1, the present invention is not limited to a suspicious person, and may be an abnormality detection for an object or a place. For example, in the case of detecting an abnormality with respect to an object or place, it is detected that the guard is paying attention to a specific object or place from the frequency at which the same object or place appears in the image acquired by the wearable camera 10. By judging the difference from the normal time by comparing with the image of the same place at the time, it is determined whether or not an abnormality different from the normal time has occurred in the thing or place where the guards are paying attention. Is possible.

  Thus, based on information acquired by various information acquisition devices such as the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environmental information sensor 23 worn by the security guard, Detect that different special attention is directed, and determine whether or not the target person or object to which the security guard is paying special attention should be watched. Since the corresponding countermeasure procedure is notified to the security guard, efficient security can be realized in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient.

  Next, the system configuration of the security system according to the present embodiment will be described. FIG. 2 is a system configuration diagram of the security system according to the present embodiment. As shown in FIG. 2, a device related to a security system includes a device equipped by a security guard, a device installed in a control center that controls the security guard, and a device fixedly installed in a security target area. And are connected via a communication network 91.

  The device equipped with the guard includes a wearable camera 10 to be worn on the body, a motion sensor 21 and a biological information sensor 22, and a wireless communication device 30, a portable terminal device 40 and an environment information sensor 23 to be carried. The wearable camera 10 is worn on the head as shown in FIG. 2, and a camera 11 that acquires image data in a direction in which the face is facing, a microphone 13 that acquires audio data, and a security guard in the mounted state. A display 12 that outputs an image to a part of the field of view and an earphone 14 (not shown) that outputs sound are included. As shown in FIG. 2, the motion sensor 21 has a plurality of sensors that detect movement at positions corresponding to the respective parts of the body of the guard, and information on the movement of the guard by detecting the movement of each part of the body. It is a device that acquires. The biological information sensor 22 is a device that is worn in contact with the body of the guard, and is a device that acquires biological information such as the body temperature, heart rate, and acceleration of the guard. The environmental information sensor 23 is a device that periodically acquires position information such as the temperature, humidity, altitude, and GPS of the guard by being carried by the guard.

  The mobile terminal device 40 is connected to the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environmental information sensor 23 by short-range wireless communication such as Bluetooth, and the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environmental information. The information acquired by the sensor 23 is transmitted to the control center server 50 of the control center. In addition, the mobile terminal device 40 generates a process (hereinafter referred to as “incident”) to be performed as security support based on information acquired from the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environmental information sensor 23. If the occurrence of an incident is detected, information related to the detected incident is transmitted to the control center server 50.

  In addition, when the mobile terminal device 40 receives output data such as image data and audio data from the control center server 50, the mobile terminal device 40 outputs the received output data to the display 12 and the earphone 14 of the wearable camera 10. In addition, when the received output data is neither image data nor audio data, the mobile terminal device 40 can convert, for example, audio to the earphone 14 or convert it to an image and display it on the display 12. . The mobile terminal device 40 can also output the received output data to the display operation unit 41 and the voice input / output unit 46 included in the mobile terminal device 40.

  The wireless communication device 30 is a communication relay device that can be connected to the communication network 91 via a connection path different from the connection path used by the mobile terminal device 40. Further, the wireless communication device 30 can be connected by a communication procedure such as Wi-Fi or wireless LAN, and can be connected to the communication network 91 with respect to a device connected by a communication procedure such as Wi-Fi or wireless LAN. Provides a communication path with the device. When the connection route used by the mobile terminal device 40 cannot be used due to a disaster, or when the connection route connected to the communication network 91 used by the mobile terminal device 40 is not usable due to congestion, By connecting to the communication network 91 via the wireless communication device 30, communication between the mobile terminal device 40 and the control center server 50 becomes possible. In addition, it is possible to change the setting of the wireless communication device 30 such as Wi-Fi or wireless LAN network name disclosure or non-disclosure, encryption key, etc. It is also possible to make it usable by a general device other than the device to be used.

  The control center server 50 detects the occurrence of an incident based on various information acquired by the guard's equipment received via the mobile terminal device 40, and processes corresponding to the detected incident if the occurrence of the incident is detected And output the processing result to the portable terminal device 40 carried by the security guard.

  Further, the control center server 50 assigns the control center terminal 62 in the control center when the processing contents to be specifically performed cannot be determined, for example, when an abnormal value of the biological information sensor 22 is detected. Thus, the operator who operates the control center terminal 62 and a guard can communicate with each other. Specifically, the control center terminal 62 acquires and outputs information such as images, sounds, biometric information, and environmental information acquired by the equipment of the security guard, and a voice input device connected to the control center terminal 62 or the like. Information input by the input device is transmitted to the mobile terminal device 40. The portable terminal device 40 outputs the received information to the display 12 of the wearable camera 10, the earphone 14, the display operation unit 41 and the voice input / output unit 46 of the portable terminal device 40, thereby operating the control center terminal 62. Allows two-way information exchange with security guards. In addition, since the operator who operates the control center terminal 62 can confirm the information acquired by the various information acquisition devices worn by the security guard, whether or not the security guard is in a state requiring the assistance and the necessary assistance contents. This determination can be made in a short time and appropriately. When the control center terminal 62 accepts the operator's judgment content, the control center terminal 62 notifies the control center server 50 of the content, and the control center server 50 identifies the incident type based on the operator's judgment content, and identifies the identified incident. Process according to the.

  In addition, the control center server 50 can be connected to the monitoring camera 92 and the notification device 93 installed in the security target area via the communication network 91, acquires image data acquired by the monitoring camera 92, Information can be output from the server 50 to the notification device 93. That is, for example, an image acquired by the surveillance camera 92 is displayed on the display 12 of the wearable camera 10 worn by the guard according to the request of the guard, or for example, for the judgment of the guard in evacuation guidance at the time of a disaster or the like. It is also possible to reflect the evacuation route based on the notification device 93 immediately.

  Next, a functional internal configuration according to the present embodiment of the mobile terminal device 40 shown in FIG. 2 will be described. FIG. 3 is a block diagram illustrating a functional internal configuration of the mobile terminal device 40 according to the present embodiment. As shown in FIG. 3, the mobile terminal device 40 includes a display operation unit 41, a short-range wireless communication unit 42, a wireless communication unit 43, an external communication unit 44, a camera 45, a voice input / output unit 46, a storage unit 47, and a control. Part 48 is provided.

  The display operation unit 41 is an input / output unit that receives display and operation of a touch-type liquid crystal panel or the like. The near field communication unit 42 is an interface unit for performing near field communication with the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23 using Bluetooth or the like. The wireless communication unit 43 is an interface unit for performing wireless communication with the wireless communication device 30 according to a communication procedure such as Wi-Fi or wireless LAN. The external communication unit 44 is an interface unit for performing communication with the control center server 50 of the control center.

  The camera 45 is an input unit that acquires image data. The audio input / output unit 46 includes an audio input unit such as a microphone and an audio output unit such as a speaker and headphones.

  The storage unit 47 is a storage device including a DDR-SDRAM (Double Data Rate Synchronous Dynamic Random Access Memory) or the like. The storage unit 47 includes specific face feature data 47a and procedure data 47b. The specific face feature data 47a is data used by the offline face authentication unit 48i of the individual application 48h described later. The procedure data 47b is data used in a procedure guide unit 48k of the individual application 48h described later.

  The control unit 48 is a control unit that controls the entire mobile terminal device 40, and includes a collection data transmission unit 48a, a collection data analysis unit 48b, an output processing unit 48g, and an individual application 48h. Actually, programs corresponding to these functional units are stored in a ROM (Read Only Memory) or a non-volatile memory (not shown), and these programs are loaded into a CPU (Central Processing Unit) and executed. The corresponding process will be executed.

  The collected data transmission unit 48 a transmits various information transmitted from the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environment information sensor 23 to the control center server 50 via the short-range wireless communication unit 42.

  The collected data analysis unit 48 b detects the occurrence of various incidents based on various information transmitted from the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environmental information sensor 23 via the short-range wireless communication unit 42. . The collected data analysis unit 48b includes a voice analysis unit 48c, an image analysis unit 48d, a motion analysis unit 48e, an abnormality detection unit 48f, and the like according to the information to be analyzed and the type of incident to be detected.

  The voice analysis unit 48c analyzes the voice data acquired by the microphone 13 of the wearable camera 10 and detects the occurrence of an incident. For example, an instruction according to a guardian's voice may be analyzed to detect an incident according to the instruction.

  The image analysis unit 48d analyzes the image data acquired by the camera 11 of the wearable camera 10 and detects the occurrence of an incident. In the present embodiment, the incident detection for the search process for determining whether or not the person is a suspicious person is performed by the control center server 50. However, it is assumed that the portable terminal device 40 performs the detection by the image analysis unit 48d. Also good.

  The motion analysis unit 48e detects the occurrence of an incident by analyzing information regarding the operation of the guard acquired by the motion sensor 21. For example, a corresponding incident may be detected according to an operation corresponding to a predetermined incident of a guard.

  The abnormality detection unit 48f analyzes data acquired by the motion sensor 21, the biological information sensor 22, and the like, and detects the occurrence of an incident. For example, if an abnormal value of data acquired by the motion sensor 21 or the biological information sensor 22 is detected, it is determined that there is a high possibility that the guard is in an abnormal state, and the state of the guard by the control center terminal 62 is determined. It may be detected that an incident of confirmation has occurred.

  The output processing unit 48g receives information such as image information and audio information that are processing results corresponding to the incident received from the control center server 50, and the image information is displayed on the display 12 of the wearable camera 10 or the display operation of the mobile terminal device 40. The audio information is output to the unit 41 to the earphone 14 of the wearable camera 10 or the audio input / output unit 46 of the mobile terminal device 40. In addition, when the received processing result is neither image information nor sound information, the output processing unit 48g can convert the sound into, for example, sound and output it to the earphone 14, or convert it into an image and display it on the display 12. .

  The individual application 48h is a processing unit that performs processing on a processing result in a special format that is not a general-purpose processing result such as image information or audio information as a processing result corresponding to the incident received from the control center server 50. . The individual application 48h includes an offline face authentication unit 48i, a wireless communication device setting unit 48j, a procedure guide unit 48k, and the like.

  The offline face authentication unit 48i, for example, as a blacklist search incident processing result, along with the determination result of whether or not the person of the face image acquired by the wearable camera 10 is a person included in the blacklist. Is received, the feature data of the received face image is stored in the specific face feature data 47a. Further, the offline face authentication unit 48i carries out detection of a suspicious person once detected by matching the face image of the person acquired by the camera 11 of the wearable camera 10 with the face feature data included in the specific face feature data 47a. By using the terminal device 40, it is possible to support tracking of a suspicious person locally without cooperation with the control center server 50.

  For example, the wireless communication device setting unit 48j has received setting change information related to the disclosure or non-disclosure of the network name of the wireless communication device 30 and the encryption key as a processing result for the incident of wireless access point setting from the control center server 50. In this case, the wireless communication device setting unit 48j transmits the received setting change information to the wireless communication device 30 to change the settings relating to the disclosure or nondisclosure of the network name, the encryption key, and the like.

  For example, if the procedure guide unit 48k receives information on a processing procedure related to a specific job as a processing result as a processing result of a support incident related to the specific job, the procedure guide unit 48k stores the received information on the processing procedure in the procedure data 47b. . Further, the procedure guide unit 48k sequentially executes the specific information of the security guard by outputting the procedure information accompanied by the voice and image included in the stored procedure data 47b to the display 12 and the earphone 14 of the wearable camera 10. To guide.

  Next, a data structure according to the present embodiment of the mobile terminal device 40 shown in FIG. 3 will be described with reference to FIG.

  The specific face feature data 47a is data having record items including an identification number for identifying the face feature data, attribute information of the person corresponding to the identification number, and face feature information. The attribute information includes information such as the name, gender, age of the person corresponding to the identification number, and the reason listed in the black list. The example of the specific face feature data 47a in FIG. 4 indicates that the person with the identification number “00101” has the name “Taro Tanaka”, the gender “male”, and the age “30”.

  The procedure data 47b is data in which a procedure number indicating the order in which the procedures are performed, a data classification indicating the type of procedure instruction data, and procedure instruction data are used as record items. The data classification is coded data, “1” indicates that the forward instruction data is audio data, “2” indicates that the forward instruction data is image data, and “3” indicates the forward data. The instruction data indicates voice + image data, and “4” indicates that the order instruction data is character data.

  In the example of the procedure data 47b in FIG. 4, the procedure instruction data corresponding to the procedure application number “1” is the data classification “1”, the voice data, and the procedure instruction data corresponding to the procedure application number “2”. Indicates that the data classification is “1” and audio data, and the procedure instruction data corresponding to the procedure application number “3” indicates that the data classification is “3” and audio + image data.

  Next, a functional internal configuration according to the present embodiment of the control center server 50 shown in FIG. 2 will be described. FIG. 5 is a block diagram showing a functional internal configuration of the control center server 50 according to the present embodiment. As shown in FIG. 5, the control center server 50 is connected to an input unit 51 and a display unit 52. The input unit 51 is a keyboard or a mouse, and the display unit 52 is a display device such as a liquid crystal panel.

  In addition, the control center server 50 includes a communication unit 53, a storage unit 54, and a control unit 55. The communication unit 53 is an interface unit for performing data communication with the wireless communication device 30, the mobile terminal device 40, the monitoring camera 92, and the notification device 93 via the communication network 91.

  The storage unit 54 is a storage device composed of a hard disk device, a nonvolatile memory, or the like. The storage unit 54 includes collected data 54a, guard data 54b, terminal management data 54c, incident data 54d, output data 54e, a black list DB 54m, and a procedure DB 54n.

  The collected data 54a is data obtained by accumulating information acquired from various information acquisition devices worn by the guards received from the mobile terminal device 40. The security guard data 54b is information related to a security guard to be supported by the security system, and is data including attribute information such as a security guard's real-time situation and security skills held by the security guard. The terminal management data 54c is data indicating the operating status of a plurality of control center terminals 62 installed in the control center. The incident data 54d is data for managing an incident that has occurred, and includes information such as identification information numbered for each incident that has occurred, an incident type, and an incident status.

  The output data 54e is a processing result associated with the incident, and includes output destination data 54f, instruction text data 54g, audio output data 54h, image output data 54i, specific face feature data 54j, procedure data 54k, and the like. The output destination data 54f is information related to a destination to which processing results such as instruction text data 54g, audio output data 54h, image output data 54i, specific face feature data 54j, and procedure data 54k are transmitted. For example, in the case of a blacklist search incident, the destination to which the blacklist search processing result is sent is usually a guard who wears the wearable camera 10 that has acquired the face image. In the case of an incident such as a request, it becomes a guard who is the subject of dispatch instructions.

  The instruction text data 54g is output data for the security guard, and the received mobile terminal device 40 displays the received instruction text data 54g as character information on the display 12 of the wearable camera 10 or converts it into voice data to be used as an earphone. 14 for output. The audio output data 54h is output data for the security guard, and the received mobile terminal device 40 outputs the received audio output data 54h to the earphone 14. The image output data 54 i is output data for the security guard, and the received portable terminal device 40 outputs the received image output data 54 i to the display 12 of the wearable camera 10.

  The specific face feature data 54j is data that is output as an incident processing result such as a blacklist search, and includes information such as face feature data corresponding to the searched blacklist person. When the specific face feature data 54j is transmitted to the mobile terminal device 40, the mobile terminal device 40 additionally registers the received specific face feature data 54j in the specific face feature data 47a.

  The procedure data 54k is information on a procedure to be taken by the guard as an incident processing result. When the procedure data 54k is transmitted to the mobile terminal device 40, the mobile terminal device 40 receives the received procedure data 54k. Is stored in the procedure data 47b and the navigation of the procedure is performed.

  The black list DB 54m is a database including feature data of a face image of a person requiring attention and information related to the person requiring attention, and is a DB used in processing corresponding to an incident of a black list search. Further, the procedure DB 54n is a DB that stores the procedure of the procedure performed by the security guard. When the procedure data 54k is output as the incident processing result, the procedure corresponding to the procedure DB 54n is selected and output to the procedure data 54k. To do.

  The control unit 55 is a control unit that controls the entire control center server 50, and includes a data collection / accumulation processing unit 55a, a collected data monitoring unit 55b, a guard data management unit 55c, a terminal control unit 55d, an individual processing unit 55e, and an output. A processing unit 55h is included. Actually, programs corresponding to these functional units are stored in a ROM or non-volatile memory (not shown), and the corresponding processes are executed by loading these programs into a CPU (Central Processing Unit) and executing them. I will let you.

The data collection / accumulation processing unit 55a receives various data acquired from various devices that are equipped with guards from the mobile terminal device 40, and accumulates them in the collected data 54a.

  The collected data monitoring unit 55b is a processing unit that monitors various information acquired from the various information acquisition devices worn by the guards from the mobile terminal device 40 and detects the occurrence of various incidents. Although the collected data monitoring unit 55b and the collected data analyzing unit 48b of the mobile terminal device 40 can detect incidents based on the same data, they do not perform duplicate processing, Functions are appropriately distributed to the mobile terminal device 40 and the control center server 50 according to information necessary for data analysis.

  The guard data management unit 55c manages the real-time situation of the guard of the guard data 54b. For example, the position information is received from the environmental information sensor 23 carried by the security guard, the position information of the security guard possessed by the security guard data 54b is updated, or the information on the incident occurring in association with the security guard is real-time. Update with.

  The terminal control unit 55d performs allocation and release for incidents of the control center terminal 62 installed in the control center. If the control center terminal 62 is assigned to an incident, the terminal control unit 55d relays data communication between the assigned control center terminal 62 and the mobile terminal device 40 corresponding to the incident, and the control center terminal The state where the operator who operates 62 and the guard can communicate is made.

  The individual processing unit 55e performs individual processing according to the type of incident and outputs output data 54e as a processing result. The individual processing unit 55e includes a black list search unit 55f that is a processing unit for each incident type, a wireless communication device setting unit 55g, and the like.

  The black list search unit 55f is a processing unit for an incident called black list search for confirming whether a person included in the image data acquired by the wearable camera 10 is not included in the black list, and includes the image data acquired by the wearable camera 10. Using the face image of the person to be matched with the information in the black list DB 54m, the processing results include instruction text data 54g, audio output data 54h, image output data 54i, specific face feature data 54j, procedure data 54k, etc. Output data.

  The wireless communication device setting unit 55g is, for example, a processing unit for an incident called wireless access point setting, and outputs setting change information related to the disclosure or non-disclosure of the network name of the wireless communication device 30 and the encryption key as a processing result. To do.

  The output processing unit 55h is a processing unit that transmits the output data 54e output from the individual processing unit 55e to the output destination indicated by the output destination data 54f included in the output data 54e in response to the incident that has occurred.

  Next, the data structure according to the present embodiment of the control center server 50 shown in FIG. 5 will be described with reference to FIGS.

  The collected data 54a in FIG. 6 includes the date and time when the data was collected, the identification information of the guard who wears or carries the device that acquired the data, the data classification indicating the type of the collected data, and the acquired data as the possessed items of the record. It is data. The data classification is encoded data, “01” indicates data acquired by the camera 11 of the wearable camera 10, and “02” is data acquired by the microphone 13 of the wearable camera 10. “03” indicates data acquired by the motion sensor 21, “04” indicates data acquired by the biological information sensor 22, and “05” indicates data acquired by the environmental information sensor 23. “81” indicates data acquired by the monitoring camera 92, and “90” indicates a result of analyzing information acquired by the various information acquisition devices worn by the security guard by the mobile terminal device 40. Indicates data. The acquired data has a data format corresponding to the data classification.

  In the example of the collected data 54a in FIG. 6, data acquired by the camera 11 of the wearable camera 10 worn by the security guard whose date and time is “2014/4/10 15:00” and whose security guard identification information is “05015” is recorded. It has been shown.

  The security guard data 54b in FIG. 6 is data in which the identification information of the security guard, the security guard situation indicating the real-time situation of the security guard, attribute information of the security guard, and the like are stored items of the record. The security guard status includes the mission number for identifying the mission assigned to the security guard, the incident number associated with the security guard, the position information received from the environmental information sensor 23 of the security guard, and the security guard's status. The communication address of the portable terminal device 40 to be carried is included. The guard attribute information includes information such as gender and possession skills.

  In the example of the security guard data 54b in FIG. 6, the security guard corresponding to the security guard identification information “12345” is assigned the mission for the mission number “123”, and the incident “12301234” corresponding to the security guard. And the sex is “M”, indicating that the man is male.

  The terminal management data 54c in FIG. 6 is data in which the status of the control center terminal 62 with respect to the terminal identification number, the associated incident number, and the like are associated with the terminal identification number that can identify the control center terminal 62. It is. The status is coded data, and “0” indicates that it is not assigned to any incident, and “1” indicates that it is assigned to any incident. In the example of the terminal management data 54c in FIG. 6, the control center terminal 62 having the terminal identification number “011” has a status of “1” and is assigned to an incident, and the assigned incident number is “1010251”. It is shown that.

  The incident data 54d in FIG. 6 includes the occurrence date and time of the incident, the incident number for identifying the incident that has occurred, the type of the incident that has occurred, the status of the incident, the identification information of the guard corresponding to the incident that has occurred, etc. It is data to be. The incident status is coded data, “00” indicates that the incident is being determined, “01” indicates that the destination to which the processing result is transmitted has been determined, and “02” indicates Indicates that the processing result has been transmitted, and “90” indicates that the incident has been handled.

  In the example of the incident data 54d in FIG. 6, an incident with an occurrence date of “2014/4/10 17:30” has an incident number of “12301234”, an incident type of “201”, and an incident status of “01”. The destination to which the processing result is transmitted has been determined, and the identification information of the guard corresponding to the incident is “12345”.

  The output data 54e shown in FIG. 6 is a common data format of the output destination data 54f, the instruction text data 54g, the voice output data 54h, the image output data 54i, the specific face feature data 54j, and the procedure data 54k. The incident number of the incident, the incident branch number for identifying the output number 54e when a plurality of output data 54e is output for the incident number, the data classification, and the data for each classification are the possessed items of the record. It is data. The data classification is coded data, “01” indicates that the data included in the classification data is the output destination data 54f, and “02” indicates that the data included in the classification data is the instruction text data. 54g, “03” indicates that the data included in the classification data is the audio output data 54h, and “04” indicates that the data included in the classification data is the image output data 54i. ing.

  In the example of the output data 54e in FIG. 6, the data corresponding to the incident number “12301234” and the incident branch number “001” has the data classification “01” and the output destination data 54f as the data classified by classification. It shows that.

  The black list DB 54m in FIG. 7 has the same structure as the specific face feature data 47a of the mobile terminal device 40 shown in FIG. Further, the procedure DB 54n in FIG. 7 is data in which a procedure identification number associated with a series of procedures is added to the record item with respect to the procedure data 47b of the mobile terminal device 40 in FIG. The procedure data 47b shown in FIG. 4 is data extracted by selecting any one procedure from the procedure DB 54n storing a plurality of procedures.

  Next, a processing procedure when the control center server 50 receives information from the mobile terminal device 40 will be described. FIG. 8 is a flowchart illustrating a processing procedure when the control center server 50 receives information from the mobile terminal device 40.

  If the data collection / accumulation processing unit 55a receives a report of an incident detected based on various information acquired by the various information acquisition devices worn by the guard from the mobile terminal device 40, the received information is stored in the collected data 54a. Register (step S101).

  If the information received in step S101 is not a report of an incident (step S102; No), the collected data monitoring unit 55b analyzes the received data to determine whether an incident has occurred and the type of incident ( Step S103). When the information received in step S101 is an incident report (step S102; Yes), the data collection / accumulation processing unit 55a registers the content of the received incident report in the incident data 54d (step S102). S104), the process proceeds to step S112.

  If it is determined in step S103 that the incident is not an incident (step S105; Yes), the process ends. If it is determined in step S103 that the incident is an incident (step S105; No), the collected data monitoring unit 55b registers the determination result of the process in step S103 in the incident data 54d (step S106). . When the incident type is also determined in the determination process in step S103 (step S107; Yes), the process proceeds to step S112.

  If the incident type is not determined in the determination process of step S103 (step S107; No), the terminal control unit 55d allocates the control center terminal 62 and assigns the assigned control center terminal 62 and the portable terminal corresponding to the incident. It connects with the apparatus 40 and the state which the operator who operates the control center terminal 62 and a guard can communicate is made (step S108).

  If the incident type is received from the control center terminal 62 as a result of the process of step S108 (step S109; Yes), the terminal control unit 55d registers the received incident type in the incident data 54d (step S110). Further, as a result of the processing in step S108, if it is received from the control center terminal 62 that the response to the incident has been completed (step S109; No), the terminal control unit 55d displays the incident status of the corresponding incident data 54d as follows. The terminal control unit 55d updates the incident status of the corresponding incident data 54d to “90” corresponding completion (step S111), and ends the process.

  If the incident type is determined, the individual processing unit 55e executes processing according to the incident type. Specifically, the individual processing unit 55e executes processing according to the incident type, outputs the processing result to the output data 54e (step S112), determines a destination to which the processing result is transmitted, and outputs the output data 54e. To the output destination data 54f (step S113).

  The output processing unit 55h transmits the processing result to the mobile terminal device 40 carried by the guard according to the output data 54e (step S114), and for the incident that is terminated by transmitting the processing result (step S115; Yes). Then, the incident status of the corresponding record in the incident data 54d is updated to “90” corresponding completion (step S116), and the process is terminated. For incidents for which processing for the incident does not end by transmitting the processing result (step S115; No), the processing ends without performing the incident close processing in step S116.

  Next, the procedure of the blacklist search incident detection process in the received data analysis process (step S103) shown in FIG. 8 will be described with reference to the flowchart shown in FIG.

  When the received information is image data (step S201; Yes), the collected data monitoring unit 55b analyzes the received image data and detects a person included in the image (step S202). Further, the collected data monitoring unit 55b determines the feature for each person detected in step S202, and stores the feature information for each person detected in step S202 together with the reception time of the image data (step S203). The collected data monitoring unit 55b last receives image data based on the detected feature information for each person accumulated in time series by the processing performed in step S202 and step S203 each time image data is received. To an appearance rate, which is the rate at which the same person having the same feature appears in an image within a predetermined time range, is calculated for each person (step S204).

  There is a person whose appearance rate for each person calculated in step S204 is equal to or higher than a predetermined value (step S205; Yes), and the heart rate acquired by the biometric information sensor 22 worn by the security guard at that time is compared with other time points. When a significant change is recognized (step S206; Yes), the collected data monitoring unit 55b determines that the guard is paying special attention to a person with a high appearance rate, and the person is blacklisted. Is determined as a blacklist search incident to search whether or not the person is included in the list (step S207), and the process is terminated.

  When there is no person whose appearance rate for each person calculated in step S204 is a predetermined value or more (step S205; No), or when there is a person whose appearance rate for each person calculated in step S204 is a predetermined value or more (step) Even if it is (S205; Yes), when a significant change is not recognized compared with other time points in the heart rate acquired by the biometric information sensor 22 worn by the guard at that time point (step S206; No), The process ends without performing the process of step S207. The process is also terminated when the received information is not image data (step S201; No).

  The criteria for determining that the security guard shown in FIG. 9 is paying special attention to a specific person is an example. For example, by attaching a sensor that detects the gaze of the security guard to the security guard, The determination may be made by analyzing the movement of the line of sight.

  Next, the processing procedure of the black list search process in the output data generation process (step S112) shown in FIG. 8 will be described using the flowchart shown in FIG.

  The black list search unit 55f extracts the face image of the person to be evaluated from the received image data (step S301), and calculates facial feature data based on the extracted face image (step S302). The black list search unit 55f evaluates the similarity between the facial feature data of the person to be evaluated calculated in step S302 and the facial feature data of the person included in the black list DB 54m, and determines that the similarity is high. A search process is performed to determine whether or not the person to be included exists in the blacklist DB (step S303).

  In the search processing of the black list DB 54m in step S303, if a person with high similarity exists in the black list DB 54m (step S304; Yes), the black list search unit 55f determines that the black list has high similarity. Information relating to the person in the DB 54m is output as the specific face feature data 54j (step S305), and the procedure data 54k is used as a security guard handling procedure when a person similar to the person included in the black list DB 54m is detected. Output (step S306), the process is terminated.

  In the search process of the black list DB 54m in step S303, when a person with high similarity does not exist in the black list DB 54m (step S304; No), the process of step S305 and step S306 is skipped and the process ends.

  Next, the procedure of the guide process of the procedure for the guard when the procedure information in the mobile terminal device 40 shown in FIG. 2 is received will be described using the flowchart shown in FIG.

  When the procedure guide unit 48k receives the procedure data 54k from the control center server 50, the procedure guide unit 48k stores the received procedure data 54k as the procedure data 47b and confirms whether or not to guide the procedure according to the procedure data 47b. Is performed (step S401). In the guide confirmation process in step S401, if a guard's response that a guide instruction is required is received (step S402; Yes), the procedure guide unit 48k includes an unoutput procedure instruction data in the procedure data 47b. The procedure instruction data having the smallest procedure number is output to the output destination corresponding to the data classification (step S403).

  If a guard's response indicating that the procedure for the instruction procedure data output in step S403 has been completed is accepted (step S404; Yes), and there is no unoutput procedure instruction data (step S405; Yes), a procedure guide The unit 48k outputs to the earphone 14 of the wearable camera 10 that the procedure guide according to the procedure data 47b is ended (step S406), and ends the process.

  If the guard's response indicating that the procedure for the procedure instruction data output in step S403 has been completed is not accepted (step S404; No), the process returns to step S404 to wait for the guard's response. When there is unoutput procedure instruction data (step S405; No), the process shifts to step S403 to shift to the output process for the next procedure number. Also, in the guide confirmation process in step S401, if a guard's response indicating that a guide instruction is unnecessary is received (step S402; No), the process ends without performing the procedure guide process based on the procedure data 47b. .

  As described above, based on information acquired by various information acquisition devices such as the wearable camera 10, the motion sensor 21, the biological information sensor 22, and the environmental information sensor 23 worn by the security guard, Detecting that a special attention that is different from the time is directed, the security guard determines whether the target person or object to which special attention is directed is a target to be warned, and the determination result and the determination Since the security procedure is notified to the security guard according to the result, efficient security can be realized in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient.

  In the present embodiment, in the control center server 50 that has received the information acquired by the various information acquisition devices worn by the security guard, the security guard can take the person or the object based on the information acquired by the received various information acquisition devices. Although it has been explained that a person or object to which special attention is directed is detected and whether a person or object to which special attention is directed is to be warned, the present invention is not limited to this. It is not something. For example, you may make it detect that the guard is paying special attention with respect to a person or an object based on the information acquired with the various information acquisition apparatus with which the guard is mounted | worn with the portable terminal device 40. FIG. Further, only the determination of whether or not the person or thing to which the security guard has paid special attention is the target to be warned may be performed by another device such as the control center server 50, and in some cases the security guard The portable terminal device 40 may also determine whether or not a person or an object to which a special attention is directed is an object to be warned.

  Each configuration illustrated in the present embodiment is functionally schematic and does not necessarily need to be physically configured as illustrated. That is, the form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed / integrated in an arbitrary unit according to various loads or usage conditions. Can be configured.

  As described above, the security system and the security method according to the present invention are suitable for realizing efficient security in a situation where the number of information acquisition devices such as imaging devices and sensors is insufficient.

DESCRIPTION OF SYMBOLS 10 Wearable camera 11, 45 Camera 12 Display 13 Microphone 14 Earphone 21 Motion sensor 22 Biometric information sensor 23 Environmental information sensor 30 Wireless communication apparatus 40 Portable terminal device 41 Display operation part 42 Short-range wireless communication part 43 Wireless communication part 44 External communication part 46 voice input / output unit 47, 54 storage unit 47a, 54j specific face feature data 47b, 54k procedure data 48, 55 control unit 48a collection data transmission unit 48b collection data analysis unit 48c voice analysis unit 48d image analysis unit 48e motion analysis unit 48f Anomaly detection unit 48g, 55h Output processing unit 48h Individual application 48i, 55g Offline face authentication unit 48j Wireless communication device setting unit 48k Procedure guide unit 50 Control center server 51 Input unit 52 Display unit 53 Communication Part 54a Collected data 54b Security guard data 54c Terminal management data 54d Incident data 54e Output data 54f Output destination data 54g Instruction text data 54h Audio output data 54i Image output data 54m Blacklist DB
54n Procedure DB
55a Data collection / accumulation processing unit 55b Collected data monitoring unit 55c Security guard data management unit 55d Terminal control unit 55e Individual processing unit 55f Blacklist search unit 62 Control center terminal 91 Communication network 92 Surveillance camera 93 Notification device

Claims (7)

Information acquisition means that is carried or worn by a security guard and acquires information around the security guard;
A guard state determination means for determining the state of the guard;
Detection means for detecting an object existing around the guard as an evaluation target based on the information acquired by the information acquisition means;
Using the security guard state determined by the security guard state determination means and the information acquired by the information acquisition means related to the object detected as the evaluation target by the detection means, the evaluation of the object as a warning target is performed. A security system comprising: a security target evaluation means for performing security. The information acquisition means acquires at least image information in a direction in which the face of the guard is facing,
The security guard state determination means determines the state in which the security guard is paying special attention to an object included in the image of the image information, using the image information acquired by the information acquisition means,
The detection means detects, as the evaluation target, an object to which the guard is paying special attention by the guard state determination means,
The security target evaluation means, when it is determined by the security guard state determination means that the security guard is in a state of paying special attention to the object included in the image of the image information, the The security system according to claim 1, wherein the image information acquired by the information acquisition unit is used to evaluate the object as a warning target.   3. The apparatus according to claim 1, further comprising an evaluation result notifying unit that notifies the guard of an evaluation result when the guard target evaluating unit evaluates that the object to be evaluated is required to be vigilance. The security system described.   The apparatus further comprises procedure notifying means for notifying the guard of information related to the procedure of the countermeasure when the guard object evaluating means evaluates that the object to be evaluated is required to be handled. The security system according to 1, 2, or 3.   The information acquired by the information acquisition means is one or more of audio information, position information, information relating to the operation of the guard, information relating to the living body of the guard, and information relating to the environment, in addition to image information. The security system according to any one of claims 1 to 4, further comprising: The security target evaluation means is:
When it is determined by the guard state determination means that the guard is in a state of paying special attention to the person included in the image information image, the image related to the person acquired by the information acquisition means 6. The similarity between the information and the image information of a person who needs to be alerted is evaluated, and when the similarity is high, the person is evaluated as a person who needs to be alerted. The security system according to any one of the above. An information acquisition step of acquiring information around the security guard by a device carried or attached to the security guard;
A guard state determination step for determining the state of the guard;
A detection step of detecting an object present around the guard as an evaluation target based on the information acquired by the information acquisition step;
Using the security guard state determined in the security guard state determination step and the information acquired in the information acquisition step related to the object detected as the evaluation target in the detection step, the object is evaluated as a warning target. A security method characterized by comprising: a security target evaluation step to be performed.

Images