JP7189307B2 - Security system, management device and security method - Google Patents

Description

The present invention relates to a security system, a management device, and a security method capable of efficiently detecting spoofing of a security guard, etc., when guarding a security area where a large number of third parties are located by a plurality of security guards, etc.

Conventionally, when an event venue or the like is guarded by a plurality of security guards, there is a possibility that a malicious suspicious person may impersonate the security guards. If such a suspicious person masquerades as a security guard, a situation will occur that hinders security, and there is a risk that the security system will collapse.

In order to detect the spoofing of security guards, well-known personal authentication technology can be used. For example, in Patent Document 1, when a logon request is received from a user terminal, a web server transmits a program for capturing a face image, and compares the face image captured by the web camera of the user terminal with information registered in advance in a user database. Then, a personal authentication server for performing personal authentication is disclosed. This personal authentication server receives a photographing command from the Web server at a predetermined timing even while the content is being used, and transmits the face image photographed by the Web camera to the Web server. Repeatedly perform personal authentication and monitor whether or not the user is replaced.

JP 2010-066990 A

However, although the technique of Patent Document 1 is effective for authenticating a user who continuously views the display screen of a user terminal, it is difficult to apply it to the authentication of a security guard guarding a security area. . This is because the guards do not stop at one place within the guarded area.

In particular, when a passerby is allowed to pass through the guarded area, the passerby blocks the field of view of the fixed camera, making it difficult for the fixed camera to capture an appropriate facial image of the guard. For this reason, it is difficult to apply the method disclosed in Japanese Patent Application Laid-Open No. 2002-200001, which assumes that a proper facial image of the user can be obtained, to the case of detecting impersonation of a security guard.

For these reasons, when a security area is guarded by a plurality of security guards, how to detect spoofing of security guards is an important issue. Such problems arise not only for security guards, but also for venue staff, volunteers, and the like.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems of the prior art, and is capable of efficiently detecting impersonation of a security guard or the like when guarding a security area with a plurality of security guards or the like. An object of the present invention is to provide a security system, a management device and a security method.

In order to solve the above-described problems and achieve the object, the present invention provides a terminal device possessed by each of a plurality of security personnel who are in charge of guarding a predetermined security area, and a management device provided to communicate with each terminal device. wherein the management device includes an image acquisition unit that acquires an image captured by an imaging device possessed by each of the plurality of security personnel; and an image acquired by the image acquisition unit. a first determination unit that determines whether or not there is a person wearing clothing or accessories for security personnel; and the first determination unit determines that the person is included in the image. a second judgment unit for judging whether or not the face image of the person conforms to a predetermined authentication condition, if the face image of the person meets the authentication condition, and the second judgment unit determines that the face image of the person meets the authentication condition a detection unit that detects impersonation of a security officer by a third party based on the face image of the person included in the image, and the second determination unit detects the face image of the person When it is determined that the authentication condition is not met, a predetermined notification instructing the terminal device possessed by one or more security personnel located near the person to take a face image of the person is sent. and a notification unit.
The present invention also provides a security system comprising terminal devices possessed by a plurality of security personnel in charge of guarding a predetermined security area, and a management device provided to communicate with each terminal device, The management device includes an image acquisition unit that acquires an image captured by an imaging device possessed by each of the plurality of security personnel; a first determination unit that determines whether or not there is a person wearing the a second determination unit that determines whether or not a predetermined authentication condition is met; and if the second determination unit determines that the face image of the person meets the authentication condition, the facial image is included in the image. When it is determined that the face image of the person does not meet the authentication conditions by the detection unit that detects spoofing of a security officer by a third party based on the face image of the person and the second determination unit. and a notification unit that issues a predetermined notification instructing the terminal device possessed by the person to contact another security guard.
Further, according to the present invention, in the above invention, the predetermined authentication condition includes a condition as to whether or not a predetermined number of pixels out of the number of pixels forming the face image of the person are included. and

Further, according to the present invention, in the above invention, the imaging device is a wearable camera that is attached to the body of each security guard and has an imaging unit that captures at least an image.

Further, according to the present invention, in the above invention, the management device further includes a storage unit that stores registered face images of security personnel or feature amounts extracted from the registered face images, and the detection unit includes: Based on the face image of the person included in the image and the registered face image of each security officer stored in the storage unit or the feature amount extracted from the registered face image, a third party can provide the security officer with It is characterized by detecting spoofing.

Further, the present invention is a management device provided so as to be capable of communicating with a terminal device possessed by each of a plurality of security personnel who are in charge of guarding a predetermined security area. an image acquisition unit that acquires an image captured by an imaging device; and a determination as to whether or not a person wearing clothing or attachments for security personnel is present in the image acquired by the image acquisition unit. a first determination unit, and a second determination unit for determining whether or not a facial image of the person conforms to a predetermined authentication condition when the first determination unit determines that the person is included in the image. and when the second determination unit determines that the face image of the person conforms to the authentication conditions, a security guard by a third party based on the face image of the person included in the image and one or more security guards positioned near the person when the second determination unit determines that the face image of the person does not meet the authentication conditions. and a notification unit that issues a predetermined notification to a terminal device possessed by a person to instruct imaging of the face image of the person.
Further, the present invention is a management device provided so as to be capable of communicating with a terminal device possessed by each of a plurality of security personnel who are in charge of guarding a predetermined security area. an image acquisition unit that acquires an image captured by an imaging device; and a determination as to whether or not a person wearing clothing or attachments for security personnel is present in the image acquired by the image acquisition unit. a first determination unit, and a second determination unit for determining whether or not a facial image of the person conforms to a predetermined authentication condition when the first determination unit determines that the person is included in the image. and when the second determination unit determines that the face image of the person conforms to the authentication conditions, a security guard by a third party based on the face image of the person included in the image and a detection unit for detecting spoofing of a person, and when the second determination unit determines that the face image of the person does not meet the authentication conditions, another security for the terminal device possessed by the person. and a notification unit that issues a predetermined notification instructing contact with the person in charge.

Further, the present invention is a security method in a security system having terminal devices possessed by a plurality of security personnel who are in charge of security in a predetermined security area, and a management device provided so as to communicate with each terminal device. an image acquisition step in which the management device acquires an image captured by an imaging device possessed by each of the plurality of security personnel; a first determination step of determining whether or not a person wearing clothing or accessories for a person in charge exists; a second determination step of determining whether or not the facial image of the person conforms to a predetermined authentication condition, if the facial image of the person is determined to meet a predetermined authentication condition; a detection step of detecting spoofing of a security personnel by a third party based on the face image of the person included in the image when it is determined that the authentication condition is met; When it is determined in the second determination step that the face image of the person does not meet the authentication conditions, the person's face image is sent to a terminal device possessed by one or more security personnel located near the person. and a notification step of performing a predetermined notification instructing to capture a face image.
Further, the present invention is a security method in a security system having terminal devices possessed by a plurality of security personnel who are in charge of security in a predetermined security area, and a management device provided so as to communicate with each terminal device. an image acquisition step in which the management device acquires an image captured by an imaging device possessed by each of the plurality of security personnel; a first determination step of determining whether or not a person wearing clothing or accessories for a person in charge exists; a second determination step of determining whether or not the facial image of the person conforms to a predetermined authentication condition, if the facial image of the person is determined to meet a predetermined authentication condition; a detection step of detecting spoofing of a security personnel by a third party based on the face image of the person included in the image when it is determined that the authentication condition is met; When it is determined in the second determination step that the face image of the person does not meet the authentication conditions, a predetermined notification instructing the terminal device possessed by the person to contact another security personnel is sent. and a notification step to be performed.

According to the present invention, when a security area is guarded by a plurality of guards or the like, it is possible to efficiently detect spoofing of the guards or the like.

FIG. 1 is an explanatory diagram for explaining the concept of the security system according to this embodiment. FIG. 2 is a system configuration diagram showing the system configuration of the security system. FIG. 3 is a diagram showing the configuration of the security guard terminal device shown in FIG. FIG. 4 is a diagram showing the configuration of the management device shown in FIG. 2. As shown in FIG. FIG. 5 is a flow chart showing a processing procedure of the security guard terminal device shown in FIG. FIG. 6 is a flow chart showing a processing procedure of the management device shown in FIG. FIG. 7 is an example of a screen displayed on the display operation unit of the security guard terminal device. FIG. 8 is another example of a screen displayed on the display operation unit of the security terminal device. FIG. 9 is another example of a screen displayed on the display operation unit of the security terminal device.

BEST MODE FOR CARRYING OUT THE INVENTION Preferred embodiments of a security system, a management device, and a security method according to the present invention will now be described in detail with reference to the accompanying drawings. Here, the case of spoofing security guards will be described, but the method can also be applied to the detection of spoofing of venue staff and volunteers in the same way.

<Security system concept>
First, the concept of the security system according to this embodiment will be explained. FIG. 1 is an explanatory diagram for explaining the concept of the security system according to this embodiment. As shown in FIG. 1, security guard A is equipped with a camera 31, and captures a moving image with this camera 31 (1). The imaging range of the camera 31 moves as the guard A's face moves, and the subject of the moving image to be captured changes. It is assumed that security guard A has been instructed in advance to "take other security guards' face images periodically."

After that, the moving image data captured by the camera 31 is transmitted to the management device 50 arranged in the control center via the guard terminal device 40 and a wireless communication network (2). Note that the moving image data captured by the camera 31 can be configured to be transmitted directly from the camera 31 to the management device 50 without going through the security terminal device 40 .

The management device 50 that has received the moving image data checks whether or not the moving image data includes an appropriate face image of security guard B wearing a security guard uniform (a face image sufficient for face authentication). (3). Then, when the moving image data includes the face image of security guard B, face authentication is performed using the registered face image of security guard B stored in advance to determine whether the security guard is a registered security guard or not. (4). As a result, when it is determined that security guard B is a pre-registered regular security guard, management device 50 waits for moving image data to be processed next.

On the other hand, if security guard B wearing a security guard uniform is included in the moving image data but does not include an appropriate face image, or if security guard B's face recognition fails In this case, the security guard terminal device 40 of the security guard A located near the security guard B is notified of an instruction to capture the face image of the security guard B (5), and the security guard terminal device 40 Display the instructions (6). It is presumed that a malicious suspicious person who is trying to impersonate a security guard tends to look down so that other security guards cannot see his/her face, and is often unable to obtain an appropriate facial image. , the security guard A is instructed to acquire the face image of the security guard B, thereby prompting acquisition of the face image of the security guard B who may be impersonated. Security guard A confirms the displayed content and asks security guard B to pick up a face image (7), and acquires moving image data including the face image of security guard B. FIG.

As described above, in this security system, when the moving image data includes the face image of security guard B, face recognition is performed to determine whether the security guard is a legitimate security guard or an impersonation by a third party. When the moving image data does not contain the face image of security guard B, each security guard is urged to acquire the face image. In addition, it is possible to efficiently detect spoofing as a security guard or the like.

It should be noted that the above series of descriptions are examples for explaining the outline of the present embodiment in an easy-to-understand manner, and the above configurations and procedures do not limit the content of the present invention. For example, FIG. 1 shows a case where security guards are targeted, but security personnel such as venue staff or volunteers who are in charge of security may also be targeted.

<Security system configuration>
Next, the system configuration of the security system shown in FIG. 1 will be described. FIG. 2 is a system configuration diagram of the security system shown in FIG. As shown in FIG. 2, the security system has multiple guard equipment 30 and a management device 50 .

The security guard equipment 30 is a device equipped by security guards. The security guard equipment 30 includes a camera 31 that is a wearable camera, a microphone 32 , a GPS (Global Positioning System) unit 33 , earphones 34 , a speaker 35 and a security guard terminal device 40 .

The camera 31 captures an image of the surroundings and outputs image data to the guard terminal device 40 . Specifically, the camera 31 uses an optical sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) to generate moving image data of the surroundings. The camera 31 may also be provided with attachments to be attached to the guard's body, for example, the attachments may be integrated with a helmet, eyeglasses or earphones.

The microphone 32 acquires ambient sounds and outputs sound data to the security guard terminal device 40 . The GPS unit 33 receives signals from GPS satellites, calculates the position, and outputs the position data to the guard terminal device 40 . The earphone 34 and the speaker 35 output sound under the control of the security terminal device 40 .

The guard terminal device 40 has a function of performing wireless communication using a mobile phone communication network. Also, it may have a function of performing wireless communication conforming to standards such as Wi-Fi (Wireless Fidelity). The guard terminal device 40 can communicate with the management device 50 using these communication functions.

The security guard terminal device 40 transmits moving image data captured by the camera 31 to the management device 50 and outputs command data received from the management device 50 to the display unit and the earphone 34 or the speaker 35 .

The management device 50 uses the moving image data received from the security guard equipment 30 to detect impersonation of a security guard by an unauthorized third party, and notifies the security guard terminal device 40 possessed by each security guard. It is a device that performs A detailed description of the management device 50 will be given later.

Next, the internal configuration of the guard terminal device 40 shown in FIG. 2 will be described. FIG. 3 is an internal configuration diagram showing the internal configuration of the guard terminal device 40 shown in FIG. As shown in FIG. 3 , the security guard terminal device 40 has an equipment interface 41 , a display operation section 42 , a mobile communication network connection section 43 , a storage section 45 and a control section 46 . For convenience of explanation, the explanation of the parts that are not characteristic of this embodiment will be omitted here.

The equipment interface 41 is an interface that receives outputs from the camera 31 , the microphone 32 and the GPS unit 33 and outputs sound to the earphone 34 and the speaker 35 . The display operation unit 42 is a device such as a touch panel display that performs display output and reception of operation input.

The mobile communication network connection unit 43 is a communication interface that connects to a mobile phone communication network for communication. In addition, a communication interface for performing wireless communication conforming to standards such as Wi-Fi (Wireless Fidelity) may be provided. The storage unit 45 is a storage device such as a hard disk or flash memory, and stores moving image data 45a captured by the camera 31 and the like.

The control unit 46 is a control unit that controls the security terminal device 40 as a whole, and has a moving image capturing control unit 46a, a moving image transmission unit 46b, and a command processing unit 46c. The control unit 46 can be realized by a CPU (Central Processing Unit) or the like. When the control unit 46 is implemented by a CPU, the moving image pickup control unit 46a, the moving image transmission unit 46b, and the command processing unit 46c are implemented as processes executed by the CPU.

The moving image pickup control unit 46a is a control unit that controls the start of moving image pickup by the camera 31, the storage of the moving image data 45a in the storage unit 45, and the end of the moving image pickup by the camera 31. FIG. For example, when a security guard is placed at a predetermined position to start guarding, when the security guard presses the "security start button" displayed on the display operation unit 42, the camera 31 is instructed to start capturing a moving image. When the security guard presses the "security interrupt button" or "security end button" displayed on the display operation unit 42, the camera 31 is notified of the end of capturing the moving image.

The moving image transmission unit 46 b is a processing unit that transmits the moving image data 45 a stored in the storage unit 45 to the management device 50 . Storing the moving image data 45a captured by the camera 31 in the storage unit 45 and reading out the moving image data 45a from the storage unit 45 can be performed in parallel.

The command processing unit 46 c is a processing unit that processes commands notified from the management device 50 . Specifically, when receiving a command to "acquire a face image of a specific security guard" from the management device 50, this is displayed on the display operation unit 42, and sound is output to the earphone 34 or the speaker 35. Do.

Next, the internal configuration of the management device 50 shown in FIG. 1 will be described. FIG. 4 is an internal configuration diagram showing the internal configuration of the management device 50 shown in FIG. As shown in FIG. 4 , the management device 50 has a display section 51 , an input section 52 , a communication section 53 , a storage section 54 and a control section 55 .

The display unit 51 is a display device such as a liquid crystal panel or a display device. The input unit 52 is an input device such as a keyboard or mouse. The communication unit 53 is an interface unit for communicating with the security guard terminal device 40 or the like.

The storage unit 54 is a storage device such as a hard disk device or a non-volatile memory, and stores security guard management data 54a, moving image data 54b, and authentication condition data 54c. The security guard management data 54a is data for managing information belonging to an individual security guard, placement of security guards, security schedules, face image data of security guards or feature amounts of the face image data, non-authentication periods, and the like. The security guard's personal information includes the security guard's identification information, name, affiliation, and the like. By referring to the security guard management data 54a, it is possible to identify security guards who have not undergone facial authentication for a predetermined period of time.

The moving image data 54b is moving image data transmitted from the security terminal device 40, and this moving image data is stored for each security terminal device 40 or security guard identification information. Note that this moving image data 54b is filed at regular time intervals.

The authentication condition data 54c is data including conditions for authenticating the face image of the security guard included in the moving image data 54b. For example, the authentication condition data 54c includes a condition that the security guard faces downward or to the side and that the number of pixels that form the original face image of the security guard cannot be two-thirds or more. In this case, even if the face image data is corrected, there is a high possibility that an accurate face image cannot be obtained, so in this case the spoofing detection process is not performed. Also, in cases where the pixel values of half of the pixels forming the face image are remarkably high or low due to backlight or a dark environment, etc., there is a high possibility that an accurate face image cannot be obtained even if the face image data is corrected. Therefore, spoofing detection processing is not performed in this case. In this way, conditions for inappropriate facial images are stored in the authentication condition data 54c, and facial images that do not conform to the authentication condition data 54c are not subjected to spoofing detection processing.

The control unit 55 is a control unit that controls the entire management device 50, and has a guard management unit 55a, a moving image data acquisition unit 55b, a judgment unit 55c, a spoofing detection unit 55d, and an instruction notification unit 55e. In practice, programs corresponding to these functional units are stored in a ROM or non-volatile memory (not shown), and these programs are loaded into the CPU and executed to enable the security guard management unit 55a to acquire moving image data. The corresponding processes are executed by the unit 55b, the determination unit 55c, the spoofing detection unit 55d, and the command notification unit 55e.

The security guard management unit 55a is a processing unit that manages security guards by registering information about the security guards in the security guard management data 54a. In addition, based on the placement and schedule of the guards shown in the guard management data 54a, instructions such as replacement are transmitted to the guard terminal device 40. FIG. In particular, the security guard management unit 55a can identify security guards who have not undergone face authentication for a predetermined period of time by referring to the security guard management data 54a. In response, the instruction notification unit 55e is instructed to capture the face image of the corresponding security guard.

The moving image data acquisition unit 55b is a processing unit that acquires moving image data from the security terminal device 40. The acquired moving image data is stored as moving image data 54b for each security terminal device 40 or security guard identification information. Stored in the storage unit 54 .

The determination unit 55c is a processing unit that determines whether or not the moving image data 54b stored in the storage unit 54 includes a face image that can identify a security guard. Specifically, when the moving image data 54b includes a face image of a security guard, the authentication condition data 54c stored in the storage unit 54 is referenced to determine whether the face image conforms to the authentication condition data 54c. determine whether

Note that the determination unit 55c determines whether the captured person is a security guard based on clothing worn by the captured person (for example, uniforms, shirts, pants, shoes, hats, accessories, and other items worn by the person). It is possible to specify whether or not

The spoofing detection unit 55d detects that a third party has spoofed a security guard based on the face image of the security guard when the determination unit determines that the security guard's face image is included. It is a processing unit that detects whether or not Specifically, a well-known one-to-N face authentication process is performed using this face image and the registered face image of the security guard. For example, if the cross-correlation coefficient of both face images is calculated and is equal to or greater than a predetermined value, it is determined that the two match each other. If the result of face recognition processing does not match any of the registered face images, it is determined that there is a possibility that a third party is impersonating a security officer, and if the face matches any of the registered face images , it is determined that impersonation of the security personnel by a third party has not occurred.

The command notification unit 55e notifies the guard terminal device 40 of a predetermined command when the determination unit 55c determines that the face image included in the moving image data 54b does not conform to the authentication condition data 54c. processing unit. It is also possible to notify a predetermined command to the security guard terminal device 40 of the corresponding security guard. However, if the face image included in the moving image data 54b matches the authentication condition data 54c within a predetermined period of time (for example, within 10 minutes) and is authenticated as a legitimate security guard, the security guard terminal Certain commands to the device 40 can also be canceled. This is because it is not appropriate to issue commands too frequently.

In addition, when the spoofing detection unit 55d detects that the spoofing of a security guard may have occurred, the command notification unit 55e detects that the guard terminal device 40 of a security guard located near the security guard in question. is a processing unit that notifies a predetermined command to the It is also possible to notify a predetermined command to the security guard terminal device 40 of the corresponding security guard.

<Description of security system processing>
Next, processing in the security system will be described. Here, security guards are taken as an example for explanation, but venue staff or the like may be used. Also, it is assumed that a plurality of security guards are equipped with security guard equipment 30, respectively.

FIG. 5 is a flow chart showing the processing procedure of the guard terminal device 40 shown in FIG. This processing procedure is repeatedly executed during security. As shown in FIG. 5, when a moving image is captured by the camera 31 (step S101), this moving image data is transmitted from the camera 31 to the security terminal device 40 (step S102), and It is stored in the storage unit 45 (step S103).

After step S103, the guard terminal device 40 determines whether or not the predetermined time has come (step S104), and if the predetermined time has not come (step S104; No), the process ends. Then, when the predetermined time has come (step S104; Yes), the moving image data 45a is read out from the storage unit 45 (step S105), and this moving image data 45a is transmitted to the management device 50 (step S106). . The reason why the moving image data 45a is transmitted at the predetermined time assigned to the security terminal device 40 is that the moving image data 45a from each security terminal device 40 is concentrated in the management device 50. This is for avoidance, and if sufficient resources are secured, the moving image data 45a may be transmitted to the management device 50 at all times regardless of the time.

Next, processing in the management device 50 will be described. FIG. 6 is a flow chart showing the determination processing procedure of the management device 50 shown in FIG. As shown in FIG. 6, it is first determined whether moving image data has been received via the communication unit 53 (step S201). repeat. On the other hand, if the moving image data has been received (step S201; Yes), after storing the moving image data in the storage unit 54 (step S202), it is determined whether the moving image data contains the face image of the security guard. is determined (step S203), and when the moving image data does not include the security guard's face image (step S203; No), the process proceeds to step S201.

On the other hand, if the moving image data contains the face image of the security guard (step S203; Yes), it is determined whether the face image satisfies the authentication conditions (step S204). does not meet the authentication conditions (step S204; No), the security guard terminal device 40 of the security guard located near the security guard in question is instructed to capture the face image of the security guard in question. It transmits (step S206), and on condition that a predetermined end operation has not been performed (step S207; No), the process proceeds to step S201.

If the face image satisfies the authentication conditions (step S204; Yes), face authentication is performed by comparing this face image with the registered face image of each security guard, and as a result, the security guard is determined to be a legitimate security guard. If so (step S205; Yes), on condition that a predetermined end operation has not been performed (step S207; No), the process proceeds to step S201. If it is determined that the security guard is not a legitimate security guard (there is a possibility that a third party is pretending to be a security guard) (step S205; No), the security guard terminal of a security guard located near the security guard in question. A command is sent to the device 40 to capture the face image of the security guard (step S206), and on condition that a predetermined end operation has not been performed (step S207; No), the process proceeds to step S201. . It should be noted that if a predetermined end operation has been performed (step S207; Yes), the series of processes described above is ended.

In the above description, the case of matching a face image with each registered face image has been described, but it is also possible to extract a predetermined feature amount from the face image and match this feature amount with the registered feature amount. A cross-correlation coefficient or the like can be used for such collation processing.

Further, in the above description, a case is shown in which a command is transmitted to the security guard terminal device 40 of the security guard located near the security guard to capture the face image of the security guard. It is also possible to issue a command to the security guard's terminal device 40, such as "Contact another security guard to have him/her take an image of his/her face."

Next, an example of a screen displayed on the display operation unit 42 of the guard terminal device 40 will be described. FIG. 7 is a diagram showing an example of a screen displayed on the display operation unit 42 of the security terminal device 40. As shown in FIG. As shown in this screen example 61, the display operation unit 42 of the security guard terminal device 40 includes an instruction to request cooperation in image capturing and an image showing the security guard to be imaged. . As a result, the security guard who received the command can clearly identify the security guard who is requested to cooperate with the image capturing, and the security guard who was not determined to be a security guard can be re-determined. You can ask for cooperation.

FIG. 8 is a diagram showing another screen example displayed on the display operation unit 42 of the guard terminal device 40. As shown in FIG. In this screen example 62, when a plurality of persons wearing uniforms of security guards, who are insiders, are photographed, an indicator 62a indicating which of the persons wearing uniforms is being imaged is displayed. Is displayed. This index 62 a may be attached by the management device 50 . As a result, even when a plurality of persons wearing the uniforms of security guards are shown in the image, the security guard who confirms the instruction on the display operation unit 42 of the security terminal device 40 is the object of imaging. A person can be clearly identified.

FIG. 9 is a diagram showing another screen example displayed on the display operation unit 42 of the guard terminal device 40. As shown in FIG. In this screen example 63, when the image cannot be recognized due to insufficient image capturing conditions, by displaying the image capturing conditions that caused the failure, image capturing with improved image capturing conditions can be encouraged. The security guard carrying the security guard terminal device 40 on which the command is displayed calls out to the security guard according to the command and requests, for example, the security guard's cooperation in taking a face image.

As described above, in this embodiment, the security terminal devices 40 possessed by a plurality of security guards who are in charge of guarding a predetermined security area, and the management device provided so as to be able to communicate with each security guard terminal device 40 50, the management device 50 includes a moving image data acquisition unit 55b that acquires moving image data captured by the camera 31 attached to each security guard, and a moving image data acquisition unit 55b that acquires moving image data. a judgment unit 55c for judging whether or not a face image capable of identifying a security guard is included in the received moving image data; Furthermore, the spoofing detection unit 55d detects spoofing of a security guard by a third party based on the face image of the security guard. spoofing can be efficiently detected.

In this embodiment, the case where a third party pretends to be a security guard has been described, but the same can be applied to cases where a third party pretends to be a venue staff or a volunteer in charge of guarding a predetermined security area. In this case, it is necessary to have the venue staff and volunteers carry the security guard terminal device 40 and the camera 31, and to wear clothes that allow the venue staff and volunteers to be identified.

Also, in this embodiment, the case of detecting impersonation of a security guard by a third party based on moving image data captured by one camera 31 has been described, but the present invention is not limited to this. Instead, it is possible to detect impersonation of a security guard by a third party based on a plurality of moving image data captured by a plurality of cameras 31 . Further, based on the moving image data captured by the camera 31 and the moving image data captured by the fixed camera, it is possible to detect impersonation of a security guard by a third party. As a result, spoofing detection is performed using moving image data captured from a plurality of directions, so detection accuracy can be improved.

In this embodiment, the moving image data captured by the camera 31 is transmitted to the management device 50 via the security terminal device 40, but the present invention is not limited to this. It can also be applied when moving image data is directly transmitted from the camera 31 to the management device 50 .

Also, in the present embodiment, the case of capturing moving image data with the camera 31 has been described, but the present invention is not limited to this, and can be similarly applied to the case of capturing still images.

In this embodiment, 1:N face recognition processing is performed using moving image data and a plurality of registered face images. Although the configuration has been described as an example for determining that there is a possibility that a For example, a security guard that should be included in the moving image data is specified in advance, and one-to-one face authentication processing is performed using the moving image data and the registered face image of the specified security guard. It may be determined that there is a possibility that impersonation of the security personnel by the security personnel has occurred. Security guards that should be included in the moving image data can be identified by comparing the imaging position and imaging date and time of the moving image data with the deployment schedule of the guards indicated in the security guard management data 54a.

As described above, the security system, management device, and security method according to the present invention are useful for efficiently detecting spoofing of a security guard in a security area guarded by a plurality of security guards.

30 security guard equipment 31 camera 32 microphone 33 GPS unit 34 earphone 35 speaker 40 security guard terminal device 41 equipment interface 42 display operation section 43 mobile communication network connection section 45 storage section 45a moving image data 46 control section 46a moving image pickup control section 46b Moving image transmission unit 46c Command processing unit 51 Display unit 52 Input unit 53 Communication unit 54 Storage unit 54a Security guard management data 54b Moving image data 54c Authentication condition data 55 Control unit 55a Security guard management unit 55b Moving image data acquisition unit 55c Judging unit 55d Impersonation detection unit 55e Command notification unit 61-63 Screen example 62a Indicator A, B Security guard

Claims (9)

A security system comprising a terminal device owned by each of a plurality of security personnel in charge of security in a predetermined security area, and a management device provided to communicate with each terminal device,
The management device
an image acquisition unit that acquires an image captured by an imaging device possessed by each of the plurality of security personnel;
a first determination unit that determines whether or not the image acquired by the image acquisition unit includes a person wearing clothing or accessories for security personnel;
a second determination unit that, when the first determination unit determines that the person is included in the image, determines whether or not the face image of the person conforms to a predetermined authentication condition;
When the second determination unit determines that the face image of the person meets the authentication conditions, a third party is prevented from impersonating a security officer based on the face image of the person included in the image. a detection unit that detects
When the second determination unit determines that the face image of the person does not meet the authentication conditions, the person is sent to a terminal device possessed by one or more security personnel located near the person. and a notification unit that issues a predetermined notification for instructing imaging of the face image of the person. A security system comprising a terminal device owned by each of a plurality of security personnel in charge of security in a predetermined security area, and a management device provided to communicate with each terminal device,
The management device
an image acquisition unit that acquires an image captured by an imaging device possessed by each of the plurality of security personnel;
a first determination unit that determines whether or not the image acquired by the image acquisition unit includes a person wearing clothing or accessories for security personnel;
a second determination unit that, when the first determination unit determines that the person is included in the image, determines whether or not the face image of the person conforms to a predetermined authentication condition;
When the second determination unit determines that the face image of the person meets the authentication conditions, a third party is prevented from impersonating a security officer based on the face image of the person included in the image. a detection unit that detects
When the second determination unit determines that the facial image of the person does not meet the authentication conditions, a predetermined notification instructing the terminal device possessed by the person to contact another security guard. A security system comprising: a notification unit that performs The predetermined authentication condition is
3. The security system according to claim 1, further comprising a condition as to whether or not a predetermined number of pixels forming said face image of said person is included. The imaging device is
3. The security system according to claim 1, wherein the security system is a wearable camera that is attached to the body of each security officer and has an imaging unit that captures at least an image. The management device
further comprising a storage unit for storing registered face images of security personnel or feature amounts extracted from the registered face images;
The detection unit is
Based on the face image of the person included in the image and the registered face image of each security officer stored in the storage unit or the feature amount extracted from the registered face image, a security officer by a third party 5. The security system according to any one of claims 1 to 4, which detects spoofing of a person. A management device provided so as to be capable of communicating with terminal devices possessed by a plurality of security personnel in charge of security in a predetermined security area,
an image acquisition unit that acquires an image captured by an imaging device possessed by each of the plurality of security personnel;
a first determination unit that determines whether or not the image acquired by the image acquisition unit includes a person wearing clothing or accessories for security personnel;
a second determination unit that, when the first determination unit determines that the person is included in the image, determines whether or not the face image of the person conforms to a predetermined authentication condition;
When the second determination unit determines that the face image of the person meets the authentication conditions, a third party is prevented from impersonating a security officer based on the face image of the person included in the image. a detection unit that detects
When the second determination unit determines that the face image of the person does not meet the authentication conditions, the person is sent to a terminal device possessed by one or more security personnel located near the person. and a notification unit that issues a predetermined notification for instructing imaging of the face image of the person. A management device provided so as to be capable of communicating with terminal devices possessed by a plurality of security personnel in charge of security in a predetermined security area,
an image acquisition unit that acquires an image captured by an imaging device possessed by each of the plurality of security personnel;
a first determination unit that determines whether or not the image acquired by the image acquisition unit includes a person wearing clothing or accessories for security personnel;
a second determination unit that, when the first determination unit determines that the person is included in the image, determines whether or not the face image of the person conforms to a predetermined authentication condition;
When the second determination unit determines that the face image of the person meets the authentication conditions, a third party is prevented from impersonating a security officer based on the face image of the person included in the image. a detection unit that detects
When the second determination unit determines that the facial image of the person does not meet the authentication conditions, a predetermined notification instructing the terminal device possessed by the person to contact another security guard. and a notification unit that performs A security method in a security system having terminal devices possessed by a plurality of security personnel in charge of security in a predetermined security area, and a management device provided to communicate with each terminal device, comprising:
an image acquisition step in which the management device acquires an image captured by an imaging device possessed by each of the plurality of security personnel;
a first determination step in which the management device determines whether or not the image obtained by the image obtaining step includes a person wearing clothing or accessories for security personnel;
a second determination, wherein the management device determines whether or not the face image of the person conforms to a predetermined authentication condition when the person is determined to be included in the image in the first determination step; process and
When the second determination step determines that the facial image of the person conforms to the authentication conditions, the management device determines whether a security guard by a third party based on the facial image of the person included in the image. a detection step of detecting impersonation of a person;
Terminal devices possessed by one or more security personnel located near the person when the management device determines in the second determination step that the face image of the person does not conform to the authentication conditions and a notification step of issuing a predetermined notification instructing the person to pick up the face image of the person. A security method in a security system having terminal devices possessed by a plurality of security personnel in charge of security in a predetermined security area, and a management device provided to communicate with each terminal device, comprising:
an image acquisition step in which the management device acquires an image captured by an imaging device possessed by each of the plurality of security personnel;
a first determination step in which the management device determines whether or not the image obtained by the image obtaining step includes a person wearing clothing or accessories for security personnel;
a second determination, wherein the management device determines whether or not the face image of the person conforms to a predetermined authentication condition when the person is determined to be included in the image in the first determination step; process and
When the second determination step determines that the facial image of the person conforms to the authentication conditions, the management device determines whether a security guard by a third party based on the facial image of the person included in the image. a detection step of detecting impersonation of a person;
When the second determination step determines that the face image of the person does not meet the authentication conditions, the management device instructs the terminal device possessed by the person to contact another security personnel. A security method characterized by comprising: a notification step of performing a predetermined notification to instruct.

Images