JP2007219683A - Security management equipment, security management system and security management method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a security management device for compensating the difficulty of the collation of a face image, and for attaining high-security access control. <P>SOLUTION: A security management device 1 is provided with a registered face image DB 28 for registering the face image of a user who is permitted to enter a security area; a video receiving part 12 for receiving a video from a photographing device 50 which photographs the surrounding of the entrance of the security area; a face image detection part 18 for detecting the face image from the input video; a face image collation part 26 for collating the face image detected by the face image detection part 18 with the face image registered in a registered face image DB 28; and a warning signal notification part 32 for, when the face image is not detected by the face image detection part 26, notifying a first warning level signal to instruct an operation terminal 70 arranged in the security area to display the figure image, and for, when the face image is not collated by the face image collation part 26, notifying a second warning level signal to instruct the operation terminal 70 to display the face image. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a security management device that manages entry into a security area.

Conventionally, a security management system that performs user authentication when entering a security area has been known. Patent Document 1 describes an entry / exit management device that permits entry based on a user authentication result. The entrance / exit management device described in Patent Literature 1 includes a card reader that reads user authentication information, a determination unit that determines whether the user authentication information is correct, and an electric lock only when the validity of the authentication information is confirmed. And an electric lock driving unit for unlocking the device. In this entry / exit management device, entry into the user's room is managed by unlocking when the authentication information read from the user's card reader is valid.
JP-A-5-311930 JP 2000-194975 A

  However, the entrance / exit management device described in Patent Document 1 determines whether to enter a room based only on the legitimacy of the user's authentication information. Therefore, it cannot be said that the security is necessarily high. For example, a person who picks up a card on which authentication information is recorded can enter the room illegally by using the card.

  In order to further increase security, it has been proposed to collate face images of users, but it is not easy to collate face images with high accuracy. If high accuracy is required for collation of face images, a legitimate user cannot enter the room due to the collation failure. On the other hand, if the accuracy of face image matching may be lowered, unauthorized unauthorized third parties are allowed to enter.

  In addition, a technique described in Patent Document 2 that automatically reports to a supervisor who is closest to the monitored facility is also known in order to quickly deal with an alarm in the monitored facility. . However, when face image verification cannot be performed, it is not appropriate to notify the monitoring staff one by one, and the response to the user who wants to enter the room is delayed.

  In view of the above background, an object of the present invention is to provide a security management device capable of overcoming difficulty in collating face images and performing entrance management with high security.

  A security management device according to the present invention includes a registered face image database in which a face image of a user permitted to enter a security area is registered, and a video reception unit that receives a video from a photographing device that captures a state near the entrance of the security area. And a human image detection unit that detects a human image from the video received by the video reception unit, and an image in which the human image is detected when the human image detection unit detects the human image. A face image detection unit for detecting a face image of the person from among the face image detection unit, a face image verification unit for verifying whether the face image detected by the face image detection unit is registered in the registered face image database, and the face Instructing the device arranged in the security area to display the person image taken by the photographing device when the image detecting unit cannot detect the face image. When the face image is not collated by the face image collating unit, the face image photographed by the photographing device is displayed on the device arranged in the security area. And a warning signal notification unit that notifies a signal of a second warning level instructed to.

  With this configuration, when the face image extracted from the video of the photographing apparatus cannot be collated, a signal of the first warning level or a signal of the second warning level is transmitted to the device in the security area, and the security area The person image or face image extracted from the video is displayed on the device. A person in the security area can give a room entry permission to a user who cannot enter the room due to a verification failure. Authentication by a person in the security area can compensate for the difficulty of collating face images and can manage room entry with security. Further, the warning signal notification unit notifies different warning levels depending on whether the face image matching failure is caused by the undetected face image or the face image matching failure. Thus, the person in the security area can immediately determine the degree of urgency while proceeding with his / her work. When the face image cannot be detected, it is considered that the user is intentionally prevented from taking a picture by the photographing apparatus, and there is a possibility that the user is a malicious intruder. Therefore, a high warning level is used as the first warning level. To be notified. On the other hand, if the face image is detected but the face image cannot be collated, it is possible that the user who is allowed to enter the room cannot be collated, or it may be a client or the like. Notify the alert level.

  In the security management device of the present invention, the warning signal notification unit does not notify a signal when a face image is verified by the face image verification unit.

  With this configuration, if the face image is verified and the user can enter without obtaining approval from the person in the security area, nothing is displayed on the device in the security area. There is no hindrance.

  In the security management device of the present invention, the face image matching unit receives user identification information transmitted from a user identification information reader provided at the entrance of the security area, and the face image corresponding to the received user identification information Is read from the registered face image database, and the read face image is collated with the face image detected by the face image detecting unit.

  With this configuration, the face image matching process needs only to be matched with the face image corresponding to the user identification information, so the load of the matching process can be reduced.

  In the security management device of the present invention, the face image collating unit has a configuration for collating a plurality of face images detected for the same person with face images stored in the registered face image database.

  With this configuration, since a plurality of detected face images are collated, it is possible to reduce collation failures caused by photographing conditions such as a photographing direction and brightness.

  In the security management device according to the present invention, the warning signal notification unit can further receive a response to the notified first warning level signal or second warning level signal from the device, and the warning signal notification unit A response device storage unit that stores information indicating the device that has transmitted the response when a response to the signal of the first warning level or the signal of the second warning level notified from is received from any of the devices It has the composition provided.

  With this configuration, it is possible to manage persons corresponding to users who could not collate face images.

  In the security management device of the present invention, the warning signal notification unit, when receiving the response, for all the devices that are the transmission destinations of the first warning level signal or the second warning level signal. Thus, a warning cancellation signal for stopping the display of the person image or the face image is transmitted.

  With this configuration, when an operator of one of the devices in the security area approves the user's entry or takes some action, it is no longer necessary to deal with all the devices other than the operator. Can be notified.

  In the security management device of the present invention, the first warning level signal is a signal for instructing to blink and display at least a part of a screen for displaying the person image.

  With this configuration, when a person with the first alert level appears, it is possible to visually draw attention.

  In the security management device of the present invention, the first warning level signal is a signal for instructing to output a sound when displaying a screen for displaying the person image.

  With this configuration, when a person with the first warning level appears, it is possible to audibly alert.

  In the security management device of the present invention, the first warning level signal is a signal for instructing to display the moving image of the person.

  With this configuration, when a person with the first alert level appears, the state of the person can be notified in detail.

  The security management system of the present invention includes a photographing device for photographing a state near the entrance of a security area, and a security management device for managing entry into the security area based on a video photographed by the photographing device. The security management device includes a registered face image database in which a face image of a user permitted to enter the security area is registered, a video receiving unit that receives a video transmitted from the photographing device, and the video receiving unit A person image detecting unit for detecting a person image from the received video, and when the person image detecting unit detects the person image, the person image is detected from the detected images. A face image detection unit for detecting a face image and collating whether the face image detected by the face image detection unit is registered in the registered face image database When the face image collation unit and the face image detection unit cannot detect a face image, the device arranged in the security area is instructed to display the person image photographed by the photographing device. A signal of a first warning level is notified, and when a face image is not verified by the face image verification unit, a face image captured by the imaging device is displayed on a device arranged in the security area A warning signal notification unit that notifies a signal of a second warning level instructed to do so.

  With this configuration, as with the security management device of the present invention, authentication by a person in the security area can compensate for the difficulty of collating face images and perform entrance management with security ensured. In addition, a person in the security area can immediately determine the urgency while proceeding with his / her work. Various configurations of the security management apparatus of the present invention can be applied to the security management system of the present invention.

  The security management method of the present invention includes a video receiving step for receiving a video from a photographing device that captures a state near the entrance of a security area, and a human image detection for detecting a human image from the video received in the video receiving step. A face image detecting step for detecting a face image of the person from the images in which the person image is detected when the person image is detected in the person image detecting step; and the face image detecting step. A face image collating step for collating whether or not the face image detected in the step is included in a registered face image database in which a face image of a user permitted to enter the security area is registered, and in the face image detecting step When a face image cannot be detected, a person image shot by the shooting device is displayed on a device arranged in the security area. A signal of a first warning level instructing to be performed, and when a face image is not collated in the face image collation step, the image is photographed by the photographing apparatus on a device arranged in the security area. A warning signal notification step of notifying a second warning level signal that instructs to display the face image.

  With this configuration, as with the security management device of the present invention, authentication by a person in the security area can compensate for the difficulty of collating face images and perform entrance management with security ensured. In addition, a person in the security area can immediately determine the urgency while proceeding with his / her work. Various configurations of the security management apparatus of the present invention can be applied to the security management method of the present invention.

  The program of the present invention is a program for managing entrance to a security area based on a video transmitted from an imaging device that captures a scene near the entrance of the security area, and receives a video from the imaging device on a computer. When the person image detection step detects the person image from the image received at the image reception step, and the person image detection step detects the person image from the person image detection step. A face image detecting step for detecting a face image of the person from the detected images, and the face image detected in the face image detecting step is a face image of a user permitted to enter the security area. A face image collating step for collating whether the image is included in the registered registered face image database, and the face image is detected in the face image detecting step. If it is not possible to output, a signal of a first warning level instructing a device arranged in the security area to display a person image photographed by the photographing device is notified, and the face image matching step When a face image is not collated in step 2, a warning is sent to a second warning level signal instructing the device arranged in the security area to display the face image taken by the photographing device. And a signal notification step.

  With this configuration, as with the security management device of the present invention, authentication by a person in the security area can compensate for the difficulty of collating face images and perform entrance management with security ensured. In addition, a person in the security area can immediately determine the urgency while proceeding with his / her work. Various configurations of the security management apparatus of the present invention can be applied to the program of the present invention.

  The computer-readable storage medium of the present invention has a configuration storing the above program.

  With this configuration, as with the security management device of the present invention, authentication by a person in the security area can compensate for the difficulty of collating face images and perform entrance management with security ensured. In addition, a person in the security area can immediately determine the urgency while proceeding with his / her work.

  ADVANTAGE OF THE INVENTION According to this invention, the authentication by the person who exists in a security area has the outstanding effect that the difficulty of the collation of a face image can be supplemented, and entrance management which secured security can be performed. In addition, a person in the security area can immediately determine the urgency while proceeding with his / her work.

  The security management system according to the embodiment of the present invention will be described below. In the present embodiment, the security management system will be described as an example of a system that manages entry into the security room.

(First embodiment)
FIG. 1 is a diagram showing a configuration of a security management system 1 according to the present embodiment. The security management system 1 includes a security management device 10 that controls the electric lock 60 in the security room and manages entry into the security room. An ID card processing device 40 that reads an ID card and a photographing device 50 for photographing a user who wants to read the ID card are provided at the security room entrance. When there is no user, the photographing device 50 photographs the state near the entrance door of the security room.

  The security management device 10 is connected to the ID card processing device 40 and the photographing device 50. The security management device 10 determines whether or not the user can enter the security room by collating face images extracted from the video imaged by the imaging device 50.

  The security management device 10 includes a video receiving unit 12 that receives a video transmitted from the imaging device 50 and an image storage unit 14 that stores at least a part of the video received by the video receiving unit 12. Yes. The security management device 10 includes a person image detection unit 16 that detects a person image from the video received by the video reception unit 12 and a face image detection unit 18 that detects a face image from the image detected by the person image detection unit 16. It has.

  The human image detection unit 16 is described in, for example, “Extraction and Tracking of Multiple Moving Objects Using Time Series Difference Images” (Tatsumi / Yagi / Taniuchida, Information Processing Society of Japan Research Report, CV-81-7, 51-55). A person's image is extracted by the developed technique. The person image detection unit 16 recognizes the same person (moving object) from the continuous images, assigns an identifier (person No.) to the person, and extracts a continuous image from when the person appears on the screen until it disappears. . In addition, the person image detection unit 16 acquires the time of the first image when the person appears on the screen as “screen IN time”, and acquires the time of the image immediately before the person disappears from the screen as “screen OUT time”.

  The face image detection unit 18 detects a plurality of face images of the person from the video from the screen IN time to the screen OUT time detected by the person image detection unit 16. The face image detection unit 18 stores the detected face image in the face image storage unit 20.

  FIG. 2 is a diagram illustrating an example of data stored in the face image storage unit 20. The face image storage unit 20 stores “person No.”, “detection time”, and “face image data”. “Person No” is an identifier assigned to the person image detected by the person image detection unit 16. With this information, it is possible to grasp to which person the stored face image corresponds.

  “Detection time” is data indicating the time when a face image is detected. Here, a method for obtaining the detection time will be described. The security management device 10 includes a time unit 22. The clock unit 22 allows any component in the security management apparatus 10 to refer to the current time. The image counting unit 24 connected to the face image detecting unit 18 obtains the time when the face image is detected from the time when the video is started to be recorded and the number of frames from the recording start time.

  The “face image data” stored in the face image storage unit 20 is a data file of the detected face image. As the format of the data file, for example, a known image format such as a gif format or a tif format can be used.

  The face image collation unit 26 has a function of collating whether the face image data stored in the face image storage unit 20 is registered in a registered face image database (hereinafter referred to as “registered face image DB”) 28. First, the registered face image DB 28 will be described.

  FIG. 3 is a diagram illustrating an example of data stored in the registered face image DB 28. The registered face image DB 28 stores “user ID” and “face image data”. “User ID” is an identifier that identifies a user who is permitted to enter the security room. “Face image data” is a face image of the user specified by “user ID”. Here, an example has been described in which one face image data is registered for one user, but a plurality of face image data may be registered for one user. For example, a face image with glasses and a face image without glasses, or a face image with long hair and a face image with short hair may be registered.

  The face image collation unit 26 acquires the user ID read from the ID card by the ID collation unit 44 of the ID card processing device 40. The face image matching unit 26 reads a registered face image corresponding to the user ID acquired from the ID card processing device 40 from the registered face image DB 28. The face image matching unit 26 determines whether or not the face image read from the registered face image DB 28 matches any of the plurality of face images detected by the face image detection unit 18. Perform the matching process.

  The face image collation unit 26 is connected to an electric lock control unit 30 that controls the electric lock 60 and is also connected to a warning signal notification unit 32 that notifies the work terminal 70 of a warning level. The face image collation unit 26 transmits the collation result of the face image collation to the electric lock control unit 30 and the warning signal notification unit 32. The electric lock control unit 30 unlocks the electric lock 60 when the collation result by the face image collation unit 26 is OK, and does not unlock otherwise.

  The warning signal notification unit 32 transmits a signal indicating a warning level to the work terminal 70 when the collation result by the face image collation unit 26 is NG. The warning signal notification unit 32 transmits a first warning level signal to the work terminal 70 when the face image cannot be detected, and when the face image matching is NG, the warning signal notification unit 32 transmits the second warning level signal. A signal is transmitted to the work terminal 70. Further, the warning signal notification unit 32 has a function of receiving a response signal transmitted from the work terminal 70 when either the “approval” button or the “handling” button is selected on the work terminal 70. When receiving a response signal from any of the work terminals 70, the warning signal notification unit 32 stores the work terminal 70 that is the transmission source of the response signal in the handling terminal storage unit 34. Thereafter, the warning signal notification unit 32 transmits a warning release signal to the work terminal 70 that has transmitted the warning level signal.

  FIG. 4 is a diagram illustrating an example of data stored in the handling terminal storage unit 34. The coping terminal storage unit 34 stores data of “work terminal ID”, “processing time”, and “approval / coping”. “Working terminal ID” is data for identifying the working terminal that is the transmission source of the response signal. With this data, the person corresponding to the intruder or visitor can be identified. “Processing time” is information indicating the time of approval or handling. “Approval / handling” is data indicating whether the user has approved or has taken action. “Approval” means that the user is authenticated and allowed to enter the room by authenticating a person in the security room. “Correction” means that entry is not permitted.

  The work terminal 70 is a device provided in the security. The work terminal 70 is, for example, a PC of a registered user who is permitted to enter the security room. When the work terminal 70 receives a signal indicating the first warning level or a signal indicating the second warning level from the security management apparatus 10, the work terminal 70 displays a person image or a face image transmitted together with the signal on the screen. .

  FIG. 5 is a diagram illustrating an example of a screen to be displayed when a first warning level signal is received. In the work terminal 70, it is a figure which shows the example which received the signal of the 1st alert level from the security management apparatus 10, when the edit operation | work of mail was normally performed. A pop-up window with the title “Intruder” is displayed at the bottom right of the screen. In this case, it is preferable to display the window in a manner that alerts the user. For example, it is possible to employ a configuration in which the “intruder” portion is displayed blinking or a sound is output together with the display. In addition, in order to inform in detail the state of the intruder, a moving image of the photographed person may be displayed in an area under “intruder”.

  FIG. 6 is a diagram illustrating an example of a screen to be displayed when a second warning level signal is received. In the work terminal 70, it is a figure which shows the example which received the signal of the 2nd warning level from the security management apparatus 10, when the edit operation | work of mail was normally performed. A pop-up window with the title “Visitor” is displayed at the bottom right of the screen.

  FIG. 7 is a diagram illustrating an operation of detecting a person and a face image in the security management system 1 according to the present embodiment. In the security management system 1 of the present embodiment, the imaging device 50 always captures an image near the entrance of the security room (S10). The video imaged by the imaging device 50 is transmitted to the security management device 10. When the video reception unit 12 of the security management device 10 receives the video transmitted from the imaging device 50, the human image detection unit 16 detects a human image from the received video. At this time, the person image detection unit 16 obtains a time when the person starts to be detected (screen IN time) and a time when the person is no longer detected (screen OUT time). The security management apparatus 10 determines whether or not a person image is detected by the person image detection unit 16 (S12). If a person image is detected, the image storage unit 14 displays the video from which the person image is detected. (S14). With the above operation, the security management apparatus 10 records only the video in which the person image is detected from the video that is constantly input, so that only the necessary video can be efficiently stored.

  When the person image detecting unit 16 detects the person image, the security management device 10 assigns a person number for identifying the person to the detected person image (S16). Next, the person image detection unit 16 transmits the screen IN time and the screen OUT time to the warning signal notification unit 32 (S18).

  Subsequently, the face image detection unit 18 of the security management device 10 detects a face image from the person image detected by the person image detection unit 16 (S20). The face image detection unit 18 detects a plurality of face images at predetermined time intervals from a person image detected between the screen IN time and the screen OUT time. The face image detection unit 18 stores the detected face image, the person number, and the detection time in association with each other (S22). The security management device 10 determines whether or not the number of persons in the image has become 0 (S24). If the number of persons in the image is not 0 (NO in S24), since a person other than the detected person is included, the process returns to step S16 for extracting a person image and performs the same processing as described above. If the number of persons in the image is 0 (YES in S24), the security management apparatus 10 ends recording in the image storage unit 14 (S26).

  Next, the security management device 10 determines whether or not the face image detection unit 18 has detected a face image (S28). If even one face image is detected between the screen IN time and the screen OUT time, it is determined that the face image has been detected.

  FIG. 8 is a diagram illustrating processing for determining whether or not a face image has been detected. The horizontal axis in FIG. 8 indicates time. The screen IN time T1 indicates the time when the human image starts to be detected, and the screen OUT time T2 indicates the time when the human image is no longer detected. In the pattern A, a face image is detected in all cases of face image detection processing performed at a predetermined time interval between the screen IN time T1 and the screen OUT time T2. In the pattern B, the face image was detected at the first and fourth times of the face image detection process performed at a predetermined time interval between the screen IN time T1 and the screen OUT time T2. In pattern A and pattern B, since the face image could be detected, it is determined that face image detection is OK (YES in S28). In pattern C, the face image could not be detected in all cases, so it is determined as face image detection NG (NO in S28).

  If it is determined that the face image cannot be detected (NO in S28), the security management device 10 notifies the warning signal notification unit 32 of the face image detection NG (S30). Receiving this, the warning signal notification unit 32 transmits a signal of the first warning level to the work terminal 70 (S32). After notifying the face image detection NG or determining that the face image detection is OK, the process returns to step S12 for detecting a person from the video received from the photographing device 50 and the above operation is repeated.

  With the above operation, the security management apparatus 10 can detect a person and a face image from the video that is always photographed by the photographing apparatus 50 and store it in the face image storage unit 20. Next, an operation for collating face images by the security management apparatus 10 will be described.

  FIG. 9 is a flowchart showing an operation of collating face images by the security management apparatus 10. The collation of the face image is started by causing the ID card processing device 40 to read the ID card.

  First, the ID reading unit 42 of the ID card processing device 40 reads the ID card, and the ID verification unit 44 checks whether the user ID read by the ID reading unit 42 is stored in the registrant ID file 46 (S40). . When the collation by the ID collation unit 44 is OK (YES in S42), the ID collation unit 44 transmits the time when the user ID is collated and the collated user ID to the security management apparatus 10 (S44). If the collation by the ID collation unit 44 is NG (NO in S42), the security management device ends the face image collation process and waits for the next user ID to be read.

  When the face image matching unit 26 of the security management device 10 receives the user ID and the matching time from the ID card processing device 40, the face image matching unit 26 performs a face image matching process based on the received user ID and the matching time. The face image matching unit 26 acquires a face image corresponding to the received user ID from the registered face image DB 28 (S46). Further, the face image collation unit 26 acquires a face image corresponding to the received collation time from the face image storage unit 20 (S48). The face image collation unit 26 collates the face image by comparing the face image acquired from the registered face image DB 28 with the face image acquired from the face image storage unit 20 (S50).

  If the face image collation is OK (YES in S52), the face image collation unit 26 notifies the electric lock control unit 30 of the face image collation OK (S54). When receiving the notification of face image verification OK, the electric lock control unit 30 unlocks the electric lock 60 (S56). If the collation of the face image is NG (NO in S52), the security management apparatus 10 determines whether or not collation has been performed for a predetermined number of face images (S58). When collation is not performed for a predetermined number of face images (NO in S58), face images corresponding to the collation time are acquired again (S48). In this case, the face image detected immediately before the previously acquired face image is acquired. Normally, a user who presents an ID card in an attempt to enter the security room approaches the photographing device 50, so the face image at the ID card collation time is the largest, and the face image goes back to the past from the collation time. It is thought to become gradually smaller. Therefore, by acquiring face images sequentially from the collation time toward the past, face image collation processing can be executed in order from large face images suitable for collation. The operation after acquiring the face image corresponding to the collation time is the same as the operation described above.

  In the case of face image collation NG (NO in S52) and when a predetermined number of face images are compared (YES in S58), the warning signal notification unit 32 is notified that the face images have not been collated. (S60). Upon receiving the notification of face image matching NG, the warning signal notification unit 32 transmits a second warning level signal to the work terminal 70 (S62).

  FIG. 10 is a diagram illustrating operations of the security management device 10 and each work terminal 70. The security management device 10 transmits a first alert level signal to the work terminal 70 (S70). Note that FIG. 10 illustrates an example in which the first warning level signal is transmitted. However, when the security management device 10 transmits the second warning level signal, the operation is almost the same as the operation illustrated in FIG. 10. Is performed. When transmitting a signal of the second warning level, the difference from the signal of the first warning level is that the screen displayed on the work terminal is not a screen that notifies the intruder but a screen that notifies the visitor. It is.

  The security management device 10 transmits the human image data to the work terminal 70 together with the first warning level signal. The work terminal 70 that is the transmission target of the warning level signal is a terminal that is turned on at the time of signal transmission among the work terminals 70 in the security room. In this embodiment, an example is described in which a warning signal is transmitted to all terminals that are powered on. However, it is not always necessary that all terminals that are powered on be transmission targets. For example, it may be transmitted to the terminal of the receptionist. When there is a user who is scheduled to visit, a second warning level signal may be transmitted to the user's work terminal.

  When the work terminal 70 receives the first warning level signal transmitted from the security management apparatus 10 (S72), the work terminal 70 displays the screen of the intruder (S74) and alerts the user. Here, the screen of the intruder is displayed on all the work terminals 70 that have received the first warning level signal. When any of the work terminals 70 receives selection of a countermeasure button (S76), the work terminal 70 notifies the security management apparatus 10 that the countermeasure button has been selected (S78). FIG. 10 illustrates an example in which the countermeasure button is selected, but the following processing is the same when the approval button is selected.

  When the security management apparatus 10 receives a notification that the countermeasure button has been selected from the work terminal 70 (S80), the security management apparatus 10 identifies the work terminal 70 that is the transmission source of the notification, and stores the information of the work terminal 70 as a history and stores the countermeasure terminal. Stored in the unit 34 (S82). The security management device 10 transmits a warning level release signal to each work terminal 70 (S84). When each work terminal 70 receives a warning level release signal from the security management device 10 (S86), the work terminal 70 erases the screen of the intruder display (S88).

  The configuration and operation of the security management system 1 according to the first embodiment of the present invention have been described above.

  In the security management system 1 according to the first embodiment, since the security management device 10 manages room entry by collating face images, a person who picks up or steals an ID card cannot enter the security room, improving security. Can be achieved. In addition, when the face image collation is NG, the person in the security room can approve by displaying the face image or the person image on the work terminal 70 in the security room. Even when face images cannot be properly matched due to shooting conditions, the user can be allowed to enter the room while maintaining high security.

  Moreover, the security management system 1 of this Embodiment performs notification of a different alert level by the case where a face image cannot be detected, and the case where a face image cannot be collated. As a result, a person in the security area can immediately determine the urgency while performing his or her original work.

(Second Embodiment)
FIG. 11 is a diagram illustrating a configuration of the security management system 2 according to the second embodiment of this invention. The security management system 2 of the second embodiment has the same basic configuration as that of the security management system 1 of the first embodiment, but is a verification NG that stores a user ID whose face image verification is NG. It has a user file 36.

  FIG. 12 is a diagram illustrating an example of data stored in the verification NG user file 36. The verification NG user file 36 stores “NG user ID” and data of “detection time”. The NG user ID stored in the verification NG user file 36 is stored without being erased until the next face image verification is performed and the verification is OK or approval is obtained from another person in the security room.

  In the present embodiment, the work terminal 70 prompts the security management apparatus 10 to input a user ID at the time of login, and transmits the input user ID to the security management apparatus 10. The security management device 10 determines whether or not the user ID transmitted from the work terminal 70 is registered in the verification NG user file 36 and transmits the determination result to the work terminal 70. When the input user ID is registered in the verification NG user file 36, the work terminal 70 refuses to log in to the work terminal 70.

  The security management system 2 according to the second embodiment can further enhance security by restricting login to the work terminal 70 of a user whose face image collation is NG.

  Also, the security management system 2 of the second embodiment can improve the security by the face image matching while compensating for the accuracy of the face image matching, like the security management system 1 of the first embodiment. Have

  The security management system 1 and the security management apparatus 10 of the present invention have been described in detail with reference to the embodiment. However, the present invention is not limited to the above embodiment.

  In the above-described embodiment, whether or not a face image has been detected is determined by detecting the face at a predetermined interval between the time when a person is detected (from the screen IN time) and the time when it is no longer detected (until the screen OUT time). It is assumed that the detection of the face image is OK when the image is detected and the face image can be detected even once. However, the algorithm for determining whether or not the detection of the face image is OK is not limited to the example of the embodiment described above. For example, when a predetermined number of consecutive face images can be detected, it may be determined that face image detection is OK.

  ADVANTAGE OF THE INVENTION According to this invention, it has the outstanding effect that the authentication by the person in a security area can compensate the difficulty of collation of a face image, and can perform entrance management with security ensured, and entrance to a security area It is useful as a security management device for managing

The figure which shows the structure of the security management system of 1st Embodiment The figure which shows the example of the data memorize | stored in the face image memory | storage part The figure which shows the example of the data memorize | stored in registration face image DB The figure which shows the example of the data memorize | stored in the coping terminal memory | storage part The figure which shows the example of a screen display of a work terminal when the signal of the 1st alert level is transmitted The figure which shows the example of a screen display of a work terminal when the signal of a 2nd alert level is transmitted. Diagram showing the operation of the security management system The figure explaining the determination of OK / NG of face image detection Diagram showing the operation of the security management system Diagram showing the operation of the security management system The figure which shows the structure of the security management system of 2nd Embodiment. The figure which shows the example of the data memorize | stored in the collation NG user file

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Security management system 2 of 1st Embodiment Security management system 10 of 2nd Embodiment Security management apparatus 12 Image | video receiving part 14 Image storage part 16 Person image detection part 18 Face image detection part 20 Face image storage part 22 Time unit 24 Image counting unit 26 Face image verification unit 28 Registered face image database 30 Electric lock control unit 32 Warning signal notification unit 34 Countermeasure terminal storage unit 36 Verification NG user file 40 ID card processing device 42 ID reading unit 44 ID verification unit 46 Registrant ID file 50 Imaging device 60 Electric lock 70 Work terminal

Claims (13)

A registered face image database in which face images of users allowed to enter the security area are registered;
A video receiver that receives video from a photographic device that captures the situation near the entrance of the security area;
A human image detection unit for detecting a human image from the video received by the video reception unit;
A face image detection unit that detects a face image of the person from the images in which the person image is detected when the person image is detected by the person image detection unit;
A face image collation unit that collates whether the face image detected by the face image detection unit is registered in the registered face image database;
When the face image detection unit cannot detect a face image, the first warning level is instructed to display a person image captured by the image capturing device on a device arranged in the security area. A signal is notified, and when the face image is not collated by the face image collation unit, the device arranged in the security area is instructed to display the face image photographed by the photographing apparatus. A warning signal notification unit for notifying a signal of a warning level of 2,
A security management device comprising:   The security management apparatus according to claim 1, wherein the warning signal notification unit does not notify a signal when a face image is verified by the face image verification unit.   The face image matching unit receives user identification information transmitted from a user identification information reader provided at the entrance of a security area, and reads a face image corresponding to the received user identification information from the registered face image database. 2. The security management apparatus according to claim 1, wherein the read face image is collated with the face image detected by the face image detection unit.   The security management apparatus according to claim 1, wherein the face image collating unit collates a plurality of face images detected for the same person with face images stored in the registered face image database.   The warning signal notification unit can further receive a response to the notified first warning level signal or second warning level signal from the device, and the first warning signal notified by the warning signal notification unit. When a response to a level signal or a second alert level signal is received from any of the devices, a response device storage unit is provided that stores information indicating the device that transmitted the response. Item 4. The security management device according to Item 1.   When the warning signal notification unit receives the response, the warning signal notification unit transmits a person image or a face image to all the devices that are the transmission destinations of the first warning level signal or the second warning level signal. 6. The security management apparatus according to claim 5, wherein a warning cancellation signal for stopping display is transmitted.   The security management apparatus according to claim 1, wherein the signal of the first alert level is a signal that instructs to blink and display at least a part of a screen that displays the person image.   The security management device according to claim 1, wherein the first warning level signal is a signal for instructing to output a sound when displaying a screen for displaying the person image.   The security management apparatus according to claim 1, wherein the first warning level signal is a signal instructing to display a moving image of the person. A photographing device for photographing the state near the entrance of the security area;
A security management device that manages entry into the security area based on the video imaged by the imaging device;
With
The security management device includes:
A registered face image database in which face images of users permitted to enter the security area are registered;
A video receiver for receiving video transmitted from the imaging device;
A human image detection unit for detecting a human image from the video received by the video reception unit;
A face image detection unit that detects a face image of the person from the images in which the person image is detected when the person image is detected by the person image detection unit;
A face image collation unit that collates whether the face image detected by the face image detection unit is registered in the registered face image database;
When the face image detection unit fails to detect a face image, the first warning level that instructs to display the person image captured by the image capturing device on a device arranged in the security area is displayed. A signal is sent, and when the face image is not collated by the face image collation unit, an instruction is given to display the face image photographed by the photographing apparatus on a device arranged in the security area. A warning signal notification unit for notifying a signal of a warning level of 2,
A security management system characterized by comprising: A video receiving step for receiving video from a photographing device for photographing a state near the entrance of the security area;
A person image detecting step of detecting a person image from the video received in the video receiving step;
A face image detecting step for detecting a face image of the person from the images in which the person image is detected when a person image is detected in the person image detecting step;
A face image collating step for collating whether the face image detected in the face image detecting step is included in a registered face image database in which a face image of a user permitted to enter the security area is registered;
If the face image cannot be detected in the face image detection step, the first warning level is instructed to display the person image photographed by the photographing device on the device arranged in the security area. A signal is notified, and when the face image is not verified in the face image matching step, the device arranged in the security area is instructed to display the face image taken by the photographing device. A warning signal notifying step for notifying a signal of a warning level of 2;
A security management method characterized by comprising: A program for managing the entrance to the security area based on the video transmitted from the photographing device for photographing the state near the entrance of the security area,
On the computer,
A video receiving step of receiving video from the imaging device;
A person image detecting step of detecting a person image from the video received in the video receiving step;
A face image detecting step for detecting a face image of the person from the images in which the person image is detected when a person image is detected in the person image detecting step;
A face image collating step for collating whether the face image detected in the face image detecting step is included in a registered face image database in which a face image of a user permitted to enter the security area is registered;
If the face image cannot be detected in the face image detection step, the first warning level is instructed to display the person image photographed by the photographing device on the device arranged in the security area. A signal is notified, and when the face image is not verified in the face image matching step, the device arranged in the security area is instructed to display the face image taken by the photographing device. A warning signal notifying step for notifying a signal of a warning level of 2;
A program characterized by having executed. A computer-readable storage medium storing the program according to claim 12.

Images