KR102011226B1 - Security management system by face recognition and method - Google Patents

Abstract

The present invention relates to a security management system using face recognition, which is provided to manage security in a passenger terminal of an airport, a harbor, and an express bus terminal; and to a method thereof. According to the present invention, the security management system includes a plurality of CCTV cameras which detect an object from an image, by being installed at different places in and around the passenger terminal to acquire the image around an installation place. The security management system includes a security management server interconnected to the CCTV cameras and manager terminals through a communication network. The security management server registers object information including a facial image of the object; recognizes the face of the object from an image which includes the object and is received from the CCTV cameras through the communication network, when the CCTV camera detects the object; and compares the recognized face with a face of previously registered object information to determine whether an event has occurred. When an event occurs, the security management server transmits notification information with respect to the event to the manager terminal of the passenger terminal. Accordingly, in the case of a person, who should be observed or monitored, among visitors detected in the passenger terminal, a moving line of the corresponding person is checked and monitored inside and outside the passenger terminal, and an accident caused by the visitors can be prevented.

Description

Security management system using face recognition and its method {SECURITY MANAGEMENT SYSTEM BY FACE RECOGNITION AND METHOD}

The present invention relates to a security management system, and more specifically, by using a face recognition technology to obtain the image of the passengers in the passenger terminal, such as airport, port and express bus, extract the face image from the obtained image, By comparing the face image with the registered face image, if the person who needs to observe and monitor is notified in real time to the security manager who resides in the passenger terminal, the passenger's movement and movement path can be observed. It relates to a security management system and a method using a face recognition function to manage the security of.

In general, the security management system using video has built CCTV cameras in vulnerable places, banks, department stores, airports, harbors, etc. By transmitting, displaying and recording the site image in real time to the remote control center connected with the network, the administrator can monitor and collect various information such as safety check and various information to prevent accidents, dangerous situations and crimes in advance. Allow for action to be taken. Such a security management system can identify abnormalities of many surveillance sites with a small number of personnel, and can provide essential data for future criminal investigations, finding missing persons or lost children.

In particular, airports, harbor passenger terminals, express bus passenger terminals, etc., which are visited by many passengers, are located in the suburbs of the vulnerable city center, so it is absolutely necessary to establish a security management system. Recently, with the influx of foreign workers, foreigners working in nearby industrial complexes or farmhouses are increasing, and incidents and accidents are frequently caused by them. Therefore, there is an urgent need to secure the safety of citizens by identifying the immigration routes that need to be monitored not only in the passenger terminal but also in the surrounding areas of the passenger terminal.

However, in the existing passenger terminal security management system, security officers have to monitor the CCTV camera images in person at the control center, and when there are a large number of persons who are detected, whether they are domestic or foreign criminals or domestic or foreign persons, etc. There was a problem that it was difficult to take action by accurately identifying the personnel in real time.

Domestic Patent Publication No. 10-1297295 (August 14, 2013) Korean Laid-Open Patent Publication No. 10-2014-0004084 (published January 10, 2014) Domestic Patent Publication No. 10-0967718 (Notice 07 July 2010) Korean Laid-Open Patent Publication No. 10-2015-0025470 (published March 10, 2015)

SUMMARY OF THE INVENTION An object of the present invention is to provide a security management system and method using the face recognition of passers-by for security management of a passenger terminal.

Another object of the present invention is to provide a security management system and method for prompt action, confirmation and monitoring by informing the security manager in the field of the passenger terminal when the event occurs using the face recognition, whether the event occurred. will be.

Still another object of the present invention is to acquire images of foreign workers using the passenger terminal by using face recognition, and in connection with the movement of foreign workers working in industrial complexes or farmhouses located in the passenger terminal and its surrounding area. It is to provide a security management system and method for promoting the safety of citizens by grasping it.

In order to achieve the above objects, the security management system of the present invention obtains an image using a plurality of CCTV cameras installed inside and outside the passenger terminal for security management of the passenger terminal of the present invention, the face of the object from the obtained image The present invention has a feature of determining whether an event occurs by recognizing and comparing it with a face of a pre-registered object. As such, when the event occurs, the security management system of the present invention transmits the notification information to the manager terminal to monitor the movement of the object.

Security management system for a passenger terminal of the present invention according to this feature, having identification information, installed in different places inside and outside the passenger terminal to obtain an image for each installation place, and to detect the object in the acquired image A plurality of CCTV cameras; At least one manager terminal provided by a security officer of the passenger terminal and located inside and outside the passenger terminal; And pre-register object information including face images of objects using a passenger terminal, and when an object is detected from any one of the CCTV cameras, transmit a still cut image including the object from the one CCTV camera through a communication network. Receiving a face image of the object from the still cut image, extracting a face image, comparing the extracted face image with a face image included in the object information, and determining whether an event is generated. It transmits the notification information according to the occurrence of the event to the terminal, and includes a security management server to monitor the copper wire of the object generating the event in cooperation with the CCTV cameras.

In one embodiment of this aspect, the CCTV camera; Acquiring a high resolution image of an installation place and converting the low resolution image from the high resolution image to the security management server, and if an object is detected in the high resolution image, the still cut extracted from the high resolution image and the high resolution image. The image is transmitted to the security management server.

In another embodiment, the security management server; The location of the CCTV camera that has transmitted the still cut image is determined using the identification information, and the notification information is transmitted to the manager terminal at a location adjacent to the CCTV camera whose location is determined.

In another embodiment, the security management server; Registering the object information including personal information and face image of each of the objects, receiving the images obtained from each of the CCTV cameras through a communication network, the image containing the object detected from the CCTV camera and the still Receives a cut image to recognize the face of the object to extract a face image, and compares the extracted face image with the face image of the object information to determine whether an event occurs, according to whether or not the event occurs, the manager terminal A face recognition server for processing to provide notification information; An image recording apparatus for receiving and recording an image transmitted from each of the CCTV cameras by the face recognition server; An image storage device storing at least video data recorded by the image recording device, a face image of an object extracted by the face recognition server, and a face image included in the object information; And an image display device for outputting the image transmitted from each of the CCTV cameras, the face image of the extracted object, and the object information to be monitored.

In another embodiment, the security management server; The metadata is generated and stored by receiving the object information, the video data, and the attribute information of the face image from the face recognition server, and receiving search information about a specific object from the manager terminal through a communication network. A search server for searching for and extracting the object information of the specific object and an image from the image storage device and transmitting the extracted object information and the image to the manager terminal to confirm or monitor the identity of the specific object; It includes more.

As described above, the security management system for the passenger terminal of the present invention obtains the images of the passengers using the passenger terminal, and recognizes and extracts the face from the acquired image to determine whether the event occurs, the security officer Can monitor the movement of the object according to the event occurrence in real time.

In addition, the security management system for a passenger terminal of the present invention recognizes the face of an object in the passenger terminal and applies it to security management, whereby a specific person needs to observe and monitor, for example, criminals, criminals, suspects, wanted persons And when an unregistered foreign person is detected, real-time information of the person to the security officer to manage the security of the passenger terminal, it is possible to identify the movement of the person to promote the safety of citizens.

In addition, the security management system for the passenger terminal of the present invention works not only in the passenger terminal frequented by passengers, but also in areas around the passenger terminal, for example, in areas where security is vulnerable, or in foreign farms and farms working in a number of industrial complexes nearby. Security management based on facial recognition technology can be provided to foreign workers, so that many foreigners can relieve anxiety.

In addition, the security management system for the passenger terminal of the present invention can recognize the information of the passenger terminal and the objects (people or vehicles) moving around by connecting the face recognition technology and CCTV camera in real time, and can predict the expected moving line. .

1 is a block diagram showing a network configuration of a security management system for a passenger terminal according to the present invention;
2 is a block diagram showing the configuration of the CCTV camera shown in FIG.
3 is a block diagram showing the configuration of the security management server shown in FIG.
4 is a block diagram showing the configuration of a face recognition server shown in FIG. 3;
5 is a block diagram showing the configuration of the search server shown in FIG.
6 is a flowchart showing the processing procedure of the security management system according to the present invention.

The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be interpreted as being limited by the embodiments described below. This embodiment is provided to more completely explain the present invention to those skilled in the art. Therefore, the shape of the components in the drawings, etc. have been exaggerated to emphasize a more clear description.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1 to 6.

1 is a block diagram showing a network configuration of a security management system for a passenger terminal according to the invention, Figure 2 is a block diagram showing the configuration of the CCTV camera shown in Figure 1, Figure 3 is shown in Figure 1 4 is a block diagram showing the configuration of the security management server, FIG. 4 is a block diagram showing the configuration of the face recognition server shown in FIG. 3, and FIG. 5 is a block diagram showing the configuration of the search server shown in FIG.

1 to 5, the security management system 2 of the present invention is a passenger terminal inside the passenger terminal for security management, such as a passenger terminal, such as an airport, a harbor, or a highway bus passenger terminal frequent entry and exit of many users For example, a person who needs to observe and monitor an image of an occupant in real time by using a plurality of first CCTV cameras 200 installed in the system and recognize a face of each person in the acquired image, for example If criminals, criminals, suspects, wanted persons and unregistered foreigners are detected, real-time information of the person is provided to the security officer to manage the security of the passenger terminal.

In addition, the security management system 2 of the present invention is connected to the plurality of first CCTV cameras 200 installed in the passenger terminal, and the plurality of second CCTV cameras 200a installed in the area around the passenger terminal. If a person who needs to observe and monitor among the passengers detected inside the passenger terminal is required to acquire the image by using it, then the movement of the person is identified and monitored in the area around the passenger terminal, whereby In order to prevent accidents, the security of areas around passenger terminals should be managed.

To this end, the security management system 2 of the present invention includes a communication network 4, a plurality of first and second CCTV cameras 200 and 200a, a plurality of manager terminals 300 and a security management server 100. do. In the security management system 2, at least one administrator terminal 300 and the security management server 100 interoperate with each other through a communication network 4 using a security-only web application and / or app application.

Specifically, the communication network 4 is provided with, for example, a wired / wireless communication network, a mobile communication network, a dedicated network, or the like, and may be provided as each of these single communication networks or a mixed composite communication network. The communication network 4 connects the first and second CCTV cameras 200 and 200a to the security management server 100, the manager terminal 300, and the security management server 100 to enable data communication. For example, the first and second CCTV cameras 200 and 200a and the security management servers 100 are connected through a dedicated network, for example, a wired communication network, a dedicated intra communication network, and the security management with the manager terminal 300. The servers 100 are connected through a wireless communication network or a mobile communication network.

The first and second CCTV cameras 200 and 200a are intelligent surveillance cameras, for example, fixed cameras and rotating cameras. The first CCTV cameras 200 are installed at different locations inside the passenger terminal so that a plurality of cameras can photograph a predetermined area of the installation place. The first CCTV camera 200 is installed at various places inside the passenger terminal including at least a departure hall and an arrival hall of an airport or a harbor, for example. In addition, a plurality of second CCTV cameras (200a) are respectively installed in different locations in the area around the passenger terminal to photograph a certain area of the installation site.

The first and second CCTV cameras 200 and 200a are provided with identification information (for example, ID, IP, etc.) that the security management server 100 can identify, thereby allowing each installation location or location inside and outside the passenger terminal. Is determined.

The first and second CCTV cameras 200 and 200a photograph each of the installation places to obtain a high resolution image. The first and second CCTV cameras 200 and 200a are provided with, for example, 4K high-definition CCTV cameras, and images obtained from low-resolution CCTV cameras applied to existing security, surveillance, or security systems (for example, about 2M). Acquire an image of higher resolution (e.g., an image of 12 M pixels) than the image of a pixel.

The first and second CCTV cameras 200 and 200a generate and store low resolution images having different resolutions by compressing a high resolution image obtained by using an encoder, a compression codec, etc. provided therein at different compression rates. In this embodiment, the low resolution image is provided as an image of 2 M pixels, for example, based on the H.264 compression codec, and the high resolution image is provided as an image of 12 M pixels, for example. The first and second CCTV cameras 200 and 200a may provide images of different resolutions to the user according to the use of the user.

Therefore, the first and second CCTV cameras 200 and 200a normally provide a low resolution image to the security management server 100 through the communication network 4, and an object, for example, needs to be observed and monitored in the acquired image. When an access person is detected, a high resolution image is provided to the security management server 100. The first and second cameras 200 and 200a normally transmit a low resolution image to the security management server 100, and upon detection of an object, transmit a high resolution image in response to a request of the security management server 100.

In this embodiment, as shown in FIG. 2, the first and second CCTV cameras 200 and 200a may include a communication unit 210, a controller 220, a camera module 230, an object detector 240, and a storage unit ( 250).

The communication unit 210 is provided with, for example, a wired or wireless communication module, and processes data communication with the security management server 100 through the communication network 4. In other words, the communication unit 210 stores an image of the installation place acquired by the security management server 100 through the communication network 4, a still cut image including an object, and its identification information from the obtained image. send.

The camera module 230 is provided with, for example, a high resolution image sensor module to obtain a high resolution image of an installation place in real time.

The object detector 240 detects the presence of an object, that is, an accessor, in the image obtained from the camera module 230. The object detector 240 extracts an image that includes the detected object, that is, a still cut image.

The storage unit 250 may include identification information of the first or second CCTV camera 200 or 200a, a high resolution image obtained from the camera module 230, a still cut image extracted from the object detector 240, and a controller 220. Save the low resolution image compressed by).

The controller 220 controls to process various operations of the first or second CCTV camera 200 or 200a. That is, the controller 220 controls each of the communication unit 210, the camera module 230, the object detector 240, and the storage unit 250 to interwork a corresponding function. The controller 220 includes an encoder, a compression codec, and the like, through which the high resolution image obtained from the camera module 230 is compressed at different compression ratios to generate a low resolution image having different resolutions according to a purpose. Control to store at 250. In addition, the controller 220 controls to transmit the high resolution image or the low resolution image to the security management server 100 through the communication network 4.

The manager terminal 300 is provided with, for example, a smartphone, a personal computer, and the like, and a security officer in a passenger terminal and a corresponding jurisdiction, for example, a security manager, a security officer, a police officer, a security guard, and the like. The manager terminal 300 is connected to the security management server 100 through the communication network (4). In addition, the manager terminal 300 may be provided as a portable terminal dedicated to security management, for example, a personal information terminal.

The manager terminal 300 receives the notification information according to the occurrence of the event from the security management server 100 so that the security officer checks the event occurrence history included in the notification information, for example, personal information such as a face image of a specific person, Through this, the movement and movement path of the person are provided to observe with caution in real time. The notification information may include personal information such as the name, gender, nationality, age, and face image of the person who generated the event, the reason for observation, the purpose of immigration, the current location inside and outside the passenger terminal, and features such as clothes. . Therefore, the security officer inquires the information of the person through the notification information transmitted to the manager terminal 300, and checks the identity by identifying the face image of the person or monitors the movement of the person, the movement path, etc. Quickly identify and observe and monitor the person.

In addition, the manager terminal 300 accesses the security management server 100 through the communication network 4, searches for a specific person, and if the person is already registered, the identity of the person, for example, personal information, a face image, and the like, can be queried. Can be. For example, if a security officer is found in advance at the departure hall or the arrival hall of the airport passenger terminal, or if a person who needs confirmation is found and needs to check the personal information of the person, the administrator terminal 300 is used in the field. By connecting to the security management server 100 can query and confirm the person.

The security management server 100 monitors and processes security management of the passenger terminal by interlocking the first and second CCTV cameras 200 and 200a with the manager terminal 300. That is, the security management server 100 recognizes the face of the object in each image obtained from the first and second CCTV cameras 200 and 200a to determine whether an event occurs. Processes to identify the moving line of the person by linking the image and the position of the second CCTV camera (200, 200a).

To this end, the security management server 100 extracts the detected object image when an object is detected from the images obtained from the first and second CCTV cameras 200 and 200a, and extracts a face image from the extracted object image. Recognize. The security management server 100 compares the face image of the recognized object with the face images of the registered object information and determines whether the object is a specific person that needs to be observed. That is, the security management server 100 compares the recognized object, that is, the person with the registered face image, for example, when the criminal, the offender, the suspect, the wanted person is determined that the person is registered but needs to be observed. An event is generated depending on the case of a foreigner. When the event occurs, the security management server 100 transmits the notification information to the manager terminal 300 to confirm the identity of the person or to monitor the movement of the person.

In detail, the security management server 100 registers, stores, and manages information about objects that need to be observed, that is, object information. The security management server 100 receives an image obtained from each of the plurality of first and second CCTV cameras 200 and 200a to extract and recognize an object image, and extracts and recognizes a face image from the recognized object image. Then, it is compared with the registered object information to determine whether an event occurs. At this time, the security management server 100 determines the location (or location) of the recognized object through the identification information of each of the first and second CCTV cameras 200 and 200a. The security management server 100 transmits notification information to at least one manager terminal 300 when an event occurs. For example, the notification information may be transmitted to at least one manager terminal 300 adjacent to a recognized location of the object, or the notification information may be transmitted to all manager terminals 300 of the passenger terminal site. In addition, the security management server 100 processes the image obtained from the plurality of CCTV cameras (200, 200a) installed in the passenger terminal inside and outside the security manager to identify and monitor the movement of the person.

As shown in FIG. 3, the security management server 100 of this embodiment includes a face recognition server 120, a search server 130, an image recording device 140, an image storage device 150, and an image display device 160. ). In this embodiment, the face recognition server 120 and the search server 130 are independently separated, but may be provided as one server 110 in which the face recognition server 120 and the search server 130 are integrated.

The face recognition server 120 registers and stores object information including personal information and a face image of each object in advance. Such object information may be obtained from, for example, a police agency, a related government office, or the like to input and register object information, or through a communication network 4, an offender or criminal who is disclosed in connection with an online system (not shown) such as a police office or a related government office. Object information such as suspects and wanted persons can be received in real time. In addition, the face recognition server 120 may register by receiving object information on a foreigner to be observed through an interpol or the like.

The face recognition server 120 receives a low resolution image or a high resolution image obtained from each of the first and second CCTV cameras 200 and 200a through the communication network 4. That is, the face recognition server 120 receives a low resolution image in real time from each of the first and second CCTV cameras 200 and 200a in real time, and when an object is detected from the low resolution image, the first and second CCTV cameras ( 200, 200a) to request and receive a high resolution image. Therefore, the network load between the first and second CCTV cameras 200 and 200a and the face recognition servers 120 may be reduced.

The face recognition server 120 receives a high resolution image including the detected object from each of the first and second CCTV cameras 200 and 200a to recognize a face of the object and extracts a face image. The face recognition server 120 stores the extracted face image, that is, the face still cut image, and compares the face image with the previously stored face images. The face recognition server 120 compares the two matched face images to determine whether an event occurs, and provides notification information to the manager terminal 300 according to whether an event occurs.

The face recognition server 120 transfers the image transmitted from each of the first and second CCTV cameras 200 and 200a to the image recording device 140 to record the image in real time, thereby moving the video data to the image storage device 150. Save it. The face recognition server 120 stores the extracted face image of the object, video data of an event generated section, and the like in the image storage device 150. The face recognition server 120 outputs the image transmitted from each of the first and second CCTV cameras 200 and 200a and the face image to the image display device 160 to monitor and display the face image in real time. In addition, the face recognition server 120 provides the administrator terminal 300 with the search server 130 to search and monitor desired object information. To this end, the face recognition server 120 provides attribute information and object information about the video data and the face image to the search server 130.

As shown in FIG. 4, the face recognition server 120 according to this embodiment includes a communication unit 121, a control unit 122, an object information registration unit 123, an object extraction unit 124, a face recognition unit 125, and an event. The determination unit 126, a notification processor 127, and a storage unit 128 are included.

Specifically, the communication unit 121 is connected to the communication network 4 including, for example, a wired / wireless communication module, a mobile communication module, an interface module, and the like, and thereby, in real time from each of the first and second CCTV cameras 200 and 200a. Receive low resolution video. When the object detecting unit 240 detects the object in the image, the communication unit 121 receives a high resolution image from each of the first and second CCTV cameras 200 and 200a in which the object is detected. The communicator 121 is connected to the search server 130 and transmits property information and object information about the image and the face image to the search server 130. The communication unit 121 transmits the notification information to the manager terminal 300 when an event occurs.

The object information registration unit 123 stores and registers object information including personal information and a face image of each of objects such as a public criminal, criminal, suspect, wanted, and unregistered foreigner, and stores them in the storage unit 128. do. The object information may include, for example, a person's name, age, gender, nationality, face image, access purpose, and the like. The object information registration unit 123 may receive object information from an online system such as an external police station or an associated public office through the communication network 4 and register the object information in the storage unit 128.

The object extracting unit 124 recognizes an object in the high resolution image transmitted from each of the first and second CCTV cameras 200 and 200a and extracts an object image including the recognized object.

The face recognition unit 125 recognizes the face of the object from the object image extracted by the object extractor 124 and extracts a face image. The face recognition unit 125 generates the extracted face image and attribute information on the face image and stores the extracted face image in the image storage device 150 and the storage unit 128. The face recognition unit 125 processes the attribute information of the face image to the search server 130.

The event determination unit 126 compares the face image extracted by the face recognition unit 125 with the face image of each of the object information pre-registered in the storage unit 128 to determine whether an event is generated. The event determining unit 126 notifies the notification processing unit 127 of whether or not an event occurs according to the determination result.

When the notification processor 127 notifies that the event has occurred from the event determination unit 126, the notification processor 127 transmits notification information according to the event occurrence to the at least one manager terminal 300.

The storage unit 128 stores at least object information, pre-registered face images, and attribute information about the extracted face images and face images in real time.

In addition, the controller 122 controls to process various operations of the face recognition server 120. That is, the controller 122 may include a communication unit 121, an object information registration unit 123, an object extracting unit 124, a face recognition unit 125, an event determination unit 126, a notification processing unit 127, and a storage unit 128. ) To recognize and extract the face of the object based on the above-described face recognition technology, determine whether an event occurs by comparing with the face of the registered object information, and notify the manager terminal 300 when the event occurs. Control to send information.

Referring back to FIG. 3, the video recording device 140 may include, for example, a digital video recorder (DVR), a network video recorder (NVR), and the like. It is connected to each of the second CCTV cameras (200, 200a). The image recording device 140 receives and records the images acquired from each of the first and second CCTV cameras 200 and 200a from the face recognition server 120 to generate video data, and generates the video data. Save it to

The image storage device 150 includes at least a face image registered from the face recognition server 130, a low resolution and high resolution image transmitted from each of the first and second CCTV cameras 200 and 200a, and an event according to an event occurrence in the image. Save the cut image.

The video display device 160 is provided with a video display device such as a monitor, a multi vision, a multi screen, and the like, and outputs an image received from the face recognition server 120 in real time. The image display device 160 may display a face image extracted from the face recognition server 120 and a pre-registered face image. In addition, when a desired object is searched by the manager terminal 300, the video display device 160 may display the searched object information under the control of the face recognition server 120.

The search server 130 searches and extracts an image to monitor an image and a face image stored in the image storage device 150 according to search information such as a real time or a desired time and a search condition. To this end, the search server 130 receives the attribute information of the image and the face image from the face recognition server 120, through this generates metadata for each image and face image, and the generated metadata to the image and face image Match, store, register and manage each. Here, the properties of the image and face image include the time and location (location) of obtaining the image and face image, unique identification information (ID or IP) of the CCTV cameras 200 and 200a, file name, resolution, size, reading and modification, etc. Permissions, tags, presence of objects, location of objects (screen coordinates). The metadata may include information about the position of the CCTV cameras 200 and 200a, the position of the object, the direction of movement and the movement path of the object, a time stamp, an image acquisition time for the object, and an object position in the image ( Coordinates), and information about an image section including the object.

The search server 130 receives the search information of the contents included in the metadata from the manager terminal 300, searches for and extracts an image from the image storage device 150, and transmits the extracted image to the manager terminal 300. Provides for identifying or monitoring the identity of an object. For example, the security officer authenticates and accesses the search server 130 through the manager terminal 300, checks the identity of a specific person at the passenger terminal site, or a recognized person is found at the passenger terminal site. When the search information is input to search the object information of the person, the search server 130 searches for, extracts the object information of the person, and transmits it to the administrator terminal 300 so that the security officer can identify the person's identity, personal information, and face image. It can be provided to monitor.

In this embodiment, as shown in FIG. 5, the search server 130 may include the communication unit 131, the control unit 132, the metadata generation unit 133, the metadata storage unit 134, and the object search processing unit 135. It includes.

Specifically, the communication unit 131 is connected to the face recognition server 120 through the internal network, and is connected to the manager terminal 300 through the communication network (4). The communication unit 131 receives a face image and attribute information on the face image from the face recognition server 120. The communication unit 131 receives the search information from the manager terminal 300 and transmits object information corresponding to the search information, that is, personal information and face image of the object, to the manager terminal 300.

The metadata generator 133 receives the attribute information about the image and the face image transmitted from the face recognition server 120 and generates metadata about each image and the face image. Here, the metadata includes information about the position of the CCTV cameras 200 and 200a, the position of the object, the moving direction and the movement path of the object, the event occurrence time, the event content, the image acquisition time for the object, and the object position in the image (coordinates). ), Information about an image section including the object may be included.

The metadata storage unit 134 matches and stores the metadata generated by the metadata generator 133 with each of the image and the face image.

The object search processor 135 searches for and extracts object information corresponding to the search information input from the manager terminal 300, and searches for an image and a face image stored in the image storage device 150 by matching the extracted object information. And extract. The object retrieval processing unit 135 provides the communication unit 131 to transmit the object information, the extracted image, and the face image to the manager terminal 170.

The controller 132 controls to process various operations of the search server 130. That is, the controller 122 controls the communication unit 131, the metadata generation unit 133, the metadata storage unit 134, and the object search processing unit 135 to correspond to the search information input from the manager terminal 300. The search result, that is, the object information, the image, the face image data, and the like are provided to the manager terminal 300.

As described above, the security management system 2 of the present invention obtains an image of the installation place inside and outside the passenger terminal by using a plurality of CCTV cameras (200, 200a), and when the object is detected from the acquired image, It extracts and recognizes the face image of the registered object and compares it with the registered face image. If the object is a person who needs to observe and monitor, it generates an event and provides the security officer with notification information according to the event occurrence. Handle to manage

6 is a flowchart showing a processing procedure of the security management system according to the present invention. This procedure is processed by the configuration of the security management system shown in FIG.

Referring to FIG. 6, the security management system 2 according to an embodiment of the present invention includes object information that requires observation and monitoring in the security management server 100 in step S400, for example, object information such as an open criminal, a criminal, a suspect, a wanted person, and the like. And register and manage object information on foreigners to be observed. The object information includes at least personal information such as the name, age, gender, and nationality of the object, and a face image of the object.

In operation S410, each of the plurality of first and second CCTV cameras 200 and 200a respectively installed at different locations in the inner and outer peripheral areas of the passenger terminal acquires an image of the installation location, and is obtained in step S420. Determines whether an object is detected in the image. In this case, each of the first and second CCTV cameras 200 and 200a acquires a high resolution image and detects the presence or absence of an object by the object detecting unit 240 provided therein.

When an object is detected by any one of the first and second CCTV cameras 200 and 200a in operation S430, an object image including the object is extracted from the high resolution image, that is, a high-resolution still cut image, along with its identification information. Send to the security management server (100). However, the CCTV camera 200 converts a high resolution image into a low resolution image and transmits it to the security management server 100 when the object is not detected. Accordingly, the security management server 100 determines the location of the corresponding CCTV cameras 200 and 200a, that is, an installation place, through identification information of each of the first and second CCTV cameras 200 and 200a.

In operation S440, the security management server 100 extracts a face image by recognizing a face of an object from a high-resolution still cut image transmitted from one of the first and second CCTV cameras 200 and 200a. In operation S450, the security management server 100 matches and compares the extracted face image with face images of pre-registered object information.

In operation S460, the security management server 100 determines whether an event occurs according to a result of comparing the two face images. In this case, the event corresponds to, for example, a case where the extracted object is a person registered or a person who needs to observe and monitor, such as a foreigner.

As a result of the determination, when the event occurs in step S470, the security management server 100 transmits the notification information according to the occurrence of the event to the manager terminal 300 in the passenger terminal site, so that the security officer to observe and monitor the person, At the same time, monitor the moving line of the object, such as in the passenger terminal control center. At this time, the security management server 100 transmits the notification information to the manager terminal 300 of the location adjacent to the installation place of the CCTV camera 200, 200a, which acquired the image of the event generated object, or to the passenger terminal site Notification information may be transmitted to all manager terminals 300. In addition, the security management server 100 stores the high resolution image and the face image and the object information for the image and the face image according to the event occurrence in the image storage device 150 to be used as evidence later. However, if it is determined that the event has not occurred, the security management server 100 proceeds to step S410 and repeats the above-described processes (S410 to S460).

In the above, the configuration and operation of the security management system using the face recognition according to the present invention has been shown in accordance with the detailed description and drawings, but this is merely described by way of example, and various within the scope without departing from the technical spirit of the present invention. Changes and changes are possible.

2: security management system
4: communication network
100: security management server
110: server
120: face recognition server
130: search server
140: video recording device
150: video storage device
160: video display device
200, 200a: CCTV Camera
300: administrator terminal

Claims (5)

In the security management system for passenger terminals:
A plurality of CCTV cameras having identification information, installed in different places inside and outside the passenger terminal, respectively obtaining images of the installation place, and detecting an object from the acquired images;
At least one manager terminal provided by a security officer of the passenger terminal and located inside and outside the passenger terminal; And
Register object information including face images of objects using a passenger terminal, and when an object is detected from any one of the CCTV cameras, a still cut image including the object is transmitted from the one CCTV camera through a communication network. And extracting a face image by recognizing a face of the object from the still cut image, comparing the extracted face image with a face image included in the object information, and determining whether an event occurs. When the event occurs, the manager terminal And a security management server to transmit notification information according to an event occurrence and to monitor the copper wire of the object generating the event in cooperation with the CCTV cameras;
The CCTV camera acquires a high resolution image of the installation place and usually converts the low resolution image from the high resolution image and transmits it to the security management server. When an object is detected in the high resolution image, the CCTV camera extracts the high resolution image and the high resolution image. Transmitting the still cut image to the security management server;
The security management server,
Registering the object information including personal information and face image of each of the objects, receiving the images obtained from each of the CCTV cameras through a communication network, the image containing the object detected from the CCTV camera and the still Receives a cut image to recognize the face of the object to extract a face image, and compares the extracted face image with the face image of the object information to determine whether an event occurs, according to whether or not the event occurs, the manager terminal A face recognition server for processing to provide notification information; And
The metadata is generated and stored by receiving the object information, the video data, and the attribute information of the face image from the face recognition server, and receiving search information about a specific object from the manager terminal through a communication network. And a search server for searching for and extracting the object information of the specific object and the image from the image storage device and transmitting the extracted object information and the image to the manager terminal to confirm or monitor the identity of the specific object. and,
The face recognition server,
When the low resolution image is transmitted in real time from each of the CCTV cameras through a communication network, and when the object is detected in the low resolution image, a high resolution image is transmitted from each of the CCTV cameras in which the object is detected, and the image and face image are transmitted to the search server. A first communication unit which transmits property information and object information about the controller and transmits notification information to the manager terminal when an event occurs;
An object information register configured to input and register object information including at least personal information and a face image of each object;
An object extracting unit that recognizes an object from a high resolution image transmitted from each of the CCTV cameras and extracts an object image including the recognized object;
A face recognition unit recognizing a face of an object from the object image extracted by the object extracting unit, extracting a face image, generating a extracted face image and attribute information on the face image, and providing the extracted face image to the search server;
An event discriminating unit which matches and compares the face image extracted by the face recognition unit with the face images of each of the registered object information to determine whether an event is generated;
A notification processor for transmitting notification information according to an event occurrence to the at least one manager terminal when informing that the event has occurred from the event determination unit;
A storage unit for storing at least object information, a pre-registered face image, and attribute information about a face image and a face image extracted in real time; And
The communication unit, the object information registration unit, the object extraction unit, the face recognition unit, the event determination unit, the notification processor, and the storage unit are controlled to process various operations of the face recognition server, based on a face recognition technology. And a first control unit for recognizing and extracting a face, determining whether an event occurs by comparing with a face of pre-registered object information, and transmitting notification information to the manager terminal when an event occurs.
The search server,
Connected to the face recognition server through an internal network, connected to the manager terminal through a communication network, receiving attribute information on a face image and a face image from the face recognition server, and receiving search information from the manager terminal. A second communication unit which transmits object information corresponding to the manager terminal;
A metadata generator which receives the attribute information of the image and the face image transmitted from the face recognition server and generates metadata about the image and the face image;
A metadata storage unit for storing the metadata generated by the metadata generator by matching the image and face images with each other;
Search and extract the object information corresponding to the search information input from the manager terminal, search and extract the image and face image matched with the extracted object information, and display the object information and the extracted image and face image. An object retrieval processing unit provided to the second communication unit to transmit to the second communication unit; And
The manager terminal controls the second communication unit, the metadata generating unit, the metadata storage unit, and the object search processing unit to process the overall operation of the search server so as to retrieve a search result corresponding to the search information input from the manager terminal. Security management system for a passenger terminal comprising a second control to control to provide.
delete The method according to claim 1,
The security management server;
Passenger terminal, characterized in that for determining the position of the CCTV camera that has transmitted the still cut image using the identification information, and transmits the notification information to the administrator terminal of the position adjacent to the CCTV camera is determined the position. Security management system.
The method according to claim 1 or 3,
The security management server;
An image recording apparatus for receiving and recording an image transmitted from each of the CCTV cameras by the face recognition server;
The image storage device storing at least video data recorded by the image recording device, a face image of an object extracted by the face recognition server, and a face image included in the object information; And
And a video display device for outputting the images transmitted from each of the CCTV cameras, the face image of the extracted object, and the object information to be monitored. delete

Images