JP7201748B2 - Information processing device, determination method, and program - Google Patents

Description

The present disclosure relates to an information processing device, determination method, and program.

2. Description of the Related Art Conventionally, there has been provided an entrance/exit management system capable of informing/transmitting authentication results of face authentication to each user who passes through a gate (see, for example, Patent Literature 1).

JP 2018-92293 A

By the way, there is a need for a surveillance camera system that uses a whitelist to determine whether a person has entered a zone. In such a surveillance camera system, when registered face image data is registered in a white list, for example, a hand-held camera is used to photograph a face, and the photographed face image data is read into a terminal device connected to the surveillance camera system. . Further, it takes time and effort to register the face image data in the whitelist of the surveillance camera system from the terminal device.

In addition, in a company or the like, for example, there are cases where persons who can enter are distinguished for each zone such as a floor or a room. For example, a person A may enter room X and room Y, and person B may enter room X but may not enter room Y. In this way, in a facility or the like that distinguishes who can enter each zone, it is important to manage whether or not a person other than the person specified for each zone has entered the zone.

Non-limiting examples of the present disclosure contribute to providing an information processing device, a determination method, and a program that facilitate registration of registered face image data in a whitelist.

A non-limiting embodiment of the present disclosure contributes to providing an information processing device, a determination method, and a program for determining whether a person other than the person determined for each zone has entered the zone.

The present disclosure includes a communication unit that receives face image data from a camera that captures each of a plurality of zones of a building, camera identification information of each of the plurality of cameras, and a first table that associates the plurality of zones with each other. and a second table linking the registered face image data and the zone in which the person is permitted to enter in the registered face image data, and referring to the second table based on the face image data, After obtaining the permission zone in which the person of the face image data is permitted to enter, referring to the first table based on the camera identification information, the photographing zone in which the person of the face image data was photographed is obtained. and a control unit that determines permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone.

Further, the present disclosure is a determination method performed by a computer, which receives facial image data from a camera that photographs each of a plurality of zones of a building, and based on the facial image data, registers registered facial image data, By referring to a second table in which a zone in which a person in the registered face image data is permitted to enter is linked, a permission zone in which a person in the face image data is permitted to enter is acquired, and the person in the face image data is acquired. based on the camera identification information of the camera that captured the face image data, referring to a first table linking the camera identification information of each of the plurality of cameras and the plurality of zones, and capturing the person of the face image data A determination method is provided for acquiring a photographing zone and determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone.

The present disclosure also provides a method for receiving face image data from a camera that captures each of a plurality of zones of a building in a computer, and based on the face image data, registered face image data, and A second table that associates the zone to which the person of the face image data is permitted to enter is obtained by referring to the second table, and the camera of the camera that photographed the person of the face image data Based on the identification information, referring to a first table linking the camera identification information of each of the plurality of cameras and the plurality of zones to obtain a shooting zone in which the person of the face image data was shot, A program is provided for executing a process of determining permission/non-permission of entry of a person in the face image data based on the permission zone and the photographing zone.

a communication unit for receiving face image data from a camera that captures each of a plurality of zones of a building; camera identification information for each of the plurality of cameras; first information linking the plurality of zones; a memory for storing image data and second information linking the zone in which a person is permitted to enter in the registered face image data; referring to the second information based on the face image data; After acquiring the permission zone in which the person of the face image data is allowed to enter, referring to the first information based on the camera identification information, acquires the photographing zone in which the person of the face image data was photographed. and a control unit that determines permission/non-permission of entry of the person in the face image data based on the permission zone and the photographing zone.

Further, the present disclosure is a determination method performed by a computer, which receives facial image data from a camera that photographs each of a plurality of zones of a building, and based on the facial image data, registers registered facial image data, By referring to the second information linked with the zone in which the person in the registered face image data is permitted to enter, the permission zone in which the person in the face image data is permitted to enter is acquired, and the person in the face image data is acquired. based on the camera identification information of the camera that captured the face image data, referring to the camera identification information of each of the plurality of cameras and the first information linking the plurality of zones with the person of the face image data A determination method is provided for acquiring a photographing zone and determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone.

The present disclosure also provides a method for receiving face image data from a camera that captures each of a plurality of zones of a building in a computer, and based on the face image data, registered face image data, and by referring to the second information linked with the zone into which the person of the face image data is permitted to enter, obtaining the permission zone into which the person of the face image data is permitted to enter, and the camera of the camera that photographed the person of the face image data obtaining a photographing zone in which the person of the face image data was photographed by referring to first information linking the camera identification information of each of the plurality of cameras and the plurality of zones based on the identification information; A program is provided for executing a process of determining permission/non-permission of entry of a person in the face image data based on the permission zone and the photographing zone.

In addition, these generic or specific aspects may be realized by systems, devices, methods, integrated circuits, computer programs, or recording media. may be realized by any combination of

According to an embodiment of the present disclosure, it is possible to facilitate registration of registration face image data to the whitelist.

According to an embodiment of the present disclosure, it can be determined whether a person other than the person specified for each zone has entered the zone.

Further advantages and advantages of an embodiment of the disclosure are apparent from the specification and drawings. Such advantages and/or advantages are provided by the several embodiments and features described in the specification and drawings, respectively, not necessarily all provided to obtain one or more of the same features. no.

The figure which showed an example of the surveillance camera system which concerns on 1st Embodiment. A diagram showing an example of video from surveillance cameras installed in the zone Diagram showing a block configuration example of a surveillance camera Diagram showing an example of server block configuration Diagram showing a block configuration example of a terminal device The figure which showed an example of the table memorize|stored in the memory|storage part of a server. The figure which showed an example of the table memorize|stored in the memory|storage part of a server. Sequence diagram showing an operation example of the surveillance camera system The figure which showed an example of the table memorize|stored in the memory|storage part of the server based on 2nd Embodiment. Sequence diagram showing an example of the operation of the surveillance camera system in registering face data and time The figure which showed an example of the monitoring camera system which concerns on 3rd Embodiment. Diagram showing a block configuration example of a card reader The figure which showed an example of the table memorize|stored in the memory|storage part of a server. Sequence diagram showing an operation example of the surveillance camera system The figure which showed an example of the monitoring camera system which concerns on 4th Embodiment. Diagram for explaining the schematic operation of the surveillance camera system The figure which showed an example of the table memorize|stored in the memory|storage part of a server. The figure which showed an example of the table memorize|stored in the memory|storage part of a server. Sequence diagram showing an operation example of the surveillance camera system Diagram explaining the judgment method in the blacklist method Diagram explaining the determination method in the whitelist method Sequence diagram showing an example of judgment processing in the blacklist method Sequence diagram showing an example of judgment processing in the whitelist method A diagram showing an example of a terminal device screen when an alarm signal is output by the blacklist method A diagram showing an example of a terminal device screen when an alarm signal is output by the whitelist method A diagram showing an example of the terminal device screen when an alarm signal is output The figure which showed an example of the surveillance camera system which concerns on 5th Embodiment. The figure which showed an example of the surveillance camera system which concerns on 5th Embodiment. Sequence diagram showing an operation example of the surveillance camera system Sequence diagram showing an operation example of the surveillance camera system A sequence diagram showing an operation example of the monitoring camera system according to the sixth embodiment. The figure which showed an example of the surveillance camera system which concerns on 7th Embodiment. Diagram explaining an example of accessing a table Diagram explaining an example of accessing a table Sequence diagram showing an operation example of the surveillance camera system

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid unnecessary verbosity in the following description and to facilitate understanding by those skilled in the art.

It should be noted that the accompanying drawings and the following description are provided for a thorough understanding of the present disclosure by those skilled in the art and are not intended to limit the claimed subject matter.

(First embodiment)
FIG. 1 is a diagram showing an example of a monitoring camera system according to the first embodiment. As shown in FIG. 1, the monitoring camera system includes monitoring cameras 1a to 1d, a server (information processing device) 2, and a terminal device 3. FIG. 1 shows building A1 in addition to the surveillance camera system. Building A1 is, for example, a company, an apartment building, or a commercial facility.

Zones A-C may be rooms, entrances, corridors, stairs, floors, elevators, etc. of building A1. Also, zones A to C may be the site on which the building A1 is built. In other words, zones A to C may be regarded as areas where it is determined whether or not a person is permitted to enter (approach). A zone may be called an area. Zones A to C are hereinafter described as rooms in building A1.

Surveillance cameras 1a-1d are installed in zones A-C. For example, surveillance camera 1a is installed in zone A of building A1. Surveillance cameras 1b and 1c are installed in zone B of building A1. The surveillance camera 1d is installed in zone C of building A1.

Surveillance cameras 1a-1d are installed so as to photograph people in zones A-C. For example, the monitoring cameras 1a-1d are installed so as to photograph the entire zones A-C.

FIG. 2 is a diagram showing an example of an image captured by the surveillance camera 1a installed in zone A. As shown in FIG. The surveillance camera 1a, for example, as shown in FIG. 2, captures a wide range of images in the room.

Returning to the description of FIG. The server 2 is connected to the surveillance cameras 1a to 1d via a network such as a LAN (Local Area Network) or the Internet. The server 2 may be installed inside the building A1, or may be installed at a location separate from the building A1.

The server 2 stores (registers) face image data (hereinafter sometimes referred to as face data) of persons who can enter (enter) zones A to C in each of zones A to C. FIG. The server 2 compares the face data of the person photographed by the monitoring cameras 1a to 1d with the registered face data. The server 2 transmits the collation result to the terminal device 3 .

The terminal device 3 is connected to the server 2 via a network such as LAN or the Internet. The terminal device 3 may be installed in the building A1, or may be installed in a place other than the building A1. The terminal device 3 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Note that the monitoring cameras 1a-1d may be installed so as to photograph people entering the zones A-C. For example, the monitoring cameras 1a-1d may be installed so as to photograph the vicinity of the entrances of zones A-C.

Surveillance cameras already installed in zones A to C may be used as the surveillance cameras 1a to 1d. For example, monitoring cameras 1a to 1d that are already installed in zones A to C as part of a recording system that records videos in zones A to C may be used as the monitoring cameras 1a to 1d. In this case, the outputs of the monitoring cameras 1a to 1d may be branched to the recording system and the server 2. FIG.

FIG. 3 is a diagram showing a block configuration example of the surveillance camera 1a. As shown in FIG. 3, the surveillance camera 1a has an imaging section 11, a control section 12, a communication section 13, and a storage section .

The imaging unit 11 has, for example, a lens and an imaging element (not shown). The lens of the imaging unit 11 forms an image of the subject on the light receiving surface of the imaging element. As for the lens, lenses with various focal lengths or shooting ranges can be used depending on the installation location of the monitoring camera 1a, the shooting application, or the like.

The imaging element of the imaging unit 11 converts the light received on the light receiving surface into an electrical signal. The imaging device is, for example, an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging unit 11 converts an electric signal (analog signal) corresponding to the light received by the light receiving surface of the imaging element into a digital signal and outputs the digital signal to the control unit 12 .

The control unit 12 controls the entire surveillance camera 1a. The control unit 12 may be configured by, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control unit 12 determines a person's face from the image output from the imaging unit 11 . The control unit 12 cuts out the identified person's face, and transmits face data (still image) of the cut out face to the server 2 via the communication unit 13 .

The communication unit 13 communicates with the server 2 . The communication unit 13 may communicate with the server 2 via a network cable (wired) such as an Ethernet (registered trademark) cable, for example. Further, the communication unit 13 may communicate with the server 2 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 14 stores a program for operating the control unit 12 . The storage unit 14 also stores data for the control unit 12 to perform calculation processing, data for the control unit 12 to control each unit, and the like. The storage unit 14 may be configured by storage devices such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, and HDD (Hard Disk Drive).

Note that the monitoring cameras 1b to 1d have the same block configuration as the monitoring camera 1a. Therefore, description of the block configuration of the monitoring cameras 1b to 1d is omitted.

FIG. 4 is a diagram showing a block configuration example of the server 2. As shown in FIG. As shown in FIG. 4 , the server 2 has a control section 21 , a communication section 22 and a storage section 23 .

The control unit 21 controls the server 2 as a whole. The control unit 21 may be configured by, for example, a CPU.

The communication unit 22 communicates with the monitoring cameras 1 a to 1 d and the terminal device 3 . The communication unit 22 may communicate with the monitoring cameras 1a to 1d and the terminal device 3, for example, via a network cable such as an Ethernet cable. Further, the communication unit 22 may communicate with the monitoring cameras 1a to 1d and the terminal device 3 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 23 stores a program for operating the control unit 21 . The storage unit 23 also stores data for the control unit 21 to perform calculation processing, data for the control unit 21 to control each unit, and the like. The storage unit 23 may be configured by storage devices such as RAM, ROM, flash memory, and HDD.

FIG. 5 is a diagram showing a block configuration example of the terminal device 3. As shown in FIG. As shown in FIG. 5 , the terminal device 3 has a control section 31 , an input section 32 , a display section 33 , a communication section 34 and a storage section 35 .

The control unit 31 controls the terminal device 3 as a whole. The control unit 31 may be configured by, for example, a CPU.

The input unit 32 is connected to an input device (not shown) such as a keyboard, a touch panel superimposed on the screen of the display device, or a mouse. The input unit 32 receives a signal according to the user's operation output from the input device, and outputs the signal to the control unit 31 .

The display unit 33 is connected to a display device (not shown) included in the terminal device 3 . The display unit 33 outputs the image data output from the control unit 31 to the display device.

In order to simplify the explanation, detection of persons entering the room in zone A and zone B will be explained below. As described with reference to FIG. 1, in zone A, surveillance camera 1a is installed, and in zone B, surveillance cameras 1b and 1c are installed.

FIG. 6 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. As shown in FIG. A table TB1 shown in FIG. 6 is stored in the storage unit 23 of the server 2, for example, when the surveillance cameras 1a to 1c are installed in the building A1. The table TB1 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2 . Information in the table TB1 may be added, changed, or deleted by the terminal device 3, for example.

The table TB1 has zone identification information 41a and face data 41b. The zone identification information 41a is identification information for identifying zones A and B. FIG. For example, "A" in table TB1 indicates zone A identification information. "B" in table TB1 indicates zone B identification information. The face data 41b is human face data.

The table TB1 may be said to be information indicating persons permitted to enter the room for each zone. For example, the person in the circled row of the face data 41b of the table TB1 can enter the zone indicated by the circled column of the zone identification information 41a. Also, the face data 41b in the barred row of the table TB1 cannot enter the zone indicated by the zone identification information 41a in the barred column.

More specifically, the person with the face data 41ba in FIG. 6 can enter the zones A and B. A person with face data 41bb in FIG. 6 can enter zone A, but cannot enter zone B. A person with the face data 41bc in FIG. 6 cannot enter zone A, but can enter zone B.

FIG. 7 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. As shown in FIG. A table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2, for example, when the monitoring cameras 1a to 1c are installed in the building A1. The table TB2 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2 . Information in the table TB2 may be added, changed, or deleted by the terminal device 3, for example.

The table TB2 has zone identification information 42a and camera identification information 42b. The zone identification information 42a is identification information that identifies a zone. The camera identification information 42b is identification information for identifying the monitoring cameras 1a to 1c. For example, "1a" in the camera identification information 42b indicates the identification information of the monitoring camera 1a. "1b" of the camera identification information 42b indicates the identification information of the surveillance camera 1b. "1c" of the camera identification information 42b indicates the identification information of the surveillance camera 1c.

The table TB2 may be said to be information indicating installation locations in zones of the surveillance cameras 1a to 1c. For example, the monitoring camera of the camera identification information 42b in the circled row of the table TB2 is installed in the zone indicated by the zone identification information 42a in the circled column. In addition, the monitoring camera of the camera identification information 42b in the row with the bar in the table TB2 is not installed in the zone indicated by the zone identification information 42a in the column with the bar.

More specifically, the surveillance camera 1a of the camera identification information 42ba in FIG. The surveillance camera 1b with the camera identification information 42bb in FIG. The surveillance camera 1c with the camera identification information 42bc in FIG.

Although the tables TB1 and TB2 are stored in the storage unit 23 of the server 2 in FIGS. 6 and 7, the present invention is not limited to this. Both or one of table TB1 and table TB2 may be stored in a database separate from server 2 . Below, it is assumed that the table TB1 is stored in a registration DB (DB: database) and the table TB2 is stored in the storage unit 23 of the server 2 . The registration DB may be regarded as part of the server 2, for example.

FIG. 8 is a sequence diagram showing an operation example of the surveillance camera system. The control unit 31 of the terminal device 3 performs grouping setting of the zones A and B and the surveillance cameras 1a to 1c for the server 2 according to the operator's operation (step S1). That is, the control unit 31 of the terminal device 3 sets the server 2 to associate the zones A and B with the surveillance cameras 1a to 1c. As a result, for example, the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2 .

The control unit 31 of the terminal device 3 performs face registration to the zones A and B in the registration DB according to the operator's operation (steps S2a and S2b). That is, the control unit 31 of the terminal device 3 sets associations between the zones A and B and face data of persons who can enter the zones A and B in the registration DB. As a result, for example, the table TB1 shown in FIG. 6 is stored in the registration DB. Information registration in the registration DB is performed via the server 2 . Also, the control unit 31 of the terminal device 3 may obtain face data to be registered in the registration DB from a face database of another system.

Assume that the imaging unit 11 of the surveillance camera 1a in zone A has captured a person. The control unit 12 of the monitoring camera 1a cuts out a human face from the video imaged by the imaging unit 11, and transmits the face data of the cut out face and the camera identification information of the monitoring camera 1a to the server 2 (step S3). ).

The control unit 21 of the server 2 receives the face data transmitted in step S3 and the camera identification information of the monitoring camera 1a (step S4).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23 and acquires zone identification information corresponding to the camera identification information received in step S4 (step S5).

In the example of FIG. 8, the control unit 21 of the server 2 receives the camera identification information "1a" of the monitoring camera 1a in step S4. Therefore, the control unit 21 of the server 2 acquires the zone identification information "A" of the zone A from the table TB2 of FIG. Thereby, the control unit 21 of the server 2 can specify (determine) that the face data 51 received in step S4 was captured by the monitoring camera 1a installed in the zone A. FIG. In other words, the control unit 21 of the server 2 can identify that the person whose face is in the face data 51 received in step S4 is in zone A.

After specifying the zone in step S5, the control unit 21 of the server 2 refers to the table TB1 of the registration DB to acquire face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB2 with the face data received in step S4 (step S6).

In the example of FIG. 8, the control unit 21 of the server 2 specifies that the person with the face of the face data 51 is in zone A in step S5. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A of the table TB1 shown in FIG. 6 with the face data 51 received in step S4. Since the face data 51 matches the face data 41ba corresponding to zone A in the table TB1 shown in FIG. That is, the control unit 21 of the server 2 determines that the person in the face data 5 is a person permitted to enter the zone A. FIG.

The control unit 21 of the server 2 transmits the matching result (face matching OK) of step S6 to the terminal device 3 (step S7). It should be noted that the control unit 21 of the server 2 does not have to transmit the matching result to the terminal device 3 when determining that face matching is OK. In other words, the control unit 21 of the server 2 may transmit the matching result to the terminal device 3 only when face matching is determined to be NG. Further, when the control unit 31 of the terminal device 3 receives the result of face matching OK in step S7 of FIG. 8, it may display that effect on the display device.

Assume that the imaging unit 11 of the surveillance camera 1a in zone A has captured a person. The control unit 12 of the monitoring camera 1a cuts out a human face from the video captured by the imaging unit 11, and transmits the face data of the cut out face and the camera identification information of the monitoring camera 1a to the server 2 (step S8). ).

The control unit 21 of the server 2 receives the face data transmitted in step S8 and the camera identification information of the monitoring camera 1a (step S9).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23 and acquires zone identification information corresponding to the camera identification information received in step S9 (step S10).

In the example of FIG. 8, the control unit 21 of the server 2 receives the camera identification information "1a" of the monitoring camera 1a in step S9. Therefore, the control unit 21 of the server 2 acquires the zone identification information "A" of the zone A from the table TB2 of FIG. Accordingly, the control unit 21 of the server 2 can identify that the face data 52 received in step S9 was captured by the surveillance camera 1a installed in the zone A. FIG. In other words, the control unit 21 of the server 2 can identify that the person whose face is in the face data 52 received in step S9 is in zone A.

After specifying the zone in step S10, the control unit 21 of the server 2 refers to the table TB1 of the registration DB to acquire face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB2 with the face data received in step S9 (step S11).

In the example of FIG. 8, the control unit 21 of the server 2 specifies that the person with the face of the face data 52 is in zone A in step S10. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A shown in FIG. 6 with the face data 52 received in step S9. Since the face data 52 does not match the face data 41ba and 41bb corresponding to zone A shown in FIG. That is, the control unit 21 of the server 2 determines that the person in the face data 5 is not permitted to enter the zone A.

The control unit 21 of the server 2 transmits the matching result (face matching NG) of step S11 to the terminal device 3 (step S12). The control unit 31 of the terminal device 3 receives the matching result of face matching NG, and displays an alert on the display device, for example. Note that the control unit 21 of the server 2 may transmit the verification result of step S11 to an audio output device such as a speaker installed in zone A, for example. The audio output device installed in zone A may output a warning sound or the like upon receiving the collation result of step S11.

As described above, the communication unit 22 of the server 2 receives face image data from the plurality of cameras 1a to 1d that photograph the plurality of zones A to C of the building A1. The control unit 21 compares the face image data received by the communication unit 22 with the registered face image data of the person who is permitted to enter the zone, and obtains the face image data in the zone where the person of the face image data was photographed. to determine whether or not to allow entry of As a result, the server 2 can determine whether or not a person other than the persons determined for each of the zones A to C has entered the zones A to C.

In addition, the server 2 accumulates images from a plurality of surveillance cameras 1a to 1d, and judges entry into each zone of the building A1. As a result, the user who uses the surveillance camera system only has to set the entry of people for each zone of the building A1 to the server 2, which facilitates the zone setting.

(Modification)
In the above description, the monitoring cameras 1a to 1d cut out a person's face and send the face data to the server 2, but the present invention is not limited to this. The monitoring cameras 1a to 1d may transmit video data of the zone to the server 2, and the server 2 may detect and cut out human faces. In this case, the image data transmitted from the monitoring cameras 1a to 1d to the server 2 may be regarded as including face data.

(Second embodiment)
The second embodiment also determines when a person may enter the zone. Below, portions different from the first embodiment will be described.

FIG. 9 is a diagram showing an example of a table stored in the storage unit 23 of the server 2 according to the second embodiment. A table TB11 shown in FIG. 9 is stored in the storage unit 23 of the server 2, for example, when the monitoring cameras 1a to 1c are installed in the building A1. The table TB11 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2 . Information in the table TB11 may be added, changed, or deleted by the terminal device 3, for example.

The table TB11 has zone identification information 41a and face data 41b, like the table TB1 described in FIG. It can be said that the table TB11 is information indicating a person who is permitted to enter the room for each zone and also indicates the time during which the person is allowed to stay in the zone. For example, the time shown in the table TB11 indicates the time during which the face data 41b in the row of that time can enter the zone indicated by the zone identification information 41a in the column of that time.

More specifically, the person with the face data 41ba in FIG. 9 can enter zone A between 9:00 and 19:00. The person with the face data 41ba in FIG. 9 can enter zone B between 13:00 and 17:00. A person with the face data 41bb in FIG. 9 can enter zone A between 9:00 and 19:00. The person with face data 41bb in FIG. 9 cannot enter zone B all day long. The person with face data 41bc in FIG. 9 cannot enter zone A all day long. The person with the face data 41bc in FIG. 9 can enter zone B between 15:00 and 17:00.

Although the table TB11 is stored in the storage unit 23 of the server 2 in the above description, the present invention is not limited to this. The table TB11 may be stored in the registration DB.

The operation of the server 2 according to the second embodiment differs from that according to the first embodiment in the process of face collation in step S6 described with reference to FIG. The control unit 21 of the server 2 determines the time during which the person in the face data 51 received in step S4 can stay in the zone in the face matching process in step S6.

For example, the control unit 21 of the server 2 specifies that the person with the face of the face data 51 is in zone A in step S5. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A shown in FIG. 9 with the face data 51 received in step S4. Since the face data 51 matches the face data 41ba corresponding to the zone A shown in FIG. :00 to 19:00). The control unit 21 of the server 2 determines that face matching is OK if the current time is between 9:00 and 19:00. On the other hand, if the current time is not between 9:00 and 19:00, the control unit 21 of the server 2 determines that face matching is NG.

As described above, the control unit 21 of the server 2 determines whether or not it is time for the person represented by the face image data to enter the zone in which the person represented by the face image data was photographed. and is used for determination. As a result, the server 2 can determine whether or not a person other than the persons determined for each of the zones A to C has entered the zones A to C.

(Modification)
The facial data and time registrations of people who may be in the zone may be stored in the server 2 or registration DB by a device other than the terminal device 3 .

FIG. 10 is a sequence diagram showing an operation example of the monitoring camera system in registration of face data and time. A terminal device 61 shown in FIG. 10 is a terminal used by a person who makes a reservation for a facility with a set zone, such as a movie theater, restaurant, condominium, office, or concert venue. A person who reserves the facility uses the terminal device 61 to register face data and the time to enter the zone of the facility. The terminal device 3 shown in FIG. 10 is managed by an administrator of a facility such as a movie theater, a restaurant, an apartment building, an office, or a concert venue.

The terminal device 61 may be, for example, a smart phone, a tablet terminal, or a personal computer. The terminal device 61 may be equipped with an application for registering face data and time in the server 2 or a registration DB. The application may be provided by the administrator of each facility. The terminal device 61 has a block configuration similar to the block configuration shown in FIG.

The sequence of FIG. 10 will be described below. In FIG. 10, illustration of the monitoring cameras 1a to 1d installed in the facility is omitted.

The control unit 31 of the terminal device 3 performs grouping setting of the zones A and B and the monitoring cameras 1a to 1c for the server 2 according to the operator's operation (step S21). That is, the control unit 31 of the terminal device 3 sets the server 2 to associate the zones A and B with the monitoring cameras 1a to 1c. As a result, for example, the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2 .

A person who reserves a facility in which zones are installed (for example, a person who reserves a movie theater) receives, for example, face data, the name of a person who uses the facility, and information on the zone to be used (for example, when a movie is shown) in the terminal device 61. Enter reservation information such as the name of the room to be booked, etc.) and time to enter the zone. The terminal device 61 transmits the input reservation information to the server 2 (step S22).

The control unit 21 of the server 2 performs face registration in the registration DB based on the reservation information transmitted from the terminal device 61 (step S23). That is, the control unit 21 of the server 2 generates the table TB11 shown in FIG. 9 in the registration DB. Note that the control unit 21 of the server 2 may generate the table TB11 in the storage unit 23 .

The control unit 21 of the server 2 transmits the reservation information received in step S22 to the terminal device 3 (step S24). The administrator of the terminal device 3 can grasp the reservation details of the person using the facility from the reservation information received by the terminal device 3 .

In this way, a person who uses a facility in which a zone is set may use the terminal device 61 to set the face data and the time to enter the zone in the server 2 or the registration DB.

Note that, for example, a person who makes a restaurant reservation may use the terminal device 61 to register face data and a reservation time in the server 2 or the registration DB when making the restaurant reservation. A zone may be set for each room serving restaurant meals.

Further, for example, a resident of the condominium may use the terminal device 61 to register the visitor's face data and visit time in the server 2 or the registration DB. A zone may be set for each entrance and floor of the condominium.

Further, for example, an office staff member may use the terminal device 61 to register the visitor's face data and visit time in the server 2 or the registration DB. Zones may be established for each office entrance, floor, or room.

Also, for example, a person who reserves a concert may use the terminal device 61 to set the facial data, the time to watch the concert, etc. in the server 2 or the registration DB when reserving the concert ticket. Zones may be established for each class and box of seats in the concert venue.

(Third Embodiment)
In a company or the like, there are cases in which zones that employees can enter are distinguished according to the cards they possess. For example, a certain employee can enter a certain room by holding his/her card over a card reader provided at the entrance of a certain room, but another employee cannot enter a certain room by holding his or her card over the card reader. cannot enter the room. In the third embodiment, face data is registered using such card information.

FIG. 11 is a diagram showing an example of a surveillance camera system according to the third embodiment. In FIG. 11, the same reference numerals are given to the same parts as in FIG. In FIG. 11, illustration of the building A1 is omitted.

The surveillance camera system of FIG. 11 has card readers 71a to 71c in contrast to the surveillance camera system shown in FIG.

The card reader 71a is installed next to the entrance door of zone A, for example. The zone identification information of zone A is associated with the card reader 71a.

The card reader 71b is installed next to the entrance door of zone B, for example. The card reader 71b is associated with the zone identification information of zone B. FIG.

The card reader 71c is installed next to the entrance door of zone C, for example. The zone identification information of zone C is associated with the card reader 71c.

The card reader 71a performs short-range wireless communication with a card possessed by an employee, for example. The card reader 71a reads information from the card held over the card reader 71a and determines whether or not the person holding the card is an employee who can enter the zone A. The card readers 71b and 71c also read information from the held card and determine whether or not the person holding the card is an employee who can enter the zones B and C in the same way as the card reader 71a.

The card reader 71a unlocks the entrance door of zone A when the card reader 71a determines that the card holder can enter the zone A from the read card information. On the other hand, the card reader 71a does not unlock the entrance door of the zone A when it determines that the card holder cannot enter the zone A from the read card information. The card readers 71b and 71c also control the unlocking of the entrance doors of the zones B and C based on the read card information, like the card reader 71a.

The employee's photo is attached to the card owned by the employee. The card reader 71a has a camera. When the card reader 71a unlocks the entrance door of zone A, the camera takes a photo of the employee's face attached to the card (obtains a still image of the face photo). Then, the card reader 71a transmits the face data of the captured face photograph and the zone identification information of the zone A to the server 2. FIG. That is, when a card holder is allowed to enter zone A using the card, the face photograph attached to the card and the zone identification information of zone A are linked and transmitted to the server 2.例文帳に追加

The card readers 71b, 71b also have cameras, like the card reader 71a. When the card readers 71b and 71c unlock the entrance doors of zones B and C, the cameras take photographs of the faces of the employees attached to the cards. Then, the card readers 71b and 71c transmit the face data of the photographed face and the zone identification information of the zones B and C to the server 2. FIG.

FIG. 12 is a diagram showing a block configuration example of the card reader 71a. As shown in FIG. 12 , the card reader 71 a has an imaging section 81 , a control section 82 , a card communication section 83 , a communication section 84 and a storage section 85 .

The imaging unit 81 has, for example, a lens and an imaging device (not shown). The lens of the imaging unit 81 forms an image of the subject on the light receiving surface of the imaging device. Lenses with various focal lengths or shooting ranges can be used depending on the installation location of the card reader 71a, the shooting application, or the like.

The imaging element of the imaging unit 81 converts the light received on the light receiving surface into an electrical signal. The imaging device is, for example, an image sensor such as CCD or CMOS. The imaging unit 81 converts an electric signal (analog signal) corresponding to the light received by the light receiving surface of the imaging device into a digital signal and outputs the digital signal to the control unit 82 .

The control unit 82 controls the entire card reader 71a. The control unit 82 may be configured by, for example, a CPU or a DSP. The control unit 82 determines a person's face from the image output from the imaging unit 81 . The control unit 82 cuts out the face of the identified person, and transmits face data (still image) of the cut out face to the server 2 via the communication unit 84 .

The card communication unit 83 performs short-range wireless communication with the card held over the card reader 71a.

A communication unit 84 communicates with the server 2 . The communication unit 84 may communicate with the server 2 via a network cable such as an Ethernet cable, for example. Also, the communication unit 84 may communicate with the server 2 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 85 stores a program for operating the control unit 82 . The storage unit 85 also stores data for the control unit 82 to perform calculation processing, data for the control unit 82 to control each unit, and the like. The storage unit 85 may be configured by storage devices such as RAM, ROM, flash memory, and HDD.

In order to simplify the explanation, detection of persons entering the room in zone A and zone B will be explained below.

FIG. 13 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. As shown in FIG. The table TB21 has zone identification information 41a and face data 41b, like the table TB1 described with reference to FIG.

The table TB21 shown in FIG. 13 is generated based on the face data transmitted from the card readers 71a to 71c and the zone identification information. The face data and zone identification information are transmitted from the card readers 71a to 71c when the person can enter the zones A and B as described above. Therefore, the table TB21 can be said to be information indicating persons who have been able to enter the zones A and B. FIG.

For example, assume that a person enters zone A using a card with a photograph of face data 41ba. In this case, the server 2 receives the face data 41ba and the zone identification information A from the card reader 71a provided at the entrance of the zone A. FIG. As a result, the information indicated by the dotted line frame A11 is registered in the table TB21 in FIG.

It is also assumed that a person enters zone A using a card with a photograph of face data 41bb. In this case, the server 2 receives the face data 41bb and the zone identification information A from the card reader 71a provided at the entrance of the zone A. FIG. As a result, the information indicated by the dotted line frame A12 is registered in the table TB21 of FIG.

It is also assumed that a person enters zone B using a card with a photograph of face data 41bc. In this case, the server 2 receives the face data 41bc and the zone identification information B from the card reader 71b provided at the entrance of the zone B. FIG. As a result, the information indicated by the dotted line frame A13 is registered in the table TB21 of FIG.

Although the table TB21 is stored in the storage unit 23 of the server 2 in FIG. 13, the present invention is not limited to this. The table TB21 may be stored in the registration DB. It is assumed below that the table TB21 is stored in the registration DB.

FIG. 14 is a sequence diagram showing an operation example of the surveillance camera system. In FIG. 14, it is assumed that the grouping setting of the zones A and B and the cameras 1a to 1c (for example, the process of step S1 in FIG. 8) has been completed. That is, it is assumed that the storage unit 23 of the server 2 stores the table TB2 shown in FIG. In FIG. 14, description of the processing of the monitoring cameras 1b and 1c and the card reader 71b installed in zone B is omitted.

The card reader 71a acquires the card information of the held card. The card reader 71a unlocks the entrance door of zone A based on the acquired card information, and photographs the card held up. The control unit 82 of the card reader 71a cuts out the face picture attached to the card from the photographed card, and transmits the face data of the cut out face picture and the zone identification information of zone A to the server 2 (step S31).

The control unit 21 of the server 2 performs face registration in the registration DB based on the information transmitted in step S31 (step S32). For example, the control unit 21 of the server 2 registers the information of the dotted line frame A11 shown in FIG. 13 in the table TB21 of the registration DB.

Here, it is assumed that the card held over the card reader 71a in step S31 is a stolen card. For example, it is assumed that the person whose face data 91 shown in FIG. 14 impersonates the person whose face data 92 shown in FIG. 14 has entered Zone A using a stolen card.

Assume that the imaging unit 11 of the monitoring camera 1a in zone A has captured a person (the person whose face is in the face data 91). The control unit 12 of the monitoring camera 1a cuts out a human face from the video captured by the imaging unit 11, and transmits the face data of the cut out face and the camera identification information of the monitoring camera 1a to the server 2 (step S33). ).

The control unit 21 of the server 2 receives the face data transmitted in step S33 and the camera identification information of the monitoring camera 1a (step S34).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23 and acquires the zone identification information corresponding to the camera identification information received in step S34 (step S35).

In the example of FIG. 14, the control unit 21 of the server 2 receives the camera identification information "1a" of the surveillance camera 1a in step S33. Therefore, the control unit 21 of the server 2 acquires the zone identification information "A" of the zone A from the table TB2 of FIG. Accordingly, the control unit 21 of the server 2 can identify that the face data 91 received in step S34 was captured by the surveillance camera 1a installed in the zone A. FIG. In other words, the control unit 21 of the server 2 can identify that the person whose face is in the face data 91 received in step S34 is in zone A.

After specifying the zone in step S35, the control unit 21 of the server 2 refers to the table TB21 of the registration DB to acquire face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB21 with the face data received in step S34 (step S36).

In the example of FIG. 14, the control unit 21 of the server 2 specifies that the person with the face of the face data 91 is in zone A in step S35. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A of the table TB21 shown in FIG. 13 with the face data 91 received in step S34. Since the face data 91 does not match the face data 41ba and 41bb corresponding to zone A shown in FIG. That is, the control unit 21 of the server 2 determines that the person in the face data 9 is not permitted to enter the zone A. FIG.

The control unit 21 of the server 2 transmits the matching result of step S36 to the terminal device 3 (step S37). The control unit 31 of the terminal device 3 receives the matching result of face matching NG, and displays an alert on the display device, for example.

As described above, the communication unit 22 of the server 2 receives face image data of face photographs attached to cards from the card readers 71a to 71c provided corresponding to each of the plurality of zones A to C. . The control unit 21 of the server 2 stores the received face image data as face data in the table TB21. As a result, the server 2 can determine whether or not a person other than the persons determined for each of the zones A to C has entered the zones A to C.

(Modification 1)
Although the card readers 71a to 71c take a photograph of the face attached to the card and transmit the face data of the photograph of the face to the server 2, the present invention is not limited to this. For example, the card may include an IC (Integrated Circuit). The IC may store face data of the employee who has the card. The card readers 71a to 71c may acquire face data from the IC mounted on the card and transmit it to the server 2. FIG.

(Modification 2)
The card readers 71a to 71c may transmit to the server 2 the name read from the card or the card identification information of the card. Upon receiving the name or card identification information transmitted from the card readers 71a to 71c, the control unit 21 of the server 2 may receive face data corresponding to the name or card identification information from the server that manages the card information. . Then, the control unit 21 of the server 2 may generate the table TB21 shown in FIG. 13 based on the received face data and the zone identification information received from the card readers 71a to 71c. The server that manages the card information stores the face data of the card holder and the name or card identification information in association with each other.

(Modification 3)
Although the surveillance camera system including the card readers 71a to 71c has been described as being installed in a company, it is not limited to this. A surveillance camera system including card readers 71a to 71c may be installed in an apartment building, a commercial facility, or the like.

(Fourth embodiment)
In the fourth embodiment, a case will be described in which conditions for monitoring the entry of people are different for each zone. For example, the surveillance camera system uses a blacklist method to determine human entry in one zone, and a whitelist method to determine human entry in another zone.

FIG. 15 is a diagram showing an example of a monitoring camera system according to the fourth embodiment. As shown in FIG. 15, the surveillance camera system has surveillance cameras 101a and 101b, a server 102, a terminal device 103, and alarm devices 104a, 104b, 105a and 105b. FIG. 15 shows a plan view of the interior of the building A101 in addition to the monitoring camera system.

The building A101 has zones A and B. Zones A and B are adjacent. The building A101 has, for example, an entrance A102a for entering zone A from outside the building A101 and an entrance A102b for entering zone B via zone A. Zone B can be accessed by passing through Zone A.

Building A101 is, for example, a store such as a supermarket or a convenience store. Zone A of building A101 is, for example, a sales floor for merchandise. Zone B is, for example, a backyard for storing inventory or processing merchandise.

A surveillance camera 101a is installed in zone A of building A101. A surveillance camera 101b is installed in zone B of building A101.

Surveillance cameras 101a and 101b are installed in building A101 so as to photograph people in zones A and B, respectively. For example, the monitoring camera 101a is installed on the ceiling, wall, or the like of Zone A so as to photograph the entirety of Zone A. The monitoring camera 101b is installed on the ceiling, wall, or the like of Zone B so as to photograph the entire Zone B. FIG.

The server 102 is connected to the surveillance cameras 101a and 101b via a network such as LAN or the Internet. The server 102 may be installed inside the building A101, or may be installed at a location separate from the building A101.

The server 102 stores (registers) face data of persons who cannot enter zone A and face data of persons who can enter zone B. FIG. In other words, the server 102 has a blacklist of people who cannot enter zone A and a whitelist of people who can enter zone B. The server 102 collates face data of persons photographed by the monitoring cameras 101a and 101b with registered face data. The server 102 transmits the matching result to the terminal device 103 and the alarm devices 104a, 104b, 105a and 105b.

The terminal device 103 is connected to the server 102 via a network such as LAN or the Internet. The terminal device 103 may be installed inside the building A101, or may be installed at a location separate from the building A101. The terminal device 103 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Alarm devices 104 a and 104 b receive alarm signals output from server 102 . The alarm devices 104a and 104b are, for example, alarm lamps. The alarm devices 104a and 104b emit light upon receiving an alarm signal. Alarm device 104a is installed in zone A and alarm device 104b is installed in zone B. FIG.

The alarm devices 105a and 105b receive alarm signals output from the server 102 by wireless communication. The alarm devices 105a and 105b are, for example, portable alarm devices possessed by the staff of the building A101. The alarm devices 105a, 105b vibrate upon receiving an alarm signal. Also, the alarm devices 105a and 105b may output light or sound upon receiving an alarm signal. In FIG. 15, the alarm device 105a is located in zone A and the alarm device 105b is located in zone B, but the present invention is not limited to this. The positions of the alarm devices 105a and 105b change according to the movement of the staff carrying the alarm devices 105a and 105b.

Note that the monitoring cameras 101a and 101b may be installed so as to photograph people entering the zones A and B. FIG. For example, the surveillance camera 101a may be installed so as to photograph the vicinity of the entrance A102a of the zone A. The surveillance camera 101b may be installed so as to photograph the vicinity of the entrance A102b of the zone B.

Also, in each of zones A and B, a plurality of surveillance cameras may be installed. Each of Zones A and B may be installed with a plurality of surveillance cameras to photograph persons within Zones A and B.

Monitoring cameras already installed in the zones A and B may be used as the monitoring cameras 101a and 101b. For example, the monitoring cameras 101a and 101b that are already installed in the zones A and B as part of the recording system that records the videos of the zones A and B may be used. In this case, the outputs of the monitoring cameras 101a and 101b may be branched to the recording system and the server 102. FIG.

Also, the number of zones is not limited to two. There may be three or more zones. Surveillance cameras installed in each of the three or more zones are connected to server 102 . The server 102 uses either a blacklist or a whitelist in each of the three or more zones to determine human access to the zone.

The monitoring camera system may also include a recorder for recording video data captured by the monitoring cameras 101a and 101b. The monitoring camera system may include a monitoring device that displays video data captured by the monitoring cameras 101a and 101b in real time. The monitoring device may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Also, the monitoring cameras 101a and 101b have the same configuration as the monitoring camera 1a described in FIG. 3, and the description thereof will be omitted. The server 102 has the same configuration as the server 2 described in FIG. 4, and its description is omitted. The terminal device 103 has the same configuration as the terminal device 3 described in FIG. 5, and the description thereof is omitted.

Below, building A101 is explained as a store.

FIG. 16 is a diagram for explaining the schematic operation of the surveillance camera system. In FIG. 16, the same reference numerals are given to the same parts as in FIG. FIG. 16 shows human face data 111-113.

The face data 111 is, for example, face data of a cautionary person such as a person suspected of having shoplifted in the past or a person who has shoplifted. When the caution person enters zone A, which is a product counter, the terminal device 103 and alarm devices 104a, 104b, 105a, and 105b are notified (an alarm signal is output). As a result, for example, an employee of the store can recognize that the person to be warned has appeared in zone A, which is the merchandise counter, and can monitor the person to be warned. It should be noted that even if the caution person enters the zone B which is the backyard, the terminal device 103 and the warning devices 104a, 104b, 105a, 105b are notified.

The face data 112 is face data of a trader who deals with the store. When a trader enters Zone A, which is a product sales floor, the terminal device 103 and alarm devices 104a, 104b, 105a, and 105b are not notified. 105a and 105b. As a result, for example, an employee of the store can recognize that the trader has appeared in zone B, which is the backyard, and inform the trader that zone B is off-limits to unauthorized persons.

The face data 113 are employees of the store. Even if the employee enters Zone A, which is the product counter, and Zone B, which is the backyard, the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b are not notified. That is, employees can move freely between Zone A and Zone B.

The server 102 uses a blacklist in Zone A, which is a sales floor, to determine whether a specific person enters Zone A.

For example, the face data 111 of the caution person is registered in the blacklist. Therefore, when a person to be cautioned registered in the blacklist is photographed by the surveillance camera 101a, the face data of the person to be cautioned photographed by the surveillance camera 101a matches the face data 111 registered in the blacklist. The server 102 outputs alarm signals to the terminal device 103 and alarm devices 104a, 104b, 105a and 105b.

In the backyard zone B, the server 102 determines whether or not a specific person enters the zone B using the whitelist.

For example, employee face data 113 is whitelisted. Therefore, when a person other than an employee who is not registered in the whitelist is photographed by the surveillance camera 101b, the face data of the person photographed by the surveillance camera 101b and the face of the employee registered in the whitelist are combined. Since it does not match the data 113, the server 102 outputs an alarm signal to the terminal device 103 and alarm devices 104a, 104b, 105a, 105b.

That is, when a person registered in the blacklist appears in zone A, server 102 outputs an alarm signal to terminal device 103 and alarm devices 104a, 104b, 105a, and 105b. Also, when a person not registered in the whitelist appears in zone B, server 102 outputs an alarm signal to terminal device 103 and alarm devices 104a, 104b, 105a, and 105b.

FIG. 17 is a diagram showing an example of a table stored in the storage unit of server 102. As shown in FIG. A table TB101 shown in FIG. 17 is stored in the storage unit of the server 102, for example, when the surveillance cameras 101a and 101b are installed in the building A101. The table TB101 may be created by the terminal device 103 and stored in the storage unit of the server 102 . Information in the table TB101 may be added, changed, or deleted by the terminal device 103, for example.

The table TB101 has zone identification information 121a and camera identification information 121b. The zone identification information 121a is identification information for identifying zones A and B. FIG. For example, "A" in the zone identification information 121a indicates zone A identification information. "B" in the zone identification information 121a indicates zone B identification information.

The camera identification information 121b is identification information for identifying the monitoring cameras 101a and 101b. For example, "101a" in the camera identification information 121b indicates the identification information of the surveillance camera 101a. "101b" of the camera identification information 121b indicates the identification information of the monitoring camera 101b.

The table TB101 may be regarded as information indicating installation locations in zones of the monitoring cameras 101a and 101b. For example, the surveillance camera 101a with the camera identification information "101a" shown in FIG. The monitoring camera 101b with camera identification information “101b” shown in FIG.

FIG. 18 is a diagram showing an example of a table stored in the storage unit of server 102. As shown in FIG. Table TB102 shown in FIG. 18 is stored in the storage unit of server 102, for example, when surveillance cameras 101a and 101b are installed in building A101. The table TB102 may be created by the terminal device 103 and stored in the storage unit of the server 102 . Information in the table TB102 may be added, changed, or deleted by the terminal device 103, for example.

The table TB102 has zone identification information 131a, list information 131b, and face data 131c. The zone identification information 131a is identification information for identifying zones A and B. FIG. For example, "A" in the zone identification information 131a indicates zone A identification information. "B" in the zone identification information 131a indicates zone B identification information.

The list information 131b is information indicating the determination type in the corresponding zone. BL shown in FIG. 18 indicates that entry into the corresponding zone is determined by the blacklist method. WL indicates that access to the corresponding zone is determined by a whitelist method.

For example, in the example of FIG. 18, the list information 131b of zone A is "BL". Therefore, in zone A, human entry is determined by a blacklist method. Also, the list information 131b of zone B is "WL". Therefore, in zone B, human entry is determined by the whitelist method.

The face data 131c is human face data. The face data 132a corresponds to, for example, the face data 113 described with reference to FIG. 16, and is the face data of the employee. The face data 132b corresponds to, for example, the face data 111 described with reference to FIG. 16, and is the face data of the caution person.

The table TB102 may be regarded as a table that defines whether the person in the face data is determined by the blacklist method or the whitelist method for each zone.

For example, a person with face data 132a in table TB102 is circled in zone B (white list). Therefore, even if the person in the face data 132a enters the zone B, no alarm signal is output. On the other hand, an alarm signal is output when a person whose face data is not registered in the table TB102 and who is not circled in the column of zone B in FIG.

Also, the person of the face data 132b of the table TB102 is circled in zone A (black list). Therefore, when the person in the face data 132b enters zone A, an alarm signal is output. On the other hand, for a person whose face data is not registered in the zone A column of FIG.

Note that "a person is registered in the blacklist" means that the face data of the person is registered in the table TB102 and information (a circle in FIG. 18) is registered in the blacklist column of the list information 131b. You may Further, "a person is registered in the whitelist" means that the face data of the person is registered in the table TB102 and information (a circle in FIG. 18) is registered in the whitelist column of the list information 131b. You may

Although the tables TB101 and TB102 are stored in the storage unit of the server 102 in FIGS. 17 and 18, the present invention is not limited to this. Both or one of table TB101 and table TB102 may be stored in a database separate from server 102 . A separate database may be considered part of the server 102 . Tables TB101 and TB102 are assumed to be stored in the registration DB below.

FIG. 19 is a sequence diagram showing an operation example of the surveillance camera system. The control unit of the terminal device 103 links the zones A and B with the monitoring cameras 101a and 101b to the registration DB via the server 102, for example, according to the operation of an operator such as an employee of the store. (steps S41, S42). In addition, the control unit of the terminal device 103 associates the zones A and B with the blacklist and whitelist in the registration DB via the server 102 according to the operator's operation (steps S41 and S42). ).

That is, the control unit of the terminal device 103 sets the association between the zones A and B and the monitoring cameras 101a and 101b in the registration DB. Thereby, for example, the table TB102 shown in FIG. 17 is stored in the registration DB. Also, the control unit of the terminal device 103 sets the association between the zones A and B and the blacklist and whitelist in the registration DB. As a result, the zone identification information 131a and the list information 131b of the table TB102 shown in FIG. 18, for example, are stored in the registration DB.

The control unit of the terminal device 103 registers the face data in the registration DB via the server 102 according to the operator's operation (steps S43 and S44). Thereby, for example, the face data 131c of the table TB102 shown in FIG. 18 is stored in the registration DB.

The control unit of the terminal device 103 associates the face data registered in the registration DB with the zone via the server 102 according to the operator's operation (steps S45 and S46). For example, the control unit of the terminal device 103 associates the face data 132b registered in the registration DB with the zone A (blacklist). Also, the control unit of the terminal device 103 associates the face data 132a registered in the registration DB with the zone B (white list). As a result, information on circles and bars in the table TB102 shown in FIG. 18, for example, is stored in the registration DB.

Assume that the imaging unit of the surveillance camera 101a in zone A has captured a person. The control unit of the monitoring camera 101a cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the monitoring camera 101a to the server 102 (step S47).

The control unit of server 102 collates the face data transmitted in step S47 with the face data stored in the registration DB (step S48).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires zone identification information corresponding to the camera identification information transmitted in step S47. In the example of FIG. 19, the camera identification information "101a" of the surveillance camera 101a is transmitted in step S47. Therefore, the control unit of the server 102 acquires the zone identification information "A" of the zone A from the table TB101 of FIG. Thereby, the control unit of the server 102 can specify (determine) that the face data 141 transmitted in step S47 was captured by the monitoring camera 101a installed in the zone A. In other words, the control unit of server 102 can identify that the person whose face is in face data 141 transmitted in step S47 is in zone A.

After specifying the zone, the control unit of the server 102 refers to the table TB102 of the registration DB to acquire face data and list information corresponding to the specified zone. Then, the control unit of the server 102 compares the face data acquired from the table TB102 with the face data transmitted in step S47, and selects the list information method (blacklist method or whitelist method) obtained from the table TB102. Entry into zones A and B by a person is determined according to the following.

In the example of FIG. 19, the control unit of server 102 identifies that the person whose face is in face data 141 is in zone A. In FIG. The list information for zone A is a blacklist. Therefore, the control unit of the server 102 collates the face data 132b corresponding to zone A in the table TB102 shown in FIG. 18 with the face data 141 transmitted in step S47. Since the face data 141 matches the face data 132b of the table TB102 shown in FIG. 18, the control unit of the server 102 determines that the face collation matches. That is, the control unit of the server 102 determines that the person in the face data 141 transmitted in step S47 is registered in the blacklist.

The control unit of the server 102 transmits the collation result (alarm signal of registered face detection) of step S48 to the terminal device 103 and the alarm devices 104a, 105a, and 105b (step S49). When the control unit of the server 102 determines that the registered face has been detected, the control unit of the server 102 transmits the face data 141 captured by the surveillance camera 101a or the face data 132b stored in the table TB102 that matches the face data 141 to the terminal device 103. . The control unit of the terminal device 103 displays the face data 141 or the face data 132b transmitted from the server 102 on the display device.

Assume that the imaging unit of the surveillance camera 101a in zone A has captured a person. The control unit of monitoring camera 101a cuts out a human face from the video imaged by the imaging unit, and transmits face data of the cut out face and camera identification information of monitoring camera 101a to server 102 (step S50).

The control unit of the server 102 collates the face data transmitted in step S50 with the face data stored in the registration DB (step S51).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires zone identification information corresponding to the camera identification information transmitted in step S50. In the example of FIG. 19, the camera identification information "101a" of the monitoring camera 101a is transmitted in step S50. Therefore, the control unit of the server 102 acquires the zone identification information "A" of the zone A from the table TB101 of FIG. Thereby, the control unit of the server 102 can identify that the face data 142 transmitted in step S50 was captured by the monitoring camera 101a installed in the zone A. FIG. In other words, the control unit of server 102 can identify that the person whose face is in face data 142 transmitted in step S50 is in zone A.

After specifying the zone, the control unit of the server 102 refers to the table TB102 of the registration DB to acquire face data and list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S50, and according to the list information method acquired from the table TB102, to human zones A and B. judge the entry of

In the example of FIG. 19, the control unit of server 102 identifies that the person whose face is in face data 142 is in zone A. In FIG. The list information for zone A is a blacklist. Therefore, the control unit of the server 102 collates the face data 132b corresponding to zone A in the table TB102 shown in FIG. 18 with the face data 142 transmitted in step S50. Since the face data 142 does not match the face data 132b of the table TB102 shown in FIG. 18, the controller of the server 102 determines that the face verification does not match. That is, the control unit of the server 102 determines that the person in the face data 142 is not registered in the blacklist.

Since the person in the face data 142 is not registered in the blacklist, the control unit of the server 102 does not send an alarm signal to the terminal device 103 and the alarm devices 104a, 105a, 105b.

Assume that the imaging unit of the surveillance camera 101b in zone B has captured a person. The control unit of the monitoring camera 101b cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101b to the server 102 (step S52).

The control unit of server 102 collates the face data transmitted in step S52 with the face data stored in the registration DB (step S53).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires zone identification information corresponding to the camera identification information transmitted in step S52. In the example of FIG. 19, the camera identification information "101b" of the monitoring camera 101b is transmitted in step S52. Therefore, the control unit of the server 102 acquires the zone identification information "B" of the zone B from the table TB101 of FIG. Thereby, the control unit of the server 102 can identify that the face data 143 transmitted in step S52 was captured by the monitoring camera 101b installed in the zone B. FIG. In other words, the control unit of server 102 can identify that the person whose face is in face data 143 transmitted in step S52 is in zone B. FIG.

After specifying the zone, the control unit of the server 102 refers to the table TB102 of the registration DB to acquire face data and list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S52, and according to the list information method acquired from the table TB102, to human zones A and B. judge the entry of

In the example of FIG. 19, the control unit of server 102 identifies that the person whose face is in face data 143 is in zone B. In FIG. List information of zone B is a white list. Therefore, the control unit of the server 102 collates the face data 132b corresponding to zone B in the table TB102 shown in FIG. 18 with the face data 143 transmitted in step S52. Since the face data 143 does not match the face data 132a of the table TB102 shown in FIG. 18, the controller of the server 102 determines that the face verification does not match. That is, the control unit of the server 102 determines that the person in the face data 143 is not registered in the whitelist.

The control unit of the server 102 transmits the collation result (alarm signal of unregistered face detection) of step S53 to the terminal device 103 and the alarm devices 104a, 105a, and 105b (step S54). Note that the control unit of the server 102 transmits the face data 143 captured by the monitoring camera 101b to the terminal device 103 when the detection of the unregistered face is determined. The control unit of the terminal device 103 displays the face data 143 transmitted from the server 102 on the display device.

Assume that the imaging unit of the surveillance camera 101b in zone B has captured a person. The control unit of the monitoring camera 101b cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101b to the server 102 (step S55).

The control unit of the server 102 collates the face data transmitted in step S55 with the face data stored in the registration DB (step S56).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires zone identification information corresponding to the camera identification information transmitted in step S55. In the example of FIG. 19, the camera identification information "101b" of the monitoring camera 101b is transmitted in step S55. Therefore, the control unit of the server 102 acquires the zone identification information "B" of the zone B from the table TB101 of FIG. Thereby, the control unit of the server 102 can identify that the face data 144 transmitted in step S55 was captured by the monitoring camera 101b installed in the zone B. FIG. In other words, the control unit of server 102 can identify that the person whose face is in face data 144 transmitted in step S55 is in zone B. FIG.

After specifying the zone, the control unit of the server 102 refers to the table TB102 of the registration DB to acquire face data and list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S55, and according to the list information method acquired from the table TB102, to human zones A and B. judge the entry of

In the example of FIG. 19, the control unit of server 102 identifies that the person whose face is in face data 144 is in zone B. In FIG. List information of zone B is a white list. Therefore, the control unit of the server 102 collates the face data 132a corresponding to zone B in the table TB102 shown in FIG. 18 with the face data 144 transmitted in step S55. Since the face data 144 matches the face data 132a of the table TB102 shown in FIG. 18, the control unit of the server 102 determines that the face collation is matched. That is, the control unit of the server 102 determines that the person in the face data 144 is registered in the whitelist.

Since the person of the face data 144 is a person registered in the whitelist, the control unit of the server 102 does not send an alarm signal to the terminal device 103 and the alarm devices 104a, 105a, 105b.

FIG. 20 is a diagram for explaining a determination method in the blacklist method. Arrows A111 to A113 in FIG. 20 indicate how a person enters zone A. In FIG. FIG. 20 also shows face data 151 registered in zone A (blacklist) of table TB102. FIG. 20 also shows face data 152 to 156 captured by the monitoring camera 101a installed in zone A. As shown in FIG.

The control unit of the monitoring camera 101 a cuts out a face image when detecting a person's face, and transmits face data of the cut out face image to the server 102 . For example, the control unit of the monitoring camera 101a transmits face data 152 to the server 102 when detecting a human face at time t.

Two seconds after the detection of the person's face, the control unit of the monitoring camera 101a cuts out two pieces of face data of the detected person, and transmits them to the server 102 . For example, at time t+2, which is two seconds after time t, the control unit of surveillance camera 101a continuously cuts out two pieces of face data 153 and 154 and transmits them to server 102 . Two seconds is an example, and is not limited to this number of seconds.

Also, the control unit of the monitoring camera 101a cuts out two pieces of face data of the detected person and transmits them to the server 102 four seconds after the detection of the person's face. For example, at time t+4, which is four seconds after time t, the control unit of surveillance camera 101a continuously cuts out two pieces of face data 155 and 156 and transmits them to server 102 . Four seconds is an example, and is not limited to this number of seconds.

The control unit of the server 102 matches the face data transmitted by the monitoring camera 101a with the face data stored in the table TB102, and the face data transmitted by the monitoring camera 101a matches the face data stored in the table TB102. determine whether or not to At this time, the control unit of the server 102 calculates the degree of similarity between the face data transmitted by the monitoring camera 101a and the face data stored in the table TB102. determines that the transmitted face data matches the face data stored in the table TB102.

Note that the operator may use the terminal device 103 to set the threshold. The threshold may be set, for example, based on the accuracy (roughness) of the face data registered in the table TB102. In the example of FIG. 20, the threshold is set to 1.04.

For example, the control unit of the server 102 calculates the degree of similarity between the face data 152 transmitted by the monitoring camera 101a and the face data 151 stored in the table TB102. In the example of FIG. 20, the similarity between face data 152 and face data 151 is 0.80, which does not exceed the threshold of 1.04. Therefore, the control unit of the server 102 determines that the face data 152 and the face data 151 do not match.

Further, the control unit of the server 102 calculates the degree of similarity between the face data 153 and 154 transmitted by the monitoring camera 101a and the face data 151 stored in the table TB102. In the example of FIG. 20, the similarity between face data 153 and face data 151 is 0.90, which does not exceed the threshold of 1.04. Moreover, the similarity between the face data 154 and the face data 151 is 0.95, which does not exceed the threshold value of 1.04. Therefore, the control unit of the server 102 determines that the face data 153, 154 and the face data 151 do not match.

Further, the control unit of the server 102 calculates the degree of similarity between the face data 155 transmitted by the surveillance camera 101a and the face data 151 stored in the table TB102. In the example of FIG. 20, the similarity between face data 155 and face data 151 is 1.15, which exceeds the threshold of 1.04. Therefore, the control unit of the server 102 determines that the face data 155 and the face data 151 match. That is, the control unit of the server 102 determines that the person captured by the monitoring camera 101a is registered in the blacklist.

In blacklist determination, the control unit of the server 102 outputs an alarm signal when the degree of similarity between the face data 155 captured by the monitoring camera 101a and the face data 151 stored in the table TB102 exceeds a threshold. Output.

FIG. 21 is a diagram for explaining a determination method in the whitelist method. Arrows A121 to A123 in FIG. 21 indicate how a person enters zone B. FIG. FIG. 21 also shows face data 161 registered in zone B (white list) of table TB102. 21 also shows face data 162 to 166 captured by the monitoring camera 101b installed in zone B. FIG.

The control unit of the monitoring camera 101b cuts out a face image and transmits the face data to the server 102 in the same manner as the monitoring camera 101a.

In the blacklist determination described with reference to FIG. 20, the control unit of the server 102, upon receiving face data from the monitoring camera 101a, sequentially calculates similarity, and when the calculated similarity exceeds the threshold, It is determined that the person in the received face data is a person registered in the blacklist.

On the other hand, in the whitelist determination, the control unit of the server 102 receives a series of face data of a certain number from the surveillance camera 101b, and then determines whether or not the person photographed by the surveillance camera 101b is a person registered in the whitelist. determine whether For example, when the control unit of the server 102 receives five series of face data 162 to 166 (face data 162 to 166 of the same person) from the monitoring camera 101b, the control unit of the server 102 receives the five face data 162 captured by the monitoring camera 101b. 166 is a whitelisted person.

Upon receiving the five pieces of face data 162-166, the control unit of server 102 calculates the degree of similarity between each of the received face data 162-166 and face data 161 stored in table TB102. The control unit of the server 102 calculates the average value of the calculated similarities, and determines whether or not the person photographed by the surveillance camera 101b is registered in the whitelist based on the calculated average value. may

For example, the control unit of the server 102 calculates the average values of the similarities 0.50, 0.30, 0.35, 0.20, and 0.25 of the face data 162 to 166 shown in FIG. If the value is equal to or less than the threshold value of 1.04, it may be determined that the person captured by the monitoring camera 101b is not registered in the whitelist. Note that the number of similarities used for calculating the average value is not limited to five. The number of degrees of similarity used to calculate the average value may be varied, and may be set from the terminal device 103, for example.

Further, the control unit of the server 102 may determine that the person captured by the monitoring camera 101b is not registered in the whitelist when the median value of the calculated similarities is equal to or less than the threshold value of 1.04.

As described above, in the whitelist determination, the control unit of the server 102 receives a series of face data of a certain number from the surveillance camera 101b, and then determines that the person photographed by the surveillance camera 101b is a person registered in the whitelist. Determine whether or not As a result, the control unit of the server 102 can suppress erroneous whitelist determination.

For example, even if a person registered in the whitelist is captured by the surveillance camera 101b, the first piece of face data may have a low degree of similarity. For example, the face of the first face data 162 may be partially hidden by the door of the entrance A 102b of zone B and have a low degree of similarity. In this case, the alarm signal is output even though the person is registered in the whitelist.

However, as described above, after receiving a certain number of series of face data from the monitoring camera 101b, the control unit of the server 102 determines whether the person photographed by the monitoring camera 101b is a person registered in the whitelist. determine whether Therefore, the control unit of the server 102 does not output an alarm signal even if the similarity of the first piece of face data 162 is equal to or less than the threshold. As a result, the control unit of the server 102 can suppress erroneous whitelist determination.

FIG. 22 is a sequence diagram showing an example of determination processing in the blacklist method. The control unit of the terminal device 103 registers the face data in the registration DB via the server 102 according to the operator's operation (steps S61 and S62). At this time, the control unit of the terminal device 103 also transmits the threshold according to the operator's operation. Thereby, for example, the face data 131c of the table TB102 shown in FIG. 18 is stored in the registration DB. Also, a threshold value is registered along with the face data 131c. Below, the threshold is set to 1.04.

Assume that the imaging unit of the surveillance camera 101a in zone A has captured a person. The control unit of the monitoring camera 101a cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101a to the server 102 (step S63).

The control unit of server 102 collates the face data transmitted in step S63 with the face data stored in the registration DB (step S64). The method of acquiring the face data stored in the registration DB is the same as the method described in step S48 of FIG. 19, so description thereof will be omitted.

The control unit of the server 102 calculates a score (similarity) between the face data transmitted in step S63 and the face data stored in the registration DB (step S65). Here, the score of the face data transmitted in step S63 is assumed to be 0.80. Since the score of 0.80 does not exceed the threshold of 1.04, the controller of server 102 does not output an alarm signal.

After two seconds have passed since the transmission of the face data in step S63, the control unit of the monitoring camera 101a transmits two pieces of face data (steps S66 and S69).

The matching of the face data transmitted in step S66 and the calculation of the score (steps S67 and S68) are the same as in steps S64 and S65, so the description thereof will be omitted. Also, the matching of the face data transmitted in step S69 and the calculation of the score (steps S70 and S71) are the same as those in steps S64 and S65, so the description thereof will be omitted.

After four seconds have passed since the transmission of the face data in step S63, the control unit of the surveillance camera 101a transmits two pieces of face data (steps S72 and S76).

The control unit of server 102 collates the face data transmitted in step S72 with the face data stored in the registration DB (step S73).

The control unit of the server 102 calculates a score (similarity) between the face data transmitted in step S72 and the face data stored in the registration DB (step S74). Here, the score of the face data transmitted in step S72 is assumed to be 1.15. Since the score of 1.15 exceeds the threshold of 1.04, the control unit of the server 102 determines detection of the registered face and outputs an alarm signal for registered face detection to the terminal device 103 (step S75).

The matching of the face data transmitted in step S76 and the calculation of the score (steps S77 and S78) are the same as in steps S64 and S65, and the description thereof will be omitted.

FIG. 23 is a sequence diagram showing an example of determination processing in the whitelist method. The face registration processing in steps S81 and S82 of FIG. 23 is the same as that of steps S61 and S62 of FIG. 22, and the description thereof will be omitted. 23 are the same as steps S63, S66, S69, S72, and S76 in FIG. 22, and description thereof will be omitted. However, in FIG. 23, surveillance camera 101b installed in zone B transmits face data to server .

The face collation processing in steps S84, S87, S90, S93, and S96 in FIG. 23 is the same as step S64 in FIG. 22, and the description thereof will be omitted. Also, the score calculation processing in steps S85, S88, S91, S94, and S97 of FIG. 23 is the same as that of step S65 of FIG. 22, and the description thereof will be omitted.

In the whitelist method, after receiving five pieces of face data from the monitoring camera 101b, the control unit of the server 102 determines whether or not the person whose face data is captured by the monitoring camera 101b is registered in the whitelist. do.

Assume that the scores of the face data transmitted in steps S83, S86, S89, S92, and S95 are 0.50, 0.30, 0.35, 0.20, and 0.25. The control unit of the server 102 uses, for example, the median value of the five scores to determine whether or not the person represented by the face data transmitted by the monitoring camera 101b is registered in the whitelist. In the example of FIG. 23, the median value is 0.35, which does not exceed the threshold value of 1.04. judge not.

When the control unit of the server 102 determines that the person in the face data captured by the monitoring camera 101b is not registered in the whitelist, it transmits an alarm signal indicating non-registration detection to the terminal device 103 (step S98).

In the sequences of FIGS. 22 and 23, surveillance cameras 101a and 110b transmit two pieces of face data to server 102 two seconds after the first transmission of face data, and two pieces of face data four seconds later. Although it is transmitted to the server 102, it is not limited to this. The number of seconds and the number of sheets for transmitting face data may be variable, and may be set from the terminal device 103, for example.

Also, the number of seconds for transmitting face data may be 3 or more. For example, the surveillance cameras 101a and 101b may transmit the face data to the server 102 three times, 2 seconds, 4 seconds, and 6 seconds after the initial transmission of the face data. The number of seconds for transmitting face data may be variable, and may be set from the terminal device 103, for example.

FIG. 24 is a diagram showing a screen example of the terminal device 103 when an alarm signal is output by the blacklist method. When an alarm signal is output by the blacklist method, the display device of the terminal device 103 displays an image shown in FIG. The images include face images captured by the surveillance camera 101a and exceeding the threshold, and face images registered in the table TB102.

When the live button shown in FIG. 24 is clicked, the display device of the terminal device 103 displays the current image captured by the monitoring camera 101a. When the play button is clicked, on the display device of the terminal device 103, images before and after the person captured by the surveillance camera 101a is determined to be registered in the blacklist are played back.

FIG. 25 is a diagram showing a screen example of the terminal device 103 when an alarm signal is output by the whitelist method. 25 is displayed on the display device of the terminal device 103 when the alarm signal is output by the whitelist method. In the image, a face image captured by the monitoring camera 101b that does not exceed the threshold is displayed.

The face data of the person for whom the alarm signal was output by the whitelist method is not registered in the table TB102. Therefore, the display device of the terminal device 103 displays an image 171 indicating that a person with an unregistered face has been detected.

When the live button shown in FIG. 25 is clicked, the display device of the terminal device 103 displays the current situation captured by the surveillance camera 101b. When the play button is clicked, the display device of the terminal device 103 plays back the images before and after the person captured by the monitoring camera 101b was determined not to be registered in the whitelist.

The display device of the terminal device 103 may display a face image when the alarm signal is output regardless of the blacklist method or the whitelist method.

FIG. 26 is a diagram showing a screen example of the terminal device 103 when an alarm signal is output. The display device of the terminal device 103 shown in FIG. 26 displays an image when the alarm signal is output by the blacklist method and an image when the alarm signal is output by the whitelist method. That is, the display device of the terminal device 103 displays an image of a person registered in the blacklist in the sales area (zone A) and a person not registered in the whitelist in the employee area (zone B). The image at the time of appearance is mixed and displayed.

As described above, the server 102 has a communication unit that receives the first facial data from the surveillance camera 101a installed in zone A and the second facial data from the surveillance camera 101b installed in zone B. In addition, the server 102 collates the first face data with registered face data registered in the blacklist, determines whether the person of the registered face data registered in the blacklist has entered the zone A, It has a control unit that compares face data with registered face data registered in the whitelist and determines whether a person whose registered face data is not registered in the whitelist enters zone B.

As a result, the server 102 can appropriately monitor the entry of people into the zone even if the conditions for monitoring the entry of people change for each zone. For example, the server 102 uses a blacklist to determine the entry of a cautionary person in zone A, which is a sales floor, and uses a whitelist to determine the entry of persons other than employees in zone B, which is a backyard. , and the entry of people into zones A and B can be appropriately monitored.

(Modification)
A surveillance camera system may be used, for example, in a company or an apartment building. For example, a surveillance camera system may use a blacklist to determine the zone of a company's entrance, and a whitelist to determine the zone of each department within the building. Also, for example, the surveillance camera system may determine the common zone at the entrance of the condominium using a blacklist, and determine the zones of each floor in the building using a whitelist.

(Fifth embodiment)
In the fifth embodiment, when a person who is not registered in the white list enters zone B described in the fourth embodiment, the person who enters zone B according to an instruction from the terminal device 103 Register the face data of a person in the whitelist. Further, in the fifth embodiment, when a person who is not registered in the whitelist enters zone B described in the fourth embodiment, he/she enters zone B according to an instruction from terminal device 103. Then, the face data of the person is registered in the zone A blacklist.

FIG. 27 is a diagram showing an example of a surveillance camera system according to the fifth embodiment. In FIG. 27, the same components as in FIG. 15 are denoted by the same reference numerals. FIG. 27 shows face data 201 of a person.

Face data 201 is, for example, an employee of a store. Employees are not blacklisted because they are allowed to enter Zone A, which is a product sales floor. The employee can enter zone B, which is the backyard, but is not registered in the whitelist.

The employee of face data 201 is not blacklisted. Therefore, even if the employee of face data 201 enters zone A, the controller of server 102 does not output an alarm signal to terminal device 103 and alarm devices 104a, 104b, 105a, and 105b.

The employee of face data 201 is not whitelisted. Therefore, when the employee of face data 201 enters zone B, the control unit of server 102 outputs an alarm signal to terminal device 103 and alarm devices 104a, 104b, 105a, and 105b. Also, the control unit of the server 102 outputs the face data 201 captured by the monitoring camera 101 b to the terminal device 103 .

Upon receiving the alarm signal and the face data 201 captured by the monitoring camera 101b, the terminal device 103 displays an image of the received face data 201 on the display device. The operator who operates the terminal device 103 operates the terminal device 103 after confirming that the person in the face data 201 displayed on the display device of the terminal device 103 is, for example, an employee who can enter zone B. Then, the server 102 is instructed to register the employee's face data 201 in the whitelist.

The control unit of the server 102 registers the face data 201 displayed on the display device of the terminal device 103 in the whitelist in response to the registration instruction from the terminal device 103 . That is, the control unit of the server 102 registers in the whitelist the face data 201 of the employee that triggered the transmission of the alarm signal. As a result, the control unit of the server 102 does not output an alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b even if the employee of the face data 201 enters the zone B next time.

By the above processing of the monitoring camera system, the operator of the terminal device 103 can obtain the face data 201 captured by the monitoring camera 101b of the employee who can enter the zone B, for example, without receiving the face data 201 from the employee. can be easily whitelisted using Further, the employee does not have to photograph the employee's face and transmit the photographed face data to the terminal device 103 .

Note that the face data 201 is not registered in the whitelist at first. Therefore, until the face data 201 is registered in the whitelist by the terminal device 103, an alarm signal is transmitted from the server 102 to the terminal device 103 and the alarm devices 104a, 104b, 105a and 105b.

FIG. 28 is a diagram showing an example of a surveillance camera system according to the fifth embodiment. In FIG. 28, the same components as in FIG. 15 are denoted by the same reference numerals. FIG. 28 shows face data 202 of a person.

The face data 202 is, for example, face data of a person who has visited the store. Assume that the visitor is not registered in the blacklist and whitelist of the server 102 .

The visitor of face data 202 is not registered in the blacklist. Therefore, even if the visitor of face data 202 enters zone A, the control unit of server 102 does not output an alarm signal to terminal device 103 and alarm devices 104a, 104b, 105a, and 105b.

The visitor of face data 202 is not registered in the whitelist. Therefore, when the employee of face data 202 enters zone B, the control unit of server 102 outputs an alarm signal to terminal device 103 and alarm devices 104a, 104b, 105a, and 105b. Also, the control unit of the server 102 outputs face data 202 photographed by the monitoring camera 101 b to the terminal device 103 .

Upon receiving the alarm signal and the face data 202 captured by the monitoring camera 101b, the terminal device 103 displays an image of the received face data 202 on the display device. The operator who operates the terminal device 103 operates the terminal device 103 after confirming that the person in the face data 202 displayed on the display device of the terminal device 103 is not, for example, an employee who can enter zone B. Then, the server 102 is instructed to register the face data 202 of the visitor in the blacklist.

The control unit of the server 102 registers the face data 202 displayed on the display device of the terminal device 103 in the blacklist in response to the registration instruction from the terminal device 103 . That is, the control unit of the server 102 registers in the blacklist the face data 202 of the visitor who triggered the transmission of the alarm signal. As a result, when a visitor who has entered zone B, which is restricted to authorized persons, enters zone A again, for example, the control unit of server 102 controls terminal device 103 and alarm devices 104a, 104b, 105a, 105b outputs an alarm signal. A store employee can monitor visitors who enter Zone B, which is off-limits to unauthorized persons.

Through the above processing of the monitoring camera system, the operator of the terminal device 103 can obtain the face data 202 captured by the monitoring camera 101b without receiving the face data of the person whose entry into zone A is to be monitored, for example, from an employee. can be easily blacklisted using In addition, the employee does not have to photograph the face of the person whose entry into zone A is to be monitored and transmit the photographed face data to the terminal device 103 .

FIG. 29 is a sequence diagram showing an operation example of the surveillance camera system. FIG. 29 is a sequence diagram corresponding to whitelist registration described in FIG. The processing of steps S101 to S106 shown in FIG. 29 is the same as steps S41 to S46 described with reference to FIG. 19, and the description thereof will be omitted.

Assume that the imaging unit of the surveillance camera 101b in zone B has captured an image of an employee. The employee is, for example, an employee who has visited the store in building A101 for the first time and is not registered in the whitelist. The control unit of the monitoring camera 101b cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101b to the server 102 (step S107).

The control unit of server 102 collates face data 206 transmitted in step S107 with face data stored in the registration DB (step S108). The method of matching face data is the same as the method described in step S53 of FIG. 19, and the description thereof will be omitted. Since the employee of the face data 206 is not registered in the whitelist, the control unit of the server 102 determines that the face data 206 is not registered in the whitelist (unregistered face detection).

The control unit of the server 102 transmits the collation result (alarm signal of unregistered face detection) of step S108 to the terminal device 103 and the alarm devices 104a, 105a, and 105b (step S109). Note that the control unit of the server 102 transmits the face data 206 captured by the surveillance camera 101b to the terminal device 103 when the detection of the unregistered face is determined. The control unit of the terminal device 103 displays the face data 206 transmitted from the server 102 on the display device.

Upon receiving an operation from the operator to register the face data 206 in the whitelist, the control unit of the terminal device 103 transmits a face registration instruction to the server 102 (step S110).

Upon receiving the face registration instruction transmitted in step S110, the control unit of server 102 registers face data 206 that triggered transmission of the alarm signal in step S109 in table TB102 of the registration DB (step S111). .

Assume that the imaging unit of the surveillance camera 101b in zone B has captured an image of an employee. The employee is an employee registered in the whitelist by the face registration processing in step S111. The control unit of the monitoring camera 101b cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101b to the server 102 (step S112).

The control unit of the server 102 collates the face data 207 transmitted in step S112 with the face data stored in the registration DB (step S113). The face data 207 matches the face data 206 registered in the table TB102 of the registration DB in step S111. Therefore, the control unit of the server 102 determines that the employee of the face data 207 is a person registered in the whitelist.

FIG. 30 is a sequence diagram showing an operation example of the surveillance camera system. FIG. 30 is a sequence diagram corresponding to blacklist registration described in FIG. The processing of steps S121 to S126 shown in FIG. 30 is the same as steps S41 to S46 described with reference to FIG. 19, and the description thereof will be omitted.

Assume that the imaging unit of the surveillance camera 101b in zone B has captured a visitor. It is assumed that the visitor is not registered in the blacklist and whitelist. The control unit of the monitoring camera 101b cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101b to the server 102 (step S127).

The control unit of the server 102 collates the face data 208 transmitted in step S127 with the face data stored in the registration DB (step S128). The method of matching face data is the same as the method described in step S53 of FIG. 19, and the description thereof will be omitted. Since the visitor of the face data 208 is not registered in the whitelist, the control unit of the server 102 determines that the face data 208 is not registered in the whitelist (unregistered face detection).

The control unit of the server 102 transmits the collation result (alarm signal of unregistered face detection) of step S128 to the terminal device 103 and the alarm devices 104a, 105a, and 105b (step S129). Note that the control unit of the server 102 transmits the face data 208 captured by the monitoring camera 101b to the terminal device 103 when the detection of the unregistered face is determined. The control unit of the terminal device 103 displays the face data 208 transmitted from the server 102 on the display device.

When the control unit of the terminal device 103 receives an operation to register the face data 208 in the blacklist from the operator, it transmits a face registration instruction to the server 102 (step S130).

Upon receiving the face registration instruction transmitted in step S130, the control unit of server 102 registers face data 208 that triggered transmission of the alarm signal in step S129 in table TB102 of the registration DB (step S131). .

Assume that the imaging unit of the surveillance camera 101a in zone A has captured a visitor. The store visitor is a store visitor registered in the blacklist by the face registration process in step S131. The control unit of the monitoring camera 101a cuts out a human face from the image captured by the imaging unit, and transmits face data of the cut out face and camera identification information of the monitoring camera 101a to the server 102 (step S132).

The control unit of server 102 collates face data 209 transmitted in step S132 with face data stored in the registration DB (step S133). The face data 209 matches the face data 208 registered in the table TB102 of the registration DB in step S131. Therefore, the control unit of the server 102 determines that the visitor of the face data 209 is a person registered in the blacklist. The control unit of the server 102 transmits the collation result (alarm signal of suspicious person notification) of step S133 to the terminal device 103 and the alarm devices 104a, 105a, and 105b (step S134).

As described above, the server 102 collates the first face data received from the surveillance camera 101a with the first registered face data registered in the whitelist, and determines whether the person other than the person in the first registered face data is identified. A control unit that determines entry into zone B, and a communication unit that transmits an alarm signal to terminal device 103 when it is determined that a person other than the person in the first registered face data has entered zone B. The control unit of the server 102 registers the first face data of the person who triggered the transmission of the alarm signal in the whitelist in accordance with the instruction from the terminal device 103 that received the alarm signal. This allows the operator to easily register registered face data in the whitelist.

In addition, the control unit of the server 102 registers the first face data of the person who triggered the transmission of the alarm signal in the blacklist in accordance with the instruction from the terminal device that received the alarm signal. This allows the operator to easily register registered face data in the blacklist.

(Sixth embodiment)
In the first embodiment, the control unit 21 of the server 2 refers to the table TB2 and identifies the zone of the person whose face data is captured. Then, the control unit 21 of the server 2 acquires face data corresponding to the specified zone by referring to the table TB1, and compares the acquired face data with the face data captured by the monitoring cameras 1a to 1c.

On the other hand, in the sixth embodiment, the control unit 21 of the server 2 refers to the table TB1 based on the face data captured by the monitoring cameras 1a to 1c, and determines whether the person in the face data is permitted to enter. get the zone Then, the control unit 21 of the server 2 refers to the table TB2 based on the camera identification information, acquires the photographing zone in which the person of the face data is photographed, and obtains the photographing zone of the person of the face data based on the permission zone and the photographing zone. Judge whether entry is permitted or not permitted.

The configuration of the monitoring camera system and the block configuration of each device in the sixth embodiment are the same as the configuration of the monitoring camera system and the block configuration of each device in the first embodiment, so the description thereof will be omitted.

FIG. 31 is a sequence diagram showing an operation example of the surveillance camera system according to the sixth embodiment. In the sequence diagram of FIG. 31, the same processes as those of the sequence diagram of FIG. 8 are given the same reference numerals. Processing different from the processing in the sequence diagram of FIG. 8 will be described below.

The control unit 21 of the server 2 collates the face data stored in the table TB1 with the face data 51 received in step S4 (step S141).

The control unit 21 of the server 2 acquires the permission zone in which the person of the face data 51 received in step S4 is permitted to enter the room by the collation in step S141 (step S142).

In the example of FIG. 31, the face data 51 received in step S4 matches the face data 41ba of the table TB1 shown in FIG. A person whose face data 51 matches face data 41ba can enter zones A and B according to the table TB1 shown in FIG. Therefore, zones A and B are the permitted zones for the person in the face data 51 received in step S4.

The control unit 21 of the server 2 refers to the table TB2 based on the camera identification information received in step S4, and obtains the photographing zone in which the face data 51 received in step S4 was photographed (step S143).

In the example of FIG. 31, the control unit 21 of the server 2 has received the camera identification information "1a" in step S4. Therefore, the control unit 21 of the server 2 acquires the zone A as the photographing zone.

Based on the permission zone acquired in step S142 and the photographing zone acquired in step S143, the control unit 21 of the server 2 allows the person of the face data 51 received in step S4 to enter zones A and B. determine the permission of In the case of the example of FIG. 8, zones A and B are allowed zones for the person of the face data 51 . Also, the photographing zone of the person of the face data 51 is zone A. Therefore, the person of the face data 51 is a person who is permitted to enter the zones A and B, and is in the zone A. It is determined that the person is permitted to enter. That is, if there is a photographing zone that matches the permission zone, the control unit 21 of the server 2 determines that the person photographed by the surveillance camera is permitted to enter the photographing zone.

The control unit 21 of the server 2 transmits to the terminal device 3 the determination result of permission to enter zones A and B (step S144). In the example of FIG. 31, the control unit 21 of the server 2 determines that the person in the face data 51 is permitted to enter the zone A, and therefore transmits information indicating that entry is OK to the terminal device 3 .

The control unit 21 of the server 2 collates the face data stored in the table TB1 with the face data 52 received in step S8 (step S145).

The control unit 21 of the server 2 acquires the permission zone in which the person of the face data 52 received in step S9 is permitted to enter the room through the collation in step S145 (step S146).

In the example of FIG. 31, the face data 52 received in step S9 does not match the face data 41ba, 41bb, 41bc of the table TB1 shown in FIG. A person whose face data 52 does not match the face data 41ba, 41bb, and 41bc cannot enter the zones A and B. Therefore, there is no permission zone for the person of the face data 52 received in step S9, and the control unit 21 of the server 2 determines that the person of the face data 52 is not permitted to enter zones A and B. .

The control unit 21 of the server 2 transmits to the terminal device 3 the determination result of permission to enter zones A and B (step S147). In the example of FIG. 31, the control unit 21 of the server 2 determines that the person in the face data 52 is not permitted to enter the zones A and B, and therefore transmits information indicating entry NG to the terminal device 3. do.

As described above, the server 2 includes the communication unit 22 that receives face data from the monitoring cameras 1a to 1c that capture the respective zones A to C of the building A1. The server 2 includes a table TB2 linking camera identification information of each of the plurality of monitoring cameras 1a to 1c, a plurality of zones A to C, registered face data, and zones in which the persons of the registered face data are permitted to enter. and a table TB1 in which A to C are linked. Based on the face data, the server 2 refers to the table TB1 to acquire the permission zone in which the person of the face data is permitted to enter, and then refers to the table TB2 based on the camera identification information to identify the person of the face data. A control unit 21 acquires a photographing zone in which is photographed, and determines permission/non-permission of entry of the person of the face data based on the permission zone and the photographing zone. As a result, the server 2 can determine whether or not a person other than the persons determined for each of the zones A to C has entered the zones A to C.

(Seventh embodiment)
In the seventh embodiment, terminal devices that access the two tables are different.

FIG. 32 is a diagram showing an example of a surveillance camera system according to the seventh embodiment. As shown in FIG. 32, the surveillance camera system has surveillance cameras 301 a and 301 b , a server 302 , and terminal devices 303 and 304 .

FIG. 32 shows a plan view of the interior of building A301 in addition to the surveillance camera system. Building A301 is, for example, a concert venue. Below, building A301 is explained as a concert hall.

The building A301 has zones A and B. In zone A, A seats are set. In zone B, B seats are set. B seats are farther from the stage than A seats. The A seat and the B seat have, for example, different concert fees.

A surveillance camera 301a is installed in zone A of building A301. A surveillance camera 301b is installed in zone B of building A301.

Surveillance cameras 301a and 301b are installed in building A301 so as to photograph people in zones A and B, respectively. For example, the monitoring camera 301a is installed on the ceiling, wall, or the like of Zone A so as to photograph the entirety of Zone A. The monitoring camera 301b is installed on the ceiling, wall, or the like of Zone B so as to photograph the entire Zone B. FIG.

The server 302 is connected to surveillance cameras 301a and 301b via a network such as LAN or the Internet. The server 302 may be installed inside the building A301, or may be installed at a location separate from the building A301.

The server 302 stores (registers) face data of people who can enter the zones A and B. FIG. In other words, server 302 has a whitelist of who can enter zones A and B. The server 302 compares the face data of the person captured by the monitoring cameras 301a and 301b with the registered face data. The server 302 transmits the matching result to the terminal device 303 .

The terminal device 303 is connected to the server 302 via a network such as LAN or the Internet. The terminal device 303 may be installed in the building A301, or may be installed in a place other than the building A301. The terminal device 303 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like. The terminal device 303 is used, for example, by an operator of a company that manages concerts.

The terminal device 303 is used, for example, by an operator of a company that manages concerts. The operator uses the terminal device 303 to input information regarding the settings of the monitoring cameras 301a and 301b. For example, the operator uses the terminal device 303 to set the zones A and B and the monitoring cameras 301a and 301b for grouping. Also, the operator uses the terminal device 303, for example, to monitor zones A and B for inappropriate people. For example, the operator uses the terminal device 303 to monitor whether there is a person in zone A who cannot enter zone A. Also, the operator uses the terminal device 303 to monitor whether or not there is a person in zone B who cannot enter zone B. FIG.

The terminal device 304 is connected to the server 302 via a network such as LAN or the Internet. The terminal device 304 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Terminal device 304 is used, for example, by a user watching a concert. A user, for example, uses the terminal device 304 to reserve or purchase tickets for a concert in order to watch the concert.

A plurality of monitoring cameras may be installed in each of the zones A and B. Each of Zones A and B may be installed with a plurality of surveillance cameras to photograph persons within Zones A and B.

Monitoring cameras already installed in zones A and B may be used as the monitoring cameras 301a and 301b. For example, the monitoring cameras 301a and 301b that are already installed in zones A and B as part of a recording system that records videos in zones A and B may be used. In this case, the outputs of the monitoring cameras 301a and 301b may be branched to the recording system and the server 302. FIG.

Also, the number of zones is not limited to two. There may be three or more zones. Surveillance cameras installed in each of the three or more zones are connected to server 302 . Server 302 uses either blacklists or whitelists in each of the three or more zones to determine human access to the zones.

The monitoring camera system may also include a recorder for recording video data captured by the monitoring cameras 301a and 301b. The monitoring camera system may include a monitoring device that displays video data captured by the monitoring cameras 301a and 301b in real time. The monitoring device may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Also, the monitoring cameras 301a and 301b have the same configuration as the monitoring camera 1a described in FIG. 3, and the description thereof will be omitted. The server 302 has the same configuration as the server 2 described with reference to FIG. 4, and the description thereof will be omitted. However, the communication unit of the server 302 communicates with the terminal devices 303 and 304 . The terminal devices 303 and 304 have the same configuration as the terminal device 3 explained in FIG. 5, so the explanation thereof is omitted.

FIG. 33 is a diagram illustrating an example of access to the table TB301. A table TB301 shown in FIG. 33 is the same as the table TB2 described in FIG. However, the table TB2 in FIG. 7 has three pieces of camera identification information, whereas the table TB301 in FIG. 33 has two pieces of camera identification information. Camera identification information “a” shown in FIG. 33 is the camera identification information of the monitoring camera 301a, and camera identification information “b” is the camera identification information of the monitoring camera 301b.

The terminal device 303 can access the table TB301. The terminal device 304 cannot access the table TB301. The table TB301 is created by the terminal device 303 and stored in the storage unit 23 of the server 302 . Information in the table TB2 may be added, changed, or deleted by the terminal device 303, for example.

FIG. 34 is a diagram illustrating an example of access to the table TB302. A table TB302 shown in FIG. 34 is the same as the table TB11 described in FIG. However, the time registered in the table TB301 of FIG. 34 differs from the time registered in the table TB11 of FIG.

The terminal device 304 can access the table TB302. For example, a user who wants to watch a concert can use the terminal device 304 to register the user's face data, seat, and the date and time of the concert to be seen in the table TB302. Also, the user may use the terminal device 303 to add, change, or delete information in the table TB302.

The terminal device 303 may be able to access the table TB302. For example, an authorized operator may use terminal device 303 to view, add, change, or delete information in table TB302.

Tables TB301 and TB302 may be stored in the storage unit of server 302 . Both or one of table TB301 and table TB302 may be stored in a database separate from server 302 . A separate database may be considered part of the server 302 . Below, the tables TB301 and TB302 are assumed to be stored in the registration DB.

FIG. 35 is a sequence diagram showing an operation example of the surveillance camera system. The control unit of the terminal device 303 performs grouping setting of the zones A and B and the monitoring cameras 301a and 301b in the registration DB via the server 302 according to the operator's operation (steps S151 and S152). That is, the control unit of the terminal device 303 sets the association between the zones A and B and the monitoring cameras 301a and 301b in the registration DB. As a result, for example, the table TB301 shown in FIG. 33 is stored in the registration DB.

A person who reserves a concert inputs reservation information such as face data, name, information on the zone to be reserved (information on seats in the concert hall), and time to enter the concert hall into the terminal device 304, for example. The terminal device 304 transmits the input reservation information to the server 302 (step S153).

The control unit of the server 302 performs face registration in the registration DB based on the reservation information transmitted from the terminal device 304 (step S154). That is, the control unit of server 302 generates table TB302 shown in FIG. 34 in the registration DB.

For example, the person of the face data 311 in FIG. 35 uses the terminal device 304 to reserve a concert to be played on xx, yy, 2019 from 13:00 to 15:00. Also, the person of the face data 311 reserves the A seat using the terminal device 304 . In this case, the table TB302 stores, for example, the information indicated by the dotted line frame A401 in FIG.

When the face registration in step S154 is completed, the control unit of the server 302 transmits the reservation information registered in the table TB302 to the terminal device 3 (step S155). The administrator of the terminal device 303 can grasp the content of the reservation made by the person who reserved the concert venue from the reservation information received by the terminal device 303 .
The terminal device 303 transmits a reservation information request to the server 302 according to the operator's operation (step S156). The operator can specify, for example, date and time or seat (zone) information as the requested reservation information.

Upon receiving the reservation information from the terminal device 303, the control unit of the server 302 accesses the table TB302 of the registration DB and acquires the reservation information (step S157).

The control unit of the server 302 transmits the reservation information acquired from the table TB302 to the terminal device 303 (step S158).

As described above, the server 302 includes a communication unit that receives face data from the surveillance cameras 301a and 301b that capture images of the plurality of zones A and B of the building A301; a control unit that compares registered face data of a person permitted to enter and determines whether or not the person of the face data is allowed to enter the zone in which the face data was photographed. The communication unit receives from the terminal device 303 information about the settings of the monitoring cameras 301a and 301b, and from the terminal device 304, the registered face of the person requesting permission to enter at least one of the plurality of zones A and B. Receive data. This makes it convenient for a person who wants to enter the zone to directly register the registered face data in the surveillance camera system.

(Modification)
In the above description, the monitoring camera system is applied to concert halls, but it is not limited to this. The monitoring camera system can be applied, for example, to paid lecture halls, attractions in amusement parks, movie theaters, trains such as Shinkansen bullet trains, and airplanes.

For example, when the surveillance camera system is applied to a venue for paid courses, the server 302 determines whether or not people are sitting in appropriate seats (zones). The server 302 may grasp the vacancy status of paid courses. Server 302 may also determine who is sitting in which seat. The server 302 may also calculate the correlation between grades and seats. The server 302 may also calculate the attendance rate for each lecturer of a paid course.

Also, when the monitoring camera system is applied to an amusement park attraction, the monitoring cameras 301a and 301b may be installed for each attraction (zone). Server 302 may determine whether the person is at the appropriate attraction.

Also, when the surveillance camera system is applied to a movie theater, the surveillance cameras 301a and 301b may be installed in each room (zone) where the movie is shown. Server 302 may determine whether the person is seated in the appropriate room.

Moreover, when applying a monitoring camera system to a Shinkansen, the monitoring cameras 301a and 301b may be installed for each vehicle (zone). The server 302 may determine whether the person is seated in the appropriate vehicle seat. This simplifies ticket inspection.

The embodiment has been described above. Each of the above embodiments may be combined.

In each of the embodiments described above, the registered face data registered in the table may be, for example, a photograph attached to an employee card. For example, the card reader may be equipped with a camera, take a picture attached to the employee card, and send it to the server.

Also, the registered face data registered in the table may be acquired from the video stored in the recorder. For example, the operator may reproduce the video stored in the recorder on the terminal device, cut out the face of the person to be registered in the table from the reproduced video, and register the face data of the cut face in the table.

Also, the registered face data registered in the table may be face data photographed at a face authentication gate. The operator may display an image of the face data taken at the face authentication gate on the terminal device, cut out the face of the person to be registered in the table from the displayed image, and register the face data of the cut out face in the table. .

In the above-described embodiments, the notation "... part" used for each component may be "... circuit (circuitry)", "... device", "... unit", or " . . module” may be substituted.

Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is obvious that a person skilled in the art can conceive various modifications or modifications within the scope of the claims. It is understood that such variations or modifications are also within the technical scope of the present disclosure. Further, each component in the embodiment may be combined arbitrarily within the scope of the present disclosure.

The present disclosure can be implemented in software, hardware, or software in conjunction with hardware. Each functional block used in the description of the above embodiments is partially or wholly implemented as an LSI, which is an integrated circuit, and each process described in the above embodiments is partially or wholly implemented as It may be controlled by one LSI or a combination of LSIs. An LSI may be composed of individual chips, or may be composed of one chip so as to include some or all of the functional blocks. The LSI may have data inputs and outputs. LSIs are also called ICs, system LSIs, super LSIs, and ultra LSIs depending on the degree of integration.

The method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Alternatively, an FPGA that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may be used. The present disclosure may be implemented as digital or analog processing.

Furthermore, if an integration technology that replaces the LSI appears due to advances in semiconductor technology or another derived technology, the technology may naturally be used to integrate the functional blocks. Application of biotechnology, etc. is possible.

A program describing the processing contents of the functions that the server should have is provided. By executing the program on a computer, the above processing functions are realized on the computer.

The surveillance camera system of the present disclosure is useful in a surveillance camera system that determines whether or not a person other than the person determined for each zone has entered the zone.

1a to 1d, 101a, 101b, 301a, 301b Surveillance camera 2, 102, 302 Server 3, 61, 103, 303, 304 Terminal device 11, 81 Imaging unit 12, 21, 31, 82 Control unit 13, 22, 34, 84 communication unit 14, 23, 35, 85 storage unit 32 input unit 33 display unit 41a, 42a, 121a, 131a zone identification information 41b, 41ba to 41bc, 51, 52, 91, 92, 111 to 113, 131c, 132a, 132b, 141-144, 151-156, 166-166, 201, 202, 206, 207, 208, 209, 311 face data 42b, 42ba-42bc, 121b camera identification information 71a-71c card reader 83 card communication section 104a, 104b, 105a, 105b Alarm device 131b List information TB1, TB2, TB11, TB21, TB101, TB102, TB301, TB302 Tables A to C Zones A1, A101, A301 Building

Claims (8)

a communication unit that receives face image data from a camera that captures each of a plurality of zones of a building;
a first table that associates camera identification information of each of a plurality of cameras with the plurality of zones;
a second table that associates registered face image data with zones in which persons in the registered face image data are permitted to enter;
The second table is referred to based on the face image data, and after acquiring the permission zone in which the person of the face image data is permitted to enter, the first table is referred to based on the camera identification information. a control unit for obtaining a photographing zone in which the person of the face image data is photographed, and determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone; have
Information processing equipment. When the photographing zone that matches the permission zone exists, the control unit determines permission for the person of the face image data to enter the photographing zone.
The information processing device according to claim 1 . When the registered face image data matching the face image data is not registered in the second table, the control unit determines whether or not the person of the face image data is permitted to enter the plurality of zones. ,
The information processing device according to claim 1 . A determination method performed by a computer,
receiving facial image data from cameras photographing each of a plurality of zones of a building;
Based on the face image data, a second table that associates the registered face image data with the zones in which the person in the registered face image data is permitted to enter is referred to, and the person in the face image data is allowed to enter. Get the permitted zone of authorization,
The face image data by referring to a first table linking the camera identification information of each of the plurality of cameras and the plurality of zones based on the camera identification information of the camera that photographed the person in the face image data. Get the shooting zone where the person was shot,
Determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone;
judgment method. to the computer,
receiving facial image data from cameras photographing each of a plurality of zones of a building;
Based on the face image data, a second table that associates the registered face image data with the zones in which the person in the registered face image data is permitted to enter is referred to, and the person in the face image data is allowed to enter. Get the permitted zone of authorization,
The face image data by referring to a first table linking the camera identification information of each of the plurality of cameras and the plurality of zones based on the camera identification information of the camera that photographed the person in the face image data. Get the shooting zone where the person was shot,
executing a process of determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone;
program. a communication unit that receives face image data from a camera that captures each of a plurality of zones of a building;
camera identification information for each of a plurality of cameras, first information linking the plurality of zones, registered face image data, and a zone in which a person is permitted to enter in the registered face image data are linked. a memory for storing second information;
After referring to the second information based on the face image data to obtain a permission zone in which the person of the face image data is permitted to enter, referring to the first information based on the camera identification information a control unit for obtaining a photographing zone in which the person of the face image data is photographed, and determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone; have
Information processing equipment. A determination method performed by a computer,
receiving facial image data from cameras photographing each of a plurality of zones of a building;
Based on the face image data, reference is made to second information that associates the registered face image data with a zone in which the person in the registered face image data is permitted to enter, and the person in the face image data is allowed to enter. Get the permitted zone of authorization,
The face image data is obtained by referring to first information linking the camera identification information of each of the plurality of cameras and the plurality of zones based on the camera identification information of the camera that photographed the person of the face image data. Get the shooting zone where the person was shot,
Determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone;
judgment method. to the computer,
receiving facial image data from cameras photographing each of a plurality of zones of a building;
Based on the face image data, reference is made to second information that associates the registered face image data with a zone in which the person in the registered face image data is permitted to enter, and the person in the face image data is allowed to enter. Get the permitted zone of authorization,
The face image data is obtained by referring to first information linking the camera identification information of each of the plurality of cameras and the plurality of zones based on the camera identification information of the camera that photographed the person of the face image data. Get the shooting zone where the person was shot,
executing a process of determining permission/non-permission of entry of the person of the face image data based on the permission zone and the photographing zone;
program.

Images