JP2021168153A - Information processor, determination method, and program - Google Patents

Abstract

To provide an information processor that can easily register registered face image data to a white list.SOLUTION: An information processor includes: a control unit that collates first face image data received from a first monitor camera with first registered face image data registered in a white list to determine entry of a person other than a person in the first registered face image data into a first zone; and a communication unit that transmits, when it is determined that a person other than the person in the first registered face image data enters the first zone, an alarm signal to a terminal device. The control unit registers, in response to an instruction from the terminal device that receives the alarm signal, first face image data of the person who triggers the transmission of the alarm signal in the white list.SELECTED DRAWING: Figure 29

Description

The present disclosure relates to information processing devices, determination methods, and programs.

Conventionally, an entrance / exit management system capable of notifying and transmitting the authentication result by face recognition to each user passing through the gate has been provided (see, for example, Patent Document 1).

JP-A-2018-92293

By the way, there is a demand for a surveillance camera system that determines the entry of people into a zone using a white list. In such a surveillance camera system, when registering the registered face image data in the white list, for example, a face is photographed using a handy camera, and the photographed face image data is read into a terminal device connected to the surveillance camera system. .. Then, it takes time and effort to register the face image data in the white list of the surveillance camera system from the terminal device.

Further, in a company or the like, for example, a person who can enter may be distinguished for each zone such as a floor or a room. For example, person A may be able to enter room X and room Y, and person B may be able to enter room X but not room Y. In this way, in a facility or the like that distinguishes people who can enter each zone, it is important to manage whether or not a person other than the person determined for each zone has entered the zone.

Non-limiting examples of the present disclosure contribute to the provision of an information processing device, a determination method, and a program capable of easily registering registered face image data in a white list.

The non-limiting examples of the present disclosure contribute to the provision of an information processing device, a determination method, and a program for determining whether or not a person other than the person determined for each zone has entered the zone.

The present disclosure is a first table in which a communication unit that receives face image data from a camera that captures each of a plurality of zones of a building, camera identification information of each of the plurality of cameras, and the plurality of zones are linked. With reference to the second table in which the registered face image data and the zone in which the person is allowed to enter the registered face image data are linked, and the second table based on the face image data, the said After acquiring the permission zone in which the person in the face image data is allowed to enter, the shooting zone in which the person in the face image data is photographed is acquired by referring to the first table based on the camera identification information. An information processing device including a control unit for determining permission / denial of entry of a person in the face image data based on the permission zone and the photographing zone.

Further, in the present disclosure, face image data is received from a camera that photographs each of a plurality of zones of a building, and based on the face image data, the registered face image data and the person in the registered face image data can enter. With reference to the second table associated with the permitted zone, the permitted zone in which the person in the face image data is allowed to enter is acquired, and the camera identification information of the camera that photographed the person in the face image data is used. Based on this, the camera identification information of each of the plurality of cameras and the first table in which the plurality of zones are linked are referred to to acquire the shooting zone in which the person in the face image data is photographed, and the permission zone is obtained. Provided is a determination method for determining permission / denial of entry of a person in the face image data based on the above-mentioned shooting zone.

Further, in the present disclosure, the computer receives face image data from a camera that captures each of a plurality of zones of the building, and based on the face image data, the registered face image data and the person in the registered face image data. Refer to the second table associated with the zone where the person is allowed to enter, acquire the permitted zone where the person in the face image data is allowed to enter, and take a picture of the person in the face image data. Based on the identification information, the camera identification information of each of the plurality of cameras and the first table in which the plurality of zones are linked are referred to to acquire the photographing zone in which the person of the face image data is photographed. Provided is a program for determining permission / non-permission of entry of a person in the face image data based on the permission zone and the photographing zone, and executing a process.

A communication unit that receives face image data from cameras that shoot each of a plurality of zones of a building, camera identification information of each of the plurality of cameras, first information that links the plurality of zones, and a registered face. Refer to the memory for storing the image data and the second information associated with the zone in which the person is allowed to enter the registered face image data, and the second information based on the face image data. After acquiring the permission zone in which the person in the face image data is allowed to enter, the shooting zone in which the person in the face image data is photographed is acquired by referring to the first information based on the camera identification information. Further, the information processing apparatus is provided which has a control unit for determining permission / non-permission of entry of a person in the face image data based on the permission zone and the photographing zone.

Further, in the present disclosure, face image data is received from a camera that photographs each of a plurality of zones of a building, and based on the face image data, the registered face image data and the person in the registered face image data can enter. With reference to the second information associated with the permitted zone, the permitted zone in which the person in the face image data is permitted to enter is acquired, and the camera identification information of the camera that captured the person in the face image data is used. Based on this, the camera identification information of each of the plurality of cameras and the first information in which the plurality of zones are linked are referred to to obtain a shooting zone in which the person in the face image data is photographed, and the permission zone is obtained. Provided is a determination method for determining permission / denial of entry of a person in the face image data based on the above-mentioned shooting zone.

Further, in the present disclosure, face image data is received by a computer from a camera that captures each of a plurality of zones of a building, and based on the face image data, a registered face image data and a person in the registered face image data are obtained. With reference to the second information associated with the zone where the person is allowed to enter, the camera of the camera which acquired the permitted zone where the person in the face image data is allowed to enter and photographed the person in the face image data. Based on the identification information, the camera identification information of each of the plurality of cameras and the first information in which the plurality of zones are linked are referred to to acquire the shooting zone in which the person in the face image data is photographed. Provided is a program for determining permission / non-permission of entry of a person in the face image data based on the permission zone and the shooting zone, and executing a process.

It should be noted that these comprehensive or specific embodiments may be realized in a system, device, method, integrated circuit, computer program, or recording medium, and the system, device, method, integrated circuit, computer program, and recording medium. It may be realized by any combination of.

According to one embodiment of the present disclosure, it is possible to easily register the registered face image data in the white list.

According to one embodiment of the present disclosure, it is possible to determine whether or not a person other than the person determined for each zone has entered the zone.

Further advantages and effects in one embodiment of the present disclosure will be apparent from the specification and drawings. Such advantages and / or effects are provided by some embodiments and features described in the specification and drawings, respectively, but not all need to be provided in order to obtain one or more identical features. There is no.

The figure which showed an example of the surveillance camera system which concerns on 1st Embodiment The figure which showed the image example of the surveillance camera installed in the zone The figure which showed the block configuration example of the surveillance camera Diagram showing an example of a server block configuration The figure which showed the block configuration example of a terminal device The figure which showed an example of the table stored in the storage part of a server The figure which showed an example of the table stored in the storage part of a server Sequence diagram showing an operation example of a surveillance camera system The figure which showed an example of the table stored in the storage part of the server which concerns on 2nd Embodiment Sequence diagram showing an operation example of the surveillance camera system in the registration of face data and time The figure which showed an example of the surveillance camera system which concerns on 3rd Embodiment The figure which showed the block configuration example of a card reader The figure which showed an example of the table stored in the storage part of a server Sequence diagram showing an operation example of a surveillance camera system The figure which showed an example of the surveillance camera system which concerns on 4th Embodiment The figure explaining the schematic operation of the surveillance camera system The figure which showed an example of the table stored in the storage part of a server The figure which showed an example of the table stored in the storage part of a server Sequence diagram showing an operation example of a surveillance camera system The figure explaining the judgment method in the blacklist method The figure explaining the judgment method in the white list method Sequence diagram showing an example of judgment processing in the blacklist method Sequence diagram showing an example of judgment processing in the white list method The figure which showed the screen example of the terminal device when the alarm signal was output by the blacklist method. The figure which showed the screen example of the terminal device when the alarm signal was output by the white list method. The figure which showed the screen example of the terminal device when an alarm signal was output The figure which showed an example of the surveillance camera system which concerns on 5th Embodiment The figure which showed an example of the surveillance camera system which concerns on 5th Embodiment Sequence diagram showing an operation example of a surveillance camera system Sequence diagram showing an operation example of a surveillance camera system A sequence diagram showing an operation example of the surveillance camera system according to the sixth embodiment. The figure which showed an example of the surveillance camera system which concerns on 7th Embodiment Diagram illustrating an example of table access Diagram illustrating an example of table access Sequence diagram showing an operation example of a surveillance camera system

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art.

It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(First Embodiment)
FIG. 1 is a diagram showing an example of a surveillance camera system according to the first embodiment. As shown in FIG. 1, the surveillance camera system includes surveillance cameras 1a to 1d, a server (information processing device) 2, and a terminal device 3. In addition to the surveillance camera system, building A1 is shown in FIG. Building A1 is, for example, a company, a condominium, a commercial facility, or the like.

Zones A to C may be rooms, entrances, corridors, stairs, floors, elevators, etc. of building A1. Further, zones A to C may be sites on which building A1 is built. That is, zones A to C may be regarded as areas in which it is determined whether or not a person is allowed to enter (enter). Zones may be referred to as areas. In the following, zones A to C will be described as rooms in building A1.

Surveillance cameras 1a to 1d are installed in zones A to C. For example, the surveillance camera 1a is installed in the zone A of the building A1. Surveillance cameras 1b and 1c are installed in zone B of building A1. The surveillance camera 1d is installed in the zone C of the building A1.

Surveillance cameras 1a to 1d are installed so as to photograph people in zones A to C. For example, the surveillance cameras 1a to 1d are installed so as to capture the entire area in zones A to C.

FIG. 2 is a diagram showing an image example of the surveillance camera 1a installed in the zone A. As shown in FIG. 2, the surveillance camera 1a captures a wide range of the room.

Returning to the description of FIG. The server 2 is connected to the surveillance cameras 1a to 1d by, for example, a network such as a LAN (Local Area Network) or the Internet. The server 2 may be installed in the building A1 or may be installed in a place different from the building A1.

The server 2 stores (registers) image data (hereinafter, may be referred to as face data) of a person's face that can enter (enter) zones A to C in each of zones A to C. The server 2 collates the face data of the person photographed by the surveillance cameras 1a to 1d with the registered face data. The server 2 transmits the collated result to the terminal device 3.

The terminal device 3 is connected to the server 2 by a network such as a LAN or the Internet. The terminal device 3 may be installed in the building A1 or may be installed in a place different from the building A1. The terminal device 3 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

The surveillance cameras 1a to 1d may be installed so as to photograph people entering the zones A to C. For example, the surveillance cameras 1a to 1d may be installed so as to photograph the vicinity of the entrances of the zones A to C.

Further, as the surveillance cameras 1a to 1d, the surveillance cameras already installed in the zones A to C may be used. For example, for the surveillance cameras 1a to 1d, surveillance cameras already installed in the zones A to C may be used as a part of the recording system for recording the images in the zones A to C. In this case, the outputs of the surveillance cameras 1a to 1d may be branched to the recording system and the server 2.

FIG. 3 is a diagram showing a block configuration example of the surveillance camera 1a. As shown in FIG. 3, the surveillance camera 1a includes an imaging unit 11, a control unit 12, a communication unit 13, and a storage unit 14.

The image pickup unit 11 includes, for example, a lens and an image pickup device (not shown). The lens of the image pickup unit 11 forms an image of the subject on the light receiving surface of the image pickup device. As the lens, lenses having various focal lengths or shooting ranges can be used depending on the installation location of the surveillance camera 1a, the shooting application, and the like.

The image sensor of the image pickup unit 11 converts the light received on the light receiving surface into an electric signal. The image sensor is, for example, an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The image pickup unit 11 converts an electric signal (analog signal) corresponding to the light received on the light receiving surface of the image pickup element into a digital signal and outputs the digital signal to the control unit 12.

The control unit 12 controls the entire surveillance camera 1a. The control unit 12 may be configured by, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processer). The control unit 12 determines a human face from the image output from the image pickup unit 11. The control unit 12 cuts out the face of the determined person, and transmits the face data (still image) of the cut out face to the server 2 via the communication unit 13.

The communication unit 13 communicates with the server 2. The communication unit 13 may communicate with the server 2 via, for example, a network cable (wired) such as an Ethernet (registered trademark) cable. Further, the communication unit 13 may communicate with the server 2 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 14 stores a program for operating the control unit 12. Further, the storage unit 14 stores data for the control unit 12 to perform calculation processing, data for the control unit 12 to control each unit, and the like. The storage unit 14 may be composed of a storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, and an HDD (Hard Disk Drive).

The surveillance cameras 1b to 1d have the same block configuration as the surveillance cameras 1a. Therefore, the description of the block configuration of the surveillance cameras 1b to 1d will be omitted.

FIG. 4 is a diagram showing a block configuration example of the server 2. As shown in FIG. 4, the server 2 has a control unit 21, a communication unit 22, and a storage unit 23.

The control unit 21 controls the entire server 2. The control unit 21 may be configured by, for example, a CPU.

The communication unit 22 communicates with the surveillance cameras 1a to 1d and the terminal device 3. The communication unit 22 may communicate with the surveillance cameras 1a to 1d and the terminal device 3 via a network cable such as an Ethernet cable. Further, the communication unit 22 may communicate with the surveillance cameras 1a to 1d and the terminal device 3 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 23 stores a program for operating the control unit 21. Further, the storage unit 23 stores data for the control unit 21 to perform calculation processing, data for the control unit 21 to control each unit, and the like. The storage unit 23 may be composed of a storage device such as a RAM, a ROM, a flash memory, and an HDD.

FIG. 5 is a diagram showing a block configuration example of the terminal device 3. As shown in FIG. 5, the terminal device 3 includes a control unit 31, an input unit 32, a display unit 33, a communication unit 34, and a storage unit 35.

The control unit 31 controls the entire terminal device 3. The control unit 31 may be configured by, for example, a CPU.

The input unit 32 is connected to, for example, an input device (not shown) such as a keyboard, a touch panel superimposed on the screen of the display device, or a mouse. The input unit 32 receives the signal output from the input device according to the user's operation and outputs the signal to the control unit 31.

The display unit 33 is connected to a display device (not shown) included in the terminal device 3. The display unit 33 outputs the image data output from the control unit 31 to the display device.

In the following, for the sake of simplicity, the detection of occupants in Zone A and Zone B will be described. As described with reference to FIG. 1, a surveillance camera 1a is installed in the zone A, and surveillance cameras 1b and 1c are installed in the zone B.

FIG. 6 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. The table TB1 shown in FIG. 6 is stored in the storage unit 23 of the server 2, for example, when the surveillance cameras 1a to 1c are installed in the building A1. The table TB1 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2. Further, the information in the table TB1 may be added, changed, or deleted by, for example, the terminal device 3.

Table TB1 has zone identification information 41a and face data 41b. The zone identification information 41a is identification information for identifying zones A and B. For example, "A" in the table TB1 indicates the identification information of the zone A. “B” in the table TB1 indicates the identification information of the zone B. The face data 41b is human face data.

The table TB1 may be said to be information indicating the persons who are allowed to enter the room for each zone. For example, the person in the face data 41b in the circled row of the table TB1 indicates that he / she can enter the zone indicated by the zone identification information 41a in the circled column. Further, it is shown that the person in the face data 41b of the row with the bar of the table TB1 cannot enter the zone indicated by the zone identification information 41a of the column with the bar.

More specifically, the person with the face of the face data 41ba in FIG. 6 can enter the zones A and B. The person with the face of the face data 41bb in FIG. 6 can enter the zone A, but cannot enter the zone B. A person with a face of face data 41bc in FIG. 6 cannot enter zone A, but can enter zone B.

FIG. 7 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. The table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2, for example, when the surveillance cameras 1a to 1c are installed in the building A1. The table TB2 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2. Further, the information in the table TB2 may be added, changed, or deleted by, for example, the terminal device 3.

The table TB2 has zone identification information 42a and camera identification information 42b. The zone identification information 42a is identification information for identifying the zone. The camera identification information 42b is identification information for identifying the surveillance cameras 1a to 1c. For example, “1a” in the camera identification information 42b indicates the identification information of the surveillance camera 1a. “1b” of the camera identification information 42b indicates the identification information of the surveillance camera 1b. “1c” of the camera identification information 42b indicates the identification information of the surveillance camera 1c.

The table TB2 may be said to be information indicating the installation location in the zones of the surveillance cameras 1a to 1c. For example, the surveillance camera of the camera identification information 42b in the circled row of the table TB2 indicates that it is installed in the zone indicated by the zone identification information 42a in the circled column. Further, it is shown that the surveillance camera of the camera identification information 42b in the row with the bar of the table TB2 is not installed in the zone indicated by the zone identification information 42a of the column with the bar.

More specifically, the surveillance camera 1a of the camera identification information 42ba of FIG. 7 is installed in the zone A. The surveillance camera 1b of the camera identification information 42bb of FIG. 7 is installed in the zone B. The surveillance camera 1c of the camera identification information 42bc of FIG. 7 is installed in the zone B.

In FIGS. 6 and 7, the tables TB1 and TB2 are stored in the storage unit 23 of the server 2, but the present invention is not limited to this. Table TB1 and / or one of table TB2 may be stored in a database separate from the server 2. In the following, it is assumed that the table TB1 is stored in the registration DB (DB: database) and the table TB2 is stored in the storage unit 23 of the server 2. The registration DB may be regarded as a part of the server 2, for example.

FIG. 8 is a sequence diagram showing an operation example of the surveillance camera system. The control unit 31 of the terminal device 3 sets the grouping of the zones A and B and the surveillance cameras 1a to 1c for the server 2 according to the operation of the operator (step S1). That is, the control unit 31 of the terminal device 3 sets the server 2 to associate the zones A and B with the surveillance cameras 1a to 1c. As a result, for example, the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2.

The control unit 31 of the terminal device 3 registers faces in zones A and B in the registration DB according to the operation of the operator (steps S2a and S2b). That is, the control unit 31 of the terminal device 3 sets the association between the zones A and B and the face data of the person who can enter the zones A and B in the registration DB. As a result, for example, the table TB1 shown in FIG. 6 is stored in the registration DB. The information registration of the registration DB is performed via the server 2. Further, the control unit 31 of the terminal device 3 may obtain the face data to be registered in the registration DB from the face database of another system.

It is assumed that the imaging unit 11 of the surveillance camera 1a in zone A photographs a person. The control unit 12 of the surveillance camera 1a cuts out a human face from the image captured by the imaging unit 11, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 1a to the server 2 (step S3). ).

The control unit 21 of the server 2 receives the face data transmitted in step S3 and the camera identification information of the surveillance camera 1a (step S4).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23, and acquires the zone identification information corresponding to the camera identification information received in step S4 (step S5).

In the example of FIG. 8, the control unit 21 of the server 2 receives the camera identification information “1a” of the surveillance camera 1a in step S4. Therefore, the control unit 21 of the server 2 acquires the zone identification information “A” of the zone A from the table TB2 of FIG. As a result, the control unit 21 of the server 2 can identify (determine) that the face data 51 received in step S4 has been captured by the surveillance camera 1a installed in the zone A. In other words, the control unit 21 of the server 2 can identify the person with the face of the face data 51 received in step S4 as being in the zone A.

When the zone is specified in step S5, the control unit 21 of the server 2 refers to the table TB1 of the registration DB and acquires the face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB2 with the face data received in step S4 (step S6).

In the example of FIG. 8, the control unit 21 of the server 2 specifies in step S5 that the person with the face of the face data 51 is in the zone A. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A of the table TB1 shown in FIG. 6 with the face data 51 received in step S4. Since the face data 51 matches the face data 41ba corresponding to the zone A of the table TB1 shown in FIG. 6, the control unit 21 of the server 2 determines that the face matching matches. That is, the control unit 21 of the server 2 determines that the person with the face data 51 is a person who is permitted to enter the zone A.

The control unit 21 of the server 2 transmits the collation result (face collation OK) in step S6 to the terminal device 3 (step S7). When the control unit 21 of the server 2 determines that the face collation is OK, the control unit 21 does not have to transmit the collation result to the terminal device 3. In other words, the control unit 21 of the server 2 may transmit the collation result to the terminal device 3 only when the face collation NG is determined. Further, when the control unit 31 of the terminal device 3 receives the collation result of the face collation OK in step S7 of FIG. 8, the control unit 31 may display to that effect on the display device.

It is assumed that the imaging unit 11 of the surveillance camera 1a in zone A photographs a person. The control unit 12 of the surveillance camera 1a cuts out a human face from the image captured by the imaging unit 11, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 1a to the server 2 (step S8). ).

The control unit 21 of the server 2 receives the face data transmitted in step S8 and the camera identification information of the surveillance camera 1a (step S9).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23, and acquires the zone identification information corresponding to the camera identification information received in step S9 (step S10).

In the example of FIG. 8, the control unit 21 of the server 2 receives the camera identification information “1a” of the surveillance camera 1a in step S9. Therefore, the control unit 21 of the server 2 acquires the zone identification information “A” of the zone A from the table TB2 of FIG. As a result, the control unit 21 of the server 2 can identify that the face data 52 received in step S9 is taken by the surveillance camera 1a installed in the zone A. In other words, the control unit 21 of the server 2 can identify the person with the face of the face data 52 received in step S9 as being in the zone A.

When the zone is specified in step S10, the control unit 21 of the server 2 refers to the table TB1 of the registration DB and acquires the face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB2 with the face data received in step S9 (step S11).

In the example of FIG. 8, the control unit 21 of the server 2 specifies in step S10 that the person with the face of the face data 52 is in the zone A. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A shown in FIG. 6 with the face data 52 received in step S9. Since the face data 52 does not match the face data 41ba and 41bb corresponding to the zone A shown in FIG. 6, the control unit 21 of the server 2 determines that the face matching does not match. That is, the control unit 21 of the server 2 determines that the person with the face data 52 is not permitted to enter the zone A.

The control unit 21 of the server 2 transmits the collation result (face collation NG) of step S11 to the terminal device 3 (step S12). The control unit 31 of the terminal device 3 receives the collation result of the face collation NG and displays an alert on the display device, for example. The control unit 21 of the server 2 may transmit the collation result of step S11 to, for example, an audio output device such as a speaker installed in the zone A. When the audio output device installed in the zone A receives the collation result in step S11, it may output a warning sound or the like.

As described above, the communication unit 22 of the server 2 receives the face image data from the plurality of cameras 1a to 1d that capture the plurality of zones A to C of the building A1. The control unit 21 collates the face image data received by the communication unit 22 with the registered face image data of the person who is permitted to enter the zone, and the face image data in the zone in which the person of the face image data is photographed is collated. Judge the permission and denial of entry of the person. As a result, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

Further, the server 2 collects the images of the plurality of surveillance cameras 1a to 1d and determines the entry of each zone of the building A1. As a result, the user who uses the surveillance camera system only needs to set the entry of people in each zone of the building A1 to the server 2, and the zone setting becomes easy.

(Modification example)
In the above, the surveillance cameras 1a to 1d cut out the human face and transmit the face data to the server 2, but the present invention is not limited to this. The surveillance cameras 1a to 1d may transmit the video data of the zone to the server 2, and the server 2 may detect a human face and cut it out. In this case, the video data transmitted from the surveillance cameras 1a to 1d to the server 2 may be considered to include face data.

(Second Embodiment)
In the second embodiment, the time when a person may enter the zone is also determined. Hereinafter, a part different from the first embodiment will be described.

FIG. 9 is a diagram showing an example of a table stored in the storage unit 23 of the server 2 according to the second embodiment. The table TB11 shown in FIG. 9 is stored in the storage unit 23 of the server 2, for example, when the surveillance cameras 1a to 1c are installed in the building A1. The table TB11 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2. The information in the table TB11 may be added, changed, or deleted by, for example, the terminal device 3.

The table TB11 has zone identification information 41a and face data 41b, similarly to the table TB1 described with reference to FIG. The table TB11 may be said to indicate the person who is allowed to enter the room for each zone and the information indicating the time during which the person may stay in the zone. For example, the time shown in the table TB11 indicates the time when the person in the face data 41b in the row at that time can enter the zone indicated by the zone identification information 41a in the column of that time.

More specifically, the person with the face of the face data 41ba in FIG. 9 can enter the zone A between 9:00 and 19:00. The person with the face of the face data 41ba in FIG. 9 can enter the zone B between 13:00 and 17:00. The person with the face of the face data 41bb in FIG. 9 can enter the zone A between 9:00 and 19:00. The person with the face of the face data 41bb in FIG. 9 cannot enter the zone B all day long. A person with a face of face data 41bc in FIG. 9 cannot enter Zone A all day long. A person with a face of face data 41 bc in FIG. 9 can enter zone B between 15:00 and 17:00.

In the above, the table TB11 is stored in the storage unit 23 of the server 2, but the present invention is not limited to this. The table TB11 may be stored in the registration DB.

The operation of the server 2 of the second embodiment is different from that of the first embodiment in the face matching process of step S6 described with reference to FIG. In the face matching process of step S6, the control unit 21 of the server 2 determines the time during which the person with the face data 51 received in step S4 may be in the zone.

For example, the control unit 21 of the server 2 specifies in step S5 that the person with the face of the face data 51 is in the zone A. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A shown in FIG. 9 with the face data 51 received in step S4. Since the face data 51 matches the face data 41ba corresponding to the zone A shown in FIG. 9, the control unit 21 of the server 2 may be in the zone A of the face data 41ba with the same face matching (9). : 00 to 19:00) is determined. If the current time is between 9:00 and 19:00, the control unit 21 of the server 2 determines that face matching is OK. On the other hand, the control unit 21 of the server 2 determines that the face matching is NG unless the current time is between 9:00 and 19:00.

As described above, the control unit 21 of the server 2 determines whether or not the person in the face image data is allowed to enter in the zone in which the person in the face image data is photographed with the face image data and the current time. Judgment is made using. As a result, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

(Modification example)
The face data and time registration of the person who may be in the zone may be stored in the server 2 or the registration DB by a device different from the terminal device 3.

FIG. 10 is a sequence diagram showing an operation example of the surveillance camera system in registering face data and time. The terminal device 61 shown in FIG. 10 is a terminal used by a person who reserves a facility in which a zone is set, such as a movie theater, a restaurant, a condominium, an office, or a concert hall. The person who reserves the facility uses the terminal device 61 to register the face data and the time to enter the zone of the facility. The terminal device 3 shown in FIG. 10 is managed by, for example, a manager of a facility such as a movie theater, a restaurant, a condominium, an office, or a concert hall.

The terminal device 61 may be, for example, a smart phone, a tablet terminal, a personal computer, or the like. The terminal device 61 may be equipped with an application for registering face data and time in the server 2 or the registration DB. The application may be provided by the administrator of each facility. The terminal device 61 has a block configuration similar to the block configuration shown in FIG.

Hereinafter, the sequence of FIG. 10 will be described. In FIG. 10, the surveillance cameras 1a to 1d installed in the facility are not shown.

The control unit 31 of the terminal device 3 sets the grouping of the zones A and B and the surveillance cameras 1a to 1c for the server 2 according to the operation of the operator (step S21). That is, the control unit 31 of the terminal device 3 sets the server 2 to associate the zones A and B with the surveillance cameras 1a to 1c. As a result, for example, the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2.

A person who reserves a facility in which a zone is installed (for example, a person who reserves a movie theater) has, for example, face data on a terminal device 61, the name of a person who uses the facility, and information on the zone to be used (for example, a movie is shown). Enter the reservation information such as the name of the room to be opened) and the time to enter the zone. The terminal device 61 transmits the input reservation information to the server 2 (step S22).

The control unit 21 of the server 2 performs face registration in the registration DB based on the reservation information transmitted from the terminal device 61 (step S23). That is, the control unit 21 of the server 2 generates the table TB11 shown in FIG. 9 in the registration DB. The control unit 21 of the server 2 may generate the table TB11 in the storage unit 23.

The control unit 21 of the server 2 transmits the reservation information received in step S22 to the terminal device 3 (step S24). The administrator of the terminal device 3 can grasp the reservation contents of the person who uses the facility from the reservation information received by the terminal device 3.

In this way, a person who uses the facility in which the zone is set may use the terminal device 61 to set the face data and the time to enter the zone in the server 2 or the registration DB.

For example, when a person who reserves a restaurant makes a reservation for a restaurant, the face data and the reservation time may be registered in the server 2 or the registration DB by using the terminal device 61. Zones may be set for each room serving restaurant meals.

Further, for example, the resident of the condominium may use the terminal device 61 to register the visitor's face data and the visit time in the server 2 or the registration DB. Zones may be set for each entrance of the condominium and for each floor.

Further, for example, an office worker may use the terminal device 61 to register the visitor's face data and the visit time in the server 2 or the registration DB. Zones may be set per office entrance, per floor, or per room.

Further, for example, when a person who reserves a concert reserves a ticket for the concert, the terminal device 61 may be used to set face data, a time to watch the concert, and the like in the server 2 or the registration DB. Zones may be set for each class of seats in the concert hall and for each box.

(Third Embodiment)
In companies, etc., employees may be able to distinguish the zones in which they can enter depending on the card they have. For example, one employee can enter a room by holding a card over a card reader provided at the entrance of a room, but another employee can enter a room by holding the card over a card reader. I can't enter the room. In the third embodiment, face data is registered using the card information of such a card.

FIG. 11 is a diagram showing an example of the surveillance camera system according to the third embodiment. In FIG. 11, the same ones as those in FIG. 1 are designated by the same reference numerals. In FIG. 11, the illustration of the building A1 is omitted.

The surveillance camera system of FIG. 11 has card readers 71a to 71c with respect to the surveillance camera system shown in FIG.

The card reader 71a is installed next to the entrance door of the zone A, for example. The zone identification information of the zone A is associated with the card reader 71a.

The card reader 71b is installed next to the entrance door of the zone B, for example. The zone identification information of the zone B is associated with the card reader 71b.

The card reader 71c is installed next to the entrance door of the zone C, for example. Zone identification information of zone C is associated with the card reader 71c.

The card reader 71a, for example, performs short-range wireless communication with a card possessed by an employee. The card reader 71a reads information from the card held over the card reader 71a, and determines whether or not the person holding the card is an employee who can enter the zone A. Similar to the card reader 71a, the card readers 71b and 71c also read information from the card held over and determine whether or not the person holding the card is an employee who can enter the zones B and C.

When the card reader 71a determines from the read card information that the person holding the card can enter the zone A, the card reader 71a unlocks the entrance door of the zone A. On the other hand, if the card reader 71a determines from the read card information that the person holding the card cannot enter the zone A, the card reader 71a does not unlock the entrance door of the zone A. Similar to the card reader 71a, the card readers 71b and 71c also control the unlocking of the entrance doors of the zones B and C from the read card information.

A photograph of the employee's face is attached to the card possessed by the employee. The card reader 71a includes a camera. When unlocking the entrance door of Zone A, the card reader 71a takes a face photograph of an employee attached to the card by a camera (acquires a still image of the face photograph). Then, the card reader 71a transmits the face data of the photographed face photograph and the zone identification information of the zone A to the server 2. That is, when the person who holds the card can enter the zone A by using the card, the face photograph attached to the card and the zone identification information of the zone A are linked and transmitted to the server 2.

Like the card reader 71a, the card readers 71b and 71b also have a camera. When unlocking the entrance doors of zones B and C, the card readers 71b and 71c take a photograph of the employee's face attached to the card by a camera. Then, the card readers 71b and 71c transmit the face data of the photographed face photograph and the zone identification information of the zones B and C to the server 2.

FIG. 12 is a diagram showing a block configuration example of the card reader 71a. As shown in FIG. 12, the card reader 71a includes an imaging unit 81, a control unit 82, a card communication unit 83, a communication unit 84, and a storage unit 85.

The image pickup unit 81 includes, for example, a lens and an image pickup device (not shown). The lens of the image pickup unit 81 forms an image of the subject on the light receiving surface of the image pickup device. As the lens, lenses having various focal lengths or shooting ranges can be used depending on the installation location of the card reader 71a, the shooting application, and the like.

The image sensor of the image pickup unit 81 converts the light received on the light receiving surface into an electric signal. The image sensor is, for example, an image sensor such as a CCD or CMOS. The image pickup unit 81 converts an electric signal (analog signal) corresponding to the light received on the light receiving surface of the image pickup element into a digital signal, and outputs the digital signal to the control unit 82.

The control unit 82 controls the entire card reader 71a. The control unit 82 may be configured by, for example, a CPU or a DSP. The control unit 82 determines a human face from the image output from the image pickup unit 81. The control unit 82 cuts out the face of the determined person, and transmits the face data (still image) of the cut out face to the server 2 via the communication unit 84.

The card communication unit 83 performs short-range wireless communication with the card held over the card reader 71a.

The communication unit 84 communicates with the server 2. The communication unit 84 may communicate with the server 2 via a network cable such as an Ethernet cable. Further, the communication unit 84 may communicate with the server 2 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 85 stores a program for operating the control unit 82. Further, the storage unit 85 stores data for the control unit 82 to perform calculation processing, data for the control unit 82 to control each unit, and the like. The storage unit 85 may be composed of a storage device such as a RAM, a ROM, a flash memory, and an HDD.

In the following, for the sake of simplicity, the detection of occupants in Zone A and Zone B will be described.

FIG. 13 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. The table TB21 has zone identification information 41a and face data 41b, similarly to the table TB1 described with reference to FIG.

The table TB21 shown in FIG. 13 is generated based on the face data transmitted from the card readers 71a to 71c and the zone identification information. As described above, the face data and the zone identification information are transmitted from the card readers 71a to 71c when a person can enter the zones A and B. Therefore, the table TB21 can be said to be information indicating a person who has been able to enter the zones A and B.

For example, suppose a person enters Zone A with a card with a face photo of face data 41ba. In this case, the server 2 receives the face data 41ba and the zone identification information A from the card reader 71a provided at the entrance of the zone A. As a result, the information shown in the dotted line frame A11 is registered in the table TB21 of FIG.

Further, it is assumed that a person enters the zone A by a card with a face photograph of face data 41bb. In this case, the server 2 receives the face data 41bb and the zone identification information A from the card reader 71a provided at the entrance of the zone A. As a result, the information shown in the dotted line frame A12 is registered in the table TB21 of FIG.

Further, it is assumed that a person enters the zone B by a card with a face photograph of face data 41bc. In this case, the server 2 receives the face data 41bc and the zone identification information B from the card reader 71b provided at the entrance of the zone B. As a result, the information shown in the dotted line frame A13 is registered in the table TB21 of FIG.

In FIG. 13, the table TB21 is stored in the storage unit 23 of the server 2, but the present invention is not limited to this. The table TB21 may be stored in the registration DB. In the following, it is assumed that the table TB21 is stored in the registration DB.

FIG. 14 is a sequence diagram showing an operation example of the surveillance camera system. In FIG. 14, it is assumed that the grouping setting between the zones A and B and the cameras 1a to 1c (for example, the process of step S1 in FIG. 8) is completed. That is, it is assumed that the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2. In FIG. 14, the description of the processing of the surveillance cameras 1b and 1c and the card reader 71b installed in the zone B will be omitted.

The card reader 71a acquires the card information of the card held over. Based on the acquired card information, the card reader 71a unlocks the entrance door of zone A and photographs the card held over. The control unit 82 of the card reader 71a cuts out the face photo attached to the card from the photographed card, and transmits the face data of the cut out face photo and the zone identification information of the zone A to the server 2 (step). S31).

The control unit 21 of the server 2 performs face registration in the registration DB based on the information transmitted in step S31 (step S32). For example, the control unit 21 of the server 2 registers the information of the dotted line frame A11 shown in FIG. 13 in the table TB21 of the registration DB.

Here, it is assumed that the card held over the card reader 71a in step S31 is a stolen card. For example, it is assumed that the person with the face of the face data 91 shown in FIG. 14 impersonates the person with the face of the face data 92 shown in FIG. 14 and enters the zone A using a theft card.

It is assumed that the imaging unit 11 of the surveillance camera 1a in zone A has photographed a person (a person with a face in face data 91). The control unit 12 of the surveillance camera 1a cuts out a human face from the image captured by the imaging unit 11, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 1a to the server 2 (step S33). ).

The control unit 21 of the server 2 receives the face data transmitted in step S33 and the camera identification information of the surveillance camera 1a (step S34).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23, and acquires the zone identification information corresponding to the camera identification information received in step S34 (step S35).

In the example of FIG. 14, the control unit 21 of the server 2 receives the camera identification information “1a” of the surveillance camera 1a in step S33. Therefore, the control unit 21 of the server 2 acquires the zone identification information “A” of the zone A from the table TB2 of FIG. As a result, the control unit 21 of the server 2 can identify that the face data 91 received in step S34 is taken by the surveillance camera 1a installed in the zone A. In other words, the control unit 21 of the server 2 can identify the person with the face of the face data 91 received in step S34 as being in the zone A.

When the zone is specified in step S35, the control unit 21 of the server 2 refers to the table TB21 of the registration DB and acquires the face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB21 with the face data received in step S34 (step S36).

In the example of FIG. 14, the control unit 21 of the server 2 specifies in step S35 that the person with the face of the face data 91 is in the zone A. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A of the table TB21 shown in FIG. 13 with the face data 91 received in step S34. Since the face data 91 does not match the face data 41ba and 41bb corresponding to the zone A shown in FIG. 13, the control unit 21 of the server 2 determines that the face matching does not match. That is, the control unit 21 of the server 2 determines that the person with the face data 91 is not permitted to enter the zone A.

The control unit 21 of the server 2 transmits the collation result of step S36 to the terminal device 3 (step S37). The control unit 31 of the terminal device 3 receives the collation result of the face collation NG and displays an alert on the display device, for example.

As described above, the communication unit 22 of the server 2 receives the facial image data of the facial photograph attached to the card from the card readers 71a to 71c provided corresponding to each of the plurality of zones A to C. .. The control unit 21 of the server 2 stores the received face image data as the face data of the table TB21. As a result, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

(Modification example 1)
The card readers 71a to 71c are supposed to take a face photograph attached to the card and transmit the face data of the face photograph to the server 2, but the present invention is not limited to this. For example, the card may be equipped with an IC (Integrated Circuit). The face data of the employee who holds the card may be stored in the IC. The card readers 71a to 71c may acquire face data from the IC mounted on the card and transmit it to the server 2.

(Modification 2)
The card readers 71a to 71c may transmit the name read from the card or the card identification information of the card to the server 2. When the control unit 21 of the server 2 receives the name or card identification information transmitted from the card readers 71a to 71c, the control unit 21 may receive the face data corresponding to the name or card identification information from the server that manages the card information. .. Then, the control unit 21 of the server 2 may generate the table TB21 shown in FIG. 13 based on the received face data and the zone identification information received from the card readers 71a to 71c. The server that manages the card information stores the face data of the person who holds the card in association with the name or the card identification information.

(Modification example 3)
Surveillance camera systems including card readers 71a to 71c have been described as examples of being installed in a company, but are not limited thereto. Surveillance camera systems including card readers 71a to 71c may be installed in condominiums, commercial facilities, and the like.

(Fourth Embodiment)
In the fourth embodiment, a case where the conditions for on-site monitoring of people are different for each zone will be described. For example, a surveillance camera system uses a blacklist method to determine the entry of people in one zone and a whitelist method to determine the entry of people in another zone.

FIG. 15 is a diagram showing an example of the surveillance camera system according to the fourth embodiment. As shown in FIG. 15, the surveillance camera system includes surveillance cameras 101a, 101b, a server 102, a terminal device 103, and alarm devices 104a, 104b, 105a, 105b. FIG. 15 shows a plan view of the inside of the building A101 in addition to the surveillance camera system.

Building A101 has zones A and B. Zones A and B are adjacent to each other. The building A101 has, for example, an entrance A102a for entering the zone A from outside the building A101 and an entrance A102b for entering the zone B via the zone A. Zone B can be entered by passing through Zone A.

Building A101 is, for example, a store such as a supermarket or a convenience store. Zone A of building A101 is, for example, a sales floor for goods. Zone B is, for example, a backyard for storing inventory or processing goods.

The surveillance camera 101a is installed in the zone A of the building A101. The surveillance camera 101b is installed in zone B of the building A101.

Surveillance cameras 101a and 101b are installed in building A101 so as to photograph people in zones A and B. For example, the surveillance camera 101a is installed on the ceiling or wall of the zone A so as to capture the entire zone A. The surveillance camera 101b is installed on the ceiling or wall of the zone B so as to photograph the entire zone B.

The server 102 is connected to the surveillance cameras 101a and 101b by, for example, a network such as a LAN or the Internet. The server 102 may be installed in the building A101, or may be installed in a place different from the building A101.

The server 102 stores (registers) the face data of a person who cannot enter the zone A and the face data of a person who can enter the zone B. In other words, the server 102 has a blacklist of people who cannot enter zone A and a whitelist of people who can enter zone B. The server 102 collates the face data of the person photographed by the surveillance cameras 101a and 101b with the registered face data. The server 102 transmits the collation result to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

The terminal device 103 is connected to the server 102 by a network such as a LAN or the Internet. The terminal device 103 may be installed in the building A101, or may be installed in a place different from the building A101. The terminal device 103 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

The alarm devices 104a and 104b receive the alarm signal output from the server 102. The alarm devices 104a and 104b are, for example, alarm lamps. The alarm devices 104a and 104b emit light when the alarm signal is received. The alarm device 104a is installed in zone A, and the alarm device 104b is installed in zone B.

The alarm devices 105a and 105b receive the alarm signal output from the server 102 by wireless communication. The alarm devices 105a and 105b are, for example, portable alarm devices owned by the staff of the building A101. The alarm devices 105a and 105b vibrate when they receive an alarm signal. Further, the alarm devices 105a and 105b may output light emission or sound when receiving the alarm signal. In FIG. 15, the alarm device 105a is located in zone A, and the alarm device 105b is located in zone B, but is not limited thereto. The positions of the alarm devices 105a and 105b change according to the movement of the staff possessing the alarm devices 105a and 105b.

The surveillance cameras 101a and 101b may be installed so as to photograph a person entering the zones A and B. For example, the surveillance camera 101a may be installed so as to photograph the vicinity of the entrance A102a of the zone A. The surveillance camera 101b may be installed so as to photograph the vicinity of the entrance A102b of the zone B.

Further, a plurality of surveillance cameras may be installed in each of the zones A and B. Each of the zones A and B may be installed so as to photograph a person in the zones A and B by a plurality of surveillance cameras.

Further, as the surveillance cameras 101a and 101b, the surveillance cameras already installed in the zones A and B may be used. For example, for the surveillance cameras 101a and 101b, surveillance cameras already installed in the zones A and B may be used as a part of the recording system for recording the images in the zones A and B. In this case, the outputs of the surveillance cameras 101a and 101b may be branched to the recording system and the server 102.

Also, the number of zones is not limited to two. The number of zones may be 3 or more. Surveillance cameras installed in each of the three or more zones are connected to the server 102. The server 102 uses either the blacklist or the whitelist in each of the three or more zones to determine the entry of a person into the zone.

Further, the surveillance camera system may include a recorder that records video data captured by the surveillance cameras 101a and 101b. The surveillance camera system may include a monitoring device that displays video data captured by the surveillance cameras 101a and 101b in real time. The monitoring device may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Further, the surveillance cameras 101a and 101b have the same configuration as the surveillance cameras 1a described with reference to FIG. 3, and the description thereof will be omitted. The server 102 has the same configuration as the server 2 described with reference to FIG. 4, and the description thereof will be omitted. The terminal device 103 has the same configuration as the terminal device 3 described with reference to FIG. 5, and the description thereof will be omitted.

Hereinafter, the building A101 will be described as a store.

FIG. 16 is a diagram illustrating a schematic operation of the surveillance camera system. In FIG. 16, the same ones as in FIG. 15 are designated by the same reference numerals. FIG. 16 shows human face data 111-113.

The face data 111 is, for example, face data of a person who is suspected of having shoplifted before or a person of caution such as a person who has shoplifted. When the caution person enters the zone A, which is the product sales floor, the terminal device 103 and the alarm devices 104a, 104b, 105a, and 105b are notified (alarm signals are output). Thereby, for example, the employee of the store can recognize that the attention person has appeared in the zone A which is the product sales floor, and can monitor the attention person. Even if the caution person enters the zone B, which is the backyard, the terminal device 103 and the alarm devices 104a, 104b, 105a, and 105b are notified.

The face data 112 is face data of a trader who deals with a store. Even if the trader enters the zone A, which is the product sales floor, the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b are not notified, but when the trader enters the backyard zone B, the terminal device 103 and the alarm devices 104a, 104b, Notified to 105a and 105b. Thereby, for example, the employee of the store can recognize that the trader has appeared in the zone B which is the backyard, and can inform the trader that the zone B is off limits to anyone other than the persons concerned.

The face data 113 is an employee of the store. Even if an employee enters zone A, which is a product sales floor, and zone B, which is a backyard, the terminal device 103 and the alarm devices 104a, 104b, 105a, and 105b are not notified. That is, the employee can move freely between Zone A and Zone B.

In the zone A, which is the sales floor, the server 102 determines the entry of a specific person into the zone A by using the blacklist.

For example, the face data 111 of the attention person is registered in the blacklist. Therefore, when the attention person registered in the blacklist is photographed by the surveillance camera 101a, the face data of the attention person photographed by the surveillance camera 101a matches the face data 111 registered in the blacklist. The server 102 outputs an alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

The server 102 determines the entry of a specific person into the zone B by using the white list in the zone B which is the backyard.

For example, the employee face data 113 is registered in the white list. Therefore, when a person other than the employee who is not registered in the white list is photographed by the surveillance camera 101b, the face data of the person photographed by the surveillance camera 101b and the face of the employee registered in the white list. Since the data 113 does not match, the server 102 outputs an alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

That is, when a person registered in the blacklist appears in the zone A, the server 102 outputs an alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b. Further, when a person who is not registered in the white list appears in the zone B, the server 102 outputs an alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

FIG. 17 is a diagram showing an example of a table stored in the storage unit of the server 102. The table TB101 shown in FIG. 17 is stored in the storage unit of the server 102, for example, when the surveillance cameras 101a and 101b are installed in the building A101. The table TB 101 may be created by the terminal device 103 and stored in the storage unit of the server 102. Further, the information in the table TB 101 may be added, changed, or deleted by the terminal device 103, for example.

The table TB101 has zone identification information 121a and camera identification information 121b. The zone identification information 121a is identification information that identifies the zones A and B. For example, "A" of the zone identification information 121a indicates the identification information of the zone A. “B” of the zone identification information 121a indicates the identification information of the zone B.

The camera identification information 121b is identification information for identifying the surveillance cameras 101a and 101b. For example, "101a" of the camera identification information 121b indicates the identification information of the surveillance camera 101a. “101b” of the camera identification information 121b indicates the identification information of the surveillance camera 101b.

The table TB101 may be regarded as information indicating the installation location in the zones of the surveillance cameras 101a and 101b. For example, it is shown that the surveillance camera 101a of the camera identification information “101a” shown in FIG. 17 is installed in the zone A. It is shown that the surveillance camera 101b of the camera identification information “101b” shown in FIG. 17 is installed in the zone B.

FIG. 18 is a diagram showing an example of a table stored in the storage unit of the server 102. The table TB 102 shown in FIG. 18 is stored in the storage unit of the server 102, for example, when the surveillance cameras 101a and 101b are installed in the building A101. The table TB 102 may be created by the terminal device 103 and stored in the storage unit of the server 102. Further, the information in the table TB 102 may be added, changed, or deleted by the terminal device 103, for example.

The table TB102 has zone identification information 131a, list information 131b, and face data 131c. The zone identification information 131a is identification information for identifying zones A and B. For example, "A" of the zone identification information 131a indicates the identification information of the zone A. “B” of the zone identification information 131a indicates the identification information of the zone B.

The list information 131b is information indicating a determination type in the corresponding zone. BL shown in FIG. 18 indicates that the entry of the corresponding zone is determined by the blacklist method. WL indicates that the entry of the corresponding zone is determined by the white list method.

For example, in the case of the example of FIG. 18, the list information 131b of the zone A is “BL”. Therefore, in zone A, the entry of people is determined by the blacklist method. Further, the list information 131b of the zone B is "WL". Therefore, in zone B, the entry of people is determined by the white list method.

The face data 131c is human face data. The face data 132a corresponds to, for example, the face data 113 described with reference to FIG. 16, and is the face data of an employee. The face data 132b corresponds to, for example, the face data 111 described with reference to FIG. 16, and is the face data of the attention person.

The table TB102 may be regarded as a table that defines whether the person in the face data is determined by the blacklist method or the whitelist method for each zone.

For example, the person in the face data 132a of the table TB102 has a circle in the zone B (white list). Therefore, the person with the face data 132a does not output the alarm signal even if he / she enters the zone B. On the other hand, a person whose column B in FIG. 18 is not circled and a person whose face data is not registered in the table TB102 outputs an alarm signal when he / she enters zone B.

In addition, the person in the face data 132b of the table TB102 is circled in the zone A (blacklist). Therefore, when the person with the face data 132b enters the zone A, an alarm signal is output. On the other hand, a person whose column A in FIG. 18 is not circled and a person whose face data is not registered in the table TB102 do not output an alarm signal even if he / she enters zone A.

In addition, "a person is registered in the blacklist" means that the face data of the person is registered in the table TB102 and the information (circle in FIG. 18) is registered in the blacklist column of the list information 131b. You may. Further, "a person is registered in the white list" means that the face data of the person is registered in the table TB102 and the information (circle in FIG. 18) is registered in the white list column of the list information 131b. You may.

In FIGS. 17 and 18, the tables TB101 and TB102 are stored in the storage unit of the server 102, but the present invention is not limited to this. Both or one of the table TB101 and the table TB102 may be stored in a database separate from the server 102. The separate database may be regarded as a part of the server 102. In the following, the tables TB101 and TB102 are stored in the registration DB.

FIG. 19 is a sequence diagram showing an operation example of the surveillance camera system. The control unit of the terminal device 103 links the zones A and B with the surveillance cameras 101a and 101b to the registration DB via the server 102, for example, in response to an operation of an operator such as a store employee. (Steps S41 and S42). Further, the control unit of the terminal device 103 links the zones A and B with the blacklist and the whitelist to the registration DB via the server 102 in response to the operation of the operator (steps S41 and S42). ).

That is, the control unit of the terminal device 103 sets the association between the zones A and B and the surveillance cameras 101a and 101b in the registration DB. As a result, for example, the table TB102 shown in FIG. 17 is stored in the registration DB. Further, the control unit of the terminal device 103 sets the association between the zones A and B with the blacklist and the whitelist in the registration DB. As a result, for example, the zone identification information 131a and the list information 131b of the table TB102 shown in FIG. 18 are stored in the registration DB.

The control unit of the terminal device 103 registers the face data in the registration DB via the server 102 in response to the operation of the operator (steps S43 and S44). As a result, for example, the face data 131c of the table TB102 shown in FIG. 18 is stored in the registration DB.

The control unit of the terminal device 103 links the face data registered in the registration DB with the zone via the server 102 according to the operation of the operator (steps S45 and S46). For example, the control unit of the terminal device 103 associates the face data 132b registered in the registration DB with the zone A (blacklist). Further, the control unit of the terminal device 103 associates the face data 132a registered in the registration DB with the zone B (white list). As a result, in the registration DB, for example, information regarding the circles and bars of the table TB102 shown in FIG. 18 is stored.

It is assumed that the imaging unit of the surveillance camera 101a in zone A photographs a person. The control unit of the surveillance camera 101a cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101a to the server 102 (step S47).

The control unit of the server 102 collates the face data transmitted in step S47 with the face data stored in the registration DB (step S48).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires the zone identification information corresponding to the camera identification information transmitted in step S47. In the example of FIG. 19, the camera identification information “101a” of the surveillance camera 101a is transmitted in step S47. Therefore, the control unit of the server 102 acquires the zone identification information “A” of the zone A from the table TB101 of FIG. As a result, the control unit of the server 102 can identify (determine) that the face data 141 transmitted in step S47 has been captured by the surveillance camera 101a installed in the zone A. In other words, the control unit of the server 102 can identify the person with the face of the face data 141 transmitted in step S47 as being in the zone A.

When the control unit of the server 102 specifies the zone, the control unit refers to the table TB102 of the registration DB and acquires the face data and the list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S47, and a method of list information acquired from the table TB102 (blacklist method or whitelist method). According to this, the entry of a person into zones A and B is determined.

In the example of FIG. 19, the control unit of the server 102 identifies that the person with the face of the face data 141 is in the zone A. The list information of zone A is a blacklist. Therefore, the control unit of the server 102 collates the face data 132b corresponding to the zone A of the table TB102 shown in FIG. 18 with the face data 141 transmitted in step S47. Since the face data 141 matches the face data 132b of the table TB102 shown in FIG. 18, the control unit of the server 102 determines that the face matching matches. That is, the control unit of the server 102 determines that the person with the face data 141 transmitted in step S47 is a person registered in the blacklist.

The control unit of the server 102 transmits the collation result (alarm signal of registered face detection) of step S48 to the terminal device 103 and the alarm devices 104a, 105a, 105b (step S49). When the control unit of the server 102 determines the registered face detection, the control unit transmits the face data 141 captured by the surveillance camera 101a or the face data 132b stored in the table TB 102 matching the face data 141 to the terminal device 103. .. The control unit of the terminal device 103 displays the face data 141 or the face data 132b transmitted from the server 102 on the display device.

It is assumed that the imaging unit of the surveillance camera 101a in zone A photographs a person. The control unit of the surveillance camera 101a cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101a to the server 102 (step S50).

The control unit of the server 102 collates the face data transmitted in step S50 with the face data stored in the registration DB (step S51).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires the zone identification information corresponding to the camera identification information transmitted in step S50. In the example of FIG. 19, the camera identification information “101a” of the surveillance camera 101a is transmitted in step S50. Therefore, the control unit of the server 102 acquires the zone identification information “A” of the zone A from the table TB101 of FIG. As a result, the control unit of the server 102 can identify that the face data 142 transmitted in step S50 has been captured by the surveillance camera 101a installed in the zone A. In other words, the control unit of the server 102 can identify the person with the face of the face data 142 transmitted in step S50 as being in the zone A.

When the control unit of the server 102 specifies the zone, the control unit refers to the table TB102 of the registration DB and acquires the face data and the list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S50, and moves to the zones A and B of the person according to the method of the list information acquired from the table TB102. Judge the entry of.

In the example of FIG. 19, the control unit of the server 102 identifies that the person with the face of the face data 142 is in the zone A. The list information of zone A is a blacklist. Therefore, the control unit of the server 102 collates the face data 132b corresponding to the zone A of the table TB102 shown in FIG. 18 with the face data 142 transmitted in step S50. Since the face data 142 does not match the face data 132b of the table TB102 shown in FIG. 18, the control unit of the server 102 determines that the face matching does not match. That is, the control unit of the server 102 determines that the person with the face data 142 is not registered in the blacklist.

Since the person with face data 142 is not registered in the blacklist, the control unit of the server 102 does not transmit the alarm signal to the terminal device 103 and the alarm devices 104a, 105a, 105b.

It is assumed that the imaging unit of the surveillance camera 101b in zone B has photographed a person. The control unit of the surveillance camera 101b cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101b to the server 102 (step S52).

The control unit of the server 102 collates the face data transmitted in step S52 with the face data stored in the registration DB (step S53).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires the zone identification information corresponding to the camera identification information transmitted in step S52. In the example of FIG. 19, the camera identification information “101b” of the surveillance camera 101b is transmitted in step S52. Therefore, the control unit of the server 102 acquires the zone identification information “B” of the zone B from the table TB101 of FIG. As a result, the control unit of the server 102 can identify that the face data 143 transmitted in step S52 was taken by the surveillance camera 101b installed in the zone B. In other words, the control unit of the server 102 can identify the person with the face of the face data 143 transmitted in step S52 as being in the zone B.

When the control unit of the server 102 specifies the zone, the control unit refers to the table TB102 of the registration DB and acquires the face data and the list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S52, and moves to the zones A and B of the person according to the method of the list information acquired from the table TB102. Judge the entry of.

In the example of FIG. 19, the control unit of the server 102 identifies that the person with the face of the face data 143 is in the zone B. The list information of zone B is a white list. Therefore, the control unit of the server 102 collates the face data 132b corresponding to the zone B of the table TB102 shown in FIG. 18 with the face data 143 transmitted in step S52. Since the face data 143 does not match the face data 132a of the table TB102 shown in FIG. 18, the control unit of the server 102 determines that the face matching does not match. That is, the control unit of the server 102 determines that the person with the face data 143 is a person who is not registered in the white list.

The control unit of the server 102 transmits the collation result (alarm signal for unregistered face detection) of step S53 to the terminal device 103 and the alarm devices 104a, 105a, 105b (step S54). When the control unit of the server 102 determines the unregistered face detection, the control unit transmits the face data 143 captured by the surveillance camera 101b to the terminal device 103. The control unit of the terminal device 103 displays the face data 143 transmitted from the server 102 on the display device.

It is assumed that the imaging unit of the surveillance camera 101b in zone B has photographed a person. The control unit of the surveillance camera 101b cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101b to the server 102 (step S55).

The control unit of the server 102 collates the face data transmitted in step S55 with the face data stored in the registration DB (step S56).

For example, the control unit of the server 102 refers to the table TB101 of the registration DB and acquires the zone identification information corresponding to the camera identification information transmitted in step S55. In the example of FIG. 19, the camera identification information “101b” of the surveillance camera 101b is transmitted in step S55. Therefore, the control unit of the server 102 acquires the zone identification information “B” of the zone B from the table TB101 of FIG. As a result, the control unit of the server 102 can identify that the face data 144 transmitted in step S55 is taken by the surveillance camera 101b installed in the zone B. In other words, the control unit of the server 102 can identify the person with the face of the face data 144 transmitted in step S55 as being in the zone B.

When the control unit of the server 102 specifies the zone, the control unit refers to the table TB102 of the registration DB and acquires the face data and the list information corresponding to the specified zone. Then, the control unit of the server 102 collates the face data acquired from the table TB102 with the face data transmitted in step S55, and moves to the zones A and B of the person according to the method of the list information acquired from the table TB102. Judge the entry of.

In the example of FIG. 19, the control unit of the server 102 identifies that the person with the face of the face data 144 is in the zone B. The list information of zone B is a white list. Therefore, the control unit of the server 102 collates the face data 132a corresponding to the zone B of the table TB102 shown in FIG. 18 with the face data 144 transmitted in step S55. Since the face data 144 matches the face data 132a of the table TB102 shown in FIG. 18, the control unit of the server 102 determines that the face matching matches. That is, the control unit of the server 102 determines that the person with the face data 144 is a person registered in the white list.

Since the person with face data 144 is a person registered in the white list, the control unit of the server 102 does not transmit the alarm signal to the terminal device 103 and the alarm devices 104a, 105a, 105b.

FIG. 20 is a diagram illustrating a determination method in the blacklist method. Arrows A111 to A113 in FIG. 20 show a person entering Zone A. Further, FIG. 20 shows the face data 151 registered in the zone A (blacklist) of the table TB102. Further, FIG. 20 shows face data 152 to 156 taken by the surveillance camera 101a installed in the zone A.

When the control unit of the surveillance camera 101a detects a human face, it cuts out a face image and transmits the face data of the cut out face image to the server 102. For example, when the control unit of the surveillance camera 101a detects a human face at time t, the control unit transmits the face data 152 to the server 102.

Two seconds after detecting the human face, the control unit of the surveillance camera 101a cuts out two pieces of the detected human face data and transmits the detected human face data to the server 102. For example, the control unit of the surveillance camera 101a continuously cuts out two face data 153 and 154 at time t + 2, which is 2 seconds after time t, and transmits them to the server 102. 2 seconds is an example and is not limited to this number of seconds.

Further, the control unit of the surveillance camera 101a cuts out two pieces of the detected human face data 4 seconds after detecting the human face and transmits the detected human face data to the server 102. For example, the control unit of the surveillance camera 101a continuously cuts out two face data 155 and 156 at time t + 4, which is 4 seconds after time t, and transmits them to the server 102. 4 seconds is an example and is not limited to this number of seconds.

The control unit of the server 102 collates the face data transmitted by the surveillance camera 101a with the face data stored in the table TB102, and the face data transmitted by the surveillance camera 101a matches the face data stored in the table TB102. Determine whether or not to do so. At this time, the control unit of the server 102 calculates the similarity between the face data transmitted by the surveillance camera 101a and the face data stored in the table TB102, and when the calculated similarity exceeds the threshold value, the surveillance camera 101a It is determined that the face data transmitted by the user matches the face data stored in the table TB102.

The operator may set the threshold value using the terminal device 103. The threshold value may be set based on, for example, the accuracy (roughness) of the face data registered in the table TB102. In the example of FIG. 20, the threshold is set to 1.04.

For example, the control unit of the server 102 calculates the degree of similarity between the face data 152 transmitted by the surveillance camera 101a and the face data 151 stored in the table TB 102. In the example of FIG. 20, the similarity between the face data 152 and the face data 151 is 0.80, which does not exceed the threshold value of 1.04. Therefore, the control unit of the server 102 determines that the face data 152 and the face data 151 do not match.

Further, the control unit of the server 102 calculates the degree of similarity between the face data 153 and 154 transmitted by the surveillance camera 101a and the face data 151 stored in the table TB 102. In the example of FIG. 20, the similarity between the face data 153 and the face data 151 is 0.90, and does not exceed the threshold value of 1.04. Further, the degree of similarity between the face data 154 and the face data 151 is 0.95, which does not exceed the threshold value of 1.04. Therefore, the control unit of the server 102 determines that the face data 153, 154 and the face data 151 do not match.

Further, the control unit of the server 102 calculates the degree of similarity between the face data 155 transmitted by the surveillance camera 101a and the face data 151 stored in the table TB 102. In the example of FIG. 20, the degree of similarity between the face data 155 and the face data 151 is 1.15, which exceeds the threshold value of 1.04. Therefore, the control unit of the server 102 determines that the face data 155 and the face data 151 match. That is, the control unit of the server 102 determines that the person photographed by the surveillance camera 101a is a person registered in the blacklist.

In the blacklist determination, the control unit of the server 102 issues an alarm signal when the degree of similarity between the face data 155 captured by the surveillance camera 101a and the face data 151 stored in the table TB 102 exceeds the threshold value. Output.

FIG. 21 is a diagram illustrating a determination method in the white list method. Arrows A121 to A123 in FIG. 21 show a person entering Zone B. Further, FIG. 21 shows face data 161 registered in zone B (white list) of the table TB102. Further, FIG. 21 shows face data 162 to 166 taken by the surveillance camera 101b installed in the zone B.

Similar to the surveillance camera 101a, the control unit of the surveillance camera 101b cuts out the face image and transmits the face data to the server 102.

In the blacklist determination described with reference to FIG. 20, when the control unit of the server 102 receives the face data from the surveillance camera 101a, the control unit sequentially calculates the similarity, and when the calculated similarity exceeds the threshold value, the surveillance camera 101a is used. It is determined that the person in the received face data is a person registered in the blacklist.

On the other hand, in the white list determination, the control unit of the server 102 receives a certain number of face data from the surveillance camera 101b, and then whether or not the person photographed by the surveillance camera 101b is a person registered in the white list. Is determined. For example, when the control unit of the server 102 receives a series of five face data 162 to 166 (face data 162 to 166 in the same person) from the surveillance camera 101b, the control unit receives five face data 162 captured by the surveillance camera 101b. It is determined whether or not the persons up to 166 are registered in the white list.

When the control unit of the server 102 receives the five face data 162 to 166, the control unit calculates the degree of similarity between each of the received face data 162 to 166 and the face data 161 stored in the table TB 102. The control unit of the server 102 calculates the calculated average value of the similarity, and based on the calculated average value, determines whether or not the person photographed by the surveillance camera 101b is a person registered in the white list. You may.

For example, the control unit of the server 102 calculates the average values of the similarity values of 0.50, 0.30, 0.35, 0.25, and 0.25 of the face data 162 to 166 shown in FIG. 21, and the calculated averages. When the value is 1.04 or less, it may be determined that the person photographed by the surveillance camera 101b is not a person registered in the white list. The degree of similarity used to calculate the average value is not limited to five. The number of similarities used in calculating the average value may be variable, and may be set from, for example, the terminal device 103.

Further, when the median value of the calculated similarity is 1.04 or less, the control unit of the server 102 may determine that the person photographed by the surveillance camera 101b is not a person registered in the white list.

As described above, in the white list determination, the control unit of the server 102 receives a certain number of face data from the surveillance camera 101b, and then the person photographed by the surveillance camera 101b is a person registered in the white list. Judge whether or not. As a result, the control unit of the server 102 can suppress the erroneous determination of the white list determination.

For example, even when a person registered in the white list is photographed by the surveillance camera 101b, the similarity may be low in the first face data. For example, the face of the first face data 162 may be partially hidden by the door of the entrance A102b of the zone B, and the similarity may be low. In this case, an alarm signal is output even though the person is registered in the white list.

However, as described above, the control unit of the server 102 receives a certain number of face data from the surveillance camera 101b, and then whether or not the person photographed by the surveillance camera 101b is a person registered in the white list. Is determined. Therefore, the control unit of the server 102 does not output the alarm signal even if the similarity of the first face data 162 is equal to or less than the threshold value. As a result, the control unit of the server 102 can suppress the erroneous determination of the white list determination.

FIG. 22 is a sequence diagram showing an example of determination processing in the blacklist method. The control unit of the terminal device 103 registers the face data in the registration DB via the server 102 in response to the operation of the operator (steps S61 and S62). At this time, the control unit of the terminal device 103 also transmits the threshold value according to the operation of the operator. As a result, for example, the face data 131c of the table TB102 shown in FIG. 18 is stored in the registration DB. In addition, a threshold value is registered along with the face data 131c. In the following, the threshold value is 1.04.

It is assumed that the imaging unit of the surveillance camera 101a in zone A photographs a person. The control unit of the surveillance camera 101a cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101a to the server 102 (step S63).

The control unit of the server 102 collates the face data transmitted in step S63 with the face data stored in the registration DB (step S64). The method of acquiring the face data stored in the registration DB is the same as the method described in step S48 of FIG. 19, and the description thereof will be omitted.

The control unit of the server 102 calculates the score (similarity) between the face data transmitted in step S63 and the face data stored in the registration DB (step S65). Here, the score of the face data transmitted in step S63 is set to 0.80. Since the score 0.80 does not exceed the threshold value 1.04, the control unit of the server 102 does not output the alarm signal.

Two seconds after the transmission of the face data in step S63, the control unit of the surveillance camera 101a transmits two face data (steps S66 and S69).

The face data collation and score calculation (steps S67 and S68) transmitted in step S66 are the same as in steps S64 and S65, and the description thereof will be omitted. Further, the face data collation and score calculation (steps S70 and S71) transmitted in step S69 are the same as in steps S64 and S65, and the description thereof will be omitted.

Four seconds after the transmission of the face data in step S63, the control unit of the surveillance camera 101a transmits two face data (steps S72 and S76).

The control unit of the server 102 collates the face data transmitted in step S72 with the face data stored in the registration DB (step S73).

The control unit of the server 102 calculates the score (similarity) between the face data transmitted in step S72 and the face data stored in the registration DB (step S74). Here, the score of the face data transmitted in step S72 is 1.15. Since the score 1.15 exceeds the threshold value 1.04, the control unit of the server 102 determines the detection of the registered face and outputs the alarm signal of the registered face detection to the terminal device 103 (step S75).

The face data collation and score calculation (steps S77 and S78) transmitted in step S76 are the same as in steps S64 and S65, and the description thereof will be omitted.

FIG. 23 is a sequence diagram showing an example of determination processing in the white list method. The face registration process of steps S81 and S82 of FIG. 23 is the same as that of steps S61 and S62 of FIG. 22, and the description thereof will be omitted. Further, the process of transmitting face data in steps S83, S86, S89, S92, and S95 in FIG. 23 is the same as in steps S63, S66, S69, S72, and S76 in FIG. 22, and the description thereof will be omitted. However, in FIG. 23, the surveillance camera 101b installed in the zone B transmits the face data to the server 102.

The face matching process of steps S84, S87, S90, S93, and S96 of FIG. 23 is the same as that of step S64 of FIG. 22, and the description thereof will be omitted. Further, the score calculation process of steps S85, S88, S91, S94, and S97 of FIG. 23 is the same as that of step S65 of FIG. 22, and the description thereof will be omitted.

In the white list method, the control unit of the server 102 receives five face data from the surveillance camera 101b, and then determines whether or not the person with the face data captured by the surveillance camera 101b is registered in the white list. do.

Here, the scores of the face data transmitted in steps S83, S86, S89, S92, and S95 are set to 0.50, 0.30, 0.35, 0.25, 0.25. The control unit of the server 102 uses, for example, the median of the five scores to determine whether or not the person in the face data transmitted by the surveillance camera 101b is registered in the white list. In the example of FIG. 23, the median value is 0.35 and the threshold value does not exceed 1.04. Therefore, in the control unit of the server 102, the person of the face data photographed by the surveillance camera 101b is registered in the white list. Judge that there is no.

When the control unit of the server 102 determines that the person in the face data captured by the surveillance camera 101b is not registered in the white list, the control unit transmits an alarm signal for unregistered detection to the terminal device 103 (step S98).

In the sequence of FIGS. 22 and 23, the surveillance cameras 101a and 110b transmit the two face data to the server 102 2 seconds after the transmission of the first face data, and the two face data 4 seconds later. It was sent to the server 102, but it is not limited to this. The number of seconds and the number of face data to be transmitted may be variable, and may be set from, for example, the terminal device 103.

Further, the number of seconds for transmitting face data may be 3 or more. For example, the surveillance cameras 101a and 101b may transmit the face data to the server 102 three times, two seconds later, four seconds later, and six seconds later after the transmission of the first face data. The number of seconds for transmitting face data may be variable, for example, may be set from the terminal device 103.

FIG. 24 is a diagram showing a screen example of the terminal device 103 when an alarm signal is output by the blacklist method. When the alarm signal is output by the blacklist method, the image shown in FIG. 24 is displayed on the display device of the terminal device 103. As the image, a face image that exceeds the threshold value taken by the surveillance camera 101a and a face image registered in the table TB102 are displayed.

When the live button shown in FIG. 24 is clicked, the display device of the terminal device 103 displays the current image captured by the surveillance camera 101a. When the play button is clicked, the display device of the terminal device 103 reproduces the images before and after when it is determined that the person photographed by the surveillance camera 101a is registered in the blacklist.

FIG. 25 is a diagram showing a screen example of the terminal device 103 when an alarm signal is output by the white list method. When the alarm signal is output by the white list method, the image shown in FIG. 25 is displayed on the display device of the terminal device 103. As the image, a face image that does not exceed the threshold value taken by the surveillance camera 101b is displayed.

The face data of the person whose alarm signal is output by the white list method is not registered in the table TB102. Therefore, the display device of the terminal device 103 displays an image 171 indicating that a person with an unregistered face has been detected.

When the live button shown in FIG. 25 is clicked, the display device of the terminal device 103 displays the current state of shooting by the surveillance camera 101b. When the play button is clicked, the display device of the terminal device 103 reproduces the images before and after when it is determined that the person photographed by the surveillance camera 101b is not registered in the white list.

The display device of the terminal device 103 may display a face image when an alarm signal is output regardless of the blacklist method or the whitelist method.

FIG. 26 is a diagram showing a screen example of the terminal device 103 when an alarm signal is output. The display device of the terminal device 103 shown in FIG. 26 displays an image when the alarm signal is output by the blacklist method and an image when the alarm signal is output by the white list method. That is, on the display device of the terminal device 103, an image when a person registered in the blacklist appears in the sales floor area (zone A) and a person not registered in the white list in the employee area (zone B) are displayed. The image when it appears is mixed and displayed.

As described above, the server 102 has a communication unit that receives the first face data from the surveillance camera 101a installed in the zone A and the second face data from the surveillance camera 101b installed in the zone B. Further, the server 102 collates the first face data with the registered face data registered in the blacklist, determines that the registered face data registered in the blacklist has entered the zone A, and determines that the person has entered the zone A. It has a control unit that collates face data with registered face data registered in the white list and determines that a person with registered face data not registered in the white list enters zone B.

As a result, the server 102 can appropriately monitor the entry of people into the zone even if the conditions for monitoring the entry of people change in each zone. For example, the server 102 determines the entry of a person of interest using a blacklist in zone A, which is a sales floor, and uses a whitelist to determine the entry of a person other than an employee in zone B, which is a backyard. It is possible to appropriately monitor the entry of people into zones A and B.

(Modification example)
Surveillance camera systems may be used, for example, in companies or condominiums. For example, the surveillance camera system may determine the zone at the entrance of the company by using a blacklist, and may determine the zone of each department in the building by using a whitelist. Further, for example, the surveillance camera system may determine the common zone at the entrance of the condominium by using a blacklist, and may determine the zone of each floor in the building by using a whitelist.

(Fifth Embodiment)
In the fifth embodiment, when a person who is not registered in the white list enters the zone B described in the fourth embodiment, he / she enters the zone B in response to an instruction from the terminal device 103. Register the face data of a person in the white list. Further, in the fifth embodiment, when a person who is not registered in the white list enters the zone B described in the fourth embodiment, he / she enters the zone B in response to an instruction from the terminal device 103. The face data of the person is registered in the zone A blacklist.

FIG. 27 is a diagram showing an example of the surveillance camera system according to the fifth embodiment. In FIG. 27, the same ones as those in FIG. 15 are designated by the same reference numerals. FIG. 27 shows human face data 201.

The face data 201 is, for example, an employee of a store. Employees are not blacklisted because they can enter Zone A, which is the merchandise section. Employees can enter Zone B, the backyard, but are not whitelisted.

The employee of face data 201 is not blacklisted. Therefore, even if the employee of the face data 201 enters the zone A, the control unit of the server 102 does not output the alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

Employees with face data 201 are not whitelisted. Therefore, when the employee of the face data 201 enters the zone B, the control unit of the server 102 outputs the alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b. Further, the control unit of the server 102 outputs the face data 201 captured by the surveillance camera 101b to the terminal device 103.

When the terminal device 103 receives the alarm signal and the face data 201 captured by the surveillance camera 101b, the terminal device 103 displays the image of the received face data 201 on the display device. The operator who operates the terminal device 103 operates the terminal device 103 when it is confirmed that the person of the face data 201 displayed on the display device of the terminal device 103 is, for example, an employee who can enter the zone B. Then, the server 102 is instructed to register the employee face data 201 in the white list.

The control unit of the server 102 registers the face data 201 displayed on the display device of the terminal device 103 in the white list in response to the registration instruction from the terminal device 103. That is, the control unit of the server 102 registers the employee face data 201 that triggered the transmission of the alarm signal in the white list. As a result, the control unit of the server 102 does not output an alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b even if the employee of the face data 201 next enters the zone B.

By the above processing of the surveillance camera system, the operator of the terminal device 103 can obtain the face data 201 taken by the surveillance camera 101b without receiving the employee's face data that can enter the zone B, for example, from the employee. Can be easily whitelisted using. Further, the employee does not have to photograph the face of the employee and transmit the photographed face data to the terminal device 103.

The face data 201 is not initially registered in the white list. Therefore, until the face data 201 is registered in the white list by the terminal device 103, the alarm signal is transmitted from the server 102 to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

FIG. 28 is a diagram showing an example of the surveillance camera system according to the fifth embodiment. In FIG. 28, the same ones as those in FIG. 15 are designated by the same reference numerals. FIG. 28 shows human face data 202.

The face data 202 is, for example, face data of a person who has visited the store. It is assumed that the visitor is not registered in the blacklist and whitelist of the server 102.

Visitors to face data 202 are not blacklisted. Therefore, even if the visitor of the face data 202 enters the zone A, the control unit of the server 102 does not output the alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b.

The visitor of the face data 202 is not registered in the white list. Therefore, when the employee of the face data 202 enters the zone B, the control unit of the server 102 outputs the alarm signal to the terminal device 103 and the alarm devices 104a, 104b, 105a, 105b. Further, the control unit of the server 102 outputs the face data 202 captured by the surveillance camera 101b to the terminal device 103.

When the terminal device 103 receives the alarm signal and the face data 202 captured by the surveillance camera 101b, the terminal device 103 displays the image of the received face data 202 on the display device. The operator who operates the terminal device 103 operates the terminal device 103 when it is confirmed that the person of the face data 202 displayed on the display device of the terminal device 103 is not an employee who can enter the zone B, for example. Then, the server 102 is instructed to register the visitor's face data 202 in the black list.

The control unit of the server 102 registers the face data 202 displayed on the display device of the terminal device 103 in the blacklist in response to the registration instruction from the terminal device 103. That is, the control unit of the server 102 registers the face data 202 of the visitor who triggered the transmission of the alarm signal in the blacklist. As a result, when a visitor who has entered the zone B, which is not accessible to anyone other than the persons concerned, returns to the store and enters the zone A, for example, the control unit of the server 102 sets the terminal device 103 and the alarm devices 104a, 104b, 105a, An alarm signal is output to 105b. Store employees can monitor visitors who enter Zone B, which is only accessible to those involved.

By the above processing of the surveillance camera system, the operator of the terminal device 103 can obtain the face data 202 captured by the surveillance camera 101b without receiving the face data of the person who wants to monitor the entry of the zone A from, for example, an employee or the like. Can be easily blacklisted using. Further, the employee does not have to photograph the face of the person who wants to monitor the entry into the zone A and transmit the photographed face data to the terminal device 103.

FIG. 29 is a sequence diagram showing an operation example of the surveillance camera system. FIG. 29 is a sequence diagram corresponding to the white list registration described with reference to FIG. 27. The processing of steps S101 to S106 shown in FIG. 29 is the same as that of steps S41 to S46 described with reference to FIG. 19, and the description thereof will be omitted.

It is assumed that the imaging unit of the surveillance camera 101b in zone B has photographed an employee. It is assumed that the employee is, for example, the employee who visits the store of the building A101 for the first time and is not registered in the white list. The control unit of the surveillance camera 101b cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101b to the server 102 (step S107).

The control unit of the server 102 collates the face data 206 transmitted in step S107 with the face data stored in the registration DB (step S108). The face data collation method is the same as the method described in step S53 of FIG. 19, and the description thereof will be omitted. Since the employee of the face data 206 is not registered in the white list, the control unit of the server 102 determines that the face data 206 is not registered in the white list (unregistered face detection).

The control unit of the server 102 transmits the collation result (alarm signal for unregistered face detection) in step S108 to the terminal device 103 and the alarm devices 104a, 105a, 105b (step S109). When the control unit of the server 102 determines the unregistered face detection, the control unit transmits the face data 206 captured by the surveillance camera 101b to the terminal device 103. The control unit of the terminal device 103 displays the face data 206 transmitted from the server 102 on the display device.

When the control unit of the terminal device 103 receives the operation of registering the face data 206 in the white list from the operator, the control unit transmits the face registration instruction to the server 102 (step S110).

The control unit of the server 102 registers the face data 206 that triggered the transmission of the alarm signal in step S109 in the table TB102 of the registration DB in response to the reception of the face registration instruction transmitted in step S110 (step S111). ..

It is assumed that the imaging unit of the surveillance camera 101b in zone B has photographed an employee. The employee is an employee registered in the white list by the face registration process in step S111. The control unit of the surveillance camera 101b cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101b to the server 102 (step S112).

The control unit of the server 102 collates the face data 207 transmitted in step S112 with the face data stored in the registration DB (step S113). The face data 207 matches the face data 206 registered in the table TB102 of the registration DB in step S111. Therefore, the control unit of the server 102 determines that the employee of the face data 207 is a person registered in the white list.

FIG. 30 is a sequence diagram showing an operation example of the surveillance camera system. FIG. 30 is a sequence diagram corresponding to the blacklist registration described with reference to FIG. 28. The processing of steps S121 to S126 shown in FIG. 30 is the same as that of steps S41 to S46 described with reference to FIG. 19, and the description thereof will be omitted.

It is assumed that the imaging unit of the surveillance camera 101b in zone B has photographed a visitor. Visitors are not blacklisted or whitelisted. The control unit of the surveillance camera 101b cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101b to the server 102 (step S127).

The control unit of the server 102 collates the face data 208 transmitted in step S127 with the face data stored in the registration DB (step S128). The face data collation method is the same as the method described in step S53 of FIG. 19, and the description thereof will be omitted. Since the visitor of the face data 208 is not registered in the white list, the control unit of the server 102 determines that the face data 208 is not registered in the white list (unregistered face detection).

The control unit of the server 102 transmits the collation result (alarm signal for unregistered face detection) in step S128 to the terminal device 103 and the alarm devices 104a, 105a, 105b (step S129). When the control unit of the server 102 determines that the unregistered face has been detected, the control unit transmits the face data 208 captured by the surveillance camera 101b to the terminal device 103. The control unit of the terminal device 103 displays the face data 208 transmitted from the server 102 on the display device.

When the control unit of the terminal device 103 receives the operation of registering the face data 208 in the blacklist from the operator, the control unit transmits the face registration instruction to the server 102 (step S130).

The control unit of the server 102 registers the face data 208 that triggered the transmission of the alarm signal in step S129 in the table TB102 of the registration DB in response to the reception of the face registration instruction transmitted in step S130 (step S131). ..

It is assumed that the imaging unit of the surveillance camera 101a in zone A has photographed a visitor. The visitor is a visitor registered in the blacklist by the face registration process in step S131. The control unit of the surveillance camera 101a cuts out a human face from the image captured by the imaging unit, and transmits the face data of the cut out face and the camera identification information of the surveillance camera 101a to the server 102 (step S132).

The control unit of the server 102 collates the face data 209 transmitted in step S132 with the face data stored in the registration DB (step S133). The face data 209 matches the face data 208 registered in the table TB102 of the registration DB in step S131. Therefore, the control unit of the server 102 determines that the visitor of the face data 209 is a person registered in the blacklist. The control unit of the server 102 transmits the collation result (alarm signal of suspicious person notification) in step S133 to the terminal device 103 and the alarm devices 104a, 105a, 105b (step S134).

As described above, the server 102 collates the first face data received from the surveillance camera 101a with the first registered face data registered in the white list, and refers to a person other than the person in the first registered face data. It includes a control unit that determines entry into zone B, and a communication unit that transmits an alarm signal to the terminal device 103 when it is determined that a person other than the person of the first registered face data has entered zone B. The control unit of the server 102 registers the first face data of the person who triggered the transmission of the alarm signal in the white list in response to the instruction from the terminal device 103 that has received the alarm signal. As a result, the operator can easily register the registered face data in the white list.

Further, the control unit of the server 102 registers the first face data of the person who triggered the transmission of the alarm signal in the blacklist in response to the instruction from the terminal device that received the alarm signal. This allows the operator to easily register the registered face data in the blacklist.

(Sixth Embodiment)
In the first embodiment, the control unit 21 of the server 2 refers to the table TB2 and identifies the zone of the person whose face data was photographed. Then, the control unit 21 of the server 2 refers to the table TB1 to acquire the face data corresponding to the specified zone, and collates the acquired face data with the face data captured by the surveillance cameras 1a to 1c.

On the other hand, in the sixth embodiment, the control unit 21 of the server 2 refers to the table TB1 based on the face data captured by the surveillance cameras 1a to 1c, and permits the person to enter the face data. Get the zone. Then, the control unit 21 of the server 2 refers to the table TB2 based on the camera identification information, acquires the shooting zone in which the person in the face data is photographed, and obtains the shooting zone in which the person in the face data is photographed, and the control unit 21 of the face data is based on the permission zone and the shooting zone. Judge whether entry is permitted or not.

The configuration of the surveillance camera system and the block configuration of each device in the sixth embodiment are the same as the configuration of the surveillance camera system and the block configuration of each device in the first embodiment, and the description thereof will be omitted.

FIG. 31 is a sequence diagram showing an operation example of the surveillance camera system according to the sixth embodiment. In the sequence diagram of FIG. 31, the same processes as those of the sequence diagram of FIG. 8 are designated by the same reference numerals. Hereinafter, processing different from the processing of the sequence diagram of FIG. 8 will be described.

The control unit 21 of the server 2 collates the face data stored in the table TB1 with the face data 51 received in step S4 (step S141).

The control unit 21 of the server 2 acquires the permission zone in which the person of the face data 51 received in step S4 is permitted to enter the room by the collation in step S141 (step S142).

In the example of FIG. 31, the face data 51 received in step S4 matches the face data 41ba of the table TB1 shown in FIG. A person with face data 51 that matches face data 41ba can enter zones A and B from the table TB1 shown in FIG. Therefore, the permitted zones of the person of the face data 51 received in step S4 are zones A and B.

The control unit 21 of the server 2 refers to the table TB2 based on the camera identification information received in step S4, and acquires the photographed shooting zone of the face data 51 received in step S4 (step S143).

In the example of FIG. 31, the control unit 21 of the server 2 receives the camera identification information “1a” in step S4. Therefore, the control unit 21 of the server 2 acquires the zone A as a shooting zone.

The control unit 21 of the server 2 enters the zones A and B of the person of the face data 51 received in step S4 based on the permission zone acquired in step S142 and the shooting zone acquired in step S143. Judge the permission of. In the case of the example of FIG. 8, the permission zones of the person of the face data 51 are zones A and B. The shooting zone of the person in the face data 51 is zone A. Therefore, since the person in the face data 51 is a person who is permitted to enter the zones A and B and is in the zone A, the control unit 21 of the server 2 determines that the person in the face data 51 enters the zone A. Judge as a person who is allowed to enter. That is, when the control unit 21 of the server 2 has a shooting zone that matches the permission zone, the person photographed by the surveillance camera is determined to be a person who is permitted to enter the shooting zone.

The control unit 21 of the server 2 transmits the entry permission determination result to the zones A and B to the terminal device 3 (step S144). In the example of FIG. 31, the control unit 21 of the server 2 determines that the person in the face data 51 is a person who is permitted to enter the zone A, and therefore transmits information indicating that entry is OK to the terminal device 3.

The control unit 21 of the server 2 collates the face data stored in the table TB1 with the face data 52 received in step S8 (step S145).

The control unit 21 of the server 2 acquires the permission zone in which the person of the face data 52 received in step S9 is permitted to enter the room by the collation in step S145 (step S146).

In the example of FIG. 31, the face data 52 received in step S9 does not match the face data 41ba, 41bb, 41bc of the table TB1 shown in FIG. A person with face data 52 that does not match face data 41ba, 41bb, 41bc cannot enter zones A and B. Therefore, there is no permission zone for the person in the face data 52 received in step S9, and the control unit 21 of the server 2 determines that the person in the face data 52 is not permitted to enter the zones A and B. ..

The control unit 21 of the server 2 transmits the entry permission determination result to the zones A and B to the terminal device 3 (step S147). In the example of FIG. 31, the control unit 21 of the server 2 determines that the person in the face data 52 is a person who is not permitted to enter the zones A and B, and therefore transmits information indicating an entry NG to the terminal device 3. do.

As described above, the server 2 includes a communication unit 22 that receives face data from the surveillance cameras 1a to 1c that photograph each of the plurality of zones A to C of the building A1. The server 2 has a table TB2 in which the camera identification information of each of the plurality of surveillance cameras 1a to 1c and the plurality of zones A to C are linked, the registered face data, and the zone in which the registered face data is allowed to enter. It is provided with a table TB1 in which A to C are linked. The server 2 refers to the table TB1 based on the face data to acquire the permission zone where the person in the face data is permitted to enter, and then refers to the table TB2 based on the camera identification information to refer to the person in the face data. The control unit 21 is provided with a control unit 21 that acquires a shooting zone in which the photographed image is taken and determines whether or not to allow or disallow entry of a person in face data based on the permission zone and the shooting zone. As a result, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

(7th Embodiment)
In the seventh embodiment, the terminal devices that access the two tables are different.

FIG. 32 is a diagram showing an example of the surveillance camera system according to the seventh embodiment. As shown in FIG. 32, the surveillance camera system includes surveillance cameras 301a and 301b, a server 302, and terminal devices 303 and 304.

FIG. 32 shows a plan view of the inside of the building A301 in addition to the surveillance camera system. Building A301 is, for example, a concert hall. In the following, the building A301 will be described as a concert hall.

Building A301 has zones A and B. A seat is set in zone A. B seats are set in zone B. Seat B is farther from the stage than seat A. For example, the concert fee is different between the A seat and the B seat.

The surveillance camera 301a is installed in zone A of the building A301. The surveillance camera 301b is installed in zone B of the building A301.

Surveillance cameras 301a and 301b are installed in building A301 so as to photograph people in zones A and B. For example, the surveillance camera 301a is installed on the ceiling or wall of the zone A so as to capture the entire zone A. The surveillance camera 301b is installed on the ceiling or wall of the zone B so as to photograph the entire zone B.

The server 302 is connected to the surveillance cameras 301a and 301b by, for example, a network such as a LAN or the Internet. The server 302 may be installed in the building A301, or may be installed in a place different from the building A301.

The server 302 stores (registers) face data of a person who can enter zones A and B. In other words, server 302 has a white list of people who can enter zones A and B. The server 302 collates the face data of the person photographed by the surveillance cameras 301a and 301b with the registered face data. The server 302 transmits the collation result to the terminal device 303.

The terminal device 303 is connected to the server 302 by a network such as a LAN or the Internet. The terminal device 303 may be installed in the building A301, or may be installed in a place different from the building A301. The terminal device 303 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like. The terminal device 303 is used, for example, by an operator of a company that operates a concert.

The terminal device 303 is used, for example, by an operator of a company that operates a concert. The operator uses the terminal device 303 to input information regarding the settings of the surveillance cameras 301a and 301b. For example, the operator uses the terminal device 303 to set the grouping of the zones A and B and the surveillance cameras 301a and 301b. Further, the operator uses, for example, the terminal device 303 to monitor whether there is an inappropriate person in the zones A and B. For example, the operator uses the terminal device 303 to monitor whether there is a person who cannot enter the zone A in the zone A. Further, the operator uses the terminal device 303 to monitor whether or not there is a person who cannot enter the zone B in the zone B.

The terminal device 304 is connected to the server 302 by a network such as a LAN or the Internet. The terminal device 304 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

The terminal device 304 is used, for example, by a user who watches a concert. The user reserves or purchases a concert ticket, for example, using the terminal device 304 to watch the concert.

A plurality of surveillance cameras may be installed in each of zones A and B. Each of the zones A and B may be installed so as to photograph a person in the zones A and B by a plurality of surveillance cameras.

Further, as the surveillance cameras 301a and 301b, surveillance cameras already installed in the zones A and B may be used. For example, for the surveillance cameras 301a and 301b, surveillance cameras already installed in the zones A and B may be used as a part of the recording system for recording the images in the zones A and B. In this case, the outputs of the surveillance cameras 301a and 301b may be branched to the recording system and the server 302.

Also, the number of zones is not limited to two. The number of zones may be 3 or more. Surveillance cameras installed in each of the three or more zones are connected to the server 302. The server 302 uses either the blacklist or the whitelist in each of the three or more zones to determine the entry of a person into the zone.

Further, the surveillance camera system may include a recorder that records video data captured by the surveillance cameras 301a and 301b. The surveillance camera system may include a monitoring device that displays video data captured by the surveillance cameras 301a and 301b in real time. The monitoring device may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Further, the surveillance cameras 301a and 301b have the same configuration as the surveillance cameras 1a described with reference to FIG. 3, and the description thereof will be omitted. The server 302 has the same configuration as the server 2 described with reference to FIG. 4, and the description thereof will be omitted. However, the communication unit of the server 302 communicates with the terminal devices 303 and 304. The terminal devices 303 and 304 have the same configuration as the terminal device 3 described with reference to FIG. 5, and the description thereof will be omitted.

FIG. 33 is a diagram illustrating an access example of the table TB301. The table TB301 shown in FIG. 33 is the same as the table TB2 described in FIG. However, the table TB2 in FIG. 7 has three camera identification information, but the table TB301 in FIG. 33 is different in that it has two camera identification information. Further, the camera identification information "a" shown in FIG. 33 is the camera identification information of the surveillance camera 301a, and the camera identification information "b" is the camera identification information of the surveillance camera 301b.

The terminal device 303 can access the table TB301. The terminal device 304 cannot access the table TB301. The table TB301 is created by the terminal device 303 and stored in the storage unit 23 of the server 302. Further, the information in the table TB2 may be added, changed, or deleted by the terminal device 303, for example.

FIG. 34 is a diagram illustrating an access example of the table TB302. The table TB302 shown in FIG. 34 is the same as the table TB11 described in FIG. However, the time registered in the table TB301 of FIG. 34 is different from the time registered in the table TB11 of FIG.

The terminal device 304 can access the table TB302. For example, a user who wants to watch a concert can use the terminal device 304 to register the user's face data, seats, and the date and time of the concert to be watched in the table TB302. In addition, the user may add, change, or delete the information in the table TB 302 by using the terminal device 303.

The terminal device 303 may be able to access the table TB 302. For example, an authorized operator may use the terminal device 303 to view, add, change, or delete information in table TB302.

The tables TB301 and TB302 may be stored in the storage unit of the server 302. Further, both or one of the table TB301 and the table TB302 may be stored in a database separate from the server 302. The separate database may be considered as part of the server 302. In the following, the tables TB301 and TB302 are stored in the registration DB.

FIG. 35 is a sequence diagram showing an operation example of the surveillance camera system. The control unit of the terminal device 303 sets the grouping of the zones A and B and the surveillance cameras 301a and 301b in the registration DB via the server 302 according to the operation of the operator (steps S151 and S152). That is, the control unit of the terminal device 303 sets the association between the zones A and B and the surveillance cameras 301a and 301b in the registration DB. As a result, for example, the table TB301 shown in FIG. 33 is stored in the registration DB.

A person who reserves a concert, for example, inputs face data, a name, information on a zone to be reserved (information on seats in a concert hall), and reservation information such as time to enter the concert hall in the terminal device 304. The terminal device 304 transmits the input reservation information to the server 302 (step S153).

The control unit of the server 302 performs face registration in the registration DB based on the reservation information transmitted from the terminal device 304 (step S154). That is, the control unit of the server 302 generates the table TB 302 shown in FIG. 34 in the registration DB.

For example, the person with face data 311 in FIG. 35 uses the terminal device 304 to reserve a concert to be performed from 13:00 to 15:00 on the yy day of xx month 2019. Further, the person with face data 311 reserves the A seat by using the terminal device 304. In this case, the information shown in the dotted line frame A401 of FIG. 34 is stored in the table TB302, for example.

When the face registration in step S154 is completed, the control unit of the server 302 transmits the reservation information registered in the table TB 302 to the terminal device 3 (step S155). The administrator of the terminal device 303 can grasp the reservation contents of the person who reserved the concert hall from the reservation information received by the terminal device 303.
The terminal device 303 transmits the reservation information request to the server 302 in response to the operation of the operator (step S156). The operator can specify, for example, date and time or seat (zone) information as the requested reservation information.

When the control unit of the server 302 receives the reservation information from the terminal device 303, it accesses the table TB302 of the registration DB and acquires the reservation information (step S157).

The control unit of the server 302 transmits the reservation information acquired from the table TB 302 to the terminal device 303 (step S158).

As described above, the server 302 has a communication unit that receives face data from surveillance cameras 301a and 301b that capture each of the plurality of zones A and B of the building A301, face data, and each of the zones A and B. It is provided with a control unit that collates with the registered face data of a person who is permitted to enter and determines whether or not the person in the face data can enter in the zone where the face data is photographed. The communication unit receives information regarding the settings of the surveillance cameras 301a and 301b from the terminal device 303, and requests the access permission from the terminal device 304 to at least one of the plurality of zones A and B. Receive data. This makes it convenient for a person who wants to enter the zone to directly register the registered face data in the surveillance camera system.

(Modification example)
In the above, the surveillance camera system is applied to the concert hall, but the present invention is not limited to this. The surveillance camera system can also be applied to, for example, paid lecture venues, amusement park attractions, movie theaters, trains such as the Shinkansen, or airplanes.

For example, when applying a surveillance camera system to a venue for a paid course, the server 302 determines whether or not a person is sitting in an appropriate seat (zone). The server 302 may grasp the vacancy status of the paid course. Further, the server 302 may determine who is sitting in which seat. Further, the server 302 may calculate the correlation between the grade and the seat. Further, the server 302 may calculate the attendance rate for each instructor of the paid lecture.

Further, when the surveillance camera system is applied to an attraction in an amusement park, the surveillance cameras 301a and 301b may be installed for each attraction (zone). Server 302 may determine if a person is at an appropriate attraction.

Further, when the surveillance camera system is applied to a movie theater, the surveillance cameras 301a and 301b may be installed in each room (zone) to be screened. The server 302 may determine if a person is sitting in an appropriate room seat.

Further, when the surveillance camera system is applied to the Shinkansen, the surveillance cameras 301a and 301b may be installed for each vehicle (zone). The server 302 may determine whether a person is sitting in a suitable vehicle seat. This makes it possible to simplify ticket inspection.

The embodiment has been described above. Each of the above embodiments may be combined.

In each of the above-described embodiments, the registered face data registered in the table may be, for example, a photograph attached to an employee card. For example, the card reader may be equipped with a camera, take a picture attached to the employee card, and send it to the server.

Further, the registered face data registered in the table may be acquired from the video stored in the recorder. For example, the operator may play back the video stored in the recorder on the terminal device, cut out the face of the person to be registered in the table from the played back video, and register the face data of the cut face in the table.

Further, the registered face data registered in the table may be face data taken by the face recognition gate. The operator may display the image of the face data taken by the face recognition gate on the terminal device, cut out the face of the person who wants to be registered in the table from the displayed image, and register the face data of the cut face in the table. ..

In the above-described embodiment, the notation "... part" used for each component is "... circuitry", "... device", "... unit", or "... unit". It may be replaced with another notation such as "... module".

Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear to those skilled in the art that various modifications or modifications can be conceived within the scope of the claims. It is understood that such modifications or modifications also fall within the technical scope of the present disclosure. In addition, each component in the embodiment may be arbitrarily combined without departing from the gist of the present disclosure.

The present disclosure can be realized by software, hardware, or software linked with hardware. Each functional block used in the description of the above embodiment is partially or wholly realized as an LSI which is an integrated circuit, and each process described in the above embodiment is partially or wholly. It may be controlled by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip so as to include a part or all of functional blocks. The LSI may include data input and output. LSIs may be referred to as ICs, system LSIs, super LSIs, and ultra LSIs depending on the degree of integration.

The method of making an integrated circuit is not limited to LSI, and may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Further, an FPGA that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connection and settings of the circuit cells inside the LSI may be used. The present disclosure may be realized as digital processing or analog processing.

Furthermore, if an integrated circuit technology that replaces an LSI appears due to advances in semiconductor technology or another technology derived from it, it is naturally possible to integrate functional blocks using that technology. There is a possibility of applying biotechnology.

A program that describes the processing contents of the functions that the server should have is provided. By executing the program on a computer, the above processing function is realized on the computer.

The surveillance camera system of the present disclosure is useful in a surveillance camera system that determines whether or not a person other than a person determined for each zone has entered the zone.

1a to 1d, 101a, 101b, 301a, 301b Surveillance camera 2,102,302 Server 3,61,103,303,304 Terminal device 11,81 Imaging unit 12,21,31,82 Control unit 13,22,34, 84 Communication unit 14, 23, 35, 85 Storage unit 32 Input unit 33 Display unit 41a, 42a, 121a, 131a Zone identification information 41b, 41ba to 41bc, 51, 52, 91, 92, 111-113, 131c, 132a, 132b, 141-144,151-156,166-166,201,202,206,207,208,209,311 Face data 42b, 42ba-42bc, 121b Camera identification information 71a-71c Card reader 83 Card communication unit 104a, 104b, 105a, 105b Alarm device 131b List information TB1, TB2, TB11, TB21, TB101, TB102, TB301, TB302 Tables A to C Zones A1, A101, A301 Buildings

Claims (8)

A communication unit that receives face image data from a camera that shoots each of multiple zones of the building,
A first table in which the camera identification information of each of the plurality of cameras and the plurality of zones are linked, and
A second table in which the registered face image data and the zone in which the person is allowed to enter the registered face image data are linked, and
The second table is referred to based on the face image data, the permission zone in which the person is permitted to enter the face image data is acquired, and then the first table is referred to based on the camera identification information. A control unit that acquires a shooting zone in which a person in the face image data is photographed and determines permission / non-permission of entry of the person in the face image data based on the permission zone and the shooting zone. Have, have
Information processing device. When the shooting zone corresponding to the permission zone exists, the control unit determines the permission of the person of the face image data to enter the shooting zone.
The information processing device according to claim 1. When the registered face image data matching the face image data is not registered in the second table, the control unit determines that the person is not allowed to enter the plurality of zones of the face image data. ,
The information processing device according to claim 1. Receives facial image data from a camera that captures each of the multiple zones of the building
Based on the face image data, the registered face image data and the second table in which the zone in which the person is allowed to enter the registered face image data are linked are referred to, and the person in the face image data can enter. Get the allowed allowed zone and
Based on the camera identification information of the camera that captured the person in the face image data, the face image data is referred to with reference to a first table in which the camera identification information of each of the plurality of cameras and the plurality of zones are linked. Get the shooting zone where the person was shot,
The permission / non-permission of the person in the face image data is determined based on the permission zone and the shooting zone.
Judgment method. On the computer
Receives facial image data from a camera that captures each of the multiple zones of the building
Based on the face image data, the registered face image data and the second table in which the zone in which the person is allowed to enter the registered face image data are linked are referred to, and the person in the face image data can enter. Get the allowed allowed zone and
Based on the camera identification information of the camera that captured the person in the face image data, the face image data is referred to with reference to a first table in which the camera identification information of each of the plurality of cameras and the plurality of zones are linked. Get the shooting zone where the person was shot,
Based on the permission zone and the shooting zone, the permission / denial of entry of the person in the face image data is determined, and the process is executed.
program. A communication unit that receives face image data from a camera that shoots each of multiple zones of the building,
The camera identification information of each of the plurality of cameras, the first information in which the plurality of zones are linked, the registered face image data, and the zone in which the person is allowed to enter the registered face image data are linked. A memory to store the second information and
The second information is referred to based on the face image data, the permission zone in which the person is permitted to enter the face image data is acquired, and then the first information is referred to based on the camera identification information. A control unit that acquires a shooting zone in which a person in the face image data is photographed and determines permission / non-permission of entry of the person in the face image data based on the permission zone and the shooting zone. Have, have
Information processing device. Receives facial image data from a camera that captures each of the multiple zones of the building
Based on the face image data, the registered face image data and the second information in which the registered face image data is associated with the zone where the person is allowed to enter are referred to, and the person in the face image data can enter. Get the allowed allowed zone and
Based on the camera identification information of the camera that captured the person in the face image data, the face image data is referred to with reference to the first information in which the camera identification information of each of the plurality of cameras and the plurality of zones are associated with each other. Get the shooting zone where the person was shot,
The permission / non-permission of the person in the face image data is determined based on the permission zone and the shooting zone.
Judgment method. On the computer
Receives facial image data from a camera that captures each of the multiple zones of the building
Based on the face image data, the registered face image data and the second information in which the registered face image data is associated with the zone where the person is allowed to enter are referred to, and the person in the face image data can enter. Get the allowed allowed zone and
Based on the camera identification information of the camera that captured the person in the face image data, the face image data is referred to with reference to the first information in which the camera identification information of each of the plurality of cameras and the plurality of zones are associated with each other. Get the shooting zone where the person was shot,
Based on the permission zone and the shooting zone, the permission / denial of entry of the person in the face image data is determined, and the process is executed.
program.

Images