JP2020119066A - Information processing device, determination method, and program - Google Patents

Abstract

To provide an information processing device and a determination method for determining whether a person other than the persons determined to be permitted to enter each zone has entered the zone.SOLUTION: An information processing device has: a communication unit for receiving face image data from cameras for photographing respective zones in a building; and a control unit for collating the face image data with the registered face image data of the persons permitted to enter each zone and for determining whether the entry of the person corresponding to the face image data is permitted or not in the zone in which the face image data is photographed.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to an information processing device and an authentication method.

2. Description of the Related Art Conventionally, an entrance/exit management system capable of notifying and transmitting an authentication result by face authentication to each user who passes through a gate has been provided (for example, see Patent Document 1).

JP, 2008-92293, A

By the way, in a company or the like, for example, people who can enter may be distinguished in each zone such as a floor or a room. For example, a person A may enter room X and room Y, and a person B may enter room X but cannot enter room Y. As described above, in a facility or the like that distinguishes a person who can enter each zone, it is important to manage whether or not a person other than the person who is determined for each zone does not enter the zone.

The non-limiting example of the present disclosure contributes to the provision of an information processing device that determines whether or not a person other than the person determined for each zone is in the zone.

An information processing apparatus according to an aspect of the present disclosure is a communication unit that receives face image data from a camera that captures each of a plurality of zones of a building, the face image data, and a person who is permitted to enter each zone. Of the registered face image data, and a control unit that determines whether or not the person in the face image data is allowed to enter the zone in which the face image data is captured.

A determination method according to an aspect of the present disclosure receives face image data from a camera that captures each of a plurality of zones of a building, and the face image data and a registered face image of a person who is permitted to enter each zone. The data is collated, and permission/non-permission of the person of the face image data in the zone where the face image data is photographed is determined.

Note that these comprehensive or specific aspects may be realized by a system, a device, a method, an integrated circuit, a computer program, or a recording medium. The system, the device, the method, the integrated circuit, the computer program, and the recording medium. May be realized in any combination.

According to one aspect of the present disclosure, it is possible to determine whether or not a person other than the person determined for each zone is not in the zone.

Further advantages and effects of one aspect of the present disclosure will be apparent from the specification and the drawings. Such advantages and/or effects are provided by the features described in several embodiments and in the specification and drawings, respectively, but not necessarily all to obtain one or more of the same features. There is no.

The figure which showed an example of the surveillance camera system which concerns on 1st Embodiment. Figure showing a video example of a surveillance camera installed in the zone Figure showing a block configuration example of the surveillance camera Diagram showing an example of the server block configuration Diagram showing an example of the block configuration of the terminal device The figure which showed an example of the table memorize|stored in the memory|storage part of a server. The figure which showed an example of the table memorize|stored in the memory|storage part of a server. Sequence diagram showing an operation example of the surveillance camera system The figure which showed an example of the table memorize|stored in the memory|storage part of the server which concerns on 2nd Embodiment. Sequence diagram showing an operation example of the surveillance camera system in registration of face data and time The figure which showed an example of the surveillance camera system which concerns on 3rd Embodiment. Diagram showing an example of the block configuration of a card reader The figure which showed an example of the table memorize|stored in the memory|storage part of a server. Sequence diagram showing an operation example of the surveillance camera system

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of well-known matters and duplicate description of substantially the same configuration may be omitted. This is for avoiding unnecessary redundancy in the following description and for facilitating understanding by those skilled in the art.

It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims by these.

(First embodiment)
FIG. 1 is a diagram showing an example of a surveillance camera system according to the first embodiment. As shown in FIG. 1, the surveillance camera system includes cameras 1a to 1d, a server (information processing device) 2, and a terminal device 3. FIG. 1 shows a building A1 in addition to the surveillance camera system. The building A1 is, for example, a company, an apartment, a commercial facility, or the like.

Zones A-C may be rooms, entrances, corridors, stairs, floors, elevators, etc. of building A1. The zones A to C may be the site where the building A1 is built. That is, the zones A to C may be regarded as areas where it is determined whether or not entry (entry) of a person is permitted. Zones may be referred to as areas. Below, zone A-C is demonstrated as a room of building A1.

The surveillance cameras 1a to 1d are installed in the zones A to C. For example, the surveillance camera 1a is installed in the zone A of the building A1. The surveillance cameras 1b and 1c are installed in the zone B of the building A1. The surveillance camera 1d is installed in the zone C of the building A1.

The surveillance cameras 1a to 1d are installed so as to photograph the persons in the zones A to C. For example, the surveillance cameras 1a to 1d are installed so as to capture images of the entire zones A to C.

FIG. 2 is a diagram showing an image example of the surveillance camera 1a installed in the zone A. The monitoring camera 1a captures an image of a room over a wide range, for example, as shown in FIG.

Returning to the description of FIG. The server 2 is connected to the surveillance cameras 1a to 1d by a network such as a LAN (Local Area Network) or the Internet, for example. The server 2 may be installed in the building A1 or may be installed in a place different from the building A1.

The server 2 stores (registers) image data of a face of a person who can enter (enter) the zones A to C (hereinafter sometimes referred to as face data) in each of the zones A to C. The server 2 collates the face data of the person photographed by the surveillance cameras 1a to 1d with the registered face data. The server 2 transmits the collated result to the terminal device 3.

The terminal device 3 is connected to the server 2 via a network such as a LAN or the Internet. The terminal device 3 may be installed in the building A1 or may be installed in a place different from the building A1. The terminal device 3 may be, for example, a personal computer, a smart phone, a tablet terminal, or the like.

Note that the surveillance cameras 1a to 1d may be installed so as to capture an image of a person who enters the zones A to C. For example, the surveillance cameras 1a to 1d may be installed so as to capture images near the entrances of the zones A to C.

Moreover, the monitoring cameras already installed in the zones A to C may be used as the monitoring cameras 1a to 1d. For example, as the surveillance cameras 1a to 1d, the surveillance cameras already installed in the zones A to C may be used as a part of the recording system for recording the images of the zones A to C. In this case, the outputs of the surveillance cameras 1a to 1d may be branched to the recording system and the server 2.

FIG. 3 is a diagram showing a block configuration example of the surveillance camera 1a. As shown in FIG. 3, the surveillance camera 1 a includes an imaging unit 11, a control unit 12, a communication unit 13, and a storage unit 14.

The image pickup section 11 has, for example, a lens and an image pickup element (not shown). The lens of the image pickup unit 11 forms an image of a subject on the light receiving surface of the image pickup element. As the lens, lenses having various focal lengths or shooting ranges can be used depending on the installation location of the surveillance camera 1a or the shooting application.

The image pickup device of the image pickup unit 11 converts the light received by the light receiving surface into an electric signal. The image sensor is, for example, an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The image pickup unit 11 converts an electric signal (analog signal) corresponding to the light received on the light receiving surface of the image pickup element into a digital signal and outputs the digital signal to the control unit 12.

The control unit 12 controls the entire surveillance camera 1a. The control unit 12 may be configured by, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control unit 12 determines the human face from the video output from the imaging unit 11. The control unit 12 cuts out the face of the determined person and transmits the face data (still image) of the cut-out face to the server 2 via the communication unit 13.

The communication unit 13 communicates with the server 2. The communication unit 13 may communicate with the server 2 via, for example, a network cable (wired) such as an Ethernet (registered trademark) cable. The communication unit 13 may communicate with the server 2 via short-range wireless communication such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The storage unit 14 stores a program for operating the control unit 12. In addition, the storage unit 14 stores data for the control unit 12 to perform calculation processing, data for the control unit 12 to control each unit, and the like. The storage unit 14 may be configured by a storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, and an HDD (Hard Disk Drive).

The monitoring cameras 1b to 1c have the same block configuration as the monitoring camera 1a. Therefore, the description of the block configuration of the surveillance cameras 1b to 1c is omitted.

FIG. 4 is a diagram showing a block configuration example of the server 2. As shown in FIG. 4, the server 2 has a control unit 21, a communication unit 22, and a storage unit 23.

The control unit 21 controls the entire server 2. The control unit 21 may be configured by a CPU, for example.

The communication unit 22 communicates with the surveillance cameras 1a to 1d and the terminal device 3. The communication unit 22 may communicate with the surveillance cameras 1a to 1d and the terminal device 3 via a network cable such as an Ethernet cable, for example. In addition, the communication unit 22 may communicate with the monitoring cameras 1a to 1d and the terminal device 3 via short-range wireless communication such as Wi-Fi or Bluetooth.

The storage unit 23 stores a program for operating the control unit 21. Further, the storage unit 23 stores data for the control unit 21 to perform calculation processing, data for the control unit 21 to control each unit, and the like. The storage unit 23 may be configured by a storage device such as a RAM, a ROM, a flash memory, and an HDD.

FIG. 5 is a diagram showing a block configuration example of the terminal device 3. As shown in FIG. 5, the terminal device 3 includes a control unit 31, an input unit 32, a display unit 33, a communication unit 34, and a storage unit 35.

The control unit 31 controls the entire terminal device 3. The control unit 31 may be configured by a CPU, for example.

The input unit 32 is connected to an input device (not shown) such as a keyboard, a touch panel superimposed on the screen of a display device, or a mouse, for example. The input unit 32 receives a signal output from the input device according to a user operation, and outputs the signal to the control unit 31.

The display unit 33 is connected to a display device (not shown) included in the terminal device 3. The display unit 33 outputs the image data output from the control unit 31 to the display device.

In the following, in order to simplify the explanation, the detection of the occupants in the zones A and B will be described. As described in FIG. 1, the monitoring camera 1a is installed in the zone A, and the monitoring cameras 1b and 1c are installed in the zone B.

FIG. 6 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. The table TB1 illustrated in FIG. 6 is stored in the storage unit 23 of the server 2 when the monitoring cameras 1a to 1c are installed in the building A1, for example. The table TB1 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2. Moreover, the information of the table TB1 may be added, changed, or deleted by the terminal device 3, for example.

The table TB1 has zone identification information 41a and face data 41b. The zone identification information 41a is identification information for identifying the zones A and B. For example, “A” in the table TB1 indicates the identification information of the zone A. “B” of the table TB1 indicates the identification information of the zone B. The face data 41b is human face data.

The table TB1 may be said to be information indicating the persons who are permitted to enter the room for each zone. For example, the person in the face data 41b in the circled row of the table TB1 indicates that the person can enter the zone indicated by the zone identification information 41a in the circled column. Further, the person in the face data 41b in the row with the bar in the table TB1 indicates that he/she cannot enter the zone indicated by the zone identification information 41a in the column with the bar.

More specifically, the person with the face of the face data 41ba in FIG. 6 can enter the zones A and B. A person having a face of face data 41bb in FIG. 6 can enter the zone A but cannot enter the zone B. A person with a face of face data 41bc in FIG. 6 cannot enter the zone A, but can enter the zone B.

FIG. 7 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. The table TB2 illustrated in FIG. 7 is stored in the storage unit 23 of the server 2 when the monitoring cameras 1a to 1c are installed in the building A1, for example. The table TB2 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2. Further, the information of the table TB2 may be added, changed, or deleted by the terminal device 3, for example.

The table TB2 has zone identification information 42a and camera identification information 42b. The zone identification information 42a is identification information that identifies a zone. The camera identification information 42b is identification information for identifying the surveillance cameras 1a to 1c. For example, “1a” of the camera identification information 42b indicates identification information of the surveillance camera 1a. “1b” of the camera identification information 42b indicates identification information of the surveillance camera 1b. “1c” of the camera identification information 42b indicates identification information of the surveillance camera 1c.

The table TB2 may be said to be information indicating the installation locations in the zones of the monitoring cameras 1a to 1c. For example, it indicates that the surveillance camera of the camera identification information 42b in the circled row of the table TB2 is installed in the zone indicated by the zone identification information 42a in the circled column. Further, it is indicated that the surveillance camera of the camera identification information 42b in the row with the bar in the table TB2 is not installed in the zone indicated by the zone identification information 42a in the column with the bar.

More specifically, the surveillance camera 1a of the camera identification information 42ba of FIG. 7 is installed in the zone A. The surveillance camera 1b of the camera identification information 42bb of FIG. 7 is installed in the zone B. The surveillance camera 1c of the camera identification information 42bc of FIG. 7 is installed in the zone B.

Although the tables TB1 and TB2 are stored in the storage unit 23 of the server 2 in FIGS. 6 and 7, the present invention is not limited to this. The table TB1 and/or the table TB2 may be stored in a database separate from the server 2. Hereinafter, it is assumed that the table TB1 is stored in the registration DB (DB: database) and the table TB2 is stored in the storage unit 23 of the server 2. The registration DB may be regarded as a part of the server 2, for example.

FIG. 8 is a sequence diagram showing an operation example of the surveillance camera system. The control unit 31 of the terminal device 3 sets the grouping of the zones A and B and the monitoring cameras 1a to 1c in the server 2 according to the operation of the operator (step S1). That is, the control unit 31 of the terminal device 3 sets the server 2 to associate the zones A and B with the monitoring cameras 1a to 1c. As a result, for example, the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2.

The control unit 31 of the terminal device 3 performs face registration in the zones A and B in the registration DB according to the operation of the operator (steps S2a and S2b). That is, the control unit 31 of the terminal device 3 sets the correspondence between the zones A and B and the face data of the persons who can enter the zones A and B in the registration DB. As a result, for example, the table TB1 shown in FIG. 6 is stored in the registration DB. Information registration in the registration DB is performed via the server 2. The control unit 31 of the terminal device 3 may obtain the face data to be registered in the registration DB from the face database of another system.

It is assumed that the imaging unit 11 of the monitoring camera 1a in the zone A has photographed a person. The control unit 12 of the monitoring camera 1a cuts out a human face from the image captured by the imaging unit 11, and transmits the face data of the cut-out face and the camera identification information of the monitoring camera 1a to the server 2 (step S3). ).

The control unit 21 of the server 2 receives the face data transmitted in step S3 and the camera identification information of the surveillance camera 1a (step S4).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23 and acquires the zone identification information corresponding to the camera identification information received in step S4 (step S5).

In the example of FIG. 8, the control unit 21 of the server 2 receives the camera identification information “1a” of the surveillance camera 1a in step S4. Therefore, the control unit 21 of the server 2 acquires the zone identification information “A” of the zone A from the table TB2 of FIG. Thereby, the control unit 21 of the server 2 can specify (determine) that the face data 51 received in step S4 is captured by the surveillance camera 1a installed in the zone A. In other words, the control unit 21 of the server 2 can specify that the person with the face of the face data 51 received in step S4 is in the zone A.

When the zone is specified in step S5, the control unit 21 of the server 2 refers to the table TB1 of the registration DB and acquires the face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB2 with the face data received in step S4 (step S6).

In the example of FIG. 8, the control unit 21 of the server 2 specifies that the person with the face of the face data 51 is in the zone A in step S5. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A of the table TB1 shown in FIG. 6 with the face data 51 received in step S4. Since the face data 51 matches the face data 41ba corresponding to the zone A of the table TB1 shown in FIG. 6, the control unit 21 of the server 2 determines that the face matching has matched. That is, the control unit 21 of the server 2 determines that the person having the face data 51 is a person who is permitted to enter the zone A.

The control unit 21 of the server 2 transmits the matching result (face matching OK) of step S6 to the terminal device 3 (step S7). In addition, the control part 21 of the server 2 does not need to transmit a collation result to the terminal device 3, when face collation OK is determined. In other words, the control unit 21 of the server 2 may transmit the matching result to the terminal device 3 only when the face matching NG is determined. Further, when the control unit 31 of the terminal device 3 receives the collation result of the face collation OK in step S7 of FIG. 8, it may display that fact on the display device.

It is assumed that the imaging unit 11 of the monitoring camera 1a in the zone A has photographed a person. The control unit 12 of the surveillance camera 1a cuts out a person's face from the video imaged by the imaging unit 11, and transmits the face data of the cut-out face and the camera identification information of the surveillance camera 1a to the server 2 (step S8). ).

The control unit 21 of the server 2 receives the face data transmitted in step S8 and the camera identification information of the surveillance camera 1a (step S9).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23 and acquires the zone identification information corresponding to the camera identification information received in step S9 (step S10).

In the example of FIG. 8, the control unit 21 of the server 2 receives the camera identification information “1a” of the surveillance camera 1a in step S9. Therefore, the control unit 21 of the server 2 acquires the zone identification information “A” of the zone A from the table TB2 of FIG. As a result, the control unit 21 of the server 2 can specify that the face data 52 received in step S9 is taken by the surveillance camera 1a installed in the zone A. In other words, the control unit 21 of the server 2 can specify that the person with the face of the face data 52 received in step S9 is in the zone A.

When the zone is specified in step S10, the control unit 21 of the server 2 refers to the table TB1 of the registration DB and acquires the face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB2 with the face data received in step S9 (step S11).

In the example of FIG. 8, the control unit 21 of the server 2 specifies that the person with the face of the face data 52 is in the zone A in step S10. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A shown in FIG. 6 with the face data 52 received in step S9. Since the face data 52 does not match the face data 41ba and 41bb corresponding to the zone A shown in FIG. 6, the control unit 21 of the server 2 determines that the face matching does not match. That is, the control unit 21 of the server 2 determines that the person of the face data 52 is a person who is not permitted to enter the zone A.

The control unit 21 of the server 2 transmits the matching result (face matching NG) of step S11 to the terminal device 3 (step S12). The control unit 31 of the terminal device 3 receives the matching result of the face matching NG and displays an alert on the display device, for example. Note that the control unit 21 of the server 2 may transmit the matching result of step S11 to a voice output device such as a speaker installed in the zone A, for example. The voice output device installed in the zone A may output a warning sound or the like when receiving the verification result in step S11.

As described above, the communication unit 22 of the server 2 receives face image data from the plurality of cameras 1a to 1d that capture the plurality of zones A to C of the building A1. The control unit 21 collates the face image data received by the communication unit 22 with the registered face image data of the person who is allowed to enter the zone, and the face image data in the zone where the person of the face image data is photographed. Determine the permission and non-permission of the person in. Thereby, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

In addition, the server 2 collects the images of the plurality of surveillance cameras 1a to 1d and determines the entry for each zone of the building A1. As a result, a user who uses the surveillance camera system only needs to set the entry of a person in each zone of the building A1 to the server 2, which facilitates zone setting.

(Modification)
In the above, the surveillance cameras 1a to 1d cut out a human face and transmit the face data to the server 2, but the present invention is not limited to this. The surveillance cameras 1a to 1d may transmit the image data of the zone to the server 2, and the server 2 may detect the face of the person and cut it out. In this case, the video data transmitted from the surveillance cameras 1a to 1d to the server 2 may be regarded as including face data.

(Second embodiment)
In the second embodiment, the time when a person can enter the zone is also determined. In the following, parts different from the first embodiment will be described.

FIG. 9 is a diagram showing an example of a table stored in the storage unit 23 of the server 2 according to the second embodiment. The table TB11 illustrated in FIG. 9 is stored in the storage unit 23 of the server 2 when the monitoring cameras 1a to 1c are installed in the building A1, for example. The table TB11 may be created by the terminal device 3 and stored in the storage unit 23 of the server 2. The information of the table TB11 may be added, changed, or deleted by the terminal device 3, for example.

The table TB11 has the zone identification information 41a and the face data 41b, like the table TB1 described in FIG. The table TB11 may be said to be information indicating the person who is allowed to enter the room for each zone and the time when the person may stay in the zone. For example, the time shown in the table TB11 shows the time when the person of the face data 41b in the row of the time can enter the zone indicated by the zone identification information 41a in the column of the time.

More specifically, the person with the face of the face data 41ba in FIG. 9 can enter the zone A from 9:00 to 19:00. A person whose face is shown in the face data 41ba in FIG. 9 can enter the zone B between 13:00 and 17:00. A person with a face of face data 41bb in FIG. 9 can enter the zone A between 9:00 and 19:00. A person with the face data 41bb in FIG. 9 cannot enter the zone B all day long. A person with the face data 41bc shown in FIG. 9 cannot enter the zone A all day long. The person with the face of the face data 41bc in FIG. 9 can enter the zone B between 15:00 and 17:00.

In the above description, the table TB11 is stored in the storage unit 23 of the server 2, but it is not limited to this. The table TB11 may be stored in the registration DB.

The operation of the server 2 of the second embodiment is different from that of the first embodiment in the face matching process of step S6 described in FIG. In the face matching process of step S6, the control unit 21 of the server 2 determines the time for which the person of the face data 51 received in step S4 may stay in the zone.

For example, the control unit 21 of the server 2 specifies that the person having the face of the face data 51 is in the zone A in step S5. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A shown in FIG. 9 with the face data 51 received in step S4. Since the face data 51 matches the face data 41ba corresponding to the zone A shown in FIG. 9, the control unit 21 of the server 2 may wait for the time (9 0:00 to 19:00) is determined. If the current time is between 9:00 and 19:00, the control unit 21 of the server 2 determines that face matching is OK. On the other hand, if the current time is not between 9:00 and 19:00, the control unit 21 of the server 2 determines that the face matching is NG.

As described above, the control unit 21 of the server 2 determines whether it is the time when the person of the face image data is permitted to enter the zone in which the person of the face image data is photographed, and the face image data and the current time. And is determined using. Thereby, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

(Modification)
The registration of face data and time of a person who may be in the zone may be stored in the server 2 or the registration DB by a device other than the terminal device 3.

FIG. 10 is a sequence diagram showing an operation example of the surveillance camera system in registration of face data and time. The terminal device 61 shown in FIG. 10 is a terminal used by a person who reserves a facility in which a zone is set, such as a movie theater, a restaurant, an apartment, an office, or a concert venue. The person who reserves the facility uses the terminal device 61 to register the face data and the time to enter the zone of the facility. The terminal device 3 illustrated in FIG. 10 is managed by a manager of a facility such as a movie theater, a restaurant, a condominium, an office, or a concert venue.

The terminal device 61 may be, for example, a smartphone, a tablet terminal, a personal computer, or the like. The terminal device 61 may be equipped with an application that registers face data and time in the server 2 or the registration DB. The application may be provided by the administrator of each facility. The terminal device 61 has a block configuration similar to that shown in FIG.

The sequence of FIG. 10 will be described below. In FIG. 10, the monitoring cameras 1a to 1d installed in the facility are not shown.

The control unit 31 of the terminal device 3 sets the grouping of the zones A and B and the monitoring cameras 1a to 1c in the server 2 according to the operation of the operator (step S21). That is, the control unit 31 of the terminal device 3 sets the server 2 to associate the zones A and B with the monitoring cameras 1a to 1c. As a result, for example, the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2.

A person who reserves a facility in which a zone is installed (for example, a person who reserves a movie theater) is, for example, face data, a name of a person who uses the facility, information of a zone to be used (for example, a movie is shown on the terminal device 61). Enter the reservation information such as the name of the room to be entered) and the time to enter the zone. The terminal device 61 transmits the input reservation information to the server 2 (step S22).

The control unit 21 of the server 2 performs face registration in the registration DB based on the reservation information transmitted from the terminal device 61 (step S23). That is, the control unit 21 of the server 2 creates the table TB11 shown in FIG. 9 in the registration DB. The control unit 21 of the server 2 may generate the table TB11 in the storage unit 23.

The control unit 21 of the server 2 transmits the reservation information received in step S22 to the terminal device 3 (step S24). The manager of the terminal device 3 can grasp the reservation content of the person who uses the facility from the reservation information received by the terminal device 3.

In this way, a person who uses the facility in which the zone is set may use the terminal device 61 to set the face data and the time to enter the zone in the server 2 or the registration DB.

Note that, for example, a person who reserves a restaurant may use the terminal device 61 to register the face data and the reservation time in the server 2 or the registration DB when making a reservation for the restaurant. Zones may be set for each room that serves meals in a restaurant.

Further, for example, the resident of the condominium may use the terminal device 61 to register the face data of the visitor and the visit time in the server 2 or the registration DB. The zone may be set for each entrance of the apartment and each floor.

Further, for example, a staff member of the office may use the terminal device 61 to register the face data of the visitor and the visit time in the server 2 or the registration DB. Zones may be established per office entrance, per floor, or per room.

Further, for example, when a person who reserves a concert reserves a ticket for the concert, the terminal device 61 may be used to set the face data and the time for viewing the concert in the server 2 or the registration DB. Zones may be set for each class and box of seats at a concert venue.

(Third Embodiment)
In a company or the like, an employee may distinguish the zone in which he/she can enter the room, depending on the card he/she has. For example, one employee can enter a room by holding the card over the card reader installed at the entrance of the room, but another employee can hold the card over the card reader by holding the card over the room. Cannot enter the room. In the third embodiment, face data is registered using the card information of such a card.

FIG. 11 is a diagram showing an example of a surveillance camera system according to the third embodiment. 11, the same parts as those in FIG. 1 are designated by the same reference numerals. In FIG. 11, the illustration of the building A1 is omitted.

The surveillance camera system in FIG. 11 has card readers 71a to 71c in addition to the surveillance camera system shown in FIG.

The card reader 71a is installed, for example, next to the entrance door of the zone A. Zone identification information of zone A is associated with the card reader 71a.

The card reader 71b is installed, for example, next to the entrance door of the zone B. Zone identification information of zone B is associated with the card reader 71b.

The card reader 71c is installed, for example, next to the entrance door of the zone C. Zone identification information of zone C is associated with the card reader 71c.

The card reader 71a, for example, performs short-distance wireless communication with a card carried by an employee. The card reader 71a reads information from the card held over the card reader 71a and determines whether the person who holds the card is an employee who can enter the zone A. Similar to the card reader 71a, the card readers 71b and 71c also read information from the swiped card and determine whether the person who has the card is an employee who can enter the zones B and C.

From the read card information, the card reader 71a unlocks the entrance door of the zone A when it is determined that the person who has the card can enter the zone A. On the other hand, the card reader 71a does not unlock the entrance door of the zone A when it is determined from the read card information that the person who has the card cannot enter the zone A. Similarly to the card reader 71a, the card readers 71b and 71c also control unlocking of the entrance doors of the zones B and C based on the read card information.

The employee's card has a photograph of the employee's face attached. The card reader 71a includes a camera. When unlocking the entrance door of the zone A, the card reader 71a takes a photograph of the employee's face attached to the card by the camera (obtains a still image of the photograph of the face). Then, the card reader 71a transmits the face data of the taken face photograph and the zone identification information of the zone A to the server 2. That is, when the person who possesses the card can enter the zone A using the card, the facial photograph attached to the card and the zone identification information of the zone A are linked and transmitted to the server 2.

Like the card reader 71a, the card readers 71b and 71b also include a camera. When unlocking the entrance doors of the zones B and C, the card readers 71b and 71c take a photograph of the employee's face attached to the card by the camera. Then, the card readers 71b and 71c transmit the face data of the photographed face photograph and the zone identification information of the zones B and C to the server 2.

FIG. 12 is a diagram showing a block configuration example of the card reader 71a. As shown in FIG. 12, the card reader 71a includes an imaging unit 81, a control unit 82, a card communication unit 83, a communication unit 84, and a storage unit 85.

The image pickup section 81 has, for example, a lens and an image pickup element (not shown). The lens of the image pickup unit 81 forms an image of the subject on the light receiving surface of the image pickup element. As the lens, lenses having various focal lengths or shooting ranges can be used depending on the installation place of the card reader 71a, the shooting application, or the like.

The image pickup device of the image pickup unit 81 converts the light received by the light receiving surface into an electric signal. The image sensor is, for example, an image sensor such as CCD or CMOS. The image pickup unit 81 converts an electric signal (analog signal) corresponding to the light received on the light receiving surface of the image pickup element into a digital signal and outputs the digital signal to the control unit 82.

The control unit 82 controls the entire card reader 71a. The control unit 82 may be configured by a CPU or a DSP, for example. The control unit 82 determines the human face from the video output from the image capturing unit 81. The control unit 82 cuts out the face of the determined person and transmits the face data (still image) of the cut-out face to the server 2 via the communication unit 84.

The card communication unit 83 performs short-range wireless communication with the card held over the card reader 71a.

The communication unit 84 communicates with the server 2. The communication unit 84 may communicate with the server 2 via a network cable such as an Ethernet cable, for example. The communication unit 84 may communicate with the server 2 via short-range wireless communication such as Wi-Fi or Bluetooth.

The storage unit 85 stores a program for operating the control unit 82. In addition, the storage unit 85 stores data for the control unit 82 to perform calculation processing, data for the control unit 82 to control each unit, and the like. The storage unit 85 may be configured by a storage device such as RAM, ROM, flash memory, and HDD.

In the following, in order to simplify the explanation, the detection of the occupants in the zones A and B will be described.

FIG. 13 is a diagram showing an example of a table stored in the storage unit 23 of the server 2. The table TB21 has zone identification information 41a and face data 41b, like the table TB1 described in FIG.

The table TB21 shown in FIG. 13 is generated based on the face data transmitted from the card readers 71a to 71c and the zone identification information. As described above, the face data and the zone identification information are transmitted from the card readers 71a to 71c when the person can enter the zones A and B. Therefore, the table TB21 can be said to be information indicating the persons who have entered the zones A and B.

For example, it is assumed that a person enters the zone A with a card having a face photograph of the face data 41ba. In this case, the server 2 receives the face data 41ba and the zone identification information A from the card reader 71a provided at the entrance of the zone A. As a result, the information indicated by the dotted frame A11 is registered in the table TB21 of FIG.

Further, it is assumed that a person enters the zone A by using the card with the face photograph of the face data 41bb. In this case, the server 2 receives the face data 41bb and the zone identification information A from the card reader 71a provided at the entrance of the zone A. As a result, the information indicated by the dotted frame A12 is registered in the table TB21 of FIG.

Further, it is assumed that a person enters the zone B by using the card with the face photograph of the face data 41bc. In this case, the server 2 receives the face data 41bc and the zone identification information B from the card reader 71b provided at the entrance of the zone B. As a result, the information indicated by the dotted frame A13 is registered in the table TB21 of FIG.

Although the table TB21 is stored in the storage unit 23 of the server 2 in FIG. 13, the present invention is not limited to this. The table TB21 may be stored in the registration DB. Below, the table TB21 is assumed to be stored in the registration DB.

FIG. 14 is a sequence diagram showing an operation example of the surveillance camera system. In FIG. 14, it is assumed that the grouping settings of the zones A and B and the cameras 1a to 1c (for example, the process of step S1 in FIG. 8) are completed. That is, it is assumed that the table TB2 shown in FIG. 7 is stored in the storage unit 23 of the server 2. In FIG. 14, description of the processing of the monitoring cameras 1b and 1c and the card reader 71b installed in the zone B is omitted.

The card reader 71a acquires the card information of the swiped card. The card reader 71a unlocks the entrance door of the zone A on the basis of the acquired card information, and photographs the held card. The control unit 82 of the card reader 71a cuts out the face photograph attached to the card from the photographed card, and transmits the face data of the cut face photograph and the zone identification information of the zone A to the server 2 (step S31).

The control unit 21 of the server 2 performs face registration in the registration DB based on the information transmitted in step S31 (step S32). For example, the control unit 21 of the server 2 registers the information of the dotted frame A11 shown in FIG. 13 in the table TB21 of the registration DB.

Here, in step S31, the card held over the card reader 71a is assumed to be a stolen card. For example, it is assumed that the person with the face data 91 shown in FIG. 14 impersonates the person with the face data 92 shown in FIG. 14 and enters the zone A using the theft card.

It is assumed that the imaging unit 11 of the monitoring camera 1a in the zone A has photographed a person (a person having a face in the face data 91). The control unit 12 of the surveillance camera 1a cuts out a person's face from the video imaged by the imaging unit 11, and transmits the face data of the cut-out face and the camera identification information of the surveillance camera 1a to the server 2 (step S33). ).

The control unit 21 of the server 2 receives the face data transmitted in step S33 and the camera identification information of the surveillance camera 1a (step S34).

The control unit 21 of the server 2 refers to the table TB2 of the storage unit 23 and acquires the zone identification information corresponding to the camera identification information received in step S34 (step S35).

In the example of FIG. 14, the control unit 21 of the server 2 receives the camera identification information “1a” of the surveillance camera 1a in step S33. Therefore, the control unit 21 of the server 2 acquires the zone identification information “A” of the zone A from the table TB2 of FIG. Thereby, the control unit 21 of the server 2 can specify that the face data 91 received in step S34 is taken by the surveillance camera 1a installed in the zone A. In other words, the control unit 21 of the server 2 can specify that the person with the face of the face data 91 received in step S34 is in the zone A.

When the zone is specified in step S35, the control unit 21 of the server 2 refers to the table TB21 of the registration DB and acquires the face data corresponding to the specified zone. Then, the control unit 21 of the server 2 collates the face data acquired from the table TB21 with the face data received in step S34 (step S36).

In the example of FIG. 14, the control unit 21 of the server 2 specifies that the person with the face of the face data 91 is in the zone A in step S35. Therefore, the control unit 21 of the server 2 collates the face data 41ba and 41bb corresponding to the zone A of the table TB21 shown in FIG. 13 with the face data 91 received in step S34. Since the face data 91 does not match the face data 41ba and 41bb corresponding to the zone A shown in FIG. 13, the control unit 21 of the server 2 determines that the face matching does not match. That is, the control unit 21 of the server 2 determines that the person of the face data 91 is a person who is not permitted to enter the zone A.

The control unit 21 of the server 2 transmits the matching result of step S36 to the terminal device 3 (step S37). The control unit 31 of the terminal device 3 receives the matching result of the face matching NG and displays an alert on the display device, for example.

As described above, the communication unit 22 of the server 2 receives the face image data of the face photograph attached to the card from the card readers 71a to 71c provided corresponding to each of the plurality of zones A to C. .. The control unit 21 of the server 2 stores the received face image data as face data in the table TB21. Thereby, the server 2 can determine whether or not a person other than the person determined for each of the zones A to C has entered the zones A to C.

(Modification 1)
Although the card readers 71a to 71c take the face photograph attached to the card and transmit the face data of the face photograph to the server 2, the present invention is not limited to this. For example, the card may be equipped with an IC (Integrated Circuit). The IC may store face data of an employee who has a card. The card readers 71a to 71c may acquire face data from an IC mounted on the card and send it to the server 2.

(Modification 2)
The card readers 71a to 71c may transmit the name read from the card or the card identification information of the card to the server 2. When receiving the name or the card identification information transmitted from the card readers 71a to 71c, the control unit 21 of the server 2 may receive the face data corresponding to the name or the card identification information from the server that manages the card information. .. Then, the control unit 21 of the server 2 may generate the table TB21 shown in FIG. 13 based on the received face data and the zone identification information received from the card readers 71a to 71c. In the server that manages the card information, the face data of the person who owns the card and the name or the card identification information are stored in association with each other.

(Modification 3)
The monitoring camera system including the card readers 71a to 71c has been described as an example installed in a company, but the invention is not limited to this. The surveillance camera system including the card readers 71a to 71c may be installed in an apartment or a commercial facility.

Each functional block used in the description of the above embodiment is typically realized as an LSI which is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include some or all of them. The name used here is LSI, but it may also be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

Further, the method of circuit integration is not limited to LSI, and it may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor capable of reconfiguring the connection and setting of circuit cells inside the LSI may be used.

Furthermore, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. The application of biotechnology is possible. Further, the respective embodiments may be combined.

INDUSTRIAL APPLICABILITY The surveillance camera system of the present disclosure is useful in a surveillance camera system that determines whether or not a person other than the person determined for each zone is in the zone.

1a to 1d Surveillance camera 2 Server 3,61 Terminal device 11,81 Imaging unit 12, 21, 31, 82 Control unit 13, 22, 34, 84 Communication unit 14, 23, 35, 85 Storage unit 32 Input unit 33 Display unit 41a, 42a Zone identification information 41b, 41ba to 41bc, 51, 52, 91, 92 Face data 42b, 42ba to 42bc Camera identification information 71a to 71c Card reader 83 Card communication unit A to C Zone A1 Building

The present disclosure relates to an information processing device , a determination method, and a program .

Claims (6)

A communication unit that receives face image data from a camera that captures each of a plurality of zones of a building,
The face image data is compared with registered face image data of a person who is permitted to enter each zone, and permission/non-permission of entry of the person of the face image data in the zone where the face image data is photographed is determined. A control unit for judging,
Information processing device having a. The communication unit receives camera identification information from a camera that has photographed the person in the face image data,
The control unit refers to a table in which the camera identification information of each of a plurality of cameras and the plurality of zones are associated with each other, and identifies a shooting zone in which a person of the face image data is shot.
The information processing apparatus according to claim 1. The control unit is
The registered face image data and the registered face image data of the person permitted to enter the photographing zone are referred to by referring to a table in which the zone of the registered face image data where the person is permitted to enter is linked. Acquired,
The acquired registered face image data is compared with the face image data, and it is determined whether or not the person in the face image data is a person who is permitted to enter the photographing zone.
The information processing apparatus according to claim 2. The communication unit receives card face image data from a card reader provided corresponding to each of the plurality of zones,
The control unit associates the card face image data as the registered image data with a zone of the registered face image data that is permitted to enter a person,
The information processing device according to claim 3. The control unit determines whether or not it is time for the person of the face image data to enter the zone in which the person of the face image data is photographed,
The information processing device according to any one of claims 1 to 4. Receive face image data from a camera that captures each of multiple zones in the building,
The face image data is compared with registered face image data of a person who is permitted to enter each zone, and permission/non-permission of entry of the person of the face image data in the zone where the face image data is photographed is determined. judge,
Judgment method.

Images