JP6364371B2 - Entrance / exit management system - Google Patents

Description

  The present invention relates to an entrance / exit management system.

  An entrance / exit management system for identifying a person entering and exiting a building from an image has been put into practical use. In Patent Document 1, the number of entrance / exit candidates including a prospective entrance / exit candidate who can enter / exit a building from a photographed image is counted and the number of non-entry / exiters is calculated from an image after the entrance / exit candidate enters / exits. There is disclosed an invention of an entrance / exit management device that counts and determines whether or not there is unauthorized entry based on whether or not the difference between the number of entrance / exit scheduled persons and the number of entrance / exit candidates exceeds the number of unentered / exited persons.

JP 2010-2111510 A

  However, although the entrance / exit management device described in Patent Document 1 can grasp the number of visitors / entrants and the number of unauthorized visitors from an image, it does not consider authenticating and identifying each of the visitors / entrants. was there.

  The present invention has been made in consideration of the above-described facts, and an object thereof is to provide an entrance / exit management system that can identify the entrance / exit of a building and grasp the position of the specified entrance / exit.

  According to a first aspect of the present invention for solving the above-described problem, a person position detecting unit is provided at an entrance of a building and detects the position of a person existing near the entrance of the building, and the person position detecting unit detects the position. A first identifier setting unit for setting a first identifier for the person who has taken the image, a photographing unit for photographing a face of a person existing in an area detected by the person position detecting unit, and a human face on an image photographed by the photographing unit A second identifier setting unit for identifying the person and setting a second identifier based on the position of the person's face on the image, thereby associating the second identifier with the specified person, and the first identifier setting The first identifier is associated with the person specified by associating the first identifier set by the section with the second identifier set by the second identifier setting section, and the position of the person specified by the second identifier setting section is determined. The person position It is detected by the knowledge unit, and a, and entry and exit determining section determining entry and exit to the building of the specified person.

  According to the first aspect of the present invention, the first identifier set by the first identifier setting unit is associated with the second identifier set by the second identifier setting unit. The person identified by the association can be associated with the first identifier associated with the person position detection unit, and the person position detection unit can detect the position of the person identified by the second identifier setting unit. Become.

  According to a second aspect of the present invention, in the first aspect of the invention, the first position specifying unit is configured so that the person position detecting unit sequentially detects the person located at a predetermined end in the left-right direction. A first identifier is set, and the second position specifying unit sets the second identifier in order from the person located at the predetermined end in the left-right direction in the image captured by the imaging unit, and the entrance / exit The determination unit associates the first identifier and the second identifier in the same set order.

  According to the second aspect of the present invention, the first identifier and the second identifier are set in the same order by the first identifier setting unit and the second identifier setting unit, so that the first identifier and the second identifier Correspondence becomes easy.

  According to a third aspect of the present invention, in the first or second aspect of the present invention, when the person specified by the second identifier setting unit includes a person related to the building, the room for photographing the inside of the building The photographing of the photographing unit is turned off, and the photographing of the indoor photographing unit is turned on when the person specified by the second identifier setting unit does not include a person related to the building.

  According to invention of Claim 3, operation | movement of the surveillance camera in a building can be suitably controlled by whether the person specified from the image is a related person of a building.

  As described above, the invention described in claim 1 relates to the change in the position of the specified person by associating the first identifier related to the detection of the position of the person with the second identifier related to the specification of the person. I can grasp. As a result, it is possible to identify the entrance / exit of the building and grasp the location of the specified entrance / exit.

  According to the second aspect of the present invention, it is possible to grasp a change in the position of the specified person by associating the first identifier related to the detection of the position of the person with the second identifier related to the specification of the person. As a result, it is possible to identify the entrance / exit of the building and grasp the location of the specified entrance / exit.

  According to the third aspect of the present invention, the surveillance camera can be appropriately controlled by specifying the person in the building.

It is the schematic which shows an example of the entrance / exit management system which concerns on embodiment of this invention. It is the schematic which looked at the entrance from the outdoor side. It is a block diagram which shows schematic structure of the home controller in the entrance / exit management system which concerns on embodiment of this invention. It is the schematic which showed an example of operation | movement of an indoor position detection sensor, an outdoor position detection sensor, and an indoor face authentication camera. It is the sequence diagram which showed an example of operation | movement of the entrance / exit management system which concerns on embodiment of this invention. It is a flowchart which shows an example of the monitoring authentication process of the entrance / exit management system which concerns on embodiment of this invention.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram showing an example of an entrance / exit management system 10 according to the present embodiment. As shown in FIG. 1, the entrance / exit management system 10 according to the present embodiment has an indoor position for detecting the position of a person on the indoor side and the outdoor side above the door 52 provided at the entrance 54. A detection sensor 58A and an outdoor position detection sensor 58B are provided.

  The indoor position detection sensor 58A and the outdoor position detection sensor 58B are, for example, sensors for irradiating a laser to detect the position of a person existing near the door 52 of the entrance 54, and the indoor position detection sensor 58A is the entrance 54. The outdoor position detection sensor 58B detects the position of a person in the vicinity of the entrance 54 and the position of the person in the vicinity of the entrance 54.

The indoor position detection sensor 58A and the outdoor position detection sensor 58B detect the phase difference between the phase of the irradiated laser and the phase of the laser reflected by the object and returned to the indoor position detection sensor 58A and the outdoor position detection sensor 58B, respectively. To do. The indoor controller 30, which is a control device for the indoor position detection sensor 58A and the outdoor position detection sensor 58B, detects the position of the detected object based on the phase difference detected by the indoor position detection sensor 58A and the outdoor position detection sensor 58B. The size of the object can be grasped. Based on the detected size of the object, it can be determined whether the object is a person or an animal such as a dog or cat. The indoor position detection sensor 58A and the outdoor position detection sensor 58B may use sensors such as a millimeter wave radar in addition to the laser.

  On the side of the door 52, an indoor face authentication camera 56A and an outdoor face authentication camera 56B for photographing a face of a person approaching the door 52 are provided. The indoor face authentication camera 56A is provided on the indoor side of the entrance 54 and photographs the face of a person approaching the door 52 from the back of the building. The outdoor face authentication camera 56B is provided on the outdoor side of the entrance 54, and photographs the face of a person approaching the door 52 from the outside.

  The indoor face authentication camera 56A captures a person's face existing in the area detected by the indoor position detection sensor 58A, and the outdoor face authentication camera 56B captures a person's face present in the area detected by the outdoor position detection sensor 58B. Installed.

  The indoor face authentication camera 56A and the outdoor face authentication camera 56B continuously shoot, and the home controller 30 that is a control device of the indoor face authentication camera 56A and the outdoor face authentication camera 56B detects a person's face from the captured image. , Perform human face authentication. Alternatively, each of the indoor face authentication camera 56A and the outdoor face authentication camera 56B is provided with a human sensor that detects infrared rays emitted by the person, and when the human sensor detects the person, the person's face is photographed and photographed. The person's face may be authenticated using the image.

  There are various methods for authentication (face authentication) by identifying a person's face. In the present embodiment, the entrance / exit management system 10 as a person who is permitted to enter a building such as a resident from the arrangement pattern of the facial organs such as nose, eyebrows, eyes, mouth, cheeks, etc. It is determined whether or not the user is registered.

  In the building, a home camera 60 capable of photographing the trends of persons in the room is provided on the inner wall 40 of the building, and the home camera 60 is controlled by a home controller 30 as a control device. The In addition, an indoor position detection sensor 62 is provided inside the building to detect the presence or absence of a person and the position of the person in the building.

  The home position detection sensor 62 is, for example, a sensor for irradiating a laser to detect the presence / absence of a person and the position of the person, but may be a sensor using a millimeter wave radar.

  FIG. 2 is a schematic view of the entrance 54 as viewed from the outdoor side. As shown in FIG. 2, the outdoor position detection sensor 58B is provided above the door 52, and detects the position of the person by irradiating the person approaching the door 52 with a laser. The outdoor face authentication camera 56 </ b> B is provided on the left side of the door 52, and photographs the face of a person approaching the door 52 from the outdoor side.

  FIG. 3 is a block diagram showing a schematic configuration of the home controller 30 in the entrance / exit management system 10 according to the present embodiment. The home controller 30 includes a CPU (Central Processing Unit) 12, a HDD (Hard Disk Drive) 14, a RAM (Random Access Memory) 16, a network I / F unit 18, and a ROM (Read Only Memory) 20. . The home controller 30 includes a display unit 22, an operation input unit 24, and a bus 26, and has functions of a terminal for inputting information and a terminal for displaying information.

  The CPU 12 governs the overall operation of the home controller 30. The HDD 14 is a non-volatile storage device in which a control program for each camera, an image processing program, a face authentication program, an OS (Operating System), data for execution of each program, and the like are recorded. The HDD 14 also stores data for face authentication of the occupants of the building. Specifically, the data for face authentication of the resident of the building is an arrangement pattern on the face of a facial organ such as the nose, eyebrows, eyes, mouth, and cheeks of the resident. The RAM 16 is a volatile storage device in which an OS, a program, or data is expanded. The network I / F unit 18 is for connecting to a network, and includes a NIC (Network Interface Card) and its driver. The ROM 20 is a non-volatile storage device that stores a boot program that operates when the home controller 30 is activated. The display unit 22 displays information related to the entrance / exit management system 10 to the user. The operation input unit 24 is used when a user inputs operations and information of the entrance / exit management system 10, and examples thereof include an input device such as a touch panel and a keyboard and a pointing device such as a trackball, a pen tablet, and a mouse. included. The bus 26 is used when information is exchanged.

  The display unit 22 displays an image captured by each camera. For example, in the case of an image of the indoor face authentication camera 56 </ b> A, the face image of the person to be authenticated is displayed on the screen of the display unit 22.

  FIG. 4 is a schematic diagram illustrating an example of operations of the indoor position detection sensor 58A, the outdoor position detection sensor 58B, and the indoor face authentication camera 56A. In the situation 1 of FIG. 4, the indoor position detection sensor 58A detects three persons approaching the entrance 54 from the back of the building, and the in-home controller 30 sets an ID for each person based on the positional relationship of the persons. . There are various modes of ID assignment. As an example, ID (1), ID (2), and ID (3) are assigned in order from the person located at the left end to the person located on the right side with respect to the indoor position detection sensor 58A. Set. Alternatively, IDs of ID (1), ID (2), and ID (3) may be set in order from the person located at the right end to the person located on the left side with respect to the indoor position detection sensor 58A.

  The indoor face authentication camera 56A captures the face of the person detected by the indoor position detection sensor 58A. The in-home controller 30 identifies the person by performing face authentication of the person photographed by the indoor face authentication camera 56A, and sets an ID in order from the person located at the left end of the image, and assigns the person identified by face authentication. Match IDs.

  In the present embodiment, IDs may be set in order from the person located at the right end of the image, but the order in which IDs are set is the same as in the case of the indoor position detection sensor 58A described above. That is, if IDs are set in order from the leftmost person among the persons detected by the indoor position detection sensor 58A, IDs are set in order from the person positioned at the left end in the image captured by the indoor face authentication camera 56A.

  Then, the ID set based on the detection result of the indoor position detection sensor 58A is associated with the ID set based on the image captured by the indoor face authentication camera 56A. In this embodiment, IDs having the same set order are associated with each other. For example, IDs (1), ID (2), and ID (3) are set in order from the person located at the left end to the person located on the right side with respect to the indoor position detection sensor 58A, and the indoor face authentication camera 56A takes a picture. When the ID of ID (1), ID (2), ID (3) is set in order from the person located at the left end of the image to the person located on the right side, ID (1), ID (2), IDs (3) are associated with each other.

  By associating the IDs described above, the ID set based on the detection result of the indoor position detection sensor 58A can be associated with the person specified from the image taken by the indoor face authentication camera 56A. The position of the specified person can be detected by the sensor 58A.

  When the association between the IDs is completed, the in-home controller 30 determines that the person at home is a family A (ID (1)), a family B (ID (2)), and other than the family (ID (3) from the result of the face authentication. )) Is a total of 3 people.

  Situation 2 in FIG. 4 is a situation in which family B (ID (2)) and others (ID (3)) go out, and family B (ID (2)) and others (ID (ID) outside the entrance 54). (3)) is detected by the outdoor position detection sensor 58B. The indoor face authentication camera 56A captures only the family A (ID (1)), and the in-home controller 30 stores that the resident is the family A (ID (1)).

  Situation 3 in FIG. 4 is a situation in which family A (ID (1)) returns to the back of the building. The indoor position detection sensor 58A detects the family A (ID (1)) that is moving away, and the indoor face authentication camera 56A captures only the family A (ID (1)). The in-home controller 30 stores that the resident is the family A (ID (1)).

  FIG. 5 is a sequence diagram showing an example of the operation of the entrance / exit management system 10 according to the present embodiment. (1) The person specifying unit in the home controller 30 that controls the indoor face authentication camera 56A and the outdoor face authentication camera 56B performs face authentication of the person from the photographed image, and whether the person is a family that has been registered for authentication. Identify the person.

  The (3) second position specifying unit in the home controller 30 that controls the indoor position detection sensor 58A and the outdoor position detection sensor 58B specifies the two-dimensional position of the object detected by each sensor. The indoor position detection sensor 58A and the outdoor position detection sensor 58B, which are provided above the door 52 and irradiate a laser downward so as to look down, are positions on the plane of the object to be detected, for example, the left and right or front and rear of the object. The position is detected relatively. In the present embodiment, the position of the object on the plane detected by each sensor is defined as a two-dimensional position.

  The (2) first position specifying unit in the in-home controller 30 that controls the indoor face authentication camera 56A and the outdoor face authentication camera 56B specifies the position in the left-right direction in the image, and sequentially identifies the position from the left of the person who specified the position. Set. By this ID setting, the person specified from the image as described above is managed by the ID.

  The (3) second position specifying unit in the home controller 30 that controls the indoor position detection sensor 58A and the outdoor position detection sensor 58B sets IDs in order from the left of the object specifying the two-dimensional position.

  Subsequently, the (4) person position specifying unit of the home controller 30 associates the IDs set by (2) the first position specifying unit and (3) the second position specifying unit, and grasps the position of the specified person. To do.

  (4) In order to determine the number of people at home and the person, the person position specifying unit determines whether to go out or stay at home from the movement and position of the person with each ID. And the person who stays at home and the number of people are determined.

  (4) The person position specifying unit controls the home camera 60 based on the control described later with reference to FIG.

  FIG. 6 is a flowchart showing an example of the monitoring authentication process of the entrance / exit management system 10 according to the present embodiment. In step 600, when the home position detection sensor 62 detects a person in the building, it is determined that there is one or more people at home, and when no person is detected in the building, it is determined that the person is away. In step 602, the photographing of the home camera 60 is turned on for security, and the process returns.

  If it is determined in step 600 that there is a person at home, the person who is at home is specified in step 604, and if the person at home is a person other than the family, photographing by the home camera 60 is performed for security in step 606. Turn on and return the process.

  In step 604, the family member is included in the at-home person, but if there are persons other than the family member, it is determined in step 608 whether or not there is a guardian such as a parent. If the determination in step 608 is negative, in step 610, shooting of the home camera 60 is turned on for security, and the process returns.

  If the determination in step 608 is affirmative, in step 612, shooting by the home camera 60 is turned off and the process returns.

  If it is determined in step 604 that the person at home is only a family member, it is determined in step 614 whether there is a parent or guardian. If the determination in step 614 is affirmative, in step 616, shooting of the home camera 60 is turned off and the process returns.

  If the determination in step 614 is negative, it is determined in step 618 whether or not the child watching setting for watching the child is on for security. If the determination is affirmative, in step 620, shooting of the home camera 60 is turned on. To return the processing. If the determination in step 618 is negative, in step 622, shooting of the home camera 60 is turned off and the process returns.

  As described above, according to the present embodiment, the person entering and leaving the building is identified from the image, and an ID is set for the person identified from the image. Furthermore, a specific ID is set for a person whose position is detected by a laser sensor or the like, and the specified position of the person can be detected by a laser sensor or the like by associating the ID with the ID set from the above-described image. It is possible to provide an entrance / exit management system capable of grasping the location of the visitors.

  In this embodiment, sensors and cameras are provided on the indoor side and the outdoor side of the entrance, respectively.For example, sensors and cameras are provided only on the indoor side. You may make it grasp the entrance and exit of.

  In the present embodiment, the person who is at home may be specified by face authentication by the home camera 60, and the change in the position of the person who is at home may be detected by the home position detection sensor 62.

10 Entrance / exit management system 12 CPU
14 HDD
16 RAM
18 Network I / F section 20 ROM
22 Display unit 24 Operation input unit 26 Bus 30 Home controller 40 Inner wall 52 Door 54 Entrance 56A Indoor face authentication camera 56B Outdoor face authentication camera 58A Indoor position detection sensor 58B Outdoor position detection sensor 60 Home camera 62 Home position detection sensor

Claims (3)

A person position detection unit that is provided at the entrance of the building and detects the position of a person existing near the entrance of the building;
A first identifier setting unit that sets a first identifier for the person whose position is detected by the person position detection unit;
A photographing unit for photographing a face of a person existing in an area detected by the person position detecting unit;
By identifying the person from the face of the person on the image captured by the photographing unit and setting the second identifier based on the position of the person's face on the image, the second identifier is made to correspond to the identified person A second identifier setting unit;
The first identifier is associated with the person specified by associating the first identifier set by the first identifier setting unit with the second identifier set by the second identifier setting unit, and is specified by the second identifier setting unit. An entry / exit determination unit that detects the position of the person who has been detected by the person position detection unit and determines entry / exit of the identified person into the building;
Entrance / exit management system with The first identifier setting unit sets the first identifier in order from a person located at a predetermined end in the left-right direction among the persons detected by the person position detection unit,
The second identifier setting unit sets the second identifier in order from the person located at the predetermined end in the left-right direction in the image captured by the imaging unit,
The entrance / exit management system according to claim 1, wherein the entrance / exit determination unit associates the first identifier and the second identifier in the same set order. When the person specified by the second identifier setting unit includes a person related to the building, the shooting of the indoor shooting unit for shooting the inside of the building is turned off, and the person specified by the second identifier setting unit is An indoor shooting control unit that turns on the shooting of the indoor shooting unit when a person concerned with the building is not included;
The entrance / exit management system according to claim 1 or 2, further comprising:

Images