JP6364372B2 - Regional monitoring system - Google Patents

Description

  The present invention relates to a regional monitoring system.

  An apparatus for photographing a person such as a monitoring camera is required to be able to continue photographing the person in response to the movement of the person as the subject. In Patent Document 1, a priority is set for feature information detected from each of a plurality of persons reflected in a photographed image, and the tracking device controls the camera so that the feature information having a high priority continues to be reflected in the photographed image. The invention is disclosed.

Japanese Patent No. 4957721

  However, the tracking device described in Patent Document 1 needs to keep the face to be tracked reflected in the captured image. Therefore, when the face of the person is hidden, there is a problem that it is difficult to track and photograph the person.

  The present invention has been made in consideration of the above-described facts, and an object of the present invention is to provide a regional monitoring system capable of tracking and tracking a person even if the face of the person to be monitored is hidden.

  In order to solve the above-mentioned problem, the invention of claim 1 is characterized in that the attribute information of the target person is obtained by comparing the feature information of the face of the target person included in the photographed image of the face authentication camera with the feature information registered in the face database. And a first person identifier setting unit that sets a first identifier in order from the target person located at a predetermined end in the left-right direction in the captured image, and the same direction as the direction in which the face authentication camera captures A second person identifier setting unit for setting a second identifier in order from a person located at the predetermined end in the left-right direction among the target persons detected by the detection unit installed in the direction; The attribute of the target person detected by the detection unit is specified by associating the identifier with the second identifier, the position of the person with the predetermined attribute is detected by the detection unit, and the person with the predetermined attribute is detected. And and a control unit for controlling the surveillance camera to allow shooting.

  According to the first aspect of the present invention, the identifier of the target person whose attribute is specified by face authentication using a captured image is associated with the identifier set based on the detection result of the detection unit that detects the position of the target person. Thus, the position of the person whose attribute is specified can be detected by the detection unit. Furthermore, it is possible to keep the surveillance camera directed at the person with the predetermined attribute detected by the detection unit.

  According to a second aspect of the present invention, in the first aspect of the present invention, the detection unit can detect a distance between the target persons, and the control unit can determine the target person as the person having the predetermined attribute. When the face database includes a plurality of face unregistered persons whose face feature information is not registered, the monitoring camera is set so as to photograph the face unregistered person whose attribute is the closest to the person who is a resident. Control.

  According to the second aspect of the present invention, when there are a plurality of face unregistered persons who are not residents, it is possible to preferentially track and photograph the face unregistered person closest to the residents.

  The invention according to claim 3 is the invention according to claim 1 or 2, further comprising a sound detection unit that detects a specific sound registered in advance in a sound database and a position of a sound source of the specific sound, and the control unit The position of the sound source of the specific sound detected by the sound detection unit matches the position of the person whose attribute is a resident, and the feature information of the face is stored in the face database as the person of the predetermined attribute in the target person. When a face unregistered person who is not registered is included, the surveillance camera is controlled so as to photograph the face unregistered person and a report is made to the authorities.

  According to the invention described in claim 3, when a resident operates a security buzzer or the like, a face unregistered person near the resident is determined as a suspicious person, and the face unregistered person is given priority. Track and shoot and notify authorities.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, when the person with the predetermined attribute is a wanted crime, the control unit is configured to photograph the wanted crime. Control and report to authorities.

  According to the fourth aspect of the present invention, it is possible to preferentially track and shoot the wanted criminals and notify the authorities.

  As described above, according to the first aspect of the present invention, the position of the person whose attribute is specified can be detected by the detection unit, and the monitoring camera is continuously directed to the person with the predetermined attribute detected by the detection unit. Even if the face of a target person is hidden, the person can be tracked and monitored.

  According to the second aspect of the present invention, it is possible to monitor a face unregistered person closest to the inhabitant as a monitoring target and track the monitoring target.

  According to the third aspect of the present invention, in a dangerous situation such as an operation of a security buzzer or the like, it is possible to preferentially track and photograph the monitoring target and notify the authorities.

  According to the invention described in claim 4, in a dangerous situation where there is a criminal arrangement criminal, it is possible to preferentially track and photograph the monitoring target and notify the authorities.

It is the schematic which shows an example of the regional monitoring system which concerns on embodiment of this invention. It is the schematic which showed an example of the structure of a street pole. It is the sequence diagram which showed an example of operation | movement of the regional monitoring system which concerns on embodiment of this invention. It is the schematic which showed an example of person ID setting in the regional monitoring system which concerns on embodiment of this invention. It is the table | surface which showed an example of the tracking priority of the system controller of the regional monitoring system which concerns on embodiment of this invention.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram showing an example of a regional monitoring system 10 according to the present embodiment. As shown in FIG. 1, the area monitoring system 10 according to the present embodiment includes a tracking camera 22A, 22B, 22C, 22D, 22E, a face authentication camera 24A, 24B, 24C, 24D, 24E, and a person position detection sensor 26A. , 26B, 26C, 26D, 26E and street poles 20A, 20B, 20C, 20D, and 20E each having sound detection sensors 28A, 28B, 28C, 28D, and 28E are areas to be monitored (hereinafter referred to as “monitored areas”). Are provided).

  The cameras and sensors included in each of the street poles 20 </ b> A to 20 </ b> E are connected to the information center 80 via the network 70. The network 70 is preferably a dedicated network in consideration of security, but security may be secured by a technique such as VPN (Virtual Private Network).

  The information center 80 identifies a person to be monitored (hereinafter referred to as “target person”) and controls the direction and angle of view of the tracking cameras 22A to 22E to photograph the target person. The information center 80 also takes measures such as notifying the authorities when the target person is in danger such as a wanted crime.

  FIG. 2 is a schematic diagram showing an example of the configuration of the street pole 20A. Since the configuration of the street poles 20B to 20E is the same as that of the street pole 20A, detailed description thereof will be omitted. A dedicated pole may be used as the street pole 20A, but a camera and a sensor may be provided in an existing facility such as a utility pole.

  The tracking camera 22A is a camera that tracks a target person and captures a moving image. The tracking camera 22A has a camera angle (direction), an angle of view, and the like of the tracking camera 22A so that the tracking camera 22A continues to reflect the target person in the captured image based on the control of the system controller 82 provided in the information center 80. A tracking control unit 22A1 for controlling the.

  The face authentication camera 24A performs face authentication of a person when detecting the face of the person from the captured image. There are various methods for authentication (face authentication) by identifying a person's face. In the present embodiment, the face authentication unit 24A1 extracts the facial pattern of facial organs such as the nose, eyebrows, eyes, mouth, and cheeks, and the extracted facial organ layout pattern is registered in the face database 24A2. The person having the extracted facial organ arrangement pattern (hereinafter referred to as “face registrant”) is authenticated by comparing with the arrangement pattern of the existing facial organ. The attribute of a person such as who is called “resident” is specified. Furthermore, not only the determination of the attribute such as whether or not the person is a resident, but also the specific resident who has been face-authenticated can be specified.

  The face database 24A2 is a database that stores the arrangement patterns of the facial organs of the residents in the monitoring target area, and the arrangement patterns of the facial organs of dangerous persons such as wanted persons.

  The authentication result of the face authentication unit 24A1 is input to the face position detection unit 24A3. The face position detection unit 24A3 detects the positional relationship of each person in the image captured by the face authentication camera 24A. In the present embodiment, paying attention to the positional relationship between the left and right of each person, the position of the person's face in the captured image is calculated. Further, the first person ID setting unit 24A4 sets an ID (identifier) for the person in the image. In the present embodiment, IDs are set in order from the person on the left in the photographed image to the person on the right in the photographed image. The ID may be set in order from the person shown on the right in the photographed image to the person shown on the left in the photographed image. The ID of each person set by the first person ID setting unit 24A4 of the face authentication camera 24A is transmitted to the system controller 82 in the information center 80.

  The person position detection sensor 26A is installed in the same direction as the direction in which the face authentication camera 24A shoots. For example, the person position detection sensor 26A irradiates a laser to detect an object such as a person existing in front of the person position detection sensor 26A. Sensor. The person position detection sensor 26A detects the phase difference between the phase of the laser irradiated by the person position detection sensor 26A and the phase of the laser reflected by the object and returned to the person position detection sensor 26A. Now, it is a sensor that can detect the distance between objects. The person position detection sensor 26A may be a sensor using millimeter wave radar.

  The person position detection unit 26A1 of the person position detection sensor 26A detects the position of the person existing in front of the person position detection sensor 26A based on the phase difference detected by the person position detection sensor 26A. Then, the second person ID setting unit 26A2 sets an ID for the person existing in front of the person position detection sensor 26A. In the present embodiment, IDs are set in order from the person who is leftmost among the persons detected by the person position detection sensor 26A. Of the persons detected by the person position detection sensor 26A, IDs may be set in order from the rightmost person, but the order of setting IDs is the same as in the case of the first person ID setting unit 24A4 described above. To do. That is, if the first person ID setting unit 24A4 has set IDs in order from the leftmost person in the captured image, the second person ID setting unit 26A2 is also the person detected by the person position detection sensor 26A. IDs are set in order from the leftmost person.

  The ID of each person set by the second person ID setting unit 26A2 of the person position detection sensor 26A is transmitted to the system controller 82 in the information center 80.

  The sound detection sensor 28A is a sensor that detects sound generated near the street pole 20A as stereo sound. The sound detected by the sound detection sensor 28A is output from the sound matching unit 28A1 in the sound detection sensor 28A. The specific sound is identified with reference to the specific sound database 28A2 in which the sound pattern of the specific sound (hereinafter referred to as “specific sound”) is registered. The sound pattern of the specific sound registered in the specific sound database 28A2 is, for example, a sound pattern of a security buzzer.

  The sound source position detection unit 28A3 in the sound detection sensor 28A detects the position of the sound source of the specific sound and transmits it to the system controller 82 in the information center 80 when the sound collation unit 28A1 detects the specific sound. The position of the sound source is specified based on the stereo sound detected by the sound detection sensor 28A.

  The system controller 82 of the information center 80 receives the person position to which the ID set by the first person ID setting unit 24A4 of the face authentication camera 24A and the ID set by the second person ID setting unit 26A2 of the person position detection sensor 26A are input. A specific unit 82A is provided. The person position specifying unit 82A specifies the attribute of the target person detected by the person position detecting sensor 26A by associating the ID set by the first person ID setting unit 24A4 with the ID set by the second person ID setting unit 26A2. To do.

  For example, the face authentication camera 24A identifies that the leftmost person in the image is a local resident by face authentication and is set to “ID01”, and is detected to the left by the person position detection sensor 26A. When “ID01” is set for a person, the following occurs. The person position specifying unit 82A sets the first person ID setting unit 24A4 by associating “ID01” set by the first person ID setting unit 24A4 with “ID01” set by the second person ID setting unit 26A2. The attribute “resident” associated with “ID01” is associated with “ID01” set by the second person ID setting unit 26A2.

  As a result, “ID01” set by the second person ID setting unit 26A2 can be detected by the person position detection sensor 26A as a person having the attribute of inhabitants, and further, a specific position can be detected by the person position detection sensor 26A. It is possible to detect a person having an attribute and continue to shoot the person with the tracking camera 22A, which is a monitoring camera, directed to the position where the person is detected.

  The person ID / sound source position distance calculation unit 82B in the system controller 82 receives the position of the person specified by the person position specifying unit 82A and the position of the sound source of the specific sound detected by the sound source position detection unit 28A3. For example, it is determined whether or not the position of the sound source corresponds to the position of a person such as a resident. Furthermore, a person who has an attribute of resident and a person who has a non-resident attribute and is not a face authentication data unregistered person (hereinafter referred to as “face unregistered person”) or a face registrant but a dangerous person such as a wanted person. The distance is calculated from the detection result of the person position detection sensor 26A.

  The tracking target determination unit 82C in the system controller 82 determines a tracking target to be tracked and photographed by the tracking camera 22A according to a predetermined tracking priority 82D, and continues to shoot the determined tracking target. 22A is controlled. In the present embodiment, among the target persons, a person having a predetermined attribute is preferentially set as a target for shooting. The predetermined attributes are, for example, a wanted crime and a face unregistered person.

  The face authentication unit 24A1, the face database 24A2, the face position detection unit 24A3, and the first person ID setting unit 24A4 of the face authentication camera 24A may be included in the system controller 82.

  Similarly, a person position detection unit 26A1 and a second person ID setting unit of the person position detection sensor 26A, a sound collation unit 28A1, a specific sound database 28A2, and a sound source position detection unit 28A3 of the sound detection sensor 28A are also included in the system controller 82. It may be.

  FIG. 3 is a sequence diagram showing an example of the operation of the regional monitoring system 10 according to the present embodiment. The face authentication unit 24A1 of the face authentication camera 24A performs face authentication of a person from the photographed image, and specifies a person attribute such as whether the person is a resident.

  The face position detection unit 24A3 of the face authentication camera 24A specifies the position in the left-right direction in the captured image, and the first person ID setting unit 24A4 sets the ID in order from the left of the person whose position is specified.

  The person position detection unit 26A1 of the person position detection sensor 26A detects an object from the detection result of the person position detection sensor 26A, and relatively determines the position on the plane of the object to be detected, for example, the left and right positions of the object. Identify.

  The second person ID setting unit 26A2 of the person position detection sensor 26A sets IDs in order from the left of the person whose position in the left-right direction is specified, for example.

  The person position specifying unit 82A of the system controller 82 associates the IDs set by the first person ID setting unit 24A4 and the second person ID setting unit 26A2, and grasps the attribute and position of the person of each ID. In the present embodiment, the first person ID setting unit 24A4 sets the ID from the left person of the photographed image, and the second person ID setting unit 26A2 sets the ID from the left side of the detected person. In such a case, IDs having the same order set by the first person ID setting unit 24A4 and the second person ID setting unit 26A2 are associated with each other. In the first person ID setting unit 24A4 and the second person ID setting unit 26A2, if the same ID is set when the set order is the same, the same IDs are associated with each other.

  The person position specifying unit 82A specifies the attribute of the person detected by the person position detecting sensor 26A by associating the ID set by the first person ID setting unit 24A4 with the ID set by the second person ID setting unit 26A2. To do. And by the above process, the attribute of the person in the vicinity of the street pole 20A is identified and the position of the person is grasped.

  Next, the grasping of the position by the specific sound will be described. The sound verification unit 28A1 of the sound detection sensor 28A specifies that the specific sound is, for example, a security buzzer sound. Then, the sound source position detection unit 28A3 of the sound detection sensor 28A specifies a two-dimensional position of the sound source, for example, a position in the left-right direction.

  The system controller 82 determines in the person ID position / sound source position distance calculation unit 82B whether or not the position of the sound source of the specific sound corresponds to the position of the resident, and further, the resident who is the sound source, the face unregistered person, etc. The distance is calculated.

  The tracking target determination unit 82C of the system controller 82 determines that the face unregistered person closest to the resident who is a face registrant whose face feature information is registered in the face database 24A2 satisfies the requirements described in the tracking priority 82D. It is determined whether or not the image is satisfied, and in the case of an affirmative determination, the tracking camera 22A is controlled to perform a procedure such as photographing the face unregistered person or the like and reporting to the authorities.

  FIG. 4 is a schematic diagram showing an example of person ID setting in the regional monitoring system 10 according to the present embodiment. As shown in (1) of FIG. 4, after identifying a person in the captured image by face authentication by the face authentication unit 24A1 of the face authentication camera 24A, the first person ID setting unit 24A4 sets an ID for each person. To do. The ID is set based on the positional relationship between the left and right within the image. In this embodiment, IDs are set in order from the person located at the left end in the image.

  Subsequently, as shown in (2) of FIG. 4, in the second person ID setting unit 26A2 of the person position detection sensor 26A, an ID is assigned to each person based on the position relationship of each person detected by the person position detection sensor 26A. Set. In the present embodiment, IDs are set in order from the person detected by the person position detection sensor 26A on the leftmost side.

  The ID setting order is the same as that of the first person ID setting unit 24A4 of the face authentication camera 24A. When the ID setting order is the same in the first person ID setting unit 24A4 and the second person ID setting unit 26A2, the ID set in the first person ID setting unit 24A4 and the ID set in the second person ID setting unit 26A2 May be the same. For example, as shown in FIG. 4, if the first person ID setting unit 24A4 sets “ID01” for the leftmost person, the second person ID setting unit 26A2 sets “ID01” for the leftmost person. To do.

  Thereafter, “ID02” is set to the person right next to the person “ID01”, and “ID03” is set to the person right next to the person “ID02”.

  In (3) of FIG. 4, the ID set by the first person ID setting unit 24A4 is associated with the ID set by the second person ID setting unit 26A2. As described above, the ID setting order is the same in the first person ID setting unit 24A4 and the second person ID setting unit 26A2, and the ID set in the first person ID setting unit 24A4 and the second person ID setting unit 26A2 If the IDs to be set are set in the same setting order, the same IDs may be associated with each other.

  FIG. 4 (4) shows a case where the face unregistered person of “ID02” is set as the tracking target of the tracking camera 22A. The resident “ID01” person does not exist within the shooting angle of view of the face authentication camera 24A, but the position is grasped by the person position detection sensor 26A.

  FIG. 5 is a table showing an example of the tracking priority 82D of the system controller 82. The tracking priority 82D is information stored in the storage means of the system controller 82. As an example, the tracking priority 82D defines six stages from “1” having the highest priority to “exclusion (no tracking)”.

  The tracking priority “1” in FIG. 5 is a case where a dangerous person such as a wanted person is photographed by the face authentication camera 24A. In the present embodiment, risk person data such as a wanted person is also registered in the face database 24A2 of the face authentication camera 24A. For a dangerous person with tracking priority “1”, threats and announcements are made to the dangerous person through broadcasting in the monitored area, and the person is tracked by the police and other authorities and by the tracking camera 22A. Continue shooting. For example, even when the person to be tracked disappears from the angle of view of the tracking camera 22A of the street pole 20A, the face tracking cameras 24B to 24E and the persons of the street poles 20B to 20E different from the street pole 20A The position detection sensors 26B to 26E supplement the tracking target person, and the tracking cameras 22B to 22E continue to capture the tracking target person.

  The tracking priority “2” is when the face unregistered person is in the captured image and a specific sound such as a security buzzer is detected. Even in such a case, since the risk to the residents is high, the face unregistered person is intimidated and announced to the residents by broadcast etc., and the face is not registered by the police and other authorities and the tracking camera 22A. The camera is being tracked.

  The tracking priority “3” is when the face unregistered person is in the captured image and a specific sound such as a security buzzer is not detected, but the distance between the face unregistered person and the child's inhabitants is short. . In such a case, monitoring by the tracking camera 22A is continued, and information on the location of the resident who is a child is transmitted to the guardian by e-mail or the like as necessary. The case where the distance is close means, for example, a case where the distance between persons is less than 1 m.

  Tracking priority “4” is when the face unregistered person is in the captured image and a specific sound such as a security buzzer is not detected, but when the distance between the face unregistered person and the adult female resident is short is there. In such a case, monitoring by the tracking camera 22A is continued.

  The tracking priority “5” is when the face unregistered person is in the captured image and a specific sound such as a security buzzer is not detected, but when the distance between the face unregistered person and the adult male resident is short. is there. In such a case, monitoring by the tracking camera 22A is continued.

  In addition, when there are a plurality of persons with a predetermined attribute such as face unregistered persons in the tracking priorities “3” to “5”, the person with the predetermined attribute closest to the person whose attribute is the resident To control the direction and angle of view of the tracking cameras 22A to 22E.

  And exclusion is a case where only the face registrant who is a resident is in the photographed image. In such a case, basically no danger is recognized, so monitoring by the tracking camera 22A is not performed.

  As described above, according to the present embodiment, the ID set based on the captured image of the face authentication camera and the ID set based on the detection result of the person position detection sensor are associated with each other by the monitoring target. Even if a person's face is hidden, the person can be tracked and monitored.

10 area monitoring system 20A, 20B, 20C, 20D, 20E street pole 22A, 22B, 22C, 22D, 22E tracking camera 22A1 tracking control unit 24A, 24B, 24C, 24D, 24E face authentication camera 24A1 face authentication unit 24A2 face database 24A3 Face position detection unit 24A4 First person ID setting unit 26A, 26B, 26C, 26D, 26E Person position detection sensor 26A1 Person position detection unit 26A2 Second person ID setting unit 28A, 28B, 28C, 28D, 28E Sound detection sensor 28A1 Sound Verification unit 28A2 Specific sound database 28A3 Sound source position detection unit 82 System controller 82A Person position specification unit 82B Person ID position / sound source position distance calculation unit 82C Tracking target determination unit 82D Tracking priority

Claims (4)

The feature information of the face of the target person included in the photographed image of the face authentication camera is compared with the feature information registered in the face database, and the attribute of the target person is specified, and in the left-right direction in the photographed image A first person identifier setting unit for setting a first identifier in order from the target person located at a predetermined end;
A second identifier is set in order from the person located at the predetermined end in the left-right direction among the target persons detected by the detection unit installed in the same direction as the direction in which the face authentication camera captures. A two person identifier setting unit;
By associating the first identifier and the second identifier, the attribute of the target person detected by the detection unit is specified, the position of the person with the predetermined attribute is detected by the detection unit, and the person with the predetermined attribute is detected. A control unit that controls the surveillance camera so that it can shoot,
Regional monitoring system with The detection unit can detect a distance between the target persons,
The control unit, when the target person includes a plurality of face unregistered persons whose face database does not have facial feature information registered as the person with the predetermined attribute, the distance from the person whose attribute is a resident The regional monitoring system according to claim 1, wherein the monitoring camera is controlled so as to photograph the face unregistered person who is closest. A sound detector that detects a specific sound registered in advance in the sound database and a position of a sound source of the specific sound;
The control unit is configured such that the position of the sound source of the specific sound detected by the sound detection unit matches the position of a person whose attribute is a resident, and the target database has a face in the face database as a person having the predetermined attribute. The area according to claim 1 or 2, wherein, when a face unregistered person whose feature information is not registered is included, the surveillance camera is controlled so as to photograph the face unregistered person and a report is made to the authorities. Monitoring system.   2. The regional monitoring according to claim 1, wherein when the person with the predetermined attribute is a wanted crime, the control section controls the monitoring camera so as to photograph the wanted crime and also notifies the authorities. system.

Images