JP2016194759A - Security system and security method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a security guard to ensure efficient security by using image data or video data imaged by an imaging device.SOLUTION: The security system images the inside of a security section by solid imaging devices C1 to C3 or the like, and tracks a person H1 on the basis of a plurality of pieces of image data including the same person H1 imaged by the solid imaging devices C1 to C3 or the like, and detects the behavior feature of the tracked person H, and associates security information based on the behavior feature. A security guard G1 images the neighborhood of his or her own visual field by a wearable camera, and requests a management device 10 to collate the person included in the captured image data. When the person included in the image data is the person H1, the management device 10 notifies the security guard of the corresponding security information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a security system and a security method capable of performing efficient security using image data or video data captured by an imaging device when performing security by a security guard.

  Conventionally, a technique has been known in which a plurality of monitoring cameras are provided in a monitoring area, image data captured by each monitoring camera is transmitted to a monitoring center, and the monitoring center displays the locus of a suspicious person using these image data. Yes. For example, Patent Document 1 discloses an intruder monitoring system that detects an intruder who has entered a monitoring area and displays an image and a trajectory of the detected intruder on a monitor. The video server includes a plurality of monitoring areas. The background image of the blind spot area that cannot be captured by the camera is displayed by interpolating from the image captured around the blind spot area, and the position and trajectory of the intruder that passes through the blind spot area is entered immediately before entering the blind spot area. A technique is disclosed in which a bird's-eye view image is created so that a movement is predicted from a person's trajectory and an intruder image acquired immediately before entering the blind spot area along the movement predicted trajectory is displayed as a clipped image.

  Although the thing of this patent document 1 is effective when performing the monitoring activity using a monitor, when actually performing the guard by the guard, the supervisor gives various instructions to the guard. It must be done, and it cannot perform quick and efficient security.

  For this reason, for example, using a conventional head-mounted display device typified by Patent Document 2, the overhead image of Patent Document 1 is displayed on the head-mounted display device possessed by the security guard, and the security guard tracks the intruder, etc. It is also conceivable to make it possible to see the image directly.

JP 2014-72598 A JP 2014-174510 A

  However, even if the above measures are taken and a bird's-eye view image is displayed on the head-mounted display device possessed by the guard, the guard is expected to be at a loss as to how to use this bird's-eye view image for security. However, there is a problem that it is difficult to make use of such a bird's-eye view image for quick and efficient security.

  Further, when the conventional head mounted display device represented by the above-mentioned Patent Document 2 is used, a security guard images a person with a wearable camera mounted on the head mounted display device and transmits the image data to the monitoring center. Determines whether this person matches one of the blacklisted persons, and if it matches, informs the security guard of that fact and head-mounts the fictitious image including the notification result. It is possible to display on the display device.

  However, even if such a head-mounted display device is used, it can be applied only when a suspicious person is blacklisted in advance, even if there is a person who behaves suspiciously, When the blacklist is not registered, there is a problem that information cannot be notified to the security guard and efficient security cannot be performed.

  For these reasons, when performing security by a security guard, it is an important issue how to perform efficient security in real time using image data captured by the imaging device.

  The present invention has been made to solve the above-described problems of the prior art, and when performing security by a security guard, efficient security is achieved by using image data or video data captured by an imaging device. It is an object to provide a security system and a security method that can be performed.

  In order to solve the above-described problems and achieve the object, the invention according to claim 1 is a server that performs image processing of at least a plurality of imaging devices that capture images in a security area and image data captured by at least each imaging device. A security system including a device and a mobile terminal device having at least a display unit that is carried by a security guard capable of communicating with the server device, wherein the server device includes the same subject imaged by each imaging device Based on a plurality of image data, behavior feature detection means for detecting the behavior feature of the target person, and notification means for notifying the mobile terminal device of security information based on the behavior feature detected by the behavior feature detection means It is characterized by comprising.

  The invention according to claim 2 is the invention according to claim 1, further comprising tracking means for tracking the behavior of the target person using image data captured by the plurality of imaging devices. The detecting means detects the behavior feature from a change in the state of the subject tracked by the tracking means.

  The invention described in claim 3 is the invention described in claim 1 or 2, further comprising storage means for storing the behavior feature in association with security information that is information related to security, the behavior feature detection. When the security information corresponding to the detected behavior feature is stored in the storage means, the means registers the target person indicating the detected behavior feature as a target of caution, and corresponds to the detected behavior feature The security information to be associated is associated with the subject to be watched.

  According to a fourth aspect of the present invention, in the third aspect of the present invention, the mobile terminal device further includes an imaging unit that captures an image of the vicinity of the field of view of the guard, and the notification unit includes the imaging unit. When the imaged image data includes the attention target object, security information associated with the attention object is notified to the mobile terminal device.

  The invention according to claim 5 is the invention according to claim 4, wherein the imaging unit is used as one of the plurality of imaging devices.

  The invention according to claim 6 is the invention according to claim 4 or 5, wherein the display unit has a transmission screen arranged in the field of view of the guard, and the view in the field of view of the guard The security information is projected in accordance with the position of the target to be watched.

  The invention according to claim 7 is the invention according to any one of claims 3 to 6, further comprising guard arrangement management means for managing the arrangement of the guards, wherein the notification means When the current position of the attention target is specified, the security information is notified to a mobile terminal device of a guard located within a predetermined range from the current position of the attention target.

  The invention according to claim 8 includes a portable terminal device including at least a display unit and an imaging unit carried by a security guard, and a server device that performs image processing of image data captured by the imaging unit. In the security system, the server device detects behavior characteristics of the target person based on a plurality of image data including the same target person imaged by the imaging unit, and the behavior characteristic And a notification means for notifying the portable terminal device of security information based on the behavior feature detected by the detection means.

  According to a ninth aspect of the present invention, there are provided a plurality of imaging devices that image the inside of a security area, a server device that performs image processing of at least image data captured by each imaging device, and a security that can communicate with the server device. A security method by a security system including at least a portable terminal device having a display unit carried by an employee, and based on a plurality of image data including the same target person imaged by each imaging device, the behavior of the target person It includes a behavior feature detection step for detecting a feature, and a notification step for notifying the mobile terminal device of security information based on the behavior feature detected by the behavior feature detection step.

  The invention described in claim 10 includes a portable terminal device including at least a display unit and an imaging unit carried by a security guard, and a server device that performs image processing of image data captured by the imaging unit. A security method by a security system, the behavior feature detecting step for detecting the behavior feature of the subject based on a plurality of image data including the same subject imaged by the imaging unit, and the behavior feature detecting step A notification step of notifying the portable terminal device of security information based on the behavioral feature detected by.

  According to the present invention, the inside of a security area is imaged by a plurality of imaging devices, the behavior characteristics of the target person are detected based on a plurality of image data including the same target person, and the security guard is provided with security information based on the behavior characteristics. Since notification is given to the portable terminal device that is carried, when guarding by a guard, efficient guarding can be performed using image data or video data captured by the imaging device.

  Further, according to the present invention, the inside of the security area is imaged by the portable terminal device carried by the security guard, the behavior feature of the subject is detected based on a plurality of image data including the same subject, and based on the behavior feature Since the guard information is notified to the portable terminal device carried by the guard, when guarding by the guard, efficient guard can be performed using image data or video data captured by the imaging device. .

FIG. 1 is an explanatory diagram of an outline of security according to the embodiment. FIG. 2 is a block diagram showing an internal configuration of the management apparatus shown in FIG. FIG. 3 is an explanatory diagram of the imaging device installation data and the guard arrangement data. FIG. 4 is an explanatory diagram of person tracking data. FIG. 5 is an explanatory diagram of definition data and data requiring attention. FIG. 6 is a block diagram showing the internal configuration of the security guard terminal shown in FIG. FIG. 7 is a flowchart showing the procedure of the registration processing of the attention target by the management apparatus. FIG. 8 is a flowchart illustrating a procedure for notifying a target of attention by the management apparatus. FIG. 9 is an explanatory diagram of a specific example of leaving the bag. FIG. 10 is an explanatory diagram of notification of leaving a bag. FIG. 11 is an explanatory diagram for dealing with a person who has caused a trouble. FIG. 12 is an explanatory diagram of imaging control for a target requiring attention. FIG. 13 is an explanatory diagram regarding the association of surrounding persons. FIG. 14 is an explanatory diagram of stepwise information display.

  Exemplary embodiments of a security system and a security method according to the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is an explanatory diagram of an outline of security according to the embodiment. In the security system according to the present embodiment, the inside of the security area is imaged by a plurality of imaging devices, the behavior of the person is tracked using the captured image data, and the characteristics of the behavior of the person are detected. And the guard information based on the characteristic of action is notified and displayed on the terminal device which a guard carries.

  In the example shown in FIG. 1, the fixed imaging devices C1 to C3 are installed at different locations in the security area, and the security area is monitored by imaging the security area with the fixed imaging devices C1 to C3 (1 ).

  The person H1 is walking in this guard area, and the person H1 is sequentially imaged by the fixed imaging devices C1 to C3. The management device 10 tracks the person H1 using image data captured by the fixed imaging devices C1 to C3. By this tracking, it can be identified that the person H1 has moved from the installation position of the fixed imaging device C1 to the installation position of the fixed imaging device C2, and then moved to the installation position of the fixed imaging device C3.

  Furthermore, the management device 10 detects the feature of the action of the person H1 using the image data captured by the fixed imaging devices C1 to C3. In the example shown in FIG. 1, the person H1 in the image data captured by the fixed imaging device C1 carries a black bag. The person H1 in the image data captured by the fixed imaging device C2 also carries a black bag, but the person H1 in the image data captured by the fixed imaging device C3 does not carry a black bag. Thus, by comparing the image data of the person H1 captured by the fixed imaging devices C1 to C3, a decrease in the belongings of the person H1 is detected as a feature of the action.

  Loss of belongings is information that should be paid attention to on security. For example, when a black bag is left somewhere as shown in FIG. 1, this bag may be a forgotten item or an explosive item.

  Therefore, if the management device 10 detects a decrease in belongings as a feature of behavior, the management device 10 associates the leaving of the article with the person H1 as security information. The management apparatus 10 provides this security information to security guards as necessary.

  Specifically, the guard G1 shown in FIG. 1 carries a guard terminal that is a terminal device for the guard, and the guard terminal has a wearable camera and a head-mounted display.

  The security guard terminal images the vicinity of the security guard's field of view with a wearable camera, and requests the management device 10 to collate the person included in the captured image data (2). If the person included in the image data is the person H1, the management apparatus 10 notifies “leave bag” as the corresponding security information (3).

  The security guard terminal projects the notified security information on the head mounted display. The guard G1 can take measures such as reading the guard information and calling out to the person H1.

  As described above, in the security system according to the present embodiment, the inside of the security area is imaged by the fixed imaging devices C1 to C3 and the like, and a plurality of image data including the same person H1 captured by the fixed imaging devices C1 to C3 and the like is obtained. Based on the behavior feature of the person H1, the guard information based on the behavior feature is notified to the guard terminal of the guard G1. For this reason, efficient security can be performed using image data captured by the fixed imaging devices C1 to C3 and the like.

  Next, the internal configuration of the management apparatus 10 shown in FIG. 1 will be described. FIG. 2 is a configuration diagram showing an internal configuration of the management apparatus 10 shown in FIG. As shown in FIG. 2, the management device 10 is connected to a plurality of fixed imaging devices C <b> 1 to Cn and can wirelessly communicate with a plurality of guard terminals 30. In addition, the management device 10 includes a display unit 11, an input unit 12, a communication unit 13, a wireless communication unit 14, a storage unit 15, and a control unit 16.

  As described above, the fixed imaging devices C1 to Cn are installed at appropriate intervals in the security area and image surrounding people. Then, the captured image data is transmitted to the management apparatus 10. The security guard terminal 30 is worn by a security guard and performs imaging of surroundings, communication with the management device 10, and output of information received from the management device 10.

  The display unit 11 is a liquid crystal panel, a display device, or the like. The input unit 12 is a keyboard, a mouse, or the like. The communication unit 13 is an interface unit for communicating with a plurality of fixed imaging devices C1 to Cn. The wireless communication unit 14 is an interface unit for performing wireless communication with a plurality of guard terminals 30.

  The storage unit 15 is a storage device such as a hard disk device or a non-volatile memory, and stores imaging device installation data 15a, guard arrangement data 15b, person tracking data 15c, definition data 15d, and caution target data 15e.

  The imaging device installation data 15a is data indicating the location and operation state where the fixed imaging devices C1 to Cn are installed. The guard arrangement data 15b is data for managing the arrangement of the guards. The identification information of the guards, the identification information of the guard terminals carried by the guards, the placement positions of the guards, the current situation, etc. Corresponds.

  The person tracking data 15c is data indicating the tracking result of the person imaged by the fixed imaging devices C1 to Cn. The definition data 15d is data that defines the security information by the behavior characteristics by associating the behavior characteristics with the security information. The caution target data 15e is data in which a person who should be alerted by a guard by notifying the guard information is registered.

  The control unit 16 is a control unit that controls the entire management apparatus 10, and includes a guard state management unit 16a, a tracking unit 16b, a behavior feature detection unit 16c, and a notification processing unit 16d. Actually, programs corresponding to these functional units are stored in a ROM or a non-volatile memory (not shown), and these programs are loaded into a CPU (Central Processing Unit) and executed, whereby the security state management unit 16a. The tracking unit 16b, the behavior feature detection unit 16c, and the notification processing unit 16d respectively execute processes corresponding to each other.

  The security state management unit 16a is a processing unit that manages the arrangement and state of the fixed imaging devices C1 to Cn and the security guard. Specifically, the security state management unit 16a registers and manages the location and operation state where the fixed imaging devices C1 to Cn are installed in the imaging device installation data 15a. Moreover, the guard state management part 16a registers and manages the place and state where the guard was arrange | positioned in the guard arrangement | positioning data 15b.

  The tracking unit 16b is a processing unit that tracks a person. Specifically, the tracking unit 16b extracts a human image from the image data captured by the fixed imaging devices C1 to Cn and the guard terminal 30, and calculates the feature amount. If a person with a matching feature quantity is not registered in the person tracking data 15c, the person is newly registered. If a person with a matching feature amount is registered in the person tracking data 15c, the state of the person is updated based on the image data.

  The tracking unit 16b provides identification information for each person, and associates the face image with the feature amount. If a person's name or the like can be specified from a predetermined database, the name is also associated. Furthermore, gender and age are estimated and associated by image processing or the like.

  In addition, the tracking unit 16b associates the date and time when the person is imaged with the imaged device and the location of the person with the identification information of the person. Furthermore, the color, behavior, and belongings of the jacket are identified and associated by image processing. When updating the status of a registered person, the date and time of image capture, the imaged device, the color of the jacket at the time, behavior, belongings, etc. are added.

  The behavior feature detection unit 16c is a processing unit that detects the behavior feature of each person from the person tracking data 15c. The behavior feature detection unit 16c refers to the definition data 15d based on the detected behavior feature, and determines whether or not corresponding security information exists. If the corresponding security information exists, the person whose action feature corresponds to the security information is registered as the attention required data 15e, and the notification content determined by the security information is associated with the attention required.

  The notification processing unit 16d collates whether or not an image of a person included in the image data captured by the security guard terminal 30 or the fixed imaging devices C1 to Cn is a target of caution. If the image data captured by the security guard terminal 30 includes a caution target, the notification content associated with the caution target is transmitted to the security guard terminal 30. Moreover, you may notify also to the other guard terminal 30 located in the vicinity of the guard terminal 30 which imaged the attention required object. At this time, it is preferable that the content of the notification for the security guard terminal 30 that has imaged the subject requiring attention differs from the notification for the surrounding security guard terminals 30.

  In addition, the notification processing unit 16d is a guard located in the vicinity of the fixed imaging devices C1 to Cn that have captured the attention target if the image data captured by the fixed imaging devices C1 to Cn includes the attention target. Notification to the employee terminal 30.

  Next, data stored in the storage unit 15 of the management apparatus 10 will be described. FIG. 3 is an explanatory diagram of the imaging device installation data 15a and the guard arrangement data 15b. The imaging device installation data 15a illustrated in FIG. 3A associates an arrangement location and a state with a camera ID that is identification information of the fixed imaging devices C1 to Cn.

  Specifically, the fixed imaging device with the camera ID “C1” has the arrangement location “P1” and the operation state “monitoring”. Similarly, the fixed imaging device with the camera ID “C2” has the arrangement location “P2” and the operation state “monitoring”.

  The guard arrangement data 15b shown in FIG. 3 (b) includes a terminal ID, an arrangement location, a state, etc., which are identification information of a guard terminal carried by the guard, with respect to a guard ID, which is identification information of the guard. Corresponds. In FIG. 3B, it is shown that the guard with the guard ID “G0001” carries the guard terminal with the terminal ID “Tg0001” and is guarding at the arrangement place “P4”.

  FIG. 4 is an explanatory diagram of the person tracking data 15c. A face image, a feature amount, a name, a sex, and an age are associated with a person ID that is person identification information. Further, for each person, each time the person is imaged, the date and time, the detection device that is the imaging apparatus, and the location of the person are associated. Also, the color, behavior, and belongings of the outerwear identified from the image data are associated.

  In the example shown in FIG. 4, the face ID, feature amount (x1, x2,...), Name “A B”, gender “male”, and age “30s” are associated with the person ID “H001”. Yes. Then, the person is imaged at “0802 13:00” at the place “P1” by the fixed imaging device C1, the color of the jacket is “black”, the action is “walking”, and the belongings are “black attache case”. It shows that there was. In addition, the person is imaged at “0802 13:10” at the place “P2” by the fixed imaging device C2, the color of the jacket is “black”, the action is “walking”, and the belongings are “black attache case”. It shows that there was.

  Similarly, in the example illustrated in FIG. 4, for the person ID “H002”, the face image, the feature amount (y1, y2...), The name “(unknown)”, the gender “female”, and the age “20s”. Are associated with each other.

  FIG. 5 is an explanatory diagram of the definition data 15d and the attention target data 15e. In the definition data 15d shown in FIG. 5D, security information and action features are associated with a definition ID that is identification information of the definition.

  Specifically, the definition ID “D001” associates the security information “Leave” with the behavior characteristic “Inventory: Decrease”. The behavior characteristic “possession: decrease” is a state where the possession is decreasing as a result of comparing the image data.

  In addition, the definition ID “D002” associates the security information “deposit” with the behavior characteristic “possession: increase”. The behavior characteristic “possession: increase” is a state in which possession has increased as a result of comparing image data.

  The definition ID “D003” associates the security information “trouble” with the behavior feature “behavior: trouble”. The behavior feature “behavior: trouble” is a state in which a state in which a person is in trouble is indicated by image data.

  Further, the definition ID “D004” associates the security information “long stay” with the behavior feature “location: same for a predetermined time or more”. The behavior feature “location: same for a predetermined time or more” is a state in which a person is continuously imaged for a predetermined time or more at the same location.

  Further, the definition ID “D005” associates the security information “random contact” with the behavior feature “behavior: talking to a predetermined number or more different persons”. The behavior feature “behavior: talking to a predetermined number or more of different persons” is a state in which image data indicates a state of speaking to a predetermined number or more of different persons. Such acts are conducted through illegal sales or solicitation.

  Also, the definition ID “D006” associates the security information “suspicious behavior 1” with the behavior feature “behavior: crawling around and putting a hand on the chest”. The behavioral feature “behavior: putting a hand on the chest while scooping around” is a state in which image data shows a state of putting a hand on the chest while scooping around. In such a state, there is a possibility that a knife, a gun, or the like is inserted in the chest to search for an opponent.

  In the attention-target data 15e shown in FIG. 5E, the face image, the feature amount, the name, the sex, the age, the notification target, and the notification content are associated with the person ID that needs attention. Here, the notification target is a security guard who has discovered a target requiring attention or a guard located in the vicinity of the target requiring attention. The notification content is the content of the notification determined by the security information.

  Specifically, in FIG. 5E, the person ID “H001” is registered as a target of caution, and the face image, the feature amount (x1, x2,...), The name “AB”, and the gender “male”. ”And the age“ 30s ”. In addition, when the subject of notification is “discoverer”, that is, a security guard who has discovered the subject of attention, “the person who may have left the bag in the site” is the notification content. If the subject of notification is “surrounding”, that is, a security guard located in the vicinity of the subject of special attention, “the bag may have been left nearby. .

  Next, the internal configuration of the security guard terminal 30 shown in FIG. 2 will be described. FIG. 6 is a configuration diagram illustrating an internal configuration of the security guard terminal 30 illustrated in FIG. 2. As shown in FIG. 6, the guard terminal 30 includes a display unit 31, an input unit 32, a camera 33, a wireless communication unit 34, a storage unit 35, and a control unit 36.

  The display unit 31 is a head-mounted display that projects an image on a transmission screen arranged in the field of view of the guard. The input unit 32 is an input interface that receives a guard's input to an operation button or the like. The camera 33 is a wearable camera that captures an image of the vicinity of a guard's field of view. The wireless communication unit 34 is a communication interface for wirelessly communicating with the management apparatus 10.

  The storage unit 35 is a storage device such as a hard disk device or a nonvolatile memory, and stores monitoring data 35a and notification output data 35b. The monitoring data 35a is data to be transmitted as a monitoring result to the management apparatus 10, such as image data captured by the camera 33. The notification output data 35b is data stored in order to output the notification received from the management device 10 to the guard terminal 30.

  The control unit 36 is a control unit that controls the guard terminal 30 as a whole, and includes an information collection processing unit 36a and an information output processing unit 36b. The information collection processing unit 36 a is a processing unit that captures an image of the surroundings with the camera 33, stores the obtained image data as monitoring data 35 a, and transmits it to the management apparatus 10. The image data transmitted in this way is used for tracking by the tracking unit 16b and verification by the notification processing unit 16d.

  The information collection processing unit 36a may transmit the obtained image data as it is to the management apparatus 10 as the monitoring data 35a. However, when the person is cut out from the image data and the person can be cut out, the cut out person May be transmitted to the management apparatus 10 as the monitoring data 35a.

  In this way, the security guard terminal 30 cuts out a person, so that the communication amount and the processing load on the management device 10 can be reduced. Further, if the security guard terminal 30 performs the calculation up to the feature amount of the cut-out person, the communication amount and the processing load on the management device 10 can be further reduced.

  The information output processing unit 36 b is a processing unit that stores the content of the notification received from the management device 10 as the notification output data 35 b and displays it on the display unit 31. At this time, the information output processing unit 36b determines the display position of the notification in accordance with the position of the target to be watched in the security guard's field of view. For this reason, the guard can recognize in a state where notifications are superimposed on the person he / she is viewing.

  Next, a process for registering the attention target by the management apparatus 10 will be described. FIG. 7 is a flowchart illustrating the procedure of the process for registering the attention target by the management apparatus 10. First, the tracking unit 16b receives image data captured by the fixed imaging devices C1 to Cn and the guard terminal 30 as a monitoring result (step S101). The tracking unit 16b identifies a person from the received monitoring result (step S102), and adds information related to the person to the person tracking data 15c and updates it (step S103).

  The behavior feature detection unit 16c detects behavior features from the updated person tracking data 15c (step S104), and refers to the definition data 15d based on the detected behavior features to determine whether corresponding security information exists. Determination is made (step S105).

  If there is no corresponding security information (step S105; No), the process is terminated as it is. On the other hand, if the corresponding security information exists (step S105; Yes), the person whose action characteristics correspond to the security information is set as the target of caution, and the notification content determined by the security information is associated with the target of caution. The data 15e is registered (step S106), and the process is terminated.

  Next, the notification process by the management apparatus 10 will be described. FIG. 8 is a flowchart illustrating a procedure for notifying the attention target by the management apparatus 10. First, the notification processing unit 16d receives image data captured by the fixed imaging devices C1 to Cn and the guard terminal 30 as a monitoring result (step S201). The notification processing unit 16d identifies a person from the received monitoring result, and refers to the caution target data 15e to collate whether or not it is a caution target (step S202).

  If the identified person is not a target of caution (step S203; No), the process is terminated as it is. On the other hand, if the identified person is an attention target (step S203; Yes), the notification target is selected (step S204), and the notification content associated with the attention target is transmitted to the notification target (step S205). ), The process is terminated.

Next, a specific example of leaving the bag will be described. FIG. 9 is an explanatory diagram of a specific example of leaving the bag. First, the following information is registered in the person tracking data 15c by imaging the person H1 with the fixed imaging device C1.
"Detection device: Camera C1
Location: P1
Date: 0802 13:00
Name: A B
Gender: Male Age: 30's Outer color: Black Carry: Black attache case "

Thereafter, when the person H1 is imaged by the fixed imaging device C2, the following information is registered in the person tracking data 15c.
"Detection device: Camera C2
Place: P2
Date: 0802 13:10
Name: A B
Gender: Male Age: 30's Outer color: Black Carry: Black attache case "

Furthermore, when the person H1 is imaged by the fixed imaging device C3, the following information is registered in the person tracking data 15c.
"Detection device: Camera C3
Place: P3
Date: 0802 13:20
Name: A B
Gender: Male Age: 30s Outer color: Black Personal belongings: None

  Here, the security information “Leave” corresponds to the possession of the person tracking data 15c being changed from “Black attache case” to “None”. Therefore, the notification content indicating “leave bag” is associated with the person H1.

  FIG. 10 is an explanatory diagram of notification of leaving a bag. First, if “bag leaving” is associated with the person H1, as shown in FIG. 10A, the guards G2 and G3 near the place where the bag is left are notified. Specifically, for the security guard terminals 30 of the security guards G2 and G3, together with the face image of the person H1, "there is a possibility that a bag has been left near the spots P2 and P3. Work with caution." And send notifications. It is also possible to instruct the search, confirmation, and collection of the bag.

  Further, as shown in FIG. 10B, when the guard G1 images the person H1 with the guard terminal 30 and transmits the image data to the management apparatus 10, the management apparatus 10 performs collation and the person H1 needs attention. It is determined that it is a target.

  And the management apparatus 10 is "the person who may have left the bag in the site" with the face image of the person H1 with respect to the guard terminal 30 of the guard G1 who imaged the attention target. Send notifications for.

Next, how to deal with a person who has trouble will be described. FIG. 11 is an explanatory diagram for dealing with a person who has caused a trouble. First, the person H2 and the person H3 are imaged by the fixed imaging device C6. Then, it is identified that the person H2 and the person H3 are in dispute by performing image processing on the image data captured by the fixed imaging device C6. In this case, the following information is registered in the person tracking data 15c.
"Detection device: Camera C6
Location: P6
Date: 0802 14:30
Name: E
Gender: Male Age: 20s Outer color: White Action: Trouble "

  Thereafter, the person H3 is tracked using another fixed imaging device C7 or the like. Then, when the security guard G8 images the person H3 by the security guard terminal 30 and transmits the image data to the management apparatus 10, the management apparatus 10 performs collation and together with the face image of the person H3, “Trouble occurs at the point P6. Send a notification saying "I am a person."

  Although the person H3 has been described here, information is also registered in the person tracking data 15c for the person H2, and notification to the security guard is possible.

  Next, other usage examples of the person tracking data 15c and the attention target data 15e will be described. The person tracking data 15c and the attention target data 15e can be used not only for notification to the guard terminal 30 but also for control of imaging.

FIG. 12 is an explanatory diagram of imaging control for a target requiring attention. In the example shown in FIG. 12, the person H4 is imaged by the fixed imaging device C6, and the following information is registered in the person tracking data 15c.
"Detection device: Camera C6
Location: P6
Date: 0802 14:50
Name: (Unknown)
Gender: Male Age: 40s Outer color: Gray Action: Crawling around and putting hands on chest

  In this case, the person H4 becomes a target of caution due to the action of the person H4. Further, since the action suggests that a weapon is hidden behind the chest, it is required to acquire information about the chest of the person H4. Therefore, while tracking the person H4, at the time of imaging with the fixed imaging device C7, control is performed so that the breast of the person H4 is magnified and imaged.

  In this way, by using the person tracking data 15c and the caution target data 15e for imaging control, it is possible to efficiently collect useful information for security purposes.

  Moreover, when tracking a person, it is good also as relating the surrounding person. For example, a person who has talked or handed over an object requiring attention may be related to the suspicious behavior of the object requiring attention. Therefore, when tracking a person and registering a related person, especially a person who has made a contact such as a conversation, and making that person a target of attention, the related peripheral person is also a candidate for a target of attention. .

  FIG. 13 is an explanatory diagram regarding the association of surrounding persons. In the person tracking data 15c shown in FIG. 13, when the person with the person ID “H001” is imaged at “0802 13:00”, the person located in the same image data is associated as a peripheral person. Specifically, “H015, H327” is associated as a peripheral person.

  Next, a specific example of display to the guard will be described. Since it is necessary for the security guard to always grasp the surrounding situation, it is not desirable that the amount of information displayed on the display unit 31 that is a head-mounted display becomes excessive. Therefore, step-by-step information display is performed according to the state of the guard.

  FIG. 14 is an explanatory diagram of stepwise information display. In the example illustrated in FIG. 14, when the notification target is a discoverer, a notification condition is set, and the notification content is changed according to the condition. Specifically, when there is a target requiring attention in the field of view, a symbol “!” Indicating that there is a notification in the vicinity of the target requiring attention is projected.

  If the subject requiring attention is located in the center of the field of view of the guard, the notification content “Leave bag left” is projected. In addition, if the subject requiring attention is located in the center of the guard's field of view and the distance to the subject requiring attention is within 10m, "There is a possibility that the black attache case was left between 13:10 and 13:20." The notification content is projected. And if the operation by the security guard is performed, the notification content “Name: AB, Gender: Male, Age: 30s” is projected.

  As described above, in the security system according to the embodiment, the inside of the security area is imaged by the fixed imaging devices C1 to Cn and the security guard terminal 30, the person is identified and tracked from the imaging result, and the human behavior feature is detected. Then, the target of caution is registered, and information about the target of caution is provided to the security guard terminal. For this reason, when guarding by a guard, efficient guarding can be performed using captured image data.

  In the present embodiment, the case where image data captured by an imaging device such as the fixed imaging devices C1 to Cn and the guard terminal 30 is used as an example is described. However, the fixed imaging devices C1 to Cn and the guard terminal 30 are used. The present invention can be similarly applied even when the image pickup apparatus such as the above picks up image data.

  Each configuration illustrated in the present embodiment is functionally schematic and does not necessarily need to be physically configured as illustrated. That is, the form of distribution / integration of each device is not limited to the one shown in the figure, and all or a part thereof may be functionally or physically distributed / integrated in an arbitrary unit according to various loads or usage conditions. Can be configured.

  The security system and the security method according to the present invention are suitable for performing efficient security by a security guard using image data or video data captured by an imaging device.

DESCRIPTION OF SYMBOLS 10 Management apparatus 11, 31 Display part 12, 32 Input part 13 Communication part 14, 34 Wireless communication part 15, 35 Storage part 15a Imaging device installation data 15b Security guard arrangement data 15c Person tracking data 15d Definition data 15e Attention target data 16 Control unit 16a Security state management unit 16b Tracking unit 16c Behavior feature detection unit 16d Notification processing unit 30 Security guard terminal 33 Camera 35a Monitoring data 35b Notification output data 36a Information collection processing unit 36b Information output processing unit C1 to Cn Fixed imaging apparatus

Claims (10)

A portable terminal having a plurality of imaging devices that image the inside of a security area, a server device that performs image processing of at least image data captured by each imaging device, and at least a display unit that is carried by a security guard that can communicate with the server device A security system including a device,
The server device
Behavior feature detection means for detecting behavior features of the subject based on a plurality of image data including the same subject captured by each imaging device;
A security system comprising: notification means for notifying the mobile terminal device of security information based on the behavior feature detected by the behavior feature detection means. A tracking unit that tracks the behavior of the subject using image data captured by the plurality of imaging devices;
The security system according to claim 1, wherein the behavior feature detection unit detects the behavior feature from a change in the state of the subject tracked by the tracking unit. And further comprising storage means for storing the behavior characteristics and security information that is information related to security in association with each other,
The behavior feature detecting means registers the target person showing the detected behavior feature as a target to be watched when the security information corresponding to the detected behavior feature is stored in the storage means, and the detected The security system according to claim 1 or 2, wherein security information corresponding to a behavior feature is associated with the target to be watched. The mobile terminal device further includes an imaging unit that images the vicinity of the field of view of the guard,
The notification means, when the caution target is included in the image data captured by the imaging unit, notifies the mobile terminal device of security information associated with the caution target. Item 4. The security system according to item 3.   The security system according to claim 4, wherein the imaging unit is used as one of the plurality of imaging devices.   The said display part has a transmission type screen arrange | positioned in the said guard's field of vision, The said guard information is projected according to the position of the said attention target object in the said guard's field of vision. Or the security system of 5. It further comprises a guard placement management means for managing the placement of the guard,
The notifying means notifies the guard information to a mobile terminal device of a guard who is located within a predetermined range from the current position of the attention target when the current position of the attention target is specified. The security system according to any one of claims 3 to 6. A security system including a mobile terminal device including at least a display unit and an imaging unit carried by a security guard, and a server device that performs image processing of image data captured by the imaging unit,
The server device
Behavior feature detection means for detecting behavior features of the subject based on a plurality of image data including the same subject captured by the imaging unit;
A security system comprising: notification means for notifying the mobile terminal device of security information based on the behavior feature detected by the behavior feature detection means. A portable terminal having a plurality of imaging devices that image the inside of a security area, a server device that performs image processing of at least image data captured by each imaging device, and at least a display unit that is carried by a security guard that can communicate with the server device A security method by a security system including a device,
A behavior feature detecting step for detecting behavior features of the subject based on a plurality of image data including the same subject captured by each imaging device;
A security method comprising: a notification step of notifying the mobile terminal device of security information based on the behavior feature detected by the behavior feature detection step. A security method by a security system including a portable terminal device including at least a display unit and an imaging unit carried by a security guard, and a server device that performs image processing of image data captured by the imaging unit,
A behavior feature detecting step for detecting behavior features of the subject based on a plurality of image data including the same subject captured by the imaging unit;
A security method comprising: a notification step of notifying the mobile terminal device of security information based on the behavior feature detected by the behavior feature detection step.

Images