JP2011018094A - Patrol support system, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a patrol support system for enabling a guard who goes toward a job site where any abnormality is generated to easily specify a suspicious person in a patrol guard task.SOLUTION: The patrol support system for supporting a patrol guard to perform patrol guard includes: a person monitoring means 100 for detecting a person included in a video from video data photographed by a photographing means arranged in a prescribed guard region, and for monitoring the detected person; a suspicious person detection means 101 for detecting a person satisfying predetermined detection conditions as a suspicious person from persons monitored by the person monitoring means 100; a location information calculation means 102 for calculating the relative location information of the suspicious person detected by the suspicious person detection means 101 with the patrol guard; and a suspicious person information transmission means 103 for transmitting prescribed information to a portable terminal carried by the patrol guard based on the relative location information calculated by the location information calculation mean 102.

Description

  The present invention relates to a patrol guard support system, patrol guard support method, and patrol guard support program that support patrol guard services.

  Even in an environment where machine security is provided by a surveillance camera, security guards often patrol regularly. In addition, when the security system detects any abnormality, a security guard is dispatched to the site for situation confirmation and human response.

  As a system for supporting such a security service, for example, in Patent Document 1, an alarm device and a monitoring camera are installed around a monitoring target, and when an abnormality is seen by the alarm device, the monitoring camera and the monitoring camera are monitored. Describes a system that connects a user's mobile terminal and transmits video to the mobile terminal.

  Further, Patent Document 2 discloses information indicating a photographed image and the position / orientation of a patrol person from a terminal having a camera function, positioning means, and pointing direction measuring means possessed by a patrol person to a remote monitoring center. A system for transmitting and displaying received information in a three-dimensional space at a monitoring center is described.

JP 2005-117575 A JP 2008-257385 A

  When surveillance system alarms that detect suspicious behavior are generated by surveillance camera images or sensors, patrol guards go to the site to take action, but the suspicious person must be on site before reaching the site. There is a problem that the security guards do not know who to follow, because the situation changes, such as leaving the office and being confused with crowds.

  At this time, it is difficult to respond after confirming in detail (for example, the position of a suspicious person, face, clothes, etc.) who has caused what in the video taken by the surveillance camera. In particular, when instructing a guard to travel to the site, it is difficult to show the video captured by the surveillance camera and grasp the situation.

  Also, in security services, it is often possible to make a voice communication between the surveillance center side confirming the video and the patrol guard by having the patrol guard possess a wireless transceiver, a local PHS, or the like. Even in this case, however, it is time-consuming and inaccurate if it is reported verbally about the place / situation that occurred, the appearance of the person who caused it, and the subsequent actions, and it is difficult to respond quickly and appropriately.

  If the system described in Patent Document 1 is used, the video of the surveillance camera can be transmitted to the terminal of the supervisor. However, the video of the monitoring camera corresponding to the alarm device that issued the abnormality is only displayed on the terminal, and it is not possible to go back to the past to check the situation when an abnormality occurs or to track the suspicious person Can not.

  Therefore, the security guard who goes to check the situation at the site cannot grasp the situation at the time of occurrence of the abnormality and the subsequent process, and the suspicious person cannot be easily identified.

  Moreover, in the system described in patent document 2, the situation of the field can only be grasped | ascertained in the monitoring center. Therefore, in order for the security guard to grasp the situation at the time of occurrence of the abnormality, it is necessary to rely on verbal instructions from the monitoring center. In the first place, since the information grasped by the monitoring center is information transmitted from the terminal held by the guard, it is almost the same as the information (for example, field of view) grasped by the guard himself. Therefore, it cannot be applied to the purpose of assisting the security guard who goes to confirm the situation at the site.

  Therefore, the present invention provides a patrol guard support system, patrol guard support method, and patrol guard support program that enable a guard heading to the site where an abnormality has occurred to identify a suspicious person in a patrol guard service. Objective.

  A patrol guard support system according to the present invention is a patrol guard support system that supports patrol guards by patrol guards, and from a video data photographed by photographing means arranged in a predetermined guard area, a person included in the video is detected. A person monitoring unit that detects and monitors the detected person, a suspicious person detecting unit that detects a person that satisfies a predetermined detection condition among the persons monitored by the person monitoring unit, and a suspicious person detection Based on the relative position information calculated by the position information calculating means, the position information calculating means for calculating the relative position information between the suspicious person detected by the means and the patrol guard, and predetermined information on the mobile terminal held by the patrol guard And suspicious person information transmitting means for transmitting.

  A patrol security support method according to the present invention includes a person monitoring step for detecting a person included in a video from video data taken by a photographing means arranged in a predetermined security area, and monitoring the detected person, and a person to be monitored Among them, a suspicious person detection step for detecting a person who satisfies a predetermined detection condition as a suspicious person, a position information calculation step for calculating relative position information between the detected suspicious person and a patrol guard, and And a suspicious person information transmission step of transmitting predetermined information to the portable terminal held by the patrol guard based on the relative position information.

  The patrol security support program according to the present invention is a personal monitoring process for detecting a person included in a video from video data taken by a photographing means arranged in a predetermined security area on a computer and monitoring the detected person. Among the persons to be monitored, a suspicious person detection process for detecting a person who satisfies a predetermined detection condition as a suspicious person, and a positional information calculation process for calculating relative positional information between the detected suspicious person and a patrol guard Based on the calculated relative position information, a suspicious person information transmission process for transmitting predetermined information to a portable terminal held by a patrol guard is executed.

  ADVANTAGE OF THE INVENTION According to this invention, in the patrol guard work, the guard who goes to the spot where abnormality occurred can identify a suspicious person easily.

It is a functional block diagram which shows an example of a function structure of the patrol guard assistance system by this invention. It is a schematic diagram which shows an example of the environment to which the patrol guard assistance system is applied. It is a flowchart which shows the process example which a patrol guard assistance system performs. It is a schematic diagram which shows the outline of the intersection determination process by the position / line-of-sight determination means 8 in this embodiment. It is a flowchart which shows the process example which a patrol guard assistance system performs. It is a schematic diagram which shows an example of the information display terminal 15 which a guard holds in this embodiment. It is a functional block diagram which shows the minimum structural example of a patrol guard assistance system.

  Embodiments of the present invention will be described below with reference to the drawings. In this embodiment, as an example of applying the patrol security support system, in a region where a surveillance camera is installed in a facility such as an airport or a station, a person who has entered a specific region is detected as a suspicious person, and the RFID sensor and wireless communication A case will be described in which tracking is instructed to a security guard who has a possible information display terminal and patrols.

  FIG. 1 is a functional block diagram showing an example of a functional configuration of a patrol security support system according to the present invention. As shown in FIG. 1, the patrol guard support system includes video data input means 1, calibration means 2, sensor data input means 3, authentication means 4, person detection tracking means 5, suspicious person detection means 6, and three-dimensional map recording. Means 7, position / line-of-sight determination means 8, transmission information selection means 9, video recording means 10, recorded video recording means 11, map / guidance information creation means 12, video / still image extraction means 13, and information transmission means 14. The patrol guard support system is realized by an information processing apparatus such as a personal computer that operates according to a program, for example.

  Specifically, the video data input unit 1 is realized by a CPU and a network interface unit of an information processing apparatus that operates according to a program. The video data input means 1 has a function of receiving video data from a surveillance camera or the like via a communication network and inputting the received video data to a patrol guard support system. Note that the video data input means and the monitoring camera are not limited to the communication network, and may be connected to each other by a signal line, for example.

  Specifically, the calibration unit 2 is realized by a CPU of an information processing apparatus that operates according to a program. The calibration unit 2 has a function of associating video data captured by each monitoring camera or the like input by the video data input unit 1 with a coordinate system in the real space. For example, the calibration unit 2 associates video data with the coordinate system by extracting several points from the camera installation position and the coordinates in the image of a known object and performing calculations.

  Specifically, the sensor data input unit 3 is realized by a CPU and a network interface unit of an information processing apparatus that operates according to a program. The sensor data input means 3 receives the authentication information detected by the sensor (received from the RFID tag) from the sensor (for example, RFID sensor) installed in the monitoring area via the communication network, and receives the received authentication information. It has a function to input to the patrol security support system.

  Specifically, the authentication unit 4 is realized by a CPU of an information processing apparatus that operates according to a program. The authentication unit 4 has a function of associating the authentication information input by the sensor data input unit 3 with a detected person (for example, a guard who possesses an information display terminal). For example, the authentication unit 4 stores identification information in association with each guard, and associates input recognition information with a person based on information stored in advance. If the authentication unit 4 does not match any authentication information stored in advance, the authentication unit 4 may not perform the association as the authentication failure.

  Specifically, the person detection tracking means 5 is realized by a CPU of an information processing apparatus that operates according to a program. The person detection tracking unit 5 has a function of detecting a person appearing in the video from the video data input by the video data input unit 1 and tracking the detected person. For example, the person detection tracking unit 5 detects person data indicating a person from the video data, and monitors changes in the detected person data. In this case, the person detection tracking unit 5 performs image processing such as detecting a difference in luminance value between pixels in the video, and detects an object in the video. Then, if the detected object matches pattern data indicating a person stored in advance, it is determined that the image of the person is included, and is extracted from the video data.

  Moreover, the person detection tracking means 5 calculates the position information of a person and a guard based on the position of a surveillance camera or an RFID base station, for example. And the person detection tracking means 5 updates the position information of the detected person and guards at any time based on the received video data and authentication information. In the present embodiment, “monitor a person” or “monitor a patrol guard” means, for example, that the position information of a detected person or guard is updated as needed based on received video data or authentication information. Is to execute the process.

  Specifically, the suspicious person detection means 6 is realized by a CPU of an information processing apparatus that operates according to a program. The suspicious person detecting means 6 has a function of analyzing a person's behavior tracked by the person detecting and tracking means 5 and detecting a person who satisfies a predetermined detection condition as a suspicious person. If the suspicious person detecting means 6 determines that the position where the person exists has changed within a specific area (for example, a restricted entry area) based on the position information, for example, the suspicious person detecting means 6 detects the person as a suspicious person. In the present embodiment, an example is described in which whether or not a position where a person exists changes within a specific region is used as a detection condition for a suspicious person. However, the present invention is not limited to this example. The detection condition may be whether or not an object is possessed.

  Specifically, the three-dimensional map recording means 7 is realized by a storage device such as a magnetic disk or an optical disk. The three-dimensional map recording means 7 records the three-dimensional information of the space to be monitored and the objects existing in the space.

  Specifically, the position / line-of-sight determining means 8 is realized by a CPU of an information processing apparatus that operates according to a program. The position / line-of-sight determination means 8 includes information indicating a suspicious person detected by the suspicious person detection means 6 among persons tracked by the person detection tracking means 5 and positions of related persons such as guards associated with the authentication means 4. The relative position between the suspicious person and the guard is calculated based on the position information indicating the position and the three-dimensional information recorded by the three-dimensional map recording means 7, and it is determined whether or not the guard can visually recognize the suspicious person. It has a function to do.

  Specifically, the transmission information selection means 9 is realized by a CPU of an information processing apparatus that operates according to a program. The transmission information selection means 9 has a function of selecting information to be transmitted to the information display terminal possessed by the guard based on the determination result of the position / line-of-sight determination means 8 according to a predetermined standard.

  Specifically, the video recording unit 10 is realized by a CPU of an information processing apparatus that operates according to a program. The video recording means 10 has a function of recording video data input by the video data input means 1 (stores it in the recorded video storage means 11).

  Specifically, the recorded video recording unit 11 is realized by a storage device such as a magnetic disk or an optical disk. The recorded video recording means 11 records video data.

  Specifically, the map / guidance information creating means 12 is realized by a CPU of an information processing apparatus that operates according to a program. The map / guidance information creating means 12 has a function of creating the information selected by the transmission information selecting means 9 based on the position information of the suspicious person detected by the suspicious person detecting means 6. The map / guidance information creation means 12 creates map data indicating the positions of guards and suspicious persons, for example, according to the selection result of the transmission information selection means 9.

  Specifically, the video / still image extraction unit 13 is realized by a CPU of an information processing apparatus that operates according to a program. The video / still image extracting unit 13 selects video data (for example, video data) from video data recorded by the video recording storage unit 11 according to a predetermined standard when the transmission information selection unit 9 selects transmission of video data. Data and still image data).

  Specifically, the information transmission unit 14 is realized by a CPU and a network interface unit of an information processing apparatus that operates according to a program. The information transmission means 14 sends the information created by the map / guidance information creation means 12 according to the selection result by the transmission information selection means 9 and the information extracted by the video / still image extraction means 13 to the security guard via the communication network. It has a function to transmit to the information display terminal possessed.

  Next, the operation of the patrol guard support system will be described. FIG. 2 is a schematic diagram illustrating an example of an environment to which the patrol guard support system is applied. 3 and 5 are flowcharts showing an example of processing executed by the patrol guard support system.

  As shown in FIG. 2, a plurality of fixed surveillance cameras are installed in a target area assuming a large public facility such as an airport or a station. These surveillance cameras take pictures of security guards traveling around the site and persons including suspicious persons. A patrol security support system (not shown) receives the video taken by the surveillance camera via a wired or wireless communication network. In addition, there is no restriction | limiting about the kind of camera, For example, you may use an analog camera and a network type camera.

  In the example shown in FIG. 2, a guard in transit has an RFID tag capable of transmitting a unique ID (authentication information) and a portable information display terminal capable of wireless communication with the patrol guard support system. The patrol guard during the patrol may have a terminal in which both are integrated.

  In addition, a plurality of wireless communication base stations and RFID base stations for communicating with the RFID tag and the information display terminal are installed in the monitoring target area (one each in FIG. 2). The wireless communication base station and the RFID base station are connected to the patrol guard support system via the communication network, like the monitoring camera.

  In the example shown in FIG. 2, when each surveillance camera captures a surveillance area, the video data input means 1 receives the video data captured by each surveillance camera via a communication network and supports the received video data for patrol security. Input to the system (step S1 shown in FIG. 3).

  Then, the calibration unit 2 executes a process of associating the video data captured by each monitoring camera input by the video data input unit 1 with the coordinate system in the real space (step S2). However, the process of step S2 is executed only when the system is started and the first process is performed. That is, when the orientation of the surveillance camera does not change, the association between the video data and the coordinate system in the real space does not change even if only the first time is performed. For this reason, position information in the real space can be calculated from the position of the person shown in the video in the person tracking process described later.

  When the RFID base station receives the authentication information from the RFID tag possessed by the security guard, the sensor data input means 3 receives the authentication information from the RFID base station via the communication network, and circulates the received authentication information. Input to the security support system (step S3).

  Then, the authentication unit 4 executes a process of associating the authentication information input by the sensor data input unit 3 with the detected person (the guard who possesses the RFID tag that transmitted the authentication information) (step S4). In this way, the authentication information is received from the RFID tag possessed by the patrol guard and the authentication process is performed, so that the security guard can be more accurately identified and the position information of the guard can be obtained. Can do.

  Next, the person detection / tracking means 5 detects a person appearing in the video from the video data input by the video data input means 1, and executes a process of tracking the detected person (step S5). For example, the person detection tracking unit 5 detects person data indicating a person from the video data, and monitors changes in the detected person data. For example, the person detection / tracking means 5 calculates position information of a suspicious person or a guard based on the position of a monitoring camera, an RFID base station, or a known object shown in the video. And the person detection tracking means 5 updates the position information of the detected person and guards at any time based on the received video data and authentication information.

  Next, the suspicious person detecting means 6 analyzes the behavior of the person tracked by the person detecting and tracking means 5 and executes a process of detecting a person who satisfies a predetermined detection condition as a suspicious person (step S6). If the suspicious person detecting means 6 determines that the position where the person exists has changed within a specific area (for example, a restricted entry area) based on the position information, for example, the suspicious person detecting means 6 detects the person as a suspicious person.

  In step S6, when a suspicious person is detected, the position / line-of-sight determination means 8 is a guard that the authentication means 4 associates with the suspicious person detected by the suspicious person detection means 6 among the persons tracked by the person detection tracking means 5. The relative position between the suspicious person and the guard is calculated based on each position information of the staff and the three-dimensional information recorded by the three-dimensional map recording means 7, and the guard can visually recognize the suspicious person. Whether or not (step S7).

  Here, the position / line-of-sight determination means 8 may use, for example, a method called intersection determination processing as a method for determining whether or not the visual recognition is possible. FIG. 4 is a schematic diagram showing an outline of the intersection determination process by the position / line-of-sight determination unit 8 in the present embodiment. Hereinafter, the intersection determination process will be described with reference to FIG.

  In the environment shown in FIG. 4, it is assumed that there are structures such as pillars in the space, and these are recorded in advance in the 3D map recording means 7 as 3D data.

  First, the position / line-of-sight determination means 8 corresponds to the corresponding position on the three-dimensional map based on the position information of the suspicious person detected by the suspicious person detection means 6 and the position information of the security guard associated with the authentication means 4. In addition, a three-dimensional human model corresponding to the size of the person is arranged.

  In the present embodiment, it is assumed that the user stands upright at the corresponding position, but when the user knows that he / she is taking a different posture (for example, when the size of an object in a video detected as a suspicious person changes). The person model may be changed to a corresponding shape.

  Next, the position / line-of-sight determination means 8 generates a line segment on the space connecting the two person models (for example, the center of the head). Then, the position / line-of-sight determination means 8 regards this line segment as a line of sight, and determines whether or not the line of sight contacts each object in the surrounding space with all the surfaces constituting each object (structure). Judgment by

  And when it determines with passing through any surface, the position and eyes | visual_axis determination means 8 determines with this eyes | visual_axis being shielded.

  On the other hand, if it is determined that there is no contact between the line of sight and all objects (structures) (that is, no surface passes through), the position / line-of-sight determination means 8 has no object blocking the line of sight, and the guard And the suspicious person are determined to be in a mutually visible state. The above is the intersection determination process executed by the position / line-of-sight determination unit 8 in the present embodiment.

  When the determination processing by the position / line-of-sight determination unit 8 is completed, the transmission information selection unit 9 selects information to be transmitted to the guard based on the determination result of the position / line-of-sight determination unit 8 (step S8). ).

  FIG. 5 is a flowchart showing a processing example executed by the patrol guard support system after detection of a suspicious person. With reference to this flowchart, the operation after detection of a suspicious person will be described.

  First, the transmission information selection means 9 calculates a linear distance between the two based on the position information of the guard and the position information of the suspicious person (step S9). In the present embodiment, the transmission information selection means 9 calculates the straight line distance from the three-dimensional position of both, but when the target facility is not hierarchically structured and can be managed without duplication at the position on the plane. The distance on the plane may be calculated.

  Next, the transmission information selection means 9 determines whether or not the distance between the guard and the suspicious person is a long distance (for example, a straight distance of 50 m or more) based on the calculated distance (step S10). . Note that the criterion for determining whether the distance is long is not limited to 50 m, and may be set to 30 m or more, for example.

  If it is determined in step S10 that it is a long distance, the position / line-of-sight determination means 8 determines whether or not a suspicious person can be visually recognized by the guard through the above-described intersection determination process (step S11).

  If it is determined in step S11 that the information cannot be viewed, the transmission information selection means 9 uses not the video data for displaying the suspicious person as information to be transmitted to the information display terminal, but the position of the suspicious person on the map and the suspicious person. Is selected (step S12). Thereafter, the transmission information selection means 9 shifts the processing to step S21.

  On the other hand, if it is determined in step S11 that it can be visually recognized, there is a possibility that the security guard visually recognizes the suspicious person and makes a situation determination. Therefore, the transmission information selection means 9 transmits information to the information display terminal as In addition to information indicating the position of the suspicious person on the map and the distance to the suspicious person, video data taken by a surveillance camera installed in the vicinity of the suspicious person (ie, the surveillance camera photographing the suspicious person) Is selected (step S13). Thereafter, the transmission information selection means 9 shifts the processing to step S21.

  If it is determined in step S10 that the distance between the guard and the suspicious person is not a long distance, the transmission information selection unit 9 has a short distance (for example, 10 m or less) between the guard and the suspicious person. It is determined whether or not (step S14). Note that the criterion for determining whether the distance is short is not limited to 10 m, and may be set to 5 m or less, for example.

  If it is determined in step S14 that the distance is not short, the transmission information selection means 9 considers that the distance between the guard and the suspicious person is a medium distance, and that there is little possibility that the suspicious person will come into contact immediately. As information to be transmitted to the information display terminal, in addition to information indicating the position of the suspicious person on the map and the distance from the suspicious person, video data at the time of the suspicious action of the target (suspicious person) is selected (step S15). Thereafter, the transmission information selection means 9 shifts the processing to step S21.

  If it is determined in step S14 that the distance is short, the transmission information selection unit 9 determines whether or not the tracking of the suspicious person can be maintained (step S16). For example, the transmission information selection unit 9 determines that the person data detected as a suspicious person can be maintained in the video data even at the time of this processing, and can be maintained.

  If it is determined in step S16 that the suspicious person cannot be maintained, the transmission information selecting unit 9 determines that the suspicious person may be lurking in the vicinity of the object, as information to be transmitted to the information display terminal. Video data (for example, still image data) immediately before the person data shown cannot be specified is selected (step S17). In such a case, by transmitting this information, it is possible to prompt the guard to take an appropriate action. Thereafter, the transmission information selection means 9 shifts the processing to step S21.

  On the other hand, if it is determined in step S <b> 16 that the position can be maintained, the position / line-of-sight determination unit 8 determines whether the guard can visually recognize the suspicious person based on the position information of the guard and the suspicious person. An intersection determination process for determining is executed (step S18).

  If it is determined in step S18 that the information cannot be visually recognized, the transmission information selection unit 9 uses the current video data showing the suspicious person being tracked as information to be transmitted to the information display terminal (that is, the surveillance camera captures in real time). Video data) is selected (step S19). By transmitting this information, it is possible to compensate for the guard's blind spot and facilitate tracking of the subject. Thereafter, the transmission information selection means 9 shifts the processing to step S21.

  On the other hand, if it is determined in the step that it can be visually recognized, it is assumed that the security guard can visually recognize the suspicious person, and the transmission information selection means 9 displays the screen display to the security guard as information to be transmitted to the information display terminal. Warning information for warning using voice is selected (step S20). By transmitting this warning information, it is possible to prompt attention to the suspicious person's behavior. Thereafter, the transmission information selection means 9 shifts the processing to step S21.

  When the transmission information selection unit 9 selects information to be transmitted in any of the above steps, the information transmission unit 14 transmits the information selected by the transmission information selection unit 9 to the information display terminal possessed by the security guard ( Step S21).

  Specifically, at this time, the map / guidance information creation means 12 creates the information selected by the transmission information selection means 9 based on the position information of the suspicious person detected by the suspicious person detection means 6.

  Also, the video / still image extracting means 13 uses the video data recorded by the video recording storage means 11 when the transmission information selecting means 9 selects moving image data or still image data as information to be transmitted to the information display terminal. Moving image data and still image data are extracted according to a predetermined standard.

  Then, the information transmission means 14 is an information display that is held by the security guard with the information selected by the transmission information selection means 9 and the information generated by the map / guidance information creation means 12 and the information extracted by the video / still image extraction means 13. Transmit to terminal 15.

  Next, the information display terminal possessed by the security guard will be described. FIG. 6 is a schematic diagram illustrating an example of the information display terminal 15 held by a guard in the present embodiment. The information display terminal 15 includes an information display unit realized by a liquid crystal display device or the like, and a wireless communication unit (not shown).

  When the wireless communication unit receives information from the information transmitting unit 14, the information display terminal displays the received information on the information display unit. In the example shown in FIG. 6, as the received information, an image of the suspicious person taken by the surveillance camera, information indicating the position of the suspicious person on the map, and the like are displayed. The information to be displayed is not limited to this. For example, the position information of other guards may be displayed at the same time. An information display terminal may be provided with an input unit such as a touch panel or operation buttons, and information displayed on the information display unit may be switched according to an input operation using the input unit by a guard.

  From the above, in this embodiment, a guard who handles a suspicious person at the site can easily identify and track the suspicious person who generated the alarm at the site.

  The reason for this is that in this embodiment, as information for identifying the suspicious person on the information display terminal possessed by the security guard moving to the site while analyzing the video of the surveillance camera and continuously tracking the suspicious person This is because map data, video data from a surveillance camera, and the like are transmitted for reference.

  Therefore, as in the system described in Patent Document 1, it is possible to set a wide range of flexible suspicious person detection conditions in this embodiment without depending on the alarm device.

  Also, for example, in patrol guards, when a small number of security guards are used to check the situation, there is a possibility that the suspicious person being tracked may attack the guards, so it is necessary to avoid inadvertent approaching encounters .

  However, in the system described in Patent Document 1, the video of the monitoring camera corresponding to the alarm device that has issued the abnormality is only displayed on the terminal. Therefore, the security guard who goes to confirm the situation at the site cannot grasp the subsequent behavior and position of the suspicious person and cannot support the security of the security guard.

  On the other hand, in this embodiment, the positional relationship between the target suspicious person and the security guard is grasped using the analysis of the video data by the surveillance camera and the sensor (RFID base station), and the distance and the visibility situation are judged. After that, information such as warning when approaching is transmitted to the information display terminal possessed by the guard.

  Therefore, it is possible to support the security of patrol guards who handle suspicious persons on site.

  The present invention is not limited to the above-described embodiment, and can be implemented in various other modes. As for the information display terminal to be held by the patrol guard, there is no limitation on the mode as long as the condition that the image can be visually confirmed is satisfied, for example, using a head-up display device that can be mounted on the head Also good. In this case, there is an advantage that the guard can check the displayed information while maintaining the freedom of both hands and the view of the real space.

  In the above embodiment, the operation when a suspicious person is detected has been described. However, since most of the time during normal patrol monitoring work is in a state where there is no suspicious person, information that supports security during this period May be selected and transmitted.

  For example, when a suspicious person is not detected, the patrol security support system transmits video data of a surveillance camera that captures a blind spot in the vicinity such as behind the guard, or the guard is at a position where an incident has occurred in the past. Warning information may be transmitted when approaching.

  From the above, it can be said that this embodiment has the following features.

  The patrol security support system installs a monitoring camera and an RFID antenna base station in a target space, and tracks a moving person. Then, the patrol guard is allowed to carry the RFID tag, thereby performing identification with other persons and more accurate position tracking. In addition, other persons are also detected by analyzing the surveillance camera video, and a person who has performed suspicious behavior such as entering a specific range is tracked as a suspicious person after a detection warning. A known method may be used for these processes.

  In addition, the patrol guard support system manages all the patrol guards moving in the target space and the positions of suspicious persons being tracked by suspicious behavior on a three-dimensional space model in the surveillance area. When a suspicious action occurs, the patrol guard support system determines the distance / positional relationship between the guard currently in the field and the suspicious person who has newly started tracking, and whether or not it can be visually recognized on the space model. Based on the determination result, the patrol security support system creates information including appropriate video and images according to the situation from the video and space model of the surveillance camera and transmits them to the terminal owned by the patrol guard By doing so, the guards are encouraged to respond appropriately.

  Also, in determining the prospects between suspicious persons and guards using a spatial model, an object (for example, a cylinder) that approximates a person is placed at the current position in the model being tracked, and the opponent model is viewed from one head position. A straight line is drawn toward the point of view and this is taken as the line of sight. Then, the patrol guard support system determines whether or not the line of sight intersects with each object existing in the surrounding environment by performing a three-dimensional geometric determination as to whether or not it passes through each of the constituent surfaces.

  Next, the minimum configuration of the patrol guard support system according to the present invention will be described. FIG. 7 is a functional block diagram illustrating a minimum configuration example of the patrol guard support system. As shown in FIG. 7, the patrol guard support system includes person monitoring means 100, suspicious person detecting means 101, position information calculating means 102, and suspicious person information transmitting means 103 as minimum components.

  In the patrol security support system with the minimum configuration shown in FIG. 7, the person monitoring unit 100 detects person data indicating a person in the video from the video data captured by the monitoring camera, and monitors the detected person data. The suspicious person detecting unit 101 detects suspicious person data indicating the suspicious person among the person data monitored by the person monitoring unit 100. Then, the position information calculation unit 102 calculates relative position information between the suspicious person identified by the suspicious person data detected by the suspicious person detection unit 101 and the patrol guard. And the suspicious person information transmission means 103 transmits predetermined information to the portable terminal which a patrol guard holds based on the relative position information which the position information calculation means 102 calculated.

  Therefore, according to the patrol security support system with the minimum configuration, the security guard who handles the suspicious person at the site can easily identify and track the suspicious person who generated the warning based on the information received by the mobile terminal. .

  In addition, in this embodiment, the characteristic structure of the patrol guard assistance system as shown to the following (1)-(6) is shown.

  (1) The patrol guard support system is a patrol guard support system that assists patrol guards with patrol guards, and detects the persons included in the video from the video data taken by the photographing means arranged in a predetermined guard area. Person monitoring means for detecting and monitoring the detected person (for example, realized by the video data input means 1, calibration means 2 and person detection tracking means 5) and a person monitored by the person monitoring means are predetermined. Between the suspicious person detection means (for example, realized by the suspicious person detection means 6) that detects a person who satisfies the detected condition as a suspicious person and the patrol guard Based on position information calculation means for calculating position information (for example, realized by the position / gaze determination means 8) and relative position information calculated by the position information calculation means Suspicious individual information transmitting means for transmitting predetermined information to the mobile terminal cyclic guards held (e.g., as implemented by the transmission information selecting unit 9 and the information transmission means 14), characterized in that it comprises a.

  (2) In the patrol guard support system, the patrol guard includes a visual judgment means (for example, realized by the position / gaze judgment means 8) for judging whether or not the patrol guard can visually recognize the suspicious person. The predetermined information may be transmitted to the mobile terminal held by the patrol guard based on the determination result of the visual recognition determination means.

  (3) In the patrol security support system, the visual recognition determination means includes three-dimensional data (for example, recorded by the three-dimensional map recording means 7) that can identify the space to be monitored and the structure existing in the space; Based on the position information of the suspicious person determined from the video data and the position information of the patrol guard, the patrol guard may determine whether or not the suspicious person can be visually recognized.

  (4) In the patrol security support system, the person monitoring means may be configured to monitor the patrol guard based on information received from a mobile terminal by a sensor arranged in a predetermined security area.

  (5) In the patrol guard support system, the suspicious person information transmitting unit may be configured to transmit the position information of the suspicious person (for example, created by the map / guidance information creating unit 12) to the portable terminal. .

  (6) In the patrol security support system, the suspicious person information transmitting means transmits video data (for example, extracted from the video recording storage means 11 by the video / still image extracting means 13) that can identify the suspicious person to the portable terminal. It may be configured to.

  INDUSTRIAL APPLICABILITY The present invention can be applied to support for security work in a facility, in particular, to use in combination with patrol security by a guard and facility security by a surveillance camera system. Further, the present invention does not limit the tracking target to a person, and may track another target such as a vehicle. For example, in a facility parking lot or the like, the present invention can be applied to a case where a suspicious vehicle and a related person vehicle are tracked and information corresponding to the positional relationship is transmitted to a display device in the related person vehicle.

DESCRIPTION OF SYMBOLS 1 Surveillance camera image input means 2 Calibration means 3 Sensor data input means 4 Authentication means 5 Person detection tracking means 6 Suspicious person detection means 7 Three-dimensional map recording means 8 Position / line-of-sight determination means 9 Transmission information selection means 10 Video recording means 11 Recorded video recording means 12 Map / guidance information creation means 13 Video / still image selection means 14 Information transmission means 15 Information display terminal 100 Person monitoring means 101 Suspicious person detection means 102 Position information calculation means 103 Suspicious person information transmission means

Claims (10)

A patrol guard support system that supports patrol guards by patrol guards,
A person monitoring means for detecting a person included in the video from the video data taken by the photographing means arranged in a predetermined security area, and monitoring the detected person;
Among the persons monitored by the person monitoring means, a suspicious person detecting means for detecting a person who satisfies a predetermined detection condition as a suspicious person,
Position information calculating means for calculating relative position information between the suspicious person detected by the suspicious person detecting means and the patrol guard;
A suspicious person information transmitting means for transmitting predetermined information to a portable terminal held by the patrol guard based on the relative position information calculated by the position information calculating means. Including a visual determination means for determining whether the patrol guard can visually recognize the suspicious person,
The patrol security support system according to claim 1, wherein the suspicious person information transmission unit transmits predetermined information to a portable terminal held by the patrol guard based on a determination result of the visual recognition determination unit. The visual determination means is based on the three-dimensional data that can identify the space to be monitored and the structures existing in the space, the position information of the suspicious person determined from the video data, and the position information of the patrol guard. The patrol guard support system according to claim 2, wherein the patrol guard determines whether the suspicious person can be visually recognized. The person monitoring means monitors the patrol guard based on information received from a mobile terminal by a sensor arranged in a predetermined security area. Security support system. The suspicious person information transmitting means transmits the position information of the suspicious person to the mobile terminal. The patrol guard support system according to any one of claims 1 to 4. The suspicious person information transmission means transmits video data that can identify a suspicious person to the mobile terminal. The patrol security support system according to any one of claims 1 to 5. A person monitoring step of detecting a person included in the video from the video data photographed by the photographing means arranged in a predetermined security area, and monitoring the detected person;
A suspicious person detection step of detecting a person who satisfies a predetermined detection condition as a suspicious person among persons to be monitored;
A position information calculating step for calculating relative position information between the detected suspicious person and the patrol guard;
A suspicious person information transmitting step of transmitting predetermined information to a mobile terminal held by the patrol guard based on the calculated relative position information. A visual determination step for determining whether or not the patrol guard can visually recognize the suspicious person,
The patrol guard support method according to claim 7, wherein in the suspicious person information transmitting step, predetermined information is transmitted to the mobile terminal held by the patrol guard based on the determination result. On the computer,
A person monitoring process for detecting a person included in the video from the video data photographed by the photographing means arranged in the predetermined security area, and monitoring the detected person;
Suspicious person detection processing for detecting a person who satisfies a predetermined detection condition as a suspicious person among persons to be monitored;
Position information calculation processing for calculating relative position information between the detected suspicious person and the patrol guard;
A patrol guard support program for executing a suspicious person information transmitting process for transmitting predetermined information to a mobile terminal held by the patrol guard based on the calculated relative position information. On the computer,
A visual inspection process is performed to determine whether the patrol guard can visually recognize the suspicious person,
The traveling security support program according to claim 9, wherein in the suspicious person information transmission process, based on a determination result, a process of transmitting predetermined information to a mobile terminal held by the patrol guard is executed.

Images