JP2017040983A - Security system and person image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily obtain tracking information visually on behavior of a person to be monitored, in a monitoring area.SOLUTION: A security system includes: a camera 11 for imaging a predetermined monitoring area; a recorder 13 for recording an image captured by the camera 11; a sensor 12 for detecting a predetermined event in the monitoring area, on the basis of a predetermined detection condition; and a video monitoring display device 14 which receives captured images from the camera 11 and the recorder 13, to display the images. When a predetermined event is detected in the monitoring area, the video monitoring display device 14 extracts a captured image of a suspect from among the captured images recorded in the recorder 13, displays transitional captured images based on the behavior of the suspect, in time series, as well as displaying map information indicating shooting positions of the captured images, and displays position information of a shooting position of a corresponding captured image, on the map information, when a transitional captured image is specified for displaying the shooting position.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a security system and a person image display method for monitoring a monitoring target such as a person using a monitoring camera and reporting when a predetermined event occurs.

  In recent years, surveillance cameras are often installed in various places such as stores (for example, shopping malls), public facilities (for example, stations and stadiums), offices, factories, warehouses, etc., and images of monitoring subjects such as people in the surveillance area are often taken. It has become. In addition, this type of surveillance camera is used by a security system that notifies and reports to the operator, security contractor, police, etc. of the monitored location when a certain event such as an incident occurs in the surveillance area. Has been.

  As a conventional example of a security system, for example, as described in Patent Document 1, a security system that detects a suspicious person who has entered a monitoring area around a building and issues an alarm, and a mobile object that is a permitter, When the second moving body that is the permitter is simultaneously detected in the monitoring area, it is determined whether or not the non-permitted person is a suspicious person according to the movement path of the permitter and the movement path of the non-permitted person. is there.

JP 2011-165054 A

  The conventional security system has a function to determine whether a suspicious person is detected and report when a suspicious person is detected. Based on the notification, it is possible to recognize the presence of a suspicious person, rush to the site, etc. It has become. However, in the conventional security system, for example, when trying to obtain a tracking report on the suspect's behavior at the time of the incident, an image showing the suspect is manually selected from a plurality of images captured and recorded by the surveillance camera. It took a lot of time and effort to create the report. For this reason, for example, it is difficult to obtain tracking information regarding the behavior of the suspect, such as visually grasping the history of the behavior of the suspect related to the incident in time series.

  In order to solve the above-described conventional problems, the present invention provides a security system and a person image display method capable of visually easily obtaining tracking information regarding the behavior of a monitoring target such as a person in a monitoring area. With the goal.

  The present invention includes a camera that captures a predetermined monitoring area, a recorder that records a captured image captured by the camera, a sensor that detects a predetermined event in the monitoring area based on a predetermined detection condition, and the camera Or a video monitoring display device that inputs a captured image from the recorder and displays the captured image, and the video monitoring display device records the predetermined event in the monitoring area when the predetermined event is detected. Extracting a plurality of captured images in which the suspect of the event is captured from the captured image, and using the extracted captured image to display a transition captured image based on the behavior of the suspect in time series, When the map information indicating the imaging position of the captured image is displayed, and the designation input of the captured image of the position display target is received for the transition captured image, the imaging point of the corresponding captured image The position information, and displays on the map information, to provide a security system.

  The present invention is also a person image display method in a security system, wherein a predetermined monitoring area is imaged by a camera, an image captured by the camera is recorded by a recorder, and a sensor is used based on a predetermined detection condition. A predetermined event in the monitoring area is detected, a captured image from the camera or the recorder is input by a video monitoring display device, the captured image is displayed, and the monitoring is performed in the display of the captured image by the video monitoring display device. When a predetermined event is detected in the area, a plurality of captured images in which the suspect of the event is captured are extracted from the captured images recorded in the recorder, and the suspected image is extracted using the extracted captured images. A transition captured image based on a person's action is displayed in time series, map information indicating an imaging position of the captured image is displayed, and the transition captured image is displayed. When receiving the specified input position indication object of the captured image with the position information of the imaging point of the corresponding captured image, and displays on the map information, provides a human image display method.

  According to the present invention, it is possible to visually easily obtain tracking information regarding the behavior of a monitoring target such as a person in a monitoring area.

The block diagram which shows an example of the system configuration | structure of the security system of this embodiment The block diagram which shows an example of a functional structure of the security system of this embodiment The flowchart which shows the main operation | movement in the security system of this embodiment The figure which shows an example of the transition captured image display screen which shows the map information corresponding to the transition captured image based on the captured image of a suspect, and a transition captured image The flowchart which shows the display procedure of the imaging position information in a transition captured image display screen The figure which shows an example of the captured image reproduction screen which expands and displays the captured image in a transition captured image display screen The flowchart which shows the enlarged display procedure of the captured image in a transition captured image display screen and a captured image reproduction screen Flow chart showing incident related information input procedure The figure which shows an example of the display screen at the time of selecting the captured image output as a security report in a transition captured image display screen The flowchart which shows the output image selection procedure which selects the captured image output as a security report in a transition captured image display screen The flowchart which shows the output image selection cancellation | release procedure which cancels | releases selection of the captured image output as a security report in a transition captured image display screen The figure which shows an example of the display screen at the time of displaying the non-display part before and behind a transition captured image on a transition captured image display screen The flowchart which shows the display image movement display procedure which scrolls the transition captured image displayed on a transition captured image display screen The figure which shows an example of the display screen at the time of printing out the security report containing the transition captured image selected on the transition captured image display screen The flowchart which shows the report printing procedure which prints out the security report on the transition captured image display screen Figure showing an example of a report printed out as a security report

  Hereinafter, an embodiment (hereinafter referred to as “this embodiment”) that specifically discloses a security system and a person image display method according to the present invention will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

  In this embodiment, as an example of a security system, a plurality of monitoring cameras are provided at various locations of a complex store such as a shopping mall to shoot a monitoring target, and when an incident such as theft occurs as a predetermined event, the suspect's The structural example of the system which performs the report containing a captured image is shown. However, the embodiment of the security system and the person image display method according to the present invention is not limited to the contents of the embodiment described later.

[Security system configuration]
FIG. 1 is a block diagram illustrating an example of a system configuration of a security system 10 according to the present embodiment. The security system 10 includes a plurality of cameras 11-1 to 11-n, a plurality of various sensors 12-1 to 12-k, and a plurality of recorders 13-1 to 13-m.

  The cameras 11-1 to 11-n are configured to include a lens and an image sensor, are provided at various locations corresponding to a desired monitoring area, and are attached to ceilings, walls, and the like of the respective installation locations. For example, a wide-angle lens capable of obtaining a wide viewing angle of 140 degrees or more is used as the lens, and a subject image in the field of view is formed on the imaging surface of the imaging device. The image sensor is an imaging device such as a CCD (Charged-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts an optical image formed on the imaging surface into an electrical signal. Arbitrary n cameras 11-1 to 11-n are provided according to the conditions of the installation location, the system configuration, and the like. Each of the cameras 11-1 to 11-n captures an image of a subject at an installation location where the cameras 11-1 to 11-n are arranged, and acquires camera-captured images in each monitoring area. As the camera-captured video, for example, a moving image of each monitoring area is captured.

  The sensors 12-1 to 12-k are any one of various sensors such as a shoplifting prevention gate, a face matching alarm, a fire alarm, a metal detector, an object sensor, and a touch sensor. Sensors are provided at various locations. Arbitrary k sensors 12-1 to 12-k are provided according to the conditions of the installation location, the system configuration, and the like. The sensors 12-1 to 12-k detect a person, an object, an event, or the like to be detected, and output alarm information. For example, if a shoplifting prevention tag is attached to an unpurchased product in a store and a shoplifter goes through the shoplifting prevention gate after shoplifting without purchasing the product, the shoplifting prevention gate generates an alarm. It rings.

  The recorders 13-1 to 13-m are configured to include a storage device such as a hard disk or a semiconductor memory, and record camera-captured images captured by the cameras 11-1 to 11-n. Arbitrary m recorders 13-1 to 13-m are provided according to the conditions of the installation location, the system configuration, and the like. As a recorded video to be recorded in the recorders 13-1 to 13-m, not only a moving image of a camera-captured video but also a camera-captured image of a still image generated from the moving image can be recorded.

  The security system 10 includes a video monitoring display device 14, various sensor management devices 15, a database 16, a face matching server 17, a form output device 18, an input device 19, and a monitor 20.

  Cameras 11-1 to 11-n, various sensors 12-1 to 12-k, recorders 13-1 to 13-m, video surveillance display device 14, various sensor management devices 15, database 16, face matching server 17, form The output device 18 is connected to each other via the network 25 and can transmit and receive information. The network 25 is a wireless network or a wired network. The wireless network is, for example, a wireless LAN (Local Area Network), a wireless WAN (Wide Area Network), 3G, LTE (Long Term Evolution), or WiGig (Wireless Gigabit). The wired network is, for example, an intranet or the Internet.

  The video monitoring and display device 14 is configured using a computer (for example, a PC (Personal Computer)), and a camera and video captured as a moving image or a camera captured image as a still image by the cooperation of a processor and a memory according to a predetermined computer program. Various processes relating to these (hereinafter collectively referred to as “captured images”) are executed. The computer of the video surveillance display device 14 includes, for example, a processor such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit) or a DSP (Digital Signal Processor), a working memory such as a RAM (Random Access Memory) or a flash memory, It is configured using a program memory and data memory such as a ROM (Read Only Memory) and a communication interface for transmitting and receiving data. The video surveillance display device 14 receives captured images from the cameras 11-1 to 11-n and the recorders 13-1 to 13-m, and performs processing such as displaying captured images and generating a security report.

  The various sensor management devices 15 are configured by using a computer (for example, a PC), and execute various processes related to management of alarm information of various sensors by cooperation of a processor and a memory according to a predetermined computer program. The various sensor management devices 15 manage the settings of the respective sensors 12-1 to 12-k, the detection conditions in the sensors 12-1 to 12-k, and output sensor management information to the video monitoring display device 14. The various sensor management devices 15 may be configured by a single computer together with the video monitoring display device 14.

  The video monitoring display device 14 recognizes that a predetermined event has been detected in the monitoring area based on the alarm information output from the sensors 12-1 to 12-k based on the sensor management information. The sensors 12-1 to 12-k include those that detect specific persons, objects, and the like using the captured images of the cameras 11-1 to 11-n. There may be a configuration that functions as the sensors 12-1 to 12-k. In the present embodiment, the various sensor management devices 15 set the occurrence of an incident such as theft as a detection condition, and the video surveillance display device 14 recognizes that the occurrence of the event has been detected by inputting corresponding alarm information.

  The database 16 is configured using a storage device (for example, a hard disk), and stores face information of a person existing in the captured images captured by the cameras 11-1 to 11-n. As the face information stored in the database 16, the data of each face image and the face feature metadata indicating the characteristics of each part in the face image are stored and stored.

  The face collation server 17 is configured using a computer, and executes collation processing of face information by the cooperation of the processor and the memory according to a predetermined computer program for the server. The face matching server 17 compares and matches the feature data acquisition unit that acquires face image data (including thumbnails) and face feature metadata, and the face image to be matched with the face feature metadata of the matching source. A face collation unit that determines whether to perform the transmission and a communication unit that transmits and receives face information.

  The face collation server 17 uses the face images and face feature metadata stored in the database 16 to capture persons in the captured images captured by the cameras 11-1 to 11-n or recorded in the recorders 13-1 to 13-m. The face image stored in the database 16 is collated to see if it is the same person. In this embodiment, the face collation server 17 performs face collation of the suspect related to the case, determines a face image that matches the suspect's face from a plurality of captured images, and captures the suspect. To extract.

  The form output device 18 as an example of a printing device is configured by, for example, a printer having a printing function, and prints out a security report form including a captured image generated by the video monitoring display device 14. The form output device 18 can also output the form data of the security report to another device, for example, a monitoring center of a security contracting company provided outside via a network.

  The input device 19 is configured using, for example, a mouse, a keyboard, a touch panel, or a touch pad, and is connected to the video monitoring display device 14 and inputs instructions regarding various operations and settings to the video monitoring display device 14 according to a user's input operation. .

  The monitor 20 is configured by using a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence), for example, and is connected to the video monitoring display device 14, and various displays related to the captured image generated by the video monitoring display device 14. Display the screen. When a device having a touch panel is used as the input device 19, a configuration in which the display device and the input device are combined in which the input device 19 using a translucent touch sensor is disposed on the monitor 20 is assumed. . As a device including the input device 19 and the monitor 20, a smartphone, a tablet terminal, or the like may be used.

  FIG. 2 is a block diagram illustrating an example of a functional configuration of the security system 10 according to the present embodiment. The video monitoring display device 14 generates a security report including the captured image and the incident related information and the form output device 18 that performs processing related to display output of the captured image and the incident related information on the monitor 20. A report print processing unit 142 that executes a process related to print output.

  Camera-captured images captured by the camera 11 (hereinafter represented by the cameras 11-1 to 11-n) are sent to the image monitoring control unit 141 and the face matching server 17 of the image monitoring display device 14, and the recorder 13. (Hereinafter, representative of the recorders 13-1 to 13-m) is sent and recorded. The current camera-captured video (live video) captured by the camera 11 can be sent to the monitor 20 and displayed in real time.

  A moving image or a still image captured by the camera (captured image) recorded in the recorder 13 is sent to the video monitoring control unit 141. The captured image recorded in the recorder 13 can also be sent to the monitor 20 and displayed.

  The face collation server 17 having a function as a face collation processing unit inputs camera-captured images captured by the camera 11 and extracts face feature metadata and a face image for a human face included in the captured image. To the database 16. The database 16 having a function as a face information storage unit stores face information including face feature metadata and a face image sent from the face matching server 17. In addition, the face collation server 17 collates whether or not the face image in the current captured image is a face image of the same person using the face image stored in the database 16 and the face feature metadata.

  When the sensor 12 (hereinafter, representative of the sensors 12-1 to 12-k) detects an incident such as theft as a predetermined event, alarm information is input to the video monitoring control unit 141. Alarm information includes detection signals for shoplifting prevention gates installed in the vicinity of store entrances, door unlock signals when entering and exiting designated areas using card readers, etc., and fences around store sites A detection signal of the touch sensor is used. In addition, by using the camera 11 as the sensor 12, it is possible to emit detection information when a person is detected in a captured image in a place where a person usually does not enter.

  When the alarm information notifying the occurrence of the incident is input, the video monitoring control unit 141 sets the face image of the suspect from the captured image according to the operation input of the input device 19 by the guard who is the user. Further, the face collation server 17 collates the face image of the suspect, and the video monitoring control unit 141 captures the captured image including the face image of the same person as the suspect from the captured images recorded in the recorder 13. A captured image showing the suspect is extracted.

  In addition, the occurrence of the incident is detected not only by the alarm information from the sensor 12 but also by the security guard confirming the occurrence of the incident from a suspicious movement by looking at the live camera image taken on the monitor 20 and operating the input device 19. It can also be done by input.

  The video monitoring control unit 141 displays the captured image including the extracted suspect on the monitor 20. Further, the video monitoring control unit 141 inputs incident related information used as a memo of the suspect and incident related to the captured image in accordance with the operation input of the input device 19 by the user, and the memory of the video monitoring display device 14, Alternatively, it is recorded in the database 16 or the recorder 13. In addition, the video monitoring control unit 141 generates various display screens including the captured image and the case related information according to the operation input of the input device 19 by the user, and displays the generated display screen on the monitor 20.

  The report print processing unit 142 generates a security report including the captured image selected for the report and the incident related information in accordance with the operation input of the input device 19 by the user, and outputs it to the form output device 18. The form output device 18 prints out the security report generated by the report print processing unit 142.

[Operation of the security system]
FIG. 3 is a flowchart showing main operations in the security system 10 of the present embodiment. The camera 11 continuously shoots the monitoring area of each installation location, and the recorder 13 records the camera shot video shot by the camera 11. At this time, the video surveillance display device 14 can acquire camera-captured video from the camera 11 and the recorder 13.

  The face matching server 17 receives and acquires the camera-captured video captured by the camera 11 (step S11). Then, the face matching server 17 detects the face of a person in the video from the camera-captured video, and records and stores the face feature metadata indicating the feature of the face and the face image in the database 16 (step S12).

  When an incident such as theft occurs in a store where the security system 10 is deployed, the video surveillance display device 14 receives and acquires alarm information from the sensor 12 (step S13). When the alarm information is received, the video surveillance display device 14 may display the alarm information on the monitor 20 to notify the occurrence of the incident.

  By receiving the alarm information, the video surveillance display device 14 executes processing when an incident occurs. First, the video surveillance display device 14 extracts a captured image showing the suspect from the captured image recorded in the recorder 13, and inputs incident related information (step S14). Here, the video surveillance display device 14 selects a captured image captured by the suspect in accordance with an operation input of the input device 19 by a guard who is a user, and inputs incident related information corresponding to the captured image of the suspect. To do.

  When selecting the captured image captured by the suspect, for example, the captured image recorded immediately before the incident occurrence time (alarm information reception time) recorded in the recorder 13 is read and displayed on the monitor 20, and the suspect is captured. A captured image of about 30 frames is selected as a candidate image. Then, the security guard designates and selects a captured image at an angle from which the facial features of the suspect are easily understood from the candidate images by, for example, frame-feeding the candidate images. At this time, a region including the face image of the suspect in the captured image may be trimmed and enlarged.

  The face matching server 17 also extracts the face feature metadata and face image of the suspect, and records and saves them in the database 16 for the captured image obtained by capturing the suspect. In this case, face feature metadata and a face image are acquired based on a captured image of an angle at which the facial feature of the suspect selected as described above is easily understood. Then, the face collation server 17 collates the face image in the captured image with the face image of the suspect for the captured image recorded up to the present time recorded in the recorder 13, and searches for the captured image including the face image of the suspect. Step S15). Thereby, the picked-up image in which the suspect was imaged at different times and places from before the incident occurrence to after the incident occurrence is extracted.

  In addition, when extracting the captured image in which the suspect was imaged, the suspect may be detected by reading the identification code from the captured image. For example, in a store where a visitor generally holds a shopping cart, a shopping basket, a shopping bag, etc. in the store, in an environment in which a specific visitor can be associated with on-site equipment such as a shopping cart, A specific person can be tracked by attaching an identification code to the equipment in the hall and detecting the identification code from the captured image of each monitoring area in the store. In this case, face collation and identification code detection processing are executed, the face image of the suspect is associated with an identification code that exists together within a predetermined range, and the corresponding identification code is tracked and detected. Thereby, the captured image in which the suspect is captured can be extracted from the captured image in which the specific identification code is detected. As the identification code, for example, an identification code using color information such as a color barcode, or a two-dimensional barcode may be appropriately used. For example, a chameleon code (registered trademark) may be used as the color barcode.

  Subsequently, the video monitoring display device 14 displays, on the monitor 20, a transition captured image based on the behavior of the suspect in time series, using the extracted captured image of the suspect until the incident occurrence. Further, the video surveillance display device 14 simultaneously displays the map information indicating the position where each captured image is captured, together with the transition captured image, on the monitor 20 (step S16). Transition captured images are images in which multiple captured images of the same suspect at different times and locations are arranged in chronological order along with the elapsed time based on the behavior of the suspect before and after the incident. .

  The video surveillance display device 14 inputs a form output instruction in accordance with an operation input of the input device 19 such as pressing of a form output button by a guard or other user (step S17). Based on this form output instruction, the video surveillance display device 14 generates a security report in which transition captured images are displayed in time series, and prints out a security report form from the form output device 18 (step S18). In the security report, the incident related information is displayed together with the transition captured image. The form data of the security report may be output from the form output device 18 to another device such as a monitoring center of a security contractor provided outside via a network.

  The operation input of the input device 19 is an operation such as a pointer click using a mouse, a keyboard input operation, a touch panel or touchpad tap operation, or a specific operation by these input devices or other input devices. Various operations such as a gesture operation can be applied.

[Detailed operation of each process]
-Display of a captured image and map information FIG. 4: is a figure which shows an example of the transition captured image display screen which shows the map information corresponding to the transition captured image based on a suspected person's captured image, and a transition captured image.

  The transition captured image display screen 51 shown in FIG. 4 is displayed on the monitor 20 by the processing of the video surveillance display device 14. In the transition captured image display screen 51, for example, a plurality of captured images in which the suspect is imaged in a line along the lower edge of the screen are arranged in time series. A transition captured image 53 indicating the action history of the suspect is formed by the captured images arranged in time series. A map information image 52 indicating the imaging position of each captured image is arranged above the transition captured image 53. In the map information image 52, the layout of the store to be monitored is indicated by a map, and the imaging position of the captured image of each monitoring area can be displayed on the map based on the arrangement of the cameras 11.

  For example, when the user operates the input device 19 on the transition captured image display screen 51 to position the mouse pointer 55 on a specific captured image 53a in the transition captured image 53 (for example, mouse over), a specific An imaging position mark 56 corresponding to the captured image 53a and a positional information display 57 of the captured image are displayed. As the imaging position mark 56, a mark indicating a position such as a circle is displayed on the map information image 52. The position information display 57 displays the name (west entrance) of the imaging position (installation position of the camera 11) corresponding to the imaging position mark 56, the shooting date (YYYY / MM / DD), the shooting time (hh / mm / ss), and the like. Is displayed. Further, when the mouse pointer 55 is positioned on another captured image of the transition captured image 53, the display of the imaging position mark 56 and the position information display 57 is switched, and the imaging position and the imaging position information corresponding to the designated captured image are displayed. Is displayed.

  FIG. 5 is a flowchart showing a display procedure of imaging position information on the transition captured image display screen. The video surveillance display device 14 is in a state in which the transition captured image display screen 51 is displayed, in accordance with an instruction (for example, mouse over, tap, point) of the mouse pointer 55 by an operation input of the user input device 19. A designation input of a transition captured image to be displayed is received (step S21). In this case, in the transition captured image 53, designation of the captured image 53a that is the display target of the imaging position information is input.

  Then, the video surveillance display device 14 displays the imaging position mark 56 on the map information image 52 as the position information of the imaging point of the captured image 53 a corresponding to the designation input, and the position information display 57 corresponding to the imaging position mark 56. Is displayed (step S22).

Enlarged Display of Captured Image FIG. 6 is a diagram illustrating an example of a captured image playback screen that displays an enlarged captured image on the transition captured image display screen.

  As illustrated in FIG. 6, when the user operates the input device 19 on the transition captured image display screen 51 and designates (for example, clicks) a specific captured image 53 b of the transition captured image 53 with the mouse pointer 55. Then, the captured image enlargement display screen 61 is displayed, and the captured image reproduction screen 62 for displaying the specific captured image 53b in an enlarged manner and reproducing it is displayed. The captured image playback screen 62 is provided with a playback button, a stop button, a fast-forward button, a rewind button, and the like, and in accordance with a user operation instruction using the input device 19, playback of a moving image of the captured image is performed in an enlarged display state. Executed. The captured image enlargement display screen 61 is provided with a map information display button 63 for returning to the transition captured image display screen 51 including display of the original map information.

  The captured image reproduction screen 62 of the captured image enlargement display screen 61 recognizes the characteristics of the suspect, such as an image in which the suspect is facing the front, while the user reproduces and visually recognizes the moving image of the captured image. By temporarily stopping at a frame in an easy state, a captured image of a desired still image can be selected. That is, a captured image of a suitable frame can be selected from a captured image of a moving image having a plurality of frames and extracted as a captured image of a still image. In this case, when the map information display button 63 is operated to return to the original transition captured image display screen 51, in the transition captured image 53, the still image of the frame whose reproduction has been stopped is displayed on the captured image 53b. The captured image reproduction screen 62 enables confirmation of detailed contents by enlarged display of the captured image and determination of an output image frame of the captured image when outputting as a security report.

  FIG. 7 is a flowchart illustrating an enlarged display procedure of a captured image on the transition captured image display screen and the captured image reproduction screen. The video surveillance display device 14 is in a state where the transition captured image display screen 51 is displayed, by an instruction (for example, click, double tap, double click) of the mouse pointer 55 by an operation input of the input device 19 of the user. An enlarged display instruction input of any one of the transitional captured images to be enlarged and displayed is received (step S31). In this case, in the transition captured image 53, the designation of the captured image 53b that is a reproduction target of the captured image as an enlarged display is input.

  Then, the video surveillance display device 14 reads the captured image 53b corresponding to the designated input from the recorder 13, and displays the captured image enlarged display screen 61 of the captured image 53b. The recorded video of the moving image of the captured image 53b is reproduced and displayed on the entire display screen by the captured image reproduction screen 62 of the captured image enlargement display screen 61 (step S32).

-Incident-related information input FIG. 8 is a flowchart showing an incident-related information input procedure.

  When the video surveillance display device 14 acquires the alarm information from the sensor 12, as a process at the time of occurrence of the incident, for example, by the operation input of the input device 19 by the security guard who is the user, for example, by mouse click, touch panel double tap, etc. A designation input of a captured image as an information input target is received (step S41). For example, in a state in which the video surveillance display device 14 displays on the monitor 20 a captured image just before the incident occurrence point recorded in the recorder 13, a captured image in which the suspect was captured by the security officer's visual judgment is selected. The captured image for inputting the incident related information is designated by the operation input of the guard. The video surveillance display device 14 inputs designation of a captured image that is an input target of incident related information.

  Then, the video surveillance display device 14 inputs incident related information corresponding to the captured image in which the suspect corresponding to the designated input is captured (step S42). In the incident related information, the imaging information including at least one of the imaging position and the imaging time when the captured image is captured may be acquired from the camera 11 or the recorder 13 and automatically input.

As the incident related information, for example, the guard operates the keyboard of the input device 19 and inputs the type of alarm information, the characteristic information of the suspect, and the like. The incident related information is recorded in the memory of the video surveillance display device 14, the database 16, or the recorder 13. An example of incident related information is shown below.
[Common Name / Name] Common name ABCDE
[Alarm information: Origin] From shoplifting prevention gate A [Alarm information: Occurrence time] July 20, 2015 20:15:40 [Age] Visible around 35 years old [Gender] Visible to male [Height] About 160cm (Because it is about 10cm higher than the shoplifting prevention gate)
[Remarks] I often wander around the parking lot

-Output selection to security report of captured image FIG. 9 is a diagram illustrating an example of a display screen when selecting a captured image to be output as a security report on the transition captured image display screen.

  As shown in FIG. 9, on the transition captured image display screen 51, the user operates the input device 19 to specify a specific captured image 53c of the transition captured image 53 with the mouse pointer 55 (for example, right click). The image selection menu is displayed. In this state, when a menu item selection 64 is designated by dragging the image selection menu with the mouse pointer 55, a specific captured image 53c is selected as a report creation target to be output as a security report. The selected captured image for report creation is given a check box mark.

  Further, in the state where the image selection menu is displayed for the specific captured image 53c by the right click operation of the mouse pointer 55 or the like on the transition captured image display screen 51, the image selection menu is dragged with the mouse pointer 55 and the menu is displayed. When the item non-selection 65 is designated, the selection of the captured image 53c is canceled and excluded from the report creation target. The mark of the check box is deleted from the captured image from which the selection of the report creation target has been cancelled.

  FIG. 10 is a flowchart illustrating an output image selection procedure for selecting a captured image to be output as a security report on the transition captured image display screen. The video surveillance display device 14 displays the transition captured image display screen 51, and instructs the mouse pointer 55 by an operation input of the user's input device 19 (for example, right click-select, long tap-select), etc. Thus, the designation input of the transition captured image to be selected as the report creation target is received (step S51). In this case, in the transition captured image 53, the designation of the captured image 53c to be selected as a report creation target is input.

  Then, the video surveillance display device 14 sets the captured image 53c corresponding to the designated input as a report creation target, and adds a check box mark (step S52).

  FIG. 11 is a flowchart illustrating an output image selection cancellation procedure for canceling selection of a captured image to be output as a security report on the transition captured image display screen. The video surveillance display device 14 is in a state where the transition captured image display screen 51 is displayed, and an instruction of the mouse pointer 55 by an operation input of the user's input device 19 (for example, right click-non-selection, long tap-nonselection). ) Or the like to receive a designation input of a transition captured image to be a non-selection target for report creation (step S61). In this case, in the transition captured image 53, the designation of the captured image 53c that is to be a non-selected target for report creation (deselection) is input.

  Then, the video surveillance display device 14 cancels the setting of the captured image 53c corresponding to the designated input from the report creation target, and deletes the mark of the check box (step S62).

-Scroll display of transition captured image FIG. 12 is a diagram illustrating an example of a display screen when displaying a non-display portion before and after the transition captured image on the transition captured image display screen.

  As shown in FIG. 12, when the user operates the input device 19 on the transition captured image display screen 51 to move the transition captured image 53 with the mouse pointer 55 (for example, drag and drop), the movement operation is performed. Thus, the image group of the transition captured image 53 moves. Thus, the captured images that are displayed before the moving operation are displayed so that captured images that are not displayed before or after the shooting time appear in order. For example, when the transition captured image 53 is moved to the left, the image group of the transition captured image 53 is moved to the left, and the captured images after the shooting time are sequentially displayed.

  FIG. 13 is a flowchart illustrating a display image moving display procedure for scrolling the transition captured image displayed on the transition captured image display screen. The video surveillance display device 14 is in a state in which the transition captured image display screen 51 is displayed, and the operation of the mouse pointer 55 (for example, drag-and-drop, flick, swipe) by the user's input operation of the input device 19 is performed. A moving operation input of the displayed transition captured image group is received (step S71). In this case, in the transition captured image 53, a movement instruction indicating a movement direction and a movement amount for scroll display is input.

  Then, the video surveillance display device 14 scrolls the transition captured image 53 in accordance with the movement instruction, and displays the captured image before or after the shooting time (step S72).

-Print output of a security report FIG. 14: is a figure which shows an example of the display screen at the time of printing out the security report containing the transition captured image selected on the transition captured image display screen.

  As shown in FIG. 14, when the user operates the input device 19 and operates the report print button 54 with the mouse pointer 55 (for example, clicks) on the transition captured image display screen 51, the report is selected as a report creation target. A security report displaying the captured image and the incident related information corresponding to the captured image is created and printed out from the form output device 18. In the example of FIG. 14, the captured images 53d, 53e, 53f, and 53g are selected from the transition captured images 53, and a security report that displays these captured images 53d, 53e, 53f, and 53g side by side is created. At this time, the respective captured images 53d, 53e, 53f, and 53g are obtained by outputting and displaying still images of output image frames selected from moving images of the captured images of a plurality of frames in the security report.

  FIG. 15 is a flowchart showing a report printing procedure for printing out a security report on the transition captured image display screen. The video surveillance display device 14 prints a form in accordance with an instruction (for example, a print button click or tap) of the mouse pointer 55 by an operation input of the user's input device 19 while the transition captured image display screen 51 is displayed. An output instruction input is accepted (step S81). In this case, a pressing operation of the report print button 54 is input in a state where a predetermined captured image is selected as a report creation target.

  Then, the video surveillance display device 14 arranges the captured images selected as the report creation target among the transition captured images in time series, and associates the information of the imaging position and the imaging time as incident related information with respect to each captured image. A form of the attached security report is generated and output to the form output device 18 for printing (step S82).

  FIG. 16 is a diagram illustrating an example of a report printed out as a security report. In the report 71 as a security report, the face detection original image 72 enlarged and displayed so that the characteristics of the suspect are clearly shown is arranged in the upper part, and the transition imaged images 73 to be generated in the report are arranged in time series in the lower part. Has been displayed. The face detection source image 72 is a detection source suspect image in which the face image of the suspect is detected from the captured image and the face image and face feature metadata are recorded in the database 16, and the face feature of the suspect is understood. A captured image at an easy angle is used, and becomes a face image of a collation source used at the time of face collation. Under each transition captured image 73, imaging information 74 including the name of the imaging position, the shooting date, and the shooting time is displayed as incident related information. In the example of FIG. 16, based on the suspect's behavior history, time is taken by the camera at each imaging position in the monitoring area in the order of West entrance → Cosmetic department → Jewelry shop → General store → Men's clothing department → Bookstore (bookstore). A transition picked-up image 73 picked up in series is shown.

  With the security report 71, it is possible to grasp the characteristics of the suspect and the action history up to the incident at a glance in chronological order.

  As described above, in the present embodiment, when the occurrence of an incident such as theft is detected in the monitoring area, the video surveillance display device 14 captures the suspect in the incident from the captured image of the monitoring area recorded in the recorder 13. A plurality of captured images are extracted, and using the extracted captured images, transition captured images based on the behavior of the suspect are displayed in time series together with the imaging time. The video surveillance display device 14 displays a transition captured image display screen 51 on the display screen of the monitor 20, and displays the transition captured images 53 in time series on the transition captured image display screen 51.

  In addition, the video surveillance display device 14 displays a map information image 52 indicating an imaging position of each captured image together with the transition captured image 53 on the transition captured image display screen 51. In the map information image 52, an imaging position mark 56 corresponding to the captured image 53a designated by the user and a positional information display 57 of the captured image are displayed so that the position where each captured image is captured can be grasped at a glance. To.

  Also, the video surveillance display device 14 generates a security report form and outputs it to the form output device 18 to print out a report 71 as a security report. In the report 71, the transition captured images 73 to be generated by the report are arranged and displayed in time series, and the imaging information 74 such as the imaging position and the imaging time associated with each transition captured image 73 is displayed as incident related information. To do.

  According to the present embodiment, by displaying and outputting a transition captured image composed of a plurality of time-series captured images in which the same suspect is imaged, tracking information regarding the behavior of the monitoring target such as the suspect in the monitoring area is obtained. It can be easily obtained visually. For this reason, the user of a security system can grasp | ascertain the appearance position, action, etc. of a suspect by time according to elapsed time at a glance.

  The security system 10 according to the present embodiment detects a predetermined event in a monitoring area based on a predetermined detection condition, a camera 11 that captures a predetermined monitoring area, a recorder 13 that records a captured image captured by the camera 11, and the like. And a video surveillance display device 14 that inputs a captured image from the camera 11 or the recorder 13 and displays the captured image. When a predetermined event is detected in the monitoring area, the video surveillance display device 14 extracts a plurality of captured images in which the suspect of the event is captured from the captured image recorded in the recorder 13, and extracts the extracted captured images. When the transition captured image based on the action of the suspect is displayed in time series, the map information indicating the imaging position of the captured image is displayed, and the designation input of the captured image of the position display target is received for the transition captured image In addition, the position information of the imaging point of the corresponding captured image is displayed on the map information.

  As a result, the user of the security system can easily visually obtain tracking information related to the behavior of the suspect in the monitoring area by viewing the transition captured image. Moreover, the display position of each captured image can be intuitively grasped by displaying the map information. In addition, by designating a specific captured image, it is possible to easily confirm the imaging point of the corresponding captured image.

  Further, when the video surveillance display device 14 receives a movement operation input of the display image in the transition captured image, the security system 10 scrolls the transition captured image in accordance with the movement instruction, and captures the imaging before or after the imaging time. Display an image. Thereby, regarding the time-series transition captured images that are currently displayed, captured images before or after the capturing time can be sequentially displayed.

  Further, when the video surveillance display device 14 receives an enlarged display instruction input of any captured image with respect to the transition captured image, the security system 10 reproduces the captured image reproduction screen in which the corresponding captured image is reproduced in an enlarged display state. Is displayed. Thereby, the detailed image regarding the action of the suspect can be confirmed by enlarging and reproducing the moving image of the captured image.

  The person image display method according to the present embodiment is a person image display method in the security system 10 including the camera 11, the recorder 13, the sensor 12, and the video surveillance display device 14, and displays a captured image by the video surveillance display device 14. When a predetermined event is detected in the monitoring area, a plurality of captured images in which the suspect of the event is captured are extracted from captured images captured by the camera 11 and recorded in the recorder 13, and the extracted captured images are used. The transition captured image based on the suspect's action is displayed in time series, the map information indicating the captured position of the captured image is displayed, and the transition captured image receives the designation input of the captured image of the position display target. The position information of the imaging point of the corresponding captured image is displayed on the map information. Thereby, it becomes possible to easily obtain the tracking information related to the behavior of the suspect in the monitoring area visually.

  While various embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  INDUSTRIAL APPLICABILITY The present invention is useful as a security system and a person image display method that can easily obtain tracking information related to behavior of a monitoring target such as a person in a monitoring area.

DESCRIPTION OF SYMBOLS 10 Security system 11, 11-1 to 11-n Camera 12, 12-1 to 12-k Sensor 13, 13-1 to 13-m Recorder 14 Video monitoring display unit 141 Video monitoring control unit 142 Report print processing unit 15 Various Sensor management device 16 Database 17 Face collation server 18 Form output device 19 Input device 20 Monitor 25 Network 51 Transition captured image display screen 52 Map information image 53 Transition captured image 54 Report print button 61 Captured image enlarged display screen 62 Captured image reproduction screen 71 Report (security report)
72 Face detection original image 73 Transition captured image 74 Imaging information (incident related information)

Claims (4)

A camera for imaging a predetermined monitoring area;
A recorder for recording a captured image captured by the camera;
A sensor for detecting a predetermined event in the monitoring area based on a predetermined detection condition;
A video surveillance display device that inputs a captured image from the camera or the recorder and displays the captured image,
The video surveillance display device
When a predetermined event is detected in the monitoring area, a plurality of captured images in which the suspect of the event is captured is extracted from the captured image recorded in the recorder, and the extracted captured image is used. While displaying the transition captured image based on the action of the suspect in time series, displaying map information indicating the imaging position of the captured image,
When receiving the designation input of the captured image of the position display target for the transition captured image, the position information of the imaging point of the corresponding captured image is displayed on the map information.
Security system. The security system according to claim 1,
The video surveillance display device
When a moving operation input of a display image is received in the transition captured image, the transition captured image is scrolled according to a movement instruction, and the captured image before or after the shooting time is displayed.
Security system. The security system according to claim 1 or 2,
The video surveillance display device
When an enlarged display instruction input of any captured image is received for the transition captured image, a captured image reproduction screen for reproducing the corresponding captured image in an enlarged display state is displayed.
Security system. A method for displaying a person image in a security system,
Capture a predetermined monitoring area with the camera,
Record the captured image captured by the camera with a recorder,
Detecting a predetermined event in the monitoring area based on a predetermined detection condition by a sensor;
Input a captured image from the camera or the recorder by a video surveillance display device, display the captured image,
In displaying captured images by the video surveillance display device,
When a predetermined event is detected in the monitoring area, a plurality of captured images in which the suspect of the event is captured is extracted from the captured image recorded in the recorder, and the extracted captured image is used. While displaying the transition captured image based on the action of the suspect in time series, displaying map information indicating the imaging position of the captured image,
When receiving the designation input of the captured image of the position display target for the transition captured image, the position information of the imaging point of the corresponding captured image is displayed on the map information.
Human image display method.

Images