WO2017029779A1 - Système de sécurité, procédé d'affichage d'image de personne, et procédé de création de rapport - Google Patents

Système de sécurité, procédé d'affichage d'image de personne, et procédé de création de rapport Download PDF

Info

Publication number
WO2017029779A1
WO2017029779A1 PCT/JP2016/003555 JP2016003555W WO2017029779A1 WO 2017029779 A1 WO2017029779 A1 WO 2017029779A1 JP 2016003555 W JP2016003555 W JP 2016003555W WO 2017029779 A1 WO2017029779 A1 WO 2017029779A1
Authority
WO
WIPO (PCT)
Prior art keywords
captured image
captured
image
display device
suspect
Prior art date
Application number
PCT/JP2016/003555
Other languages
English (en)
Japanese (ja)
Inventor
高橋　秀明
中村　学
公嗣 矢野
中村　陽一
貴光 荒井
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2015160666A external-priority patent/JP6268497B2/ja
Priority claimed from JP2015160665A external-priority patent/JP6268496B2/ja
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2017029779A1 publication Critical patent/WO2017029779A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B23/00—Alarms responsive to unspecified undesired or abnormal conditions
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/04—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using a single signalling line, e.g. in a closed loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • This disclosure relates to a security system, a person image display method, and a report creation method for monitoring a monitoring target such as a person using a monitoring camera and reporting when a predetermined event occurs.
  • surveillance cameras are often installed in various places such as stores (for example, shopping malls), public facilities (for example, stations and stadiums), offices, factories, warehouses, etc., and images of monitoring subjects such as people in the surveillance area are often taken. It has become.
  • this type of surveillance camera is used by a security system that notifies and reports to the operator, security contractor, police, etc. of the monitored location when a certain event such as an incident occurs in the surveillance area. Has been.
  • a security system that detects a suspicious person who has entered a monitoring area around a building and issues an alarm, and a mobile object that is a permitter, When the second moving body that is the permitter is simultaneously detected in the monitoring area, it is determined whether or not the non-permitted person is a suspicious person according to the movement trajectory of the permitter and the movement trajectory of the non-permitted person. is there.
  • the conventional security system has a function to determine whether a suspicious person is detected and report when a suspicious person is detected. Based on the notification, it is possible to recognize the presence of a suspicious person, rush to the site, etc. It has become.
  • an image showing the suspect is manually selected from a plurality of images captured and recorded by the surveillance camera. It took a lot of time and effort to create the report. For this reason, for example, it is difficult to obtain tracking information regarding the behavior of the suspect, such as visually grasping the history of the behavior of the suspect related to the incident in time series.
  • the present disclosure provides a security system, a person image display method, and a report that can easily obtain tracking information regarding the behavior of a monitoring target such as a person in a monitoring area.
  • the purpose is to provide a creation method.
  • the present disclosure relates to a camera that captures a predetermined monitoring area, a recorder that records a captured image captured by the camera, a sensor that detects a predetermined event in the monitoring area based on a predetermined detection condition, and a camera or recorder.
  • a video surveillance display device that inputs the captured image and displays the captured image. When a predetermined event is detected in the monitoring area, the video surveillance display device suspects the event from the captured image recorded in the recorder.
  • a plurality of captured images taken by the person are extracted, and using the extracted captured images, a transition captured image based on the suspect's behavior is displayed in time series, and map information indicating an imaging position of the captured image is displayed.
  • the security system displays the position information of the imaging point of the corresponding captured image on the map information.
  • the present disclosure is a human image display method in a security system, in which a predetermined monitoring area is captured by a camera, a captured image captured by the camera is recorded, and monitoring is performed by a sensor based on a predetermined detection condition.
  • a predetermined event in the area is detected, a captured image from a camera or a recorder is input by the video surveillance display device, and the captured image is displayed.
  • the predetermined event occurs in the monitoring region.
  • a plurality of captured images obtained by capturing the suspect of the event are extracted from the captured images recorded in the recorder, and the transition captured images based on the suspect's actions are time-sequentially extracted using the extracted captured images.
  • Display the map information indicating the imaging position of the captured image and receive the designation input of the captured image of the position display target for the transition captured image.
  • the present disclosure provides a camera that captures a predetermined monitoring area, a recorder that records a captured image captured by the camera, a sensor that detects a predetermined event in the monitoring area based on a predetermined detection condition, A video surveillance display device that inputs a captured image from the recorder and displays the captured image, and the video surveillance display device detects an event from the captured image recorded in the recorder when a predetermined event is detected in the monitoring area.
  • a security system is provided that extracts a plurality of captured images captured by the suspect, and displays the transition captured images based on the behavior of the suspect in time series along with the imaging time using the extracted captured images.
  • the present disclosure it is possible to easily obtain the tracking information regarding the behavior of the monitoring target such as a person in the monitoring area visually.
  • FIG. 1 is a block diagram illustrating an example of a system configuration of a security system according to the present embodiment.
  • FIG. 2 is a block diagram illustrating an example of a functional configuration of the security system according to the present embodiment.
  • FIG. 3 is a flowchart showing main operations in the security system of the present embodiment.
  • FIG. 4 is a diagram illustrating an example of a transition captured image display screen showing a transition captured image based on a captured image of the suspect and map information corresponding to the transition captured image.
  • FIG. 5 is a flowchart showing a display procedure of imaging position information on the transition captured image display screen.
  • FIG. 6 is a diagram illustrating an example of a captured image reproduction screen that enlarges and displays a captured image on the transition captured image display screen.
  • FIG. 7 is a flowchart illustrating an enlarged display procedure of a captured image on the transition captured image display screen and the captured image reproduction screen.
  • FIG. 8 is a flowchart showing a procedure for inputting incident related information.
  • FIG. 9 is a diagram illustrating an example of a display screen when selecting a captured image to be output as a security report on the transition captured image display screen.
  • FIG. 10 is a flowchart illustrating an output image selection procedure for selecting a captured image to be output as a security report on the transition captured image display screen.
  • FIG. 11 is a flowchart illustrating an output image selection cancellation procedure for canceling selection of a captured image to be output as a security report on the transition captured image display screen.
  • FIG. 12 is a diagram illustrating an example of a display screen when displaying non-display portions before and after the transition captured image on the transition captured image display screen.
  • FIG. 13 is a flowchart illustrating a display image moving display procedure for scrolling the transition captured image displayed on the transition captured image display screen.
  • FIG. 14 is a diagram illustrating an example of a display screen when a security report including the transition captured image selected on the transition captured image display screen is printed out.
  • FIG. 15 is a flowchart showing a report printing procedure for printing out a security report on the transition captured image display screen.
  • FIG. 16 is a diagram illustrating an example of a report printed out as a security report.
  • the present embodiment an embodiment that specifically discloses a security system and a person image display method according to the present disclosure (hereinafter referred to as “the present embodiment”) will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.
  • the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.
  • a plurality of monitoring cameras are provided at various locations of a complex store such as a shopping mall to shoot a monitoring target, and when an incident such as theft occurs as a predetermined event, the suspect's
  • a complex store such as a shopping mall
  • an incident such as theft occurs as a predetermined event
  • the suspect's The structural example of the system which performs the report containing a captured image is shown.
  • embodiments of the security system and the person image display method according to the present disclosure are not limited to the contents of the present embodiment described later.
  • FIG. 1 is a block diagram illustrating an example of a system configuration of a security system 10 according to the present embodiment.
  • the security system 10 includes a plurality of cameras 11-1 to 11-n, a plurality of various sensors 12-1 to 12-k, and a plurality of recorders 13-1 to 13-m.
  • the cameras 11-1 to 11-n are configured to include a lens and an image sensor, are provided at various locations corresponding to a desired monitoring area, and are attached to ceilings, walls, and the like of the respective installation locations.
  • a wide-angle lens capable of obtaining a wide viewing angle of 140 degrees or more is used as the lens, and a subject image in the field of view is formed on the imaging surface of the imaging device.
  • the image sensor is an imaging device such as a CCD (Charged-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts an optical image formed on the imaging surface into an electrical signal.
  • Arbitrary n cameras 11-1 to 11-n are provided according to the conditions of the installation location, the system configuration, and the like.
  • Each of the cameras 11-1 to 11-n images a subject at an installation place where the cameras 11-1 to 11-n are arranged, and acquires camera-captured images in each monitoring area.
  • the camera-captured video for example, a moving image of each monitoring area is captured.
  • any of various sensors such as a shoplifting prevention gate, a face matching alarm, a fire alarm, a metal detector, an object sensor, and a touch sensor is used. Sensors are provided at various locations. Arbitrary k sensors 12-1 to 12-k are provided according to the conditions of the installation location, the system configuration, and the like. The sensors 12-1 to 12-k detect a person, an object, an event, or the like to be detected, and output alarm information. For example, if a shoplifting prevention tag is attached to an unpurchased product in a store and a shoplifter goes through the shoplifting prevention gate after shoplifting without purchasing the product, the shoplifting prevention gate generates an alarm. It rings.
  • the recorders 13-1 to 13-m are configured to include a storage device such as a hard disk or a semiconductor memory, and record camera-captured images captured by the cameras 11-1 to 11-n.
  • Arbitrary m recorders 13-1 to 13-m are provided according to the conditions of the installation location, the system configuration, and the like. As the recorded video to be recorded in the recorders 13-1 to 13-m, not only the moving image of the camera-captured video but also the camera-captured image of the still image generated from the moving image can be recorded.
  • the security system 10 includes a video monitoring display device 14, various sensor management devices 15, a database 16, a face matching server 17, a form output device 18, an input device 19, and a monitor 20.
  • the output device 18 is connected to each other via the network 25 and can transmit and receive information.
  • the network 25 is a wireless network or a wired network.
  • the wireless network is, for example, a wireless LAN (Local Area Network), a wireless WAN (Wide Area Network), 3G, LTE (Long Term Evolution), or WiGig (Wireless Gigabit).
  • the wired network is, for example, an intranet or the Internet.
  • the video surveillance display device 14 is configured by using a computer (for example, a PC (Personal Computer)), and the camera and the video of the still image are captured by the cooperation of the processor and the memory according to a predetermined computer program. Various processes relating to these (hereinafter collectively referred to as “captured images”) are executed.
  • the computer of the video surveillance display device 14 includes, for example, a processor such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit) or a DSP (Digital Signal Processor), a working memory such as a RAM (Random Access Memory) or a flash memory, and the like. It is configured using a program memory and data memory such as ROM (Read Only Memory) and a communication interface for transmitting and receiving data.
  • the video surveillance display device 14 receives captured images from the cameras 11-1 to 11-n and the recorders 13-1 to 13-m, and performs processing such as displaying captured images and generating a security report.
  • the various sensor management devices 15 are configured by using a computer (for example, a PC), and execute various processes related to management of alarm information of various sensors by cooperation of a processor and a memory according to a predetermined computer program.
  • the various sensor management devices 15 manage the settings of the respective sensors 12-1 to 12-k, detection conditions in the sensors 12-1 to 12-k, and output sensor management information to the video monitoring display device 14.
  • the various sensor management devices 15 may be configured by a single computer together with the video monitoring display device 14.
  • the video monitoring display device 14 recognizes that a predetermined event has been detected in the monitoring area based on the alarm information output from the sensors 12-1 to 12-k based on the sensor management information.
  • the sensors 12-1 to 12-k include those that detect specific persons, objects, and the like using images captured by the cameras 11-1 to 11-n.
  • the various sensor management devices 15 set the occurrence of an incident such as theft as a detection condition, and the video surveillance display device 14 recognizes that the occurrence of the event has been detected by inputting corresponding alarm information.
  • the database 16 is configured using a storage device (for example, a hard disk), and stores human face information existing in the captured images captured by the cameras 11-1 to 11-n. As the face information stored in the database 16, the data of each face image and the face feature metadata indicating the characteristics of each part in the face image are stored and stored.
  • a storage device for example, a hard disk
  • the face collation server 17 is configured by using a computer, and executes collation processing of face information by cooperation of a processor and a memory according to a predetermined computer program for the server.
  • the face matching server 17 compares and matches the feature data acquisition unit that acquires face image data (including thumbnails) and face feature metadata, and the face image to be matched with the face feature metadata of the matching source.
  • a face collation unit that determines whether to perform the transmission and a communication unit that transmits and receives face information.
  • the face collation server 17 uses the face image and face feature metadata stored in the database 16 to detect a person in the captured image captured by the cameras 11-1 to 11-n or recorded in the recorders 13-1 to 13-m. The face image stored in the database 16 is collated to see if it is the same person. In this embodiment, the face collation server 17 performs face collation of the suspect related to the case, determines a face image that matches the suspect's face from a plurality of captured images, and captures the suspect. To extract.
  • the form output device 18 as an example of a printing device is configured by, for example, a printer having a printing function, and prints out a security report form including a captured image generated by the video monitoring display device 14.
  • the form output device 18 can also output the form data of the security report to another device, for example, a monitoring center of a security contracting company provided outside via a network.
  • the input device 19 is configured using, for example, a mouse, a keyboard, a touch panel, or a touch pad, and is connected to the video monitoring display device 14 and inputs instructions regarding various operations and settings to the video monitoring display device 14 according to a user's input operation. .
  • the monitor 20 is configured using, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence), and is connected to the video monitoring display device 14, and various displays related to the captured image generated by the video monitoring display device 14. Display the screen.
  • a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence)
  • LCD Liquid Crystal Display
  • organic EL Electrode
  • Display the screen Display the screen.
  • a display device having a touch panel is used as the input device 19
  • a configuration in which the display device and the input device are combined in which the input device 19 using a translucent touch sensor is disposed on the monitor 20 is assumed.
  • a smartphone, a tablet terminal, or the like may be used as a device including the input device 19 and the monitor 20 .
  • FIG. 2 is a block diagram illustrating an example of a functional configuration of the security system 10 according to the present embodiment.
  • the video monitoring display device 14 generates a security report including the captured image and the incident related information and the form output device 18 that performs processing related to display output of the captured image and the incident related information on the monitor 20.
  • a report print processing unit 142 that executes a process related to print output.
  • Camera-captured images captured by the camera 11 are sent to the image monitoring control unit 141 and the face matching server 17 of the image monitoring display device 14, and the recorder 13 (Hereinafter, representative of the recorders 13-1 to 13-m) is sent and recorded.
  • the current camera-captured video (live video) captured by the camera 11 can be sent to the monitor 20 and displayed in real time.
  • a moving image or a still image captured by the camera (captured image) recorded in the recorder 13 is sent to the video surveillance controller 141.
  • the captured image recorded in the recorder 13 can also be sent to the monitor 20 and displayed.
  • the face collation server 17 having a function as a face collation processing unit inputs camera-captured images captured by the camera 11 and extracts face feature metadata and a face image for a human face included in the captured image. To the database 16.
  • the database 16 having a function as a face information storage unit stores face information including face feature metadata and a face image sent from the face matching server 17.
  • the face collation server 17 collates whether or not the face image in the current captured image is a face image of the same person using the face image stored in the database 16 and the face feature metadata.
  • alarm information is input to the video monitoring control unit 141.
  • Alarm information includes detection signals for shoplifting prevention gates installed in the vicinity of store entrances, door unlock signals when entering and exiting designated areas using card readers, etc., and fences around store sites A detection signal of the touch sensor is used.
  • the camera 11 as the sensor 12, it is possible to emit detection information when a person is detected in a captured image in a place where a person usually does not enter.
  • the video monitoring control unit 141 sets the face image of the suspect from the captured image according to the operation input of the input device 19 by the guard who is the user. Further, the face collation server 17 collates the face image of the suspect, and the video monitoring control unit 141 captures the captured image including the face image of the same person as the suspect from the captured images recorded in the recorder 13. A captured image showing the suspect is extracted.
  • the occurrence of the incident is detected not only by the alarm information from the sensor 12 but also by the security guard confirming the occurrence of the incident from a suspicious movement by looking at the live camera image taken on the monitor 20 and operating the input device 19. It can also be done by input.
  • the video monitoring control unit 141 displays a captured image including the extracted suspect on the monitor 20. Further, the video monitoring control unit 141 inputs incident related information used as a memo of the suspect and incident related to the captured image in accordance with the operation input of the input device 19 by the user, and the memory of the video monitoring display device 14, Alternatively, it is recorded in the database 16 or the recorder 13. In addition, the video monitoring control unit 141 generates various display screens including the captured image and the case related information according to the operation input of the input device 19 by the user, and displays the generated display screen on the monitor 20.
  • the report print processing unit 142 generates a security report including the captured image selected for the report and the incident related information in accordance with the operation input of the input device 19 by the user, and outputs it to the form output device 18.
  • the form output device 18 prints out the security report generated by the report print processing unit 142.
  • FIG. 3 is a flowchart showing main operations in the security system 10 of the present embodiment.
  • the camera 11 continuously shoots the monitoring area of each installation location, and the recorder 13 records the camera shot video shot by the camera 11.
  • the video surveillance display device 14 can acquire camera-captured video from the camera 11 and the recorder 13.
  • the face matching server 17 receives and acquires the camera-captured video captured by the camera 11 (step S11). Then, the face matching server 17 detects the face of a person in the video from the camera-captured video, and records and stores the face feature metadata indicating the feature of the face and the face image in the database 16 (step S12).
  • the video surveillance display device 14 receives and acquires alarm information from the sensor 12 (step S13). When the alarm information is received, the video surveillance display device 14 may display the alarm information on the monitor 20 to notify the occurrence of the incident.
  • the video surveillance display device 14 Upon receiving the alarm information, the video surveillance display device 14 executes processing when an incident occurs. First, the video surveillance display device 14 extracts a captured image showing the suspect from the captured image recorded in the recorder 13, and inputs incident related information (step S14). Here, the video surveillance display device 14 selects a captured image captured by the suspect in accordance with an operation input of the input device 19 by a guard who is a user, and inputs incident related information corresponding to the captured image of the suspect. To do.
  • the captured image captured by the suspect for example, the captured image recorded immediately before the incident occurrence time (alarm information reception time) recorded in the recorder 13 is read and displayed on the monitor 20, and the suspect is captured. A captured image of about 30 frames is selected as a candidate image. Then, the security guard designates and selects a captured image at an angle from which the facial features of the suspect are easily understood from the candidate images by, for example, frame-feeding the candidate images. At this time, a region including the face image of the suspect in the captured image may be trimmed and enlarged.
  • the face matching server 17 also extracts the face feature metadata and face image of the suspect, and records and stores it in the database 16 for the captured image obtained by capturing the suspect.
  • face feature metadata and a face image are acquired based on a captured image of an angle at which the facial feature of the suspect selected as described above is easily understood.
  • the face collation server 17 collates the face image in the captured image with the face image of the suspect for the captured image recorded up to the present time recorded in the recorder 13, and searches for the captured image including the face image of the suspect. Step S15). Thereby, the picked-up image in which the suspect was imaged at different times and places from before the incident occurrence to after the incident occurrence is extracted.
  • the suspect when extracting the captured image by which the suspect was imaged, it is also possible to detect the suspect by reading the identification code from the captured image.
  • a specific person can be tracked by attaching an identification code to the equipment in the hall and detecting the identification code from the captured image of each monitoring area in the store.
  • face collation and identification code detection processing are executed, the face image of the suspect is associated with an identification code that exists together within a predetermined range, and the corresponding identification code is tracked and detected.
  • the captured image in which the suspect is captured can be extracted from the captured image in which the specific identification code is detected.
  • the identification code for example, an identification code using color information such as a color barcode, or a two-dimensional barcode may be appropriately used.
  • a chameleon code (registered trademark) may be used as the color barcode.
  • the video monitoring display device 14 displays, on the monitor 20, a transition captured image based on the behavior of the suspect in time series, using the extracted captured image of the suspect until the incident occurs. Further, the video surveillance display device 14 simultaneously displays the map information indicating the position where each captured image is captured, together with the transition captured image, on the monitor 20 (step S16). Transition captured images are images in which multiple captured images of the same suspect at different times and locations are arranged in chronological order along with the elapsed time based on the behavior of the suspect before and after the incident. .
  • the video surveillance display device 14 inputs a form output instruction in accordance with an operation input of the input device 19 such as a press of a form output button by a security guard or another user (step S17). Based on this form output instruction, the video surveillance display device 14 generates a security report in which transition captured images are displayed in time series, and prints out a security report form from the form output device 18 (step S18). In the security report, the incident related information is displayed together with the transition captured image.
  • the form data of the security report may be output from the form output device 18 to another device such as a monitoring center of a security contractor provided outside via a network.
  • the operation input of the input device 19 is an operation such as a pointer click using a mouse, a keyboard input operation, a touch panel or touchpad tap operation, or a specific operation by these input devices or other input devices.
  • Various operations such as a gesture operation can be applied.
  • FIG. 4 is a figure which shows an example of the transition captured image display screen which shows the map information corresponding to the transition captured image based on a suspected person's captured image, and a transition captured image.
  • the transition captured image display screen 51 shown in FIG. 4 is displayed on the monitor 20 by the processing of the video surveillance display device 14.
  • the transition captured image display screen 51 for example, a plurality of captured images in which the suspect is imaged in a line along the lower edge of the screen are arranged in time series.
  • a transition captured image 53 indicating the action history of the suspect is formed by the captured images arranged in time series.
  • a map information image 52 indicating the imaging position of each captured image is arranged above the transition captured image 53.
  • the layout of the store to be monitored is indicated by a map, and the imaging position of the captured image of each monitoring area can be displayed on the map based on the arrangement of the cameras 11.
  • a specific An imaging position mark 56 corresponding to the captured image 53a and a positional information display 57 of the captured image are displayed.
  • the imaging position mark 56 a mark indicating a position such as a circle is displayed on the map information image 52.
  • the position information display 57 displays the name (west entrance) of the imaging position (installation position of the camera 11) corresponding to the imaging position mark 56, the shooting date (YYYY / MM / DD), the shooting time (hh / mm / ss), and the like. Is displayed.
  • the display of the imaging position mark 56 and the position information display 57 is switched, and the imaging position and the imaging position information corresponding to the designated captured image are displayed. Is displayed.
  • FIG. 5 is a flowchart showing a display procedure of imaging position information on the transition captured image display screen.
  • the video surveillance display device 14 is in a state in which the transition captured image display screen 51 is displayed, in accordance with an instruction (for example, mouse over, tap, point) of the mouse pointer 55 by an operation input of the user's input device 19.
  • a designation input of a transition captured image to be displayed is received (step S21).
  • the transition captured image 53 designation of the captured image 53a that is the display target of the imaging position information is input.
  • FIG. 6 is a diagram illustrating an example of a captured image playback screen that displays an enlarged captured image on the transition captured image display screen.
  • the captured image playback screen 62 is provided with a playback button, a stop button, a fast-forward button, a rewind button, and the like, and in accordance with a user operation instruction using the input device 19, playback of a moving image of the captured image is performed in an enlarged display state. Executed.
  • the captured image enlargement display screen 61 is provided with a map information display button 63 for returning to the transition captured image display screen 51 including display of the original map information.
  • the captured image reproduction screen 62 of the captured image enlargement display screen 61 recognizes the characteristics of the suspect, such as an image in which the suspect is facing the front, while the user reproduces and visually recognizes the moving image of the captured image.
  • a captured image of a desired still image can be selected. That is, a captured image of a suitable frame can be selected from a captured image of a moving image having a plurality of frames and extracted as a captured image of a still image.
  • the map information display button 63 is operated to return to the original transition captured image display screen 51, in the transition captured image 53, the still image of the frame whose reproduction has been stopped is displayed on the captured image 53b.
  • the captured image reproduction screen 62 enables confirmation of detailed contents by enlarged display of the captured image and determination of an output image frame of the captured image when outputting as a security report.
  • FIG. 7 is a flowchart showing an enlarged display procedure of a captured image on the transition captured image display screen and the captured image playback screen.
  • the video surveillance display device 14 is in a state where the transition captured image display screen 51 is displayed, by an instruction (for example, click, double tap, double click) of the mouse pointer 55 by an operation input of the input device 19 of the user.
  • An enlarged display instruction input of any one of the transitional captured images to be enlarged and displayed is received (step S31).
  • the transition captured image 53 the designation of the captured image 53b that is a reproduction target of the captured image as an enlarged display is input.
  • FIG. 8 is a flowchart showing an incident-related information input procedure.
  • a designation input of a captured image as an information input target is received (step S41). For example, in a state in which the video surveillance display device 14 displays on the monitor 20 a captured image just before the incident occurrence point recorded in the recorder 13, a captured image in which the suspect was captured by the security officer's visual judgment is selected. The captured image for inputting the incident related information is designated by the operation input of the guard.
  • the video surveillance display device 14 inputs designation of a captured image that is an input target of incident related information.
  • the video surveillance display device 14 inputs incident related information corresponding to the captured image obtained by capturing the suspect who corresponds to the designated input (step S42).
  • the imaging information including at least one of the imaging position and the imaging time when the captured image is captured may be acquired from the camera 11 or the recorder 13 and automatically input.
  • the guard operates the keyboard of the input device 19 and inputs the type of alarm information, the characteristic information of the suspect, and the like.
  • the incident related information is recorded in the memory of the video surveillance display device 14, the database 16, or the recorder 13.
  • An example of incident related information is shown below.
  • Common Name / Name Common name ABCDE [Alarm information: Origin] From shoplifting prevention gate A [Alarm information: Occurrence time] 20:15:40 July 20, 2015 [Age] Visible around 35 years old [Gender] Visible to male [Height] About 160cm (Because it is about 10cm higher than the shoplifting prevention gate) [Remarks] Many people are wandering around the parking lot.
  • Selection of output to security report of captured image FIG. 9 is a diagram showing an example of a display screen when selecting a captured image to be output as a security report on the transition captured image display screen It is.
  • the user operates the input device 19 to specify a specific captured image 53c of the transition captured image 53 with the mouse pointer 55 (for example, right click).
  • the image selection menu is displayed.
  • a menu item selection 64 is designated by dragging the image selection menu with the mouse pointer 55, a specific captured image 53c is selected as a report creation target to be output as a security report.
  • the selected captured image for report creation is given a check box mark.
  • the image selection menu is dragged with the mouse pointer 55 and the menu is displayed.
  • the item non-selection 65 is designated, the selection of the captured image 53c is canceled and excluded from the report creation target.
  • the mark of the check box is deleted from the captured image from which the selection of the report creation target has been cancelled.
  • FIG. 10 is a flowchart showing an output image selection procedure for selecting a captured image to be output as a security report on the transition captured image display screen.
  • the video surveillance display device 14 displays the transition captured image display screen 51, and instructs the mouse pointer 55 by the operation input of the user's input device 19 (for example, right click-select, long tap-select), etc.
  • the designation input of the transition captured image to be selected as the report creation target is received (step S51).
  • the transition captured image 53 the designation of the captured image 53c to be selected as a report creation target is input.
  • the video surveillance display device 14 sets the captured image 53c corresponding to the designated input as a report creation target, and adds a check box mark (step S52).
  • FIG. 11 is a flowchart showing an output image selection cancellation procedure for canceling selection of a captured image to be output as a security report on the transition captured image display screen.
  • the video surveillance display device 14 is in a state where the transition captured image display screen 51 is displayed, and an instruction of the mouse pointer 55 by an operation input of the user's input device 19 (for example, right click-non-selection, long tap-non-selection). ) Or the like to receive a designation input of a transition captured image to be a non-selection target for report creation (step S61).
  • the transition captured image 53 the designation of the captured image 53c that is to be a non-selected target for report creation (deselection) is input.
  • FIG. 12 is a diagram illustrating an example of a display screen when displaying a non-display portion before and after the transition captured image on the transition captured image display screen.
  • the movement operation is performed.
  • the image group of the transition captured image 53 moves.
  • the captured images that are displayed before the moving operation are displayed so that captured images that are not displayed before or after the shooting time appear in order. For example, when the transition captured image 53 is moved to the left, the image group of the transition captured image 53 is moved to the left, and the captured images after the shooting time are sequentially displayed.
  • FIG. 13 is a flowchart showing a display image moving display procedure for scrolling the transition captured image displayed on the transition captured image display screen.
  • the video surveillance display device 14 is in a state in which the transition captured image display screen 51 is displayed, and the operation of the mouse pointer 55 (for example, drag-and-drop, flick, swipe) by the user's input operation of the input device 19 is performed.
  • a moving operation input of the displayed transition captured image group is received (step S71).
  • a movement instruction indicating a movement direction and a movement amount for scroll display is input.
  • FIG. 14 is a figure which shows an example of the display screen at the time of printing out the security report containing the transition captured image selected on the transition captured image display screen.
  • the report is selected as a report creation target.
  • a security report displaying the captured image and the incident related information corresponding to the captured image is created and printed out from the form output device 18.
  • the captured images 53d, 53e, 53f, and 53g are selected from the transition captured images 53, and a security report that displays these captured images 53d, 53e, 53f, and 53g side by side is created.
  • the respective captured images 53d, 53e, 53f, and 53g are obtained by outputting and displaying still images of output image frames selected from moving images of the captured images of a plurality of frames in the security report.
  • FIG. 15 is a flowchart showing a report printing procedure for printing a security report on the transition captured image display screen.
  • the video surveillance display device 14 prints a form in accordance with an instruction (for example, a print button click or tap) of the mouse pointer 55 by an operation input of the user's input device 19 while the transition captured image display screen 51 is displayed.
  • An output instruction input is accepted (step S81). In this case, a pressing operation of the report print button 54 is input in a state where a predetermined captured image is selected as a report creation target.
  • the video surveillance display device 14 arranges the captured images selected as the report creation target among the transition captured images in time series, and associates the information of the imaging position and the imaging time as incident related information with respect to each captured image.
  • a form of the attached security report is generated and output to the form output device 18 for printing (step S82).
  • FIG. 16 is a diagram showing an example of a report printed out as a security report.
  • the face detection original image 72 enlarged and displayed so that the characteristics of the suspect are clearly shown is arranged in the upper part, and the transition imaged images 73 to be generated in the report are arranged in time series in the lower part.
  • the face detection source image 72 is a detection source suspect image in which the face image of the suspect is detected from the captured image and the face image and face feature metadata are recorded in the database 16, and the face feature of the suspect is understood.
  • a captured image at an easy angle is used, and becomes a face image of a collation source used at the time of face collation.
  • imaging information 74 including the name of the imaging position, the shooting date, and the shooting time is displayed as incident related information.
  • time is taken by the camera at each imaging position in the monitoring area in the order of West entrance ⁇ Cosmetic department ⁇ Jewelry shop ⁇ General store ⁇ Men's clothing department ⁇ Bookstore (bookstore).
  • a transition picked-up image 73 picked up in series is shown.
  • the report 71 of this security report makes it possible to grasp the characteristics of the suspect and the action history up to the incident at a glance in chronological order.
  • the video surveillance display device 14 when the occurrence of an incident such as theft is detected in the monitoring area, the video surveillance display device 14 captures the suspect in the incident from the captured image of the monitoring area recorded in the recorder 13. A plurality of captured images are extracted, and using the extracted captured images, transition captured images based on the behavior of the suspect are displayed in time series together with the imaging time.
  • the video surveillance display device 14 displays a transition captured image display screen 51 on the display screen of the monitor 20, and displays the transition captured images 53 in time series on the transition captured image display screen 51.
  • the video surveillance display device 14 displays a map information image 52 indicating an imaging position of each captured image along with the transition captured image 53 on the transition captured image display screen 51.
  • a map information image 52 indicating an imaging position of each captured image along with the transition captured image 53 on the transition captured image display screen 51.
  • an imaging position mark 56 corresponding to the captured image 53a designated by the user and a positional information display 57 of the captured image are displayed so that the position where each captured image is captured can be grasped at a glance.
  • the video surveillance display device 14 generates a security report form and outputs it to the form output device 18 to print out a report 71 as a security report.
  • the transition captured images 73 to be generated by the report are arranged and displayed in time series, and the imaging information 74 such as the imaging position and the imaging time associated with each transition captured image 73 is displayed as incident related information. To do.
  • the present embodiment by displaying and outputting a transition captured image composed of a plurality of time-series captured images in which the same suspect is imaged, tracking information regarding the behavior of the monitoring target such as the suspect in the monitoring area is obtained. It can be easily obtained visually. For this reason, the user of a security system can grasp
  • the security system 10 detects a predetermined event in a monitoring area based on a predetermined detection condition, a camera 11 that captures a predetermined monitoring area, a recorder 13 that records a captured image captured by the camera 11, and the like. And a video surveillance display device 14 that inputs a captured image from the camera 11 or the recorder 13 and displays the captured image.
  • the video surveillance display device 14 extracts a plurality of captured images in which the suspect of the event is captured from the captured image recorded in the recorder 13, and extracts the extracted captured images.
  • the map information indicating the imaging position of the captured image is displayed, and the designation input of the captured image of the position display target is received for the transition captured image
  • the position information of the imaging point of the corresponding captured image is displayed on the map information.
  • the user of the security system can easily obtain the tracking information regarding the behavior of the suspect in the monitoring area by viewing the transition image.
  • the display position of each captured image can be intuitively grasped by displaying the map information.
  • by designating a specific captured image it is possible to easily confirm the imaging point of the corresponding captured image.
  • the security system 10 scrolls the transition captured image in accordance with the movement instruction, and captures the imaging before or after the imaging time. Display an image. Thereby, regarding the time-series transition captured images that are currently displayed, captured images before or after the capturing time can be sequentially displayed.
  • the security system 10 reproduces the captured image reproduction screen in which the corresponding captured image is reproduced in an enlarged display state. Is displayed. Thereby, the detailed image regarding the action of the suspect can be confirmed by enlarging and reproducing the moving image of the captured image.
  • the person image display method is a person image display method in the security system 10 including the camera 11, the recorder 13, the sensor 12, and the video surveillance display device 14, and displays a captured image by the video surveillance display device 14.
  • a predetermined event is detected in the monitoring area
  • a plurality of captured images in which the suspect of the event is captured are extracted from captured images captured by the camera 11 and recorded in the recorder 13, and the extracted captured images are used.
  • the transition captured image based on the suspect's action is displayed in time series, the map information indicating the captured position of the captured image is displayed, and the transition captured image receives the designation input of the captured image of the position display target.
  • the position information of the imaging point of the corresponding captured image is displayed on the map information.
  • the present disclosure is useful as a security system and a person image display method capable of visually easily obtaining tracking information regarding the behavior of a monitoring target such as a person in a monitoring area.

Abstract

Le problème décrit par l'invention est d'obtenir visuellement, avec facilité, des informations de suivi relatives à l'action d'un sujet de surveillance tel qu'une personne dans une zone de surveillance. La solution de l'invention porte sur un système de sécurité qui est pourvu d'une caméra (11) pour prendre l'image d'une zone de surveillance prédéterminée, d'un enregistreur (13) pour enregistrer une image prise par la caméra (11), d'un capteur (12) pour détecter un évènement prédéterminé dans la zone de surveillance sur la base d'un critère de détection prédéterminé, et d'un dispositif d'affichage de vidéosurveillance (14) pour recevoir une entrée de l'image prise provenant de la caméra (11) et de l'enregistreur (13) et afficher l'image prise. Lorsque l'évènement prédéterminé est détecté dans la zone de surveillance, le dispositif d'affichage de vidéosurveillance (14) : extrait, des images prises enregistrées dans l'enregistreur (13), des images prises qui comprennent une image d'un suspect ; affiche, en série chronologique, des images prises de transition basées sur l'action du suspect ; et affiche des informations cartographiques indiquant les positions auxquelles les images prises ont été prises. Lors de la réception d'une entrée désignant l'image prise pour laquelle la position doit être affichée en ce qui concerne les images prises de transition, le dispositif d'affichage de vidéosurveillance (14) affiche, sur les informations cartographiques, des informations de position représentant la position à laquelle l'image enregistrée correspondante a été prise.
PCT/JP2016/003555 2015-08-17 2016-08-02 Système de sécurité, procédé d'affichage d'image de personne, et procédé de création de rapport WO2017029779A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2015-160665 2015-08-17
JP2015160666A JP6268497B2 (ja) 2015-08-17 2015-08-17 警備システム、及び人物画像表示方法
JP2015160665A JP6268496B2 (ja) 2015-08-17 2015-08-17 警備システム及び画像表示方法
JP2015-160666 2015-08-17

Publications (1)

Publication Number Publication Date
WO2017029779A1 true WO2017029779A1 (fr) 2017-02-23

Family

ID=58051489

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/003555 WO2017029779A1 (fr) 2015-08-17 2016-08-02 Système de sécurité, procédé d'affichage d'image de personne, et procédé de création de rapport

Country Status (1)

Country Link
WO (1) WO2017029779A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115935003A (zh) * 2022-11-22 2023-04-07 国网山东省电力公司 一种基于大数据的信息收集方法与系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09224237A (ja) * 1996-02-16 1997-08-26 Hitachi Ltd 画像監視システム
JP2012208793A (ja) * 2011-03-30 2012-10-25 Sogo Keibi Hosho Co Ltd 警備装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09224237A (ja) * 1996-02-16 1997-08-26 Hitachi Ltd 画像監視システム
JP2012208793A (ja) * 2011-03-30 2012-10-25 Sogo Keibi Hosho Co Ltd 警備装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115935003A (zh) * 2022-11-22 2023-04-07 国网山东省电力公司 一种基于大数据的信息收集方法与系统
CN115935003B (zh) * 2022-11-22 2023-09-19 国网山东省电力公司 一种基于大数据的信息收集方法与系统

Similar Documents

Publication Publication Date Title
JP6268498B2 (ja) 警備システム及び人物画像表示方法
US11150778B2 (en) System and method for visualization of history of events using BIM model
EP2934004B1 (fr) Système et procédé de mises à jour de paramètres de caméra basées sur zone virtuelle dans des systèmes de surveillance vidéo
EP2954499B1 (fr) Appareil de traitement d'informations, procédé de traitement d'informations, programme, et système de traitement d'informations
EP2876570B1 (fr) Système et procédé de visualisation de corrélation dynamique pour analyse d'incidents en nuage et détection de motif
CA2814366C (fr) Systeme et procede d'analyse apres evenement/alarme dans les systemes de television en circuit ferme et de securite integree
CN104243907B (zh) 用于动态跟踪的视频加标签
US20130208123A1 (en) Method and System for Collecting Evidence in a Security System
JP6268497B2 (ja) 警備システム、及び人物画像表示方法
US9398283B2 (en) System and method of alarm and history video playback
WO2016194275A1 (fr) Système d'analyse de ligne de flux, dispositif de caméra et procédé d'analyse de ligne de flux
WO2017029779A1 (fr) Système de sécurité, procédé d'affichage d'image de personne, et procédé de création de rapport
JP6268496B2 (ja) 警備システム及び画像表示方法
JP4594609B2 (ja) 監視システム、および監視方法
JP5909709B1 (ja) 動線分析システム、カメラ装置及び動線分析方法
JP5909712B1 (ja) 動線分析システム、カメラ装置及び動線分析方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16836777

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16836777

Country of ref document: EP

Kind code of ref document: A1