WO2016151932A1 - Système de surveillance, procédé de surveillance et programme de surveillance - Google Patents

Système de surveillance, procédé de surveillance et programme de surveillance Download PDF

Info

Publication number
WO2016151932A1
WO2016151932A1 PCT/JP2015/081289 JP2015081289W WO2016151932A1 WO 2016151932 A1 WO2016151932 A1 WO 2016151932A1 JP 2015081289 W JP2015081289 W JP 2015081289W WO 2016151932 A1 WO2016151932 A1 WO 2016151932A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
monitoring system
monitoring
video
shield
Prior art date
Application number
PCT/JP2015/081289
Other languages
English (en)
Japanese (ja)
Inventor
晃 亀井
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2016151932A1 publication Critical patent/WO2016151932A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a monitoring system, a monitoring method, and a monitoring program.
  • Patent Document 1 describes that a person is not in the monitoring area until it is confirmed that the person has passed the shielding object. A technique for determining that it exists is disclosed.
  • An object of the present invention is to provide a technique for solving the above-described problems.
  • a monitoring system provides: Video acquisition means for acquiring video captured using at least one camera; Detecting means for detecting a person performing the first action around the shield in the video as a caution person; An informing means for informing the presence of the attention person; Equipped with.
  • a monitoring method comprises: An image acquisition step of acquiring an image captured using at least one camera; A detection step of detecting a person performing the first action around the shield in the video as a caution person; A notification step of notifying the presence of the attention person; including.
  • a monitoring program provides: An image acquisition step of acquiring an image captured using at least one camera; A detection step of detecting a person performing the first action around the shield in the video as a caution person; A notification step of notifying the presence of the attention person; Is executed on the computer.
  • the present invention it is possible to determine the necessity of monitoring based on the behavior of the person with respect to the shield.
  • the monitoring system 100 is a system that determines the necessity of monitoring based on the behavior of a person with respect to a shield.
  • the monitoring system 100 includes a video acquisition unit 101, a detection unit 102, and a notification unit 103.
  • the video acquisition unit 101 acquires video captured using at least one camera 120.
  • the detection unit 102 detects a person who performs the first action around the shielding object in the video acquired by the video acquisition unit 101 as a caution person.
  • the notification unit 103 notifies the monitoring person 130 of the presence of the attention person.
  • the present embodiment it is possible to determine the necessity of monitoring based on the behavior of the person with respect to the shield.
  • FIG. 2 is a diagram for explaining the outline of the operation of the monitoring system 200 according to the present embodiment.
  • the monitoring system 200 is a system that detects and notifies a person who moves around a shield.
  • a shielding object that covers a part or all of the image appears in an image captured by a camera
  • the space behind the shielding object becomes a blind spot as viewed from the camera.
  • the truck 220 runs from the left side of the screen shot by a certain camera, and then the truck 220 stops and the driver 210 gets off the driver's seat.
  • the space on the back side of the track 220 becomes a blind spot, and the blind spot caused by this shielding object cannot be taken by the camera that is shooting this video. That is, the track 220 is a shielding object that blocks the field of view for the camera and the observer.
  • the monitoring system 200 selects a person to be excluded from the monitoring target and the tracking target based on the movement of the person around the track 220, that is, the obstacle.
  • the driver 210 that has descended from the truck 220 is a person related to the truck 220 as a shield, and thus is excluded from the alert target.
  • the surroundings of the shielding object may be, for example, the entire range of the angle of view of the camera, a range of the peripheral radius of the track 220, or the like, but is not limited thereto.
  • FIG. 3 is a block diagram showing the configuration of the monitoring system 200.
  • the monitoring system 200 includes a video acquisition unit 301, a determination unit 302, a detection unit 303, an exclusion unit 304, and a notification unit 305.
  • the video acquisition unit 301 acquires video captured by the camera 320.
  • the determination unit 302 determines the presence of a shield and a blind spot caused by the shield in the video acquired by the video acquisition unit 301.
  • the detection unit 303 detects a person who performs a predetermined action around the shielding object whose presence is determined by the determination unit 302.
  • the excluding unit 304 excludes a person who performs a predetermined action around the shield from the alert target.
  • the notification unit 305 notifies a person who has not been excluded from the alert target by the exclusion unit 304 to the supervisor 330 or the like.
  • FIG. 4A is a diagram illustrating a configuration of the exclusion table 401 included in the monitoring system 200.
  • the exclusion table 401 stores the presence / absence of exclusion in association with a person's action. Based on the exclusion table 401, the monitoring system 200 determines whether to exclude a person from the alert target.
  • the configuration of the exclusion table 401 described here is merely an example, and the configuration of the exclusion table 401 is not limited to this. Further, the method by which the monitoring system 200 determines the presence / absence of exclusion is not limited to the method of referring to the exclusion table 402.
  • FIG. 4B is a diagram illustrating a configuration of the shielding object table 402 included in the monitoring system 200.
  • the shielding object table 402 stores the presence / absence of a blind spot in association with the shielding object. Based on the shielding table 402, the monitoring system 200 determines the presence of the shielding object in the acquired video and the blind spot caused by the shielding object.
  • the configuration of the shielding table 402 described here is merely an example, and the configuration of the shielding table 402 is not limited to this.
  • FIG. 4C is a diagram illustrating a configuration of a notification table 403 included in the monitoring system 200.
  • the notification table 403 stores an alert level and a notification destination in association with the movement of a person.
  • the monitoring system 200 changes the alert level and the notification destination based on the movement of the person near the shield.
  • reporting table 403 demonstrated here is only an example, and the structure of the alerting
  • FIG. 5 is a diagram illustrating a hardware configuration of the monitoring system 200.
  • the monitoring system 200 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a storage 504, and a communication control unit 505.
  • a CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the CPU 501 is a processor for arithmetic processing, and implements each functional component of the monitoring system 200 by executing a program. Note that the number of CPUs 501 is not limited to one, and a plurality of CPUs 501 may be included, and a GPU (GraphicsGraphProcessing Unit) for image processing may be included.
  • the ROM 502 is a read only memory and stores programs such as firmware.
  • the communication control unit 505 communicates with other devices via a network. Further, the communication control unit 505 may include a CPU independent of the CPU 501 and write or read transmission / reception data to / from the RAM 503.
  • the RAM 503 is a random access memory that the CPU 501 uses as a work area for temporary storage.
  • the RAM 503 has an area for storing data necessary for realizing the present embodiment. As such data, the monitoring system 200 temporarily stores the person 531, the person's movement 532, the notification content 533, and the shielding object information 534.
  • the RAM 503 has an application execution area 535 for executing various application modules.
  • the storage 504 is a storage device that stores programs and databases necessary for realizing the present embodiment.
  • the storage 504 stores an exclusion table 401, an obstruction table 402, a notification table 403, a monitoring program 541, and a control program 545.
  • the monitoring program 541 stores a detection module 542, an exclusion module 543, and a notification module 544. These modules 542 to 544 are read by the CPU 501 into the application execution area 535 and executed.
  • the control program 545 is a program for controlling the entire monitoring system 200. Also, it is desirable to provide a DMAC (Direct Memory Access Controller) that transfers data between the RAM 503 and the storage 504 (not shown).
  • DMAC Direct Memory Access Controller
  • RAM 503 and the storage 504 shown in FIG. 5 do not show programs and data relating to general-purpose functions and other realizable functions that the monitoring system 200 has.
  • the hardware configuration of the monitoring system 200 described here is merely an example, and the present invention is not limited to this hardware configuration, and various hardware configurations can be used.
  • FIG. 6A is a flowchart for explaining the processing procedure of the monitoring system 200.
  • the monitoring system 200 acquires an image captured by the camera 320.
  • the monitoring system 200 determines the presence of the shielding object in the acquired video and the blind spot caused by the shielding object.
  • the monitoring system 200 detects a person who makes a predetermined movement around the shield.
  • the monitoring system 200 determines whether the movement of the person detected in step S605 is a predetermined action. If the action of the person is a predetermined action, the monitoring system 200 excludes the person from the alert target in step S609. The monitoring system 200 does not exclude the person from the alert target unless the person's action is a predetermined action.
  • the monitoring system 200 notifies the monitoring person or the like of the presence of the person to be alerted.
  • FIG. 6B is a flowchart for explaining the processing procedure of the presence / absence of the shielding system 200 and its blind spot.
  • the monitoring system 200 extracts an obstacle from the map information, sets the extracted obstacle as a shielding object, and further determines a blind spot due to the shielding object.
  • the monitoring system 200 detects an object that occupies a predetermined area of the imaging range of the camera 320, sets the detected object as a shielding object, and further determines a blind spot due to the shielding object. Note that the method of determining the presence of the shielding object and its blind spot is not limited to these, and various methods can be used.
  • the present embodiment it is possible to determine the necessity of monitoring based on the behavior of the person with respect to the shield. In addition, it is possible to exclude a person who performs a predetermined movement based on the behavior of the person around the shield from the alert target.
  • FIG. 7 is a diagram for explaining the outline of the operation of the monitoring system 700 according to the present embodiment.
  • the monitoring system 700 according to the present embodiment is different from the second embodiment in that it includes an action authorization unit. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.
  • the monitoring system 700 determines whether or not to exclude the person 710 from the alert target based on the behavior of the person 710 existing around the track 720 that is a shield.
  • the monitoring system 700 recognizes that the person 710 is an operator who loads and unloads a load on the truck 720 because the action of the person 710 is loading and unloading. Then, the monitoring system 700 excludes the person 710 who loads and unloads the luggage from the alert target.
  • the monitoring system 700 excludes a person repairing a tire puncture or failure of a vehicle such as a truck from the monitoring target because it is an operator for the vehicle. Furthermore, since the person who performs the car wash is also an operator for the vehicle, it is excluded from the monitoring target.
  • FIG. 8 is a block diagram showing the configuration of the monitoring system 700.
  • the monitoring system 700 further includes an action certification unit 801.
  • the behavior authorization unit 801 authorizes a person's behavior with respect to the shield. Then, based on the action of the certified person, it is certified whether or not the person is an operator for a shield such as a truck. If it is determined that the person is an operator for the shield, the exclusion unit 304 excludes the person from the alert target.
  • FIG. 9 is a flowchart for explaining the processing procedure of the monitoring system 700. Steps similar to those in FIG. 6 are given the same step numbers and description thereof is omitted.
  • step S ⁇ b> 901 the monitoring system 700 detects a person 710 who acts around the shield and recognizes the action of the person 710.
  • step S903 the monitoring system 700 determines whether or not the person 710 is a worker who works on the shielding object based on the certified action.
  • the present embodiment it is possible to determine the necessity of monitoring based on the behavior of the person with respect to the shield. In addition, it is possible to exclude a person who performs a predetermined movement based on the behavior of the person around the shield from the alert target.
  • FIG. 10 is a diagram for explaining the outline of the operation of the monitoring system 1000 according to the present embodiment.
  • the monitoring system 1000 according to the present embodiment is different from the second embodiment in that it includes an approach detection unit. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.
  • the monitoring system 1000 when the monitoring system 1000 detects that the person 1010 has approached the luggage 1020 that is a shield, for example, the monitoring system 1000 sets the approaching person 1010 as an alert target candidate.
  • the monitoring system 1000 excludes the person 1010 from the alert target.
  • the shielding object is, for example, a baggage 1020 such as cardboard, but is not limited thereto, and may be a vehicle such as a truck or a car or a ground object such as a utility pole.
  • FIG. 11 is a block diagram showing the configuration of the monitoring system 1000.
  • the monitoring system 1000 further includes an approach detection unit 1101.
  • the approach detection unit 1101 detects the approach of the person 1010 to the shielding object, and sets, for example, the approaching person 1010 as an alert target candidate. Thereafter, when the person 1010 passes through the blind spot caused by the shield, the exclusion unit 304 excludes the person 1010 from the alert target.
  • FIG. 12 is a flowchart for explaining the processing procedure of the monitoring system 1000. Steps similar to those in FIG. 6 are given the same step numbers and description thereof is omitted.
  • the monitoring system 1000 detects the person 1010 approaching the shield, and sets the person 1010 approaching, for example, as an alert target candidate.
  • the monitoring system 1000 determines whether the approaching person 1010 has passed the blind spot caused by the shield. When the person 1010 passes through the blind spot, the monitoring system 1000 excludes the person 1010 from the alert target.
  • the present embodiment it is possible to determine the necessity of monitoring based on the behavior of the person with respect to the shield. In addition, it is possible to exclude a person who performs a predetermined movement based on the behavior of the person around the shield from the alert target.
  • the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Alarm Systems (AREA)

Abstract

La présente invention vise à déterminer la nécessité d'une surveillance sur la base du comportement d'une personne par rapport à un écran. Pour ce faire, le système de surveillance est équipé d'un moyen d'acquisition vidéo, d'un moyen de détection et d'un moyen de notification. Le moyen d'acquisition vidéo du système de surveillance acquiert une vidéo capturée à l'aide d'au moins une caméra. Le moyen de détection du système de surveillance détecte une personne réalisant une première action autour d'un écran dans la vidéo, telle qu'une personne d'intérêt. Le moyen de notification du système de surveillance émet une notification concernant la présence de la personne d'intérêt.
PCT/JP2015/081289 2015-03-20 2015-11-06 Système de surveillance, procédé de surveillance et programme de surveillance WO2016151932A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015058278 2015-03-20
JP2015-058278 2015-03-20

Publications (1)

Publication Number Publication Date
WO2016151932A1 true WO2016151932A1 (fr) 2016-09-29

Family

ID=56978807

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/081289 WO2016151932A1 (fr) 2015-03-20 2015-11-06 Système de surveillance, procédé de surveillance et programme de surveillance

Country Status (1)

Country Link
WO (1) WO2016151932A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020088687A (ja) * 2018-11-28 2020-06-04 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JPWO2022030286A1 (fr) * 2020-08-05 2022-02-10

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003324720A (ja) * 2002-05-07 2003-11-14 Matsushita Electric Ind Co Ltd 監視システムと監視カメラ
JP2008225954A (ja) * 2007-03-14 2008-09-25 Hitachi Information & Control Solutions Ltd 監視システム
JP2011215829A (ja) * 2010-03-31 2011-10-27 Hitachi Ltd 監視装置および不審行動検出方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003324720A (ja) * 2002-05-07 2003-11-14 Matsushita Electric Ind Co Ltd 監視システムと監視カメラ
JP2008225954A (ja) * 2007-03-14 2008-09-25 Hitachi Information & Control Solutions Ltd 監視システム
JP2011215829A (ja) * 2010-03-31 2011-10-27 Hitachi Ltd 監視装置および不審行動検出方法

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020088687A (ja) * 2018-11-28 2020-06-04 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP7214449B2 (ja) 2018-11-28 2023-01-30 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JPWO2022030286A1 (fr) * 2020-08-05 2022-02-10
WO2022030286A1 (fr) * 2020-08-05 2022-02-10 日立建機株式会社 Système de commande pour engin de chantier
CN116057240A (zh) * 2020-08-05 2023-05-02 日立建机株式会社 作业机械的控制系统
US20230295898A1 (en) * 2020-08-05 2023-09-21 Hitachi Construction Machinery Co., Ltd. Work Machine Control System
JP7438370B2 (ja) 2020-08-05 2024-02-26 日立建機株式会社 作業機械の制御システム
EP4194622A4 (fr) * 2020-08-05 2024-09-25 Hitachi Construction Mach Co Système de commande pour engin de chantier

Similar Documents

Publication Publication Date Title
US11356599B2 (en) Human-automation collaborative tracker of fused object
JP6267972B2 (ja) 作業機械の周囲監視装置
US11877094B2 (en) Monitoring system, monitoring method, and monitoring program
US20150106005A1 (en) Methods and systems for avoiding a collision between an aircraft on a ground surface and an obstacle
US10384345B2 (en) Safety management method and safety management system
JP7290199B2 (ja) 遠隔監視制御装置、システム、方法、及びプログラム
WO2016152317A1 (fr) Dispositif de traitement vidéo, procédé de traitement vidéo, et programme de traitement vidéo
US11636715B2 (en) Using dynamic triggers in dangerous situations to view sensor data for autonomous vehicle passengers
WO2016151932A1 (fr) Système de surveillance, procédé de surveillance et programme de surveillance
US20130265787A1 (en) Advance lighting system for use with emergency vehicles
US20130338858A1 (en) Method for three dimensional perception processing and classification
KR101876624B1 (ko) 디스플레이 장치의 표시부 정상상태를 무인 검사하는 방법 및 시스템
WO2016152316A1 (fr) Système de surveillance, procédé de surveillance, dispositif de surveillance et programme de commande de dispositif de surveillance
JP2015005152A (ja) クレーンの吊り荷と作業員の接近警告システム
CN110737276B (zh) 预警方法、巡逻机器人及计算机可读存储介质
KR101566963B1 (ko) 작업 차량 상태를 고려하여 개체를 인식할 수 있는 어라운드 뷰 모니터링 방법, 이를 수행하는 어라운드 뷰 모니터링 장치 및 이를 저장하는 기록매체
KR20230122959A (ko) 안전사고 예방을 위한 위험 상황 모니터링 장치 및 방법
US20230365151A1 (en) Object detection system and object detection method
Taherizadeh et al. Real-time data-intensive telematics functionalities at the extreme edge of the network: experience with the PrEstoCloud project
WO2016152318A1 (fr) Système de surveillance, procédé de surveillance et programme de surveillance
CN112470465A (zh) 俯瞰图像生成装置、俯瞰图像生成方法以及程序
JP2007079938A (ja) 航空交通制御システムに用いられる情報処理装置
JP2018170712A (ja) 監視システム、監視制御装置、監視方法およびプログラム
WO2024121963A1 (fr) Dispositif de traitement d'informations, système de traitement d'informations, procédé de traitement d'informations et support non transitoire lisible par ordinateur
JP2022016902A (ja) 人検知装置、産業車両、及び人検知方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15886484

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15886484

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP