WO2005036881A2 - Systeme augmente de surveillance video - Google Patents

Systeme augmente de surveillance video Download PDF

Info

Publication number
WO2005036881A2
WO2005036881A2 PCT/IB2004/003304 IB2004003304W WO2005036881A2 WO 2005036881 A2 WO2005036881 A2 WO 2005036881A2 IB 2004003304 W IB2004003304 W IB 2004003304W WO 2005036881 A2 WO2005036881 A2 WO 2005036881A2
Authority
WO
WIPO (PCT)
Prior art keywords
operator
surveillance system
augmented
video surveillance
augmented video
Prior art date
Application number
PCT/IB2004/003304
Other languages
English (en)
Other versions
WO2005036881A3 (fr
Inventor
Gregory Cox
Colin Andrew
Original Assignee
De Beers Consolidated Mines Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by De Beers Consolidated Mines Limited filed Critical De Beers Consolidated Mines Limited
Priority to EP04791680A priority Critical patent/EP1673938A2/fr
Priority to AU2004306552A priority patent/AU2004306552A1/en
Priority to CA002541880A priority patent/CA2541880A1/fr
Priority to AP2006003573A priority patent/AP2006003573A0/xx
Publication of WO2005036881A2 publication Critical patent/WO2005036881A2/fr
Priority to IL174857A priority patent/IL174857A0/en
Publication of WO2005036881A3 publication Critical patent/WO2005036881A3/fr

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19613—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • THIS invention relates to an augmented video surveillance system.
  • Video surveillance or CCTV (closed circuit television) surveillance systems usually make use of a number of video cameras and communication links to transfer camera-captured analogue images to remote video monitors where they can be observed by human operators or to video image recordal equipment which records them for subsequent viewing by human operators.
  • Such systems are entirely reliant upon the operator's ability to discern, from the images viewed, whether a particular event has taken place and whether any particular action is required.
  • the present invention seeks to address these problems.
  • an augmented video surveillance system in which a surveillance video is augmented by insertion, into live video images seen by an operator, of synthetic or realistic objects and/or by visual enhancement of predetermined events taking place in the live video image seen by the operator, such insertion requiring specific action by the operator, and monitoring the action taken by the operator in response to such insertion.
  • the objective of the invention is to improve the performance and effectiveness of the operator and to measure his performance online. In accordance with the invention this object is addressed by engaging the operator's attention by interaction with the live video with the result that the operator's levels of vigilance and interest are elevated.
  • the system proposed by the invention may be used to provide on-line operator training.
  • the invention also provides apparatus for use in the system summarized above.
  • the numeral 10 indicates an event controller which controls and implements video augmentation according to the invention.
  • the event controller 10 can be programmed to augment a live video seen by an operator in a number of different ways which may be implemented alone or in combination with one another.
  • live video events are brought to the attention of the operator. These are actual live events taking place in the scene observed by the operator. Examples of typical events include entry of a person into the observed scene, addition or removal of inanimate objects to the scene. This is indicated by the numeral 11 in the diagram.
  • Enhanced Video Based Surveillance System a background image or model is generated and, during the course of live video monitoring, the overall image is segmented into respective background and foreground segments and video enhancement techniques are employed visually to enhance all or selected foreground features or events, thereby drawing the operator's attention to such features and events.
  • the system described above may be interfaced with a video motion detection system also described in the aforementioned co-pending patent application, in which case the operator's attention is drawn, by camera switching and/or image enhancement to specified motion events in the observed image. This is indicated by the numeral 13 in the diagram.
  • the operator is trained to respond to specified foreground features or events, in each case in a predetermined manner.
  • the system may be used to measure the operator's efficiency in responding in the appropriate manner to specified events.
  • the invention proposes the insertion of certain synthetic or realistic objects or events into the image viewed by the operator.
  • the event controller 10 acts in response to a rules-based event generation module 12 to initiate the generation, by a synthetic object generator 14, of a synthetic event or object and augments the raw, live video image 16 by inserting such event or object into the image, thereby forming an augmented video image 18 which is viewed by the operator.
  • the controller 10 controls all parameters relating to the insertion, e.g. the frequency of insertion, the duration of the insertion and so on.
  • Synthetic objects are objects which are inserted into the viewed image and are classified as synthetic because they do not blend into the imaged scene and can be clearly identified by the operator as artificially inserted objects. Typical examples are fanciful shapes such as stars, squares, circles, still pictures of persons or objects, or animated sequences of person and/or objects.
  • the insertion may require specific action by the operator, as indicated by the numeral 20.
  • the operator may, for example, be required to operate a mouse pointer and to click on the insertion in order to remove it.
  • the operator's reaction time and ability to carry out the required action can be monitored to provide an indication of the operator's efficiency and training and can, if necessary, be logged as part of the operator's performance record.
  • Associated with the insertion of synthetic objects can be certain specific tasks that need to be performed by the operator, such tasks requiring higher levels of cognitive engagement than a simple response of acknowledging the presence of the synthetic object by clicking on it.
  • this could be a discrimination task whereby the operator is required to distinguish between different categories of inserted synthetic objects.
  • still pictures or images of persons may show such persons displaying normal, unsuspicious behaviour and may require a first type of response by the operator.
  • pictures of persons displaying suspicious behaviour may require a totally different type of response by the operator.
  • the operator's reaction to the inserted object(s) can be used to provide a measure of ability and efficiency, with the accuracy of completion of the associated task providing an additional level of information on operator performance.
  • the object insertion technique described in the preceding paragraph also serves a valuable function in on-line training of the operator in that it can raise the operator's awareness of certain types of personal behaviour which may be considered undesirable from a security point of view, for example a person assuming a certain bodily posture in the vicinity of a high-risk area such as a cash-counting or gem sorting station.
  • a security point of view for example a person assuming a certain bodily posture in the vicinity of a high-risk area such as a cash-counting or gem sorting station.
  • the invention also envisages the augmentation of the live video by insertion of realistic objects or events, under the control of the event controller 10 and in accordance with the rules-based event generation module 12.
  • realistic video objects such as animated sequences extracted from previously recorded images of the scene under surveillance, as indicated by the block 22 in the diagram, are inserted back into the live video image 16 to produce the augmented image 18 in such a manner that the operator is unable to distinguish between artificially inserted objects and real objects of the scene. So, for instance, live video footage of a person moving in the surveilled scene can be inserted to produce the augmented image.
  • augmentation involves insertion of video footage showing an act of theft
  • the technique can be used to monitor the operator's ability to recognize the act and to react accordingly.
  • performance on inserted synthetic object(s) provides a proxy on operator performance
  • realistic insertion provide a direct measure of operator performance on completely realistic incidents.
  • Combining both approaches in operator performance monitoring also prevents unrealistic estimates of performance of operator who simply concentrate on elevating their performance on inserted synthetic objects at the expense of detecting real incidents in the surveillance video.
  • the operator will be required to interact, in accordance with his training, via an interface generator 24.
  • the operator may for example be required to click once, with a mouse pointer, on an image such as a fanciful image or a realistic image of non-threatening type or to click twice on an image representing a security threat.
  • the event controller may be programmed to give feedback to the operator, via the interface 24, to indicate that the correct action has been taken.
  • the inserted object may for instance be caused to flash and/or to disappear from the image, thereby acknowledging the correctness of the operator's action.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Alarm Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un système augmenté de surveillance vidéo augmenté par insertion dans des images vidéo en direct observées par un opérateur d'objets de synthèse ou réalistes et/ou d'une amélioration graphique d'événements prédéterminés se produisant dans l'image vidéo en direct observée par l'opérateur. Cette insertion demande des actions spécifiques de l'opérateur et les actions entreprises par l'opérateur en réponse à l'insertion sont surveillées.
PCT/IB2004/003304 2003-10-09 2004-10-11 Systeme augmente de surveillance video WO2005036881A2 (fr)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP04791680A EP1673938A2 (fr) 2003-10-09 2004-10-11 Systeme augmente de surveillance video
AU2004306552A AU2004306552A1 (en) 2003-10-09 2004-10-11 Augmented video surveillance system
CA002541880A CA2541880A1 (fr) 2003-10-09 2004-10-11 Systeme augmente de surveillance video
AP2006003573A AP2006003573A0 (en) 2003-10-09 2004-10-11 Augmented video surveillance system.
IL174857A IL174857A0 (en) 2003-10-09 2006-04-06 Augmented video surveillance system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ZA2003/7897 2003-10-09
ZA200307897 2003-10-09

Publications (2)

Publication Number Publication Date
WO2005036881A2 true WO2005036881A2 (fr) 2005-04-21
WO2005036881A3 WO2005036881A3 (fr) 2008-01-17

Family

ID=34436038

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2004/003304 WO2005036881A2 (fr) 2003-10-09 2004-10-11 Systeme augmente de surveillance video

Country Status (6)

Country Link
EP (1) EP1673938A2 (fr)
AP (1) AP2006003573A0 (fr)
AU (1) AU2004306552A1 (fr)
CA (1) CA2541880A1 (fr)
IL (1) IL174857A0 (fr)
WO (1) WO2005036881A2 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008000813A1 (de) * 2008-03-26 2009-10-01 Robert Bosch Gmbh Überwachungssystem und korrespondierendes Verfahren zur Aufmerksamkeitskontrolle eines Benutzers
WO2012087641A2 (fr) 2010-12-22 2012-06-28 Intel Corporation Techniques pour des applications à réalité mobile enrichie
US20200036909A1 (en) * 2018-07-27 2020-01-30 BriefCam Ltd. System and method allowing simultaneous viewing of live and recorded video content

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001111987A (ja) * 1999-10-07 2001-04-20 Daikoku Denki Co Ltd 監視装置
WO2002011449A1 (fr) * 2000-08-01 2002-02-07 Koninklijke Philips Electronics N.V. Signal representatif de presence pour systemes de securite et autres applications comportant des capteurs
US20030085992A1 (en) * 2000-03-07 2003-05-08 Sarnoff Corporation Method and apparatus for providing immersive surveillance

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001111987A (ja) * 1999-10-07 2001-04-20 Daikoku Denki Co Ltd 監視装置
US20030085992A1 (en) * 2000-03-07 2003-05-08 Sarnoff Corporation Method and apparatus for providing immersive surveillance
WO2002011449A1 (fr) * 2000-08-01 2002-02-07 Koninklijke Philips Electronics N.V. Signal representatif de presence pour systemes de securite et autres applications comportant des capteurs

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DONOLD C H M: "Assessing the human vigilance capacity of control room operators" HUMANS INTERFACES IN CONTROL ROOMS, COCKPITS AND COMMAND CENTRES, 1999. INTERNATIONAL CONFEENCE ON BATH, UK 21-23 JUNE 1999, LONDON, UK,IEE, UK, 21 June 1999 (1999-06-21), pages 7-11, XP006500832 ISBN: 0-85296-715-2 *
PATENT ABSTRACTS OF JAPAN vol. 2000, no. 21, 3 August 2001 (2001-08-03) & JP 2001 111987 A (DAIKOKU DENKI CO LTD), 20 April 2001 (2001-04-20) *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008000813A1 (de) * 2008-03-26 2009-10-01 Robert Bosch Gmbh Überwachungssystem und korrespondierendes Verfahren zur Aufmerksamkeitskontrolle eines Benutzers
WO2012087641A2 (fr) 2010-12-22 2012-06-28 Intel Corporation Techniques pour des applications à réalité mobile enrichie
EP2656642A2 (fr) * 2010-12-22 2013-10-30 Intel Corporation Techniques pour des applications à réalité mobile enrichie
CN103380631A (zh) * 2010-12-22 2013-10-30 英特尔公司 用于移动增强现实应用的技术
EP2656642A4 (fr) * 2010-12-22 2014-05-07 Intel Corp Techniques pour des applications à réalité mobile enrichie
TWI551334B (zh) * 2010-12-22 2016-10-01 英特爾公司 用於擴增實境的方法、設備及電腦可讀取媒體
US20200036909A1 (en) * 2018-07-27 2020-01-30 BriefCam Ltd. System and method allowing simultaneous viewing of live and recorded video content

Also Published As

Publication number Publication date
AU2004306552A1 (en) 2005-04-21
EP1673938A2 (fr) 2006-06-28
CA2541880A1 (fr) 2005-04-21
IL174857A0 (en) 2006-08-20
AP2006003573A0 (en) 2006-04-30
WO2005036881A3 (fr) 2008-01-17

Similar Documents

Publication Publication Date Title
EP1668921B1 (fr) Appareil et procede informatise pour determiner les relations de champs de vision entre plusieurs capteurs d'image
Zhou et al. A real-time system for in-home activity monitoring of elders
CN113256924A (zh) 一种轨道列车的监控系统，监控方法及监控装置
CN108027874A (zh) 使用深度摄像头的基于计算机视觉的安全系统
WO2008039401A2 (fr) Analytique vidéo pour surveillance d'opérations bancaires
EP1676249A1 (fr) Systeme et procede de recherche de changements dans une video de surveillance
EP1346577A2 (fr) Procede et appareil permettant de selectionner la meilleure image video aux fins de transmission vers une station eloignee aux fins de surveillance de la securite residentielle fondee sur un cctv
KR20220057213A (ko) 인공지능 기반의 이상행동 감지 시스템
CN104969875A (zh) 一种基于图像变化的宠物行为检测系统
CN114359976B (zh) 一种基于人物识别的智能安防方法与装置
US20240046701A1 (en) Image-based pose estimation and action detection method and apparatus
JP5088463B2 (ja) 監視システム
CN112309077A (zh) 一种泳池溺水警报方法及装置
WO2005036881A2 (fr) Systeme augmente de surveillance video
SE519700C2 (sv) Bilddatabehandling
KR20210013865A (ko) 생성적 대립 네트워크를 이용한 사람의 비정상 행동 탐지 시스템 및 방법
KR101926510B1 (ko) 광각카메라를 이용한 안면인식 기반의 광역 감시 시스템
KR20020082476A (ko) 감시 방법, 시스템 및 묘듈
US20070222894A1 (en) Enhanced Video Based Surveillance System
Odobez et al. Unsupervised activity analysis and monitoring algorithms for effective surveillance systems
Mecocci et al. Real-time automatic detection of violent-acts by low-level colour visual cues
Shao et al. Eleview: an active elevator video surveillance system
Hernández-García et al. Video motion detection using the algorithm of discrimination and the hamming distance
Priya et al. Elink-A Safe Secured Device
Ramli et al. Human motion detection framework Suzaimah Bt Ramli

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 200602541

Country of ref document: ZA

WWE Wipo information: entry into national phase

Ref document number: 174857

Country of ref document: IL

Ref document number: 2541880

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: DE

WWE Wipo information: entry into national phase

Ref document number: 2004306552

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2004791680

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2004306552

Country of ref document: AU

Date of ref document: 20041011

Kind code of ref document: A

WWP Wipo information: published in national office

Ref document number: 2004306552

Country of ref document: AU

WWP Wipo information: published in national office

Ref document number: 2004791680

Country of ref document: EP