WO2009049314A3 - Video processing system employing behavior subtraction between reference and observed video image sequences - Google Patents

Video processing system employing behavior subtraction between reference and observed video image sequences Download PDF

Info

Publication number
WO2009049314A3
WO2009049314A3 PCT/US2008/079839 US2008079839W WO2009049314A3 WO 2009049314 A3 WO2009049314 A3 WO 2009049314A3 US 2008079839 W US2008079839 W US 2008079839W WO 2009049314 A3 WO2009049314 A3 WO 2009049314A3
Authority
WO
WIPO (PCT)
Prior art keywords
behavior
motion
sequence
sequences
images
Prior art date
Application number
PCT/US2008/079839
Other languages
French (fr)
Other versions
WO2009049314A2 (en
Inventor
Venkatesh Saligrama
Janusz Konrad
Pierre-Marc Jodoin
Original Assignee
Univ Boston
Commercialization Des Produits
Venkatesh Saligrama
Janusz Konrad
Pierre-Marc Jodoin
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Boston, Commercialization Des Produits, Venkatesh Saligrama, Janusz Konrad, Pierre-Marc Jodoin filed Critical Univ Boston
Publication of WO2009049314A2 publication Critical patent/WO2009049314A2/en
Publication of WO2009049314A3 publication Critical patent/WO2009049314A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G06V20/54—Surveillance or monitoring of activities, e.g. for recognising suspicious objects of traffic, e.g. cars on the road, trains or boats
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Abstract

An image processing method includes calculating sequences of motion labels from each of first and second sequences of images, each sequence of motion labels including motion label values indicating levels of motion activity in corresponding regions of the corresponding sequence of images. First and second behavior representations are calculated, each from the sequences of motion labels calculated from the respective image sequence, such that each region of each behavior representation represents a measure of motion activity of the corresponding region throughout the respective sequence of images. A comparing function of the first and second behavior representations is calculated, and an output signal is generated that reflects a result of calculating the comparing function. Applications include surveillance applications in which anomalous behavior is identified in an observed image sequence versus background behavior in a training image sequence.
PCT/US2008/079839 2007-10-11 2008-10-14 Video processing system employing behavior subtraction between reference and observed video image sequences WO2009049314A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US97915907P 2007-10-11 2007-10-11
US60/979,159 2007-10-11

Publications (2)

Publication Number Publication Date
WO2009049314A2 WO2009049314A2 (en) 2009-04-16
WO2009049314A3 true WO2009049314A3 (en) 2009-07-30

Family

ID=40409759

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/079839 WO2009049314A2 (en) 2007-10-11 2008-10-14 Video processing system employing behavior subtraction between reference and observed video image sequences

Country Status (1)

Country Link
WO (1) WO2009049314A2 (en)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2475853C2 (en) 2007-02-08 2013-02-20 Бихейвиэрл Рикогнишн Системз, Инк. Behaviour recognition system
US8411935B2 (en) 2007-07-11 2013-04-02 Behavioral Recognition Systems, Inc. Semantic representation module of a machine-learning engine in a video analysis system
US8300924B2 (en) 2007-09-27 2012-10-30 Behavioral Recognition Systems, Inc. Tracker component for behavioral recognition system
US8200011B2 (en) 2007-09-27 2012-06-12 Behavioral Recognition Systems, Inc. Context processor for video analysis system
US8175333B2 (en) 2007-09-27 2012-05-08 Behavioral Recognition Systems, Inc. Estimator identifier component for behavioral recognition system
US9633275B2 (en) 2008-09-11 2017-04-25 Wesley Kenneth Cobb Pixel-level based micro-feature extraction
US9373055B2 (en) 2008-12-16 2016-06-21 Behavioral Recognition Systems, Inc. Hierarchical sudden illumination change detection using radiance consistency within a spatial neighborhood
US8285046B2 (en) 2009-02-18 2012-10-09 Behavioral Recognition Systems, Inc. Adaptive update of background pixel thresholds using sudden illumination change detection
US8416296B2 (en) 2009-04-14 2013-04-09 Behavioral Recognition Systems, Inc. Mapper component for multiple art networks in a video analysis system
US8340352B2 (en) 2009-08-18 2012-12-25 Behavioral Recognition Systems, Inc. Inter-trajectory anomaly detection using adaptive voting experts in a video surveillance system
US8493409B2 (en) 2009-08-18 2013-07-23 Behavioral Recognition Systems, Inc. Visualizing and updating sequences and segments in a video surveillance system
US8295591B2 (en) 2009-08-18 2012-10-23 Behavioral Recognition Systems, Inc. Adaptive voting experts for incremental segmentation of sequences with prediction in a video surveillance system
US8280153B2 (en) 2009-08-18 2012-10-02 Behavioral Recognition Systems Visualizing and updating learned trajectories in video surveillance systems
US8625884B2 (en) 2009-08-18 2014-01-07 Behavioral Recognition Systems, Inc. Visualizing and updating learned event maps in surveillance systems
US8379085B2 (en) 2009-08-18 2013-02-19 Behavioral Recognition Systems, Inc. Intra-trajectory anomaly detection using adaptive voting experts in a video surveillance system
US8358834B2 (en) 2009-08-18 2013-01-22 Behavioral Recognition Systems Background model for complex and dynamic scenes
US9805271B2 (en) 2009-08-18 2017-10-31 Omni Ai, Inc. Scene preset identification using quadtree decomposition analysis
US8270732B2 (en) 2009-08-31 2012-09-18 Behavioral Recognition Systems, Inc. Clustering nodes in a self-organizing map using an adaptive resonance theory network
US8167430B2 (en) 2009-08-31 2012-05-01 Behavioral Recognition Systems, Inc. Unsupervised learning of temporal anomalies for a video surveillance system
US8285060B2 (en) 2009-08-31 2012-10-09 Behavioral Recognition Systems, Inc. Detecting anomalous trajectories in a video surveillance system
US8797405B2 (en) 2009-08-31 2014-08-05 Behavioral Recognition Systems, Inc. Visualizing and updating classifications in a video surveillance system
US8786702B2 (en) 2009-08-31 2014-07-22 Behavioral Recognition Systems, Inc. Visualizing and updating long-term memory percepts in a video surveillance system
US8270733B2 (en) 2009-08-31 2012-09-18 Behavioral Recognition Systems, Inc. Identifying anomalous object types during classification
US8218818B2 (en) 2009-09-01 2012-07-10 Behavioral Recognition Systems, Inc. Foreground object tracking
US8218819B2 (en) 2009-09-01 2012-07-10 Behavioral Recognition Systems, Inc. Foreground object detection in a video surveillance system
US8180105B2 (en) 2009-09-17 2012-05-15 Behavioral Recognition Systems, Inc. Classifier anomalies for observed behaviors in a video surveillance system
US8170283B2 (en) 2009-09-17 2012-05-01 Behavioral Recognition Systems Inc. Video surveillance system configured to analyze complex behaviors using alternating layers of clustering and sequencing
IN2014DN08342A (en) 2012-03-15 2015-05-08 Behavioral Recognition Sys Inc
US9911043B2 (en) 2012-06-29 2018-03-06 Omni Ai, Inc. Anomalous object interaction detection and reporting
US9723271B2 (en) 2012-06-29 2017-08-01 Omni Ai, Inc. Anomalous stationary object detection and reporting
US9113143B2 (en) 2012-06-29 2015-08-18 Behavioral Recognition Systems, Inc. Detecting and responding to an out-of-focus camera in a video analytics system
US9317908B2 (en) 2012-06-29 2016-04-19 Behavioral Recognition System, Inc. Automatic gain control filter in a video analysis system
US9111353B2 (en) 2012-06-29 2015-08-18 Behavioral Recognition Systems, Inc. Adaptive illuminance filter in a video analysis system
WO2014004901A1 (en) 2012-06-29 2014-01-03 Behavioral Recognition Systems, Inc. Unsupervised learning of feature anomalies for a video surveillance system
WO2014031615A1 (en) 2012-08-20 2014-02-27 Behavioral Recognition Systems, Inc. Method and system for detecting sea-surface oil
IN2015DN03877A (en) 2012-11-12 2015-10-02 Behavioral Recognition Sys Inc
BR112016002229A2 (en) 2013-08-09 2017-08-01 Behavioral Recognition Sys Inc cognitive neurolinguistic behavior recognition system for multisensor data fusion
US10409909B2 (en) 2014-12-12 2019-09-10 Omni Ai, Inc. Lexical analyzer for a neuro-linguistic behavior recognition system
US10409910B2 (en) 2014-12-12 2019-09-10 Omni Ai, Inc. Perceptual associative memory for a neuro-linguistic behavior recognition system
CN109144260B (en) 2018-08-24 2020-08-18 上海商汤智能科技有限公司 Dynamic motion detection method, dynamic motion control method and device
CN109543590B (en) * 2018-11-16 2023-04-18 中山大学 Video human behavior recognition algorithm based on behavior association degree fusion characteristics
CN110135409B (en) * 2019-04-04 2023-11-03 平安科技（深圳）有限公司 Optimization method and device for recognition model

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
BOBICK A F ET AL: "THE RECOGNITION OF HUMAN MOVEMENT USING TEMPORAL TEMPLATES", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, IEEE SERVICE CENTER, LOS ALAMITOS, CA, US, vol. 23, no. 3, 1 March 2001 (2001-03-01), pages 257 - 267, XP001005771, ISSN: 0162-8828 *
GRAVES A; SHAOGANG GONG: "Surveillance video indexing with iconic patterns of activity", IEE INTERNATIONAL CONFERENCE ON VISUAL INFORMATION ENGINEERING (VIE 2005) 4-6 APRIL 2005 GLASGOW, UK, 2005, IEE International Conference on Visual Information Engineering (VIE 2005) (CP No.509) IEE Stevenage, UK, pages 409 - 416, XP008105068, ISBN: 0-86341-507-5 *
JODOIN P-M ET AL: "Behavior subtraction", PROCEEDINGS OF THE SPIE, SPIE, BELLINGHAM, VA , US, vol. 6822, 1 January 2008 (2008-01-01), pages 68220B - 1, XP008098903, ISSN: 0277-786X *
PIERRE-MARC JODOIN ET AL: "Modeling background activity for behavior subtraction", DISTRIBUTED SMART CAMERAS, 2008. ICDSC 2008. SECOND ACM/IEEE INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 7 September 2008 (2008-09-07), pages 1 - 10, XP031329216, ISBN: 978-1-4244-2664-5 *
TAO XIANG ET AL: "Beyond Tracking: Modelling Activity and Understanding Behaviour", INTERNATIONAL JOURNAL OF COMPUTER VISION, KLUWER ACADEMIC PUBLISHERS, BO, vol. 67, no. 1, 1 April 2006 (2006-04-01), pages 21 - 51, XP019216513, ISSN: 1573-1405 *
TAO XIANG; SHAOGANG GONG; PARKINSON D: "Autonomous visual events detection and classification without explicit object-centred segmentation and tracking", BMVC2002: BRITISH MACHINE VISION CONFERENCE 2002 2-5 SEPT. 2002 CARDIFF, UK, 2002, Electronic Proceedings of the 13th British Machine Vision Conference British Machine Vision Assoc Manchester, UK, pages 233 - 242, XP008105073, ISBN: 1-901725-20-0 *
XIANG T ET AL: "Activity based surveillance video content modelling", PATTERN RECOGNITION, ELSEVIER, GB, vol. 41, no. 7, 1 July 2008 (2008-07-01), pages 2309 - 2326, XP022594772, ISSN: 0031-3203, [retrieved on 20080128] *

Also Published As

Publication number Publication date
WO2009049314A2 (en) 2009-04-16

Similar Documents

Publication Publication Date Title
WO2009049314A3 (en) Video processing system employing behavior subtraction between reference and observed video image sequences
JP5488457B2 (en) Communication system and receiving apparatus
WO2018180750A1 (en) Information processing device and information processing method
CN110782433B (en) Dynamic information violent parabolic detection method and device based on time sequence and storage medium
EP2487900A3 (en) Image displaying device and method, and image processing device and method
WO2007127590A3 (en) Method and system for fingerprinting digital video object based on multiresolution, multirate spatial and temporal signatures
WO2008081611A1 (en) Image display device and method, and image processing device and method
ATE436060T1 (en) MOVING OBJECT DETECTION
WO2006083844A3 (en) Security system access control and method
TW201130303A (en) Image sensor with wide dynamic range
CN101106705A (en) Improved pre-alarm video buffer
WO2009023188A3 (en) Method and apparatus for improved video encoding using region of interest (roi) information
EP2093711A3 (en) Iimage processing apparatus and image processing method, and program
WO2019026457A1 (en) Image monitoring device, image monitoring method, image monitoring program, and recording medium
WO2005038717A3 (en) Method of counting objects in a monitored environment and apparatus for the same
WO2006074043A3 (en) Method and apparatus for providing motion estimation with weight prediction
JP2012014627A5 (en)
WO2007149247A3 (en) Imaging system and method with intelligent digital zooming
BRPI0714646A2 (en) Event detection method and video surveillance system using such method
US8155386B2 (en) Method and apparatus for obtaining depth information
JP5950628B2 (en) Object detection apparatus, object detection method, and program
TW200633527A (en) Pull-down detection apparatus and pull-down detection method
JP2014053722A5 (en) Display control system, display control method, and program
WO2009060674A1 (en) Film mode determination apparatus and determination method
DK1477948T3 (en) Reporting system with imaging sensor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08837090

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08837090

Country of ref document: EP

Kind code of ref document: A2