EP3635628A4 - A neuromorphic system for real-time visual activity recognition - Google Patents

A neuromorphic system for real-time visual activity recognition Download PDF

Info

Publication number
EP3635628A4
EP3635628A4 EP18823688.9A EP18823688A EP3635628A4 EP 3635628 A4 EP3635628 A4 EP 3635628A4 EP 18823688 A EP18823688 A EP 18823688A EP 3635628 A4 EP3635628 A4 EP 3635628A4
Authority
EP
European Patent Office
Prior art keywords
real
activity recognition
time visual
neuromorphic system
visual activity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18823688.9A
Other languages
German (de)
French (fr)
Other versions
EP3635628A2 (en
Inventor
Deepak Khosla
Ryan M. UHLENBROCK
Yang Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HRL Laboratories LLC
Original Assignee
HRL Laboratories LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/883,822 external-priority patent/US11055872B1/en
Application filed by HRL Laboratories LLC filed Critical HRL Laboratories LLC
Publication of EP3635628A2 publication Critical patent/EP3635628A2/en
Publication of EP3635628A4 publication Critical patent/EP3635628A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24143—Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/285—Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Medical Informatics (AREA)
  • Neurology (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Databases & Information Systems (AREA)
  • Psychiatry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
EP18823688.9A 2017-06-07 2018-04-06 A neuromorphic system for real-time visual activity recognition Pending EP3635628A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762516217P 2017-06-07 2017-06-07
US15/883,822 US11055872B1 (en) 2017-03-30 2018-01-30 Real-time object recognition using cascaded features, deep learning and multi-target tracking
PCT/US2018/026432 WO2019005257A2 (en) 2017-06-07 2018-04-06 A neuromorphic system for real-time visual activity recognition

Publications (2)

Publication Number Publication Date
EP3635628A2 EP3635628A2 (en) 2020-04-15
EP3635628A4 true EP3635628A4 (en) 2021-03-10

Family

ID=64741843

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18823688.9A Pending EP3635628A4 (en) 2017-06-07 2018-04-06 A neuromorphic system for real-time visual activity recognition

Country Status (3)

Country Link
EP (1) EP3635628A4 (en)
CN (1) CN110603542B (en)
WO (1) WO2019005257A2 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008098188A2 (en) * 2007-02-08 2008-08-14 Behavioral Recognition Systems, Inc. Behavioral recognition system
US20090087027A1 (en) * 2007-09-27 2009-04-02 John Eric Eaton Estimator identifier component for behavioral recognition system
US20120134532A1 (en) * 2010-06-08 2012-05-31 Gorilla Technology Inc. Abnormal behavior detection system and method using automatic classification of multiple features

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8345984B2 (en) * 2010-01-28 2013-01-01 Nec Laboratories America, Inc. 3D convolutional neural networks for automatic human action recognition
US9576214B1 (en) * 2012-01-23 2017-02-21 Hrl Laboratories, Llc Robust object recognition from moving platforms by combining form and motion detection with bio-inspired classification
US9008366B1 (en) * 2012-01-23 2015-04-14 Hrl Laboratories, Llc Bio-inspired method of ground object cueing in airborne motion imagery
US8700251B1 (en) * 2012-04-13 2014-04-15 Google Inc. System and method for automatically detecting key behaviors by vehicles
MX346218B (en) * 2012-09-05 2017-03-09 Element Inc Biometric authentication in connection with camera-equipped devices.
EP2720172A1 (en) * 2012-10-12 2014-04-16 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO Video access system and method based on action type detection
WO2014098783A1 (en) * 2012-12-21 2014-06-26 Echostar Ukraine, LLC Identification and tracking onscreen
US9449230B2 (en) * 2014-11-26 2016-09-20 Zepp Labs, Inc. Fast object tracking framework for sports video recognition
GB201512283D0 (en) * 2015-07-14 2015-08-19 Apical Ltd Track behaviour events

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008098188A2 (en) * 2007-02-08 2008-08-14 Behavioral Recognition Systems, Inc. Behavioral recognition system
US20090087027A1 (en) * 2007-09-27 2009-04-02 John Eric Eaton Estimator identifier component for behavioral recognition system
US20120134532A1 (en) * 2010-06-08 2012-05-31 Gorilla Technology Inc. Abnormal behavior detection system and method using automatic classification of multiple features

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HU W ET AL: "A Survey on Visual Surveillance of Object Motion and Behaviors", IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS: PART C:APPLICATIONS AND REVIEWS, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 34, no. 3, 3 August 2004 (2004-08-03), pages 334 - 352, XP011114887, ISSN: 1094-6977, DOI: 10.1109/TSMCC.2004.829274 *

Also Published As

Publication number Publication date
WO2019005257A2 (en) 2019-01-03
CN110603542A (en) 2019-12-20
WO2019005257A3 (en) 2019-05-02
EP3635628A2 (en) 2020-04-15
CN110603542B (en) 2023-04-25

Similar Documents

Publication Publication Date Title
EP3732617A4 (en) Activity recognition method using videotubes
EP3475729A4 (en) Real-time precipitation forecasting system
EP3692471A4 (en) Method for object recognition
EP3711826A4 (en) Recognition system
EP3658076A4 (en) System and method for positioning a heart valve
EP3259688A4 (en) Systems and methods for neural language modeling
EP3354417A4 (en) Gpos-connected real-time robot control system and real-time device control system using same
EP3612019A4 (en) Pet spray training system
EP3241206A4 (en) A method and system for online and remote speech disorders therapy
EP3614917A4 (en) Activity recognition
EP3496806A4 (en) Systems and methods for monitoring neural activity
EP3448247A4 (en) Real-time denoising and prediction for a continuous glucose monitoring system
EP3101934A4 (en) Interference control method and apparatus therefor in a heterogeneous system
EP3158505A4 (en) A method and a system for object recognition
EP3639121A4 (en) Neural operating system
EP3688697A4 (en) A tracking system and method
EP3652600A4 (en) Autonomous robot system
EP3713636A4 (en) Monolithic neural interface system
EP3227584A4 (en) Lubrication system and a method for controlling the lubrication system
EP3711667A4 (en) System, method, and program for recognizing myoelectric signal-originating motion
EP3711655A4 (en) Real-time parathyroid sensing system
EP3231191A4 (en) System and method for generating a self-steering beamformer
EP3562384A4 (en) A portable system and method for monitoring brain trauma
EP3710900B8 (en) Method and system for defining or learning a robot command
EP3562297B8 (en) System and method for determining a plant status

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191127

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20210205

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/62 20060101ALI20210201BHEP

Ipc: G06K 9/00 20060101ALI20210201BHEP

Ipc: G06K 9/32 20060101AFI20210201BHEP

Ipc: G06N 3/02 20060101ALI20210201BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230315

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525