EP3635628A4 - Neuromorphes system für echtzeit-sehaktivitätserkennung - Google Patents

Neuromorphes system für echtzeit-sehaktivitätserkennung Download PDF

Info

Publication number
EP3635628A4
EP3635628A4 EP18823688.9A EP18823688A EP3635628A4 EP 3635628 A4 EP3635628 A4 EP 3635628A4 EP 18823688 A EP18823688 A EP 18823688A EP 3635628 A4 EP3635628 A4 EP 3635628A4
Authority
EP
European Patent Office
Prior art keywords
real
activity recognition
time visual
neuromorphic system
visual activity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18823688.9A
Other languages
English (en)
French (fr)
Other versions
EP3635628A2 (de
Inventor
Deepak Khosla
Ryan M. UHLENBROCK
Yang Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HRL Laboratories LLC
Original Assignee
HRL Laboratories LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/883,822 external-priority patent/US11055872B1/en
Application filed by HRL Laboratories LLC filed Critical HRL Laboratories LLC
Publication of EP3635628A2 publication Critical patent/EP3635628A2/de
Publication of EP3635628A4 publication Critical patent/EP3635628A4/de
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24143—Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/285—Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Neurology (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
EP18823688.9A 2017-06-07 2018-04-06 Neuromorphes system für echtzeit-sehaktivitätserkennung Pending EP3635628A4 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762516217P 2017-06-07 2017-06-07
US15/883,822 US11055872B1 (en) 2017-03-30 2018-01-30 Real-time object recognition using cascaded features, deep learning and multi-target tracking
PCT/US2018/026432 WO2019005257A2 (en) 2017-06-07 2018-04-06 NEUROMORPHIC SYSTEM FOR REAL-TIME VISUAL ACTIVITY RECOGNITION

Publications (2)

Publication Number Publication Date
EP3635628A2 EP3635628A2 (de) 2020-04-15
EP3635628A4 true EP3635628A4 (de) 2021-03-10

Family

ID=64741843

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18823688.9A Pending EP3635628A4 (de) 2017-06-07 2018-04-06 Neuromorphes system für echtzeit-sehaktivitätserkennung

Country Status (3)

Country Link
EP (1) EP3635628A4 (de)
CN (1) CN110603542B (de)
WO (1) WO2019005257A2 (de)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008098188A2 (en) * 2007-02-08 2008-08-14 Behavioral Recognition Systems, Inc. Behavioral recognition system
US20090087027A1 (en) * 2007-09-27 2009-04-02 John Eric Eaton Estimator identifier component for behavioral recognition system
US20120134532A1 (en) * 2010-06-08 2012-05-31 Gorilla Technology Inc. Abnormal behavior detection system and method using automatic classification of multiple features

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8345984B2 (en) * 2010-01-28 2013-01-01 Nec Laboratories America, Inc. 3D convolutional neural networks for automatic human action recognition
US9008366B1 (en) * 2012-01-23 2015-04-14 Hrl Laboratories, Llc Bio-inspired method of ground object cueing in airborne motion imagery
US9576214B1 (en) * 2012-01-23 2017-02-21 Hrl Laboratories, Llc Robust object recognition from moving platforms by combining form and motion detection with bio-inspired classification
US8700251B1 (en) * 2012-04-13 2014-04-15 Google Inc. System and method for automatically detecting key behaviors by vehicles
JP2015529365A (ja) * 2012-09-05 2015-10-05 エレメント，インク． カメラ付きデバイスに関連する生体認証のためのシステム及び方法
EP2720172A1 (de) * 2012-10-12 2014-04-16 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO Videozugangssystem und Verfahren basierend auf der Erkennung der Aktionsart
WO2014098783A1 (en) * 2012-12-21 2014-06-26 Echostar Ukraine, LLC Identification and tracking onscreen
US9449230B2 (en) * 2014-11-26 2016-09-20 Zepp Labs, Inc. Fast object tracking framework for sports video recognition
GB201512283D0 (en) * 2015-07-14 2015-08-19 Apical Ltd Track behaviour events

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008098188A2 (en) * 2007-02-08 2008-08-14 Behavioral Recognition Systems, Inc. Behavioral recognition system
US20090087027A1 (en) * 2007-09-27 2009-04-02 John Eric Eaton Estimator identifier component for behavioral recognition system
US20120134532A1 (en) * 2010-06-08 2012-05-31 Gorilla Technology Inc. Abnormal behavior detection system and method using automatic classification of multiple features

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HU W ET AL: "A Survey on Visual Surveillance of Object Motion and Behaviors", IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS: PART C:APPLICATIONS AND REVIEWS, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 34, no. 3, 3 August 2004 (2004-08-03), pages 334 - 352, XP011114887, ISSN: 1094-6977, DOI: 10.1109/TSMCC.2004.829274 *

Also Published As

Publication number Publication date
WO2019005257A2 (en) 2019-01-03
EP3635628A2 (de) 2020-04-15
CN110603542B (zh) 2023-04-25
WO2019005257A3 (en) 2019-05-02
CN110603542A (zh) 2019-12-20

Similar Documents

Publication Publication Date Title
EP3732617A4 (de) Verfahren zur aktivitätserkennung mit videoröhren
EP3475729A4 (de) System zur vorhersage von ausfällung in echtzeit
EP3711826A4 (de) Erkennungssystem
EP3692471A4 (de) Verfahren zur objekterkennung
EP3658076A4 (de) System und verfahren zur positionierung einer herzklappe
EP3614917A4 (de) Aktivitätserkennung
EP3649558B8 (de) Verfahren und system für ein verteiltes datenverarbeitungssystem
EP3612019A4 (de) Sprühtrainingssystem für haustiere
EP3259688A4 (de) Systeme und verfahren zur modellierung von neuraler sprache
EP3448247A4 (de) Echtzeit-entstörung und vorhersage für ein kontinuierliches blutzuckerüberwachungssystem
EP3241206A4 (de) Verfahren und system für online- und ferntherapie von sprachstörungen
EP3496806A4 (de) Systeme und verfahren zur überwachung der nervenaktivität
EP3101934A4 (de) Interferenzsteuerungsverfahren und vorrichtung in einem heterogenen system
EP3158505A4 (de) Verfahren und system zur objekterkennung
EP3652600A4 (de) Autonomes robotersystem
EP3639121A4 (de) Neuronales betriebssystem
EP3688697A4 (de) Verfolgungssystem und -verfahren
EP3713636A4 (de) Monolithisches neuronales schnittstellensystem
EP3227584A4 (de) Schmiersystem und verfahren zur steuerung des schmiersystems
EP3711667A4 (de) System, verfahren und programm zur erkennung von myoelektrische signale erzeugenden bewegung
EP3711655A4 (de) System zur nebenschilddrüsenabtastung in echtzeit
EP3231191A4 (de) System und verfahren zur herstellung eines selbststeuernden strahlformers
EP3562297B8 (de) System und verfahren zur bestimmung eines pflanzenstatus
EP3562384A4 (de) Tragbares system und verfahren zur überwachung von hirntrauma
EP3897427A4 (de) Automatisiertes dermatologisches kryosprühbehandlungsplanungssystem

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191127

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20210205

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/62 20060101ALI20210201BHEP

Ipc: G06K 9/00 20060101ALI20210201BHEP

Ipc: G06K 9/32 20060101AFI20210201BHEP

Ipc: G06N 3/02 20060101ALI20210201BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230315

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525