EP3746938A4 - Système et procédé de classification d'activité visuelle neuromorphique faisant appel à une détection fovéale et à un filtrage contextuel - Google Patents

Système et procédé de classification d'activité visuelle neuromorphique faisant appel à une détection fovéale et à un filtrage contextuel Download PDF

Info

Publication number
EP3746938A4
EP3746938A4 EP19748018.9A EP19748018A EP3746938A4 EP 3746938 A4 EP3746938 A4 EP 3746938A4 EP 19748018 A EP19748018 A EP 19748018A EP 3746938 A4 EP3746938 A4 EP 3746938A4
Authority
EP
European Patent Office
Prior art keywords
foveated
detection
classification based
activity classification
visual activity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19748018.9A
Other languages
German (de)
English (en)
Other versions
EP3746938A2 (fr
Inventor
Deepak Khosla
Ryan M. UHLENBROCK
Yang Chen
Huapeng SU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HRL Laboratories LLC
Original Assignee
HRL Laboratories LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/883,822 external-priority patent/US11055872B1/en
Priority claimed from US15/947,032 external-priority patent/US10997421B2/en
Application filed by HRL Laboratories LLC filed Critical HRL Laboratories LLC
Publication of EP3746938A2 publication Critical patent/EP3746938A2/fr
Publication of EP3746938A4 publication Critical patent/EP3746938A4/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08—Detecting or categorising vehicles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
EP19748018.9A 2018-01-30 2019-01-14 Système et procédé de classification d'activité visuelle neuromorphique faisant appel à une détection fovéale et à un filtrage contextuel Pending EP3746938A4 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15/883,822 US11055872B1 (en) 2017-03-30 2018-01-30 Real-time object recognition using cascaded features, deep learning and multi-target tracking
US201862642959P 2018-03-14 2018-03-14
US15/947,032 US10997421B2 (en) 2017-03-30 2018-04-06 Neuromorphic system for real-time visual activity recognition
PCT/US2019/013513 WO2019152177A2 (fr) 2018-01-30 2019-01-14 Système et procédé de classification d'activité visuelle neuromorphique faisant appel à une détection fovéale et à un filtrage contextuel

Publications (2)

Publication Number Publication Date
EP3746938A2 EP3746938A2 (fr) 2020-12-09
EP3746938A4 true EP3746938A4 (fr) 2021-10-06

Family

ID=67479383

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19748018.9A Pending EP3746938A4 (fr) 2018-01-30 2019-01-14 Système et procédé de classification d'activité visuelle neuromorphique faisant appel à une détection fovéale et à un filtrage contextuel

Country Status (3)

Country Link
EP (1) EP3746938A4 (fr)
CN (1) CN111566661B (fr)
WO (1) WO2019152177A2 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111652128B (zh) * 2020-06-02 2023-09-01 浙江大华技术股份有限公司 一种高空电力作业安全监测方法、系统和存储装置
US20230206615A1 (en) * 2021-12-29 2023-06-29 Halliburton Energy Services, Inc. Systems and methods to determine an activity associated with an object of interest
US11776247B2 (en) 2022-01-07 2023-10-03 Tomahawk Robotics Classification parallelization architecture
KR20230134846A (ko) * 2022-03-15 2023-09-22 연세대학교 산학협력단 멀티스케일 객체탐지 장치 및 방법

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008098188A2 (fr) * 2007-02-08 2008-08-14 Behavioral Recognition Systems, Inc. Système de reconnaissance du comportement

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8116527B2 (en) * 2009-10-07 2012-02-14 The United States Of America As Represented By The Secretary Of The Army Using video-based imagery for automated detection, tracking, and counting of moving objects, in particular those objects having image characteristics similar to background
US9008366B1 (en) 2012-01-23 2015-04-14 Hrl Laboratories, Llc Bio-inspired method of ground object cueing in airborne motion imagery
KR102028732B1 (ko) * 2012-04-05 2019-10-04 매직 립, 인코포레이티드 능동 포비에이션 능력을 갖는 와이드-fov(field of view) 이미지 디바이스들
US9230302B1 (en) * 2013-03-13 2016-01-05 Hrl Laboratories, Llc Foveated compressive sensing system
US9147255B1 (en) 2013-03-14 2015-09-29 Hrl Laboratories, Llc Rapid object detection by combining structural information from image segmentation with bio-inspired attentional mechanisms
US9959468B2 (en) * 2015-11-06 2018-05-01 The Boeing Company Systems and methods for object tracking and classification

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008098188A2 (fr) * 2007-02-08 2008-08-14 Behavioral Recognition Systems, Inc. Système de reconnaissance du comportement

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ARUN HAMPAPUR ET AL: "Smart Video Surveillance [Exploring the concept of multiscale spatiotemporal tracking]", IEEE SIGNAL PROCESSING MAGAZINE, 1 March 2005 (2005-03-01), XP055347119, Retrieved from the Internet <URL:http://www.andrewsenior.com/papers/HampapurIEEESP05.pdf> [retrieved on 20170217], DOI: 10.1109/MSP.2005.1406476 *
PEIXOTO P ET AL: "A surveillance system combining peripheral and foveated motion tracking", PATTERN RECOGNITION, 1998. PROCEEDINGS. FOURTEENTH INTERNATIONAL CONFE RENCE ON BRISBANE, QLD., AUSTRALIA 16-20 AUG. 1998, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, vol. 1, 16 August 1998 (1998-08-16), pages 574 - 577, XP010297420, ISBN: 978-0-8186-8512-5, DOI: 10.1109/ICPR.1998.711208 *
See also references of WO2019152177A2 *

Also Published As

Publication number Publication date
CN111566661B (zh) 2023-11-17
WO2019152177A3 (fr) 2019-10-10
WO2019152177A2 (fr) 2019-08-08
CN111566661A (zh) 2020-08-21
EP3746938A2 (fr) 2020-12-09

Similar Documents

Publication Publication Date Title
EP3779786A4 (fr) Procédé et système de classification d&#39;image de rétinopathie diabétique basés sur un apprentissage profond
EP3746938A4 (fr) Système et procédé de classification d&#39;activité visuelle neuromorphique faisant appel à une détection fovéale et à un filtrage contextuel
EP3662453A4 (fr) Procédé et système de détection d&#39;accident à l&#39;aide de données contextuelles
EP3619681A4 (fr) Système et procédé de détection d&#39;obstacles mobiles sur la base d&#39;une prédiction sensorielle à partir d&#39;un mouvement d&#39;égo
EP3862991A4 (fr) Procédé et système de traitement d&#39;informations
EP3771171A4 (fr) Procédé et système de détection de site web
EP3961423A4 (fr) Procédé de traitement d&#39;informations, dispositif de traitement d&#39;informations et système de traitement d&#39;informations
EP3744484A4 (fr) Dispositif de traitement d&#39;informations, procédé de traitement d&#39;informations, et système de traitement d&#39;informations
EP3848889A4 (fr) Procédé et système de traitement d&#39;informations
EP3848860A4 (fr) Système de détection et procédé de détection de bit quantique
EP3805914A4 (fr) Dispositif, procédé et système de traitement d&#39;informations
EP3951740A4 (fr) Procédé de traitement d&#39;informations et système de traitement d&#39;informations
EP3747727A4 (fr) Système et procédé de traitement de données
EP3879524A4 (fr) Procédé et système de traitement d&#39;informations
EP3862995A4 (fr) Système, dispositif et procédé de traitement d&#39;informations
EP4062369A4 (fr) Systèmes et procédés de détection et de reconnaissance d&#39;objet
EP3933383A4 (fr) Dispositif de traitement d&#39;informations, procédé de traitement d&#39;informations, et système de traitement d&#39;informations
EP3817432A4 (fr) Procédé et système de traitement de données
EP3805048A4 (fr) Dispositif de traitement d&#39;informations, procédé de traitement d&#39;informations et système de traitement d&#39;informations
EP3819788A4 (fr) Système de traitement de données et procédé de traitement de données
EP4083844A4 (fr) Dispositif de traitement d&#39;informations, système de traitement d&#39;informations et procédé de traitement d&#39;informations
EP4047581A4 (fr) Système de traitement d&#39;informations, procédé de traitement d&#39;informations et dispositif de traitement d&#39;informations
EP4044149A4 (fr) Dispositif de traitement d&#39;informations, système de traitement d&#39;informations et procédé de traitement d&#39;informations
EP3998390A4 (fr) Procédé et système de détection anti-pincement
EP3825970A4 (fr) Système et procédé de traitement d&#39;argent en espèces

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200403

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06K0009000000

Ipc: G06N0003020000

A4 Supplementary search report drawn up and despatched

Effective date: 20210903

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101ALI20210830BHEP

Ipc: G06N 3/02 20060101AFI20210830BHEP

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230828