EP3610458A4 - Système de prédiction de mouvements d'un objet d'intérêt avec un codeur automatique - Google Patents

Système de prédiction de mouvements d'un objet d'intérêt avec un codeur automatique Download PDF

Info

Publication number
EP3610458A4
EP3610458A4 EP18784088.9A EP18784088A EP3610458A4 EP 3610458 A4 EP3610458 A4 EP 3610458A4 EP 18784088 A EP18784088 A EP 18784088A EP 3610458 A4 EP3610458 A4 EP 3610458A4
Authority
EP
European Patent Office
Prior art keywords
autoencoder
interest
predicting movements
predicting
movements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18784088.9A
Other languages
German (de)
English (en)
Other versions
EP3610458A1 (fr
Inventor
Amir M. RAHIMI
Soheil KOLOURI
Rajan Bhattacharyya
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HRL Laboratories LLC
Original Assignee
HRL Laboratories LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HRL Laboratories LLC filed Critical HRL Laboratories LLC
Publication of EP3610458A1 publication Critical patent/EP3610458A1/fr
Publication of EP3610458A4 publication Critical patent/EP3610458A4/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G06V20/42—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/537—Motion estimation other than block-based
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Image Analysis (AREA)
EP18784088.9A 2017-04-10 2018-04-09 Système de prédiction de mouvements d'un objet d'intérêt avec un codeur automatique Pending EP3610458A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762483916P 2017-04-10 2017-04-10
US201862649893P 2018-03-29 2018-03-29
PCT/US2018/026770 WO2018191192A1 (fr) 2017-04-10 2018-04-09 Système de prédiction de mouvements d'un objet d'intérêt avec un codeur automatique

Publications (2)

Publication Number Publication Date
EP3610458A1 EP3610458A1 (fr) 2020-02-19
EP3610458A4 true EP3610458A4 (fr) 2021-01-06

Family

ID=63711055

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18784088.9A Pending EP3610458A4 (fr) 2017-04-10 2018-04-09 Système de prédiction de mouvements d'un objet d'intérêt avec un codeur automatique

Country Status (4)

Country Link
US (1) US11069069B2 (fr)
EP (1) EP3610458A4 (fr)
CN (1) CN110462684B (fr)
WO (1) WO2018191192A1 (fr)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10687050B2 (en) * 2017-03-10 2020-06-16 Qualcomm Incorporated Methods and systems of reducing latency in communication of image data between devices
US10748376B2 (en) * 2017-09-21 2020-08-18 NEX Team Inc. Real-time game tracking with a mobile device using artificial intelligence
US10489656B2 (en) * 2017-09-21 2019-11-26 NEX Team Inc. Methods and systems for ball game analytics with a mobile device
US20220036216A1 (en) * 2018-09-26 2022-02-03 Google Llc Predicted Variables in Programming
US20200160176A1 (en) * 2018-11-16 2020-05-21 Royal Bank Of Canada System and method for generative model for stochastic point processes
US10918949B2 (en) * 2019-07-01 2021-02-16 Disney Enterprises, Inc. Systems and methods to provide a sports-based interactive experience
CN110727826B (zh) * 2019-09-30 2022-03-25 浙江大学 一种乒乓球战术挖掘可视化分析方法
US20210170229A1 (en) * 2019-12-06 2021-06-10 Acronis International Gmbh Systems and methods for providing strategic game recommendations in a sports contest using artificial intelligence
CN110992354B (zh) * 2019-12-13 2022-04-12 华中科技大学 基于引入自动记忆机制对抗自编码器的异常区域检测方法
JP7542331B2 (ja) 2020-06-03 2024-08-30 エヌ・ティ・ティ・コミュニケーションズ株式会社 学習装置、物体分類装置、学習方法、物体分類方法及びコンピュータプログラム
US11562523B1 (en) 2021-08-02 2023-01-24 Electronic Arts Inc. Enhanced animation generation based on motion matching using local bone phases
CN114220054B (zh) * 2021-12-15 2023-04-18 北京中科智易科技股份有限公司 基于装备总线数据分析装备战术动作并同步展示的方法
WO2024123984A1 (fr) * 2022-12-07 2024-06-13 The Regents Of The University Of California Logique de commande simple pour l'exécution distribuée de modèles d'apprentissage profond

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016157152A1 (fr) * 2015-04-03 2016-10-06 Mas-Tech S.R.L. Système d'analyse automatisée d'un match de sport

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8617008B2 (en) * 2001-09-12 2013-12-31 Pillar Vision, Inc. Training devices for trajectory-based sports
GB0218982D0 (en) * 2002-08-15 2002-09-25 Roke Manor Research Video motion anomaly detector
CN101344965A (zh) * 2008-09-04 2009-01-14 上海交通大学 基于双目摄像的跟踪系统
US20120316843A1 (en) * 2011-06-08 2012-12-13 Cobra Golf Incorporated Systems and methods for communicating sports-related information
JP6120837B2 (ja) 2011-06-27 2017-04-26 スウィング・プロファイル・リミテッド スポーツ動作のビデオを解析する方法
US20130266174A1 (en) * 2012-04-06 2013-10-10 Omek Interactive, Ltd. System and method for enhanced object tracking
CN105324275B (zh) * 2013-05-31 2017-06-20 丰田自动车株式会社 移动轨迹预测装置和移动轨迹预测方法
US9346167B2 (en) * 2014-04-29 2016-05-24 Brain Corporation Trainable convolutional network apparatus and methods for operating a robotic vehicle
CN106462747B (zh) * 2014-06-17 2020-03-17 河谷控股Ip有限责任公司 活动识别系统和方法
WO2016025887A2 (fr) 2014-08-14 2016-02-18 University Of North Dakota Prédiction de paramètres de vol à l'aide de réseaux neuronaux
US10062033B2 (en) * 2014-09-26 2018-08-28 Disney Enterprises, Inc. Analysis of team behaviors using role and formation information
WO2016054729A1 (fr) * 2014-10-10 2016-04-14 Livebarn Inc. Système et procédé de suivi optique de joueurs dans des lieux de sport
US9449230B2 (en) * 2014-11-26 2016-09-20 Zepp Labs, Inc. Fast object tracking framework for sports video recognition
US10572735B2 (en) * 2015-03-31 2020-02-25 Beijing Shunyuan Kaihua Technology Limited Detect sports video highlights for mobile computing devices
JP6421683B2 (ja) * 2015-04-14 2018-11-14 トヨタ自動車株式会社 最適制御装置、最適制御方法及び最適制御プログラム
US10115032B2 (en) * 2015-11-04 2018-10-30 Nec Corporation Universal correspondence network
US9864912B2 (en) * 2016-03-30 2018-01-09 Nec Corporation Large margin high-order deep learning with auxiliary tasks for video-based anomaly detection
US10229322B2 (en) * 2017-04-06 2019-03-12 Ants Technology (Hk) Limited Apparatus, methods and computer products for video analytics

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016157152A1 (fr) * 2015-04-03 2016-10-06 Mas-Tech S.R.L. Système d'analyse automatisée d'un match de sport

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
FELSEN PANNA ET AL: "What will Happen Next? Forecasting Player Moves in Sports Videos", 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), IEEE, 22 October 2017 (2017-10-22), pages 3362 - 3371, XP033283205, DOI: 10.1109/ICCV.2017.362 *
HASAN MAHMUDUL ET AL: "Learning Temporal Regularity in Video Sequences", 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), IEEE, 27 June 2016 (2016-06-27), pages 733 - 742, XP033021250, DOI: 10.1109/CVPR.2016.86 *
IVANOVIC BORIS ET AL: "Generative Modeling of Multimodal Multi-Human Behavior", 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), IEEE, 1 October 2018 (2018-10-01), pages 3088 - 3095, XP033491662, DOI: 10.1109/IROS.2018.8594393 *
KUAN-CHIEH WANG ET AL: "Classifying NBA Offensive Plays Using Neural Networks", RESEARCH PAPERS COMPETITION, MIT SLOAN SPORTS ANALYTICS CONFERENCE MARCH 11-12 2016, 1 January 2016 (2016-01-01), XP055753921, Retrieved from the Internet <URL:http://www.cs.toronto.edu/~zemel/documents/1536-Classifying-NBA-Offensive-Plays-Using-Neural-Networks.pdf> [retrieved on 20201125] *
LIU HAILONG ET AL: "Visualization of driving behavior using deep sparse autoencoder", 2014 IEEE INTELLIGENT VEHICLES SYMPOSIUM PROCEEDINGS, IEEE, 8 June 2014 (2014-06-08), pages 1427 - 1434, XP032620298, DOI: 10.1109/IVS.2014.6856506 *
MARK HARMON ET AL: "Predicting Shot Making in Basketball using Convolutional Neural Networks Learnt from Adversarial Multiagent Trajectories", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 15 September 2016 (2016-09-15), XP080727023 *
See also references of WO2018191192A1 *
STEPHAN ZHENG ET AL: "Generating Long-term Trajectories Using Deep Hierarchical Networks", NIPS'16: PROCEEDINGS OF THE 30TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING SYSTEMS, 5 December 2016 (2016-12-05), pages 1551 - 1559, XP055753910, Retrieved from the Internet <URL:https://dl.acm.org/doi/pdf/10.5555/3157096.3157270> [retrieved on 20201125] *

Also Published As

Publication number Publication date
WO2018191192A1 (fr) 2018-10-18
EP3610458A1 (fr) 2020-02-19
CN110462684A (zh) 2019-11-15
CN110462684B (zh) 2023-08-01
US20180293736A1 (en) 2018-10-11
US11069069B2 (en) 2021-07-20

Similar Documents

Publication Publication Date Title
EP3610458A4 (fr) Système de prédiction de mouvements d&#39;un objet d&#39;intérêt avec un codeur automatique
EP3591429A4 (fr) Système de détermination d&#39;emplacement
EP3443485A4 (fr) Systèmes et procédés pour la détermination de point d&#39;intérêt
EP3420254A4 (fr) Systèmes et procédés de diagnostics prédictifs destiné aux systèmes mécaniques
EP3253282A4 (fr) Procédé et système d&#39;interaction avec un environnement
EP3304050A4 (fr) Systèmes d&#39;analyse d&#39;images et procédés associés
EP3583544A4 (fr) Systèmes d&#39;analyse d&#39;images et procédés associés
GB201609640D0 (en) Radar system for the detection of drones
EP3119325A4 (fr) Systèmes et procédés de commande d&#39;orientation de l&#39;instrument d&#39;imagerie
EP3279749A4 (fr) Système de surveillance d&#39;environnement
EP3402384A4 (fr) Systèmes et procédés de détermination de la distance par rapport à un objet
EP3285635A4 (fr) Systèmes et procédés de détermination de distance par rapport à un objet
EP3732463A4 (fr) Détermination de caractéristiques structurales d&#39;un objet
EP3669246A4 (fr) Détection du mouvement d&#39;un véhicule autonome à l&#39;aide d&#39;une technologie radar
EP3439558A4 (fr) Système pour permettre une poursuite sans repère de trace de sonde
EP3574343A4 (fr) Système de détection d&#39;objet
EP3440447A4 (fr) Système de test mécanique compensé
EP3155878A4 (fr) Systèmes et procédés d&#39;éclairage d&#39;un environnement
EP3304522B8 (fr) Système de création d&#39;un environnement
EP3685117B8 (fr) Procédé permettant de déterminer le déplacement d&#39;un objet dans l&#39;espace
EP3403104A4 (fr) Systèmes de sonde blindés
EP3639097A4 (fr) Essais en nuage de systèmes de commande
EP3532364A4 (fr) Systèmes d&#39;automobile pour le déplacement de composants d&#39;automobile
EP3262593A4 (fr) Détermination de zones d&#39;intérêt à un emplacement de lieu d&#39;un événement
EP3216208A4 (fr) Systèmes et procédés d&#39;images à grande gamme dynamique

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20191011

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20201203

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/246 20170101ALI20201127BHEP

Ipc: G06K 9/00 20060101ALI20201127BHEP

Ipc: G06T 7/20 20170101AFI20201127BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230228

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230525