JP7696703B2 - 暗示的ポーズ表現を利用した行動認識 - Google Patents

暗示的ポーズ表現を利用した行動認識 Download PDF

Info

Publication number
JP7696703B2
JP7696703B2 JP2020151934A JP2020151934A JP7696703B2 JP 7696703 B2 JP7696703 B2 JP 7696703B2 JP 2020151934 A JP2020151934 A JP 2020151934A JP 2020151934 A JP2020151934 A JP 2020151934A JP 7696703 B2 JP7696703 B2 JP 7696703B2
Authority
JP
Japan
Prior art keywords
pose
individual
neural network
computer
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020151934A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021043974A5 (https=
JP2021043974A (ja
Inventor
バインザエペル フィリップ
ロジェ グレゴリ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Naver Corp
Original Assignee
Naver Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Naver Corp filed Critical Naver Corp
Publication of JP2021043974A publication Critical patent/JP2021043974A/ja
Publication of JP2021043974A5 publication Critical patent/JP2021043974A5/ja
Application granted granted Critical
Publication of JP7696703B2 publication Critical patent/JP7696703B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2431—Multiple classes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images
    • G06V2201/033—Recognition of patterns in medical or anatomical images of skeletal patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Image Analysis (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
JP2020151934A 2019-09-11 2020-09-10 暗示的ポーズ表現を利用した行動認識 Active JP7696703B2 (ja)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP19306098.5 2019-09-11
EP19306098.5A EP3792821B1 (en) 2019-09-11 2019-09-11 Action recognition using implicit pose representations
US16/903,527 2020-06-17
US16/903,527 US11625953B2 (en) 2019-09-11 2020-06-17 Action recognition using implicit pose representations

Publications (3)

Publication Number Publication Date
JP2021043974A JP2021043974A (ja) 2021-03-18
JP2021043974A5 JP2021043974A5 (https=) 2023-08-29
JP7696703B2 true JP7696703B2 (ja) 2025-06-23

Family

ID=68062880

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020151934A Active JP7696703B2 (ja) 2019-09-11 2020-09-10 暗示的ポーズ表現を利用した行動認識

Country Status (4)

Country Link
US (2) US11625953B2 (https=)
EP (2) EP4492337A3 (https=)
JP (1) JP7696703B2 (https=)
KR (1) KR102907878B1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11288498B2 (en) * 2019-09-19 2022-03-29 Hrl Laboratories, Llc Learning actions with few labels in the embedded space
US20210213977A1 (en) * 2020-01-14 2021-07-15 Allstate Insurance Company Nearby Driver Intent Determining Autonomous Driving System
WO2021189145A1 (en) * 2020-03-27 2021-09-30 Sportlogiq Inc. System and method for group activity recognition in images and videos with self-attention mechanisms
US11816678B2 (en) * 2020-06-26 2023-11-14 Capital One Services, Llc Systems and methods for providing user emotion information to a customer service provider
US20220138536A1 (en) * 2020-10-29 2022-05-05 Hong Kong Applied Science And Technology Research Institute Co., Ltd Actional-structural self-attention graph convolutional network for action recognition
US20220164569A1 (en) * 2020-11-26 2022-05-26 POSTECH Research and Business Development Foundation Action recognition method and apparatus based on spatio-temporal self-attention
US11216656B1 (en) * 2020-12-16 2022-01-04 Retrocausal, Inc. System and method for management and evaluation of one or more human activities
CN113343764A (zh) * 2021-05-10 2021-09-03 武汉理工大学 一种基于级联式网络架构的驾驶员分心检测方法及系统
US11941080B2 (en) * 2021-05-20 2024-03-26 Retrocausal, Inc. System and method for learning human activities from video demonstrations using video augmentation
CN113205595B (zh) * 2021-05-21 2022-03-29 华中科技大学 一种3d人体姿态估计模型的构建方法及其应用
US12206851B2 (en) * 2021-05-21 2025-01-21 Qualcomm Incorporated Implicit image and video compression using machine learning systems
CN115439922A (zh) * 2021-06-01 2022-12-06 腾讯科技（深圳）有限公司 对象行为识别方法、装置、设备及介质
CN113920577B (zh) * 2021-08-06 2024-11-12 南京邮电大学 一种室内非接触式人体活动识别方法及系统
CN114092963B (zh) * 2021-10-14 2023-09-22 北京百度网讯科技有限公司 关键点检测及模型训练方法、装置、设备和存储介质
CN114161417A (zh) * 2021-12-07 2022-03-11 东莞市易联交互信息科技有限责任公司 一种机器人的动作控制方法和系统
CN114399838B (zh) * 2022-01-18 2025-04-04 深圳市广联智通科技有限公司 基于姿态估计和二重分类的多人行为识别方法及系统
US12165258B2 (en) * 2022-03-10 2024-12-10 Nvidia Corporation Action-conditional implicit dynamics of deformable objects
CN114663593B (zh) * 2022-03-25 2023-04-07 清华大学 三维人体姿态估计方法、装置、设备及存储介质
WO2023212390A1 (en) * 2022-04-29 2023-11-02 University Of Southern California Neural network methods
KR102816761B1 (ko) * 2022-05-04 2025-06-05 동국대학교 산학협력단 레이더를 이용한 행동 인식 딥러닝 모델, 및 이를 포함하는 행동 인식 시스템
US12307756B2 (en) * 2022-05-12 2025-05-20 Samsung Electronics Co., Ltd. Fast object detection in video via scale separation
CN117456596A (zh) * 2022-07-15 2024-01-26 北京字跳网络技术有限公司 手势估计网络处理方法、装置、设备及介质
CN115240141B (zh) * 2022-07-21 2025-10-28 北京交通大学 城轨车站乘客异常行为辨识方法及系统
CN115205767A (zh) * 2022-09-16 2022-10-18 浪潮通信信息系统有限公司 一种抽烟行为检测方法、系统及装置
US20240110825A1 (en) * 2022-09-30 2024-04-04 Robert Bosch Gmbh System and method for a model for prediction of sound perception using accelerometer data
CN116434279B (zh) * 2023-04-24 2026-02-06 摩尔线程智能科技(北京)股份有限公司 手势的检测方法、装置、电子设备及存储介质
KR20240174582A (ko) * 2023-06-09 2024-12-17 에스케이텔레콤 주식회사 노이즈 골격 시퀀스 기반 행동 인식을 위한 장치 및 방법
CN116665312B (zh) * 2023-08-02 2023-10-31 烟台大学 一种基于多尺度图卷积神经网络的人机协作方法
US20250086100A1 (en) * 2023-09-12 2025-03-13 Tusimple, Inc. Autonomous vehicle driving data
CN119150082B (zh) * 2024-11-18 2025-02-18 深圳市轩宇车鼎科技有限公司 汽车ecu修复仪数据处理方法及装置
CN120088442B (zh) * 2025-05-06 2025-07-11 西北工业大学 基于物理规律和骨骼引导的细粒度人体动作生成方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009134600A (ja) 2007-11-30 2009-06-18 Toshiba Corp 行動識別装置、行動識別方法および行動識別プログラム
US10726313B2 (en) 2018-04-19 2020-07-28 Adobe Inc. Active learning method for temporal action localization in untrimmed videos

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1996959A4 (en) * 2006-03-03 2012-02-29 Medic Vision Brain Technologies Ltd SYSTEM AND METHOD FOR PRIORITIZE PRIORITIZATION AND AUTOMATIC ANALYSIS OF MEDICAL IMAGES
DE102014207802B3 (de) * 2014-04-25 2015-10-29 Bayerische Motoren Werke Aktiengesellschaft Verfahren und System zum proaktiven Erkennen einer Aktion eines Verkehrsteilnehmers
US9424458B1 (en) * 2015-02-06 2016-08-23 Hoyos Labs Ip Ltd. Systems and methods for performing fingerprint based user authentication using imagery captured using mobile devices
US10242266B2 (en) * 2016-03-02 2019-03-26 Mitsubishi Electric Research Laboratories, Inc. Method and system for detecting actions in videos
US20170316578A1 (en) * 2016-04-29 2017-11-02 Ecole Polytechnique Federale De Lausanne (Epfl) Method, System and Device for Direct Prediction of 3D Body Poses from Motion Compensated Sequence
US10913454B2 (en) * 2017-12-13 2021-02-09 Humanising Autonomy Limited Systems and methods for predicting pedestrian intent
CN110188599A (zh) * 2019-04-12 2019-08-30 哈工大机器人义乌人工智能研究院 一种人体姿态行为智能分析识别方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009134600A (ja) 2007-11-30 2009-06-18 Toshiba Corp 行動識別装置、行動識別方法および行動識別プログラム
US10726313B2 (en) 2018-04-19 2020-07-28 Adobe Inc. Active learning method for temporal action localization in untrimmed videos

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Rui Hou, et al.，Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos，2017 IEEE International Conference on Computer Vision (ICCV)，2017年，https://ieeexplore.ieee.org/document/8237882

Also Published As

Publication number Publication date
KR20210031405A (ko) 2021-03-19
EP3792821A1 (en) 2021-03-17
EP4492337A3 (en) 2025-03-05
KR102907878B1 (ko) 2026-01-05
US11625953B2 (en) 2023-04-11
EP3792821B1 (en) 2024-11-27
US20230215160A1 (en) 2023-07-06
EP4492337A2 (en) 2025-01-15
US20210073525A1 (en) 2021-03-11
JP2021043974A (ja) 2021-03-18
US12165401B2 (en) 2024-12-10

Similar Documents

Publication Publication Date Title
JP7696703B2 (ja) 暗示的ポーズ表現を利用した行動認識
Weinzaepfel et al. Mimetics: Towards understanding human actions out of context
US12076148B2 (en) Systems and methods for automated recognition of bodily expression of emotion
Xu et al. Two-stage temporal modelling framework for video-based depression recognition using graph representation
Zheng et al. Cows' legs tracking and lameness detection in dairy cattle using video analysis and Siamese neural networks
JP6333844B2 (ja) 機械学習用リソース割り当て
CN112106043B (zh) 问题应答装置及方法
CN109426805B (zh) 用于对象检测的方法、设备和计算机程序产品
US9846845B2 (en) Hierarchical model for human activity recognition
Weinzaepfel et al. Human action localization with sparse spatial supervision
WO2021042547A1 (zh) 行为识别方法、装置及计算机可读存储介质
Soomro et al. Online localization and prediction of actions and interactions
US20120239174A1 (en) Predicting Joint Positions
Guyon et al. Results and analysis of the chalearn gesture challenge 2012
Le Deep learning-based for human segmentation and tracking, 3D human pose estimation and action recognition on monocular video of MADS dataset
CN112883896A (zh) 一种基于bert网络的微表情检测方法
CN113743273B (zh) 基于视频图像目标检测的实时跳绳计数方法、装置和设备
JP2021190128A (ja) 全身ポーズを生成するためのシステム
US20240303848A1 (en) Electronic device and method for determining human height using neural networks
Janbi et al. BowlingDL: A deep learning-based bowling players pose estimation and classification
CN114299610A (zh) 一种红外视频中的动作识别方法及系统
Letsch et al. Localizing salient body motion in multi-person scenes using convolutional neural networks
CN117474949A (zh) 运动计数方法、装置、系统、电子设备及存储介质
Li et al. Research on hybrid information recognition algorithm and quality of golf swing
Sun et al. A Real-Time dairy goat tracking based on MixFormer with adaptive token elimination and efficient appearance update

Legal Events

Date Code Title Description
A80 Written request to apply exceptions to lack of novelty of invention

Free format text: JAPANESE INTERMEDIATE CODE: A80

Effective date: 20200925

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230821

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230821

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240515

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240528

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240821

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20241119

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250319

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250513

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250611

R150 Certificate of patent or registration of utility model

Ref document number: 7696703

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150