KR102907878B1 - 암시적 포즈 표현을 이용한 행동 인식 - Google Patents

암시적 포즈 표현을 이용한 행동 인식

Info

Publication number
KR102907878B1
KR102907878B1 KR1020200115685A KR20200115685A KR102907878B1 KR 102907878 B1 KR102907878 B1 KR 102907878B1 KR 1020200115685 A KR1020200115685 A KR 1020200115685A KR 20200115685 A KR20200115685 A KR 20200115685A KR 102907878 B1 KR102907878 B1 KR 102907878B1
Authority
KR
South Korea
Prior art keywords
pose
image
implicit
human
neural network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020200115685A
Other languages
English (en)
Korean (ko)
Other versions
KR20210031405A (ko
Inventor
웨인재펠 필립
로게즈 그레고리
Original Assignee
네이버 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 네이버 주식회사 filed Critical 네이버 주식회사
Publication of KR20210031405A publication Critical patent/KR20210031405A/ko
Application granted granted Critical
Publication of KR102907878B1 publication Critical patent/KR102907878B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2431—Multiple classes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/469—Contour-based spatial representations, e.g. vector-coding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images
    • G06V2201/033—Recognition of patterns in medical or anatomical images of skeletal patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Image Analysis (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
KR1020200115685A 2019-09-11 2020-09-09 암시적 포즈 표현을 이용한 행동 인식 Active KR102907878B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP19306098.5 2019-09-11
EP19306098.5A EP3792821B1 (en) 2019-09-11 2019-09-11 Action recognition using implicit pose representations
US16/903,527 2020-06-17
US16/903,527 US11625953B2 (en) 2019-09-11 2020-06-17 Action recognition using implicit pose representations

Publications (2)

Publication Number Publication Date
KR20210031405A KR20210031405A (ko) 2021-03-19
KR102907878B1 true KR102907878B1 (ko) 2026-01-05

Family

ID=68062880

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020200115685A Active KR102907878B1 (ko) 2019-09-11 2020-09-09 암시적 포즈 표현을 이용한 행동 인식

Country Status (4)

Country Link
US (2) US11625953B2 (https=)
EP (2) EP4492337A3 (https=)
JP (1) JP7696703B2 (https=)
KR (1) KR102907878B1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11288498B2 (en) * 2019-09-19 2022-03-29 Hrl Laboratories, Llc Learning actions with few labels in the embedded space
US20210213977A1 (en) * 2020-01-14 2021-07-15 Allstate Insurance Company Nearby Driver Intent Determining Autonomous Driving System
WO2021189145A1 (en) * 2020-03-27 2021-09-30 Sportlogiq Inc. System and method for group activity recognition in images and videos with self-attention mechanisms
US11816678B2 (en) * 2020-06-26 2023-11-14 Capital One Services, Llc Systems and methods for providing user emotion information to a customer service provider
US20220138536A1 (en) * 2020-10-29 2022-05-05 Hong Kong Applied Science And Technology Research Institute Co., Ltd Actional-structural self-attention graph convolutional network for action recognition
US20220164569A1 (en) * 2020-11-26 2022-05-26 POSTECH Research and Business Development Foundation Action recognition method and apparatus based on spatio-temporal self-attention
US11216656B1 (en) * 2020-12-16 2022-01-04 Retrocausal, Inc. System and method for management and evaluation of one or more human activities
CN113343764A (zh) * 2021-05-10 2021-09-03 武汉理工大学 一种基于级联式网络架构的驾驶员分心检测方法及系统
US11941080B2 (en) * 2021-05-20 2024-03-26 Retrocausal, Inc. System and method for learning human activities from video demonstrations using video augmentation
CN113205595B (zh) * 2021-05-21 2022-03-29 华中科技大学 一种3d人体姿态估计模型的构建方法及其应用
US12206851B2 (en) * 2021-05-21 2025-01-21 Qualcomm Incorporated Implicit image and video compression using machine learning systems
CN115439922A (zh) * 2021-06-01 2022-12-06 腾讯科技（深圳）有限公司 对象行为识别方法、装置、设备及介质
CN113920577B (zh) * 2021-08-06 2024-11-12 南京邮电大学 一种室内非接触式人体活动识别方法及系统
CN114092963B (zh) * 2021-10-14 2023-09-22 北京百度网讯科技有限公司 关键点检测及模型训练方法、装置、设备和存储介质
CN114161417A (zh) * 2021-12-07 2022-03-11 东莞市易联交互信息科技有限责任公司 一种机器人的动作控制方法和系统
CN114399838B (zh) * 2022-01-18 2025-04-04 深圳市广联智通科技有限公司 基于姿态估计和二重分类的多人行为识别方法及系统
US12165258B2 (en) * 2022-03-10 2024-12-10 Nvidia Corporation Action-conditional implicit dynamics of deformable objects
CN114663593B (zh) * 2022-03-25 2023-04-07 清华大学 三维人体姿态估计方法、装置、设备及存储介质
WO2023212390A1 (en) * 2022-04-29 2023-11-02 University Of Southern California Neural network methods
KR102816761B1 (ko) * 2022-05-04 2025-06-05 동국대학교 산학협력단 레이더를 이용한 행동 인식 딥러닝 모델, 및 이를 포함하는 행동 인식 시스템
US12307756B2 (en) * 2022-05-12 2025-05-20 Samsung Electronics Co., Ltd. Fast object detection in video via scale separation
CN117456596A (zh) * 2022-07-15 2024-01-26 北京字跳网络技术有限公司 手势估计网络处理方法、装置、设备及介质
CN115240141B (zh) * 2022-07-21 2025-10-28 北京交通大学 城轨车站乘客异常行为辨识方法及系统
CN115205767A (zh) * 2022-09-16 2022-10-18 浪潮通信信息系统有限公司 一种抽烟行为检测方法、系统及装置
US20240110825A1 (en) * 2022-09-30 2024-04-04 Robert Bosch Gmbh System and method for a model for prediction of sound perception using accelerometer data
CN116434279B (zh) * 2023-04-24 2026-02-06 摩尔线程智能科技(北京)股份有限公司 手势的检测方法、装置、电子设备及存储介质
KR20240174582A (ko) * 2023-06-09 2024-12-17 에스케이텔레콤 주식회사 노이즈 골격 시퀀스 기반 행동 인식을 위한 장치 및 방법
CN116665312B (zh) * 2023-08-02 2023-10-31 烟台大学 一种基于多尺度图卷积神经网络的人机协作方法
US20250086100A1 (en) * 2023-09-12 2025-03-13 Tusimple, Inc. Autonomous vehicle driving data
CN119150082B (zh) * 2024-11-18 2025-02-18 深圳市轩宇车鼎科技有限公司 汽车ecu修复仪数据处理方法及装置
CN120088442B (zh) * 2025-05-06 2025-07-11 西北工业大学 基于物理规律和骨骼引导的细粒度人体动作生成方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090028403A1 (en) * 2006-03-03 2009-01-29 Medic Vision - Brain Technologies Ltd. System and Method of Automatic Prioritization and Analysis of Medical Images
US20190176820A1 (en) * 2017-12-13 2019-06-13 Humanising Autonomy Limited Systems and methods for predicting pedestrian intent
CN110188599A (zh) * 2019-04-12 2019-08-30 哈工大机器人义乌人工智能研究院 一种人体姿态行为智能分析识别方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009134600A (ja) 2007-11-30 2009-06-18 Toshiba Corp 行動識別装置、行動識別方法および行動識別プログラム
DE102014207802B3 (de) * 2014-04-25 2015-10-29 Bayerische Motoren Werke Aktiengesellschaft Verfahren und System zum proaktiven Erkennen einer Aktion eines Verkehrsteilnehmers
US9424458B1 (en) * 2015-02-06 2016-08-23 Hoyos Labs Ip Ltd. Systems and methods for performing fingerprint based user authentication using imagery captured using mobile devices
US10242266B2 (en) * 2016-03-02 2019-03-26 Mitsubishi Electric Research Laboratories, Inc. Method and system for detecting actions in videos
US20170316578A1 (en) * 2016-04-29 2017-11-02 Ecole Polytechnique Federale De Lausanne (Epfl) Method, System and Device for Direct Prediction of 3D Body Poses from Motion Compensated Sequence
US10726313B2 (en) 2018-04-19 2020-07-28 Adobe Inc. Active learning method for temporal action localization in untrimmed videos

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090028403A1 (en) * 2006-03-03 2009-01-29 Medic Vision - Brain Technologies Ltd. System and Method of Automatic Prioritization and Analysis of Medical Images
US20190176820A1 (en) * 2017-12-13 2019-06-13 Humanising Autonomy Limited Systems and methods for predicting pedestrian intent
CN110188599A (zh) * 2019-04-12 2019-08-30 哈工大机器人义乌人工智能研究院 一种人体姿态行为智能分析识别方法

Also Published As

Publication number Publication date
KR20210031405A (ko) 2021-03-19
EP3792821A1 (en) 2021-03-17
EP4492337A3 (en) 2025-03-05
JP7696703B2 (ja) 2025-06-23
US11625953B2 (en) 2023-04-11
EP3792821B1 (en) 2024-11-27
US20230215160A1 (en) 2023-07-06
EP4492337A2 (en) 2025-01-15
US20210073525A1 (en) 2021-03-11
JP2021043974A (ja) 2021-03-18
US12165401B2 (en) 2024-12-10

Similar Documents

Publication Publication Date Title
KR102907878B1 (ko) 암시적 포즈 표현을 이용한 행동 인식
Felsberg et al. The thermal infrared visual object tracking VOT-TIR2015 challenge results
JP6333844B2 (ja) 機械学習用リソース割り当て
Yu et al. Image based static facial expression recognition with multiple deep network learning
CN109426805B (zh) 用于对象检测的方法、设备和计算机程序产品
WO2021120157A1 (en) Light weight multi-branch and multi-scale person re-identification
WO2021042547A1 (zh) 行为识别方法、装置及计算机可读存储介质
US9846845B2 (en) Hierarchical model for human activity recognition
US9183431B2 (en) Apparatus and method for providing activity recognition based application service
Le Deep learning-based for human segmentation and tracking, 3D human pose estimation and action recognition on monocular video of MADS dataset
US20120239174A1 (en) Predicting Joint Positions
CN112883896A (zh) 一种基于bert网络的微表情检测方法
Dubuisson et al. A survey of datasets for visual tracking
CN112036339B (zh) 人脸检测的方法、装置和电子设备
CN110516572B (zh) 一种识别体育赛事视频片段的方法、电子设备及存储介质
US20240303848A1 (en) Electronic device and method for determining human height using neural networks
US20220122341A1 (en) Target detection method and apparatus, electronic device, and computer storage medium
Dalva et al. Benchmarking the robustness of instance segmentation models
CN107995442A (zh) 视频数据的处理方法、装置及计算设备
CN109146969A (zh) 行人定位方法、装置及处理设备及其存储介质
CN119360370A (zh) 基于自监督任务扩散模型的视频息肉分割系统及方法
KR20240019030A (ko) 시선 방향을 검출하는 딥러닝 기반의 시선 방향 검출 모델을 학습하는 학습 방법 및 학습 장치, 이를 이용한 테스트 방법 및 테스트 장치
CN116168439A (zh) 一种轻量级唇语识别方法及相关设备
Zhou Computational Analysis of Table Tennis Games from Real-Time Videos Using Deep Learning
CN114550298A (zh) 短视频的动作识别方法及系统

Legal Events

Date Code Title Description
PA0109 Patent application

St.27 status event code: A-0-1-A10-A12-nap-PA0109

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D22-EXM-PE0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

F11 Ip right granted following substantive examination

Free format text: ST27 STATUS EVENT CODE: A-2-4-F10-F11-EXM-PR0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U11-oth-PR1002

Fee payment year number: 1

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-OTH-PR1002 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

Q13 Ip right document published

Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q13-NAP-PG1601 (AS PROVIDED BY THE NATIONAL OFFICE)