JP7146247B2 - 動作認識方法及び装置 - Google Patents

動作認識方法及び装置 Download PDF

Info

Publication number
JP7146247B2
JP7146247B2 JP2018164554A JP2018164554A JP7146247B2 JP 7146247 B2 JP7146247 B2 JP 7146247B2 JP 2018164554 A JP2018164554 A JP 2018164554A JP 2018164554 A JP2018164554 A JP 2018164554A JP 7146247 B2 JP7146247 B2 JP 7146247B2
Authority
JP
Japan
Prior art keywords
motion
basic
target
score
segments
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018164554A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020038440A (ja
JP2020038440A5 (enExample
Inventor
仁彦 中村
渉 高野
洋介 池上
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
The University of Tokyo
Original Assignee
The University of Tokyo
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The University of Tokyo filed Critical The University of Tokyo
Priority to JP2018164554A priority Critical patent/JP7146247B2/ja
Priority to PCT/JP2019/033662 priority patent/WO2020050111A1/ja
Priority to US17/273,148 priority patent/US12045994B2/en
Publication of JP2020038440A publication Critical patent/JP2020038440A/ja
Publication of JP2020038440A5 publication Critical patent/JP2020038440A5/ja
Application granted granted Critical
Publication of JP7146247B2 publication Critical patent/JP7146247B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/215—Motion-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/29—Graphical models, e.g. Bayesian networks
    • G06F18/295—Markov models or related models, e.g. semi-Markov models; Markov random fields; Networks embedding Markov models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N99/00—Subject matter not provided for in other groups of this subclass
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/143—Segmentation; Edge detection involving probabilistic approaches, e.g. Markov random field [MRF] modelling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/84—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using probabilistic graphical models from image or video features, e.g. Markov models or Bayesian networks
    • G06V10/85—Markov-related models; Markov random fields
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Probability & Statistics with Applications (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Algebra (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
JP2018164554A 2018-09-03 2018-09-03 動作認識方法及び装置 Active JP7146247B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2018164554A JP7146247B2 (ja) 2018-09-03 2018-09-03 動作認識方法及び装置
PCT/JP2019/033662 WO2020050111A1 (ja) 2018-09-03 2019-08-28 動作認識方法及び装置
US17/273,148 US12045994B2 (en) 2018-09-03 2019-08-28 Motion recognition method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018164554A JP7146247B2 (ja) 2018-09-03 2018-09-03 動作認識方法及び装置

Publications (3)

Publication Number Publication Date
JP2020038440A JP2020038440A (ja) 2020-03-12
JP2020038440A5 JP2020038440A5 (enExample) 2021-09-24
JP7146247B2 true JP7146247B2 (ja) 2022-10-04

Family

ID=69723178

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018164554A Active JP7146247B2 (ja) 2018-09-03 2018-09-03 動作認識方法及び装置

Country Status (3)

Country Link
US (1) US12045994B2 (enExample)
JP (1) JP7146247B2 (enExample)
WO (1) WO2020050111A1 (enExample)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021199392A1 (ja) * 2020-04-02 2021-10-07 日本電信電話株式会社 学習装置、学習方法及び学習プログラム、並びに、スコア推定装置、スコア推定方法及びスコア推定プログラム
WO2021210112A1 (ja) * 2020-04-15 2021-10-21 三菱電機株式会社 動作分析装置、動作分析方法、および、動作分析プログラム
JP7472658B2 (ja) * 2020-06-02 2024-04-23 富士通株式会社 行動区間推定モデル構築装置、行動区間推定モデル構築方法及び行動区間推定モデル構築プログラム
WO2022091304A1 (en) * 2020-10-29 2022-05-05 Nec Corporation Categorization apparatus, control device, categorization method, control method and computer readable medium
JP7521382B2 (ja) * 2020-10-29 2024-07-24 日本電信電話株式会社 行動認識学習装置、行動認識装置、行動認識学習方法、行動認識方法、及び行動認識学習プログラム
JP7016936B1 (ja) 2020-11-25 2022-02-07 日立建機株式会社 動作把握システム
JP7589553B2 (ja) * 2021-01-08 2024-11-26 富士通株式会社 情報処理装置、出力方法、および出力プログラム
EP4258184A4 (en) 2021-01-27 2023-12-27 Fujitsu Limited ACTION SEQUENCE DETERMINATION APPARATUS, ACTION SEQUENCE DETERMINATION METHOD AND ACTION SEQUENCE DETERMINATION PROGRAM
WO2022162780A1 (ja) 2021-01-27 2022-08-04 富士通株式会社 部分行動区間推定モデル構築装置、部分行動区間推定モデル構築方法及び部分行動区間推定モデル構築プログラム
PL4287078T3 (pl) * 2021-01-27 2026-07-20 Fujitsu Limited Urządzenie do budowania modelu do szacowania interwału działania, sposób budowania modelu do szacowania interwału działania oraz program do budowania modelu do szacowania interwału działania
WO2022208859A1 (ja) 2021-04-01 2022-10-06 富士通株式会社 技認識方法、技認識装置および体操採点支援システム
US20240202933A1 (en) * 2021-05-19 2024-06-20 Nippon Telegraph And Telephone Corporation Learning apparatus, estimation apparatus, learning model data generation method, estimation method and program
JP7614504B2 (ja) * 2021-05-20 2025-01-16 富士通株式会社 技認識方法、技認識プログラム及び体操採点支援システム
JP7609302B2 (ja) * 2021-12-10 2025-01-07 富士通株式会社 行動区間評価プログラム、装置、及び方法
JP7677455B2 (ja) * 2021-12-10 2025-05-15 富士通株式会社 行動区間検出プログラム、装置、及び方法
JP2024048120A (ja) * 2022-09-27 2024-04-08 キヤノン株式会社 情報処理装置およびその制御方法
JP7878573B2 (ja) * 2023-04-28 2026-06-23 富士通株式会社 判定方法、判定プログラムおよび情報処理装置
JP7797737B1 (ja) * 2025-08-28 2026-01-13 株式会社WinTicket 映像加工システム、映像加工方法、およびプログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007138885A1 (ja) 2006-05-26 2007-12-06 The University Of Tokyo 運動データのデータベースの構造および設計法、データベースシステム
JP2010213782A (ja) 2009-03-13 2010-09-30 Oki Networks Co Ltd 行動認識方法、装置及びプログラム
WO2018070414A1 (ja) 2016-10-11 2018-04-19 富士通株式会社 運動認識装置、運動認識プログラムおよび運動認識方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3017518A1 (en) * 2016-03-18 2017-09-21 President And Fellows Of Harvard College Automatically classifying animal behavior
CN107945207A (zh) * 2017-11-20 2018-04-20 北京众绘虚拟现实技术研究院有限公司 一种基于视频帧间低秩关联信息一致性的实时物体追踪方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007138885A1 (ja) 2006-05-26 2007-12-06 The University Of Tokyo 運動データのデータベースの構造および設計法、データベースシステム
JP2010213782A (ja) 2009-03-13 2010-09-30 Oki Networks Co Ltd 行動認識方法、装置及びプログラム
WO2018070414A1 (ja) 2016-10-11 2018-04-19 富士通株式会社 運動認識装置、運動認識プログラムおよび運動認識方法

Also Published As

Publication number Publication date
JP2020038440A (ja) 2020-03-12
US12045994B2 (en) 2024-07-23
US20240020853A1 (en) 2024-01-18
WO2020050111A1 (ja) 2020-03-12

Similar Documents

Publication Publication Date Title
US12045994B2 (en) Motion recognition method and device
Kulić et al. Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden markov chains
JP6625220B2 (ja) シーン内のオブジェクトのアクションを検出する方法及びシステム
Barbič et al. Segmenting motion capture data into distinct behaviors
Bouchard et al. Semantic segmentation of motion capture using laban movement analysis
KR101549645B1 (ko) 표정 동작사전을 이용한 표정인식 방법 및 장치
Nikpour et al. Deep reinforcement learning in human activity recognition: A survey and outlook
Patten et al. Dgcm-net: dense geometrical correspondence matching network for incremental experience-based robotic grasping
JP2014137818A (ja) 手の平開閉動作識別方法と装置、マン・マシン・インタラクション方法と設備
Dutta et al. Predicting human actions taking into account object affordances
KR102886014B1 (ko) 텍스트 기반 모션 추천을 이용하는 모션 애니메이팅 및 메쉬 스타일라이제이션 방법 및 장치
Ridge et al. Self-supervised cross-modal online learning of basic object affordances for developmental robotic systems
Yamane et al. Human motion database with a binary tree and node transition graphs
Oh et al. Using binary decision tree and multiclass SVM for human gesture recognition
Harini et al. A novel static and dynamic hand gesture recognition using self organizing map with deep convolutional neural network
Nikpour et al. Deep reinforcement learning in human activity recognition: A survey
Miners et al. Dynamic facial expression recognition using fuzzy hidden Markov models
Axenbeck et al. Recognizing complex, parameterized gestures from monocular image sequences
Panduranga et al. Dynamic hand gesture recognition system: a short survey
Kushwaha et al. Rule based human activity recognition for surveillance system
Li Deep learning of human emotion recognition in videos
Ziaie et al. A novel approach to hand-gesture recognition in a human-robot dialog system
Gutzeit Hierarchical segmentation of human manipulation movements
Singh et al. Recognizing and interpreting sign language gesture for human robot interaction
Ramanathan et al. Mutually reinforcing motion-pose framework for pose invariant action recognition

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210816

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210817

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220712

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220825

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220830

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220913

R150 Certificate of patent or registration of utility model

Ref document number: 7146247

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250