JP7521602B2 - 情報処理装置、情報処理方法およびプログラム - Google Patents

情報処理装置、情報処理方法およびプログラム Download PDF

Info

Publication number
JP7521602B2
JP7521602B2 JP2022568034A JP2022568034A JP7521602B2 JP 7521602 B2 JP7521602 B2 JP 7521602B2 JP 2022568034 A JP2022568034 A JP 2022568034A JP 2022568034 A JP2022568034 A JP 2022568034A JP 7521602 B2 JP7521602 B2 JP 7521602B2
Authority
JP
Japan
Prior art keywords
feature amount
data
information processing
motion data
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022568034A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2022123800A1 (https=
Inventor
敬太 望月
佑樹 田中
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Sony Group Corp
Original Assignee
Sony Corp
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp, Sony Group Corp filed Critical Sony Corp
Publication of JPWO2022123800A1 publication Critical patent/JPWO2022123800A1/ja
Priority to JP2024111415A priority Critical patent/JP7747131B2/ja
Application granted granted Critical
Publication of JP7521602B2 publication Critical patent/JP7521602B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/732—Query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Library & Information Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Biophysics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Dentistry (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physiology (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Psychiatry (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
JP2022568034A 2020-12-08 2021-02-19 情報処理装置、情報処理方法およびプログラム Active JP7521602B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024111415A JP7747131B2 (ja) 2020-12-08 2024-07-11 情報処理装置、情報処理方法およびプログラム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063122509P 2020-12-08 2020-12-08
US63/122,509 2020-12-08
PCT/JP2021/006290 WO2022123800A1 (ja) 2020-12-08 2021-02-19 情報処理装置、情報処理方法およびプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024111415A Division JP7747131B2 (ja) 2020-12-08 2024-07-11 情報処理装置、情報処理方法およびプログラム

Publications (2)

Publication Number Publication Date
JPWO2022123800A1 JPWO2022123800A1 (https=) 2022-06-16
JP7521602B2 true JP7521602B2 (ja) 2024-07-24

Family

ID=81974333

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022568034A Active JP7521602B2 (ja) 2020-12-08 2021-02-19 情報処理装置、情報処理方法およびプログラム
JP2024111415A Active JP7747131B2 (ja) 2020-12-08 2024-07-11 情報処理装置、情報処理方法およびプログラム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024111415A Active JP7747131B2 (ja) 2020-12-08 2024-07-11 情報処理装置、情報処理方法およびプログラム

Country Status (6)

Country Link
US (1) US20240013410A1 (https=)
EP (1) EP4261709A4 (https=)
JP (2) JP7521602B2 (https=)
KR (1) KR20230112636A (https=)
CN (1) CN116528759A (https=)
WO (1) WO2022123800A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240280687A1 (en) * 2021-06-28 2024-08-22 Google Llc System and method for motion capture
WO2024122203A1 (ja) * 2022-12-07 2024-06-13 ソニーグループ株式会社 情報処理装置、および情報処理方法
TWI900829B (zh) * 2023-03-07 2025-10-11 緯創資通股份有限公司 識別方法及無線動作捕捉系統
JP2024154850A (ja) * 2023-04-20 2024-10-31 グリー株式会社 情報処理システム、情報処理方法、及びプログラム

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010033163A (ja) 2008-07-25 2010-02-12 Kddi Corp 動きデータ検索装置及びコンピュータプログラム

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69421404T2 (de) * 1994-12-30 2000-02-10 Daewoo Electronics Co., Ltd. Blockübereinstimmungsbewegungsauswertung mit einer gewichteten Funktion
US6414684B1 (en) * 1996-04-25 2002-07-02 Matsushita Electric Industrial Co., Ltd. Method for communicating and generating computer graphics animation data, and recording media
JP2953413B2 (ja) * 1996-12-09 1999-09-27 日本電気株式会社 動作修正方法および動作修正装置
US8542928B2 (en) * 2005-09-26 2013-09-24 Canon Kabushiki Kaisha Information processing apparatus and control method therefor
CN101515371B (zh) * 2009-03-26 2011-01-19 浙江大学 人体运动数据片段提取方法
US8751191B2 (en) * 2009-12-22 2014-06-10 Panasonic Corporation Action analysis device and action analysis method
US8928672B2 (en) 2010-04-28 2015-01-06 Mixamo, Inc. Real-time automatic concatenation of 3D animation sequences
JP2015011480A (ja) * 2013-06-27 2015-01-19 カシオ計算機株式会社 画像生成装置、画像生成方法及びプログラム
KR101765208B1 (ko) * 2014-01-07 2017-08-04 한국전자통신연구원 시간 및 자세 제약 조건 아래에서 무용 동작을 생성하는 방법 및 장치
KR102013577B1 (ko) * 2015-09-14 2019-08-23 한국전자통신연구원 안무 구상 지원 장치 및 방법
US10019629B2 (en) * 2016-05-31 2018-07-10 Microsoft Technology Licensing, Llc Skeleton-based action detection using recurrent neural network
US10368087B2 (en) * 2016-09-20 2019-07-30 Ati Technologies Ulc Dynamic reload of video encoder motion estimation search window under performance/power constraints
EP3730196A4 (en) * 2017-12-19 2021-06-09 Sony Corporation INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND PROGRAM
WO2019203188A1 (ja) * 2018-04-17 2019-10-24 ソニー株式会社 プログラム、情報処理装置、及び情報処理方法
WO2019243899A1 (en) * 2018-06-18 2019-12-26 Unity IPR ApS Method and system for real-time animation generation using machine learning
JP7262937B2 (ja) * 2018-06-29 2023-04-24 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
KR102543650B1 (ko) * 2018-07-30 2023-06-15 주식회사 엔씨소프트 모션 합성 장치 및 모션 합성 방법
CN111444889B (zh) * 2020-04-30 2023-07-25 南京大学 基于多级条件影响的卷积神经网络的细粒度动作检测方法
WO2022249278A1 (ja) * 2021-05-25 2022-12-01 日本電気株式会社 画像処理装置、画像処理方法、およびプログラム

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010033163A (ja) 2008-07-25 2010-02-12 Kddi Corp 動きデータ検索装置及びコンピュータプログラム

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
XIAO, Qinkun et al.，Human Motion Retrieval Based on Deep Learning and Dynamic Time Warping，2017 2nd International Conference on Robotics and Automation Engineering (ICRAE)，IEEE，2017年12月31日，pp.426-430
石川知一ほか，キーモーションの入力によるモーションキャプチャデータの検索手法，情報処理学会研究報告 ２０１２（平成２４）年度▲３▼ ［ＣＤ－ＲＯＭ］，一般社団法人情報処理学会，2012年，Vol.2012-CG-148, No.10，pp.1-6
高原健輔ほか，特徴ベクトルの簡略離散表現によるモーション検索高速化手法，インタラクション２０１５論文集 ［ｏｎｌｉｎｅ］，一般社団法人 情報処理学会，2015年02月26日，ｐｐ．３９０－３９５，[検索日:2017.06.30], Internet<URL:http://www.interaction-ipsj.org/proceedings/2015/data/20150226/A62.pdf>

Also Published As

Publication number Publication date
WO2022123800A1 (ja) 2022-06-16
JP7747131B2 (ja) 2025-10-01
CN116528759A (zh) 2023-08-01
KR20230112636A (ko) 2023-07-27
EP4261709A4 (en) 2024-04-24
EP4261709A1 (en) 2023-10-18
US20240013410A1 (en) 2024-01-11
JPWO2022123800A1 (https=) 2022-06-16
JP2024133181A (ja) 2024-10-01

Similar Documents

Publication Publication Date Title
JP7521602B2 (ja) 情報処理装置、情報処理方法およびプログラム
US11586276B2 (en) Systems and methods for generating complementary data for visual display
US11006856B2 (en) Method and program product for multi-joint tracking combining embedded sensors and an external sensor
Alexiadis et al. Evaluating a dancer's performance using kinect-based skeleton tracking
Kitsikidis et al. Multi-sensor technology and fuzzy logic for dancer’s motion analysis and performance evaluation within a 3D virtual environment
JP2019136493A (ja) 運動の採点方法、システム及びプログラム
Tisserand et al. Preservation and gamification of traditional sports
CN120766357A (zh) 基于动态时间规整的舞蹈动作识别方法
KR102342760B1 (ko) 인공지능 기반의 골프 영상 학습장치, 그 방법 및 그 기록매체
US20250258537A1 (en) Information processing apparatus, information processing method, and program
WO2022196059A1 (ja) 情報処理装置、情報処理方法およびプログラム
JP7482471B2 (ja) 学習モデルの生成方法
Kaur et al. Human Activity Recognition
Brownridge Real-time motion capture for analysis and presentation within virtual environments
WO2024105991A1 (en) Information processing apparatus, information processing method, and program
KR102840983B1 (ko) 인공지능 기반의 마커리스 자세 추정 방식을 이용하는 골프 레슨 시스템
US20260044202A1 (en) Information processing device, information processing method, and program
Huang et al. Interactive demonstration of pointing gestures for virtual trainers
CN120766356A (zh) 基于动态时间规整的动作纠正方法
JP2024063331A (ja) 動作解析装置
WO2025084119A1 (ja) 学習装置、操作情報変換装置及び学習方法
JP2024151762A (ja) スイング解析装置、方法及びプログラム
CN119998841A (zh) 信息处理装置、信息处理方法和程序
CN119597149A (zh) 用户交互方法、装置、设备、存储介质及程序产品
CN119810268A (zh) 姿态过渡动画生成方法、装置、电子设备和存储介质

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240109

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240319

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240520

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240611

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240624

R150 Certificate of patent or registration of utility model

Ref document number: 7521602

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150