CN116528759A - 信息处理装置、信息处理方法和程序 - Google Patents

信息处理装置、信息处理方法和程序 Download PDF

Info

Publication number
CN116528759A
CN116528759A CN202180080531.4A CN202180080531A CN116528759A CN 116528759 A CN116528759 A CN 116528759A CN 202180080531 A CN202180080531 A CN 202180080531A CN 116528759 A CN116528759 A CN 116528759A
Authority
CN
China
Prior art keywords
data
feature amount
information processing
time
motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180080531.4A
Other languages
English (en)
Chinese (zh)
Inventor
望月敬太
田中佑树
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Publication of CN116528759A publication Critical patent/CN116528759A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/732—Query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Library & Information Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Biophysics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Dentistry (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physiology (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Psychiatry (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
CN202180080531.4A 2020-12-08 2021-02-19 信息处理装置、信息处理方法和程序 Pending CN116528759A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063122509P 2020-12-08 2020-12-08
US63/122,509 2020-12-08
PCT/JP2021/006290 WO2022123800A1 (ja) 2020-12-08 2021-02-19 情報処理装置、情報処理方法およびプログラム

Publications (1)

Publication Number Publication Date
CN116528759A true CN116528759A (zh) 2023-08-01

Family

ID=81974333

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180080531.4A Pending CN116528759A (zh) 2020-12-08 2021-02-19 信息处理装置、信息处理方法和程序

Country Status (6)

Country Link
US (1) US20240013410A1 (https=)
EP (1) EP4261709A4 (https=)
JP (2) JP7521602B2 (https=)
KR (1) KR20230112636A (https=)
CN (1) CN116528759A (https=)
WO (1) WO2022123800A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240280687A1 (en) * 2021-06-28 2024-08-22 Google Llc System and method for motion capture
WO2024122203A1 (ja) * 2022-12-07 2024-06-13 ソニーグループ株式会社 情報処理装置、および情報処理方法
TWI900829B (zh) * 2023-03-07 2025-10-11 緯創資通股份有限公司 識別方法及無線動作捕捉系統
JP2024154850A (ja) * 2023-04-20 2024-10-31 グリー株式会社 情報処理システム、情報処理方法、及びプログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070122036A1 (en) * 2005-09-26 2007-05-31 Yuji Kaneda Information processing apparatus and control method therefor
CN101515371A (zh) * 2009-03-26 2009-08-26 浙江大学 人体运动数据片段提取方法
JP2010033163A (ja) * 2008-07-25 2010-02-12 Kddi Corp 動きデータ検索装置及びコンピュータプログラム
CN111315453A (zh) * 2017-12-19 2020-06-19 索尼公司 信息处理设备、信息处理方法及程序
CN111444889A (zh) * 2020-04-30 2020-07-24 南京大学 基于多级条件影响的卷积神经网络的细粒度动作检测方法

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69421404T2 (de) * 1994-12-30 2000-02-10 Daewoo Electronics Co., Ltd. Blockübereinstimmungsbewegungsauswertung mit einer gewichteten Funktion
US6414684B1 (en) * 1996-04-25 2002-07-02 Matsushita Electric Industrial Co., Ltd. Method for communicating and generating computer graphics animation data, and recording media
JP2953413B2 (ja) * 1996-12-09 1999-09-27 日本電気株式会社 動作修正方法および動作修正装置
US8751191B2 (en) * 2009-12-22 2014-06-10 Panasonic Corporation Action analysis device and action analysis method
US8928672B2 (en) 2010-04-28 2015-01-06 Mixamo, Inc. Real-time automatic concatenation of 3D animation sequences
JP2015011480A (ja) * 2013-06-27 2015-01-19 カシオ計算機株式会社 画像生成装置、画像生成方法及びプログラム
KR101765208B1 (ko) * 2014-01-07 2017-08-04 한국전자통신연구원 시간 및 자세 제약 조건 아래에서 무용 동작을 생성하는 방법 및 장치
KR102013577B1 (ko) * 2015-09-14 2019-08-23 한국전자통신연구원 안무 구상 지원 장치 및 방법
US10019629B2 (en) * 2016-05-31 2018-07-10 Microsoft Technology Licensing, Llc Skeleton-based action detection using recurrent neural network
US10368087B2 (en) * 2016-09-20 2019-07-30 Ati Technologies Ulc Dynamic reload of video encoder motion estimation search window under performance/power constraints
WO2019203188A1 (ja) * 2018-04-17 2019-10-24 ソニー株式会社 プログラム、情報処理装置、及び情報処理方法
WO2019243899A1 (en) * 2018-06-18 2019-12-26 Unity IPR ApS Method and system for real-time animation generation using machine learning
JP7262937B2 (ja) * 2018-06-29 2023-04-24 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
KR102543650B1 (ko) * 2018-07-30 2023-06-15 주식회사 엔씨소프트 모션 합성 장치 및 모션 합성 방법
WO2022249278A1 (ja) * 2021-05-25 2022-12-01 日本電気株式会社 画像処理装置、画像処理方法、およびプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070122036A1 (en) * 2005-09-26 2007-05-31 Yuji Kaneda Information processing apparatus and control method therefor
JP2010033163A (ja) * 2008-07-25 2010-02-12 Kddi Corp 動きデータ検索装置及びコンピュータプログラム
CN101515371A (zh) * 2009-03-26 2009-08-26 浙江大学 人体运动数据片段提取方法
CN111315453A (zh) * 2017-12-19 2020-06-19 索尼公司 信息处理设备、信息处理方法及程序
CN111444889A (zh) * 2020-04-30 2020-07-24 南京大学 基于多级条件影响的卷积神经网络的细粒度动作检测方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SONGLE CHEN: ""Partial similarity human motion retrieval based on relative geometry features"", 2012 FOURTH INTERNATIONAL CONFERENCE ON DIGITAL HOME, 23 November 2012 (2012-11-23), pages 1 - 9 *
ZHIGANG DENG ET.AL: ""Perceptually Consistent Example-based Human Motion Retrieval"", ZHIGANG DENG, ACM SIGGRAPH SYMPOSIUM ON INTERACTIVE 3D GRAPHICS AND GAMES, 27 February 2009 (2009-02-27), pages 1 - 8, XP058097784, DOI: 10.1145/1507149.1507181 *

Also Published As

Publication number Publication date
JP7521602B2 (ja) 2024-07-24
WO2022123800A1 (ja) 2022-06-16
JP7747131B2 (ja) 2025-10-01
KR20230112636A (ko) 2023-07-27
EP4261709A4 (en) 2024-04-24
EP4261709A1 (en) 2023-10-18
US20240013410A1 (en) 2024-01-11
JPWO2022123800A1 (https=) 2022-06-16
JP2024133181A (ja) 2024-10-01

Similar Documents

Publication Publication Date Title
CN111797753B (zh) 图像驱动模型的训练、图像生成方法、装置、设备及介质
CN116528759A (zh) 信息处理装置、信息处理方法和程序
Cong et al. Laserhuman: Language-guided scene-aware human motion generation in free environment
CN110660017A (zh) 一种基于三维姿态识别的舞谱记录与演示方法
CN115244495A (zh) 针对虚拟环境运动的实时式样
US11238634B2 (en) Motion model refinement based on contact analysis and optimization
CN112434679A (zh) 康复运动的评估方法及装置、设备、存储介质
CN110232727A (zh) 一种连续姿态动作评估智能算法
US20220284652A1 (en) System and method for matching a test frame sequence with a reference frame sequence
JP2026513435A (ja) 仮想オブジェクトアニメーション生成方法、装置、電子機器、およびコンピュータプログラム
Ray et al. Pressim: An end-to-end framework for dynamic ground pressure profile generation from monocular videos using physics-based 3d simulation
Ray et al. Improving IMU based human activity recognition using simulated multimodal representations and a MoE classifier
CN114782661B (zh) 下半身姿态预测模型的训练方法及装置
Wang et al. Swimmer’s posture recognition and correction method based on embedded depth image skeleton tracking
Peng et al. Research on Action Recognition Method of Dance Video Image Based on Human‐Computer Interaction
US20250258537A1 (en) Information processing apparatus, information processing method, and program
WO2022196059A1 (ja) 情報処理装置、情報処理方法およびプログラム
Kaur et al. Human Activity Recognition
WO2023188216A1 (ja) 情報処理プログラム、情報処理方法、および情報処理装置
Matsuyama et al. A basic study on ballroom dance figure classification with LSTM using multi-modal sensor
JPWO2023188216A5 (https=)
US20240144500A1 (en) Data conversion device, moving image conversion system, data conversion method, and recording medium
KR102840983B1 (ko) 인공지능 기반의 마커리스 자세 추정 방식을 이용하는 골프 레슨 시스템
US20260120315A1 (en) Approaches to generating semi-synthetic training data for real-time estimation of pose and systems for implementing the same
JP7727242B2 (ja) 情報処理プログラム、情報処理方法、および情報処理装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination