KR20230112636A - 정보 처리 장치, 정보 처리 방법 및 프로그램 - Google Patents

정보 처리 장치, 정보 처리 방법 및 프로그램 Download PDF

Info

Publication number
KR20230112636A
KR20230112636A KR1020237017611A KR20237017611A KR20230112636A KR 20230112636 A KR20230112636 A KR 20230112636A KR 1020237017611 A KR1020237017611 A KR 1020237017611A KR 20237017611 A KR20237017611 A KR 20237017611A KR 20230112636 A KR20230112636 A KR 20230112636A
Authority
KR
South Korea
Prior art keywords
feature
feature amount
data
motion data
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020237017611A
Other languages
English (en)
Korean (ko)
Inventor
게이타 모치즈키
유키 다나카
Original Assignee
소니그룹주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 소니그룹주식회사 filed Critical 소니그룹주식회사
Publication of KR20230112636A publication Critical patent/KR20230112636A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/732—Query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Library & Information Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Biophysics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Dentistry (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physiology (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Psychiatry (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
KR1020237017611A 2020-12-08 2021-02-19 정보 처리 장치, 정보 처리 방법 및 프로그램 Pending KR20230112636A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063122509P 2020-12-08 2020-12-08
US63/122,509 2020-12-08
PCT/JP2021/006290 WO2022123800A1 (ja) 2020-12-08 2021-02-19 情報処理装置、情報処理方法およびプログラム

Publications (1)

Publication Number Publication Date
KR20230112636A true KR20230112636A (ko) 2023-07-27

Family

ID=81974333

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237017611A Pending KR20230112636A (ko) 2020-12-08 2021-02-19 정보 처리 장치, 정보 처리 방법 및 프로그램

Country Status (6)

Country Link
US (1) US20240013410A1 (https=)
EP (1) EP4261709A4 (https=)
JP (2) JP7521602B2 (https=)
KR (1) KR20230112636A (https=)
CN (1) CN116528759A (https=)
WO (1) WO2022123800A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240280687A1 (en) * 2021-06-28 2024-08-22 Google Llc System and method for motion capture
WO2024122203A1 (ja) * 2022-12-07 2024-06-13 ソニーグループ株式会社 情報処理装置、および情報処理方法
TWI900829B (zh) * 2023-03-07 2025-10-11 緯創資通股份有限公司 識別方法及無線動作捕捉系統
JP2024154850A (ja) * 2023-04-20 2024-10-31 グリー株式会社 情報処理システム、情報処理方法、及びプログラム

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120038628A1 (en) 2010-04-28 2012-02-16 Mixamo, Inc. Real-time automatic concatenation of 3d animation sequences

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69421404T2 (de) * 1994-12-30 2000-02-10 Daewoo Electronics Co., Ltd. Blockübereinstimmungsbewegungsauswertung mit einer gewichteten Funktion
US6414684B1 (en) * 1996-04-25 2002-07-02 Matsushita Electric Industrial Co., Ltd. Method for communicating and generating computer graphics animation data, and recording media
JP2953413B2 (ja) * 1996-12-09 1999-09-27 日本電気株式会社 動作修正方法および動作修正装置
US8542928B2 (en) * 2005-09-26 2013-09-24 Canon Kabushiki Kaisha Information processing apparatus and control method therefor
JP5055218B2 (ja) * 2008-07-25 2012-10-24 Ｋｄｄｉ株式会社 動きデータ検索装置及びコンピュータプログラム
CN101515371B (zh) * 2009-03-26 2011-01-19 浙江大学 人体运动数据片段提取方法
US8751191B2 (en) * 2009-12-22 2014-06-10 Panasonic Corporation Action analysis device and action analysis method
JP2015011480A (ja) * 2013-06-27 2015-01-19 カシオ計算機株式会社 画像生成装置、画像生成方法及びプログラム
KR101765208B1 (ko) * 2014-01-07 2017-08-04 한국전자통신연구원 시간 및 자세 제약 조건 아래에서 무용 동작을 생성하는 방법 및 장치
KR102013577B1 (ko) * 2015-09-14 2019-08-23 한국전자통신연구원 안무 구상 지원 장치 및 방법
US10019629B2 (en) * 2016-05-31 2018-07-10 Microsoft Technology Licensing, Llc Skeleton-based action detection using recurrent neural network
US10368087B2 (en) * 2016-09-20 2019-07-30 Ati Technologies Ulc Dynamic reload of video encoder motion estimation search window under performance/power constraints
EP3730196A4 (en) * 2017-12-19 2021-06-09 Sony Corporation INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND PROGRAM
WO2019203188A1 (ja) * 2018-04-17 2019-10-24 ソニー株式会社 プログラム、情報処理装置、及び情報処理方法
WO2019243899A1 (en) * 2018-06-18 2019-12-26 Unity IPR ApS Method and system for real-time animation generation using machine learning
JP7262937B2 (ja) * 2018-06-29 2023-04-24 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
KR102543650B1 (ko) * 2018-07-30 2023-06-15 주식회사 엔씨소프트 모션 합성 장치 및 모션 합성 방법
CN111444889B (zh) * 2020-04-30 2023-07-25 南京大学 基于多级条件影响的卷积神经网络的细粒度动作检测方法
WO2022249278A1 (ja) * 2021-05-25 2022-12-01 日本電気株式会社 画像処理装置、画像処理方法、およびプログラム

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120038628A1 (en) 2010-04-28 2012-02-16 Mixamo, Inc. Real-time automatic concatenation of 3d animation sequences

Also Published As

Publication number Publication date
JP7521602B2 (ja) 2024-07-24
WO2022123800A1 (ja) 2022-06-16
JP7747131B2 (ja) 2025-10-01
CN116528759A (zh) 2023-08-01
EP4261709A4 (en) 2024-04-24
EP4261709A1 (en) 2023-10-18
US20240013410A1 (en) 2024-01-11
JPWO2022123800A1 (https=) 2022-06-16
JP2024133181A (ja) 2024-10-01

Similar Documents

Publication Publication Date Title
KR102933193B1 (ko) 실세계 환경의 4d 시공간 모델을 생성하기 위한 실시간 시스템
JP7747131B2 (ja) 情報処理装置、情報処理方法およびプログラム
CN115244495B (zh) 针对虚拟环境运动的实时式样
US11605192B2 (en) Skeleton model update apparatus, skeleton model update method, and program
JP7171745B2 (ja) 推定装置、学習装置、推定方法、学習方法及びプログラム
Huang et al. Intelligent yoga coaching system based on posture recognition
JP7318814B2 (ja) データ生成方法、データ生成プログラムおよび情報処理装置
Jan et al. Augmented tai-chi chuan practice tool with pose evaluation
US20250258537A1 (en) Information processing apparatus, information processing method, and program
CN119440251A (zh) 一种多人大空间虚拟现实互动系统及方法
US12175579B2 (en) Skeleton model update apparatus, skeleton model update method, and program
WO2022196059A1 (ja) 情報処理装置、情報処理方法およびプログラム
EP4502924A1 (en) Information processing program, information processing method, and information processing device
CN116485953A (zh) 数据处理方法、装置、设备和可读存储介质
US20240144500A1 (en) Data conversion device, moving image conversion system, data conversion method, and recording medium
JP2021099666A (ja) 学習モデルの生成方法
KR102840983B1 (ko) 인공지능 기반의 마커리스 자세 추정 방식을 이용하는 골프 레슨 시스템
Ryu et al. Mocap-ARM: A Natural Avatar Motion Rendering System Based on Loose-Fit Sensor Jacket
JP7727242B2 (ja) 情報処理プログラム、情報処理方法、および情報処理装置
WO2024105991A1 (en) Information processing apparatus, information processing method, and program
US20260120315A1 (en) Approaches to generating semi-synthetic training data for real-time estimation of pose and systems for implementing the same
Huang et al. Interactive demonstration of pointing gestures for virtual trainers
MILLAR AN OVERVIEW OF STATE-OF-THE-ART METHODS FOR 3D HUMAN POSE ESTIMATION FROM MONOCULAR VIDEO
Shraddha et al. AI-Driven 3D Motion Capture and Human Body Detection
Chiang et al. Efficient human skeleton-based action recognition using a two-stream LSTM framework with limited datasets

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20230524

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application