CN115023732B - 信息处理装置、信息处理方法和信息处理程序 - Google Patents

信息处理装置、信息处理方法和信息处理程序

Info

Publication number
CN115023732B
CN115023732B CN202180011412.3A CN202180011412A CN115023732B CN 115023732 B CN115023732 B CN 115023732B CN 202180011412 A CN202180011412 A CN 202180011412A CN 115023732 B CN115023732 B CN 115023732B
Authority
CN
China
Prior art keywords
finger
information
information processing
posture
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202180011412.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN115023732A (zh
Inventor
西冈勇人
奥贵纪
古屋晋一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Publication of CN115023732A publication Critical patent/CN115023732A/zh
Application granted granted Critical
Publication of CN115023732B publication Critical patent/CN115023732B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)
CN202180011412.3A 2020-02-06 2021-02-05 信息处理装置、信息处理方法和信息处理程序 Active CN115023732B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020018743 2020-02-06
JP2020-018743 2020-02-06
PCT/JP2021/004301 WO2021157691A1 (ja) 2020-02-06 2021-02-05 情報処理装置、情報処理方法及び情報処理プログラム

Publications (2)

Publication Number Publication Date
CN115023732A CN115023732A (zh) 2022-09-06
CN115023732B true CN115023732B (zh) 2025-10-28

Family

ID=77199955

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180011412.3A Active CN115023732B (zh) 2020-02-06 2021-02-05 信息处理装置、信息处理方法和信息处理程序

Country Status (5)

Country Link
US (1) US20230054973A1 (https=)
EP (1) EP4102460A4 (https=)
JP (1) JP7609079B2 (https=)
CN (1) CN115023732B (https=)
WO (1) WO2021157691A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7243026B2 (ja) * 2018-03-23 2023-03-22 ヤマハ株式会社 演奏解析方法、演奏解析装置およびプログラム
JP2020042161A (ja) * 2018-09-11 2020-03-19 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
WO2021186563A1 (ja) * 2020-03-17 2021-09-23 日本電気株式会社 演奏方法
JP2022149157A (ja) * 2021-03-25 2022-10-06 ヤマハ株式会社 演奏解析方法、演奏解析システムおよびプログラム
JP7810053B2 (ja) * 2022-04-06 2026-02-03 ヤマハ株式会社 情報処理システム、情報処理方法およびプログラム
JP2023168840A (ja) 2022-05-16 2023-11-29 キヤノン株式会社 情報処理装置、情報処理システム、情報処理方法、プログラム
JP2024012764A (ja) * 2022-07-19 2024-01-31 国立大学法人東京工業大学 情報処理システム、情報処理方法及びプログラム
CN116229571A (zh) * 2023-02-22 2023-06-06 清华大学 基于触控屏的手指姿态估计方法和装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013126905A2 (en) * 2012-02-24 2013-08-29 Moscarillo Thomas J Gesture recognition devices and methods
WO2017075611A1 (en) * 2015-10-30 2017-05-04 Ostendo Technologies, Inc. System and methods for on-body gestural interfaces and projection displays
CN107978303A (zh) * 2016-10-11 2018-05-01 森兰信息科技（上海）有限公司 智能钢琴的智能检测和反馈系统

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050060606A (ko) * 2003-12-17 2005-06-22 엘지전자 주식회사 휴먼 컴퓨터 인터렉션 장치 및 방법
US20090278915A1 (en) * 2006-02-08 2009-11-12 Oblong Industries, Inc. Gesture-Based Control System For Vehicle Interfaces
JP5061645B2 (ja) * 2007-02-26 2012-10-31 ソニー株式会社 情報抽出方法、情報抽出装置、プログラム、登録装置及び照合装置
GB201003883D0 (en) * 2010-03-09 2010-04-21 Univ Southampton Apparatus and method for measurement of hand joint movement
US10533850B2 (en) * 2013-07-12 2020-01-14 Magic Leap, Inc. Method and system for inserting recognized object data into a virtual world
US9649558B2 (en) * 2014-03-14 2017-05-16 Sony Interactive Entertainment Inc. Gaming device with rotatably placed cameras
JP6329469B2 (ja) * 2014-09-17 2018-05-23 株式会社東芝 認識装置、認識方法及び認識プログラム
WO2016189372A2 (en) * 2015-04-25 2016-12-01 Quan Xiao Methods and apparatus for human centric "hyper ui for devices"architecture that could serve as an integration point with multiple target/endpoints (devices) and related methods/system with dynamic context aware gesture input towards a "modular" universal controller platform and input device virtualization
JP2017059088A (ja) * 2015-09-18 2017-03-23 沖電気工業株式会社 校正情報作成装置、校正情報作成方法、校正情報作成プログラム、姿勢検知装置、姿勢検知方法、姿勢検知プログラムおよび情報処理システム
US10073531B2 (en) * 2015-10-07 2018-09-11 Google Llc Electronic device pose identification based on imagery and non-image sensor data
US11244467B2 (en) 2016-11-07 2022-02-08 Sony Corporation Information processing apparatus, information processing mei'hod, and recording medium
CN110520822B (zh) * 2017-04-27 2023-06-27 索尼互动娱乐股份有限公司 控制装置、信息处理系统、控制方法和程序
CN109407836B (zh) * 2018-10-09 2024-08-30 成都柔电云科科技有限公司 一种手部动作捕捉系统及交互系统
CN109446952A (zh) * 2018-10-16 2019-03-08 赵笑婷 一种钢琴监督方法、装置、计算机设备及存储介质
US11710249B2 (en) * 2019-12-20 2023-07-25 Unify Medical, Inc. Generation of three-dimensional scans for intraoperative imaging

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013126905A2 (en) * 2012-02-24 2013-08-29 Moscarillo Thomas J Gesture recognition devices and methods
WO2017075611A1 (en) * 2015-10-30 2017-05-04 Ostendo Technologies, Inc. System and methods for on-body gestural interfaces and projection displays
CN107978303A (zh) * 2016-10-11 2018-05-01 森兰信息科技（上海）有限公司 智能钢琴的智能检测和反馈系统

Also Published As

Publication number Publication date
EP4102460A1 (en) 2022-12-14
EP4102460A4 (en) 2023-08-02
JP7609079B2 (ja) 2025-01-07
WO2021157691A1 (ja) 2021-08-12
JPWO2021157691A1 (https=) 2021-08-12
US20230054973A1 (en) 2023-02-23
CN115023732A (zh) 2022-09-06

Similar Documents

Publication Publication Date Title
CN115023732B (zh) 信息处理装置、信息处理方法和信息处理程序
US12353632B2 (en) Bimanual interactions between mapped hand regions for controlling virtual and graphical elements
US12086324B2 (en) Micro hand gestures for controlling virtual and graphical elements
US12260679B1 (en) Hand initialization for machine learning based gesture recognition
US11714880B1 (en) Hand pose estimation for machine learning based gesture recognition
JP7504476B2 (ja) モバイル装置のユーザの認知状態を判定するための装置、方法、及びプログラム
US20200225758A1 (en) Augmented two-stage hand gesture input
US12014645B2 (en) Virtual tutorials for musical instruments with finger tracking in augmented reality
CN113168221A (zh) 信息处理设备、信息处理方法和程序
US11998798B2 (en) Virtual guided fitness routines for augmented reality experiences
CN109951628A (zh) 模型构建方法、拍照方法、装置、存储介质及终端
WO2013149586A1 (zh) 一种腕上手势操控系统和方法
US11281293B1 (en) Systems and methods for improving handstate representation model estimates
US20230280835A1 (en) System including a device for personalized hand gesture monitoring
KR20240151240A (ko) 제스처 및 음성 제어 인터페이스 장치
US20250224809A1 (en) Single-handed gestures for reviewing virtual content
CN109844600A (zh) 信息处理设备、信息处理方法和程序
Chang et al. Real-time arm motion tracking and hand gesture recognition based on a single inertial measurement unit
WO2023154045A1 (en) Real-time 3d hand data collection and marking
Giin et al. Smart hand device gesture recognition with dynamic time-warping method
CN111782457A (zh) 机械运动模块的控制方法及装置、存储介质
CN121789911A (zh) 一种互动式自闭症儿童训练系统、方法、电子设备、可读存储介质
Sajjadi et al. AirDraw: Leveraging Smart Watch Motion Sensors for Mobile Human Computer Interactions
Chu Interacting with a Self-portrait Camera Using Gestures
CN117133045A (zh) 手势识别方法、装置、设备及介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant