JP7609079B2 - 情報処理装置、情報処理方法及び情報処理プログラム - Google Patents

情報処理装置、情報処理方法及び情報処理プログラム Download PDF

Info

Publication number
JP7609079B2
JP7609079B2 JP2021575881A JP2021575881A JP7609079B2 JP 7609079 B2 JP7609079 B2 JP 7609079B2 JP 2021575881 A JP2021575881 A JP 2021575881A JP 2021575881 A JP2021575881 A JP 2021575881A JP 7609079 B2 JP7609079 B2 JP 7609079B2
Authority
JP
Japan
Prior art keywords
fingers
information processing
processing device
information
posture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021575881A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021157691A1 (https=
Inventor
勇人 西岡
貴紀 奥
晋一 古屋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Sony Group Corp
Original Assignee
Sony Corp
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp, Sony Group Corp filed Critical Sony Corp
Publication of JPWO2021157691A1 publication Critical patent/JPWO2021157691A1/ja
Application granted granted Critical
Publication of JP7609079B2 publication Critical patent/JP7609079B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)
JP2021575881A 2020-02-06 2021-02-05 情報処理装置、情報処理方法及び情報処理プログラム Active JP7609079B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020018743 2020-02-06
JP2020018743 2020-02-06
PCT/JP2021/004301 WO2021157691A1 (ja) 2020-02-06 2021-02-05 情報処理装置、情報処理方法及び情報処理プログラム

Publications (2)

Publication Number Publication Date
JPWO2021157691A1 JPWO2021157691A1 (https=) 2021-08-12
JP7609079B2 true JP7609079B2 (ja) 2025-01-07

Family

ID=77199955

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021575881A Active JP7609079B2 (ja) 2020-02-06 2021-02-05 情報処理装置、情報処理方法及び情報処理プログラム

Country Status (5)

Country Link
US (1) US20230054973A1 (https=)
EP (1) EP4102460A4 (https=)
JP (1) JP7609079B2 (https=)
CN (1) CN115023732B (https=)
WO (1) WO2021157691A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7243026B2 (ja) * 2018-03-23 2023-03-22 ヤマハ株式会社 演奏解析方法、演奏解析装置およびプログラム
JP2020042161A (ja) * 2018-09-11 2020-03-19 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
WO2021186563A1 (ja) * 2020-03-17 2021-09-23 日本電気株式会社 演奏方法
JP2022149157A (ja) * 2021-03-25 2022-10-06 ヤマハ株式会社 演奏解析方法、演奏解析システムおよびプログラム
JP7810053B2 (ja) * 2022-04-06 2026-02-03 ヤマハ株式会社 情報処理システム、情報処理方法およびプログラム
JP2023168840A (ja) 2022-05-16 2023-11-29 キヤノン株式会社 情報処理装置、情報処理システム、情報処理方法、プログラム
JP2024012764A (ja) * 2022-07-19 2024-01-31 国立大学法人東京工業大学 情報処理システム、情報処理方法及びプログラム
CN116229571A (zh) * 2023-02-22 2023-06-06 清华大学 基于触控屏的手指姿态估计方法和装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011525283A (ja) 2008-06-18 2011-09-15 オブロング・インダストリーズ・インコーポレーテッド 車両インターフェース用ジェスチャ基準制御システム
JP2015519624A (ja) 2012-02-24 2015-07-09 トーマス ジェイ モスカリッロＭＯＳＣＡＲＩＬＬＯ， Ｔｈｏｍａｓ， Ｊ． ジェスチャー認識装置及び方法
US20180342229A1 (en) 2016-10-11 2018-11-29 Sunland Information Technology Co., Ltd. Smart detecting and feedback system for smart piano
CN109446952A (zh) 2018-10-16 2019-03-08 赵笑婷 一种钢琴监督方法、装置、计算机设备及存储介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050060606A (ko) * 2003-12-17 2005-06-22 엘지전자 주식회사 휴먼 컴퓨터 인터렉션 장치 및 방법
JP5061645B2 (ja) * 2007-02-26 2012-10-31 ソニー株式会社 情報抽出方法、情報抽出装置、プログラム、登録装置及び照合装置
GB201003883D0 (en) * 2010-03-09 2010-04-21 Univ Southampton Apparatus and method for measurement of hand joint movement
US10533850B2 (en) * 2013-07-12 2020-01-14 Magic Leap, Inc. Method and system for inserting recognized object data into a virtual world
US9649558B2 (en) * 2014-03-14 2017-05-16 Sony Interactive Entertainment Inc. Gaming device with rotatably placed cameras
JP6329469B2 (ja) * 2014-09-17 2018-05-23 株式会社東芝 認識装置、認識方法及び認識プログラム
WO2016189372A2 (en) * 2015-04-25 2016-12-01 Quan Xiao Methods and apparatus for human centric "hyper ui for devices"architecture that could serve as an integration point with multiple target/endpoints (devices) and related methods/system with dynamic context aware gesture input towards a "modular" universal controller platform and input device virtualization
JP2017059088A (ja) * 2015-09-18 2017-03-23 沖電気工業株式会社 校正情報作成装置、校正情報作成方法、校正情報作成プログラム、姿勢検知装置、姿勢検知方法、姿勢検知プログラムおよび情報処理システム
US10073531B2 (en) * 2015-10-07 2018-09-11 Google Llc Electronic device pose identification based on imagery and non-image sensor data
US11106273B2 (en) * 2015-10-30 2021-08-31 Ostendo Technologies, Inc. System and methods for on-body gestural interfaces and projection displays
US11244467B2 (en) 2016-11-07 2022-02-08 Sony Corporation Information processing apparatus, information processing mei'hod, and recording medium
CN110520822B (zh) * 2017-04-27 2023-06-27 索尼互动娱乐股份有限公司 控制装置、信息处理系统、控制方法和程序
CN109407836B (zh) * 2018-10-09 2024-08-30 成都柔电云科科技有限公司 一种手部动作捕捉系统及交互系统
US11710249B2 (en) * 2019-12-20 2023-07-25 Unify Medical, Inc. Generation of three-dimensional scans for intraoperative imaging

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011525283A (ja) 2008-06-18 2011-09-15 オブロング・インダストリーズ・インコーポレーテッド 車両インターフェース用ジェスチャ基準制御システム
JP2015519624A (ja) 2012-02-24 2015-07-09 トーマス ジェイ モスカリッロＭＯＳＣＡＲＩＬＬＯ， Ｔｈｏｍａｓ， Ｊ． ジェスチャー認識装置及び方法
US20180342229A1 (en) 2016-10-11 2018-11-29 Sunland Information Technology Co., Ltd. Smart detecting and feedback system for smart piano
CN109446952A (zh) 2018-10-16 2019-03-08 赵笑婷 一种钢琴监督方法、装置、计算机设备及存储介质

Also Published As

Publication number Publication date
EP4102460A1 (en) 2022-12-14
EP4102460A4 (en) 2023-08-02
WO2021157691A1 (ja) 2021-08-12
CN115023732B (zh) 2025-10-28
JPWO2021157691A1 (https=) 2021-08-12
US20230054973A1 (en) 2023-02-23
CN115023732A (zh) 2022-09-06

Similar Documents

Publication Publication Date Title
JP7609079B2 (ja) 情報処理装置、情報処理方法及び情報処理プログラム
CN112805750B (zh) 跨现实系统
US11886643B2 (en) Information processing apparatus and information processing method
US9342160B2 (en) Ergonomic physical interaction zone cursor mapping
US10409836B2 (en) Sensor fusion interface for multiple sensor input
CN105229571B (zh) 自然用户接口滚动和瞄准
CN105122183B (zh) 检测自然用户输入参与
RU2644520C2 (ru) Бесконтактный ввод
US10488195B2 (en) Curated photogrammetry
RU2708027C1 (ru) Способ передачи движения субъекта из видео на анимированного персонажа
US10146316B2 (en) Method and apparatus for disambiguating a plurality of targets
US12014645B2 (en) Virtual tutorials for musical instruments with finger tracking in augmented reality
US20140009384A1 (en) Methods and systems for determining location of handheld device within 3d environment
CN112449691B (zh) 通过物理接触细化虚拟网格模型
US10474342B2 (en) Scrollable user interface control
MacRitchie et al. Efficient tracking of pianists’ finger movements
KR20160106653A (ko) 조정된 스피치 및 제스처 입력
Arslan Doing more without more: Data fusion in human-computer interaction
CN121789911A (zh) 一种互动式自闭症儿童训练系统、方法、电子设备、可读存储介质
CN116156141A (zh) 体积视频播放方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240118

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240903

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241105

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20241119

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20241202

R150 Certificate of patent or registration of utility model

Ref document number: 7609079

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150