JP7388542B2 - 演奏エージェントの訓練方法、自動演奏システム、及びプログラム - Google Patents

演奏エージェントの訓練方法、自動演奏システム、及びプログラム Download PDF

Info

Publication number
JP7388542B2
JP7388542B2 JP2022509544A JP2022509544A JP7388542B2 JP 7388542 B2 JP7388542 B2 JP 7388542B2 JP 2022509544 A JP2022509544 A JP 2022509544A JP 2022509544 A JP2022509544 A JP 2022509544A JP 7388542 B2 JP7388542 B2 JP 7388542B2
Authority
JP
Japan
Prior art keywords
performance
performer
data
satisfaction
agent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022509544A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021193032A5 (https=
JPWO2021193032A1 (https=
Inventor
陽 前澤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yamaha Corp
Original Assignee
Yamaha Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yamaha Corp filed Critical Yamaha Corp
Publication of JPWO2021193032A1 publication Critical patent/JPWO2021193032A1/ja
Publication of JPWO2021193032A5 publication Critical patent/JPWO2021193032A5/ja
Application granted granted Critical
Publication of JP7388542B2 publication Critical patent/JP7388542B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058—Transmission between separate instruments or between individual components of a musical system
    • G10H1/0066—Transmission between separate instruments or between individual components of a musical system using a MIDI interface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
    • G10G1/00—Means for the representation of music
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/091—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/311—Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Auxiliary Devices For Music (AREA)
JP2022509544A 2020-03-23 2021-03-09 演奏エージェントの訓練方法、自動演奏システム、及びプログラム Active JP7388542B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020051490 2020-03-23
JP2020051490 2020-03-23
PCT/JP2021/009361 WO2021193032A1 (ja) 2020-03-23 2021-03-09 演奏エージェントの訓練方法、自動演奏システム、及びプログラム

Publications (3)

Publication Number Publication Date
JPWO2021193032A1 JPWO2021193032A1 (https=) 2021-09-30
JPWO2021193032A5 JPWO2021193032A5 (https=) 2022-11-15
JP7388542B2 true JP7388542B2 (ja) 2023-11-29

Family

ID=77891473

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022509544A Active JP7388542B2 (ja) 2020-03-23 2021-03-09 演奏エージェントの訓練方法、自動演奏システム、及びプログラム

Country Status (4)

Country Link
US (1) US12367854B2 (https=)
JP (1) JP7388542B2 (https=)
CN (1) CN115298734A (https=)
WO (1) WO2021193032A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7147384B2 (ja) * 2018-09-03 2022-10-05 ヤマハ株式会社 情報処理方法および情報処理装置
WO2021186928A1 (ja) * 2020-03-17 2021-09-23 ヤマハ株式会社 演奏情報に対する評価を推論する方法、システム、及びプログラム
CN115298733A (zh) * 2020-03-24 2022-11-04 雅马哈株式会社 训练好的模型的建立方法、推定方法、演奏代理的推荐方法、演奏代理的调整方法、训练好的模型的建立系统、推定系统、训练好的模型的建立程序及推定程序
US20260105276A1 (en) * 2024-10-16 2026-04-16 Turing Dream SL Self-learning massive agentic system, apparatus, and method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015191194A (ja) 2014-03-28 2015-11-02 パイオニア株式会社 演奏評価システム、サーバ装置、端末装置、演奏評価方法及びコンピュータプログラム
JP2019162207A (ja) 2018-03-19 2019-09-26 富士ゼロックス株式会社 情報処理装置及び情報処理プログラム

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3215058B2 (ja) * 1996-11-06 2001-10-02 株式会社エイ・ティ・アール知能映像通信研究所 演奏支援機能付楽器
KR100561315B1 (ko) * 2003-10-16 2006-03-16 티제이미디어 주식회사 노래반주기의 장르별 최적음역 자동설정장치 및 방법
US8134061B2 (en) * 2006-04-21 2012-03-13 Vergence Entertainment Llc System for musically interacting avatars
JP5557087B2 (ja) * 2009-10-30 2014-07-23 カシオ計算機株式会社 自動伴奏装置およびプログラム
US9082380B1 (en) * 2011-10-31 2015-07-14 Smule, Inc. Synthetic musical instrument with performance-and/or skill-adaptive score tempo
CN108040497B (zh) * 2015-06-03 2022-03-04 思妙公司 用于自动产生协调的视听作品的方法和系统
US20220313083A1 (en) * 2015-10-09 2022-10-06 Senseye, Inc. Cognitive, emotional, mental and psychological diagnostic engine via the eye
CN105390130B (zh) * 2015-10-23 2019-06-28 施政 一种乐器
JP6776788B2 (ja) 2016-10-11 2020-10-28 ヤマハ株式会社 演奏制御方法、演奏制御装置およびプログラム
JP6130041B1 (ja) * 2016-11-15 2017-05-17 株式会社gloops 端末装置、端末装置のゲーム実行方法、ゲーム実行プログラム、及びゲーム実行プログラム記録媒体
JP6708180B2 (ja) * 2017-07-25 2020-06-10 ヤマハ株式会社 演奏解析方法、演奏解析装置およびプログラム
KR102122195B1 (ko) * 2018-03-06 2020-06-12 주식회사 웨이테크 인공지능 합주 시스템 및 인공지능 합주 방법
CN115298733A (zh) * 2020-03-24 2022-11-04 雅马哈株式会社 训练好的模型的建立方法、推定方法、演奏代理的推荐方法、演奏代理的调整方法、训练好的模型的建立系统、推定系统、训练好的模型的建立程序及推定程序
EP4341907A4 (en) * 2021-05-18 2025-01-15 Attune Media Labs, PBC SYSTEMS AND METHODS FOR AUTOMATED REAL-TIME GENERATING AN INTERACTIVE, DISCONTINUOUS, DISCRETE AVATAR

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015191194A (ja) 2014-03-28 2015-11-02 パイオニア株式会社 演奏評価システム、サーバ装置、端末装置、演奏評価方法及びコンピュータプログラム
JP2019162207A (ja) 2018-03-19 2019-09-26 富士ゼロックス株式会社 情報処理装置及び情報処理プログラム

Also Published As

Publication number Publication date
CN115298734A (zh) 2022-11-04
JPWO2021193032A1 (https=) 2021-09-30
US20230014736A1 (en) 2023-01-19
US12367854B2 (en) 2025-07-22
WO2021193032A1 (ja) 2021-09-30

Similar Documents

Publication Publication Date Title
JP7388542B2 (ja) 演奏エージェントの訓練方法、自動演奏システム、及びプログラム
JP7420220B2 (ja) 訓練済みモデルの確立方法、推定方法、演奏エージェントの推薦方法、演奏エージェントの調整方法、訓練済みモデルの確立システム、推定システム、訓練済みモデルの確立プログラム及び推定プログラム
EP3803846B1 (en) Autonomous generation of melody
US10580393B2 (en) Apparatus for analyzing musical performance, performance analysis method, automatic playback method, and automatic player system
US11557269B2 (en) Information processing method
JP7718536B2 (ja) 演奏データに対する観衆の評価を推論する方法、システム、及びプログラム
CN109346043B (zh) 一种基于生成对抗网络的音乐生成方法及装置
JP7383943B2 (ja) 制御システム、制御方法、及びプログラム
US10235898B1 (en) Computer implemented method for providing feedback of harmonic content relating to music track
JP7528971B2 (ja) 情報処理方法、情報処理システムおよびプログラム
US20230005458A1 (en) Parameter Inference Method, Parameter Inference System, and Parameter Inference Program
CN119049432A (zh) 基于人工智能的信息生成、修正方法、系统、设备及介质
CN115244613A (zh) 对针对演奏信息的评价进行推论的方法、系统及程序
JP2025170154A5 (ja) データ処理方法、データ処理システムおよびプログラム
US20230395052A1 (en) Audio analysis method, audio analysis system and program
JP7845491B2 (ja) データ処理方法、プログラムおよびシステム
Nymoen et al. Self-awareness in active music systems
US20260037775A1 (en) Signal processing apparatus, signal processing method, and program
JP7615818B2 (ja) 画像処理方法、画像処理システムおよびプログラム
CN121191526A (zh) 音频音色转换方法、电子设备及计算机存储介质
JP2024175437A (ja) 情報処理方法および情報処理装置
CN119964575A (zh) 推荐方法、装置、电子设备及计算机可读存储介质
CN120727206A (zh) 基于多模态分析的心理疗愈音乐推荐方法及系统
CN121565187A (zh) 音频处理方法、装置、电子设备、存储介质及程序产品
CN120066251A (zh) 一种智能穿戴设备的音乐生成方法及终端

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220906

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220906

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231017

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231030

R151 Written notification of patent or utility model registration

Ref document number: 7388542

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313532

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350