JP7619375B2 - 音響処理方法、音響処理システム、電子楽器およびプログラム - Google Patents
音響処理方法、音響処理システム、電子楽器およびプログラム Download PDFInfo
- Publication number
- JP7619375B2 JP7619375B2 JP2022565308A JP2022565308A JP7619375B2 JP 7619375 B2 JP7619375 B2 JP 7619375B2 JP 2022565308 A JP2022565308 A JP 2022565308A JP 2022565308 A JP2022565308 A JP 2022565308A JP 7619375 B2 JP7619375 B2 JP 7619375B2
- Authority
- JP
- Japan
- Prior art keywords
- data
- singing
- sound
- musical instrument
- sounds
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims description 47
- 238000003672 processing method Methods 0.000 title claims description 14
- 238000012549 training Methods 0.000 claims description 106
- 239000011295 pitch Substances 0.000 claims description 89
- 238000010801 machine learning Methods 0.000 claims description 69
- 230000000875 corresponding effect Effects 0.000 claims description 64
- 238000000034 method Methods 0.000 claims description 61
- 230000005236 sound signal Effects 0.000 claims description 56
- 230000004044 response Effects 0.000 claims description 30
- 230000002596 correlated effect Effects 0.000 claims description 29
- 230000006870 function Effects 0.000 claims description 20
- 230000008569 process Effects 0.000 description 48
- 238000004891 communication Methods 0.000 description 34
- 230000008859 change Effects 0.000 description 25
- 230000014509 gene expression Effects 0.000 description 21
- 238000010586 diagram Methods 0.000 description 16
- 230000001755 vocal effect Effects 0.000 description 9
- 238000013528 artificial neural network Methods 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000033764 rhythmic process Effects 0.000 description 5
- 229910001369 Brass Inorganic materials 0.000 description 4
- 239000010951 brass Substances 0.000 description 4
- 238000013527 convolutional neural network Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 208000023514 Barrett esophagus Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000015654 memory Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000306 recurrent effect Effects 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000009527 percussion Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 230000001020 rhythmical effect Effects 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
- G10H1/366—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
- G10G1/00—Means for the representation of music
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0008—Associated control or indicating means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/005—Musical accompaniment, i.e. complete instrumental rhythm synthesis added to a performed melody, e.g. as output by drum machines
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
- G10H2210/066—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/325—Musical pitch modification
- G10H2210/331—Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
- G10H2250/311—Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
- Auxiliary Devices For Music (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2020194912 | 2020-11-25 | ||
| JP2020194912 | 2020-11-25 | ||
| PCT/JP2021/042690 WO2022113914A1 (ja) | 2020-11-25 | 2021-11-19 | 音響処理方法、音響処理システム、電子楽器およびプログラム |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JPWO2022113914A1 JPWO2022113914A1 (https=) | 2022-06-02 |
| JPWO2022113914A5 JPWO2022113914A5 (https=) | 2023-07-27 |
| JP7619375B2 true JP7619375B2 (ja) | 2025-01-22 |
Family
ID=81754556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2022565308A Active JP7619375B2 (ja) | 2020-11-25 | 2021-11-19 | 音響処理方法、音響処理システム、電子楽器およびプログラム |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20230290325A1 (https=) |
| JP (1) | JP7619375B2 (https=) |
| CN (1) | CN116670751A (https=) |
| WO (1) | WO2022113914A1 (https=) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022054414A1 (ja) * | 2020-09-08 | 2022-03-17 | パナソニックＩｐマネジメント株式会社 | 音信号処理システム、及び、音信号処理方法 |
| US12452610B2 (en) * | 2021-12-30 | 2025-10-21 | Fuliang Wang | Methods for synthesis-based clear hearing under noisy conditions |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010538335A (ja) | 2007-09-07 | 2010-12-09 | マイクロソフト コーポレーション | 音声メロディ向けの自動伴奏 |
| JP2013076941A (ja) | 2011-09-30 | 2013-04-25 | Xing Inc | 楽曲再生システム、装置及び楽曲再生方法 |
| WO2018230670A1 (ja) | 2017-06-14 | 2018-12-20 | ヤマハ株式会社 | 歌唱音声の出力方法及び音声応答システム |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS58152291A (ja) * | 1982-03-05 | 1983-09-09 | 日本電気株式会社 | 自動学習型伴奏装置 |
| JPH05100678A (ja) * | 1991-06-26 | 1993-04-23 | Yamaha Corp | 電子楽器 |
| DE4430628C2 (de) * | 1994-08-29 | 1998-01-08 | Hoehn Marcus Dipl Wirtsch Ing | Verfahren und Einrichtung einer intelligenten, lernfähigen Musikbegleitautomatik für elektronische Klangerzeuger |
| JP3183117B2 (ja) * | 1995-09-13 | 2001-07-03 | ヤマハ株式会社 | カラオケ装置 |
| JPH11194784A (ja) * | 1997-12-26 | 1999-07-21 | Ricoh Co Ltd | カラオケ伴奏音生成装置 |
| JP3858842B2 (ja) * | 2003-03-20 | 2006-12-20 | ソニー株式会社 | 歌声合成方法及び装置 |
| WO2016007899A1 (en) * | 2014-07-10 | 2016-01-14 | Rensselaer Polytechnic Institute | Interactive, expressive music accompaniment system |
| CN110767201B (zh) * | 2018-07-26 | 2023-09-05 | Tcl科技集团股份有限公司 | 一种配乐生成方法、存储介质及终端设备 |
| CN109637509B (zh) * | 2018-11-12 | 2023-10-03 | 平安科技（深圳）有限公司 | 一种音乐自动生成方法、装置及计算机可读存储介质 |
| CN111724764B (zh) * | 2020-06-28 | 2023-01-03 | 北京爱数智慧科技有限公司 | 一种合成音乐的方法和装置 |
| CN111653256B (zh) * | 2020-08-10 | 2020-12-08 | 浙江大学 | 一种基于编码-解码网络的音乐伴奏自动生成方法及其系统 |
-
2021
- 2021-11-19 JP JP2022565308A patent/JP7619375B2/ja active Active
- 2021-11-19 WO PCT/JP2021/042690 patent/WO2022113914A1/ja not_active Ceased
- 2021-11-19 CN CN202180077789.9A patent/CN116670751A/zh active Pending
-
2023
- 2023-05-19 US US18/320,440 patent/US20230290325A1/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010538335A (ja) | 2007-09-07 | 2010-12-09 | マイクロソフト コーポレーション | 音声メロディ向けの自動伴奏 |
| JP2013076941A (ja) | 2011-09-30 | 2013-04-25 | Xing Inc | 楽曲再生システム、装置及び楽曲再生方法 |
| WO2018230670A1 (ja) | 2017-06-14 | 2018-12-20 | ヤマハ株式会社 | 歌唱音声の出力方法及び音声応答システム |
Also Published As
| Publication number | Publication date |
|---|---|
| US20230290325A1 (en) | 2023-09-14 |
| CN116670751A (zh) | 2023-08-29 |
| JPWO2022113914A1 (https=) | 2022-06-02 |
| WO2022113914A1 (ja) | 2022-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11996082B2 (en) | Electronic musical instruments, method and storage media | |
| CN110634460A (zh) | 电子乐器、电子乐器的控制方法以及存储介质 | |
| CN110634464A (zh) | 电子乐器、电子乐器的控制方法以及存储介质 | |
| CN116895267A (zh) | 电子乐器、电子乐器的控制方法以及存储介质 | |
| Lindemann | Music synthesis with reconstructive phrase modeling | |
| JP2003241757A (ja) | 波形生成装置及び方法 | |
| JP7740315B2 (ja) | 電子機器、電子楽器、方法及びプログラム | |
| JP2020024456A (ja) | 電子楽器、電子楽器の制御方法、及びプログラム | |
| JP7544154B2 (ja) | 情報処理システム、電子楽器、情報処理方法およびプログラム | |
| JP7619375B2 (ja) | 音響処理方法、音響処理システム、電子楽器およびプログラム | |
| JP5292702B2 (ja) | 楽音信号生成装置及びカラオケ装置 | |
| WO2025100264A1 (ja) | 情報処理方法、情報処理システムおよびプログラム | |
| JP7740068B2 (ja) | 音響生成方法、音響生成システムおよびプログラム | |
| JP5418524B2 (ja) | 楽曲データ修正装置 | |
| Winter | Interactive music: Compositional techniques for communicating different emotional qualities | |
| JP2008527463A (ja) | 完全なオーケストレーションシステム | |
| Juusela | The Berklee Contemporary Dictionary of Music | |
| JP7107427B2 (ja) | 音信号合成方法、生成モデルの訓練方法、音信号合成システムおよびプログラム | |
| JP5034471B2 (ja) | 楽音信号発生装置及びカラオケ装置 | |
| JP2023130095A (ja) | 音響生成方法、音響生成システムおよびプログラム | |
| JP3832420B2 (ja) | 楽音生成装置及び方法 | |
| JP3832419B2 (ja) | 楽音生成装置及び方法 | |
| JP3832422B2 (ja) | 楽音生成装置及び方法 | |
| Psathas | View from Olympus: double concerto for Percussion, Piano and Orchestra | |
| Maestre | LENY VINCESLAS |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230512 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20230512 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20240709 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240904 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20241210 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20241223 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 7619375 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |