CN112037754B - 一种语音合成训练数据的生成方法及相关设备 - Google Patents
一种语音合成训练数据的生成方法及相关设备 Download PDFInfo
- Publication number
- CN112037754B CN112037754B CN202010940049.0A CN202010940049A CN112037754B CN 112037754 B CN112037754 B CN 112037754B CN 202010940049 A CN202010940049 A CN 202010940049A CN 112037754 B CN112037754 B CN 112037754B
- Authority
- CN
- China
- Prior art keywords
- model
- voice
- data set
- tone
- conversion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012549 training Methods 0.000 title claims abstract description 247
- 238000000034 method Methods 0.000 title claims abstract description 92
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 72
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 72
- 238000006243 chemical reaction Methods 0.000 claims abstract description 312
- 239000011159 matrix material Substances 0.000 claims description 152
- 230000015654 memory Effects 0.000 claims description 27
- 230000002457 bidirectional effect Effects 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 17
- 238000010276 construction Methods 0.000 claims description 16
- 238000003860 storage Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000000926 separation method Methods 0.000 description 7
- 238000003062 neural network model Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 125000004122 cyclic group Chemical group 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000004913 activation Effects 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 230000033764 rhythmic process Effects 0.000 description 2
- 230000006403 short-term memory Effects 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
- G10L13/04—Details of speech synthesis systems, e.g. synthesiser structure or memory management
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
- G10L15/063—Training
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010940049.0A CN112037754B (zh) | 2020-09-09 | 2020-09-09 | 一种语音合成训练数据的生成方法及相关设备 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010940049.0A CN112037754B (zh) | 2020-09-09 | 2020-09-09 | 一种语音合成训练数据的生成方法及相关设备 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112037754A CN112037754A (zh) | 2020-12-04 |
CN112037754B true CN112037754B (zh) | 2024-02-09 |
Family
ID=73585504
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010940049.0A Active CN112037754B (zh) | 2020-09-09 | 2020-09-09 | 一种语音合成训练数据的生成方法及相关设备 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112037754B (zh) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112530403B (zh) * | 2020-12-11 | 2022-08-26 | 上海交通大学 | 基于半平行语料的语音转换方法和系统 |
CN112802462B (zh) * | 2020-12-31 | 2024-05-31 | 科大讯飞股份有限公司 | 声音转换模型的训练方法、电子设备及存储介质 |
CN113112988A (zh) * | 2021-03-30 | 2021-07-13 | 上海红阵信息科技有限公司 | 一种基于ai处理的语音合成处理系统及方法 |
CN113593522B (zh) * | 2021-06-28 | 2023-08-18 | 北京天行汇通信息技术有限公司 | 一种语音数据标注方法和装置 |
CN113314097B (zh) * | 2021-07-30 | 2021-11-02 | 腾讯科技(深圳)有限公司 | 语音合成方法、语音合成模型处理方法、装置和电子设备 |
CN113689868B (zh) * | 2021-08-18 | 2022-09-13 | 北京百度网讯科技有限公司 | 一种语音转换模型的训练方法、装置、电子设备及介质 |
WO2023102932A1 (zh) * | 2021-12-10 | 2023-06-15 | 广州虎牙科技有限公司 | 音频转换方法、电子设备、程序产品及存储介质 |
CN114333865A (zh) * | 2021-12-22 | 2022-04-12 | 广州市百果园网络科技有限公司 | 一种模型训练以及音色转换方法、装置、设备及介质 |
CN117012180A (zh) * | 2022-06-01 | 2023-11-07 | 腾讯科技(深圳)有限公司 | 语音转换模型训练方法、语音转换方法和装置 |
CN116092474B (zh) * | 2023-04-07 | 2023-06-30 | 北京边锋信息技术有限公司 | 一种语音合成方法、装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103747255A (zh) * | 2014-01-27 | 2014-04-23 | 深圳大学 | 一种基于空域感知哈希的视频篡改检测方法和装置 |
CN108461079A (zh) * | 2018-02-02 | 2018-08-28 | 福州大学 | 一种面向音色转换的歌声合成方法 |
US10186251B1 (en) * | 2015-08-06 | 2019-01-22 | Oben, Inc. | Voice conversion using deep neural network with intermediate voice training |
CN110148424A (zh) * | 2019-05-08 | 2019-08-20 | 北京达佳互联信息技术有限公司 | 语音处理方法、装置、电子设备及存储介质 |
CN111223475A (zh) * | 2019-11-29 | 2020-06-02 | 北京达佳互联信息技术有限公司 | 语音数据生成方法、装置、电子设备及存储介质 |
CN111583913A (zh) * | 2020-06-15 | 2020-08-25 | 深圳市友杰智新科技有限公司 | 语音识别和语音合成的模型训练方法、装置和计算机设备 |
-
2020
- 2020-09-09 CN CN202010940049.0A patent/CN112037754B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103747255A (zh) * | 2014-01-27 | 2014-04-23 | 深圳大学 | 一种基于空域感知哈希的视频篡改检测方法和装置 |
US10186251B1 (en) * | 2015-08-06 | 2019-01-22 | Oben, Inc. | Voice conversion using deep neural network with intermediate voice training |
CN108461079A (zh) * | 2018-02-02 | 2018-08-28 | 福州大学 | 一种面向音色转换的歌声合成方法 |
CN110148424A (zh) * | 2019-05-08 | 2019-08-20 | 北京达佳互联信息技术有限公司 | 语音处理方法、装置、电子设备及存储介质 |
CN111223475A (zh) * | 2019-11-29 | 2020-06-02 | 北京达佳互联信息技术有限公司 | 语音数据生成方法、装置、电子设备及存储介质 |
CN111583913A (zh) * | 2020-06-15 | 2020-08-25 | 深圳市友杰智新科技有限公司 | 语音识别和语音合成的模型训练方法、装置和计算机设备 |
Non-Patent Citations (1)
Title |
---|
基于混合映射模型的语音转换算法研究;康永国;双志伟;陶建华;张维;;声学学报(中文版)(第06期);第555-562页 * |
Also Published As
Publication number | Publication date |
---|---|
CN112037754A (zh) | 2020-12-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112037754B (zh) | 一种语音合成训练数据的生成方法及相关设备 | |
CN106056207B (zh) | 一种基于自然语言的机器人深度交互与推理方法与装置 | |
CN112735373B (zh) | 语音合成方法、装置、设备及存储介质 | |
JP5768093B2 (ja) | 音声処理システム | |
CN112037766B (zh) | 一种语音音色转换方法及相关设备 | |
CN112687259B (zh) | 一种语音合成方法、装置以及可读存储介质 | |
CN108447486A (zh) | 一种语音翻译方法及装置 | |
CN106971709A (zh) | 统计参数模型建立方法和装置、语音合成方法和装置 | |
CN111081230A (zh) | 语音识别方法和设备 | |
CN112071330A (zh) | 一种音频数据处理方法、设备以及计算机可读存储介质 | |
CN111508470A (zh) | 一种语音合成模型的训练方法及装置 | |
KR102272554B1 (ko) | 텍스트- 다중 음성 변환 방법 및 시스템 | |
CN114242033A (zh) | 语音合成方法、装置、设备、存储介质及程序产品 | |
WO2023221345A1 (zh) | 一种情感语音的合成方法及合成装置 | |
CN115910066A (zh) | 用于区域配电网的智能调度指挥与运营系统 | |
CN112908293B (zh) | 一种基于语义注意力机制的多音字发音纠错方法及装置 | |
Zhang et al. | AccentSpeech: Learning accent from crowd-sourced data for target speaker TTS with accents | |
CN113470622A (zh) | 一种可将任意语音转换成多个语音的转换方法及装置 | |
KR102319753B1 (ko) | 딥러닝 기반의 영상 컨텐츠 제작 방법 및 장치 | |
JPH08248994A (ja) | 声質変換音声合成装置 | |
Tits et al. | The theory behind controllable expressive speech synthesis: A cross-disciplinary approach | |
CN110808026A (zh) | 一种基于lstm的电声门图语音转换方法 | |
CN116469368A (zh) | 一种融合语义信息的语音合成方法、系统 | |
CN113299270B (zh) | 语音合成系统的生成方法、装置、设备及存储介质 | |
JP2020013008A (ja) | 音声処理装置、音声処理プログラムおよび音声処理方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210112 Address after: 510000 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Applicant after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Address before: 28th floor, block B1, Wanda Plaza, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Applicant before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20201204 Assignee: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. Assignor: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Contract record no.: X2021440000054 Denomination of invention: A method of generating speech synthesis training data and related equipment License type: Common License Record date: 20210208 |
|
EE01 | Entry into force of recordation of patent licensing contract | ||
GR01 | Patent grant | ||
GR01 | Patent grant |