EP1688911A3 - Singing voice synthesizing apparatus and method - Google Patents

Singing voice synthesizing apparatus and method Download PDF

Info

Publication number
EP1688911A3
EP1688911A3 EP06009153A EP06009153A EP1688911A3 EP 1688911 A3 EP1688911 A3 EP 1688911A3 EP 06009153 A EP06009153 A EP 06009153A EP 06009153 A EP06009153 A EP 06009153A EP 1688911 A3 EP1688911 A3 EP 1688911A3
Authority
EP
European Patent Office
Prior art keywords
phoneme
synthesizing apparatus
voice synthesizing
singing voice
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP06009153A
Other languages
German (de)
French (fr)
Other versions
EP1688911B1 (en
EP1688911A2 (en
Inventor
Yuji Hisaminato
Jordi Bonada Sanjaume
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yamaha Corp
Original Assignee
Yamaha Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yamaha Corp filed Critical Yamaha Corp
Publication of EP1688911A2 publication Critical patent/EP1688911A2/en
Publication of EP1688911A3 publication Critical patent/EP1688911A3/en
Application granted granted Critical
Publication of EP1688911B1 publication Critical patent/EP1688911B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/06—Elementary speech units used in speech synthesisers; Concatenation rules
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/033—Voice editing, e.g. manipulating the voice of the synthesiser

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Telephone Function (AREA)
  • Toys (AREA)

Abstract

A voice synthesizing apparatus comprises: means for storing phoneme pieces having a plurality of different pitches for each phoneme represented by a same phoneme symbol; means for reading a phoneme piece by using a pitch as an index; and a voice synthesizer that synthesizes a voice in accordance with the read phoneme piece.
EP06009153A 2001-03-09 2002-03-07 Singing voice synthesizing apparatus and method Expired - Lifetime EP1688911B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2001067258A JP3838039B2 (en) 2001-03-09 2001-03-09 Speech synthesizer
EP02005149A EP1239457B1 (en) 2001-03-09 2002-03-07 Voice synthesizing apparatus

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP02005149A Division EP1239457B1 (en) 2001-03-09 2002-03-07 Voice synthesizing apparatus

Publications (3)

Publication Number Publication Date
EP1688911A2 EP1688911A2 (en) 2006-08-09
EP1688911A3 true EP1688911A3 (en) 2006-09-13
EP1688911B1 EP1688911B1 (en) 2009-02-25

Family

ID=18925637

Family Applications (2)

Application Number Title Priority Date Filing Date
EP02005149A Expired - Lifetime EP1239457B1 (en) 2001-03-09 2002-03-07 Voice synthesizing apparatus
EP06009153A Expired - Lifetime EP1688911B1 (en) 2001-03-09 2002-03-07 Singing voice synthesizing apparatus and method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP02005149A Expired - Lifetime EP1239457B1 (en) 2001-03-09 2002-03-07 Voice synthesizing apparatus

Country Status (4)

Country Link
US (1) US7065489B2 (en)
EP (2) EP1239457B1 (en)
JP (1) JP3838039B2 (en)
DE (2) DE60231347D1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4067762B2 (en) * 2000-12-28 2008-03-26 ヤマハ株式会社 Singing synthesis device
JP3879402B2 (en) * 2000-12-28 2007-02-14 ヤマハ株式会社 Singing synthesis method and apparatus, and recording medium
JP3709817B2 (en) * 2001-09-03 2005-10-26 ヤマハ株式会社 Speech synthesis apparatus, method, and program
JP4153220B2 (en) 2002-02-28 2008-09-24 ヤマハ株式会社 SINGLE SYNTHESIS DEVICE, SINGE SYNTHESIS METHOD, AND SINGE SYNTHESIS PROGRAM
JP3823930B2 (en) 2003-03-03 2006-09-20 ヤマハ株式会社 Singing synthesis device, singing synthesis program
JP4622356B2 (en) * 2004-07-16 2011-02-02 ヤマハ株式会社 Script generator for speech synthesis and script generation program for speech synthesis
EP1835488B1 (en) * 2006-03-17 2008-11-19 Svox AG Text to speech synthesis
JP5233986B2 (en) * 2007-03-12 2013-07-10 富士通株式会社 Speech waveform interpolation apparatus and method
JP4455633B2 (en) * 2007-09-10 2010-04-21 株式会社東芝 Basic frequency pattern generation apparatus, basic frequency pattern generation method and program
US8244546B2 (en) * 2008-05-28 2012-08-14 National Institute Of Advanced Industrial Science And Technology Singing synthesis parameter data estimation system
JP5471858B2 (en) * 2009-07-02 2014-04-16 ヤマハ株式会社 Database generating apparatus for singing synthesis and pitch curve generating apparatus
JP5293460B2 (en) 2009-07-02 2013-09-18 ヤマハ株式会社 Database generating apparatus for singing synthesis and pitch curve generating apparatus
US8731931B2 (en) 2010-06-18 2014-05-20 At&T Intellectual Property I, L.P. System and method for unit selection text-to-speech using a modified Viterbi approach
JP5605066B2 (en) * 2010-08-06 2014-10-15 ヤマハ株式会社 Data generation apparatus and program for sound synthesis
JP6024191B2 (en) * 2011-05-30 2016-11-09 ヤマハ株式会社 Speech synthesis apparatus and speech synthesis method
JP6047922B2 (en) * 2011-06-01 2016-12-21 ヤマハ株式会社 Speech synthesis apparatus and speech synthesis method
US20130030789A1 (en) * 2011-07-29 2013-01-31 Reginald Dalce Universal Language Translator
US10860946B2 (en) * 2011-08-10 2020-12-08 Konlanbi Dynamic data structures for data-driven modeling
JP5821824B2 (en) * 2012-11-14 2015-11-24 ヤマハ株式会社 Speech synthesizer
CN104123938A (en) * 2013-04-29 2014-10-29 富泰华工业（深圳）有限公司 Voice control system, electronic device and voice control method
JP6171711B2 (en) * 2013-08-09 2017-08-02 ヤマハ株式会社 Speech analysis apparatus and speech analysis method
US10902841B2 (en) 2019-02-15 2021-01-26 International Business Machines Corporation Personalized custom synthetic speech
CN110910895B (en) * 2019-08-29 2021-04-30 腾讯科技（深圳）有限公司 Sound processing method, device, equipment and medium
CN112420015A (en) * 2020-11-18 2021-02-26 腾讯音乐娱乐科技（深圳）有限公司 Audio synthesis method, device, equipment and computer readable storage medium
CN112967538B (en) * 2021-03-01 2023-09-15 郑州铁路职业技术学院 English pronunciation information acquisition system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5642470A (en) * 1993-11-26 1997-06-24 Fujitsu Limited Singing voice synthesizing device for synthesizing natural chorus voices by modulating synthesized voice with fluctuation and emphasis
EP0848372A2 (en) * 1996-12-10 1998-06-17 Matsushita Electric Industrial Co., Ltd. Speech synthesizing system and redundancy-reduced waveform database therefor
EP0942409A2 (en) * 1998-03-09 1999-09-15 Canon Kabushiki Kaisha Phonem based speech synthesis
EP1028409A2 (en) * 1999-01-29 2000-08-16 Yamaha Corporation Apparatus for and method of inputting music-performance control data

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2504172B2 (en) 1989-03-29 1996-06-05 ヤマハ株式会社 Formant sound generator
JP2745865B2 (en) 1990-12-15 1998-04-28 ヤマハ株式会社 Music synthesizer
JP3317458B2 (en) * 1993-04-21 2002-08-26 日本電信電話株式会社 Voice synthesis method
JP3834804B2 (en) 1997-02-27 2006-10-18 ヤマハ株式会社 Musical sound synthesizer and method
JPH113096A (en) * 1997-06-12 1999-01-06 Baazu Joho Kagaku Kenkyusho:Kk Method and system of speech synthesis
JP3854713B2 (en) * 1998-03-10 2006-12-06 キヤノン株式会社 Speech synthesis method and apparatus and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5642470A (en) * 1993-11-26 1997-06-24 Fujitsu Limited Singing voice synthesizing device for synthesizing natural chorus voices by modulating synthesized voice with fluctuation and emphasis
EP0848372A2 (en) * 1996-12-10 1998-06-17 Matsushita Electric Industrial Co., Ltd. Speech synthesizing system and redundancy-reduced waveform database therefor
EP0942409A2 (en) * 1998-03-09 1999-09-15 Canon Kabushiki Kaisha Phonem based speech synthesis
EP1028409A2 (en) * 1999-01-29 2000-08-16 Yamaha Corporation Apparatus for and method of inputting music-performance control data

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CANO P ET AL: "Voice morphing system for impersonating in karaoke applications", ICMC. INTERNATIONAL COMPUTER MUSIC CONFERENCE. PROCEEDINGS, XX, XX, 2000, pages 1 - 4, XP002246647 *
MACON M W ET AL: "Concatenation-Based MIDI-to-Singing Voice Synthesis", AUDIO ENGINEERING SOCIETY. CONVENTION PREPRINT, XX, XX, no. 4591M-1, 26 September 1997 (1997-09-26), pages 1 - 10, XP002358569 *

Also Published As

Publication number Publication date
EP1239457A3 (en) 2003-11-12
EP1239457B1 (en) 2006-12-13
JP3838039B2 (en) 2006-10-25
EP1239457A2 (en) 2002-09-11
EP1688911B1 (en) 2009-02-25
DE60216651T2 (en) 2007-09-27
DE60231347D1 (en) 2009-04-09
EP1688911A2 (en) 2006-08-09
US7065489B2 (en) 2006-06-20
JP2002268659A (en) 2002-09-20
DE60216651D1 (en) 2007-01-25
US20020184032A1 (en) 2002-12-05

Similar Documents

Publication Publication Date Title
EP1688911A3 (en) Singing voice synthesizing apparatus and method
EP1793370A3 (en) apparatus and method for creating pitch wave signals and apparatus and method for synthesizing speech signals using these pitch wave signals
EP1675101A3 (en) Singing voice-synthesizing method and apparatus and storage medium
EP1071074A3 (en) Speech synthesis employing prosody templates
DE60126564D1 (en) Method and arrangement for speech synthesis
WO2008142836A1 (en) Voice tone converting device and voice tone converting method
EP0831460A3 (en) Speech synthesis method utilizing auxiliary information
EP1304680A3 (en) Apparatus and method for synthesizing a plurality of waveforms in synchronized manner
EP1291847A3 (en) Method and apparatus for controlling a speech synthesis system to provide multiple styles of speech
WO2006056972A3 (en) Method and apparatus for speaker spotting
CA2307300A1 (en) Method and system for proofreading and correcting dictated text
EP0848372A3 (en) Speech synthesizing system and redundancy-reduced waveform database therefor
EP1703488A3 (en) Music search system and music search apparatus
EP0821344A3 (en) Method and apparatus for synthesizing speech
EP1045372A3 (en) Speech sound communication system
DE60026643D1 (en) Apparatus and method for generating sound for a mobile terminal in a wireless telecommunication system
EP1450368A3 (en) Sync frame structure, information storage medium, information recording method, information reproduction method and information reproduction apparatus
DE60231100D1 (en) Apparatus for producing a metal film
EP0851405A3 (en) Method and apparatus of speech synthesis by means of concatenation of waveforms
EP1195743A3 (en) Apparatus and method for speech synthesis
ATE221242T1 (en) METHOD AND DEVICE FOR ISSUEING INFORMATION AND/OR MESSAGES BY VOICE
EP1197884A3 (en) Method and apparatus for authoring and viewing audio documents
EP1324313A3 (en) Text to speech conversion
EP2028650A3 (en) Speech pulse location search for speech coding
TW200603073A (en) Device, method and program for pitch pattern generation

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20060503

AC Divisional application: reference to earlier application

Ref document number: 1239457

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE GB

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 13/06 20060101AFI20060609BHEP

Ipc: G10L 13/02 20060101ALI20060801BHEP

RTI1 Title (correction)

Free format text: SINGING VOICE SYNTHESIZING APPARATUS AND METHOD

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE GB

AKX Designation fees paid

Designated state(s): DE GB

17Q First examination report despatched

Effective date: 20070524

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: YAMAHA CORPORATION

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AC Divisional application: reference to earlier application

Ref document number: 1239457

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60231347

Country of ref document: DE

Date of ref document: 20090409

Kind code of ref document: P

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20091126

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20180307

Year of fee payment: 17

Ref country code: DE

Payment date: 20180220

Year of fee payment: 17

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60231347

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190307

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190307

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191001