Classifications

• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
  • G10L13/00—Speech synthesis; Text to speech systems
  • G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
  • G10L13/00—Speech synthesis; Text to speech systems
  • G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
  • G10L13/10—Prosody rules derived from text; Stress or intonation
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
  • G10L13/00—Speech synthesis; Text to speech systems
  • G10L13/06—Elementary speech units used in speech synthesisers; Concatenation rules

Definitions

• the present invention relates generally to Text-To-Speech (TTS) synthesis.
• TTS Text-To-Speech
• the invention is particularly useful for determining natural pauses in synthesized pronunciation of a text segment.
• TTS Text to Speech
• concatenated text to speech synthesis allows electronic devices to receive an input text string .and provide a converted representation of the string in the form of synthesized speech.
• a device that may be required to synthesize speech originating from a non-deterministic number of received text strings will have difficulty in providing high quality realistic synthesized speech. That is because the pronunciation of each word or syllable (for Chinese characters and the like) to be synthesized is context and location dependent. For example, a pronunciation of a word at the end of a sentence (input text string) may be drawn out or lengthened.
• the pronunciation of the same word may be lengthened even more if it occurs in the middle of a sentence where emphasis is required at a natural speech pause.
• the pronunciation of a word depends on acoustic prosodic parameters comprising tone (pitch), volume (power or amplitude) .and duration.
• the prosodic parameter values for a word is dependent upon word position in a phrase and locations of natural speech pauses.
• TTS Text-To-Speech
• a method for automatically identifying natural speech pauses in a text string comprising: obtaining the text string comprising two ends these ends being a start end and a finish end; .analyzing at least one word in the text string to determine if there is a natural speech pause adjacent to the word, the analyzing being based on at least one predefined threshold value for the word, the threshold value being associated with a number of syllables between the word and one of the two ends of the text string; and inserting the natural speech pause into a synthesized speech signal output representative of the text string.
• the at least one predefined threshold value includes a P_word threshold value based on the number of syllables between the start end and the word.
• the at least one predefined threshold value includes a F_word threshold value based on the number of syllables between the finish end and the word.
• the least one predefined threshold value is determined by the steps of: providing a training set of transcriptions, with at least one natural speech pause identified by an inserted identifier; identifying words in each of the transcriptions as P_words and F_words; statistically analyzing the P_words and F_words in the training set; determining the F_word threshold value and P_word threshold value from results of the Statistically analyzing.
• the inserting the natural speech pause may also include pauses identified as Part Of Speech (POS) pattern natural breaks.
• the inserting the natural speech pause may also include pauses identified as Compound word natural pauses.
• Fig. 1 is a schematic block diagram of an electronic device in accordance with the present invention
• Fig. 2 illustrates a method 200 for determining threshold values associated with natural speech pauses in text strings
• Figs 3A to 3D illustrate examples of tanscriptions used for the method of Fig. 2.
• Fig. 4. illustrates a method for automatically identifying natural speech pauses in a text string
• Fig 5 is illustrates detailed of an analyzing step of FIG. 4.
• FIG. 1 there is illustrated an electronic device 100, in the form of a radio-telephone, comprising a device processor 102 operatively coupled by a bus 103 to a user interface 104 that is typically a touch screen or alternatively a display screen and keypad.
• the electronic device 100 also has an utterance corpus 106, a speech synthesizer 110, Non Volatile memory 120, Read Only Memory 118 and Radio communications module 116 all operatively coupled to the processor 102 by the bus 103.
• the speech synthesizer 110 has an output coupled to drive a speaker 112.
• the corpus 106 includes representations of words or phonemes and associated sampled, digitized and processed utterance waveforms PUWs.
• the Non Volatile memory 120 memory module
• the waveform utterance corpus comprises transcriptions, representing phrases and corresponding sampled and digitized utter.ance waveforms, text strings at locations relative to the natural phrase boundaries as described below.
• the radio frequency communications unit 116 is typically a combined receiver and transmitter having a common antenna.
• the radio frequency communications unit 116 has a transceiver coupled to antenna via a radio frequency amplifier.
• the transceiver is also coupled to a combined modulator/demodulator that couples the communications unit 116 to the processor 102.
• the non-volatile memory 120 (memory module) stores a user programmable phonebook database Db and Read Only Memory 118 stores operating code (OC) for device processor 102
• Fig. 2 there is illustrated a method 200 for determining threshold values associated with natural speech pauses in text strings. The threshold values being based on a number of preceding and following syllables in transcriptions in a training set TS.
• the method 200 effects a providing step 220 for providing the training set TS of transcriptions, typically sentences, with at least one natural speech pause identified by a manually inserted punctuation mark or identifier "
• One of these transcriptions 300 is "Based on our history
• each word in the transcription can be designated as : (i) A P_word that is identified as a word in the transcription with an immediately preceding natural pause identified by the punctuation mark "
• an identifying step 230 provides for identifying words in each of the transcriptions as (i)a P_word; (ii) a F_word; or (iii)a neutral word.
• table 1 below identifies attributes of each word in the transcription.
• the method 200 then performs a statistically analyzing step 240.
• a heuristic ratio HR of 0.75 is used to determine a P_word break threshold value PT for the word "in".
• a similar statistical analysis is used to determine at step 250 an F_word break threshold value FT for "in”, again the heuristic ratio HR of 0.75 is used.
• PT and FT values are determined for all other P_word and F_word instances for all other words in the training set TS (using the heuristic ratio HR of 0.75).
• the method 200 then ends at step 260 and all P word and F_word instances for all words in the training set TS are stored in the Non- Volatile
• FIG. 4 there is illustrated a method 400 for automatically identifying natural speech pauses in a text string STR, the pauses being for use in text to speech conversion performed on the electronic device 100.
• the method 400 effects a step 420 of obtaining the text string STR comprising two ends these ends being a start end SE and a finish end FE.
• a selecting word- step 430 selects one of the words (or a compound word CW)
• an analyzing step 440 provides for analyzing at least one word (or compound words CW) in the text string STR to determine if there is a natural speech pause adjacent to the word (or compound words CW), the analyzing being based on at least one predefined threshold value (PT or FT) for the word, the threshold value being associated with a number of syllables between the word and one of the two ends of the text string.
• the threshold value includes the P_word threshold value PT based on the number of syllables between the start end .and the word.
• the threshold value includes the F_word threshold value FT based on the number of syllables between the finish end and the word.
• step 450 determines that a pause was identified by step 440, then a natural speech pause is inserted, at step 460, for speech synthesis. Otherwise no pause is inserted for the word that was selected at the step 430.
• step 470 checks to determine if all words in the text string STR have been analyzed and if more there words not analyzed the method returns to step
• a speech synthesis step 480 provides for synthesizing speech at synthesizer 110, using the corpus 106, wherein inserting occurs of the natural speech pause or pauses (inserted into text string STR at step 460) ⁇ into a synthesized speech signal output representative of the text string STR.
• Fig. 5 there is illustrated a more detailed diagram of the analyzing step 440. Firstly, the text string STR is checked, at test step 441, to determine if it has a Part Of Speech (POS) pattern natural pause break.
• POS Part Of Speech
• POS pattern natural break pauses are as follows: 1. numeral + noun For instance: two thousand books. 2. verb + adverb For instance: look carefully
• a step 446 is effected and the break is identified as a F_word break. If no break is determined at step 441 then text string STR is checked, at test step 442, to determine if it has a Compound word natural pause insertion break.
• Examples of Compound word natural break pauses are as follows: a bit of a body of a few a fleet of a flooding of a fraction of a function of a good deal a good deal of a great deal a great deal of a growing number of a hint of a large body of a large number of a lot of land a majority of If a break is determined at step 442 then a step 446 is effected and the break is identified as a F_word break. If no break is identified at step 442 then at a step 443 a test determines if the P_word threshold value PT for the selected word has been reached. This is determined by comparing the number of syllables in the text string STR between the start end and the selected word.
• a natural break is determined and identified as a P_word break at step 444.
• a test determines if the N_word threshold value PT for the selected word has been reached. This is determined by comparing the number of syllables in the text string STR between the finish end and the selected word. If the F_word threshold value PT is reached then a natural break is determined .and identified as a F_word break at step 446. Otherwise, no break is identified at step 447.
• the present invention allows for identifying natural speech pauses in text strings for use in Text-To-Speech (TTS) synthesis thereby improving the quality of synthesized speech.
• TTS Text-To-Speech
• the detailed description provides a preferred exemplary embodiment only, and is not intended to limit the scope, applicability, or configuration of the invention. Rather, the detailed description of the prefe ⁇ ed exemplary embodiment provides those skilled in the art with an enabling description for implementing preferred exemplary embodiment of the invention. It should be understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the invention as set forth in the appended claims.

Priority Applications (1)

Applications Claiming Priority (2)

Publications (1)

Family

ID=34398361

Family Applications (1)

Country Status (5)

Cited By (119)

Families Citing this family (4)

Citations (3)

Family Cites Families (6)

• 2003
  • 2003-09-29 CN CNB031327087A patent/CN1320482C/zh not_active Expired - Lifetime
• 2004
  • 2004-09-17 WO PCT/US2004/030570 patent/WO2005034085A1/en active Application Filing
  • 2004-09-17 EP EP04784433A patent/EP1668631A4/en not_active Withdrawn
  • 2004-09-17 KR KR1020067006094A patent/KR20060056403A/ko not_active IP Right Cessation
  • 2004-09-17 RU RU2006114740/09A patent/RU2319221C1/ru not_active IP Right Cessation

Patent Citations (3)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events