JP3265995B2 - Singing voice synthesis apparatus and method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a singing voice synthesizing apparatus and method for causing a person to sing a song.

[0002]

2. Description of the Related Art Various techniques for synthesizing speech have been conventionally proposed. For example, a speech synthesizer using a formant synthesis method as disclosed in Japanese Patent Application Laid-Open No. 3-200300 is known.

In addition, parameter data is stored in advance over a plurality of steps so that the formant characteristics change in the same manner as actual instrument sounds or human voice sounds, and the stored parameter data is sequentially read out to formant. A musical sound synthesizer which synthesizes a natural musical sound or a human voice sound has also been known (Japanese Patent Laid-Open No. Hei 4-2512).
No. 97).

[0004] When singing voice synthesis is performed by using the above-mentioned conventionally known technique, for example, when the English lyrics "hit" is pronounced in correspondence with one quarter note, "h", "
i ”and“ t ”each have a sound generation time T (h), T
(I), T (t) are assigned in absolute time, and T (h) + T
A method of storing parameter data in advance so that (i) + T (t) becomes the sounding time of a quarter note (hereinafter referred to as “first
Or T (h) + T (i) +
T (t) is set to a time shorter than the sounding time of the quarter note, and when the sounding time of the last "t" ends, the sounding ends, or the sound of the last "t" is played for four minutes. A method of holding notes until the end of note generation (hereinafter referred to as "second conventional method")
Has been adopted.

[0005]

However, the first conventional method has a problem that it can only sing at a predetermined tempo. Therefore, a method of defining the pronunciation time of each phoneme as a relative time is also conceivable, but in particular, if the pronunciation time of unvoiced sounds (consonants) such as “h” and “t” is changed according to the tempo, the singing becomes unnatural. It will be something.

On the other hand, in the second conventional method, the singing is unnatural and uncomfortable when the sound is ended at the end of the sounding of "t" or when the sound of "t" is held. There's a problem.

The present invention has been made in view of the above points, and has as its object to provide a singing voice synthesizing apparatus and method capable of performing natural singing even if the tempo of a song is changed.

[0008]

According to a first aspect of the present invention, there is provided a singing voice synthesizing apparatus, comprising: a plurality of lyrics data indicating lyrics to be pronounced; and a plurality of lyrics data corresponding to the lyrics data. A singing voice synthesizer for sequentially synthesizing voices by controlling the pronunciation control means based on singing data including lyric pronunciation time data indicating the pronunciation time of the indicated lyrics in relative time. , Each consisting of phoneme symbol data indicating the phoneme of the lyrics and phoneme sounding time data designating the sounding time of the phoneme, wherein the phoneme sounding time data indicates that the phoneme is a voiced sound.
The first data that specifies the sounding time of the phoneme in absolute time, or the second data which specifies that the sound until the end of the lyrics sounding time data is sounding time indicated corresponding to the voiced while that such scolded either the phoneme is Yes
If it is not a voice sound, it consists of only the first data,
The sound control means, when the phoneme sounding time data is composed of the first data when the first data is absolute
While the phoneme is controlled to sound only for the sounding time specified between the phonemes, when the phoneme sounding time data is composed of the second data, the phoneme of the voiced sound is replaced with the lyrics sounding time corresponding to the voiced sound. It is characterized in that the sound is controlled until the sounding time indicated by the data ends.

The singing voice synthesizing device according to claim 2 is the singing voice synthesizing device according to claim 1, wherein the pronunciation control means is configured to generate the phoneme pronunciation time data in the lyrics data.
Is controlled so that a phoneme following a phoneme of a voiced sound composed of the second data is pronounced after the end of the sounding time indicated by the lyrics sounding time data corresponding to the voiced sound.

According to a third aspect of the present invention, there is provided a singing voice synthesizing method, wherein a plurality of lyric data indicating lyric to be pronounced and a lyric time indicated by the lyric data corresponding to the lyric data are set in relative time.
A singing voice synthesizing method for sequentially synthesizing voices by controlling the pronunciation control means based on singing data including lyric pronunciation time data indicated between the lyric data, wherein each of the lyric data is a phoneme of the lyrics. And phoneme sounding time data designating the sounding time of the phoneme, wherein the phoneme sounding time data indicates that the phoneme is voiced.
If it is sound, first the finger <br/> constant pronunciation time of the phoneme in absolute time data or the <br/> lyric sounding time data pronunciation time indicated corresponding to the voiced while that such scolded or a second data specifying that sound to the end,
If the phoneme is not voiced, the first data
Consists only, for the sound control unit, when the phoneme sounding time data is from said first data, said
While the first data controls the phoneme to sound only for the sounding time specified by the absolute time, when the phoneme sounding time data consists of the second data, the phoneme of the voiced sound is changed to the voiced sound. It is characterized in that control is performed so that the sound is generated until the end of the sounding time indicated by the corresponding lyrics sounding time data. In a singing voice synthesis method according to a fourth aspect of the present invention, in the singing voice synthesis method according to the third aspect, the phoneme generation in the lyrics data is transmitted to the pronunciation control means.
A phoneme whose sound time data follows a voiced phoneme composed of the second data is controlled so as to sound after the end of the sounding time indicated by the lyrics sounding time data corresponding to the voiced sound.

According to the singing voice synthesizing apparatus according to the first aspect or the singing voice synthesizing method according to the third aspect, when the phoneme is pronounced,
The interim data is the second data, that is, the phoneme is a voiced sound.
In some cases, the lyrics pronunciation time data corresponding to the voiced sound is
Data that specifies sounding until the end of the indicated sounding time
, The phoneme of the voiced sound is associated with the voiced sound.
Sounds until the end of the sounding time indicated by the corresponding phoneme sounding time data
The sound control means is controlled so as to make a sound .

[0012]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of a singing electronic device according to an embodiment of the present invention.
And CPU1 which controls the entire apparatus, R the formant data for programs, tables, etc. necessary for the execution of the program and the tone synthesis is performed by CPU1 is stored
OM2, a RAM 3 used as a working area of the CPU 1 and stores data in the middle of calculation, a data memory 4 storing singing data and accompaniment data for voice synthesis, and displays various parameters and operation modes of the apparatus. A display unit 5 for performing a performance operation by a player, for example, a performance operator 6 such as a keyboard, a setting operator 7 for designating a performance mode, and the like, and synthesizing voice or musical sound based on formant data. Sound source 8 for performing digital audio, a DA converter 9 for converting a digital signal output from the formant sound source 8 into an analog signal, and a sound system 10 for amplifying an output signal of the DA converter and outputting the amplified signal from a speaker.
And a bus 11 for interconnecting the above components 1 to 8.

The formant sound source 8 has a plurality of sound source channels 80. The sound source channel 80 is composed of four vowel formant generators VTG1 to VTG4 and four consonant formant generators UTG1 to UTG4. As described above, a method of providing four formant generators for vowels and consonants, respectively, and adding the outputs of these formant generators to synthesize a voice is described in, for example, Japanese Patent Application Laid-Open No. 3-200300. Known as shown.

FIG. 2 is a diagram showing the structure of data stored in the ROM 2, RAM 3, and data memory 4.

The ROM 2 stores a program executed by the CPU 1 and formant data PHDATA (FIG. 1A). Formant data PHDATA is
Data PHDATA [a], PHDATA corresponding to Japanese and English phonemes (vowels (voiced sounds) and consonants)
[E],... PHDATA [z], each formant data PHDATA is a formant center frequency,
It consists of parameters such as formant level and formant bandwidth. These parameters are configured as time-series data, and the time-varying formants are reproduced by sequentially reading them at predetermined timing.

The RAM 3 constitutes a working area used by the CPU 1 for calculation and an area having a function as a song buffer into which the performance sequence data is loaded (FIG. 2B).

The data memory 4 stores n song data SONG1, SONG2,..., SONGn (FIG. 4C). Each song data SONG is stored in the data memory 4 as shown in FIG. Song name data SOGN indicating song title
AME, tempo data TEMPO indicating the tempo of the song, data MISCDATA specifying the beat, timbre, etc., singing data LYRICSEQDAT including lyrics data, pitch data, velocity data, duration data, etc.
A and accompaniment data ACCOM indicating performance data of accompaniment
It is composed of PDATA.

Each singing data LYRICSEQDATA
Consists of m pieces of lyric note data LYRICNOTE and end data LYRICEND indicating the end of singing data. Each piece of lyric note data LYRICNOTE is composed of lyric phoneme data LYPHDATA and key-on data KEY.
ON, duration data DURATION, and key-off data KEYOFF. Lyric phoneme data L
YPHDATA indicates each phoneme of the lyrics (for example, lyrics "hi
In the example of "t", phoneme symbol data LYPHONE indicating "h", "i", "t") and phoneme sounding time data PHONETIME specifying the sounding time of the phoneme are arranged in order of sounding. Data KEYON
Represents pitch data (for example, C3) and velocity data V
(For example, 64), which determines the pitch and the rising envelope. Duration data D
URATION (for example, DUR 96) is data indicating a sound generation time (relative time), and includes tempo data TEM.
The data is converted into data corresponding to the absolute time according to the PO and the interrupt clock time. Key-off data KEYOFF
Is data indicating the end of sound generation.

FIG. 2F shows the lyrics "hit" and "y".
lyrics note data LYRICNOT corresponding to "uki"
An example of E is shown. Here, the phoneme sounding time data PH
In principle, ONETIME specifies the sound production time in absolute time (in FIG.
1 is set to “5”. For example, if the basic time unit is 8 msec, 8 msec × 5 = 40 msec
c), if specified as “0” (“hit”
"I" and "u" of "yuki" (hereinafter referred to as "zero designation") mean that the vowel is pronounced until the end of the duration, as will be described in detail later. Then, the following phonemes (“t” and “yuki” of “hit”)
“Ki”) is controlled so that it is pronounced after the end of the duration.

FIG. 3 is a flowchart of a main program executed by the CPU 1, and the execution of this program is started when the power of the apparatus is turned on.

First, in step S1, processing settings of various parameters are performed, and then the performance operator 6 and the setting operator 7
(Step S2).
In the following step S3, it is determined whether or not the performance process based on the song data SONG is being executed, and if the performance has not been started, it is determined whether or not there is a selection event of the song data SONG (step S4). . Immediately if there is no selection event, or if there is a selection event, the selected song data SONG is transferred from the data memory 4 to the song buffer of the RAM 3 (step S
5) Go to step S6.

In step S6, it is determined whether or not there is song data SONG in the song buffer of the RAM 3. If not, the process returns to step S2, and if so, it is determined whether or not a singing performance start operation event is present (step S6). S
7). If there is no operation event, the process immediately returns to step S2. If there is, the singing performance process is started, and various flags (key-on flag KEYONFLG indicating "1" indicating that sound generation processing is being executed based on lyrics note data LYRICNOTE). , Duration data DURA
A note-on flag NOTEONFLG indicating "1" indicates that the sounding time (hereinafter, referred to as "duration time") specified by TION is present, and phoneme sounding time data PHO.
A formant timer flag FTIMER which indicates by "1" that the sounding time is being specified by NETTIME.
LG, a zero designation flag PHTIMEZEROFLG indicating “0” has been designated, a remaining process flag RESTFLG designated “1” indicating that the process is being performed after the end of the duration time when zero is designated, and a pointer i. Initialize (step S8) and return to step S2.

When the singing performance process starts, step S
Then, the process proceeds from step 3 to step S9 to execute a performance process (SONG performance process, FIG. 4) based on the song data SONG loaded into the song buffer of the RAM 3. Then, it is determined whether or not there is a stop operation event of the singing performance processing (step S10). Immediately if there is no such operation event, and if there is such an operation event, a singing performance stop processing is executed. It returns to step S2.

FIG. 4 is a graph showing the relationship between SO and SO in step S9 in FIG.
It is a flowchart of an NG performance process, which is a performance process (L) based on the singing data LYRICSEQDATA.
YRICSEQDATA performance processing, step S21)
And performance processing based on the accompaniment data ACCOMPDATA (ACCOMPDATA performance processing, step S22).

FIGS. 5, 6, and 7 show steps S21 in FIG.
6 is a flowchart of LYRICSEQDATA performance processing in FIG.

In step S31, the key-on flag KE
It is determined whether or not YONFLG is "0".
Since NFLG = 0, the i-th lyrics note data L
YRICNOTEi is read (step S32), and it is determined whether or not the read data is end data LYRICEND (step S33). If the end data is LYRICEND, singing performance end processing is executed (step S36), and this processing ends. If the end data is not LYRICEND, the duration data DURATION is converted to the tempo data TEMPO and the interrupt clock time (specifically, TIMER shown in FIG. 8).
The time data is converted into time data corresponding to the interrupt processing execution interval) and set in the note timer NOTETIMER (step
Step S34) . The value of this timer is decremented by “1” each time the processing in FIG. 8 is executed.

In the following step S35, the pointer k is set to "1" and the key-on flag KEYON is set.
The FLG and the note-on flag NOTEONFLG are both set to "1", and the process proceeds to step S41 in FIG. In the step S41, it is determined whether or not the remaining processing flag RESTFLG is “0”. Initially, RESTFLG = 0, so the process proceeds to step S42, where the note-on flag N
It is determined whether or not OTEONFLG is “1”. When the duration time elapses and the value of the note timer NOTETIMER becomes "0", the note-on flag NOTEONFLG is returned from "1" to "0" (FIG. 8, steps S73 and S74). Since there is, the process proceeds to step S43.

In step S43, a zero designation flag PH
It is determined whether or not TIMEZEROFLG is "0". Since PHTIMEZEROFLG is initially 0, the process proceeds to step S44, where the formant timer flag FTIM is set.
It is determined whether or not ERFLG is “0”. Initially F
Since TIMERFLG = 0, step S5 in FIG.
1 and the phoneme symbol data LYPHO indicated by the pointer k.
Read NE. Next, the read phoneme symbol data L
It is determined whether or not YPHONE is a vowel (step S5).
2) If it is not a vowel, it is determined whether or not it is a consonant (step S53).

For example, if the phoneme symbol data LYPHONE is "
If h ", the process proceeds to step S54 via steps S52 and S53. Incidentally, steps S52 and S5
If the answer to 3 is both negative (NO), it is determined that the sounding of one piece of lyric note data LYRICNOTE has been completed, and the process proceeds to step S48 in FIG.

In step S54, the formant timer FTIMER is set to the phoneme sounding time data PHONETIME indicated by the pointer k, the formant timer flag FTIMERLG is set to "1", and the formant timer FTIMER is started (step S54). Like the note timer NOTETIMER, the formant timer FTIMER is decremented in the process of FIG. 8, and when its value becomes "0", the formant timer flag FTIMERLG is set to "0" (steps S76 to S78).

In the following step S55, the phoneme symbol data LYPHONEk is transferred to the consonant formant generating unit UTG, and then sound generation is started at the velocity specified by the key-on data KEYON (step S56), and the pointer k is incremented by "1". (Step S5
7), end this processing.

Thereafter, in the process of FIG.
Until the value of TIMER becomes “0” and the formant timer flag FTIMERLG becomes “0”, the operation of immediately ending this processing from step S44 is repeated.

The processing in FIG. 8 is performed for a predetermined time (for example, 8 msec).
c) is executed every time. In this process, first, in step S7
It is determined at 1 whether or not the key-on flag KEYONFLG is "1". If KEYONFLG = 0, the process immediately proceeds to step S75. If KEYONFLG = 1, the value of the note timer NOTETIMER is decremented by "1" (step S72), the value of the timer is “0”
It is determined whether or not this is the case (step S73). And NOT
While ETIMER> 0, the process immediately proceeds to step S75, and when NOTETIMER = 0, the note-on flag NOTEONFLG is set to “0” (step S75).
74), and proceeds to step S75.

In step S75, it is determined whether or not the formant timer flag FTIMERLG is "1".
If TIMERFLG = 0, immediately step S7
Then, if FTIMERLG = 1, the value of the formant timer FTIMER is decremented by "1" (step S76), and it is determined whether or not the value of the timer is "0" (step S77). And FTIME
While R> 0, the process immediately proceeds to step S79, and the FTI
When MER = 0, the formant timer flag FTI
MERFLG is set to "0" (step S78),
Proceed to step S79.

In step S79, another interrupt process is executed, and the process ends.

As described above, the duration time and the sounding time of each phoneme are managed by the processing of FIG.

Referring back to FIG. 6, the formant timer flag F
When TIMERFLG becomes "0", the process proceeds from step S44 to step S51, where the next phoneme symbol data LYP
Read HONEk.

In the following step S52, phoneme symbol data LY
When PHONEk is a vowel (for example, "hit"
i "), the phoneme sounding time data PHONE
It is determined whether or not TIMEk is not "0", that is, whether or not zero is specified (step S61).
If zero is specified (for example, in the case of the phoneme "i" shown in FIG. 2 (f)), the process proceeds to step S63, where it is determined whether or not a zero specification flag PHTIMEZEROFLG is "0". Initially, PHTIMEZEROFLG = 0. Therefore, the flag PHTIMEZEROFLG is set to “1”, and the process proceeds to step S67. Since the vowel designated as zero continues sounding until the end of the duration time, the formant timer FTIMER is not set.

On the other hand, when zero is not specified,
The formant timer FTIMER is set to the phoneme sounding time data PHONETIMEk indicated by the pointer k, the formant timer flag FTIMERLG is set to "1", the formant timer FTIMER is started (step S62), and the process proceeds to step S67.

In step S67, the phoneme symbol data LY
PHONEk is transferred to the vowel formant generation unit VTG, and then sound generation is started at the pitch and velocity designated by the key-on data KEYON (step S68), and the pointer k is incremented by "1" (step S68).
69), end the present process.

In the example of the lyrics "hit" shown in FIG. 2 (f), since "i" is specified as zero, the operation of immediately terminating the process from step S43 is repeated. Then, the duration time ends and the note timer NOT
The value of ETIMER becomes “0” and the note-on flag N
When OTEONFLG becomes "0", the process proceeds from step S42 to step S45, and the zero designation flag PHTIMEZ
It is determined whether or not EROFLG is “1”. In this example, P
Since HTIMEZERO = 1, the vowel (“”
i ") is silenced, and the remaining process flag RESTFLG is set to" 1 "(step S46), and step S51 is performed.
Proceed to.

In step S51, the phoneme symbol data LYPHONE ("t") is read next, and step S52 is executed.
To S57. Thereafter, the process of directly proceeding from step S41 to step S44 is repeated. When the value of the formant timer FTIMER becomes “0” and the formant timer flag FTIMERLG becomes 0, the process proceeds to step S48 via steps S51, S52, and S53, Key-on flag KEYONFLG, formant timer flag FTIMERLG, note-on flag N
OTEONFLG, zero setting flag PHTIMEZEER
The OFLG and the remaining process flag RESTFLG are set to “0”, the pointer i is incremented by “1”, and the process ends.

The lyrics note data LYRICNOT
If there is no phoneme designated as zero in E, when the duration time ends, the process proceeds from step S45 to step S45.
Proceeding to 47, mute the vowel or consonant being pronounced, and proceed to step S48.

One piece of lyrics note data LYRIC
If two or more zeros are specified in NOTE,
The answer to step S63 in FIG. 7 is negative (NO), the process proceeds to step S65, the value of the pointer k is incremented by "1", and then the formant timer flag FTI
MERFLG is set to "0" (step S66),
It returns to step S51. As a result, the second and subsequent vowels designated as zero in one piece of lyric note data are controlled so as not to sound.

FIG. 9 shows the lyrics "hi" in which the phoneme sounding time data PHONETIME is set as shown in FIG. 2 (f).
12 is a diagram for explaining a process of generating “t” corresponding to a quarter note at pitch C3. Key-on timing (time t
The sounding of the phoneme "h" starts from 1), and when the sounding time specified by the phoneme sounding time data PHONETIME1 has elapsed (time t2), the sounding of the phoneme "i" is started. At this time, the sound level of the phoneme "h" is attenuated according to a predetermined attenuation characteristic. Since the phoneme “i” is specified as zero, the end time of the duration time (time t
3) is pronounced, and then the phoneme "t" is pronounced for the designated pronunciation time.

An example in which the lyrics are "yuki" (FIG. 2)
In (f), lower side, since the phoneme "u" is designated as zero, this vowel is pronounced until the end of the duration time, and the phonemes "k" and "i" are emitted thereafter.

As described above, in the present embodiment, the vowel phonemes designated as zero in the lyric note data LYRICNOTE are pronounced until the end of the duration time, so that natural singing can be performed even if the tempo of the music is changed. It can be performed.

When a long lyrics is assigned to one note, the vocal sound to be specified by zero is changed (for example, "konnichi" is changed to "konnichiwa") so that the feeling of singing is changed. Can be changed, and the singing expression can be improved.

The present invention is not limited to the above-described embodiments, but can be implemented in various forms. For example, in the above embodiment, the song data SON
G is stored in the data memory 4, but may be supplied from an external device by providing a MIDI interface.

The method of speech synthesis is not limited to the formant synthesis method, and other methods may be employed. Also, CP
U may execute up to the speech synthesis process.

[0052]

As described above in detail, according to the singing voice synthesizing apparatus according to the first aspect or the singing voice synthesizing method according to the third aspect, the phoneme sounding time data is the second data, that is, the second data.
If the phoneme is a voiced sound, it corresponds to the voiced sound
Produces until the end of the pronunciation time indicated by the lyrics pronunciation time data
Data that specifies that voiced sound
A phoneme is indicated by phoneme sounding time data corresponding to the voiced sound.
The sound control means is used to sound until the end of the sounding time.
Since the control is performed, natural singing can be performed even when the tempo of the music is changed, and singing expression can be improved.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a singing electronic device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of data stored in each memory of FIG. 1;

FIG. 3 is a flowchart of a main program executed by a CPU of FIG. 1;

FIG. 4 is a flowchart of a singing performance process.

FIG. 5 shows the singing data (LYRICSEQDAT) of FIG.
A) It is a flowchart which shows a performance process in detail.

FIG. 6 shows the singing data (LYRICSEQDAT) of FIG.
A) It is a flowchart which shows a performance process in detail.

FIG. 7 shows the singing data (LYRICSEQDAT) of FIG.
A) It is a flowchart which shows a performance process in detail.

FIG. 8 is a flowchart of a timer interrupt process.

FIG. 9 is a diagram for explaining singing data performance processing;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 CPU 2 ROM 3 RAM 4 Data memory 8 Formant sound source 9 DA converter 10 Sound system

Continued on the front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G10L 13/06 G10H 7/02 G10K 15/04 302 G10L 13/00 JICST file (JOIS)

Claims (4)

(57) [Claims] 1. Based on singing data including a plurality of lyrics data indicating lyrics to be pronounced, and lyrics pronunciation time data corresponding to the lyrics data and indicating the pronunciation time of the lyrics indicated by the lyrics data in relative time. A singing voice synthesizer that sequentially synthesizes voices by controlling pronunciation control means, wherein each of the lyrics data specifies phoneme symbol data indicating a phoneme of the lyrics and a sounding time of the phoneme, respectively. Phoneme sounding time data, wherein the phoneme sounding time data indicates that the phoneme is a voiced sound.
In this case, the first time to specify the sounding time of the phoneme in absolute time
Data, or the lyrics sounding time second one that such scolded any data that specifies that the sound until the end of the data is sounding time indicated corresponding to the voiced speech is the phoneme
If it is not a voiced sound, only the first data is used.
Ri, the sound control means, when the phoneme sounding time data is composed of the first data when the first data is absolute
While the phoneme is controlled so as to sound the phoneme only for a specified sounding time, when the phoneme sounding time data is composed of the second data, the phoneme of the voiced sound is replaced with the lyrics sounding time corresponding to the voiced sound. A singing voice synthesizing device that controls sound generation until the end of a sounding time indicated by data. 2. The phonemic control means according to claim 1, wherein said phoneme sounding time data in said lyrics data is composed of said second data. A phoneme following a voiced phoneme is said phoneme corresponding to said voiced sound. 2. The singing voice synthesizing apparatus according to claim 1, wherein the singing voice synthesizing device is controlled so as to generate a sound after the utterance time indicated by the utterance time data. 3. Based on singing data including a plurality of lyrics data indicating lyrics to be pronounced, and lyrics pronunciation time data corresponding to the lyrics data and indicating the pronunciation time of the lyrics indicated by the lyrics data in relative time. A singing voice synthesizing method for sequentially synthesizing voices by controlling pronunciation control means, wherein each of the lyrics data specifies phoneme symbol data indicating a phoneme of the lyrics and a sounding time of the phoneme, respectively. Phoneme sounding time data, wherein the phoneme sounding time data indicates that the phoneme is a voiced sound.
In this case, the first time to specify the sounding time of the phoneme in absolute time
Data, or the lyrics sounding time second one that such scolded any data that specifies that the sound until the end of the data is sounding time indicated corresponding to the voiced speech is the phoneme
If it is not a voiced sound, only the first data is used.
Ri, for the sound control unit, when the phoneme sounding time data is composed of the first data, while the first data is controlled so as to sound the sounding time only the phonemes specified in absolute time , When the phoneme sounding time data is composed of the second data, the phoneme of the voiced sound is
A singing voice synthesizing method, wherein the singing voice synthesizing method is controlled so that sound is generated until the end of the sounding time indicated by the lyrics sounding time data corresponding to the voiced sound. 4. A method according to claim 1, wherein said phoneme sounding time data in said lyrics data is said second data.
Followed phoneme voiced consisting phonemes corresponding to the voiced
4. The singing voice synthesizing method according to claim 3, wherein the singing voice synthesis is controlled so that the singing voice is generated after the utterance time indicated by the lyric sound generation time data ends.