JP4432834B2 - Singing composition device and singing composition program - Google Patents

Description

  The present invention relates to a singing voice synthesizing apparatus and a singing voice synthesis program for synthesizing singing sounds.

Various song synthesizers have been proposed that store lyric data and note data, read out the lyric data in response to reading out the note data, and sing the lyrics by generating phonemes corresponding to the lyric data. This type of synthesizer is required to have a function of synthesizing natural human-like singing sounds. Observing the human singing sound, the pitch of the singing sound does not change stepwise according to the note data, but changes from a utterance corresponding to one note to a utterance corresponding to the next note. Draw and change continuously. This change is thought to contribute to the human nature of singing. Therefore, conventionally, in a synthesizer, studies have been made to give human-like changes to the pitch of the synthesized singing sound. For example, when synthesizing a singing sound corresponding to two consecutive notes, Patent Document 1 connects pitches corresponding to each note with a straight line, and obtains a pitch curve provided with an overshoot part before and after the straight line. An apparatus for synthesizing a singing sound whose pitch changes according to this pitch curve is proposed.
JP 2003-323188 A

  However, in the singing voice synthesizing device disclosed in Patent Document 1 described above, after the pitch of the synthesized singing sound reaches the pitch corresponding to the note, there is no change in the pitch of the singing sound. There was a problem that it was easy to become an artificial singing voice similar to a buzzer sound.

  The present invention has been made in view of the circumstances described above, and even in a section after the pitch of the synthesized singing sound has reached the pitch corresponding to the note, the pitch can be changed, which is natural. An object is to provide a singing voice synthesizing apparatus and a singing voice synthesizing program capable of obtaining a singing sound.

According to the present invention, the pitch of the singing sound pitch is determined for each note constituting the song in accordance with the data for determining the relative positions of the three types of control points that are the passage points of the pitch of the singing sound within a single note interval. A control point setting means for setting a control point to be a passing point of the trajectory, a dispersion means for generating a pseudo random number, and distributing the time of the control point set by the control point setting means in accordance with the generated pseudo random number; The trajectory passing through each control point set by the control point setting means is obtained according to a calculation method determined for each section between the two types of control points to be generated, and pitch data for changing the pitch along the trajectory is generated. A singing composition comprising: pitch data generating means for storing in the storing means; and output means for reading the pitch data from the storing means and outputting the singing sound to a sound source. Providing singing synthesis program to function location and computer as the singing voice synthesizing apparatus.
According to this invention, since the control point is set for each note and the pitch of the synthesized singing sound can be changed along the trajectory passing through the control point, the pitch of the synthesized singing sound is changed to the note. Even in the section after reaching the corresponding pitch, the pitch can be changed, and a natural singing sound can be obtained.

Embodiments of the present invention will be described below with reference to the drawings.
<First Embodiment>
FIG. 1 is a block diagram showing a configuration of a singing voice synthesizing apparatus according to the first embodiment of the present invention. This singing voice synthesizing apparatus is obtained by installing a singing voice synthesis program on a computer such as a personal computer having a function of synthesizing and outputting a voice. In FIG. 1, CPU1 is a control center which controls each part of this song synthesis apparatus. The ROM 2 is a read-only memory that stores a control program for controlling basic operations of the singing voice synthesizing apparatus such as a loader. The display unit 3 is a device for displaying an operation state of the device, input data, a message for the operator, and the like. The operation unit 4 is a means for receiving commands and various types of information from the user, and includes various types of operators such as a keyboard and a mouse. The interface group 5 includes a network interface for performing data communication with other devices via a network, a driver for transmitting / receiving data to / from an external storage medium such as a magnetic disk or a CD-ROM, and the like. It is comprised by. The HDD (hard disk device) 6 is a non-volatile storage device for storing information such as various programs and databases. The RAM 7 is a volatile memory used as a work area by the CPU 1. The CPU 1 loads a program in the HDD 6 into the RAM 7 and executes it in accordance with a command given via the operation unit 4.

  The formant sound source 8 is a sound source that synthesizes a singing sound under the control of the CPU 1. The formant sound source 8 is provided with formant center frequency data FFreq, formant level data Flevel and formant shape data FShape as information for specifying the formant of the singing sound, and pitch data PITCH specifying the pitch of the singing sound. It is done. The formant sound source 8 synthesizes a singing sound having a formant and pitch designated by these data, and outputs it from the sound system 9.

  Information stored in the HDD 6 includes a song editing program 61, song data 62, a phoneme database 63, and a song synthesis program 64. The song data 62 is data composed of note data representing a series of notes constituting the song and lyrics data representing lyrics uttered in accordance with the notes, and is edited for each song and stored in the HDD 6. The song editing program 61 is a program executed by the CPU 1 to edit song data. In a preferred embodiment, the song editing program 61 causes the display unit 3 to display a GUI (graphical user interface) including an image of a piano keyboard. The user can designate an image of a desired key on the keyboard displayed on the display unit 3 by operating the operation unit 4, and can input lyrics to be uttered in accordance with the note by operating the operation unit 4. In this way, the song editing program 61 receives information about the notes and the lyrics to be uttered in accordance with the notes from the user via the operation unit 4 and stores the note data and the lyrics data for each note in the HDD 6 as the song data 62. To store.

  The note data corresponding to one note includes information indicating the note generation time, pitch, and note length. The lyric data is data in which lyrics to be pronounced in accordance with the notes are defined for each note. The song data 62 is a chronological arrangement of note data and lyrics data corresponding to each note in accordance with the generation order from the start of the song. In the song data 62, the note data and the lyrics data are Corresponds in note units.

  The song synthesis program 64 is a program that causes the CPU 1 to execute a process of causing the formant sound source 8 to synthesize a song sound according to the song data 62. In a preferred embodiment, the song synthesis program 64 and the song editing program 61 are downloaded from a site in the Internet, for example, through an appropriate one in the interface group 5 and installed in the HDD 6. In another aspect, the song synthesis program 64 and the like are traded in a state stored in a computer-readable storage medium such as a CD-ROM or MD. In this aspect, the song synthesis program 64 and the like are read from the storage medium via an appropriate one in the interface group 5 and installed in the HDD 6. The phonological database 63 is a collection of phonological data groups referred to by the song synthesis program 64. In the phonological database 63, a group of phonological data is prepared for each type of generated voice, for example, male voice, female voice, or a specific singer. At the time of singing synthesis by the singing synthesis program 64, the user can select a group of phonological data to be used according to the voice quality to be uttered by operating the operation unit 4. The phoneme data constituting each group is a parameter for formant synthesis of each phoneme. For each phoneme, formant shape data FShape for designating the shape of each formant for generating the phoneme, the center frequency of each formant Are formant center frequency data FFreq and formant level data FLlevel for designating the output level of each formant.

  FIG. 2 shows the processing contents of the song synthesis program 64. The song synthesis program 64 is roughly divided into a song synthesis score generation process 64A and a song synthesis score output process 64B. The singing synthesis score generation process 64A is based on the song data 62 designated by the user and the phonological data of the group designated by the user in the phonological database 63, and the singing synthesis score comprising the pitch data track 71 and the phonological data track 72. This is a process of generating 70 in the work area in the RAM 7 (see FIG. 1). Here, the pitch data track 71 is a data stream in which pitch data PITCH specifying the pitch of the singing sound is arranged in time series as time passes from the start point of the song. The phonological data track 72 is a data stream in which formant shape data FShape characterizing the formant of the singing sound, formant center frequency data FFreq, and formant level data FLlevel are arranged in time series as time passes from the start of the song.

  The song synthesis score generation process 64A includes a control point setting process 641 and a pitch data generation process 642 as processes for generating the pitch data track 71. In the present embodiment, in order to enrich the expression of the singing sound, the pitch of the singing sound after reaching the pitch corresponding to the note is changed along a certain trajectory, and this pitch has a temporal change. A singing sound is generated in the formant sound source 8. In order to change the pitch of the singing sound in this way, the control point setting process 641 basically has three control points A and B as target passage points of the pitch trajectory of the singing sound synthesized for each note. And C, exceptionally defining two or one of them control points. Here, after the pitch of the singing sound reaches the pitch corresponding to the note, the control point A is the target passage point that should pass first, and the control point B is the target passage point that should pass second, the control point C Is the target passing point that should be passed last.

  In order to determine such control points for each note, in this embodiment, data relating to control points A, B, and C are prepared in advance. Here, the data relating to the control points A and B are information indicating the elapsed time from the note start time (note-on timing) to the control point A or B, and the note determined by the pitch of the control point A or B and the equal temperament. And a cent value indicating a pitch difference from the pitch. Further, the data related to the control point C is a pitch difference between the information indicating the remaining time from the control point C to the note end time (note-off timing) and the pitch of the note determined by the pitch of the control point C and the equal temperament. And a cent value indicating. In the control point setting process 641, the timing and pitch of the control points A, B, and C are determined for each note based on the note data of the note and the data related to these control points A, B, and C.

  In the pitch data generation processing 642, a pitch trajectory passing through these control points A, B and C is obtained, pitch data for changing the pitch along this trajectory is generated, and this pitch data is stored in the pitch data track 71. To do. In the present embodiment, functions for determining the pitch trajectory of each section are defined in advance between the control points A and B, between the control points B and C, and between the control point C and the control point A of the next note. ing. The pitch data generation process 642 uses these functions to determine the pitch trajectory that passes through each control point.

  The singing synthesis score generation process 64 </ b> A includes a phonological extraction process 643 and a phonological data generation process 644 as processes for generating the phonological data track 72. The phoneme extraction process 643 is a process of sequentially extracting phonemes from the lyrics indicated by the lyrics data 62B. The phoneme data generation process 644 is phoneme data for synthesizing the phonemes extracted by the phoneme extraction process 643 from the groups specified by the user among the phoneme data in the phoneme database 63, specifically, formant shape. Data FShape, formant center frequency data FFreq, and formant level data FLlevel are read and stored in the phoneme data track 72.

The singing synthesis score output processing 64B performs synchronous reproduction of the pitch data track 71 and the phonological data track 72 generated by the singing synthetic score generation processing 64A described above, and the pitch data PITCH and the formant shape data FShape, which is phonological data, This is a process of supplying formant center frequency data FFreq and formant level data FLlevel to the formant sound source 8. More specifically, in the singing synthesis score output process 64B, the pitch data PITCH and phonological data corresponding to each note are read from the pitch data track 71 and the phonological data track 72 and supplied to the formant sound source 8 as the music progresses. In the singing synthesis score output process 64B, syllables consisting only of vowels are output from the formant sound source 8 at the note-on timing of the notes, and syllables consisting of consonants and vowels are composed of the vowel part at the note-on timing of the notes. The timing of supplying each phoneme data to the formant sound source 8 is controlled.
The above is the outline of the processing content of the song synthesis program. Note that details of the song synthesis program, particularly the details of the control point setting process 641 and the pitch data generation process 642, will be clarified in the description of the operation of this embodiment in order to avoid duplication of explanation.

  Next, the operation of this embodiment will be described. In addition, below, the operation | movement of singing composition which is the characteristics of this embodiment is demonstrated, and description of another operation | movement is abbreviate | omitted. When a predetermined instruction is given via the operation unit 4, the CPU 1 loads the song synthesis program 64 in the HDD 6 into the RAM 7 and executes it. In the process of executing the song synthesis program 64, when song data 62 to be synthesized and a group of phonological data used for synthesis are designated by the operation of the operation unit 4, and an instruction to start song synthesis is given by the user. First, the execution of the song synthesis score generation process 64A is started, and the execution of the song synthesis score output process 64B is started a little later.

  In the singing synthesis score generation process 64A, the pitch data track 71 is generated from the note data 62A by executing the control point setting process 641 and the pitch data generation process 642, and the lyric data 62B by executing the phoneme extraction process 643 and the phoneme data generation process 644. From the phoneme data track 72 is generated.

  In the singing synthesis score output process 64B, the pitch data track 71 and the phonological data track 72 generated by the singing synthesis score generation process 64A are synchronously reproduced, and the pitch data PITCH and the phonological data are supplied to the formant sound source 8. As a result, a singing sound having a formant characterized by phonological data and having a pitch specified by the pitch data PITCH is sequentially synthesized by the formant sound source 8 and output from the sound system 9.

  In the present embodiment, a control point setting process 641 and a pitch data generation process 642 are executed as means for controlling the pitch of the singing sound synthesized by the formant sound source 8. For this reason, the aspect of the change of the pitch of the singing sound synthesize | combined by the formant sound source 8 becomes a characteristic of this embodiment so that it may demonstrate below.

  FIGS. 3A to 3C show execution examples of the control point setting process 641 and the pitch data generation process 642. FIG. 3A illustrates the contents of the note data 62A. In this figure, the horizontal axis is time, and the vertical axis is the pitch of notes. As shown in this figure, the pitch of a series of musical notes N0 to N4 represented by the musical note data 62A changes in a staircase pattern. In the control point setting process 641, control points are set for these notes N0 to N4. In the pitch data generation process 642, a pitch trajectory passing through each control point is obtained, and pitch data for changing the pitch along this trajectory. Is generated. FIG. 3B shows a state in which control points A, B, and C are set for the note N1, and a pitch trajectory connecting these control points is determined. In the example shown in FIG. 3B, the pitch of the control points A and C is slightly higher than the pitch of the note, and the pitch of the control point B is lower than the pitch of the note.

  In the control point setting process 641, basically three control points A, B, and C are set for one note. However, if the note length of the note is shorter than the first threshold, the last control point C is deleted, and only the control points A and B are set. Further, if the note length of the note is shorter than the second threshold shorter than the first threshold and is not worth setting two control points, only the control point A is set to that note. In FIG. 3C, three control points A, B, and C are set for notes N1 and N4 having a long note length, and two control points A and B are set for a note N3 having a note length shorter than the first threshold. Is set, and one control point A is set for a note N2 having a note length shorter than the second threshold.

  In the pitch data generation process 642, between the control points A and B, between the control points B and C, between the last control point (usually control point C, exceptionally control point B or A) and the control point A of the subsequent note. The pitch trajectory calculation method is determined for each of the sections, and the trajectory of each section is calculated according to this calculation method. Various modes are conceivable for the method of calculating the trajectory between the control points. In FIG. 3B, the first mode in which the straight line connecting the control points A and B is the pitch trajectory is indicated by a broken line, and the gentle valley connecting the control points A and B is the pitch trajectory. Two aspects are shown in solid lines.

In the first aspect, for example, the pitch p on the trajectory between the control points A and B at time t can be obtained by the following equation.
p = pA + ((pB−pA) / (tB−tA)) (t−tA) (1)
Here, pA is the pitch of the control point A, pB is the pitch of the control point B, tA is the time of the control point A, and tB is the time of the control point B.

In the second mode, the pitch P on the trajectory between the control points A and B can be obtained by the following equation.
p = pA + ((pB−pA) / (tB−tA)) (t−tA)
−v1sin ² (π (t−tA) / (tB−tA)) (2)
Here, v1 is a parameter representing the depth of the valley.
The same applies to the trajectory of the pitch between the control points B and C, and this trajectory may be a straight line connecting the control points or a curved line.
In the present embodiment, the trajectory between the control points A and B is a valley and the trajectory between the control points B and C is a straight line according to the behavior of the pitch in an actual human singing sound.

  The pitch trajectory at the note switching portion is a straight line or a curve connecting the last control point of the preceding note (usually control point C) and the first control point A of the following note. In the example shown in FIG. 3C, a curve connecting the last control point C of the preceding note N0 and the first control point A of the succeeding note N1 as the trajectory of the pitch at the switching portion from the note N0 to the note N1. Is adopted. When observing the actual movement of the pitch of the singing voice, the pitch trajectory of the note switching portion is often bent as shown by the solid line in FIG. Therefore, in the pitch data generation processing 642 in the preferred embodiment, the trajectory of the section between the last control point of the preceding note (usually control point C, exceptionally control point B or A) and the subsequent first control point. Is obtained as follows.

That is, the time is t, the time of the last control point of the preceding note is tC, the pitch of the control point is pC, the time of the first control point A of the subsequent note is tA, and the pitch of the control point is pA. In this case, the interval of t ≦ (tA + tC) / 2 is determined according to the equation (3), and the interval of t> (tA + tC) / 2 is determined according to the equation (4) to obtain the pitch p of the note switching portion.
p = (pA + pC) / 2
− ((PA−pC) / 2) (1-2 (t−tC) / (tA−tC)) ^α ) (3)
p = (pA + pC) / 2
+ ((PA−pC) / 2) (2 (t−tC) / (tA−tC) −1) ^α ) (4)

  In the above formulas (3) and (4), α is a parameter for adjusting the bending degree of the pitch change. When the parameter α is 1, the trajectory between the control points is a straight line as shown by a broken line in FIG. When the parameter α is a positive number smaller than 1, as shown by a solid line in FIG. 4, the trajectory in the first half section t ≦ (tA + tC) / 2 becomes a downwardly bent curve, and the second half t> The trajectory in the section of (tA + tC) / 2 is a curved line bent upward. In a preferred embodiment, this curve is employed as the pitch trajectory of the note switching portion. When the parameter α is a positive number larger than 1, conversely, the trajectory in the first half section is a curved line bent upward, and the trajectory in the second half section is a curved line bent downward.

  A trough (see FIG. 3B) as applied to the trajectory between the control points A and B described above may be provided on the trajectory of the pitch at which the notes are switched. According to this aspect, when the pitch goes up, the pitch of the singing voice rises once and then rises, or when the pitch goes down, the phenomenon that the pitch of the singing voice goes down once and then rises again can be reproduced in singing synthesis. it can.

  By the way, in actual singing, there is often a special pitch movement in a singing part, that is, a singing part corresponding to a note after a first note or a rest longer than a predetermined time length. In order to reproduce this phenomenon, in the control point setting process 641 in the present embodiment, when there is no note before the target note or when there is a rest longer than a predetermined time before the target note, As shown in FIG. 5, one or more additional control points (control points P and Q in FIG. 5) are arranged before the first control point A of the target note. In the pitch data generation process 642, a trajectory connecting this additional control point and the first control point A of the target note is obtained, and pitch data for changing the pitch along this trajectory is generated. In this case, the trajectory connecting the control points may be a straight line as shown by a broken line or a curved line as shown by a solid line. During the period when the lyric of the singing part does not exist, phonological data cannot be generated from the lyric, so that the phonological data generating process 644 generates phonological data that transitions from silence to the phonic corresponding to the singing lyric, Stored in the phoneme data track 72.

  In the example shown in FIG. 5, the control point P is arranged at a position that is a predetermined time before the note-on timing of the first note, and its pitch is a pitch that is lower than the pitch pS corresponding to the first note by a predetermined amount. Has been. Further, the control point Q is arranged at a position close to the note-on timing of the first note, and the pitch of the control point Q is higher than the control point P and closer to the control point P than the control point A. It is said that. In this case, the pitch of the synthesized singing sound at the beginning of the singing starts gradually rising from a certain time at the control point P before the note-on timing of the first note, and after the time near the note-on timing at which the control point Q is located. Then, the slope rises to a certain pitch of the control point A while drawing a steeper slope than before. Thus, according to this aspect, the special nuance of the singing part can be reproduced in the singing synthesis.

  In the case of singing, in addition to arranging the additional control points P and Q, if the first control point A of the singing note is arranged at a different position from the normal case, This special nuance can be reproduced in singing synthesis. For example, in the beginning part, it often takes some time until the pitch of the singing voice reaches the correct pitch corresponding to the note. Therefore, in the preferred embodiment, in order to reproduce this, the pitch of the control point A is set to be lower than the pitch corresponding to the note for the first note of the singing portion. In this way, a more natural singing can be reproduced in singing synthesis.

  Similarly, in actual singing, in the singing end part, that is, in the singing part corresponding to the last note of the song or the note before the rest longer than the predetermined time length, the pitch is gradually lowered, etc. There are many cases of special pitch movement. In order to reproduce this phenomenon, in the control point setting process 641 in the present embodiment, when there is no note after the target note or when there is a rest longer than a predetermined time after the target note, FIG. As shown, one or more additional control points (control points R and S in FIG. 6) are placed after the last control point C of the target note. In the pitch data generation process 642, a trajectory connecting this additional control point and the last control point C of the target note is obtained, and pitch data for changing the pitch along this trajectory is generated. In this case, the trajectory connecting the control points may be a straight line as shown by a broken line or a curved line as shown by a solid line. As the phoneme data, the phoneme data that is uttered in accordance with the last note at the end of the singing may be continuously adopted and stored in the phoneme data track 72.

  In the example shown in FIG. 6, the control point S is arranged at a position after a predetermined time after the note-off timing of the last note, and the pitch is a pitch lower by a predetermined amount than the pitch pE corresponding to the last note. Has been. The control point R is arranged at a position close to the note-off timing of the last note. The pitch of the control point R is higher than that of the control point S and is higher than that of the last control point C of the last note. The pitch is close to the control point S. In this case, the pitch of the synthesized singing sound at the end of the singing is lowered from the time of the last control point C of the last note to the time of the control point R near the note-off timing, and thereafter A gentler slope is drawn and the control point S is lowered to a certain pitch. Thus, according to this aspect, the special nuance of the singing end portion can be reproduced in the singing synthesis.

  As described above, according to the present embodiment, 1 to 3 control points serving as the passing points of the pitch of the singing sound are set for each note indicated by the note data, and two adjacent control points are set. The trajectory passing through each control point is obtained according to the trajectory calculation method determined for each interval, and the pitch of the synthesized singing sound is changed along the trajectory. On the other hand, a change can be given even in a section after reaching the pitch corresponding to the note, and a natural song close to a human song can be reproduced. Further, according to the present embodiment, at the part where the notes are switched, a desired change is given to the pitch trajectory of the section between the last control point of the preceding note and the first control point of the subsequent note. Therefore, natural singing can be reproduced for the part where the notes change. Further, according to the present embodiment, an additional control point is arranged before the first note for the singing portion, and an additional control point is arranged after the last note for the ending portion of the singing. Since the pitch of the synthesized singing sound is changed in accordance with the trajectory passing through, special nuances of the singing part and the singing end part can be reproduced in the singing composition.

<Second Embodiment>
Next, a second embodiment of the present invention will be described with reference to FIG. This embodiment is a modification of the first embodiment. In the present embodiment, a pseudo-random number generation process 645 is added to the singing synthesis score generation process 64A in the first embodiment. In the present embodiment, when the control point is set by the control point setting process 641, a pseudo random number is generated by the pseudo random number generation process 645 prior to that. Then, the time or pitch of each control point is dispersed from the position determined by the data indicating the relative position of the control point by this pseudo random number.

  In this embodiment, a pseudo-random number is generated each time a control point to be set advances, such as a control point A, B, C of a certain note, a control point A, B, C of the next note, etc. A fluctuation is given to the generation time or pitch of each control point by a random number. Therefore, the positions of the control points are dispersed, the mode of change in pitch is not uniform, and a natural singing sound without monotonousness can be synthesized.

  Further, in the present embodiment, in addition to the pseudo random number generation process 645, multiplication processes M1 to M7 are provided for changing the range of pseudo random numbers used for decentralization and adjusting the degree of control point dispersion for each type of control points. ing. Here, the degree of control point dispersion can be set for each type of control point by operating the operation unit 4. Therefore, according to this embodiment, the user can synthesize a singing sound that suits his / her preference by adjusting the degree of dispersion for each type of control point.

  The following modifications can be considered for this embodiment. That is, the degree of dispersion of the control points of the notes after the first note and the long rest of the music can be adjusted by the operation of the operation unit 4 independently of the degree of dispersion of the control points of the other notes. It is configured so that it can. According to this aspect, it is possible to prevent the singing of the singing portion from becoming uniform and to synthesize a natural singing sound.

<Third Embodiment>
Next, a third embodiment of the present invention will be described with reference to FIG. This embodiment is also a modification of the first embodiment. In the present embodiment, the parameter database 65 is stored in the HDD 6 in the first embodiment. This parameter database 65 shows the deflection of the change in the valley depth v1 between the control points A and B and the change in pitch of the note change portion for each of various kinds of songs such as “normal”, “sharp”, and “smooth”. It defines a set of parameters for determining the pitch trajectory, such as a parameter α for determining the condition, a parameter for determining the position of each control point relative to the note, and a function of a curve connecting the control points. In the present embodiment, when the type of singing is selected by the operation of the operation unit 4, a set of parameters corresponding to the type is read from the parameter database 65 and provided to the singing synthesis score generation process 64A. In the singing synthesis score generation process 64 </ b> A, based on the parameter set read from the parameter database 65, control points are set and a pitch trajectory that connects the control points is calculated.

  According to the present embodiment, even if the user does not know the meaning of each parameter, the user simply selects a favorite song and the parameters for such song are automatically selected. , Used for singing synthesis. Therefore, the user can easily obtain the synthesized singing sound of his / her favorite song.

<Other embodiments>
While the first to third embodiments of the present invention have been described above, various embodiments other than this can be considered for the present invention. For example:
(1) In the first embodiment, the user adjusts the data defining the relative positions of the control points A, B and C and various parameters for determining the trajectory connecting the control points by operating the operation unit 4. You may comprise so that it can do.
(2) The sound source for synthesizing the singing sound may not be a formant sound source. For example, a memory storing sample data of various phonological waveforms, or a memory storing spectral envelopes of harmonic components and anharmonic components of various phonological components, and storing the specified phonological sample data from this memory A sound source configured to read and synthesize a singing sound may be used in a singing synthesizer.
(3) The pitch trajectory obtained by the pitch data generation processing 642 may be displayed on the display unit 3 in response to a request given by the operation of the operation unit 4. Further, the user who confirms the display may be configured to correct the position of the desired control point of the desired note by operating the operation unit 4.

It is a block diagram which shows the structure of the song synthesizing | combining apparatus which is 1st Embodiment of this invention. It is a figure which shows the content of the song synthesis | combination process in the embodiment. It is a figure which shows the execution example of the control point setting process and pitch data generation process in the embodiment. It is a wave form diagram which illustrates the mode of change of the pitch in the note change part in the embodiment. It is a wave form diagram which illustrates the aspect of the change of the pitch in the singing part in the embodiment. It is a wave form diagram which illustrates the mode of change of the pitch in the end of singing in the embodiment. It is a block diagram which shows the structure of the characteristic part of the song synthesizing | combining apparatus which is 2nd Embodiment of this invention. It is a block diagram which shows the structure of the characteristic part of the song synthesizing | combining apparatus which is 3rd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 4 ... Operation part, 6 ... HDD, 7 ... RAM, 8 ... Formant sound source, 63 ... Phonological database, 64 ... Singing synthesis program, 70 ... Singing synthesis score, 71 ... Pitch data track, 72... Phonological data track, 62 A .. note data, 641... Control point setting process, 642... Pitch data generation process, 64 A .. singing synthesis score generation process, 64 B. .

Claims (9)

The passage point of the singing sound pitch trajectory for each note composing the music according to the data defining the relative positions of the three types of control points that will be the passage point of the singing sound pitch trajectory within one note interval. Control point setting means for setting the control point to be,
Distributing means for generating pseudo-random numbers and distributing the time of the control points set by the control point setting means according to the generated pseudo-random numbers;
Pitch data generating means for obtaining a trajectory passing through each control point set by the control point setting means, generating pitch data for changing the pitch along the trajectory, and storing the data in a storage means;
An singing voice synthesizing apparatus comprising: output means for reading the pitch data from the storage means and outputting the singing sound to a sound source.   The pitch data generation means obtains a trajectory passing through each control point set by the control point setting means according to a calculation method defined for each section between two adjacent control points. The singing voice synthesizing apparatus according to Item 1. When the target note is the first note or when there is a rest longer than a predetermined time length before the note, the control point setting means has one or more before the first control point of the note. The additional control point is set, and the pitch data generation means obtains a trajectory connecting the additional control point and the first control point of the note. Singing composition device given in the clause. When the target note is the first note, or when there is a rest longer than a predetermined time length before the note, the control point setting means, for the first control point of the note, The singing voice synthesizing apparatus according to claim 3, wherein the singing voice synthesizing apparatus is set to a position different from a position determined according to data for determining a relative position. And further comprising adjusting means for adjusting the degree of dispersion of the control points of the notes after the first note and long rest of the song independently of the degree of dispersion of the control points of the other notes. Item 3. The singing voice synthesizing apparatus according to item 3.   The control point setting means may include one or more additional control points after the last control point of the note when the target note is the last note or when there is a rest longer than a predetermined time length after the note. 6. The control point is set, and the pitch data generation means obtains a trajectory connecting the additional control point and the last control point of the note, according to any one of claims 1 to 5. Song synthesizer. Operation means;
The singing composition according to any one of claims 1 to 6, further comprising means for changing data for determining a relative position of the three kinds of control points in accordance with an operation on the operation means. apparatus. Operation means;
According to an operation on the operation means, there is provided means for changing data for determining a relative position of the three types of control points or a method for calculating a trajectory of a section between the two adjacent types of control points. The singing voice synthesizing device according to any one of claims 2 to 6. According to the data indicating the relative position with the notes determined for the three types of control points that are the passing points of the singing sound pitch trajectory, the passing point of the singing sound pitch trajectory for each note constituting the song, A control point setting process for setting at least one kind of control point,
A distribution process for generating pseudo-random numbers and distributing the time of the control points set by the control point setting process according to the generated pseudo-random numbers;
A pitch data generation process for obtaining a trajectory that passes through each control point set by the control point setting process and storing pitch data for changing the pitch along the trajectory in a storage means;
A singing composition program that causes the computer to execute an output process of reading out the pitch data from the storage means and outputting the singing sound to a sound source.

Images