JP3807380B2 - Score data editing device, score data display device, and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an apparatus for editing and displaying score data for automatic performance, and a program.
[0002]
[Prior art]
There is a technique for causing an automatic performance apparatus to perform automatic performance of music by using score data that is data indicating the pitch and sound generation period of a sound included in the music. There is also a device for editing score data for automatic performance.
[0003]
One method of displaying score data in the score data editing apparatus is called piano roll display. On the piano roll display screen, a bar-shaped figure corresponding to each sound indicated by the score data is arranged on a coordinate plane composed of an axis indicating pitch and an axis indicating time. The user can know the pitch and sound generation period of each sound from the position in the pitch axis direction of the bar-shaped figure and the position and length in the time axis direction.
[0004]
Furthermore, the data in the score data corresponding to the position and size of the figure can be changed by changing the position and size of the bar-shaped figure arranged on the piano roll display screen with a mouse or the like (for example, (See Patent Document 1).
[0005]
On the other hand, there is a technique in which singing is automatically performed by a singing synthesizer using singing score data including data on lyrics in addition to data on pitches and pronunciation periods (see, for example, Patent Document 2).
[0006]
[Patent Document 1]
JP-A-1-321484
[Patent Document 2]
JP 2002-202790 A
[0007]
[Problems to be solved by the invention]
By the way, as in the case of editing score data for automatic performance with instrument sounds, the score data editing device displays the pitch and pronunciation period of the sounds included in the singing score data by piano roll display etc. If the data relating to the pitch and the pronunciation period included in the singing score data can be edited by operating, the user's editing work becomes easy.
[0008]
However, in a singing performance, a single person does not emit a plurality of voices simultaneously, whereas many musical instruments can emit a plurality of sounds simultaneously. Therefore, if the score data editing device is used for editing the singing score data, the user may erroneously create singing score data instructing to utter a plurality of sounds simultaneously with the same person's voice. .
[0009]
If the synthesizer sings according to such singing score data, the singing performance becomes unnatural. In some cases, when the singing voice synthesizing apparatus finds an instruction to utter a plurality of sounds at the same time, the singing synthesizer performs processing such as uttering the subsequent sound after stopping the preceding sound. In such a case, the singing performance performed by the singing synthesizing apparatus may be different from what the user intended, which is inconvenient.
[0010]
In view of the above situation, the present invention prevents the user from creating score data that causes a plurality of sounds to be pronounced at the same time in displaying and editing score data for singing and monophonic instruments. The present invention provides an apparatus that can save a user's trouble by automatically correcting a data portion that has been created in error.
[0011]
[Means for Solving the Problems]
  In order to solve the problems described above, the present invention provides (1) pitch data indicating the pitch of the sound and (2) score data including a plurality of note data including at least the sounding period data indicating the sounding period of the sound. With respect to storage means for storing and two or more note data included in the score data,oneA first sound generation period indicated by first sound generation period data included in the note data;oneDetermining means for determining whether or not there is an overlapping portion between the second sound generation period indicated by the second sound generation period data included in other note data different from the note data ofThe sound indicated by the pitch data included in the note data for each of the note data included in the score data on the coordinates having the first axis indicating the pitch and the second axis indicating the passage of time. The position in the first axial direction corresponding to the height of the second axial direction corresponds to the position in the second axial direction corresponding to the beginning and end of the sounding period indicated by the sounding period data included in the note data, respectively. Display means for displaying a graphic as another end point, the display means,If it is determined by the determining means that there is an overlapping part,oneofShape corresponding to note dataAnd saidotherofNotedataCompatible withDoShapes, other shapesWhenDifferentRuDisplay by wayScore data characterized bydisplayProviding equipment.
[0012]
  Score data with this configurationdisplayAccording to the deviceEasy for usersData indicating simultaneous pronunciation of multiple sounds included in score data for singing or monophonic instrumentsPart can be confirmed.
[0013]
  Also, the score data according to the present inventiondisplayIn the apparatus, the adjusting means includes theWhen it is judged by the judging means that there is an overlapping partThe first pronunciation periodWhenThe second pronunciation period andThere is no overlap betweenThe first sound generation period data and the second sound generation period dataat leastIt may be configured to change one.
[0014]
  Score data with this configurationdisplayAccording to the apparatus, data indicating the simultaneous pronunciation of a plurality of sounds included in the score data for singing or for a monophonic instrument is provided.It is automatically corrected and the score data correction work by the user is reduced..
[0015]
  In the score data display device according to the aspect described above, the adjusting unit may determine the earlier of the end of the first sound generation period and the end of the second sound generation period as the start of the first sound generation period and One of the first sound generation period data and the second sound generation period data may be changed so as to coincide with a later one of the start periods of the second sound generation period. .
[0016]
  According to the score data display device having such a configuration,In many cases,Data indicating simultaneous pronunciation of multiple sounds included in score data for singing or monophonic instrumentsIs corrected to the contents intended by the user.
[0019]
  Furthermore, the present invention providesThe above score data display deviceA program for causing a computer to execute processing similar to that performed by the computer is provided.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
[1. Embodiment]
[1.1. Constitution]
FIG. 1 is a block diagram showing a configuration of a computer 1 that realizes a singing voice synthesis system according to an embodiment of the present invention. 1, a computer 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an HD (Hard Disk) 104, a display unit 105, an operation unit 106, and data input / output. A unit 107, a D / A (Digital to Analog) converter 108, an amplifier 109, and a speaker 110. Components other than the amplifier 109 and the speaker 110 are connected via a bus 115 and can transmit and receive data to and from each other.
[0021]
The CPU 101 is a microprocessor that performs general-purpose data processing. According to a control program such as BIOS (Basic Input / Output System) stored in the ROM 102 and an OS (Operating System) stored in the HD 104, the CPU 101 The control process of the component is performed.
[0022]
The ROM 102 is a non-volatile memory that stores a control program such as BIOS. The RAM 103 is a volatile memory for temporarily storing data used by the CPU 101 and other components. The BIOS in the ROM 102 is read by the CPU 101 and written in the RAM 103 when the computer 1 is turned on. The CPU 101 constructs a hardware usage environment according to the BIOS in the RAM 103.
[0023]
The HD 104 is a nonvolatile memory having a large capacity storage area, and data stored in the HD 104 can be rewritten. The HD 104 stores an OS, various applications, and data used by each application. The CPU 101 reads out the OS from the HD 104 and writes it into the RAM 103 after constructing the hardware environment using the BIOS, and performs processing such as construction of a GUI (Graphical User Interface) environment and an application execution environment according to the OS.
[0024]
Among the applications stored in the HD 104, there is a song synthesis application. When the CPU 101 receives a singing synthesis application execution instruction from the user through a mouse operation or the like, the CPU 101 reads out the singing synthesis application from the HD 104 and writes it into the RAM 103, and constructs an environment for performing various processes according to the singing synthesis application. Thus, the computer 1 functions as a singing voice synthesis system according to this embodiment.
[0025]
The display unit 105 includes a liquid crystal display and a drive circuit that drives the liquid crystal display under the control of the CPU 101, and displays information such as characters and graphics. The operation unit 106 includes a keypad, a mouse, and the like, and transmits data reflecting the contents of operations performed by the user to the CPU 101.
[0026]
The data input / output unit 107 is an interface capable of inputting / outputting various types of data, such as a USB (Universal Serial Bus) interface. The data input / output unit 107 receives data from an external device, transfers the received data to the CPU 101, and is generated by the CPU 101. Send data to an external device.
[0027]
The D / A converter 108 receives digital audio data from the CPU 101, converts it into an analog audio signal, and outputs it to the amplifier 109. The amplifier 109 amplifies this analog audio signal and outputs it from the speaker 110 as sound.
[0028]
FIG. 2 is a block diagram showing functions of the song synthesis system provided by the CPU 101 in accordance with the song synthesis application. The singing voice synthesis system includes a score data editing unit 20 and a singing voice synthesis unit 30. The score data editing unit 20 is a module that displays the singing score data to the user, edits it according to the user's operation, and delivers the edited singing score data to the singing synthesis unit 30. Here, the singing score data includes pitch data that specifies the pitches of the time-series singing sounds constituting the singing musical piece, pronunciation period data that specifies the pronunciation period, pronunciation symbols corresponding to the lyrics, and the like. The singing voice synthesizing unit 30 is a module that synthesizes singing voice data based on the singing score data.
[0029]
The score data editing unit 20 includes data input means 201, shaping means 202, storage means 203, determination means 204, display means 205, operation means 206, editing means 207, adjustment means 208, and data output means 209. Among these, the storage means 203 is the RAM 103 and the HD 104 of the computer 1. The other elements are software modules constituting the singing voice synthesis application.
[0030]
The song synthesizer 30 includes a data input unit 301, a storage unit 302, a segment database 303, a data selection unit 304, a pitch adjustment unit 305, a duration adjustment unit 306, a volume adjustment unit 307, an operation unit 308, and an audio output unit 309. It has. Of these, the segment database 303 and the storage means 302 are the RAM 103 or the HD 104 of the computer 1. The other elements are software modules constituting the singing voice synthesis application.
[0031]
In addition, in order to avoid duplication of description, the function of each component of the score data editing unit 20 and the singing voice synthesizing unit 30 will be described together in the operation description section of the present embodiment.
[0032]
[1.2. Operation]
The feature of the present invention resides in the score data editing unit 20. However, in order to understand the technical significance of the processing performed by the score data editing unit 20, the processing content of the singing synthesis unit 30 that performs singing synthesis using the output data of the score data editing unit 20 is understood. It is preferable to leave. Therefore, hereinafter, the operation of the singing voice synthesizing unit 30 will be described first, and then the operation of the score data editing unit 20 will be described.
[0033]
First, the data input means 301 of the song synthesis unit 30 receives song score data from the score data editing unit 20 and stores the received song score data in the storage means 302.
[0034]
FIG. 3 is a diagram showing the configuration of the singing score data. The singing score data includes one or more part data representing singing performance. In addition to the part data, the singing score data includes data indicating the time and tempo used in the performance, and data indicating the resolution. The singing score data shown in FIG. 3 includes three part data of parts 1 to 3, in which 4/4 time is set as the time, 120 is set as the tempo, and 480 is set as the resolution. The numerical value “120” regarding the tempo indicates that the music indicated by the singing score data is played at a tempo including 120 quarter notes per minute. The numerical value “480” regarding the resolution indicates that the time obtained by dividing one quarter note into 480 is used as the unit time in this singing score data.
[0035]
The part data includes a plurality of note data that is a set of data indicating a pitch, a pronunciation period, a pronunciation symbol, and a strength for each of a plurality of singing sounds constituting the part. In the part data, for example, note data are arranged in order from the earliest beginning of the sounding period, or in the order from the earliest end of the sounding period when the sounding period has the same beginning.
[0036]
In the present embodiment, the information related to the pronunciation period included in the singing score data is composed of information indicating the beginning of the pronunciation period and information indicating the end of the pronunciation period. It is expressed in the format of “+ unit time number”. For example, “0005: 03: 240” represents a timing at which a time of 240 unit times, that is, a time of 1/2 beat has elapsed from the timing of the third beat of the fifth measure. Note that the method of expressing the timing in the song score data is not limited to “measure number + beat number + unit time number”. Various expression methods such as a normal “hour + minute + second” format can be adopted. Moreover, you may employ | adopt the method of specifying the timing of subsequent data not by the absolute time from the reference | standard timing but by the relative time from preceding data.
[0037]
When the singing score data is stored in the storage unit 302 by the data input unit 301, the data selection unit 304 extracts the data necessary for generating the singing voice data of the singing sound designated by the singing score data. Processing to read from the database 303 is performed.
[0038]
FIG. 4 is a diagram showing the configuration of the segment database 303. The segment database 303 is divided into individual databases corresponding to each of a plurality of singers. In the example shown in FIG. 4, the segment database 303 includes individual databases 303a to 303c corresponding to three singers, respectively.
[0039]
The individual database corresponding to each singer includes a plurality of segment data collected from the singing voice waveform of the singer. The segment data is voice data obtained by extracting and encoding a phonetic feature from a singing voice waveform.
[0040]
Here, the case of singing the lyrics of “sai” with respect to the segment data will be described as an example. The lyrics “Saita” are expressed by phonetic symbols “saita”. When analyzing the waveform of the sound represented by the phonetic symbol “saita”, the rising portion of the sound of “s” → the sound of “s” → the transition portion from the sound of “s” to the sound of “a” → “ The sound of “a” is continued, and ends with the attenuation part of the sound of “a”. Each piece of data is audio data corresponding to these phonetic features.
[0041]
The segment database 303 includes speech data corresponding to the above phonetic features as segment data for all sounds and combinations of sounds. In the following description, segment data corresponding to a rising portion of a sound represented by a phonetic symbol is represented as “#s” by adding “#” in front of the phonetic symbol. The segment data corresponding to the sound attenuation part represented by a phonetic symbol is represented as “a #” by adding “#” after the phonetic symbol. Also, segment data corresponding to a transition portion from a sound represented by a certain phonetic symbol to a sound represented by another phonetic symbol is inserted between those phonetic symbols, and “sa” is entered. ". Thus, for example, “saita” is “#s” “s” “sa” “a” “ai” “i” “it” “t” “ta” “a” “a #” Is broken down into unit data units.
[0042]
The data selection means 304 includes, for example, the lyrics “saita” in the singing score data. When synthesizing the singing voice of the lyrics, “#s” “s” “s-a” is stored from the segment database 303. The piece data is read out in the order of “a”, “ai”, “i”, “it”, “t”, “ta”, “a”, and “a #”. The data selection unit 304 transmits the read segment data to the pitch adjustment unit 305 together with the singing score data.
[0043]
The pitch adjusting means 305 adjusts the pitch of the received segment data based on the data related to the pitch included in the singing score data. The pitch adjusting unit 305 transmits the segment data subjected to the pitch adjustment to the duration adjusting unit 306 together with the singing score data.
[0044]
The singing score data sent to the duration adjustment means 306 includes data for designating the sound generation period corresponding to the individual segment data. The duration adjustment unit 306 performs time adjustment of the sound generation period of each piece data so that the sound lasts for the period specified by this data. The duration adjustment unit 306 transmits the segment data that has been subjected to the time adjustment of the pronunciation period to the volume adjustment unit 307 together with the singing score data.
[0045]
The singing score data sent to the volume adjusting means 307 includes data relating to the sound intensity corresponding to each piece of piece data. The volume adjusting unit 307 adjusts the volume of each piece of data based on this data. Further, the volume adjustment unit 307 is arranged near the end of the segment data or at the beginning so that the last volume of the preceding data and the first volume of the subsequent data coincide with each other for each piece of segment data for which volume adjustment has been performed. Adjust the volume near you.
[0046]
The volume adjusting unit 307 connects the segment data whose volume has been adjusted in the order indicated by the singing score data, generates singing voice data, and stores the generated singing voice data in the storage unit 302.
[0047]
When the user gives a playback instruction to the singing voice synthesizing unit 30 using the operation unit 308, the voice output unit 309 reads the singing voice data from the storage unit 302 and outputs it to the D / A converter 108 in FIG. As a result, the user can listen to the singing performance indicated by the singing score data.
[0048]
In order to make the singing performance by the singing synthesizing unit 30 more natural, the segment database 303 has different tempos and pitches, accents, legatos, etc. regarding the characteristic portions of the sounds represented by the same phonetic symbols. It is also possible to store a plurality of different pieces of segment data corresponding to the musical expression and the like, and allow the data selection means 304 to read out the optimum data from these segment data.
[0049]
In the above description, the segment data used in the singing voice synthesizing unit 30 is speech data obtained by encoding a speech waveform, but the format of the segment data is not limited to this. For example, the unit database 303 stores, as segment data, a parameterized characteristic of frequency components of speech data obtained from speech waveforms, and the data selection unit 304 or the like is based on the parameters included in the segment data. Singing voice data may be generated by regenerating the voice data.
[0050]
Next, the operation of the score data editing unit 20 will be described. First, the data input unit 201 of the score data editing unit 20 receives singing score data from an external device or the like, and transmits the received singing score data to the shaping unit 202. The configuration of the singing score data that the data input means 201 receives from an external device or the like is the same as that shown in FIG.
[0051]
The shaping unit 202 rearranges the note data included in each part data of the singing score data in the order from the earliest beginning of the pronunciation period, or in the order from the earliest end of the pronunciation period when the pronunciation period is the same. Further, the shaping unit 202 adds items of number and overlap to the singing score data.
[0052]
FIG. 5 shows the singing score data after the item is added by the shaping means 202. In the number column, identification numbers of the respective note data are assigned according to a rule such as ascending order. In the overlap column, when there is a temporal overlap with the sound indicated by other note data, the number of the other party's note data having the overlap is written. The shaping unit 202 causes the storage unit 203 to store singing score data on which an item has been added.
[0053]
[1.2.1. Operation related to elimination of overlapping pronunciation periods]
When the singing score data is stored in the storage unit 203 according to the instruction of the shaping unit 202, the determining unit 204 includes a set of note data having overlapping pronunciation periods on the time axis for each part data of the singing score data. It is determined whether it is.
[0054]
For example, when it is determined that there is an overlap in the sound generation periods indicated by the note data A and the note data B belonging to the same part data, the determination unit 204 sets the number of the note data B in the overlap field of the note data A. The number of the note data A is written in the overlap column of the note data B. Note that the sound generation period indicated by a certain note data may overlap with the sound generation period indicated by other note data. In such a case, the numbers of the plurality of note data corresponding to the overlap column are displayed. Written. The singing score data shown in FIG. 5 does not include note data that overlaps with other note data in the pronunciation period, so the overlap column is blank for all note data.
[0055]
The display means 205 performs a piano roll display based on the singing score data. FIG. 6 is a piano roll display screen performed by the display means 205 based on the singing score data shown in FIG. In FIG. 6, each of the note bars 401a to 401f corresponds to note data. The vertical direction of the screen corresponds to the pitch of the sound, and the user can confirm the pitch of the note data indicated by each note bar by referring to the piano keyboard shown on the left side of the screen. The left-right direction of the screen corresponds to time, and the user can confirm the beginning of the sound generation period and the end of the sound generation period of the note data indicated by the note bar from the position of the left end and the right end of each note bar.
[0056]
In FIG. 6, the note bar is displayed only for the part data of part 1. The user can instruct part data to be displayed on the display unit 205 by performing a predetermined operation using the operation unit 206. When the user instructs display of a plurality of part data, the display unit 205 displays a note bar in a different color for each part data, for example.
[0057]
Further, the display means 205 displays, for example, a note bar corresponding to the sound in which the number of any note data is written in the overlap column, with a hatched line, so that any note data is displayed in the overlap column. Distinguishes from note bars corresponding to sounds for which no number is written. In addition, the method of distinguishing the note bar corresponding to the sound in which the number of the note data is written in the overlap column, that is, the sound having the overlap of the pronunciation period with the other sound, from the other sound is as follows: In addition to the hatching, various methods such as changing the color and line thickness and blinking the note bar can be applied.
[0058]
On the screen of the piano roll display, information such as the sound intensity and phonetic symbols included in the note data is usually displayed. In the example of FIG. 6, the note bar 401a is selected by the user's operation using the operation means 206, and the sound intensity and phonetic symbol of the note data corresponding to the selected note bar 401a at the lower left part of the screen, The name of the part data including the note bar 401a is shown. In addition, the note bar 401a selected by the user has a border displayed as a bold line.
[0059]
The user can instruct the score data editing unit 20 to change the pitch and the sound generation period of the note data corresponding to the note bar by operating the note bar in the piano roll display using the operation means 206. it can. For example, the user can instruct increase / decrease of data indicating the pitch of the note data corresponding to the selected note bar by pressing the up and down cursor keys after selecting the note bar with the mouse. Further, the user can instruct increase / decrease of data indicating the start or end of the sound generation period of the note data corresponding to the note bar by dragging the left end or the right end of the note bar with the mouse.
[0060]
The operation unit 206 transmits data related to the operation on the note bar by the user as described above to the editing unit 207, and the editing unit 207 changes the content of the singing score data based on the data related to the operation.
[0061]
When the data related to the start or end of the pronunciation period included in the singing score data is changed, the determination unit 204 performs the above-described determination process on the presence or absence of overlapping of the pronunciation periods for the singing score data after the change. In accordance with the result of the determination process, the determination unit 204 registers the number of the other party's note data in the overlap column for the two note data that have overlapped in the pronunciation period as a result of the change. For the two note data that have no overlap in the pronunciation period, the data in the overlap column is deleted. When the singing score data is changed by the editing unit 207 or the determining unit 204, the display unit 205 updates the piano roll display based on the changed singing score data.
[0062]
FIG. 7 shows a screen displayed by the display means 205 when the user operates the note bar 401c in the piano roll display shown in FIG. 6 and the start of the sounding period of the note data corresponding to the note bar 401c is advanced. An example is shown. As shown in FIG. 7, since the sound generation periods corresponding to the note bar 401b and the note bar 401c overlap each other, the note bar 401b and the note bar 401c are hatched. In this case, in the singing score data, the note data number corresponding to the note bar 401c is displayed in the note data overlap field corresponding to the note bar 401b, and the note data overlap field corresponding to the note bar 401c. The number of the note data corresponding to the note bar 401b is registered.
[0063]
When the user finishes editing the song score data, the user uses the operation means 206 to give an instruction to transmit the song score data to the song composition unit 30. The operation unit 206 transmits data related to the transmission instruction of the singing score data by the user to the adjustment unit 208. When receiving the data related to the transmission instruction, the adjusting unit 208 extracts one piece of note data included in the singing score data, and determines whether any number is written in the overlapped column of the extracted note data.
[0064]
If the adjustment unit 208 determines that any number is written in the overlap column in the determination process, the adjustment unit 208 instructs the display unit 205 to write the note data and the number written in the overlap column ( For note data corresponding to one of a plurality of numbers, an instruction is given to highlight the corresponding note bar. Further, the adjustment unit 208 instructs the display unit 205 to display a message window that prompts the user to instruct whether or not to perform timing adjustment processing on the two note data having overlapping pronunciation periods. . FIG. 8 shows an example of a message window displayed by the display unit 205 according to an instruction from the adjustment unit 208.
[0065]
When the user selects “Adjust with priority to later” in the message window shown in FIG. 8 and instructs “execute”, the adjustment means 208 relates to two note data having overlapping pronunciation periods ( As shown in a), the data related to the end of the sounding period of the preceding note data is changed so as to be the same as the start time of the sounding period of the later note data.
[0066]
When the user selects “adjust with priority from the start” in the message window shown in FIG. 8 and instructs “execute”, the adjustment means 208 relates to two note data having overlapping pronunciation periods ( As shown in b), the data related to the start of the sounding period of the subsequent note data is changed so as to be the same as the end of the sounding period of the preceding note data.
[0067]
If either “Adjust with Subsequent Priority” or “Adjust with Prior Priority” is selected and the start period of two note data with overlapping pronunciation periods is the same, When the end periods are the same as each other, the adjusting unit 208 changes the start period or the end period of the sound generation period, for example, as shown in (c) and (d) of FIG.
[0068]
It should be noted that the method of adjusting the sound generation period of two note data having overlapping sound generation periods is not limited to the above-mentioned prior priority or first priority. For example, the end of the sound generation period of the first note data may coincide with the start of the sound generation period of the subsequent note data at the timing at which the overlap of the sound generation periods is divided according to the ratio specified by the user. After changing the start or end of the sound generation period as described above, the adjustment means 208 deletes the number of the other note data whose overlap has been eliminated from the overlap field of the two note data.
[0069]
When the user selects “do nothing” in the message window shown in FIG. 8 and instructs “execute”, the adjustment means 208 starts and ends the sound generation periods of two note data having overlapping sound generation periods. A mark indicating that the user intentionally left an overlap, for example, “*” is added to the number in the overlap column without changing.
[0070]
The adjustment unit 208 repeats the adjustment process described above for all the note data included in the singing score data. When the user checks “Apply for all overlapping portions” in the message window of FIG. 8 and instructs “execute”, the adjusting unit 208 does not prompt the user to confirm each overlap, The above adjustment process is performed on the note data. As a result, singing score data is generated in which all the overlapping columns are blank or all the numbers in the overlapping column are marked with “*” indicating that the user intentionally left the overlapping.
[0071]
When the singing score data is changed by the adjusting unit 208, the display unit 205 performs piano roll display based on the singing score data after the change. FIG. 10 is a piano roll display screen displayed by the display unit 205 as a result of the adjustment unit 208 performing adjustment processing on the singing score data corresponding to the piano roll display shown in FIG. Subsequently, the adjusting unit 208 transmits the part obtained by removing the number and the overlap column from the singing score data to the singing synthesizing unit 30 via the data output unit 209.
[0072]
The singing voice synthesizing unit 30 performs singing performance by generating singing voice data based on the singing score data received from the score data editing unit 20 and reproducing the singing voice data in accordance with the operation described above.
[0073]
[1.2.2. Operation related to timing adjustment based on reference part data]
In general, a singing synthesizer can also perform a choral performance based on the voices of a plurality of people. The singing score data in that case includes a plurality of part data corresponding to the singing performance part. In choral music, performances that differ only in pitch are often performed among a plurality of singing performance parts. This is because it is intended that a chorus with a plurality of voices is created in the choral music.
[0074]
When editing the singing score data of the choral music, if the data related to the pronunciation period is common among the plurality of part data, the editing work performed by the user regarding the pronunciation period is the same for each of the part data. However, according to the prior art, since the data regarding the pitches of these part data are different, the contents of the edited part data cannot be reflected in the contents of the unedited part data. Therefore, it is inconvenient because the user needs to repeat the same editing operation for other part data after editing data related to timing included in a part data.
[0075]
In order to eliminate such inconvenience, the present embodiment is provided with a function for automatically correcting data indicating the pronunciation period of unedited part data based on data indicating the pronunciation period of edited part data. ing. Hereinafter, the operation will be described.
[0076]
As described above, the display unit 205 of the score data editing unit 20 distinguishes the note data included in the plurality of part data with different colors based on the singing score data including the plurality of part data, and simultaneously displays the piano roll. can do. FIG. 11 shows an example of a screen when the display unit 205 performs piano roll display for two part data. In FIG. 11, note bars 401 a to 401 f correspond to part 1 part data, and note bars 402 a to f correspond to part 2 part data.
[0077]
The singing score data illustrated in FIG. 11 is created based on the actual performance of the user by an external device, for example, and includes data indicating a pronunciation period that is not intended by the user. Here, regarding the part data of part 1, the user has already edited information related to the sound generation period, and it is assumed that the sound generation period of each singing sound belonging to part 1 is intended by the user. Further, it is assumed that the user has not yet edited the part data of part 2. In such a case, the user can change the data indicating the sound generation period of the part data of Part 2 with reference to the data indicating the sound generation period of the part data of Part 1.
[0078]
First, the user selects all the note data to be used as a reference and the note data to be changed in the pronunciation period using the operation means 206. For example, in the piano roll display of FIG. 11, the user performs an operation of surrounding a note bar to be selected using a mouse with a rectangle. Thereafter, the user instructs the score data editing unit 20 to execute timing adjustment processing using the operation unit 206. The operation unit 206 transmits data for instructing execution of the timing adjustment process to the determination unit 204 together with data for specifying the note data selected by the user.
[0079]
When the determination unit 204 receives data specifying the note data selected by the user from the operation unit 206, the determination unit 204 determines the number of the note data selected by the user, the pronunciation period from the singing score data stored in the storage unit 203. Read data about. FIG. 12 shows an example of data read by the determination unit 204 when the user selects the note bars 401b to e and note bars 402b to e in the piano roll display of FIG. 11 and instructs execution of timing adjustment processing. Show.
[0080]
Subsequently, the determination unit 204 instructs the display unit 205 to display a message window that prompts the user to designate part data as a reference. FIG. 13 shows an example of a message window displayed on the display unit 205 according to an instruction from the determination unit 204. In the “part as reference” in FIG. 13, names of all part data including any of the note data designated by the user are listed, and the user must always select one of the listed part data names. It is necessary to select.
[0081]
“Sensitivity” is a value indicating the maximum time of the difference between the start or end of the sound generation period of the reference part data and the start or end of the sound generation period of the part data to be changed, in unit time. For example, when the sensitivity is 150 and the start time of the sound generation period of the reference note data is “0001: 02: 015”, the start time of the sound generation period is “0001: 01: 345” to “0001: 02: 165”. Note data within the range is subject to change.
[0082]
The “strength” is a value indicating the ratio of the correction time to the deviation between the reference sound generation period and the sound generation period to be changed as a percentage. For example, if the strength is 100%, the start or end of the sound generation period to be changed completely coincides with the start or end of the reference sound generation period. If the strength is 70%, the start or end of the sound generation period to be changed is brought closer to the reference sound generation period by a time corresponding to 70% of the difference from the start or end of the reference sound generation period. .
[0083]
“Correct the beginning of the pronunciation period” and “Correct the end of the pronunciation period” are items for instructing the type of timing for the user to change.
When the user instructs “execute” in the message window shown in FIG. 13, the determination unit 204 performs the following determination process regarding the timing when the correction instruction is issued by the user. As an example, the user designates part 1 as a reference part, 150 as sensitivity, and 70% as strength, and both “correct the beginning of the pronunciation period” and “correct the end of the pronunciation period” The case where is checked will be described.
[0084]
First, the determination unit 204 adds the columns “reference-start” and “reference-end” to the part data to be changed shown in FIG. Subsequently, for each of the start periods of the part 2 sounding period, the determination unit 204 searches for the closest part data from among the reference part data, that is, the start period of the part 1 sounding period.
[0085]
The determination unit 204 subtracts the start period of the sound generation period of Part 2 from the start time of the sound period of Part 1 searched, and determines whether or not the absolute value of the subtraction result is 150 or less designated as the sensitivity. If the determination means 204 determines that the absolute value of the subtraction result is 150 or less, it writes the number of the searched note data of part 1 as the reference note data number in the “reference-start” column. On the other hand, when the determination unit 204 determines that the absolute value of the subtraction result is not 150 or less, the “reference-start” column is left blank for the note data of Part 2.
[0086]
The determination unit 204 repeats the above search, determination, and number writing processes for all the beginnings of the pronunciation periods of the note data to be changed in Part 2.
[0087]
Subsequently, the determination unit 204 performs the search, determination, and number writing processes for the end of the sound generation period of the part 2 note data as in the case of the start of the sound generation period. As a result, the determination unit 204 generates data shown in FIG. The determination unit 204 transmits the generated data to the adjustment unit 208 together with data indicating the strength previously specified by the user, that is, “70%”.
[0088]
When the adjustment unit 208 receives the data from the determination unit 204, the adjustment unit 208 first relates to the data at the beginning of the sound generation period of the note data of Part 2, in which the number is written in the “reference-start” column. The start period of the sound generation period of the note data of part 2 is subtracted from the start time of the sound generation period in the note data of part 1 specified by the number in the column of, and the subtraction result is multiplied by 70%, that is, 0.70.
[0089]
Subsequently, the adjusting unit 208 adds the multiplication result to the beginning of the sound generation period of the note data of Part 2. The adjustment means 208 rewrites the beginning of the pronunciation period of the note data of the corresponding number in the part data of the part 2 of the singing score data stored in the storage means 203 as a result of the addition.
[0090]
The adjustment means 208 performs the above-described subtraction, multiplication, addition, and rewriting of the singing score data for all the note data with respect to the beginning of the pronunciation period of the note data of Part 2 of the data shown in FIG. Further, the adjustment means 208 performs subtraction, multiplication, addition, and rewriting of the singing score data for the end of the sound generation period as in the case of the start of the sound generation period.
[0091]
In the above example, the case where both the start and the end of the pronunciation period are selected as the change target by the user has been described, but when only one of them is selected, regarding the timing not selected, The timing adjustment process is simply not performed.
[0092]
In the above example, the determination unit 204 associates the note data to be changed with the reference note data individually for each of the start period and the end period of the sound generation period. However, for example, only when both the start and end of the pronunciation period fall within the time range specified by “sensitivity” from the reference timing, the note data to be changed and the reference note data are associated with each other. Other association methods may be used.
[0093]
When the singing score data is changed by the adjusting unit 208, the display unit 205 performs piano roll display based on the singing score data after the change. FIG. 15 is displayed by the display unit 205 as a result of the adjustment processing of the timing of the part data of the part 2 based on the part data of the part 1 on the singing score data shown in the piano roll display of FIG. It is a screen.
[0094]
After finishing the timing adjustment process as described above, the user gives an instruction to transmit the song score data to the song composition unit 30. As a result, as already described, the singing score data is transmitted from the score data editing unit 20 to the singing synthesis unit 30, and the singing synthesis unit 30 performs the singing performance.
[0095]
[2. Modified example]
The above-described embodiment is an exemplification of the embodiment of the present invention, and various modifications can be made to the above-described embodiment without departing from the gist of the present invention.
[0096]
For example, score data edited by the score data editing device may be transmitted not to the singing synthesizer but to a sound source device capable of outputting a sound of a monophonic instrument. In this case, however, the score data does not include data related to phonetic symbols.
[0097]
As the format of the singing score data, other data formats such as a data format according to the MIDI (Musical Instrument Digital Interface) standard may be used.
[0098]
In the above-described embodiment, the singing synthesis system is realized by causing a general-purpose computer to execute processing according to the application. However, a similar singing synthesis system may be configured by dedicated hardware. . Furthermore, in the case of using a general-purpose computer or the case of using dedicated hardware, the constituent elements of the singing synthesis system do not need to be arranged in one casing. For example, the individual components of the singing voice synthesis system may form an independent device, and they may be connected to each other via a LAN or the like.
[0099]
In the above-described embodiment, the process of changing the pronunciation period between two or more note data that overlap in the pronunciation period is performed when the user instructs transmission of the singing score data. However, the timing of the change process is not limited to that in the above embodiment. For example, each time the user performs an operation on the note bar in the piano roll display and the data related to the sound generation period is changed, the overlap determination process is performed, and the data related to the sound generation period changed by the user is changed again. You may be made to do. At this time, if the confirmation work for the user is not performed, so-called “sucking” is performed, and the processing of automatically matching the end point of the note bar being edited with the end point of the nearby note bar is performed. become.
[0100]
In the above-described embodiment, the sound generation period changing process between the note data of the reference part data and the note data of other part data is performed when the user instructs the timing adjustment process. However, the timing of these processes is not limited to that in the above embodiment. For example, every time the user performs an operation on the note bar in the piano roll display and changes the data related to the pronunciation period, the beginning or end of the pronunciation period of the note data included in the part data specified as the reference, and the user It may be determined whether or not the difference between the start time or the end time of the sound generation period of the note data changed by the step is equal to or less than a predetermined period, and the sound generation period of the note data changed by the user may be changed again. . At this time, if the confirmation operation for the user is not performed, a so-called “adsorption” process is performed.
[0101]
【The invention's effect】
As described above, according to the score data display device and the program according to the present invention, when the user edits the score data related to the performance by the singing or the monophonic instrument, the data portion erroneously instructing the simultaneous sound generation simultaneously. Even if this occurs, the user can easily check the data portion, and it is possible to prevent the creation of score data that causes the singing synthesizer or the sound generator of the monophonic instrument to perform an unnatural performance. .
[0102]
Further, according to the score data editing apparatus and the program according to the present invention, when the user edits score data related to singing or playing with a monophonic instrument, the user instructs the pronunciation of a plurality of sounds simultaneously included in the score data. It is possible to easily correct the data portion to be changed to data for instructing the pronunciation of one sound at the same time.
[0103]
Further, according to the score data editing apparatus and program according to the present invention, the user can easily correct the data related to the pronunciation period of other part data based on the data related to the pronunciation period of certain part data. In editing score data including a plurality of part data having the same or similar data, the user's work is reduced.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of a computer that realizes a singing voice synthesis system according to an embodiment.
FIG. 2 is a block diagram illustrating functions of the singing voice synthesis system according to the present embodiment.
FIG. 3 is a diagram illustrating a configuration of song score data according to the present embodiment.
FIG. 4 is a diagram showing a configuration of a segment database according to the present embodiment.
FIG. 5 is a diagram showing singing score data after shaping by the shaping unit of the present embodiment.
FIG. 6 is a diagram showing a piano roll display screen of the present embodiment.
FIG. 7 is a diagram showing a piano roll display screen of the present embodiment.
FIG. 8 is a diagram showing a message window displayed in accordance with an instruction from the adjusting unit of the present embodiment.
FIG. 9 is a diagram showing how sound generation periods are adjusted by the adjusting means of the present embodiment.
FIG. 10 is a diagram showing a piano roll display screen of the present embodiment.
FIG. 11 is a diagram showing a piano roll display screen of the present embodiment.
FIG. 12 is a diagram illustrating data read by the determination unit of the present embodiment.
FIG. 13 is a diagram showing a message window displayed in accordance with an instruction from a determination unit according to the present embodiment.
FIG. 14 is a diagram illustrating data generated by the determination unit of the present embodiment.
FIG. 15 is a diagram showing a piano roll display screen of the present embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Computer, 101 ... CPU, 102 ... ROM, 103 ... RAM, 104 ... HD, 105 ... Display part, 106 ... Operation part, 107 ... Data input / output part, 108 ... D / A converter, 109 ... Amplifier, 110 ... Speaker, 115 ... Bus, 20 ... Score data editing unit, 30 ... Singing synthesis unit, 201.301 ... Data input means, 202 ... Shaping means, 203.302 ... Storage means, 204 ... Determination means, 205 ... Display means, 206 308 ... operation means, 207 ... editing means, 208 ... adjustment means, 209 ... data output means, 303 ... segment database, 304 ... data selection means, 305 ... pitch adjustment means, 306 ... duration adjustment means, 307 ... Volume adjustment means, 309... Audio output means.

Claims (5)

Storage means for storing (1) pitch data indicating a pitch, and (2) score data including a plurality of note data including at least sound generation period data indicating a sound generation period;
Relates two or more note data included in the score data, contained in the first and sounding period, different from the note data from said one note data indicated by the first sound production period data included in one note data Determining means for determining whether or not there is an overlapping portion between the second sound generation period data indicated by the second sound generation period data;
The sound indicated by the pitch data included in the note data for each of the note data included in the score data on the coordinates having the first axis indicating the pitch and the second axis indicating the passage of time. of the position of the first axis direction corresponding to the height, said second position to one respective axial end points corresponding to the beginning and end of the sounding period indicated by the sound production period data included in the note data and And display means for displaying a figure as another end point,
The display means displays the graphic corresponding to the one note data and the graphic corresponding to the other note data in a different form from the other graphic when the determining means determines that there is an overlapping portion. A score data display device characterized by that. When it is determined by the determining means that there is an overlapping portion, the first sounding period data and the second sounding period data and the second sounding period are set such that there is no overlapping portion between the first sounding period and the second sounding period. The score data display device according to claim 1, further comprising an adjusting unit that changes at least one of the pronunciation period data. The adjusting means may determine the earlier of the end of the first sounding period and the end of the second sounding period, among the start of the first sounding period and the start of the second sounding period, The score data display device according to claim 2 , wherein one of the first sound generation period data and the second sound generation period data is changed so as to coincide with a later one. A storage process for storing (1) pitch data indicating a pitch and (2) score data including a plurality of note data including at least a pronunciation period data indicating a pronunciation period of the sound;
Relates two or more note data included in the score data, the second contained in other different note data and a first sounding period, and the one note data indicated by sounding period data included in one note data A determination process for determining whether or not there is an overlapping portion between the second sound generation period indicated by the sound generation period data;
The sound indicated by the pitch data included in the note data for each of the note data included in the score data on the coordinates having the first axis indicating the pitch and the second axis indicating the passage of time. of the position of the first axis direction corresponding to the height, said second position to one respective axial end points corresponding to the beginning and end of the sounding period indicated by the sound production period data included in the note data and Let the computer execute the display process to display the graphic with the other end point,
In the display process, when it is determined in the determination process that there is an overlapping portion, the graphic corresponding to the one note data and the graphic corresponding to the other note data are displayed in a different form from the other graphic. A program for causing a computer to execute a process to perform. When it is determined in the determination process that there is an overlapping part, the first sounding period data and the second sounding period data and the second sounding period data are set such that there is no overlapping part between the first sounding period and the second sounding period. The program according to claim 4, wherein the computer is caused to execute adjustment processing for changing at least one of the pronunciation period data.

Images