JP6236765B2 - Music data editing apparatus and music data editing method - Google Patents

Description

  The present invention relates to a technique for editing music data specifying a time series of musical notes.

  Techniques for displaying and editing music data used for sound synthesis such as speech synthesis and musical tone synthesis have been proposed. For example, music data applied to speech synthesis designates the pitch of a synthesized sound, a pronunciation period, a speech code (for example, lyrics characters), and control information for each note. The control information is information that is applied to speech synthesis to control the characteristics of the synthesized sound, and specifies, for example, pitch variation (bend) immediately after the start of sound generation and vibrato mode (type and duration). In Patent Document 1, a figure representing each note specified by music data (hereinafter referred to as “note figure”) is arranged in a piano roll-type score area in which a pitch axis and a time axis are set. A technique for editing music data in response to an instruction from a user for a note graphic is disclosed. In the vicinity of the note graphic of each note, a graphic expressing the control information of the note (for example, a graphic expressing vibrato) is arranged.

Japanese Patent No. 4456088

  In the technique of Patent Document 1, for example, a setting screen for editing the control information of a note selected by the user is displayed separately from the score area, and the control information is edited according to an instruction from the user on the setting screen. A configuration may be employed. However, it is difficult for the user to intuitively grasp the control information of each note and set it to a desired numerical value by operating the setting screen independent of each note graphic. In view of the above circumstances, an object of the present invention is to enable intuitive editing of control information.

  Means employed by the present invention to solve the above problems will be described. In order to facilitate the understanding of the present invention, in the following description, the correspondence between the elements of the present invention and the elements of the embodiments described later will be indicated in parentheses, but the scope of the present invention will be exemplified in the embodiments. It is not intended to be limited.

  The music data editing apparatus of the present invention is an apparatus for editing music data that specifies, for each note, the pitch and the time of sound generation of a synthesized sound and control information applied to sound synthesis, and includes a pitch axis and a time axis. Is a means for displaying a note graphic for each note at a position corresponding to the pitch specified by the music data and at the time of pronunciation in the musical score area, and at the position corresponding to each note graphic in the musical score area. Display control means (for example, display control unit 32) for arranging an edit image (for example, transition image QA, variable instruction image QB, process selection image QC, transition image QD) for receiving an instruction to change the control information of the note indicated by the note graphic And editing processing means (for example, an editing processing unit 34) that edits the control information of the note according to an instruction from the user with respect to the edited image of each note. In the above configuration, the control information is edited according to the operation on the edited image arranged in the score area. That is, the control information is edited by a direct operation on the score area (ie, without an operation on a setting screen or the like separate from the score area). Therefore, for example, it is possible to intuitively and easily edit the control information of each note while confirming each note graphic in the score area.

  In a preferred aspect of the present invention, the display control means includes a transition image (for example, the transition image QA or the transition image QD) that represents a temporal change in the characteristic amount (for example, pitch or volume) of the synthesized sound to which the control information is applied. The edited image is arranged in the score area, the transition image is changed according to the instruction from the user with respect to the transition image, and the editing processing means is controlled to respond to the change of the transition image according to the instruction from the user. Edit information. In the above aspect, since the control information is edited so as to correspond to the change of the transition image expressing the time change of the feature value of the synthesized sound, the time change of the feature value can be edited intuitively. In addition, the specific example of the above aspect is later mentioned, for example as 1st Embodiment or 5th Embodiment.

  In the specific example of the mode for displaying the transition image, the display control means expands and contracts the transition image in the pitch axis direction in accordance with an instruction from the user. According to the above aspect, there exists an advantage that the time change of a feature-value can be confirmed in detail by expanding / contracting a transition image to a pitch axis direction. In addition, the specific example of the above aspect is later mentioned as 4th Embodiment, for example.

  In a preferred aspect of the present invention, the display control means arranges an edit image including a variable instruction image (for example, the variable instruction image QB) indicating the numerical value of the control information in the display area, and uses the numerical value indicated by the variable instruction image as a user. The editing processing means edits the control information so as to correspond to the change in the numerical value of the variable instruction image according to the instruction from the user. In the above aspect, the user can directly specify the numerical value of the control information by operating the variable instruction image. A specific example of the above aspect will be described later as a second embodiment, for example.

  In a preferred aspect of the present invention, the display control means arranges an edited image including a process selection image (for example, the process selection image QC) indicating whether or not the specific process at the time of sound synthesis is performed in the display area, and the process selection image The editing process means edits the control information so as to correspond to the execution of the specific process indicated by the process selection image. In the above aspect, the user can directly specify whether or not to execute the specific process by an operation on the process selection image. In addition, the specific example of the above aspect is later mentioned, for example as 3rd Embodiment.

  In a preferred aspect of the present invention, whether or not an edited image is displayed and whether to be edited depending on whether the display magnification of the score area is below the threshold (first display state) or the display magnification exceeds the threshold (second display state). A configuration in which the type of control information to be changed is also suitable. For example, a configuration in which the edited image is not displayed when the display magnification of the score area is lower than the threshold, or when the display magnification is lower than the threshold, the number of types of control information is smaller than when the display magnification is higher than the threshold. A configuration may be employed in which an edited image that receives a change instruction is arranged.

  The music data editing apparatus according to each of the above aspects is realized by hardware (electronic circuit) such as a DSP (Digital Signal Processor) dedicated to display of music data, and a general-purpose device such as a CPU (Central Processing Unit). This is also realized by cooperation between the arithmetic processing unit and the program. The program of the present invention is a musical score in which a pitch axis and a time axis are set in order to edit music data that designates the pitch of a synthesized sound, the time of sound generation, and control information applied to sound synthesis for each note. This is a process of displaying a note graphic for each note at a position corresponding to the pitch and pronunciation point specified by the music data in the area, and each note graphic in the score area when the display magnification of the score area exceeds the threshold Display control processing for arranging an edit image for accepting an instruction to change the control information of the note indicated by the note graphic at a position corresponding to the note graphic, and control information for the note according to an instruction from the user with respect to the edit image of each note The computer is caused to execute editing processing for editing. According to the above program, the same operation and effect as the music data editing apparatus of the present invention are realized. The program of the present invention is provided in a form stored in a computer-readable recording medium and installed in the computer, or is provided in a form distributed via a communication network and installed in the computer.

1 is a block diagram of a speech synthesizer according to a first embodiment of the present invention. It is a schematic diagram of music data. It is a schematic diagram of the edit screen in a 1st display state. It is a schematic diagram of the setting screen in a 1st display state. It is a schematic diagram of the edit screen in a 2nd display state. It is explanatory drawing of the change of a transition image. It is a schematic diagram of the edit screen of the 2nd display state in 2nd Embodiment. It is a schematic diagram of the edit screen of the 2nd display state in 3rd Embodiment. It is a schematic diagram of the edit screen of the 2nd display state in 4th Embodiment. It is a schematic diagram of the edit screen of the 2nd display state in 4th Embodiment. It is a schematic diagram of the edit screen of the 2nd display state in 5th Embodiment. It is a schematic diagram of the edit screen of the 2nd display state in a modification. It is a schematic diagram of the edit screen in a modification.

<First Embodiment>
FIG. 1 is a block diagram of a speech synthesizer 100 according to the first embodiment of the present invention. The speech synthesizer 100 is a signal processing device that generates a speech signal S of a singing sound by unit connection type speech synthesis. As shown in FIG. 1, an arithmetic processing device 12, a storage device 14, a display device 22, and an input This is realized by a computer system including the device 24 and the sound emitting device 26. For example, the speech synthesizer 100 is realized by a stationary information processing apparatus (personal computer) or a portable information processing apparatus (cellular phone or portable information terminal).

  The arithmetic processing unit 12 implements a plurality of functions (display control unit 32, editing processing unit 34, speech synthesis unit 36) by executing the program PGM stored in the storage device 14. A configuration in which each function of the arithmetic processing unit 12 is distributed over a plurality of integrated circuits, or a configuration in which a dedicated electronic circuit (for example, a DSP) realizes a part of the functions may be employed.

  The display device 22 (for example, a liquid crystal display device) displays an image instructed by the arithmetic processing device 12. The input device 24 is a device that accepts an instruction from a user (for example, a pointing device such as a mouse or a keyboard). Note that a touch panel configured integrally with the display device 22 may be employed as the input device 24. The sound emitting device 26 (for example, a headphone or a speaker) emits a sound wave corresponding to the sound signal S generated by the arithmetic processing device 12.

  The storage device 14 stores a program PGM executed by the arithmetic processing device 12 and various data (speech segment group DA, music data DB) used by the arithmetic processing device 12. A known recording medium such as a semiconductor recording medium or a magnetic recording medium or a combination of a plurality of types of recording media is employed as the storage device 14.

  The speech unit group DA is a speech synthesis library that is composed of a plurality of unit data (for example, a sample series of speech unit waveforms) corresponding to different speech units and used as a material for speech synthesis. The phoneme unit is a phoneme (for example, a vowel or a consonant) that is a minimum unit of linguistic meaning distinction, or a phoneme chain (for example, a diphone or a triphone) that connects a plurality of phonemes.

  The music data DB is data that designates a time series of notes constituting a musical composition, and includes a plurality of unit data U corresponding to different musical notes in the musical composition, as shown in FIG. Each unit data U designates a pitch X1, a sound generation point X2, a duration X3, a voice code X4, and control information X5. The pitch X1 is the pitch of the note (actually, the note number assigned to each pitch). The sound generation time point X2 means the time when sounding starts (sounding time), and the duration X3 means the time (note value) that the sound of the note continues. That is, the sound generation period is defined by the sound generation point X2 and the duration X3. It is also possible to define the sound generation period between the sound generation time point X2 and the mute time point of each note. The audio code X4 is a code indicating the pronunciation content such as the lyrics of the music. In the following description, the pronunciation character (grapheme) of the lyrics is exemplified as the phonetic code X4. However, for example, a phoneme symbol can be designated as the phonetic code X4.

  The control information X5 is a variable (expression parameter) that is applied to speech synthesis and controls the musical characteristics of the synthesized sound. In the first embodiment, variables that define minute changes in pitch immediately after the sounding point X2 (pitch fluctuation range Z1 and fluctuation length Z2) and variables that specify vibrato added to the notes (continuation of vibrato) The length Z3 and the type Z4) are exemplified as the control information X5. As shown in FIG. 2, the fluctuation range Z1 is a pitch fluctuation amount (sound generation) within a section (hereinafter referred to as “start section”) from the sound generation time point X2 to the time point when the target sound pitch X1 is reached in the sound generation period. The difference between the pitch at the start point and the target pitch X1) is defined, and the variation length Z2 defines the time length of the start section. Further, the vibrato continuation length Z3 defines the time length of a section where vibrato is added in the pronunciation section. For example, the ratio of the vibrato time length to the duration X3 of the pronunciation period is designated as the duration Z3. The vibrato type Z4 is set to one of a plurality of candidates (no vibrato / normal vibrato / large amplitude vibrato / small amplitude vibrato / long cycle vibrato / short cycle vibrato).

  The voice synthesizer 36 in FIG. 1 generates a voice signal S using the voice element group DA and the music data DB. Specifically, first, the speech synthesizer 36 sequentially selects, from the speech unit group DA, speech unit data of speech units corresponding to the speech code X4 designated by the music data DB for each note. Second, each piece of data is adjusted to the pitch X1 and duration X3 specified by the unit data U, and the sound characteristics are adjusted according to the control information X5. Thirdly, the speech synthesizer 36 generates the speech signal S by arranging the segment data after adjustment at the sound generation time point X2 designated by each unit data U and connecting them together. The voice signal S generated by the voice synthesizer 36 is supplied to the sound emitting device 26 and reproduced as a sound wave.

  The display control unit 32 in FIG. 1 causes the display device 22 to display the editing screen 50 in FIG. 3 on which the user confirms the contents of the music data DB. As shown in FIG. 3, the editing screen 50 according to the first embodiment includes a score area 51. The score area 51 is a piano roll coordinate plane in which a time axis (horizontal axis) and a pitch axis (vertical axis) intersecting each other are set. In FIG. 3, vertical broken lines L arranged at equal intervals in the time axis direction mean a boundary line (hereinafter referred to as “beat line”) of a period corresponding to one beat in the music. That is, the interval between two beat lines L adjacent to each other on the time axis corresponds to the time length of one beat of the music.

  The display control unit 32 arranges a note graphic V representing each note specified by the music data DB in the score area 51. The note graphic V of the first embodiment is a rectangular graphic. A musical note figure V is displayed in the score area 51 for the notes in a part of the music piece corresponding to the music data DB (hereinafter referred to as “display target section”). The position of the note graphic V in the pitch axis direction is set according to the pitch X1 of the music data DB, and the position of the note graphic V in the time axis direction is set according to the sounding point X2 of the music data DB. The display length of the note graphic V in the time axis direction is set according to the continuation length X3 of the music data DB. Further, the audio code X4 of the music data DB is arranged inside the musical note figure V.

  The editing processing unit 34 in FIG. 1 edits the music data DB in response to an instruction from the user for the score area 51. For example, when the change of the position of the existing note graphic V in the score area 51 is instructed, the pitch X1 and the pronunciation point X2 of the unit data U corresponding to the note graphic V are changed, and the display length of the note graphic V is changed. When the change is instructed, the continuation length X3 of the unit data U is changed. When the change of the voice code X4 corresponding to each note graphic V is instructed, the voice code X4 of the unit data U corresponding to the note graphic V is changed. When the addition of the note graphic V is instructed, the unit data U corresponding to the note graphic V is added to the music data DB.

  As shown in FIG. 3, the editing screen 50 includes an operator image (slider) 52 for the user to change the display magnification Rt in the time axis direction of the score area 51. The user can appropriately operate the operator image 52 using the input device 24. The display control unit 32 expands and contracts the display image in the score area 51 in the time axis direction so that the display magnification Rt specified by the user by the operation on the operator image 52 is obtained.

  The display magnification Rt corresponds to the display length of the unit time of the music in the score area 51 (for example, the time length of one beat of the music). Therefore, as the display magnification Rt increases (the display length of the unit time in the musical score area 51 becomes longer), the display target section in the music becomes shorter, and the number of bars and beats displayed in the musical score area 51 of the music are shortened. As the number decreases (the interval between the beat lines L increases), each note graphic V expands in the time axis direction. On the other hand, as the display magnification Rt decreases (the display length of the unit time in the score area 51 becomes shorter), the display target section in the song becomes longer, and the number of bars and beats displayed in the score area 51 of the song. As the number increases (the interval between the beat lines L decreases), the note graphic V is reduced in the time axis direction. Even when the display magnification Rt is changed, the display size of the score area 51 itself does not change.

  The display control unit 32 changes the display mode of the score area 51 according to the display magnification Rt. Specifically, the display control unit 32 compares the display magnification Rt set by the user with a predetermined threshold TH, and the first display state in which the display magnification Rt is lower than the threshold TH and the display magnification Rt is higher than the threshold TH. The display mode of the score area 51 is changed according to the second display state. That is, the second display state means a state in which the musical score area 51 is enlarged and compared with the first display state. FIG. 3 is a display example of the editing screen 50 in the first display state, and FIG. 5 is a display example of the editing screen 50 in the second display state.

  As shown in FIG. 3, in the first display state, the display control unit 32 arranges an expression graphic E around each note graphic V. The facial expression graphic E is a graphic for the user to start editing the control information X5 of each note. The facial expression graphic E is a first part E1 corresponding to the start period within the pronunciation period and a section where vibrato can be added (that is, the pronunciation period). And a second portion E2 corresponding to the tail end section). The second part E2 of the note to which the vibrato is added is set to a wavy figure (that is, a figure expressing a change in pitch due to vibrato), and the second part E2 of the note to which the vibrato is not added is a linear figure (ie, the figure). A graphic representing that the pitch is kept constant).

  When the user designates the first portion E1 of the expression figure E corresponding to the desired note by operating the input device 24 (for example, clicking with the mouse), the control information X5 (Z1, Z2) relating to the start interval of the note is set. 4 is displayed separately from the editing screen 50. FIG. The user can arbitrarily set the fluctuation range Z1 and the fluctuation length Z2 of the pitch within the start section by operating the setting screen 61. The edit processing unit 34 changes the fluctuation range Z1 and the fluctuation length Z2 designated by the control information X5 of the music data DB to the setting values on the setting screen 61.

  When the user designates the second part E2 of the expression graphic E corresponding to the desired note, setting of the part (B) in FIG. 4 for setting the control information X5 (Z3, Z4) relating to the vibrato of the note The screen 62 is displayed separately from the editing screen 50. The user can arbitrarily set the vibrato duration Z3 by an operation on the setting screen 62, and can select the vibrato type Z4 from a plurality of candidates. The edit processing unit 34 changes the vibrato duration Z3 and the type Z4 specified by the control information X5 of the music data DB to the setting values on the setting screen 62.

  In order to display the first part E1 and the second part E2 of the facial expression figure E arranged in the score area 51 in the first display state, a predetermined figure prepared in advance is used. That is, the image of the first part E1 does not depend on the control information X5, and is common over a plurality of facial expression figures E. Further, the image of the second portion E2 is common to the plurality of facial expression figures E except that the display length in the time axis direction is set according to the vibrato continuation length Z3. For example, the amplitude and period of the wavy line of the second portion E2 are common across the plurality of facial expression figures E.

  On the other hand, in the second display state (in enlarged display) in which the display magnification Rt is higher than the first display state, the display control unit 32 corresponds to each note graphic V in the score area 51 as shown in FIG. The transition image QA is arranged at a position (directly below the note graphic V). The transition image QA is an image (curve or broken line) that expresses the time change of the pitch of each note that actually reflects the control information X5. Therefore, the aspect of the transition image QA (time change of the feature amount) can be different for each note. Specifically, as shown in FIG. 6, the pitch indicated by the transition image QA changes over the fluctuation range Z1 within the start interval of the fluctuation length Z2 and reaches the pitch X1, and the amplitude and the amplitude corresponding to the type Z4 It fluctuates over a continuous length Z3 with a period.

  The user can instruct the change of the transition image QA corresponding to a desired note by appropriately operating the input device 24 (for example, dragging a part of the transition image QA with a mouse). The display control unit 32 changes the shape of the transition image QA in accordance with an instruction from the user. In FIG. 6, the change of the transition image QA is illustrated by a broken line. The edit processing unit 34 edits the note control information X5 indicated by the transition image QA operated by the user so as to correspond to the change of the transition image QA.

  For example, when the user moves the left end portion of the transition image QA in the pitch axis direction as shown by a broken line in FIG. 6, the pitch fluctuation range Z1 of the control information X5 is changed, and the transition image QA is changed. When the user expands or contracts the start section, the pitch variation length Z2 in the control information X5 is changed. Further, when the user expands or contracts the vibrato section of the transition image QA, the vibrato duration Z3 in the control information X5 is changed, and when the user changes the vibrato amplitude or cycle in the transition image QA. The vibrato type Z4 in the control information X5 is changed.

  As described above, in the first display state, the control information X5 is edited by operating the setting screen (61, 62) displayed in response to an instruction for the facial expression figure E, whereas the second display In the state, the control information X5 is edited by an operation on the transition image QA arranged in the score area 51 (that is, a direct operation on the score area 51). Therefore, for example, it is possible to intuitively edit the control information X5 of each note while checking the correlation between the notes in the score area 51.

  In the configuration in which the transition image QA is displayed in the score area 51 and the operation by the user is accepted even in the first display state where the display magnification Rt is low, a large number of note graphics V and a large number of transition images QA are included in the score area 51. Since they are mixed in a small size, it is difficult for the user to accurately operate the transition image QA so that the control information X5 is edited to a desired numerical value. In the first embodiment, since the transition image QA is displayed only in the second display state (during enlarged display) in which the display magnification Rt exceeds the threshold value TH, there is an advantage that an accurate operation of the transition image QA is easy. On the other hand, in the first display state, it is possible to accurately set the control information X5 by operating the setting screen (61, 62).

Second Embodiment
A second embodiment of the present invention will be described. In addition, about the element which an effect | action and a function are equivalent to 1st Embodiment in each form illustrated below, each reference detailed in the above description is diverted and each detailed description is abbreviate | omitted suitably.

  FIG. 7 is a schematic diagram of the editing screen 50 (score area 51) in the second display state in the second embodiment. In the second embodiment, a variable instruction image QB (QB1 to QB4) is arranged at a position corresponding to each note graphic V in the score area 51 in addition to the transition image QA similar to the first embodiment. The variable instruction image QB corresponding to each note is an image showing the numerical value of the control information X5 of that note.

  Specifically, the variable instruction image QB1 displays a pitch fluctuation range Z1, and the variable instruction image QB2 displays a pitch fluctuation length Z2. The variable instruction image QB3 displays the vibrato duration Z3, and the variable instruction image QB4 displays the vibrato type Z4. The display image in the first display state is the same as that in the first embodiment. That is, the transition image QA and the variable instruction image QB are not displayed in the score area 51 in the first display state.

  The user can instruct the numerical value of the desired variable instruction image QB by appropriately operating the input device 24. The display control unit 32 changes the numerical value of the variable instruction image QB to a numerical value designated by the user. The edit processing unit 34 edits the note control information X5 corresponding to the variable instruction image QB according to the numerical value specified by the user with respect to the variable instruction image QB.

  For example, when the numerical value of the variable instruction image QB1 is changed, the pitch fluctuation range Z1 of the control information X5 is updated to the changed numerical value, and when the numerical value of the variable instruction image QB2 is changed, the control information Of X5, the pitch fluctuation length Z2 is updated to the changed value. Similarly, the vibrato duration Z3 in the control information X5 is updated according to the instruction for the variable instruction image QB3, and the vibrato type Z4 in the control information X5 is an instruction for the variable instruction image QB4 (for example, a plurality of pull-down menu candidates). Updated in response to an instruction to select the type of vibrato from

  When the control information X5 is updated in response to an instruction from the user for the variable instruction image QB, the display control unit 32 updates the transition image QA so as to correspond to the updated control information X5. Further, as in the first embodiment, the user can change the transition image QA by operating the input device 24. When the control information X5 is updated so as to correspond to the change of the transition image QA, the display control unit 32 changes the numerical value of each variable instruction image QB to the updated content of the control information X5.

  As described above, in the second display state of the second embodiment, control is performed by an operation on the variable instruction image QB (QB1 to QB4) arranged in the score area 51 (that is, a direct operation on the score area 51). Information X5 is edited. Therefore, similarly to the first embodiment, for example, it is possible to intuitively edit the control information X5 of each note while confirming the correlation between the notes in the score area 51. Further, since the variable instruction image QB is displayed in the second display state where the display magnification Rt is high, for example, the variable instruction image QB is compared with the configuration in which the variable instruction image QB is displayed even in the first display state where the display magnification Rt is low. There is an advantage that the operation of changing the value of QB is easy. In the first display state in which the display magnification Rt is low, the display of the variable instruction image QB is omitted and the score area 51 is simplified. Therefore, there is an advantage that the user can easily confirm each note graphic V.

<Third Embodiment>
The control information X5 of the third embodiment includes processing selection information Z5 in addition to the same variables (Z1 to Z4) as in the first embodiment. The process selection information Z5 of the control information X5 for each note designates, for each of a plurality of types of specific processes, whether or not to execute a predetermined process (hereinafter referred to as “specific process”) when the synthesized sound of the note is generated. The specific process is a process that can be executed by the speech synthesizer 36 during speech synthesis. In the following description, portamento processing and automatic segment determination processing are exemplified as specific processing. The portamento process is a process for continuously connecting the pitches of two successive notes. The automatic segment determination process is a process of automatically selecting a speech segment corresponding to the speech code X4 (phonetic character) designated by the user. In a state where the automatic segment determination process is not executed, the speech segment arbitrarily designated by the user is selected regardless of the speech code X4. That is, the selection of the speech segment by the user is protected.

  FIG. 8 is a schematic diagram of the editing screen 50 (score area 51) in the second display state in the third embodiment. In the third embodiment, a processing selection image QC (QC1, QC2) is arranged at a position corresponding to each note graphic V in the score area 51 in addition to the transition image QA similar to the first embodiment. The process selection image QC corresponding to each note is an image indicating whether or not the specific process is executed when the synthesized sound of the note is generated. The process selection image QC1 is an image indicating whether or not the portamento process is executed, and the process selection image QC2 is an image indicating whether or not the automatic segment determination process is executed. The display control unit 32 displays each process selection image QC (QC1, QC2) according to the process selection information Z5 of the control information X5. A state in which the check box of the process selection image QC1 is set to ON (a state in which a check is added) means that portamento processing is executed, and a state in which the check box of the process selection image QC2 is set to ON is an automatic element. This means that the single decision process is not executed. The display image in the first display state is the same as that in the first embodiment. That is, the transition image QA and the process selection image QC are not displayed in the score area 51 in the first display state.

  The user can instruct whether or not to execute a specific process corresponding to each process selection image QC by appropriately operating the input device 24 (for example, clicking a check box of each process selection image QC with a mouse). Is possible. The display control unit 32 sets the check box of each process selection image QC to ON or OFF according to an instruction from the user. The edit processing unit 34 edits the control information X5 (process selection information Z5) corresponding to the note in response to an instruction from the user for each process selection image QC.

  As described above, in the second display state of the third embodiment, control is performed by an operation on the processing selection image QC (QC1, QC2) arranged in the score area 51 (that is, a direct operation on the score area 51). Information X5 is edited. Therefore, similarly to the first embodiment, for example, it is possible to intuitively edit the control information X5 of each note while confirming the correlation between the notes in the score area 51. Further, since the process selection image QC is displayed in the second display state where the display magnification Rt is high, for example, the process selection image QC is compared with the configuration in which the process selection image QC is displayed even in the first display state where the display magnification Rt is low. There is an advantage that the operation of QC is easy. In the first display state where the display magnification Rt is low, the display of the processing selection image QC is omitted and the score area 51 is simplified, so that there is also an advantage that the user can easily confirm each note graphic V.

<Fourth embodiment>
FIG. 9 is a schematic diagram of the editing screen 50 in the second display state according to the fourth embodiment. In the first embodiment, the transition image QA is arranged around each note graphic V in the score area 51. As shown in FIG. 9, the display control unit 32 according to the fourth embodiment arranges the transition image QA of the note inside the note figure V of each note (inside the outline).

  As shown in FIG. 9, the editing screen 50 of the fourth embodiment includes an operator image (slider) 53 for the user to change the display magnification Rp of the musical score area 51 in the pitch axis direction. . The user can appropriately operate the operator image 53 using the input device 24. The display control unit 32 expands and contracts the display image in the score area 51 in the pitch axis direction so that the display magnification Rp specified by the user by the operation on the operator image 53 is obtained.

  FIG. 10 is a schematic diagram of the editing screen 50 when the display magnification Rp is increased from the state of FIG. As shown in FIG. 10, as the display magnification Rp increases, the display control unit 32 increases the display width of one pitch in the pitch axis direction (interval between broken lines in the horizontal direction in FIG. 10) and The note graphic V is expanded in the pitch axis direction. Then, the display control unit 32 extends the transition image QA in the pitch axis direction in conjunction with the expansion of the note graphic V. That is, the time change of the pitch indicated by the transition image QA is emphasized and is easily visually recognized. Note that the control information X5 is not changed by expansion / contraction of the transition image QA linked to the display magnification Rp. The configuration in which the control information X5 is edited in response to an instruction from the user for the transition image QA is the same as in the first embodiment.

  In the fourth embodiment, the same effect as in the first embodiment is realized. In the fourth embodiment, since the display magnification Rp in the pitch axis direction can be changed, the user confirms in detail the time change of the pitch indicated by the transition image QA by increasing the display magnification Rp. It is possible.

  In the fourth embodiment, since the pitch expressed by the transition image QA corresponds to a numerical value on the pitch axis, the configuration of the first embodiment in which the transition image QA is arranged around the note graphic V (that is, Compared with the pitch that the transition image QA expresses and the numerical value on the pitch axis do not necessarily match, the user can accurately and easily grasp the numerical value of the pitch indicated by the transition image QA (and editing work) Is facilitated).

<Fifth Embodiment>
In addition to the variables (Z1 to Z4) similar to those in the first embodiment, the control information X5 in the fifth embodiment includes variables (intensities Z6, Z6) that define a minute change in amplitude immediately after the pronunciation time X2 of each note. Attenuation degree Z7) is included. The strength Z6 defines the speed (accent) at which the voice amplitude increases immediately after the sounding time point X2, and the attenuation degree Z7 defines the degree (decay) at which the voice amplitude attenuates after the start of sounding.

  FIG. 11 is a schematic diagram of the editing screen 50 in the second display state according to the fifth embodiment. The display control unit 32 arranges the transition image QD at a position corresponding to each note graphic V in the score area 51 in the second display state. The transition image QD is an image (curved line or broken line) that expresses the time change of the amplitude of each note that actually reflects the control information X5 (Z6, Z7). That is, as shown in FIG. 11, the amplitude indicated by the transition image QD increases from the sound generation time point X2 at a speed according to the strength Z6, reaches the target value, and then gradually increases with the degree according to the attenuation Z7. Attenuates.

  Similar to the transition image QA of the first embodiment, the user can instruct editing of the control information X5 by directly operating the transition image QD using the input device 24. That is, the display control unit 32 changes the shape of the transition image QD in accordance with an instruction from the user, and the editing processing unit 34 controls the musical note control information X5 (strength Z6) indicated by the transition image QD operated by the user. , Attenuation Z7) is edited so as to correspond to the change of the transition image QD. Therefore, the same effect as that of the first embodiment is also realized in the fifth embodiment.

  Note that the variable instruction image QB of the second embodiment and the processing selection image QC of the third embodiment can be arranged in the score area 51 for each note together with the transition image QD (or instead of the transition image QD). The variable instruction image QB can be used, for example, for the user to specify the strength Z6 and the attenuation Z7. Similarly to the fourth embodiment, the transition image QD is expanded and contracted in the pitch axis direction together with the note graphic V in accordance with the configuration in which the transition image QD is arranged inside the musical note graphic V and the display magnification Rp in the pitch axis direction. The structure to do is also adopted.

<Modification>
Each of the above forms can be variously modified. Specific modifications are exemplified below. Two or more modes arbitrarily selected from the following examples can be appropriately combined.

(1) In the second display state in which the display magnification Rt in the time axis direction is high, the number of note figures V displayed in the score area 51 is reduced compared to the first display state. Therefore, a configuration in which information corresponding to each note before and after the display target section in the music is arranged in the score area 51 together with the information in the display target section is preferable. For example, as shown in FIG. 12, the display control unit 32, together with the voice code X4_A (character string “Sai”) of each note in the display target section, a predetermined number of notes (that is, the note graphic V) immediately after the display target section. Is placed in the score area 51. The voice code X4_B (character string of “Hanaga”) is not displayed in the score area 51. According to the above configuration, even when the display magnification Rt is high, it is possible to check the information of each note (for example, the voice code X4) over a wide range in the music.

(2) The configuration for the user to change the display magnification Rt and the display magnification Rp is arbitrary. For example, the display magnification Rt and the display magnification Rp are specified by the user as numerical values, or the display magnification Rt and the display magnification Rp are set to predetermined values (for example, a threshold TH) by a predetermined operation (for example, pressing a button) by the user. A configuration is adopted. In addition, when the user selects one note graphic V, the display magnification Rt can be set so that the note graphic V in a predetermined range including the note graphic V is positioned in the score area 51. . For example, in the first display state illustrated in FIG. 3, when the user selects the second musical note graphic V (speech code “I”) from the beginning, the musical note graphic V selected by the user and immediately before and after The display magnification Rt is automatically set so that the three note figures V including the note figure V extend all over the time axis direction of the score area 51 (that is, the display is changed from the display of FIG. 3 to the display of FIG. 5). Set to

(3) The form of an image (hereinafter referred to as “edited image”) for receiving an instruction to change each control information X5 from the user is not limited to the above examples. For example, an image of an operator (knob) that rotates in response to an instruction from the user, or an image of an operator (slider) that moves linearly in response to an instruction from the user is, for example, the second. It may be adopted as the variable instruction image QB of the embodiment. It is also possible to configure an edited image by appropriately combining the transition image QA of the first embodiment, the variable instruction image QB of the second embodiment, and the process selection image QC of the third embodiment. As understood from the above description, the edited images (QA to QD) exemplified in the above-described embodiments are included as images for receiving a change instruction for the control information X5 from the user, and change instructions for the edited image are included. Is directly reflected in the control information X5 (ie, without performing an operation on another image such as the setting screen 61 or the setting screen 62).

(4) In each of the above-described embodiments, the edited images (QA to QD) are arranged around each note graphic V in the second display state in which the display magnification Rt exceeds the threshold TH, but the first display state and the second display are provided. It is also possible to arrange edited images (QA to QD) around each note graphic V in both states. When the edited image (QA to QD) is displayed in both the first display state and the second display state, a larger number of control information than the number of types of control information X5 that can be edited by operating the edited image in the first display state. A configuration is preferably employed in which X5 can be edited by operating the edited image in the second display state (during enlarged display).

  For example, when displaying the transition image QA of the first embodiment expressing the time change of the pitch of each note, only the change of the vibrato duration Z3 is permitted in the first display state, and the vibrato is changed in the second display state. It is permitted to change both the continuation length Z3 and the type (pitch fluctuation range) Z4. In the first display state, only the change of the vibrato duration Z3 is permitted, and in the second display state, the transition image QA that accepts a change instruction such as the vibrato duration Z3 and the type Z4 is arranged inside each note graphic V. It is also possible. Further, in the first display state, a transition image QA that accepts an instruction to change a pitch change with time is displayed, and in the second display state, a process selection image QC that indicates the presence or absence of specific processing is displayed in addition to the transition image QA. Can also be employed. Each aspect illustrated above has a configuration in which the number of types of control information X5 that can be edited by an operation on an edited image changes according to the display magnification Rt (for example, the number of types of control information X5 that can be edited in the second display state is the first). The specific contents of the images displayed in each of the first display state and the second display state are limited to the above examples. It is changed as appropriate without any change. Further, for example, a configuration in which the display mode of the mouse cursor is changed when the display magnification Rt exceeds the threshold value TH may be employed.

(5) The type of control information X5 that can be edited in response to an instruction from the user for the edited image is not limited to the above examples. For example, a configuration is adopted in which variables such as synthesized sound volume (dynamics, velocity), clarity (increase / decrease degree of high-frequency component), opening degree at the time of utterance, etc. are used as control information X5, and editing is performed in response to an instruction to the edited image. Is done. That is, the control information X5 is included as a variable applied to speech synthesis. In addition, a configuration in which the user can select information to be displayed in the score area 51 among the control information X5 is also suitable.

(6) In each of the above-described embodiments, the notes of one part of the music are displayed in the score area 51. However, the notes of each of the parts of the music can be displayed simultaneously or selectively in the score area 51. It is. The note graphic V is displayed in a different mode for each part (that is, a mode in which the note graphic V of each part can be visually distinguished by a difference in color and gradation).

(7) The format of the process selection image QC in the third embodiment is not limited to the above examples. For example, as illustrated in FIG. 13, execution of specific processing such as automatic segment determination processing and portamento processing (that is, a state in which the check boxes of the above-described processing selection image QC1 and processing selection image QC2 are set to ON). It is also possible to add the meaning processing selection image QC3 to the note graphic V (for example, to overlap the note graphic V). In the example of FIG. 13, a graphic (triangle) having a display mode different from the musical note graphic V is arranged at the corner (lower right corner) of the musical note graphic V as the processing selection image QC3. When the user operates the process selection image QC3 (for example, clicks with the mouse), the process selection image QC3 is changed to a state where the process selection image QC3 is erased (a state where the specific process is not executed). When the user operates the corner portion of the note graphic V with the process selection image QC3 being erased, the process selection image QC3 is displayed. Therefore, the user can visually confirm whether or not the specific process is executed by displaying / hiding the process selection image QC3. In addition to the configuration for controlling the display / non-display of the process selection image QC, a configuration for controlling the display mode (color and gradation) of the process selection image QC depending on whether or not the specific process is executed may be employed.

(8) In each of the above-described embodiments, the storage device 14 that stores the speech element group DA and the music data DB is mounted on the speech synthesizer 100. However, an external device (for example, a server device) that is independent of the speech synthesizer 100. May also be configured to store one or both of the speech element group DA and the music data DB. The speech synthesizer 100 acquires the speech element group DA or the music data DB via, for example, a communication network, and displays the editing screen 50, edits the music data DB, and synthesizes the speech signal S. As can be understood from the above description, the element for storing the speech element group DA and the music data DB (the storage device 14 in each of the above embodiments) is not an essential element of the speech synthesizer 100.

(9) In the above-described embodiments, the synthesis of Japanese speech has been illustrated, but the language of the speech to be synthesized is arbitrary and is not limited to Japanese. For example, the above embodiments can be similarly applied to the case of generating speech in an arbitrary language such as English, Spanish, Chinese, or Korean.

(10) In each of the above-described embodiments, the speech synthesizer 100 including the speech synthesizer 36 is exemplified. However, a device (music data editing device) that displays the music data DB on the display device 22 and edits it in accordance with an instruction from the user. The present invention is also realized as an apparatus. For example, the music data editing apparatus has a configuration in which the voice synthesizing unit 36 is omitted from the voice synthesizing apparatus 100 of FIG. In other words, the speech synthesizer 100 is realized by adding the speech synthesizer 36 to the music data editing device.

  Further, in each of the above-described embodiments, the music data DB applied to speech synthesis is illustrated, but the synthesis target to which the music data DB is applied is not limited to speech (human voice). For example, the music data DB can be used for synthesizing performance sounds (musical tone synthesis) of various musical instruments. That is, the music data DB is included as data applied to acoustic synthesis including speech synthesis and musical tone synthesis.

DESCRIPTION OF SYMBOLS 100 ... Speech synthesis device, 12 ... Arithmetic processing device, 14 ... Memory | storage device, 22 ... Display device, 24 ... Input device, 26 ... Sound emission device, 32 ... Display control part, 34 ... Editing Processing unit, 36... Speech synthesis unit.

Claims (6)

A device for editing music data that designates the pitch and sounding time of a synthesized sound and control information applied to sound synthesis for each note,
A note graphic is displayed for each note in a position corresponding to the pitch specified by the music data and the point in time of pronunciation in the musical score area where the pitch axis and time axis are set, and corresponds to each note graphic in the musical score area. Display control means for arranging an edit image for receiving an instruction to change the control information of the note indicated by the note graphic,
Editing processing means for editing the control information of the note according to an instruction from the user for the edited image of each note,
The display control means includes control information for accepting a change instruction by an edited image when the display magnification is lower than the threshold when the display magnification of the score area is higher than the threshold, and the display magnification is the threshold A music data editing apparatus that arranges an edited image that accepts an instruction to change the number of types of control information, which is larger than the case of less than The display control means arranges the edited image including a transition image expressing a temporal change in a feature amount of a synthesized sound to which control information is applied in the score area, and according to an instruction from a user with respect to the transition image Changing the transition image;
The music data editing apparatus according to claim 1, wherein the editing processing unit edits the control information so as to correspond to a change in the transition image according to an instruction from a user. The display magnification of the score area is the display magnification in the time axis direction,
The display control means expands and contracts the transition image in the time axis direction according to the display magnification in the time axis direction, while the pitch axis direction display is changed independently from the display magnification in the time axis direction. The music data editing apparatus according to claim 2, wherein the transition image is expanded and contracted in the pitch axis direction according to a magnification. The display control means arranges the edited image including a variable instruction image indicating a numerical value of control information in the score area, and changes a numerical value indicated by the variable instruction image according to an instruction from a user,
The music data editing apparatus according to any one of claims 1 to 3, wherein the editing processing unit edits the control information so as to correspond to a change in a numerical value of the variable instruction image according to an instruction from a user. The display control means arranges the edited image including the process selection image indicating whether or not the specific process at the time of sound synthesis is executed in the score area, and determines whether or not the specific process indicated by the process selection image is executed. Change according to instructions from
The music data editing apparatus according to any one of claims 1 to 4, wherein the editing processing unit edits the control information so as to correspond to whether or not a specific process indicated by the process selection image is executed. A method of editing music data that specifies the pitch of a synthesized sound and the time of pronunciation and control information applied to sound synthesis for each note,
Computer system
A note graphic is displayed for each note in a position corresponding to the pitch specified by the music data and the point in time of pronunciation in the musical score area where the pitch axis and time axis are set, and corresponds to each note graphic in the musical score area. An edit image that accepts an instruction to change the control information of the note indicated by the note graphic,
Edit the control information of the note according to the instruction from the user for the edited image of each note,
The arrangement of the edited image includes control information for receiving an instruction to change the edited image when the display magnification is lower than the threshold when the display magnification of the score area is higher than the threshold, and the display magnification is A music data editing method in which an edited image for accepting an instruction to change a large number of types of control information compared to a case where the threshold value is below the threshold is arranged.

Images