JP2009258291A - Sound data processing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make it easy to check each designated note in a music information image. <P>SOLUTION: A storage device 12 stores a plurality of sound data D used for combining different sounds. An allocation section 34 allocates singular sound data D or the plurality of sound data D to one designated note. A display control section 26 makes a display device 16 display a music information image 60 in which an indicator P whose vertical axis position is selected according to the pitch of the designated note, and whose horizontal axis position is selected according to the sounding point of time of the designated note is arranged for each designated note. The display control section 26 displays the indicator P of the designated note in which the singular sound data D are allocated, and the indicator P of the designated note in which the plurality of sound data D are allocated, in different modes. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for processing audio data used for synthesizing voice (human voice or musical instrument performance).

Conventionally, a technique for synthesizing speech based on music information (score data) that specifies a pitch, a time point of pronunciation, and a time length has been proposed. The user edits and creates music information while confirming an image in which music information is visualized (hereinafter referred to as “music information image”) on a display device. For example, as disclosed in Patent Document 1, in a music information image, figures (hereinafter referred to as “indicators”) corresponding to a voice designated as a synthesis target (hereinafter referred to as “designated sound”) are arranged in time series. It is an image (piano roll). The position of the indicator in the direction of the vertical axis is selected according to the pitch of the designated sound, and the position of the indicator in the direction of the horizontal axis is selected according to the time point of the specified sound.
JP 2004-258563 A

  Since each indicator in the music information image is individually arranged for each singing sound used for synthesizing the designated sound, a case where a plurality of singers instruct to synthesize a voice (chorus sound) singing a common melody Even so, it is necessary to create a time series of indicators in the music information image individually for each singer and instruct the synthesized sound. Therefore, there is a problem that the operation of confirming each indicator (and creating or editing music information) in the music information image is complicated for the user. In the above, the case of synthesizing a mixed sound of a plurality of singing sounds has been exemplified, but the same problem occurs when synthesizing ensemble sounds of a plurality of musical instruments. In view of the above circumstances, an object of the present invention is to facilitate confirmation of each designated sound in a music information image.

  In order to solve the above-described problems, an audio data processing device according to the present invention includes a storage unit that stores a plurality of audio data used for synthesizing different sounds, and two or more audio data among the plurality of audio data. Is assigned to one designated sound, and the position in the direction of the first axis is selected in accordance with the pitch of the designated sound, and the position in the direction of the second axis is selected in accordance with the sounding point of the designated sound. Display control means for displaying on the display device a music information image in which the designated indicator is arranged for each designated sound. In the present invention, one designated sound to which the assigning means assigns two or more audio data is displayed by one indicator of the music information image. Therefore, the user can easily confirm the designated sound as compared with the case where the indicator is displayed separately for each of the plurality of audio data assigned to the common designated sound.

  The “voice” in the present invention is arbitrary sound. For example, human vocal sounds (for example, singing sounds) and musical instrument performance sounds are included in the concept of “speech” of the present invention. The “designated sound” is a sound designated as a synthesis target. The method of specifying the designated sound is arbitrary. For example, the designated sound may be designated by music information prepared in advance, or the user may arbitrarily designate the designated sound. The “indicator mode” means a state of the indicator that can be visually recognized. For example, the size, display color (hue, brightness, saturation) and shape of the indicator are included in the concept of “indicator mode”.

  In a preferred aspect of the present invention, the display control means displays the indicators of the designated sounds having different combinations of the voice data assigned by the assignment means in different ways. In the above aspect, since the indicators having different combinations of the sound data assigned to the designated sound are displayed in different forms, the user can play the designated sounds generated from the sound data of different combinations. There is an advantage that the information image can be easily distinguished.

  In a preferred aspect of the present invention, the assigning means can selectively assign one sound data and two or more sound data to one designated sound, and the display control means has one sound data as the assigning means. The indicator of the designated sound to which is assigned and the indicator of the designated sound to which the assigning means has assigned two or more audio data are displayed in different manners. In the above aspect, the designated sound indicator assigned with the single sound data and the designated sound indicator assigned with two or more pieces of sound data are displayed in different forms. There is an advantage that the user can easily distinguish whether the data is singular or plural by the music information image. For example, when one piece of voice data is used to synthesize a single piece of voice (for example, a single utterance sound or a performance sound of one instrument), the user can sing whether the specified sound is synthesized as a solo sound or a solo sound. Whether it is synthesized as a sound or an ensemble sound can be distinguished from the indicator form of the music information image.

  In a preferred aspect of the present invention, the display control means displays in a common manner the indicators of the designated sounds that share the same combination of voice data assigned by the assigning means. In the above aspect, since the indicators having a common combination of sound data assigned to the designated sound are displayed in a common form, they are synthesized as the same kind of sound (sound synthesized from sound data of a common combination). There is an advantage that the user can easily confirm the time series of the designated sound to be played.

  In a preferred aspect of the present invention, the display control unit variably sets the aspect of each indicator in accordance with an instruction from the user. According to the above aspect, since the mode of each indicator is variably set according to an instruction from the user, each indicator is configured in an easy-to-check manner according to the sensitivity and preference of each user. Can be displayed.

  In a preferred aspect of the present invention, the display control unit changes the mode of the indicator of the designated sound according to the number of audio data assigned to the designated sound by the assigning unit. According to the above aspect, there exists an advantage that a user can confirm visually some of the audio | voice data allocated to each designated sound easily.

  In the audio data processing device according to a preferred aspect of the present invention, the pitch distribution range (pitch distribution range) of the voice corresponding to each of the two or more audio data assigned by the assigning unit to one designated sound can be changed. First setting means for setting (for example, setting unit 42 in FIG. 8) is provided, and the display control means changes the indicator mode of the designated sound in accordance with the distribution range set for the designated sound by the first setting means. Change. In the above aspect, the user can easily visually confirm the degree (distribution range) of the pitch of the voice corresponding to each of the plurality of voice data.

  In the audio data processing device according to a preferred aspect of the present invention, the second setting for variably setting the distribution range at the time when the audio corresponding to each of the two or more audio data assigned by the assigning unit to one designated sound starts. Means (for example, the setting unit 42 in FIG. 8), and the display control means changes the mode of the indicator of the designated sound according to the distribution range set by the second setting means as the designated sound. In the above aspect, the user can easily visually confirm the degree of fluctuation (distribution range) when the sound corresponding to each of the plurality of sound data is generated.

  In a preferred aspect of the present invention, the storage means stores each feature quantity of the plurality of audio data, and two or more feature quantities similar to the instruction feature quantity according to the instruction from the user among the plurality of audio data. Selecting means for selecting the audio data from the storage means, and the assigning means assigns two or more sound data selected by the selecting means to one designated sound. In the above aspect, since two or more pieces of sound data having a feature amount similar to the designated feature amount are assigned to one designated sound, the user does not recognize each musical feature amount of the plurality of sound data. However, it is possible to assign a combination of voice data having a desired feature amount of the user to the designated sound. However, a method for selecting a combination of audio data assigned to the designated sound is arbitrary. For example, a configuration in which a user designates each of two or more audio data to be assigned to one designated sound, or a configuration in which two or more audio data randomly selected from a plurality of audio data stored in a storage device is assigned to a designated sound. Is also adopted.

  In the specific example of the aspect in which the audio data is selected according to the similarity between the instruction feature quantity and the feature quantity, the selection unit is the number of voices variably instructed by the user in the order of similarity to the instruction feature quantity. Select data from storage means. In the above aspect, since the number of audio data allocated to the designated sound is variably set according to the instruction from the user, the synthesized sound of the user's desired scale (total number of singers and performers) is obtained. There is an advantage that it can be generated.

  In the aspect in which voice data is selected according to the similarity between the instruction feature quantity and the feature quantity, the feature quantity is specified by, for example, multivariate analysis (factor analysis) of voice data for a plurality of factors related to musical features. Contains multiple factor values. In the above configuration, since the factor value of each factor that characterizes the psychological impression of speech constitutes the feature amount, it is possible to appropriately generate the synthesized sound of the impression desired by the user.

  The instruction feature amount is a feature amount in which an instruction from the user is reflected. In the present invention, a specific method for specifying the instruction feature amount is arbitrary. For example, in a configuration in which a set of factor values designated by the user for each of a plurality of factors is used as an indicated feature amount, the user can specify precisely the feature amount of audio data to be used for the synthesis of the designated sound. There is an advantage. On the other hand, in the configuration in which the feature quantity stored in the storage means is used as the instruction feature quantity for the voice data selected by the user, the voice data similar to the voice data in which the user has already recognized the voice impression is selected. There is an advantage that you can.

  In the specific example of the aspect in which the audio data is selected according to the similarity between the instruction feature quantity and the feature quantity, the storage unit stores each attribute of the plurality of audio data, and the selection unit has the feature quantity indicating the instruction feature quantity. And the audio data corresponding to the attribute selected by the user is selected. In the above aspect, since the attribute of the audio data is adopted as the selection criterion by the selection means in addition to the feature amount, it is easy to select the audio data that can generate the synthesized sound that further matches the user's preference and sensitivity There is an advantage that you can. Note that, as the attribute of the voice data, for example, the gender and age of the utterer of the uttered sound represented by the voice data, or the type and model of the instrument used for the performance of the performance sound represented by the voice data are suitable.

  The audio data processing apparatus according to each aspect described above is realized by hardware (electronic circuit) such as a DSP (Digital Signal Processor) dedicated to audio data processing, and a general-purpose such as a CPU (Central Processing Unit). This is also realized by cooperation between the arithmetic processing unit and the program. The program according to the present invention assigns two or more audio data among a plurality of audio data to one designated sound to a computer having storage means for storing a plurality of audio data used for synthesizing different sounds. For each designated sound, an indicator in which the position in the direction of the first axis is selected according to the processing and the pitch of the designated sound, and the position in the direction of the second axis is selected according to the time of sounding of the designated sound. Display control processing for displaying the music information image arranged on the display device on the display device. According to the program of the present invention, operations and effects similar to those of the audio data processing apparatus according to each of the above aspects are exhibited. The program of the present invention is provided to a user in a form stored in a computer-readable recording medium and installed in the computer, or provided from a server device in a form of distribution via a communication network and installed in the computer. Is done.

<A: First Embodiment>
FIG. 1 is a block diagram of an audio data processing apparatus 100A according to the first embodiment of the present invention. As shown in FIG. 1, the audio data processing device 100A is realized by a computer system including a control device 10, a storage device 12, an input device 14, a display device 16, and a sound output device 18.

  The control device 10 is an arithmetic processing device that executes a program. The control device 10 generates and outputs a voice signal SOUT by functioning as a plurality of elements (information generation unit 22, voice synthesis unit 24, display control unit 26, selection unit 32, and allocation unit 34). However, each element of the control device 10 is also realized by a dedicated electronic circuit (DSP). The audio signal SOUT is a signal representing a waveform of a voice (hereinafter referred to as “synthetic sound”) synthesized in response to an operation by the user with respect to the input device 14. The storage device 12 stores a program executed by the control device 10 and various data used by the control device 10. A known recording medium such as a semiconductor storage device or a magnetic storage device is arbitrarily adopted as the storage device 12.

  The storage device 12 stores n pieces (n is a natural number of 2 or more) of sound data D (D1 to Dn) used for synthesizing different sounds. Each of the n pieces of sound data D in this embodiment is generated from the sound of a separate speaker. One speech data D is composed of a plurality of segment data collected for each of a plurality of speech segments ([a], [i], [u],...) Obtained by dividing speech on the time axis. The For example, data representing the waveform of a speech unit and data representing the feature amount of the waveform of the speech unit are used as the segment data. The phoneme segment is a phoneme chain in which speech is divided into a minimum unit that can be distinguished by hearing or a phoneme chain in which a plurality of phonemes are connected. As shown in FIG. 1, each audio data D is given a unique identifier dA (dA1 to dAn).

  The input device 14 is a device (for example, a mouse or a keyboard) operated by a user for inputting an instruction to the audio data processing device 100A. The display device 16 (for example, a liquid crystal display device) displays various images under the control of the control device 10. The sound output device 18 is a sound emitting device (for example, a speaker or headphones) that emits a sound wave corresponding to the audio signal SOUT supplied from the control device 10.

  The information generation unit 22 in FIG. 1 generates music information (score data) SD for designating a plurality of sounds (designated sounds) to be synthesized and stores them in the storage device 12. FIG. 2 is a schematic diagram of the music information SD. The music information SD designates the pitch, pronunciation time, pronunciation symbol, and identifier dB (dB1 to dBn) of the designated sound for each of the plurality of designated sounds. The pronunciation time includes designation of the start point and end point of the specified sound.

  An identifier dB (dB1 to dBn) corresponding to one designated sound in the music information SD is a code for identifying a combination of audio data D (hereinafter referred to as “part”) used for synthesis of the designated sound. There are cases where a single sound data D (hereinafter referred to as “single part”) is assigned to the designated sound and a set of a plurality of sound data D (hereinafter referred to as “knitting part”) is assigned. The identifier dA of the single audio data D is set as the identifier dB in the music information SD for the designated sound to which the single part is assigned, and for the combination of a plurality of audio data D for the designated sound to which the organization part is assigned. Thus, the uniquely assigned identifier dB is set in the music information SD.

  The voice synthesizer 24 in FIG. 1 synthesizes the voice signal SOUT using the music information SD generated by the information generator 22. More specifically, the speech synthesizer 24 sequentially selects each of a plurality of designated sounds (hereinafter, specifically referred to as “target designated sounds”) in time series with reference to the pronunciation time in the music information SD. When the part of the identifier dB set as the target designated sound in the music information SD is a single part, the speech synthesizer 24 firstly selects the target designated sound in the music information SD of the voice data D indicated by the identifier dB. The segment data corresponding to the phonetic symbol specified in (1) is acquired from the storage device 12. Secondly, the speech synthesizer 24 adjusts the pitch of the segment data acquired from the storage device 12 to the pitch set as the target designated sound in the music information SD. On the other hand, when the part of the identifier dB set to the target designated sound is a knitting part, the speech synthesizer 24 acquires from each of a plurality of pieces of sound data D constituting the knitting part in the same manner as in the case of a single part. The segment data is synthesized (added) after adjusting the pitch. The audio signal SOUT is generated by performing D / A conversion (not shown) of the time series of the segment data generated by the above procedure. Therefore, the designated sound to which a single part is assigned is synthesized as a single speaker's voice (singing sound), and the designated sound to which a composition part is assigned is synthesized as a mixed sound (choral sound) of a plurality of voices. The

  The display control unit 26 in FIG. 1 generates various images related to the generation and editing of the music information SD and displays them on the display device 16. For example, the display control unit 26 sets a setting image (FIGS. 3, 5, and 6) for the user to set various items, and music information for the user to confirm or edit (create) the music information SD. The image (FIG. 4) is displayed on the display device 16.

  The selection unit 32 in FIG. 1 constructs a knitting part by selecting a plurality of audio data D according to an operation from the user with respect to the input device 14. When the generation of the knitting part is instructed by the user, the display control unit 26 causes the display device 16 to display the setting image 52 of FIG. In the setting image 52, an identification area 521, a selection area 522, and a candidate area 523 are arranged. In the identification area 521, an identifier dB (named “Cho1” in the example of FIG. 3) of the knitting part actually knitted in the setting image 52 is displayed. Note that the identifier dB (for example, the name “Cho1”) is variably set according to an operation from the user on the input device 14.

  In the selection area 522, identifiers dA (for example, names such as “Taro” and “Jiro”) of the n pieces of audio data D stored in the storage device 12 are arranged. When the user selects one identifier dA in the selection area 522 and operates an operator (command button) 524 (Add), the display control unit 26 adds the identifier dA to the candidate area 523. On the other hand, when the user selects one identifier dA in the candidate area 523 and operates the operation element 525 (Delete), the display control unit 26 deletes the identifier dA from the candidate area 523.

  The operation element 526 is an image for the user to view the sound of one or a plurality of sound data D designated by the user as a candidate for composition data (that is, sound data D in which the identifier dA is arranged in the candidate area 523). It is. When the operator 526 is operated, the selection unit 32 outputs segment data of a predetermined speech unit to the speech synthesizer 24 for each of one or a plurality of speech data D in which the identifier dA is arranged in the candidate area 523. To do. The speech synthesizer 24 outputs a speech signal SOUT by mixing speech of a predetermined pitch generated from each piece data. Therefore, a synthesized sound corresponding to one or a plurality of audio data D designated as a candidate by the user is reproduced from the sound output device 18. The user repeats the selection of the identifier dA in the selection region 522 and the deletion of the identifier dA in the candidate region 523 while listening to the synthesized sound reproduced from the sound output device 18 as needed. It is possible to generate a knitting part.

  When the operator 527 (OK) is operated, the contents of the composition part are determined. More specifically, the selection unit 32 uses a plurality of identifiers dA arranged in the candidate area 523 when the operation element 527 is operated as the identifier dB displayed in the identification area 521 (that is, the identifier dB of the composition part being created). ) And stored in the storage device 12. That is, the selection unit 32 generates a knitting part by combining a plurality of audio data D selected by the user. When the operator 528 (Cancel) in FIG. 3 is operated, the setting contents in the setting image 52 are not reflected.

  Next, a music information image 60 for the user to confirm or edit the music information SD will be described with reference to FIG. When the display of the music information SD is instructed by the user, the display control unit 26 displays the music information image 60 of FIG. As shown in FIG. 4, the music information image 60 is divided into a work area 62 and an operation area 64. The work area 62 is an area where the music information SD stored in the storage device 12 is visibly displayed. More specifically, the work area 62 has a piano roll type in which a vertical axis corresponding to pitch (hereinafter referred to as “pitch axis”) and a horizontal axis corresponding to time (hereinafter referred to as “time axis”) are set. Is displayed.

  The user operates the input device 14 while visually recognizing the music information image 60 to instruct the pitch of the designated sound and the start point and end point of the pronunciation. The display control unit 26 arranges a graphic (hereinafter referred to as “indicator”) P corresponding to the designated sound instructed by the user in the work area 62. The position of the indicator P in the direction of the pitch axis is selected according to the pitch specified by the user, and the position of the indicator P in the direction of the time axis depends on the start point (or end point) of the pronunciation specified by the user. Selected. The size of the indicator P in the direction of the time axis is selected according to the time length from the start point to the end point of the specified sound. Each time the designated sound is instructed as described above, the information generating unit 22 stores the pitch designated by the user, the start point, and the end point in the storage device 12 as the pitch and pronunciation time of the designated sound in the music information SD. Store.

  By repeating the above processing, a plurality of indicators P corresponding to separate designated sounds are arranged in the work area 62. The user can select one indicator P (hereinafter referred to as “selection indicator”) P in the work area 62 by operating the input device 14. The user operates the input device 14 to instruct a phonetic symbol (character) for the selection indicator P. The information generation unit 22 stores the phonetic symbol designated by the user in the music information SD as the phonetic symbol of the designated sound corresponding to the selection indicator P.

  The assigning unit 34 in FIG. 1 selectively assigns a single part and a composition part to each designated sound (selection indicator P) in accordance with an instruction from the user. For the assignment of the part to the designated sound, the operation element 641 and the operation element 642 in the operation area 64 of FIG. 4 are used. The operator 641 is used for assigning a single part, and the operator 642 is used for assigning a knitted part. When the user selects one indicator P (selection indicator P) and operates the operator 641, the display control unit 26 identifies each of the identifiers dA of the n pieces of audio data D stored in the storage device 12. (DA1 to dAn) are displayed in the vicinity of the operation element 641 as selection candidates. The allocation unit 34 stores the identifier dA selected by the user among the n identifiers dA in the music information SD as the identifier dB of the designated sound corresponding to the selection indicator P. That is, the assigning unit 34 assigns a single part (single audio data D) to the designated sound corresponding to the selection indicator P.

  When the user operates the operation element 642, the display control unit 26 displays each identifier dB of the plurality of knitting parts knitted by the selection unit 32 as a selection candidate in the vicinity of the operation element 642. The assigning unit 34 stores the identifier dB selected by the user among the plurality of identifiers dB in the music information SD as the identifier dB of the designated sound corresponding to the selection indicator P. That is, the assigning unit 34 assigns the knitting part (a plurality of audio data D) to the designated sound corresponding to the selection indicator P.

  The indicator P immediately after being arranged in the work area 62 is displayed in an initial mode (a mode common to all the indicators P). The user can variably set the mode (size, display color (hue, brightness, saturation) and shape) of each indicator P according to the operation on the input device 14. When the user instructs to change the mode of the indicator P, the display control unit 26 causes the display device 16 to display the setting image 54 in FIG. 5 or the setting image 56 in FIG. 6.

  The setting image 54 in FIG. 5 is an image for the user to specify the mode of the frame (outline) of the selection indicator P. In the identification area 540, the identifier dB of the part (single part or composition part) assigned by the assigning unit 34 to the designated sound of the selection indicator P is displayed. The identifier dB displayed in the identification area 540 is changed according to the operation on the input device 14.

  The user appropriately operates the input device 14 while visually recognizing the setting image 54, so that a plurality of items (line type, line width, line color, etc.) relating to the frame shape of the selection indicator P can be obtained. One of the candidates is selected. For example, the user selects a frame type (for example, a solid line, a wavy line, a broken line, etc.) of the selection indicator P from a plurality of candidates displayed by operating the operation element 541 of the setting image 54. Similarly, the line width of the frame line of the selection indicator P is designated in accordance with the operation on the operation element 542, the line color of the frame line of the selection indicator P is designated in accordance with the operation on the operation element 543, and the time axis The shape (corner shape or arc shape) of both ends of the selection indicator P in the direction is designated according to the operation on the operation element 544. Further, the transparency of the frame of the selection indicator P (the degree to which the background is visually recognized through the frame) is designated according to the operation on the operation element 545. The user can directly specify numerical values for the line width and transparency of the frame of the selection indicator P. Each time the user designates or changes each item, the display control unit 26 displays the indicator P in which the designation is actually reflected in the frame line in the area 546.

  The mode of the frame line of the selection indicator P is fixed to the mode specified in the setting image 54 when the user operates the operation unit 547 (OK). That is, when the operation element 547 is operated, the display control unit 26 changes the frame line of the selection indicator P actually arranged in the work area 62 of the music information image 60 to the mode set in the setting image 54. . Further, the display control unit 26 assigns all the indicators P (ie, the identification region 540 to which the assigning unit 34 assigns a part common to the selection indicator P among the plurality of indicators P arranged in the work area 62). The frame line of the indicator P) to which the displayed part of the identifier dB is assigned is changed to the mode designated as the frame line of the selection indicator P in the setting image 54. Note that when the operation element 548 (Cancel) is operated, the setting contents in the setting image 54 are not reflected.

  On the other hand, the setting image 56 in FIG. 6 is an image for the user to specify the mode of the area inside the frame of the selection indicator P (hereinafter referred to as “inner area”). In the identification area 560, an identifier dB of a part (single part or composition part) assigned by the assigning unit 34 to the designated sound of the selection indicator P is displayed. The identifier dB displayed in the identification area 560 is changed according to the operation on the input device 14.

  The user selects one of a plurality of candidates for each of a plurality of items (colors, etc.) relating to the mode of the internal region of the selection indicator P by appropriately operating the input device 14 while confirming the setting image 56. To do. More specifically, the color of the internal area is designated in accordance with an operation on the operation element 561, and the type of hatching (hatching pattern) displayed in the internal area is designated in accordance with the operation on the operation element 562. The shaded color is designated according to the operation on the operation element 563, and the transparency of the internal region is designated according to the operation on the operation element 564. Each time the user designates or changes each item, the display control unit 26 displays an indicator P that reflects the designation in the internal area in the area 565.

  When the operation element 566 (OK) of the setting image 56 is operated, the display control unit 26 sets the internal area of the selection indicator P actually arranged in the work area 62 of the music information image 60 with the setting image 56. Change to the mode. Further, the display control unit 26 assigns all the indicators P (ie, the identification region 560 to which the assigning unit 34 assigns a part common to the selection indicator P among the plurality of indicators P arranged in the work area 62). The internal area of the indicator P) to which the displayed part of the identifier dB is assigned is changed to a mode designated as the internal area of the selection indicator P in the setting image 56. Note that when the operator 567 (Cancel) is operated, the setting contents in the setting image 56 are not reflected.

  As described above, the indicator P for each designated sound that is shared by the parts assigned by the assigning unit 34 is displayed in a common manner. Since the user can arbitrarily specify the selection indicator P and change the mode, the display control unit 26 can display the indicator P of each specified sound to which a separate part is assigned in different modes. is there. For example, the designator P of the designated sound to which the allocating unit 34 has assigned the single part and the designator P of the designated sound to which the allocating unit 34 has assigned the knitting part are displayed in a different manner.

  In the above aspect, the designated sound to which a plurality of audio data D (organization part) is assigned is displayed by one indicator P in the music information image 60. Therefore, the music information image 60 is simplified compared to the case where the indicator P is displayed separately for each of the plurality of audio data D assigned to one designated sound, and the user can determine the time series of the designated sound. Easy to check (and edit). Moreover, since the indicator P for the designated sound of the single part and the indicator P for the designated sound of the composition part can be displayed in different modes, each designated sound is reproduced as a single part (the designated sound is synthesized as a solo sound). There is also an advantage that the user can intuitively understand whether the designated part is played back (or the designated sound is synthesized as a choral sound).

<B: Second Embodiment>
Next, a second embodiment of the present invention will be described. In the following embodiments, elements that are the same as those in the first embodiment are denoted by the same reference numerals, and detailed descriptions thereof are omitted as appropriate.

  The display control unit 26 according to the present embodiment uses the designated sound indicator P in accordance with the number N of voice data D constituting the knitting part assigned to the designated sound by the assigning unit 34 (that is, the total number of sounds of the knitting part). To change. The mode of the indicator P that is controlled in accordance with the number N of audio data D is arbitrary. The configuration in which the border line of P is set to a thick line width, and as shown in the part (B) of FIG. 7, the border line and the inner area of the indicator P become darker as the number N of the audio data D of the knitting part increases. A configuration to be set is preferable. Further, for example, when the frame line of the indicator P is displayed as a wavy line, as shown in the part (C) of FIG. 7, the configuration in which the amplitude of the frame line is increased as the number N of the audio data D of the knitting part increases. Is also adopted.

  In the above embodiment, since the mode of each indicator P is controlled according to the number N of the voice data D constituting the composition part, the number N of voice data D used for the synthesis of the designated sound (that is, the synthesized sound) There is an advantage that the user can intuitively grasp the number of voices in the system. In the above embodiment, the mode of the indicator P is controlled according to the number N. For example, the display control unit 26 determines the indicator P of the designated sound according to the characteristics of the audio data D assigned to the designated sound. A configuration for variably controlling the mode is also adopted. For example, the display control unit 26 increases the frame density of the indicator P and the color density of the inner region as the volume and pitch of the voice represented by the voice data D are higher.

<C: Third Embodiment>
When a plurality of speakers sing the same melody, there is usually some variation in the pitch of each speaker and the time of pronunciation. Therefore, if the pitches of the voices corresponding to each of the plurality of voice data D constituting the knitting part and the time points of pronunciation are completely matched, the synthesized sound may give an unnatural impression on hearing. Therefore, in this embodiment, a variation (fluctuation) is given to the pitch of the sound corresponding to each sound data D and the time of pronunciation.

  FIG. 8 is a block diagram of an audio data processing device 100B according to the third embodiment of the present invention. As shown in FIG. 8, the audio data processing device 100B of this embodiment has a configuration in which a setting unit 42 is added to the audio data processing device 100A of the first embodiment. The setting unit 42 variably sets the pitch distribution range and the pronunciation point distribution range. The pitch distribution range is a range (pitch variation range) in which the pitch of the voice corresponding to each voice data D constituting the knitting part fluctuates. The pronunciation point distribution range is a range in which the sound generation time corresponding to each sound data D constituting the knitting part fluctuates (range of the sound generation time variation).

  FIG. 9 is a schematic diagram of a setting image 58 for the user to set the pitch distribution range and the pronunciation point distribution range. When the user gives a predetermined operation to the input device 14, the display control unit 26 displays the setting image 58 on the display device 16. The user specifies the pitch distribution range and the pronunciation point distribution range by operating the input device 14 while confirming the setting image 58.

  In the identification area 581 of FIG. 9, the identifier dB of the knitting part selected by the user (that is, the knitting part to be set) among the plurality of knitting parts generated by the selection unit 32 is displayed. The user operates the operation element 582 (moves left and right) to set the pitch distribution range. Similarly, the range of the pronunciation point distribution range is set according to the operation of the operator 583 by the user. The user can also directly specify the pitch distribution range and the pronunciation point distribution range by numerical values.

  The content of the setting in the setting image 58 is confirmed by the operation of the operator 584 (OK). That is, the setting unit 42 associates the pitch distribution range and the pronunciation point distribution range specified when operating the operation element 584 with the identifier dB (identifier dB displayed in the identification area 581) of the knitting part being worked on. And stored in the storage device 12. Note that when the operator 585 (Cancel) is operated, the setting contents of the setting image 58 are not reflected.

  The voice synthesizer 24 in FIG. 8 uses the pitch distribution range and the pronunciation point distribution range for synthesizing the designated sound to which the composition part is assigned. That is, the speech synthesizer 24 makes the pitches of the voices corresponding to the respective voice data D constituting the knitting part different within the pitch distribution range, and makes the time points of sound generation different within the pronunciation point distribution range. According to the above configuration, fluctuations are given to the pitches and the time points of pronunciation of the sounds constituting the synthesized sound of the knitting part, so that it is possible to generate a natural synthesized sound that is close to the actual chorus sound. .

  On the other hand, the display control unit 26 changes the mode of the indicator P to which the knitting part is assigned in accordance with the pitch distribution range and the pronunciation point distribution range set by the setting unit 42 for the knitting part. FIG. 10 is a conceptual diagram for explaining a change in the mode of the indicator P in the present embodiment. As shown in FIG. 10, the shape of the portion PE at both ends in the direction of the time axis (horizontal axis) of the indicator P is variably set according to the pitch distribution range and the pronunciation point distribution range. For example, the display control unit 26 increases the dimension L1 of the end portion PE in the direction of the pitch axis as the pitch distribution range is wider, for example, as indicated by the broken line a, and the end in the time axis direction is larger as the pronunciation point distribution range is wider. For example, the dimension L2 of the part PE is increased as indicated by a broken line b.

  In the above embodiment, since the mode of the indicator P is variably controlled according to the pitch distribution range and the pronunciation point distribution range, the pitch distribution range and the pronunciation point of the knitting part assigned to the indicator P are controlled. There is an advantage that the user can visually confirm the distribution range easily. Moreover, the dimension L1 in the direction of the pitch axis of the end portion PE of the indicator P is controlled according to the width of the pitch distribution range, and the dimension L2 in the direction of the time axis is controlled according to the width of the pronunciation point distribution range. Is done. Therefore, for example, compared to the configuration in which the dimension L1 of the end portion PE is controlled according to the sounding point distribution range and the configuration in which the dimension L2 of the end portion PE is controlled according to the pitch distribution range, There is also an advantage that the user can intuitively grasp the width of the distribution range. A configuration is also employed in which the setting unit 42 variably controls only one of the pitch distribution range and the pronunciation point distribution range.

<D: Fourth Embodiment>
In each of the above forms, the user selects a plurality of audio data D constituting the composition part. However, it is not possible for the user to select audio data D that matches his own preference or sensitivity or audio data D that is musically appropriate for synthesizing choral sound (for example, audio data D that is musically harmonized). It is complicated and difficult. Therefore, in this embodiment, the audio data D that matches the musical impression designated by the user is automatically selected and used as the knitting part.

  FIG. 11 is a block diagram of an audio data processing device 100C according to this embodiment. As shown in FIG. 11, the sound data processing device 100C has a configuration in which an analysis unit 44 is added to the sound data processing device 100A of the first embodiment. The analysis unit 44 analyzes the musical feature amount F for each of the n pieces of audio data D (D1 to Dn) stored in the storage device 12. The storage device 12 stores the feature amount F (F1 to Fn) analyzed by the analysis unit 44 for each audio data D in association with the audio data D. However, a configuration in which the audio data D and the feature amount F are stored in separate storage devices is also employed. Further, in the configuration in which the audio data D and the feature amount F are prepared outside and stored in the storage device 12, the analysis unit 44 can be omitted.

  For example, multivariate analysis (factor analysis) is used to extract the feature value F by the analysis unit 44. FIG. 12 is a conceptual diagram of feature amounts F (F1 to Fn) stored for each audio data D in the storage device 12. As shown in FIG. 12, the feature value Fi of the voice data Di (i = 1 to n) is related to each of a plurality of types of factors (metal factor, force factor, and aesthetic factor) that characterize the psychological impression of the voice. This is a set of factor values X (X [i, I], X [i, II], X [i, III]) specified by multivariate analysis of the speech data Di. In this embodiment, three types of factors ([I] to [III]) are exemplified, but the number of types of factors (the number of factor values X included in the feature amount F) in the multivariate analysis of the audio data D is It is changed arbitrarily.

  The analysis unit 44 uses a plurality of adjective pairs (for example, “a”, etc.) to express a psychological impression of music from the physical feature quantities (for example, volume, pitch, frequency characteristics, etc.) of speech represented by each piece of speech data D. By evaluating each index value of “bright-dark” and “powerful-light”), the index values of multiple adjective pairs are statistically aggregated into multiple types of factors (metal factor, force factor, aesthetic factor). The factor value X is specified. The factor value X (X [1, I], X [2, I],..., X [n, I]) of the metal factor [I] in FIG. 12 is the extent to which the listener perceives the sound as metallic. (Metallic factor) index, force factor [II] factor value X (X [1, II], X [2, II], ..., X [n, II]) It is an index of the degree to which force is perceived (power factor), and the index value X (X [1, III], X [2, III], ..., X [n, III]) of the aesthetic factor [III] is It is an index of the degree (audible factor) that the listener perceives the sound as aesthetic.

  The selection unit 32 in FIG. 11 is similar to a feature amount (hereinafter, specifically referred to as “instruction feature amount”) FU set according to an instruction from the user among n pieces of audio data D stored in the storage device 12. A plurality of audio data D corresponding to the feature amount F to be selected is selected (searched) from the storage device 12. A plurality of audio data D selected by the selection unit 32 constitutes a knitting part.

  When the user gives a predetermined operation to the input device 14, the display control unit 26 causes the display device 16 to display a setting image 72 (FIG. 13) for specifying the instruction feature amount FU. The user designates the instruction feature amount FU by appropriately operating the input device 14 while confirming the setting image 72. In the identification area 720 of the setting image 72, the identifier dB of the organization part to be edited is displayed. In the area 721, the number N of voice data D (the number of mixed voices) N that should constitute the working part being worked is displayed. The user appropriately changes the numerical value N in the area 721 by appropriately operating the input device 14 (for example, direct input of the number N to the area 721 or increase / decrease of the number N by operating the operation element 722). Is possible.

  The indicated feature value FU is a factor value U (U [I], U [II], U) for each of the three types of factors (metal factor, force factor, and aesthetic factor) similar to the feature value F stored in the storage device 12. U [III]). Each factor value U is individually set according to an operation on the input device 14. That is, the factor value U [I] of the metal factor [I] is set according to the operation of the operator 723 in FIG. 13, and the factor value U [II] of the force factor [II] is set according to the operation of the operator 724. The factor value U [III] of the aesthetic factor [III] is set according to the operation of the operator 725. For example, when the user desires a metallic voice, the factor value U [I] of the metal factor [I] is set to a large value, and when a powerful voice is desired, the powerful factor [II] The factor value U [II] is set to a large value. The user can also directly specify each factor value U as a numerical value.

  The search for the voice data D is executed in response to the operation of the operator 726 (Search). More specifically, the selection unit 32 is a set of audio data D corresponding to the top N feature values F in descending order of similarity to the instruction feature value FU set at the time of operation of the operator 726. Is searched from the storage device 12 as a candidate for the knitting part. The determination of the similarity between the instruction feature quantity FU and the feature quantity F will be described later.

  The operation element 727 is an image for the user to audition the sound corresponding to the N pieces of sound data D searched by the operation of the operation element 726 (mixture of N kinds of sounds). When the operator 727 is operated, the selection unit 32 outputs, to the speech synthesizer 24, segment data corresponding to a predetermined speech segment for each of the N speech data D searched immediately before. The speech synthesizer 24 outputs a speech signal SOUT by mixing speech of a predetermined pitch generated from N piece data. Therefore, a synthesized sound corresponding to the N pieces of sound data D retrieved from each factor value U designated by the user is reproduced from the sound output device 18. The user can generate a desired knitting part by repeatedly changing the factor value U while listening (trial listening) to the synthesized sound reproduced from the sound output device 18.

  A set of N voice data D searched at the time when the user operates the operator 728 (that is, N voice data D searched by the selection unit 32 immediately before the operator 728) is determined as a composition part. To do. More specifically, the selection unit 32 sets the identifier dA of each of the N pieces of audio data D searched at the time of operating the operator 728 to the identifier dB displayed in the identification area 720 (that is, the composition part being created). It is stored in the storage device 12 in correspondence with the identifier dB). That is, the selection unit 32 combines N pieces of audio data D having a feature amount F similar to the instruction feature amount FU designated by the user to construct a composition part. The method of using the knitting part is the same as in the first embodiment. Note that when the operation element 729 (Cancel) is operated, the setting content in the setting image 72 is not reflected.

Next, determination of similarity between the instruction feature quantity FU and the feature quantity F will be described. The selection unit 32 calculates a numerical value (hereinafter referred to as “similarity index value”) R that is an index of similarity with the instruction feature amount FU for each of the n feature amounts F1 to Fn stored in the storage device 12. . The similarity index value R in this embodiment corresponds to a distance in a space (hereinafter referred to as “factor space”) in which coordinate axes corresponding to each of the three types of factors are set, as shown in FIG. That is, the similarity index value Ri between the feature quantity Fi and the designated feature quantity FU is a factor space with the factor values U (U [I], U [II], U [III]) of the designated feature quantity FU as coordinate values. The distance between the point defined in the above and the point defined in the factor space with each factor value X (X [i, I], X [i, II], X [i, III]) of the feature value Fi as coordinate values It is. More specifically, the selection unit 32 calculates the Euclidean distance expressed by the following formula (1) as the similarity index value Ri.
Ri = √ {(X [i, I] −U [I]) ² + (X [i, II] −U [II]) ² + (X [i, III] −U [III]) ² } … (1)

  As understood from Equation (1), the similarity index value Ri becomes smaller as the degree of similarity between the instruction feature quantity FU and the feature quantity F is higher. Therefore, the selection unit 32 selects the speech data D of the top N feature quantities F in the order of the similarity index value R with the instruction feature quantity FU as the element of the organization part. Elements other than the analysis unit 44 and the selection unit 32 are the same as those in the first embodiment.

  In the above embodiment, the same effect as that of the first embodiment is realized. Furthermore, in this embodiment, since a plurality of audio data D having a feature amount F similar to the designated feature amount FU designated by the user is selected as an element of the organization part, the audio corresponding to each of the audio data D is selected. Even if the user is not familiar with the characteristics, a plurality of audio data D that matches the user's preference and sensibility and a plurality of audio data D with similar musical impressions are used as a composition part for synthesizing the voice. used. Therefore, it is possible to reduce the burden on the user who organizes the knitting part.

  In addition, since the number N of audio data D constituting the knitting part is variably set according to the operation on the input device 14, whether the knitting part is a small chorus sound or a large chorus sound is used. The user can set it arbitrarily. Further, since the user can audition the actual synthesized sound by operating the operation element 727 of the setting image 72, the instruction feature quantity FU (combination of the factor values U) for generating the desired synthesized sound is used. There is also an advantage that a person can easily search.

  It should be noted that the configuration of the second embodiment in which the mode of the indicator P of the designated sound is changed according to the number N of the audio data D constituting the knitting part, and the pitch and pronunciation of the sound of each audio data D of the knitting part are changed. The configuration of the third embodiment that imparts fluctuation is similarly applied to this embodiment.

<E: Fifth Embodiment>
In the fourth embodiment, the user directly instructs the factor value U (U [I], U [II], U [III]) from the input device 14. In the fifth embodiment of the present invention, the feature amount F of the audio data D selected by the user is used as the instruction feature amount FU. Note that description of portions common to the fourth embodiment is omitted.

  The user appropriately operates the input device 14 to select one audio data D (hereinafter referred to as “selected audio data D”) from the n audio data D (D1 to Dn) stored in the storage device 12. ) Is selected. The selection unit 32 acquires the feature amount F of the selected audio data D from the storage device 12, and, as shown in FIG. 15, the feature amount F (feature amount F1 in FIG. 15) is used as the instruction feature amount FU in the fourth embodiment. Similarity index values R (R1 to Rn) are calculated for each of the n pieces of audio data D (including selected audio data D) in the same procedure as in the embodiment. Then, the selection unit 32 includes the top N pieces of audio data D (including the selected audio data D with the similarity index value R having the minimum value (zero)) in the order of the similarity index value R as the element of the knitting part. Select as.

  In the above configuration, the selection unit 32 automatically selects N pieces of voice data D having a feature amount F similar to the selected voice data D designated by the user (that is, without requiring selection by the user). The Therefore, there is an advantage that the burden on the user for selecting the voice data D whose musical impression is similar to the known voice data D (selected voice data D) of the user as an element of the organization part is reduced. In addition, although the case where the selection audio | voice data D was included in the organization part was illustrated above, you may exclude the selection audio | voice data D from the element of an organization part.

<F: Sixth Embodiment>
In the fourth embodiment, the feature amount F of each audio data D is used for selecting the audio data D. In the sixth embodiment of the present invention, the attribute of the voice speaker corresponding to each voice data D is used for selecting the voice data D together with the feature amount F. Note that description of portions common to the fourth embodiment is omitted.

  As shown in FIG. 16, the storage device 12 of the audio data processing device 100D according to the present embodiment has a feature amount F (F1 to Fn) and an attribute A (A1 to An) for each of n pieces of audio data D (D1 to Dn). ) Is stored. The attribute A is information (property / feature) related to the voice speaker of the voice data D. In this embodiment, the sex of the speaker is exemplified as attribute A.

  The user arbitrarily designates the speaker's attribute A (gender) by appropriately operating the input device 14. The selection unit 32 starts from the n pieces of audio data D stored in the storage device 12 in the order of the similarity index value R between the specified feature value FU and the feature value F (that is, between the specified feature value FU and the feature value F). N pieces of audio data D which are positioned higher in the order of similarity) and whose attribute A matches the designation from the user are selected as elements of the organization part. Therefore, for example, when the user designates male as the attribute A, only N pieces of voice data D whose voice is male are selected and used for voice synthesis.

  According to the above configuration, since the attribute A is used as a reference for selecting the audio data D in addition to the feature amount F, the audio data D that matches the user's preference and sensitivity is compared with the fourth embodiment. There is an advantage that it can be easily and reliably selected. The designated feature value FU may be a numerical value designated by the user in the setting image 72 as in the fourth embodiment, or selected voice data designated by the user as in the fifth embodiment. The feature amount F of D may be used.

<G: Modification>
Various modifications are added to the above embodiment. An example of a specific modification is as follows. Two or more aspects may be arbitrarily selected from the following examples and combined.

(1) Modification 1
In each of the above embodiments, the designated sound indicator P to which a single part is assigned and the designated sound indicator P to which a composition part is assigned are changed to different modes according to instructions from the user. (Ie, when each indicator P is initially displayed in a common mode), the display control unit 26 displays the display mode of the indicator P of the single part and the indicator P of the composition part. A configuration in which the difference is made automatically (that is, not depending on an instruction from the user) is also adopted. For example, when the user assigns a single part to the indicator P, the display control unit 26 displays the indicator P in the initial form prepared for the single part, and the user assigns the composition part to the indicator P. When assigned, the display control unit 26 displays the indicator P in an initial form prepared for the composition part separately from the single part. The point that the mode of each indicator P is changed from the initial mode according to the operation from the user is the same as the above-described modes.

(2) Modification 2
In each of the above embodiments, the case where the user creates or edits the music information SD while confirming the music information image 60 is exemplified, but the existing music information SD is displayed as the music information image 60 for confirmation by the user. The structure to do is also adopted. The existing music information SD is stored in the storage device 12 via, for example, a portable recording medium or a communication network. The process of creating and editing the music information SD is not essential in the present invention.

(3) Modification 3
The mode of the indicator P controlled according to the combination of the voice data D allocated by the allocation unit 34 is not limited to the above examples. That is, all visually recognizable aspects such as the size, display color (hue, lightness, saturation) and shape of the indicator P can be adopted as control targets according to the combination of the audio data D. In addition, the configuration in which the user variably sets the mode of the indicator P is not essential in the present invention. For example, the indicator P is displayed in a mode automatically selected by the display control unit 26 according to the combination of the audio data D (that is, without depending on the instruction from the user). In the above embodiment, the display control unit 26 automatically displays the indicator P of each designated sound having a common part (combination of audio data D) in a common manner. A configuration is also adopted in which the user individually sets the mode of the indicator P for the designated sound.

(4) Modification 4
In each of the above embodiments, the mathematical expression (1) is used to calculate the similarity index value Ri. However, the similarity index value Ri, which is a reference for selecting the audio data D, is used as the factor value of the designated feature value FU and the feature value F. A configuration in which calculation is performed after assigning a separate weight value W for each factor to (X, U) is also suitable. For example, the selection unit 32 calculates the following formula (2) including the weight value W [I] for the metal factor, the weight value W [II] for the force factor, and the weight value W [III] for the aesthetic factor. Is used instead of to calculate the similarity index value Ri.
Ri = √ {W [I] · (X [i, I] −U [I]) ² + W [II] · (X [i, II] −U [II]) ² + W [III] · (X [ i, III] −U [III]) ² } (2)

  Each weight value W (W [I], W [II], W [iii]) is arbitrarily set according to the operation from the user to the input device 14. In the above configuration, since the influence of each factor on selection by the selection unit 32 is variably controlled according to the weight value W, there is an advantage that the combinations of the audio data D in the organization part are diversified. When the distance corresponding to the unit amount of the factor value X is different for each factor on the coordinate axis of the factor space (that is, when the scale is different for each coordinate axis), the weight value W is set separately for each factor. A configuration in which the factor value (coordinate value) of each factor is normalized is preferable. For example, in the case where each factor value X of a plurality of feature quantities F is distributed on the coordinate axis, if Equation (2) is calculated by using the inverse of the variance value of the distribution as the weight value W of the factor, the coordinate axis for each factor is calculated. An appropriate similarity index value Ri is calculated by compensating for the difference. However, the formulas (1) and (2) are merely examples of arithmetic expressions for calculating the similarity index value Ri, and publicly known techniques are used to evaluate the similarity between the instruction feature quantity FU and the feature quantity F. Adopted arbitrarily.

(5) Modification 5
The feature amount F (instruction feature amount FU) in the fourth to sixth embodiments is not limited to the factor value of multivariate analysis. More specifically, a configuration using the characteristic value (for example, frequency characteristic or volume) of the voice represented by the voice data D as the feature amount F, or a configuration using the characteristic value together with the factor value X for each factor is preferable. For example, N pieces of audio data D that are positioned higher in the order of similarity between the factor value X and the factor value U of the instruction feature quantity FU, and whose characteristic values meet the conditions according to the instruction from the user Is selected as an element of the organization part.

(6) Modification 6
In the fourth to sixth embodiments, the user specifies the number N of audio data D constituting the composition part, but a configuration in which the number N is fixed to a predetermined value is also employed. In the fourth to sixth embodiments, a configuration in which the selection unit 32 selects one piece of audio data D as a single part is also suitable. That is, the selection unit 32 selects, as a single part, one piece of sound data D corresponding to the feature amount F most similar to the designated feature amount FU among the n pieces of sound data D stored in the storage device 12.

(7) Modification 7
In each of the above embodiments, the case where each voice data D is generated from the voice of a separate speaker is illustrated for convenience, but a plurality of voice data D may be generated from different voices uttered by the same speaker. Good. In each of the above embodiments, synthesis of human vocal sounds is assumed for the sake of convenience. However, a configuration for synthesizing performance sounds of various musical instruments (that is, a configuration in which each audio data D is generated from performance sounds of musical instruments) is also possible. Adopted. As described above, the “speech” in the present invention is a concept that includes both human voices (speech sounds and singing sounds) and musical instrument performance sounds.

(8) Modification 8
The total number of voices represented by one voice data D is changed as appropriate. For example, in each of the above embodiments, the case where one piece of sound data D is generated from the sound of one speaker (or the performance sound of one instrument) is illustrated for convenience, but a mixture of a plurality of sounds generated in parallel is used. A configuration in which one piece of sound data D is generated from sound (for example, uttered sound (choral sound) by a plurality of speakers or performance sound (ensemble sound) by a plurality of musical instruments) is also employed. In the above aspect, the display control unit 26 displays the indicator P for one designated sound assigned by the assigning unit 34 to one piece of sound data D corresponding to a mixed sound of a plurality of sounds. It is displayed in the work area 62). The mixed number of voices represented by the voice data D (that is, the number of singers at the time of chorus and the total number of instruments used for the ensemble) M is stored in the storage device 12 as the attribute A of the voice data D. The display control unit 26 variably controls the mode of the indicator P in accordance with the mixture number M specified by the attribute A. The method of controlling the mode of the indicator P in accordance with the number of mixtures M is arbitrary, but for example, the mode illustrated in FIG. 7 (configuration in which the number N of audio data D in the second embodiment is replaced with the number of mixtures M) Is preferred. Also in the above configuration, there is an advantage that the user can easily confirm the indicator P of the designated sound to which a mixed sound of a plurality of sounds is assigned.

(9) Modification 9
A configuration (first embodiment to third embodiment) in which an instruction sound to which a plurality of audio data D is assigned is displayed by one indicator P, and an instruction feature amount FU in accordance with an instruction from a user. Can be established independently from the configuration (fourth embodiment to sixth embodiment) in which audio data D with similar values is selected as a synthesis target. For example, in the fourth to sixth embodiments, a configuration in which an instruction sound to which a plurality of audio data D is assigned is displayed with one indicator P and a configuration in which the indicator P is variable are appropriately omitted. Is done.

(10) Modification 10
The output destination of the audio signal SOUT is not limited to the sound output device 18. For example, a configuration in which the audio signal SOUT is stored in the storage device 12 (or other recording medium) and a configuration in which the audio signal SOUT is transmitted to a communication network are also employed.

It is a block diagram of the audio | voice data processing apparatus which concerns on 1st Embodiment of this invention. It is a schematic diagram of music information. It is a schematic diagram of the setting image for editing the organization part. It is a schematic diagram of a music information image. It is a schematic diagram of the setting image which designates the frame shape of the indicator. It is a schematic diagram of the setting image which designates the aspect of the internal region of the indicator. It is a conceptual diagram for demonstrating control of the mode of the indicator in 2nd Embodiment of this invention. It is a block diagram of the audio | voice data processing apparatus which concerns on 3rd Embodiment of this invention. It is a schematic diagram of the setting image which designates a pitch distribution range and a pronunciation point distribution range. It is a conceptual diagram for demonstrating the change of the mode of the indicator according to a pitch distribution range and a pronunciation point distribution range. It is a block diagram of the audio | voice data processing apparatus which concerns on 4th Embodiment of this invention. It is a schematic diagram of a feature amount. It is a schematic diagram of a setting image for designating an instruction feature amount. It is a conceptual diagram for demonstrating calculation of the similarity index value. It is a conceptual diagram for demonstrating calculation of the similarity index value in 5th Embodiment of this invention. It is a block diagram of the audio | voice data processing apparatus which concerns on 6th Embodiment of this invention.

Explanation of symbols

100A, 100B, 100C, 100D …… Audio data processing device, 10 …… Control device, 12 …… Storage device, 14 …… Input device, 16 …… Display device, 18 …… Sound output device, 22 …… Information generation , 24... Speech synthesis unit, 26... Display control unit, 32... Selection unit, 34 .. allocation unit, 42... Setting unit, 44 .. analysis unit, 52, 54, 56, 58, 72. ... setting image, 60 ... music information image, D (D1 to Dn) ... audio data, SD ... music information, SOUT ... audio signal.

Claims (10)

Storage means for storing a plurality of voice data used for synthesizing different voices;
Allocating means for allocating two or more audio data of the plurality of audio data to one designated sound;
An indicator in which the position in the direction of the first axis is selected according to the pitch of the designated sound and the indicator in which the position in the direction of the second axis is selected according to the time of sounding of the designated sound is arranged for each designated sound. A sound data processing apparatus comprising: display control means for displaying the music information image on the display device. The audio data processing apparatus according to claim 1, wherein the display control means displays the indicators of the designated sounds, each having a different combination of the audio data assigned by the assigning means, in different modes. The assigning means can selectively assign one sound data and two or more sound data to one designated sound,
The display control means displays the designated sound indicator assigned by the assigning means to one piece of audio data and the designated sound indicator assigned by the assigning means to two or more pieces of sound data in different modes. Item 2. The audio data processing device according to Item 1. The audio data processing apparatus according to any one of claims 1 to 3, wherein the display control means displays in a common manner the indicators of the designated sounds that share the combination of the audio data assigned by the assigning means. The audio data processing apparatus according to claim 1, wherein the display control unit variably sets the mode of each indicator according to an instruction from a user. The voice data processing device according to claim 1, wherein the display control unit changes a mode of an indicator of the designated sound in accordance with the number of voice data assigned to the designated sound by the assigning unit. Comprising: first setting means for variably setting a distribution range of voice pitches corresponding to each of two or more voice data assigned to one designated sound by the assigning means;
The voice data processing device according to any one of claims 1 to 6, wherein the display control means changes a mode of an indicator of the designated sound in accordance with a distribution range set for the designated sound by the first setting means. . A second setting means for variably setting a distribution range at a time when a voice corresponding to each of two or more voice data assigned to one designated sound by the assigning means starts;
The voice data processing device according to any one of claims 1 to 7, wherein the display control means changes a mode of an indicator of the designated sound in accordance with a distribution range set by the second setting means as the designated sound. . The storage means stores a feature amount of each of the plurality of audio data,
Selecting means for selecting, from the storage means, two or more pieces of voice data having a feature quantity similar to an instruction feature quantity according to an instruction from a user among the plurality of voice data;
The audio data processing device according to any one of claims 1 to 8, wherein the allocating unit allocates two or more audio data selected by the selecting unit to one designated sound. A computer comprising storage means for storing a plurality of voice data used for synthesizing different voices;
An allocation process for allocating two or more audio data of the plurality of audio data to one designated sound;
An indicator in which the position in the direction of the first axis is selected according to the pitch of the designated sound and the indicator in which the position in the direction of the second axis is selected according to the time of sounding of the designated sound is arranged for each designated sound. Display control processing for displaying a music information image on a display device.

Images