JP2007121876A - Method and system for processing music material - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily create music imparted with various sound effects. <P>SOLUTION: Through music material editing services, composite music materials are created by entering a plurality of music materials to a music material composition field on an editing picture. When the composite music materials are created by using these services, a user can discriminatingly specify an insertion effect to be imparted to only the composite music materials and a system effect to be imparted to all music materials including the composite music materials. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a music material processing method.

There has been proposed a composition support system in which a plurality of music materials obtained from performance sounds of various instruments can be synthesized to create one ensemble. For example, the system described in Patent Document 1 stores audio data obtained from performance sounds of various musical instruments in individual buffers as music material, and indicates the number of repetitions and the order of the audio data stored in each buffer. By making a decision, you can create original music.
JP-A-11-327550

By the way, among users who use the above-mentioned kind of composition support system, not only simply synthesizing music materials prepared in advance, but also various acoustic effects such as reverb are added to all or part of the ensemble obtained by synthesis. There are many people who want to arrange with However, since the conventional composition support system cannot add sound effects when synthesizing music materials, when creating an ensemble with sound effects, various sound effects have been applied in advance. There was an inconvenience that you had to prepare the music material recorded in, and then start creating.
The present invention has been devised under such a background, and an object of the present invention is to provide a mechanism that can easily create a musical composition with various acoustic effects.

  A music material processing method according to a preferred aspect of the present invention includes a piece file storage means for storing piece files each including music material data representing an audio signal of each music material and a material identifier of the music material, and an ensemble The material identifier of the composite music material, which is the music material obtained by combining the music materials to be performed continuously or in parallel for the length of time corresponding to a part of the performance section of the song, and the performance contents of the composite music material , Material composition management data represented as one or a plurality of columns composed of material identifiers of music materials to be played in succession or in parallel, and insertion effect control data representing acoustic effects to be given to the synthesized music material, Connected file storage means for storing each connect file including each of them, and continuously or in parallel for a time length corresponding to the entire performance section of the ensemble. One or a plurality of material identifiers of music materials that are music materials obtained by collecting music materials to be performed, and material identifiers of the respective music materials that are played in succession or in parallel, A list file storage means for storing each list file including the material composition management data represented as a column and system effect control data representing the sound effect to be given to the music material, an operator, and a data column. A music material processing method using a system having a track buffer having a plurality of tracks to be stored, wherein a music material material to be reproduced is selected in accordance with an operation of the operation element, and the reproduction object A list file including the material identifier of the music material selected in the selection step is read from the list file storage means, and A list file expansion process for storing each column of material identifiers represented by the material composition management data included in the list file in each track of the track buffer, and extracting system effect control data from the list file, and the list file expansion process The connect files each including the material identifier stored in each track are read from the connect file storage means, and each column of material identifiers represented by the material composition management data included in the connect files is stored in the list file expansion step. Each of the recorded material identifiers is stored in each track, and includes a connect file development process for extracting insertion effect control data from the connect file, and a material identifier stored in each track in the connect file development process. Pi Piece file expansion step of reading out the source files from the piece file storage means, and storing the music material data contained in those piece files in each track in place of each of the material identifiers stored in the connect file expansion step; A first effect applying step for applying a sound effect applying process based on the extracted insertion effect control data to the music material data stored in each track in the piece file developing step; and the first effect applying A mixing step of mixing the music material data of each track that has been subjected to the sound effect applying process in the step; and a sound effect applying process based on the extracted system effect control data is applied to the mixed music material data. 2 effect applying step and the second effect applying step And a tone output step of outputting the sound effect imparting processing music material data subjected as tone.

  In this aspect, the piece file development step determines whether each piece of material identifier stored in each track in the connect file development step has a piece file including the material identifier as a processing target in the piece file storage unit. Are sequentially determined, and if it is determined that there is a piece file including the material identifier to be processed, the audio material data included in the piece file is stored in the track in place of the material identifier of the processing target. Each time it is determined that there is no piece file including the material identifier, the connect file including the material identifier to be processed is read from the connect file storage unit, and the material identifier represented by the material composition management data included in the read connect file One or more columns of Ete by a process of storing the track is repeated recursively, may have a step of replacing all of the material identifier stored in each track in the connect file expansion process to the music material data.

  In addition, a plurality of music materials to be played continuously or in parallel for a certain length of time are selected according to the operation of the operation element, and the selected plurality of music materials are added to a new music material obtained collectively. Music material synthesis instruction step for inputting sound effects to be performed in accordance with the operation of the operator, and management data generation step for generating material synthesis management data representing the material identifiers of the selected plurality of music materials as one or a plurality of columns A message output step for outputting a message for inquiring whether or not the music composition material is generated; and after outputting the message, when the music music material generation instruction is not input according to the operation of the operator, the selected A material identifier unique to a synthetic music material obtained by collecting a plurality of music materials and an insertion F representing the input sound effect. And a new connect file containing the material identifier and insertion effect control data and the material composition management data generated in the management data generation step is stored in the connect file storage means, When a music music material generation instruction is input in accordance with the operation of the operator, a system identifier representing a material identifier unique to the music music material obtained by collecting the plurality of selected music materials and the input sound effect And a new file storage step for generating a new list file containing the material identifier and system effect control data and the material synthesis management data generated in the management data generation step in the list file storage means And may further include

  Furthermore, a step of inputting an audio signal of a music material via a predetermined signal input device, a material identifier unique to the music material data representing the input audio signal are generated, and the generated material identifier and the music material data And storing a new piece file including the information in the piece file storage means.

  A music material processing system according to another preferred embodiment of the present invention comprises piece file storage means for storing piece files each including music material data representing an audio signal of each music material and a material identifier of the music material. , A material identifier of a synthetic music material that is a music material obtained by combining music materials to be performed continuously or in parallel for a length of time corresponding to a part of the performance of the ensemble, and the performance of the synthetic music material Material composition management data representing the contents as one or a plurality of columns composed of material identifiers of the respective music materials to be played in succession or in parallel, and insertion effect control representing an acoustic effect to be given to the synthesized music material The connected file storage means for storing each connected file including data, and the time length corresponding to the entire performance section of the ensemble. The material identifier of the music material, which is the music material obtained by collecting the music material to be performed in the same way, and the material identifier of each music material to be played in succession or in parallel, the performance content of the music material. List file storage means for storing each list file including material composition management data represented as one or a plurality of columns, and system effect control data representing sound effects to be applied to the music material, and an operator; A track buffer having a plurality of tracks for storing a data string, a reproduction target selection means for selecting a musical composition music material to be reproduced in accordance with an operation of the operation element, and a musical composition music material selected by the reproduction target selection means A list file containing material identifiers is read from the list file storage means, and the material composition included in the list file is read Each column of material identifiers represented by physical data is stored in each track of the track buffer, and list file expansion means for extracting system effect control data from the list file, and material stored in each track by the list file expansion means Connect files each including an identifier are read from the connect file storage means, and each column of material identifiers represented by the material composition management data included in the connect files is replaced with each of the material identifiers stored by the list file expansion means. Connect file expansion means for extracting insertion effect control data from the connect file and storing the piece file including the material identifier stored in each track by the connect file expansion means from the piece file storage means. The piece file development means for reading out the music material data contained in each piece file and storing it in each track in place of the material identifier stored in the connect file development means, and the extracted insertion effect control data First effect applying means for applying the sound effect applying process to the music material data stored in each track by the piece file developing means, and each track having the sound effect applying process performed by the first effect applying means Mixing means for mixing the music material data, second effect applying means for applying the sound effect applying process based on the extracted system effect control data to the mixed music material data, and the second effect applying means Outputs music material data that has undergone acoustic effect processing as musical sound And a sound output means.

  According to the present invention, it is possible to easily create music with various acoustic effects.

(Embodiment of the Invention)
An embodiment of the present invention will be described.
The present embodiment provides the following three services to a user who creates an ensemble composed of a plurality of instrument parts.
(1) Music material recording service This service records data files of musical sounds (hereinafter referred to as "music material") representing the performance contents of a certain length of time from various musical instruments played by the user, A service that accumulates in a database.
(2) Music material editing service This service combines music materials stored in a database to represent music material (hereinafter referred to as a musical material) that represents the performance content of the length of time corresponding to a part of the performance section of the ensemble. , This music material is called “synthetic music material” as appropriate, and by connecting these synthetic music materials in any order, the performance content of the length of time corresponding to the entire performance section of the ensemble This is a service that creates music material that represents music (hereinafter, this music material is referred to as “music music material” as appropriate).
(3) Music material reproduction service This service is a service for reproducing musical composition music material created through a music material editing service as musical sound.

The music material processing system according to the present embodiment has the following two features.
The first feature is that various effects such as delay and reverb can be added to each of the synthetic music material and music composition material created from a plurality of music materials in the music material editing service.
The second feature is that when specifying an effect to be given to a synthetic music material created by the user, an effect to be given only to the synthetic music material (hereinafter referred to as an “insertion effect”), and its synthesis This is because it is possible to specify the effect after distinguishing it from the effect (hereinafter referred to as “system effect”) applied to the entire music material including the music material.

FIG. 1 is a block diagram showing the overall configuration of the music material editing system according to the present embodiment. In this system, a music material management server device 10 and a terminal device 20 are connected via a network 30. Although only one terminal device 20 is shown in the figure, a plurality of terminal devices 20 may be provided. As shown in the figure, the music material management server device 10 includes a CPU 11 that performs various controls, a RAM 12 that provides a work area, a ROM 13 that stores an IPL (Initial Program Loader), a communication interface 14, a hard disk 15, and the like.
The hard disk 15 stores a music material database 15a and a music material management program 15b.
The music material database 15a is an aggregate of a plurality of records each corresponding to one music material. One record constituting this database has four fields of “material identifier”, “piece file”, “connect file”, and “list file”. The “material identifier” field stores a material ID that is an identifier for uniquely identifying each music material. Also, a piece file is stored in the “piece file” field, a connect file is stored in the “connect file” field, and a list file is stored in the “list file” field. Here, the piece file, the connect file, and the list file stored in each of these three fields are generated in response to a request from the terminal device 20 using the music material recording service and the music material editing service shown at the beginning. File.

The data structure of each file will be described in detail.
As shown in FIG. 2A, the piece file includes music material data, reproduction time length data, material ID, and user ID. The music material data is data representing a code string obtained by encoding an audio signal of music material. The playback time length data is data representing the playback time length of the music material, such as “1 bar”, “1/2 bar”, “1/4 bar”, “2 bar”, etc. The reproduction time length of the music material is represented by a relative value based on the length. The material ID is an identifier for identifying the music material, and its content matches the ID stored in the “material identifier” field. The user ID is an identifier for identifying the user.
As shown in FIG. 2B, the connect file includes material composition management data, reproduction time length data, material ID, user ID, and effect control data. Since the contents of the reproduction time length data, material ID, and user ID are the same as those of the piece file, description thereof will be omitted. The material composition management data is sequence data representing one or two columns of material IDs of a plurality of music materials. The effect control data is a parameter representing the content of signal processing applied to the audio signal of the music material.
As shown in FIG. 2C, the list file includes material composition management data, reproduction time length data, material ID, user ID, and effect control data. The contents of the material composition management data, playback time length data, material ID, user ID, and effect control data are the same as those of the connect file. However, the material composition management data included in the connect file is sequence data representing the performance contents of the synthetic music material, whereas the material composition management data included in the list file is sequence data representing the performance contents of the music composition material. Is different.

1, the terminal device 20 includes a CPU 21, a RAM 22, a ROM 23, a mouse 24 as an operator, a computer display 25, a communication interface 26, an audio interface 27, a speaker 28, a hard disk 29, and the like.
The hard disk 29 stores a music material editing program 29a. This program is a program that gives the CPU 21 the functions characteristic of this embodiment.

Next, the operation of this embodiment will be described.
The operation of this embodiment can be roughly divided into music material recording processing, music material editing processing, and music material reproduction processing. When the user activates his / her terminal device 20, the CPU 21 displays a main menu screen on the computer display 25. In the upper part of this screen, a character string “Please select the service to use” is displayed. Below that, “Music material recording service”, “Music material editing service”, and “Music material playback service” are displayed. "Button is displayed. When the “Music material recording service” button is selected, the music material recording process is selected. When the “Music material editing service” button is selected, the music material editing process is selected, and the “Music material playback service” button is selected. Then, the music material reproduction process is executed.

FIG. 3 is a flowchart showing the music material recording process.
When the button labeled “Music material recording service” on the main menu screen is selected, the CPU 21 of the terminal device 20 displays a user ID input screen on the computer display 25 (S100). A character string “Please enter user ID” is displayed in the upper part of the user ID input screen, and a user ID input field is displayed below it. The user who refers to this screen inputs his / her user ID in the input field.
When the user ID is input, the CPU 21 of the terminal device 20 stores the user ID in the RAM 22 and then transmits a message requesting the provision of the music material recording service to the music material management server device 10 (S110).
CPU11 of the music material management server apparatus 10 which received the message transmits the display data of a material input request screen to the terminal device 20 (S120).

The CPU 21 of the terminal device 20 that has received the display data displays a material input request screen on the computer display 25 (S130). In the upper part of this screen, a character string “Please input audio signal of music material” is displayed.
The user who refers to the screen connects the musical instrument responsible for one of the musical instrument parts of the ensemble created by the user to the audio interface 27 of the terminal device 20. Then, the music material that will appear in the ensemble that he creates is played using the instrument.
The CPU 21 of the terminal device 20 stores the audio signal supplied from the musical instrument via the audio interface 27 in the RAM 22 (S140).
When the supply of the audio signal is stopped, the CPU 21 measures the reproduction time length of the audio signal stored in the RAM 22, generates reproduction time length data representing the reproduction time length, and stores it in the RAM 22 (S150). For example, if the measured playback time length is one bar length, playback time length data representing “1 bar” is generated, and if the measured playback time length is 1/2 bar, the playback time length representing “1/2 bar” is generated. Data will be generated.
The CPU 21 transmits the music material data obtained by encoding the audio signal stored in the RAM 22, the reproduction time length data generated in step 150, and its own user ID to the music material management server device 10 ( S160).

The CPU 11 of the music material management server device 10 generates a new material ID (S170).
The CPU 11 generates a new piece file including the music material data, playback time length data, and user ID received from the terminal device 20 and the material ID generated in step 170 (S180).
Subsequently, the CPU 11 adds a new record to the music material database 15a (S190).
The CPU 11 stores the material ID generated in step 170 in the “material identifier” field of the record added in step 190 and stores the piece file generated in step 180 in the “piece file” field. The data “Null” is stored in the fields “Connect file” and “List file” (S200). In the music material editing process described later, a newly generated connect file is stored in the “connect file” field, or a list file is stored in the “list file” field, while a “piece file”. In this field, “Null” data is stored.

The CPU 11 transmits display data of the recording completion notification screen obtained by embedding the material ID generated in step 170 in a predetermined template to the terminal device 20 (S210).
The CPU 21 of the terminal device 20 that has received the display data from the music material management server device 10 displays a recording completion notification screen on the computer display 25 (S220). In the upper part of the recording completion notification screen, a character string with the content “The recording of the new music material has been completed. The material ID of the recorded music material is as follows.” Is displayed. ID is displayed. At the bottom of the screen, buttons labeled “Record another music material” and “Return to main menu” are displayed. The user who understands the material ID of the newly recorded music material by referring to this screen selects any button.
When the “Register another music material” button is selected, the process returns to step 130, and the CPU 21 displays a material input request screen on the computer display 25.
When the “return to main menu” button is selected, the CPU 21 displays the main menu screen on the computer display 25 again.

  The user sequentially records the musical material for each musical instrument part that will appear in the ensemble that he creates while switching the musical instruments connected to the audio interface 27 as appropriate according to the guidance on the material input request screen. For example, if you intend to create an ensemble composed of four instrument parts: drum, bass, keyboard, and guitar, then record sequentially while switching those four instruments. As a result, the piece file including the music material data of the drum, bass, keyboard, and guitar audio signals is accumulated in the music material database 15 a of the music material management server device 10.

4 to 7 are flowcharts showing the music material editing process.
When the button labeled “music material editing service” on the main menu screen is selected, the CPU 21 of the terminal device 20 stores an area for storing a connect file and a list file to be generated from itself (hereinafter, this area). Is called a “file storage area”) in a part of the RAM 22 (S300). The files stored in the file storage area are collectively uploaded to the music material management server device 10 when the use of the music material editing service ends.
The CPU 21 displays a user ID input screen on the computer display 25 (S310). The user who refers to this screen inputs his / her user ID in the input field.
When the user ID is input, the CPU 21 of the terminal device 20 stores the user ID in the RAM 22 and then transmits a message requesting provision of the music material editing service to the music material management server device 10 (S320).

The CPU 11 of the music material management server apparatus 10 that has received the message reads all material IDs stored in the “material identifier” field of each record of the music material database 15a into the RAM 12 (S330).
The CPU 11 transmits the display data of the edit screen obtained by embedding the material ID read in step 330 in a predetermined template to the terminal device 20 (S340).
The CPU 21 of the terminal device 20 that has received the display data displays an editing screen on the computer display 25 (S350).

FIG. 8 is an editing screen.
A music material presentation field 50 is provided in the upper part of the editing screen, and a music material composition field 60 is provided in the lower part of the screen. In the music material presentation column 50, all material IDs read in step 330 are displayed as a list. In addition, a scroll bar 51 for moving the display range of the material ID up and down is provided at the right end of the presentation column. The music material composition column 60 has two tracks, a first track 61 and a second track 62. In each of these tracks, a bar (hereinafter referred to as “material ID bar”) containing the material ID of the music material selected from the music material presentation column 50 according to the user's operation is input. It has become. In addition, a scroll bar 63 for moving the display range of the track to the left and right is provided at the lower end of the music material composition field 60. Further, a button labeled “synthesize” is displayed on the right side of the music material composition column 60.
When the editing screen is displayed, the user places the mouse pointer on an arbitrary material ID in the music material presentation field 50 of the editing screen and drags the left button of the mouse 24 to move the mouse pointer to the track in the music material composition field 60. Move to and drop.
When this drag and drop operation is performed, the CPU 21 of the terminal device 20 determines whether or not a connect file including the material ID selected by the drag is stored in the file storage area of the own device (S360 in FIG. 4). .
If the CPU 21 determines in step 360 that the connect file including the material ID is not stored in the file storage area, the CPU 21 transmits the material ID selected by dragging to the music material management server apparatus 10 (S370).
The CPU 11 of the music material management server apparatus 10 that has received the material ID specifies a record in which the material ID is stored in the “material identifier” field from the music material database 15a (S380).

The CPU 11 extracts the reproduction time length data included in the file stored in the “connect file” field of the record specified in step 380. If the reproduction time length data is not stored, the CPU 11 further extracts “piece file”. The reproduction time length data included in the file stored in the field is extracted, and the reproduction time length data is transmitted to the terminal device 20 (S390 in FIG. 5).
The CPU 21 of the terminal device 20 displays a material ID bar having a width corresponding to the time length indicated by the playback time length data received from the music material management server device 10 at a position on the track where the material ID is dropped (S400). .
On the other hand, the CPU 21 that has determined in step 360 that the connect file including the material ID is stored in the file storage area of the own device extracts the reproduction time length data included in the connect file together with the material ID (S410). ).
The CPU 21 displays a material ID bar having a width corresponding to the time length indicated by the reproduction time length data extracted in step 410 at a position on the track where the material ID is dropped (S420).
The series of processing from step 360 to step 420 is repeated each time the user performs a drag-and-drop operation, and new material ID bars are sequentially formed on the tracks in the music material composition column 60.

  FIG. 9 shows an example of a drag-and-drop operation by the user and a material ID bar formed in the track according to the operation. In this figure, in the first drag-and-drop operation, the material ID “A” dragged in the music material presentation column 50 is dropped at the top position of the first track 61, which corresponds to the length of 1/2 bar. A material ID bar “A” having a horizontal width is formed on the first track 61. Furthermore, in the second drag-and-drop operation, the material ID “B” dragged in the music material presentation column 50 is dropped at the position immediately to the right of the material ID bar “A”, which corresponds to the length of 1/2 bar. A material ID bar “B” having a horizontal width is formed on the right side of the material ID bar “A”. In the third drag-and-drop operation, the material ID “C” dragged in the music material presentation column 50 is dropped at the top position of the second track 62, resulting in a material having a width corresponding to the length of one measure. An ID bar “C” is formed on the second track 62.

The user uses a drag-and-drop operation to form an array of material ID bars for a desired time length (for example, one measure) on one or both tracks in the music material synthesis column 60, and then to the left of the synthesis column. Select the button labeled “Composite”.
When the “composite” button is selected, the CPU 21 of the terminal device 20 generates material composition management data by converting the array of material IDs formed on each track in the music material composition field 60 into sequence data (FIG. 5). S430).
The CPU 21 generates reproduction time length data representing the total reproduction time length of the music material corresponding to the series of material IDs formed on the track in the music material composition column 60 and stores it in the RAM 22 (S440).
The CPU 21 transmits a message requesting issuance of a new material ID to the music material management server apparatus 10 (S450).
The CPU 21 of the music material management server apparatus 10 that has received the message generates a new material ID and transmits the material ID to the terminal device 20 (S460).
The CPU 21 of the terminal device 20 that has received the material ID stores the material ID in the RAM 22 (S470), and then displays the file attribute selection request screen as a separate window on the editing screen (S480).

FIG. 10 is a file attribute selection request screen.
In the upper part of the file attribute selection request screen, a character string “Please select whether to apply effects.” Is displayed. Below that, buttons labeled “Apply effect” and “Do not apply effect” are displayed. In the middle of the screen, a character string “Please select the type of music material file.” Is displayed. Below that, buttons labeled “Connect File” and “List File” are displayed.
The user who refers to the screen selects one of the buttons “Apply effect” and “Do not apply effect”, and one of “Connect file” and “List file”. In other words, the combinations of selections on this file attribute selection request screen are as follows: “Apply an effect to create a connect file”, “Add an effect to create a connect file”, “Apply an effect to create a list file”, “ It becomes one of the four ways of “list file without giving”.
When the button is selected, the CPU 21 determines which of the four combinations is selected (S490 in FIG. 6).

The CPU 21 that determines that the combination of “connect file without applying effect” is selected in step 490, the material composition management data generated in step 430, the playback time length data generated in step 440, and the RAM 22 in step 470. A new connect file including the material ID stored in is generated, and the connect file is stored in the file storage area of the RAM 22 (S500). That is, in this step, a connect file that does not include effect control data is generated.
Subsequently, the CPU 21 adds the material ID stored in the RAM 22 in step 470 to the music material presentation column 50 on the editing screen and displays it, and erases the material ID bar displayed on both tracks in the music material composition column 60. (S510).
Thereafter, the user can again use the drag-and-drop operation to form an array of material ID bars in the music material composition field 60 on the editing screen and select “synthesize”.

The CPU 21 that has determined that the combination of “list file without applying effects” is selected in step 490, the material composition management data generated in step 430, the playback time length data generated in step 440, and the RAM 22 in step 470. A new list file including the material ID stored in (2) is generated, and the list file is stored in the file storage area of the RAM 22 (S520). That is, in this step, a list file that does not include effect control data is generated.
After executing Step 520, the CPU 21 executes processing after Step 590 described later.

When a combination other than “Create connection file without applying effects” and “Create list file without applying effects” is selected, the CPU 21 displays an effect type selection request screen as a separate window on the editing screen (S530). ).
FIG. 11 is an effect type selection request screen.
In the upper part of the effect type selection request screen, a character string “Select an effect type.” Is displayed. Below that, buttons with names of various effects such as “delay” and “compressor” are selected.
The user who refers to the screen selects any button.
CPU21 produces | generates the effect control data showing the content of the signal processing for providing the selected effect (S540).

After the effect control data is generated, if “Apply effect to connect file” is selected on the file attribute selection request screen, the process proceeds to step 550, and the CPU 21 displays the effect section selection request screen in another window on the editing screen. Display as.
FIG. 12 is an effect section selection request screen.
In the upper part of the effect section selection request screen, a character string “Please select a section to apply the effect.” Is displayed. Below that, buttons labeled “only music material in the composition column” and “all music” are displayed.
The user who refers to the screen selects any button.
When the button labeled “only music material in composition field” is selected, the CPU 21 selects the material composition management data generated in step 430, the playback time length data generated in step 440, and the material ID stored in the RAM 22 in step 470. A new connect file including the effect control data generated in step 540 is generated (S560).
On the other hand, when the button labeled “all music” is selected, the CPU 21 selects the material composition management data generated in step 430, the playback time length data generated in step 440, and the material ID stored in the RAM 22 in step 470. Is generated, and the effect control data generated in step 540 is stored in the free area of the RAM 22 without being included in the connect file (S570).

If “add effect to list file” is selected on the file attribute selection request screen, the process proceeds to step 580, the material composition management data generated in step 430, the playback time length data generated in step 440, A new list file including the material ID stored in the RAM 22 in step 470 and the effect control data generated in step 530 is generated (S580).
CPU21 which performed step 580 or the above-mentioned step 520 judges whether there exists any effect control data memorize | stored in the vacant area (S590).
If the user has already performed a drag-and-drop operation several times and selected the “Combine” button, and “All of the songs” has been selected on the effect section selection request screen that appears after that, Since the generated connection control data should be stored in the free area without being included in the connect file, the determination result of this step is “Yes”.

The CPU 21 that has determined that there is effect control data stored in the empty area in step 590 adds the effect control data to the list file generated in step 520 or step 580 (S600). In other words, after being generated together with the connect file, the effect control data that has been placed in a floating state without belonging to the file is included in the list file. On the other hand, the CPU 21 that has determined that there is no effect control data stored in the empty area proceeds to the next step without executing this step.
CPU21 transmits all the files memorize | stored in the file storage area of RAM12 to the music material management server apparatus 10 (S610). The CPU 11 of the music material management server device 10 stores the file received from the terminal device 20 in the RAM 12 (S620).
The CPU 11 specifies one of the files stored in the RAM 12 as a processing target (S630). The CPU 11 extracts the material ID included in the file specified in step 630 (S640), and then adds one record to the file management database (S650).

The CPU 11 stores the material ID extracted in step 640 in the “material identifier” field of the record added in step 650 (S660). The CPU 11 determines whether the file specified as the processing target in step 630 is a connect file or a list file (S670).
In step 670, the CPU 11 having determined that the file to be processed is a connect file stores the file in the “connect file” field of the record added in step 650, while “piece file” and “list file”. "Null" data is stored in the "" field (S680).
On the other hand, when the CPU 11 determines that the file to be processed is a list file in step 670, the CPU 11 stores the file in the “list file” field of the record added in step 650, while “piece file” and “ The “Null” data is stored in the “Connect File” field (S690).
Thereafter, the CPU 11 determines whether there are any files that are not yet processed (S700).
If it is determined in step 700 that there are still files that are not processing targets, the process returns to step 630 to execute the subsequent processing with another file as a processing target, while such files do not remain. The determined CPU 11 transmits a message to the effect that the file upload has been completed to the terminal device 20 (S710).
CPU21 of the terminal device 20 which received the message displays a main menu screen.

The processing described above will be further described in detail with reference to a specific example.
FIG. 13 is a diagram illustrating an example of an operation via the editing screen.
The explanation here is a piece file of music material “A” and “B” obtained by recording an audio signal of 1/4 bar of a drum, and an audio signal of 1/4 bar of a guitar. Pieces of music material of “F” and “G” obtained by recording piece files of music materials of “C”, “D”, “E” and audio signals corresponding to 1/2 bars of the bus. The file is assumed to be stored in the music material database 15a through the music material recording process.

Referring to the figure, in the first operation, the user sets the material ID bars of “A” and “B”, which are music materials recorded from the drum, as “A” → “A” → “A” → “B”. After the first track 61 is formed in order, the buttons "Synthesize"->"Apply an effect and create a connect file"->"Delay"->"Only music material in the composite column" are sequentially selected. As a result, a new connection file including the material composition management data in which the material IDs are arranged in a row with “AAAB”, the effect control data for adding a delay, and the material ID “I” is generated.
In the second operation, the user tracks the material ID bars of “C” and “D”, which are music materials recorded from the guitar, in the order of “C” → “C” → “C” → “D”. Then, the buttons “Synthesize” → “Apply an effect and create a connect file” → “Compressor” → “All songs” are sequentially selected. As a result, a new connect file including the material composition management data in which the material ID is aligned with “CCCD” and the material ID “J” is generated, while the effect control data to which the compressor is added is included in the connect file. Without being stored in the free area of the RAM 12.

In the third operation, the user tracks the material ID bars of “C” and “E”, which are music materials recorded from the guitar, in the order of “C” → “C” → “C” → “E”. After being formed in 61, the buttons “Synthesize” → “Create connect file without applying effect” are sequentially selected. As a result, a new connect file including the material composition management data in which the material ID is aligned with “CCCE” and the material ID “K” is generated.
In the fourth operation, the user tracks the material ID bars of “F” and “G” which are music materials recorded from the bus in the order of “F” → “F” → “F” → “G”. The material ID bar of “I”, which is the music material obtained by synthesizing the drum music material, is formed on the second track 62 in the order of “I” → “I”, "→" Connect file without effect "button is selected in sequence. As a result, a new connect file including the material composition management data in which the material IDs are arranged in two columns “FFFG” and “II” and the material ID “L” is generated.

In the fifth operation, the user forms a material ID bar of “L”, which is a synthetic music material obtained from drum and bass music material, on the first track 61, and further a synthetic music material obtained from the music material of the guitar. After forming the material ID bar of “J” and “K” on the second track 62 in the order of “J” → “K”, “compositing” → “adding effects and creating a list file” button Are selected sequentially. As a result, a new list file is generated that includes material composition management data in which material IDs are arranged in two columns of “L” and “JK”, effect control data to which reverb is added, and material ID “M”. The compressor effect control data stored in the empty area at the time of the second operation is added to the list file.
Through the above five operations, music material for two measures having three musical instrument parts, drum, bass, and guitar, is collected as one connect file “M”.

14 to 16 are flowcharts showing the music material reproduction process.
When the button labeled “music material reproduction service” on the main menu screen is selected, the CPU 21 of the terminal device 20 transmits a message requesting provision of the music material reproduction service to the music material management server apparatus 10 (S800).
CPU11 of the music material management server apparatus 10 which received the message transmits the message which requests | requires transmission of user ID to the terminal device 20 (S810).
CPU21 of the terminal device 20 which received the message displays a user ID input screen on the computer display 25 (S820).
The user who refers to this screen inputs his / her user ID in the input field.
When the user ID is input, the CPU 21 of the terminal device 20 transmits the user ID to the music material management server device 10 (S830).

The CPU 11 of the music material management server apparatus 10 that has received the user ID identifies one or more records storing a file including the user ID in the “list file” field from the music material database 15a, and identifies the identified record. The material ID stored in the “material identifier” field is read (S840).
The CPU 11 transmits display data of the reproduction target selection request screen obtained by embedding the material ID read in step 840 in a predetermined template to the terminal device 20 (S850).
The CPU 21 of the terminal device 20 that has received the display data causes the computer display 25 to display a reproduction target selection request screen (S860).
In the upper part of the reproduction target selection request screen, a character string “Please select the ID of the music material to be reproduced.” Is displayed. Below that, all the material IDs read out in step 840 are displayed as a list.
The user who refers to this screen selects any material ID on the list.
When the material ID is selected, the CPU 21 of the terminal device 20 transmits the material ID to the music material management server device 10 (S870).

The CPU 11 of the music material management server device 10 identifies a record in which the material ID received from the terminal device 20 is stored in the “material identifier” field from the material management database, and is stored in the “list file” field of the record. The list file is read into the RAM 12 (S880).
The CPU 11 secures a control data storage area in a part of the RAM 12 (S890). This area includes effect control data (hereinafter referred to as “system effect control data”) included in the list file, and a connect file referred to in the process of restoring the audio signal of the music material from the list file. This is an area for storing included effect control data (hereinafter, this control data is referred to as “insertion effect control data”).
Further, the CPU 11 secures a multitrack sequence area in a part of the RAM 12 (S900). This area is a buffer having first to fourth four tracks.
The CPU 11 determines whether or not the system effect control data is included in the list file read in step 880 (S910).

The CPU 11 having determined that the system effect control data is included in step 910 extracts the system effect control data from the list file and stores it in the control data storage area (S920). When it is determined that the system effect control data is not included, the process proceeds to the next step without executing this step.
The CPU 11 extracts the material composition management data included in the list file read out in step 880, and writes the array of material IDs indicated by the material composition management data to one of the tracks in the multi-track sequence area (S930). Here, when the material composition management data represents only one array of material IDs, the array is written in the first track of the multi-track sequence area, and when the material composition management data represents two arrays, these The array is written in the first track and the second track in the same area.

The CPU 11 specifies one of the series of material IDs written in the multitrack sequence area in step 930 as a processing target (S940).
Subsequently, the CPU 11 identifies a record in which the “material identifier” field matches the material ID identified in step 940 from the records stored in the music material database 15a (S950).
The CPU 11 determines whether a piece file is stored in the “piece file” field of the record specified in step 950 (S960). If “Null” is not stored in the “Piece file” field, the determination result of this step is “Yes”. If “Null” is stored, the determination result of this step is “No”. become.
CPU11 which judged that the piece file was memorize | stored in step 960 reads the piece file (S970).
The CPU 11 replaces the music material data included in the read piece file with the material ID specified in step 940 (S980).
CPU11 which performed step 980 returns to step 940, and performs subsequent processing by making another material ID into a process target.

The CPU 11 that has determined that the piece file is not stored in step 960 reads the connect file in the “connect file” field of the record identified in step 940 (S990).
The CPU 11 determines whether or not the insertion effect control data is included in the read connect file (S1000).
The CPU 11 that has determined that the insertion effect control data is included in step 1000 extracts the insertion effect control data from the connect file and stores it in the control data storage area (S1010). When it is determined that the insertion effect control data is not included, the process proceeds to the next step without executing this step.

The CPU 11 determines whether the material composition management data included in the connect file read out in step 990 represents one array of material IDs or two arrays (S1020).
The CPU 11 that has determined that the material composition management data represents one array of material IDs in step 1020 replaces the array with the material IDs identified in step 940 (S1030). That is, the arrangement of the material IDs of a plurality of music materials input to one track in the music material composition column 60 is restored from the material ID of one music material specified as the processing target.
The CPU 11 that has determined in step 1020 that the material composition management data represents two arrays of material IDs replaces one of the arrays with the material ID specified in step 940 and writes the other array in the material ID yet. The data is written in a track (hereinafter referred to as “empty track”) in the multitrack sequence area where there is no (S1040). That is, the arrangement of the material IDs of a plurality of music materials respectively input to the two tracks of the music material composition column 60 in order to obtain the music material is restored from the material ID of the specified music material to be processed. .
CPU11 which performed step 1030 or step 1040 judges whether all the material IDs written in each track of the multitrack sequence area were replaced with music material data (S1050).
The CPU 11 that has determined in step 1050 that a part of the material ID has not been replaced with the music material data returns to step 940, specifies the material ID as a processing target, and executes the subsequent processing.

The CPU 11 that has determined that all of the material IDs have been replaced with the music material data in step 1050 identifies one of the tracks in the multi-track sequence area in which the music material data is written as a processing target (S1060).
The CPU 11 replaces one or a plurality of music material data written in the track specified in step 1060 with an audio signal obtained by decoding the music material data (S1070).
CPU11 which performed step 1070 judges whether all the music material data written in the track | truck were replaced with the audio signal (S1080).
If the CPU 11 determines in step 1080 that the music material data written in some of the tracks has not been replaced with the audio signal, the CPU 11 returns to step 1060 and executes the subsequent processing after setting the track as the processing target.
In step 1080, the CPU 11, which has determined that all the music material data written in the track has been replaced with the audio signal, performs signal processing according to the insertion effect control data in the control data storage area for the audio signal of a part of the track. (S1090). That is, based on the material synthesis management data included in the connect file together with the insertion effect control data in the control data storage area, the section to be subjected to signal processing is specified from the audio signal of the track, and the audio signal in the specified section is converted to the audio signal in the specified section. The signal processing according to the control data is performed.

The CPU 11 mixes an audio signal written in a track other than the first track into the first track (S1100), and then performs signal processing according to the system effect control data stored in the control data storage area in the first track. (S1110).
The CPU 11 transmits music material data obtained by encoding the audio signal subjected to signal processing to the terminal device 20 (S1120).
The CPU 21 of the terminal device 20 that has received the music material data outputs an audio signal obtained by decoding the music material data to the speaker 28 (S1130).
As a result, the musical sound of the music material is emitted from the speaker 28.

The processing described above will be further described in detail with reference to a specific example.
FIG. 17 and FIG. 18 are diagrams showing the transition of the state of each area of the RAM 12 from the selection of the material ID of the musical composition material to be reproduced until the audio signal of the musical composition material is obtained. The description here is made assuming that the material ID “M” of the synthetic music material obtained by the fifth operation shown in FIG. 13 is selected as the reproduction target.
Referring to FIG. 17, in step 910 which comes immediately after the control data storage area and the multitrack sequence area are secured in the RAM 12, the list file of the material ID “M” includes the system effect control data of the compressor and the reverb. It is judged that In step 920, both control data are stored in the control data storage area, and in step 930, the material ID “L” is assigned to the first track of the multitrack sequence area, and the material ID “JK” is assigned to the second track. Each is written (state 1). Thereafter, the loop after step 950 is repeated with the material IDs “L”, “J”, and “K” as processing targets.

To describe each loop in detail, first, since the material ID “L” does not have a corresponding piece file, the determination result in Step 960 is “No”, and the process proceeds to Step 990. The material ID “FFFG” and the material ID “II” are replaced in accordance with the material composition management data included in the file. As a result, the material ID “FFFG” is stored in the first track, the material ID “JK” is stored in the second track, and the material ID “II” is stored in the third track (state 2). This time, the loop is further repeated with the material IDs “F”, “G”, “J”, “K”, and “I” as processing targets.
Since the material IDs “F” and “G” have corresponding piece files, the determination result in step 960 is “Yes” and the process proceeds to step 970, and the music material included in the piece file read in the same step Replaced with data. As a result, the music material data “fffg” is stored in the first track (state 3).

Since the material ID “J” does not have a corresponding piece file, the determination result in step 960 is “No” and the process proceeds to step 990, in accordance with the material composition management data included in the connect file read out in the same step. It is replaced with the material ID “CCCD”. Since both of the material IDs “C” and “D” have piece files, the determination result in step 960 is “Yes” and the process proceeds to step 970 and is included in the piece file read in the same step. Replaced with music material data. The same applies to the loop whose processing target is the material ID “K”. As a result, the music material data “cccdccce” is stored in the second track (state 4).
Since the material ID “I” does not have a corresponding piece file, the determination result in step 960 is “No”, and the process proceeds to step 990, in accordance with the material composition management data included in the connect file read in the same step. Replaced with the material ID “AAAB”. Since both of the material IDs “A” and “B” have piece files, the determination result in step 960 is “Yes” and the process proceeds to step 970 and is included in the piece file read in the same step. Replaced with music material data. As a result, the music material data “aaabaab” is stored in the third track. Here, the insertion file referred to when the material ID “I” is replaced with the material ID “AAAB” includes delay insertion effect control data. Therefore, the determination result of step 1000 is “Yes”, step 1010 is executed, and the insertion effect control data is stored in the control data storage area (state 5).

When all of the material IDs of the respective tracks are replaced with music material data, the music material data is replaced with encoded audio signals in steps 1060 to 1080 (state 6). In step 1090, signal processing is performed on the audio signal for which insertion effect control data is set. In this case, the delay signal processing is performed on the audio signal in the section to which the delay effect is to be applied, that is, the audio signal of the third track replaced with the music material data “aaab”. (State 7).
In step 1100, the audio signals of all tracks are mixed into the first track (state 8), and in the subsequent step 1110, system effect control data is set for the mixed audio signals of the first track. Then, signal processing according to the control data is performed. That is, the compressor and reverb signal processing is performed (state 9).
Thereafter, the audio signal of the first track is transmitted to the terminal device 20 as music material data, and musical sounds for three tracks are emitted from the speaker 28 of the device 20 at the same time.

  According to the present embodiment described above, various effects such as delay and reverb can be added to each of the synthetic music material and music composition material created from a plurality of music materials in the music material editing service. . Then, when specifying an effect to be given to the synthetic music material in the music material editing service, an effect to be given only to the synthetic music material, an effect to be given to the whole music composition material including the synthetic music material, Can be specified after distinguishing. Thus, the user can easily create an ensemble with various effects applied in various modes.

(Other embodiments)
This embodiment can be modified in various ways.
In the above embodiment, the music material composition field 60 on the editing screen has two tracks, the first track 61 and the second track 62, but more tracks may be provided. According to this modification, it is possible to combine a sequence of material IDs of more music materials at a time by a mixing editing operation. Further, although the multi-track sequence area secured in the RAM 12 of the music material management server apparatus 10 has four tracks, it may have a larger number of tracks.
In the music material recording service of the above embodiment, the audio signal of the music material is acquired by the user himself / herself playing a musical instrument connected to the audio interface 27 of the terminal device 20, but a sound source is connected to the audio interface 27. The audio signal of the music material may be acquired by controlling the sound source.
In the music material reproduction process of the above embodiment, after the music material data written in each track of the multi-track sequence area is replaced with an audio signal, the audio signal is mixed with the first track and then sent to the terminal device 20. However, if the terminal device 20 can process audio signals of two channels, the audio signals of two channels may be mixed and then provided to the terminal device 20. Alternatively, the musical instrument part of the music material data written in each track of the multi-track sequence area is first presented to the terminal device 20, and only the audio signals of the two musical instrument parts selected by the user from these are presented to the terminal device 20. You may make it provide.
In the above-described embodiment, the music material management server device 10 is installed on the network 30 assuming use by a plurality of users, and the server device responds to a request from the user's terminal device 20 according to a request from the user's terminal device 20. Although the aspect of providing each of the material editing service and the music material reproduction service has been described, each of these services may be provided by a stand-alone computer device.

It is a block diagram which shows the whole structure of a music material editing system. It is a data structure figure of each file. It is a flowchart which shows a music material recording process. It is a flowchart which shows a music material edit process. It is a flowchart which shows a music material edit process. It is a flowchart which shows a music material edit process. It is a flowchart which shows a music material edit process. It is an edit screen. It is a figure which shows drag and drop operation. It is a file attribute selection request screen. It is an effect type selection request screen. It is an effect section selection request screen. It is a figure which shows an example of operation via an edit screen. It is a flowchart which shows a music material reproduction | regeneration process. It is a flowchart which shows a music material reproduction | regeneration process. It is a flowchart which shows a music material reproduction | regeneration process. It is a figure which shows transition of the state of RAM. It is a figure which shows transition of the state of RAM.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Music material management server apparatus, 11, 21 ... CPU, 12, 22 ... RAM, 13, 23 ... ROM, 14, 26 ... Communication interface, 15, 29 ... Hard disk, 20 ... Terminal device, 24 ... Mouse, 25 ... Computer display, 27 ... Audio interface, 28 ... Speaker, 30 ... Network, 50 ... Music material presentation column, 51, 63 ... Scroll bar, 60 ... Music material composition column

Claims (5)

Piece file storage means for storing piece files each including music material data representing an audio signal of the music material and a material identifier of the music material;
The material identifier of the synthetic music material, which is the music material obtained by combining the music materials to be played continuously or in parallel for the length of time corresponding to a part of the performance of the ensemble, and the performance contents of the synthetic music material Is expressed as one or a plurality of columns composed of material identifiers of music materials to be played in succession or in parallel, and insertion effect control data representing sound effects to be given to the synthesized music materials Connect file storage means for storing each connect file including
The material identifier of the music material that is the music material obtained by combining the music materials to be performed continuously or in parallel during the length of time corresponding to the entire performance section of the ensemble, and the performance contents of the music material , Material composition management data represented as one or a plurality of columns composed of material identifiers of the music materials to be played continuously or in parallel, and system effect control data representing the acoustic effect to be given to the music material List file storage means for storing each list file included,
An operator,
A music material processing method using a system having a track buffer having a plurality of tracks for storing a data string,
A reproduction target selection step of selecting music music material to be reproduced according to the operation of the operation element;
A list file including material identifiers of the music material selected in the reproduction target selection step is read from the list file storage means, and each column of material identifiers represented by the material composition management data included in the list file is stored in the track buffer. A list file expansion process for storing each track and extracting system effect control data from the list file;
The connect file including the material identifier stored in each track in the list file development step is read from the connect file storage means, and each column of the material identifier represented by the material composition management data included in the connect file is displayed in the list file. Connected to each track in place of the material identifier stored in the expansion process, and stored in each track, Connect file expansion process of extracting insertion effect control data from the connect file,
The piece file including the material identifier stored in each track in the connect file development step is read from the piece file storage unit, and the music material data included in the piece file is stored in the connect file development step. A piece file development process for storing in each track in place of each identifier;
A first effect applying step of applying an acoustic effect applying process based on the extracted insertion effect control data to the music material data stored in each track in the piece file developing step;
A mixing step of mixing the music material data of each track that has been subjected to the sound effect applying process in the first effect applying step;
A second effect applying step of applying an acoustic effect applying process based on the extracted system effect control data to the mixed music material data;
A music material processing method comprising: a music sound output step of outputting the music material data subjected to the sound effect applying process in the second effect applying step as a musical sound. The music material processing method according to claim 1,
The piece file development process includes:
Each of the material identifiers stored in each track in the connect file development step is processed, and it is sequentially determined whether or not there is a piece file including the material identifiers in the piece file storage means, and the material that has been processed If it is determined that there is a piece file including the identifier, the audio material data included in the piece file is stored in the track in place of the material identifier to be processed, and there is no piece file including the material identifier to be processed. Each time a determination is made, a connect file including the material identifier of the processing target is read from the connect file storage means, and one or more columns of material identifiers represented by the material composition management data included in the read connect file are processed. Recursively repeat the process of storing in the track instead of the material identifier of The music material processing method comprising the step of replacing all of the material identifier stored in each track in the connect file expansion process to the music material data. The music material processing method according to claim 1 or 2,
A sound to be given to a new music material obtained by selecting a plurality of music materials to be played continuously or in parallel for a certain length of time according to the operation of the operation element and collecting the selected music materials. A music material composition instruction step for inputting an effect according to the operation of the operation element;
A management data generation step of generating material composition management data representing the material identifiers of the selected plurality of music materials as one or a plurality of columns;
A message output step for outputting a message for inquiring whether or not music material is generated;
After outputting the message, when the music music material generation instruction is not input according to the operation of the operation element, the material identifier unique to the synthetic music material obtained by collecting the plurality of selected music materials and the input Insertion effect control data representing the generated acoustic effect, and a new connect file including the material identifier and insertion effect control data and the material composition management data generated in the management data generation step While storing in the file storage means, when a music music material generation instruction is input in accordance with the operation of the operation element, the material identifier unique to the music music material obtained by collecting the plurality of selected music materials and the input System effect control data representing the generated sound effect and identifying the material And music material processing method further has a new file storage step of storing a new list file including the Material Synthetic management data generated by the management data generating step and the system effect control data to the list file storage unit. The music material processing method according to any one of claims 1 to 3,
Inputting a music material audio signal via a predetermined signal input device;
A step of generating a unique material identifier for the music material data representing the input audio signal, and storing a new piece file including the generated material identifier and the music material data in the piece file storage means. Music material processing method. Piece file storage means for storing piece files each including music material data representing an audio signal of the music material and a material identifier of the music material;
The material identifier of the synthetic music material, which is the music material obtained by combining the music materials to be played continuously or in parallel for the length of time corresponding to a part of the performance of the ensemble, and the performance contents of the synthetic music material Is expressed as one or a plurality of columns composed of material identifiers of music materials to be played in succession or in parallel, and insertion effect control data representing sound effects to be given to the synthesized music materials Connect file storage means for storing each connect file including
The material identifier of the music material that is the music material obtained by combining the music materials to be performed continuously or in parallel during the length of time corresponding to the entire performance section of the ensemble, and the performance contents of the music material , Material composition management data represented as one or a plurality of columns composed of material identifiers of the music materials to be played continuously or in parallel, and system effect control data representing the acoustic effect to be given to the music material List file storage means for storing each list file included,
An operator,
A track buffer having a plurality of tracks for storing data strings;
Reproduction target selection means for selecting music music material to be reproduced according to the operation of the operation element;
A list file including material identifiers of the music material selected by the reproduction target selection unit is read from the list file storage unit, and each column of material identifiers represented by the material composition management data included in the list file is stored in the track buffer. List file expansion means for storing each track and extracting system effect control data from the list file;
The connect file containing the material identifier stored in each track by the list file developing means is read from the connect file storing means, and each column of material identifiers represented by the material composition management data included in the connect file is expanded in the list file. Connect file expansion means for storing in each track instead of each material identifier stored by the means, and extracting insertion effect control data from the connect file;
Each piece file containing the material identifier stored in each track by the connect file development means is read out from the piece file storage means, and each of the material identifiers stored in the piece file is stored in the piece file storage means. Piece file expansion means for storing in each track instead of,
First effect applying means for applying the sound effect applying process based on the extracted insertion effect control data to the music material data stored in each track by the piece file developing means;
Mixing means for mixing the music material data of each track on which the first effect applying means has been subjected to the sound effect applying process;
A second effect applying means for applying the sound effect applying process based on the extracted system effect control data to the mixed music material data;
A music material processing system comprising: a music sound output means for outputting the music material data subjected to the sound effect applying process by the second effect applying means as a music sound.

Images