JP4670540B2 - Music material editing method, material editing method and music material editing system - Google Patents

Description

  The present invention relates to a music material editing method.

In the scene of creating a ensemble that handles audio signals of a large number of instrument parts, an audio signal editing technique called “overdubbing” is often used.
In overdubbing, an audio signal of one channel (instrument part) is recorded on each track of the recorder and characteristics such as volume level and frequency are appropriately changed, and then the audio signal of one track is converted to the audio signal of the other track. Mix audio signals. Thereby, a part of the tracks of the recorder is secured as an empty track capable of recording a new audio signal. By repeating the reservation of empty tracks and recording of audio signals by mixing, audio signals with the number of channels exceeding the limited number of tracks of the recorder can be combined into one audio signal (for example, “Patent” Reference 1 ”).
JP-A-11-327550

However, when editing audio signals using overdubbing, once the audio signals of multiple instrument parts are combined, it is no longer possible to individually modify the audio signal content of each original instrument part. There is a problem that the degree of freedom of editing is lost because it becomes impossible.
The present invention has been devised under such a background, and even after synthesizing audio signals of a plurality of instrument parts, the contents of the audio signals of the instrument parts can be individually modified retrospectively. The purpose is to provide a simple mechanism.

A music material editing method according to a preferred embodiment of the present invention stores each piece file including a material identifier of a music material and music material data representing an audio signal of the music material, and mixes a plurality of music materials. Each connect file that includes a material identifier of a mixing music material that is a music material obtained by performing the above and a material composition management data that is a collection of material identifiers of a plurality of music materials mixed to obtain the mixing music material A music material editing method using a system comprising a storage means for storing and an operator for selecting a material identifier of an arbitrary file stored in the storage means, and a plurality of music materials to be mixed In the mixing target selection step and the mixing target selection step A material identifier unique to the mixing music material obtained by mixing the plurality of selected music materials and material composition management data that is a collection of the material identifiers of the plurality of music materials are generated, and the generated material identifier and material composition A mixing music material accumulating step for storing a new connect file including management data in the storage means, a mixing music material reproduction instruction step for selecting a mixing music material to be reproduced according to an operation of the operator, and A connect file including the material identifier of the mixing music material selected in the mixing music material reproduction instruction step is read from the storage means and associated with each of a series of material identifiers represented by the material composition management data included in the read connect file. Reading the piece file stored in the storage means Has a step, it mixes the audio signals each representing the music material data contained in the piece file read by the reading step and a mixed signal output step of outputting the audio signal obtained by mixing the reading step Determines whether there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file, and corresponds to the piece file. When there is a material identifier that is not attached, a connect file including a material identifier that is not associated with a piece file is specified from the storage unit, while being stored in association with the remaining material identifiers excluding the material identifier. Reading the piece file stored in the means and the specified connect file A file is read from the storage means, and it is further determined whether or not there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file. Each time it is determined that there is a material identifier that is not associated with the piece file, a connection file including the material identifier is recursively specified from the storage means .

  In this aspect, a new piece file including a material identifier unique to the mixing music material generated in the mixing music material storage step and music material data representing the audio signal obtained in the mixing signal output step is provided. You may further have the process memorize | stored in the said memory | storage means.

  The storage means includes a material identifier of a connected music material that is a music material obtained by connecting a plurality of music materials along a time axis, and a plurality of music material materials connected to obtain the connected music material. A piece file including material composition management data that is a collection of identifiers is stored, a connection target selection step for selecting a plurality of music materials to be connected in accordance with the operation of the operator, and the connection target selection A material identifier generated by connecting a plurality of music materials selected in the process, and a material composition management data that is a collection of material identifiers of the plurality of music materials, and the generated material identifier And a connected music material storing step for storing a new connect file including the material composition management data in the storage means, and connected music to be reproduced. A connected music material reproduction instruction step for selecting a material in accordance with the operation of the operator, and a connect file including the material identifier of the connected music material selected in the connected music material reproduction instruction step is read from the storage means, and the read connect file A reading step of reading a piece file stored in the storage means in association with each of a series of material identifiers represented by the material composition management data included in the music composition data, and music material data included in the piece file read in the reading step It may further include a connection signal output step of connecting the audio signals represented by each and outputting an audio signal obtained by the connection.

  Further, a new piece file including a material identifier unique to the connected music material generated in the connected music material storage step and music material data representing the audio signal obtained in the connected signal output step is stored in the memory. You may have the process memorize | stored in a means.

  The material composition management data included in the connect file may be sequence data in which material identifiers of a plurality of music materials to be connected, mixed, or both are divided into a plurality of tracks.

  Also, the step of inputting an audio signal of music material via a predetermined signal input device, generating music material data representing the input audio signal and a unique material identifier, and generating the generated music material data and material identifier Storing the new piece file included in the storage means.

The material editing method according to another preferred embodiment of the present invention is a material obtained by mixing a plurality of materials while storing each piece file including a material identifier of the material and material data of the material. Storage means for storing each connect file including a material identifier of a certain mixing material and material composition management data that is a collection of material identifiers of a plurality of materials mixed to obtain the mixing material; and storing in the storage means A material editing method using a system including an operation element for selecting a material identifier of a given arbitrary file, wherein a plurality of materials to be mixed are selected according to the operation of the operation element. And a mix obtained by mixing a plurality of materials selected in the mixing target selection step. A material identifier unique to the group material and material composition management data that is a collection of material identifiers of the plurality of materials, and a new connect file including the generated material identifier and material composition management data is stored in the storage means. Connected file including a mixing material storage step to be stored, a mixing material reproduction instruction step for selecting a mixing material to be reproduced according to the operation of the operation element, and a material identifier of the mixing material selected in the mixing material reproduction instruction step Read out from the storage means, read out the piece file stored in the storage means in association with each of a series of material identifiers represented by the material composition management data included in the read connect file, and in the reading step Mix the material data contained in the read piece file and mix And a mixing output step of outputting the material data obtained by grayed, the reading step, piece by said storage means into a series of material identifier for the material synthesized management data included in the read-connect file It is determined whether or not there is a material identifier that is not associated with a file, and when there is a material identifier that is not associated with a piece file, a connection file that includes a material identifier that is not associated with a piece file is stored in the storage unit. While reading the piece file stored in the storage means in association with the remaining material identifiers excluding the material identifier, and reading the specified connect file from the storage means. The storage means includes a series of material identifiers represented by the included material composition management data. Each time it is determined whether there is a material identifier that is not associated with the piece file, and each time it is determined that there is a material identifier that is not associated with the piece file, the storage unit stores the connect file including the material identifier. And recursively specifying the process .

A music material editing system according to another preferred embodiment of the present invention stores each piece file including a material identifier of a music material and music material data representing an audio signal of the music material, and stores a plurality of music materials. Each connect file including a material identifier of a mixing music material that is a music material obtained by mixing and material composition management data that is a collection of material identifiers of a plurality of music materials mixed to obtain the mixing music material A storage means for storing, an operator for selecting a material identifier of an arbitrary file stored in the storage means, and a mixing target selection for selecting a plurality of music materials to be mixed according to the operation of the operator And a plurality of music materials selected by the mixing target selection means The material composition management data, which is a collection of material identifiers unique to the mixing music material obtained and the material identifiers of the plurality of music materials, is generated, and a new connect file including the generated material identifier and material composition management data Is stored in the storage means, mixed music material reproduction instructing means for selecting a mixing music material to be reproduced in accordance with the operation of the operation element, and the mixing selected by the mixing music material reproduction instructing means A connect file including a material identifier of music material is read from the storage means, and a piece file stored in the storage means is read in association with each of a series of material identifiers represented by the material composition management data included in the read piece file. Read means and a piece file read by the read means Mixes the audio signal represented by each of Murrell music material data, and a mixed signal output means for outputting the audio signal obtained by mixing, the reading means, Material Synthetic management data included in the read-connect file It is determined whether or not there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by and when there is a material identifier that is not associated with the piece file, it corresponds to the piece file. Means for reading out a piece file stored in the storage means in association with the remaining material identifiers excluding the material identifier, while specifying a connect file including a material identifier not attached from the storage means; Read the connected file from the storage means, It is further determined whether or not there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the file, and the material that is not associated with the piece file Means for recursively identifying a connect file including the material identifier from the storage means each time it is determined that there is an identifier .

  According to the present invention, even after the audio signals of a plurality of instrument parts are synthesized, the contents of the audio signals of each instrument part can be retrospectively edited.

(First embodiment)
A first embodiment of the present invention will be described.
The present embodiment is characterized by providing the following two services to a person who creates an ensemble composed of a plurality of instrument parts (hereinafter simply referred to as “creator”).
(1) Music material recording service This service is a relatively short phrase music that will frequently appear in each instrument part of the ensemble created by the creator (hereinafter referred to as "music material"). This is a service that records audio signals in advance using various musical instruments and creates individual data files.
(2) Music material editing service A service for synthesizing an audio signal of an ensemble by connecting and mixing music materials that have been individually converted into data files according to the editing operation of the creator.

  FIG. 1 is a block diagram showing the overall configuration of the music material editing system according to the present embodiment. In this system, a music material management server device 10 and a terminal device 20 are connected via a network 30. Although only one terminal device 20 is shown in the figure, a plurality of terminal devices 20 may be provided. As shown in the figure, the music material management server device 10 includes a CPU 11 that performs various controls, a RAM 12 that provides a work area to the CPU 11, a ROM 13 that stores an IPL (Initial Program Loader), a communication interface 14, a hard disk 15, and the like.

The hard disk 15 stores a music material database 15a and a music material management program 15b.
The music material database 15a is an aggregate of a plurality of records each corresponding to one music material. One record constituting the database 15a has three fields of “material identifier”, “piece file”, and “connect file”. The “material identifier” field stores a material ID that is an identifier for uniquely identifying each music material. Also, a piece file is stored in the “piece file” field, and a connect file is stored in the “connect file” field. Here, an outline of the piece file and the connect file stored in both of these fields will be given.

As shown in FIG. 2A, the piece file includes music material data, reproduction time length data, material ID, and user ID. The music material data is data representing a code string obtained by encoding an audio signal of music material. The playback time length data is data representing the playback time length of the music material, such as “1 bar”, “1/2 bar”, “1/4 bar”, “2 bar”, etc. The reproduction time length of the music material is represented by a relative value based on the length. The material ID is an identifier for identifying the music material, and its content matches the ID stored in the “material identifier” field. The user ID is an identifier for identifying the creator of the music material.
As shown in FIG. 2B, the connect file includes material composition management data, reproduction time length data, material ID, and user ID. Since the contents of the reproduction time length data, material ID, and user ID are the same as those of the piece file, description thereof will be omitted. The material composition management data is sequence data representing an array of material IDs.
The piece file and the connect file are generated in response to a request from the terminal device 20 using the music material recording service and the music material editing service shown at the beginning. Details of the generation procedure will be described later in the description of the operation. explain.

In FIG. 1, the terminal device 20 includes a CPU 21, a RAM 22, a ROM 23, a mouse 24 as an operator, a computer display 25, a communication interface 26, an audio interface 27, a speaker 28, a hard disk 29, and the like.
The hard disk 29 stores a music material editing program 29a. This program is a program that gives the CPU 21 the functions characteristic of this embodiment.

Next, the operation of this embodiment will be described.
The operation of this embodiment can be roughly divided into music material recording processing and music material editing processing. When the creator activates his / her terminal device 20, the CPU 21 displays a main menu screen on the computer display 25. In the upper part of this screen, the text string “Please select the service you want to use” is displayed, and below that, buttons labeled “Music material recording service” and “Music material editing service” are displayed. Is done. When the “music material recording service” button is selected, the music material recording process is executed, and when the “music material editing service” button is selected, the music material editing process is executed.

FIG. 3 is a flowchart showing the music material recording process.
When the button labeled “Music material recording service” on the main menu screen is selected, the CPU 21 of the terminal device 20 displays a user ID input screen on the computer display 25 (S100). A character string “Please enter user ID” is displayed in the upper part of the user ID input screen, and a user ID input field is displayed below it. The creator who refers to this screen inputs his user ID in the input field.
When the user ID is input, the CPU 21 of the terminal device 20 stores the user ID in the RAM 22 and then transmits a message requesting the provision of the music material recording service to the music material management server device 10 (S110).

CPU11 of the music material management server apparatus 10 which received the message transmits the display data of a material input request screen to the terminal device 20 (S120).
The CPU 21 of the terminal device 20 that has received the display data displays a material input request screen on the computer display 25 (S130). In the upper part of this screen, a character string “Please input audio signal of music material” is displayed.
The performer who refers to the screen connects the musical instrument responsible for one of the musical instrument parts of the ensemble to be created to the audio interface 27 of the terminal device 20. Then, the music material that will appear in the ensemble that he creates is played using the instrument.
The CPU 21 of the terminal device 20 stores the audio signal supplied from the musical instrument via the audio interface 27 in the RAM 22 (S140).

When the supply of the audio signal is stopped, the CPU 21 measures the reproduction time length of the audio signal stored in the RAM 22, generates reproduction time length data representing the reproduction time length, and stores it in the RAM 22 (S150). For example, if the measured playback time length is one bar length, playback time length data representing “1 bar” is generated, and if the measured playback time length is 1/2 bar, the playback time length representing “1/2 bar” is generated. Data will be generated.
Subsequently, the CPU 21 transmits the music material data obtained by encoding the audio signal stored in the RAM 22, the reproduction time length data generated in step 150, and its own user ID to the music material management server device 10. (S160).

The CPU 11 of the music material management server device 10 stores the music material data, the playback time length data, and the user ID received from the terminal device 20 in the RAM 12 (S170).
The CPU 11 generates a new material ID (S180).
The CPU 11 generates a new piece file including the music material data, playback time length data, and user ID stored in the RAM 12 and the material ID generated in step 180 (S190).
Subsequently, the CPU 11 adds a new record to the music material database 15a (S200).

The CPU 11 stores the material ID generated in step 180 in the “material identifier” field of the record added in step 200, and stores the piece file generated in step 190 in the “piece file” field of the record. (S210). Further, “Null” data is stored in the “Connect File” field of the record added in Step 200 (S220). In the music material editing process to be described later, a newly generated connect file is stored in the “connect file” field, while “Null” data is stored in the “piece file” field. Become.
The CPU 11 transmits display data of a recording completion notification screen obtained by embedding the material ID generated in step 180 in a predetermined template to the terminal device 20 (S230).
The CPU 21 of the terminal device 20 that has received the display data from the music material management server device 10 displays a recording completion notification screen on the computer display 25 (S240). In the upper part of the recording completion notification screen, a character string with the content “The recording of the new music material has been completed. The material ID of the recorded music material is as follows.” Is displayed. An ID is displayed. At the bottom of the screen, buttons labeled “Record another music material” and “Return to main menu” are displayed. The creator who understands the material ID of the newly recorded music material by referring to this screen selects any button.

When the “Register another music material” button is selected, the process returns to step 130, and the CPU 21 displays a material input request screen on the computer display 25.
When the “return to main menu” button is selected, the CPU 21 displays the main menu screen on the computer display 25 again.
The creator sequentially records the musical material for each musical instrument part, which will appear in the ensemble that he creates, while switching the musical instruments connected to the audio interface 27 as appropriate. For example, if you intend to create an ensemble composed of four instrument parts: drum, bass, keyboard, and guitar, then record sequentially while switching those four instruments. As a result, the piece file including the music material data of the drum, bass, keyboard, and guitar audio signals is accumulated in the music material database 15 a of the music material management server device 10.

4 and 5 are flowcharts showing the music material editing process.
When the button labeled “Music material editing service” on the main menu screen is selected, the CPU 21 of the terminal device 20 displays a user ID input screen on the computer display 25 (S300). The creator who refers to this screen inputs his user ID in the input field.
When the user ID is input, the CPU 21 of the terminal device 20 stores the user ID in the RAM 22 and then transmits a message requesting provision of the music material editing service to the music material management server device 10 (S310).
The CPU 11 of the music material management server apparatus 10 that has received the message reads all material IDs stored in the “material identifier” field of each record of the music material database 15a into the RAM 12 (S320).
The CPU 11 transmits display data of an editing screen obtained by embedding the material ID read in step 320 in a predetermined template to the terminal device 20 (S330).

The CPU 21 of the terminal device 20 that has received the display data displays an editing screen on the computer display 25 (S340).
FIG. 6 is an editing screen.
A music material presentation field 50 is provided in the upper part of the editing screen, and a music material composition field 60 is provided in the lower part of the screen. In the music material presentation column 50, all material IDs read in step 320 are displayed as a list. In addition, a scroll bar 51 for moving the display range of the material ID up and down is provided at the right end of the presentation column. The music material composition column 60 has two tracks, a first track 61 and a second track 62. Each of these tracks is input with a bar containing the material ID of the music material selected from the music material presentation column 50 in accordance with the operation of the creator (hereinafter, this bar is referred to as “material ID bar”). It has become. In addition, a scroll bar 63 for moving the display range of the track to the left and right is provided at the lower end of the music material composition field 60. Further, on the right side of the music material composition column 60, buttons labeled “composite” and “play” are displayed.

When the editing screen is displayed, the creator places the mouse pointer on an arbitrary material ID in the music material presentation field 50 of the editing screen and drags the left button of the mouse 24 to move the mouse pointer to the music material composition field 60. Move to the track and drop.
When this drag and drop operation is performed, the CPU 21 of the terminal device 20 transmits the material ID selected by dragging to the music material management server device 10 (S350).

The CPU 11 of the music material management server apparatus 10 that has received the material ID specifies a record in which the material ID is stored in the “material identifier” field from the music material database 15a (S360).
The CPU 11 extracts the reproduction time length data included in the file stored in the “connect file” field of the record identified in step 360. If the reproduction time length data is not stored, the CPU 11 further extracts “piece file”. The reproduction time length data included in the file stored in the field is extracted, and the reproduction time length data is transmitted to the terminal device 20 (S370).
The CPU 21 of the terminal device 20 stores the reproduction time length data received from the music material management server device 10 in the RAM 22 (S380). Then, a material ID bar having a width corresponding to the time length indicated by the reproduction time length data is displayed at a position on the track where the material ID is dropped (S390).
Each time the creator performs a drag-and-drop operation, a series of processing from step 350 to step 390 is repeated, and new material ID bars are sequentially formed on the tracks in the music material composition column 60.

FIG. 7 is an example of a drag and drop operation by the creator and a material ID bar formed in the track in accordance with the operation. In this figure, in the first drag-and-drop operation, the material ID “A” dragged in the music material presentation column 50 is dropped at the top position of the first track 61, which corresponds to the length of 1/2 bar. A material ID bar “A” having a horizontal width is formed on the first track 61. Furthermore, in the second drag-and-drop operation, the material ID “B” dragged in the music material presentation column 50 is dropped at the position immediately to the right of the material ID bar “A”, which corresponds to the length of 1/2 bar. A material ID bar “B” having a horizontal width is formed on the right side of the material ID bar “A”. In the third drag-and-drop operation, the material ID “C” dragged in the music material presentation column 50 is dropped at the top position of the second track 62, resulting in a material having a width corresponding to the length of one measure. An ID bar “C” is formed on the second track 62. In the following description, the material IDs of the music materials to be continuously played are arranged on the same track in the music material composition column 60 as in the relationship between the material ID bar “A” and the material ID bar “B” in FIG. The drag-and-drop operation is called “concatenated editing operation”, and the material ID of the music material to be played back at the same time as the relationship between the material ID bars “A” and “B” and the material ID bar “C” is the music material A drag-and-drop operation for juxtaposition on separate tracks in the synthesis column 60 is referred to as a “mixing editing operation”.
The creator uses the linked editing operation and the mixing editing operation to form an array of material ID bars for a desired length of time (for example, one bar) on one or both tracks in the music material composition column 60, and then performs the same composition. Select the button labeled “Composite” or the button labeled “Play” on the left side of the column.
In FIG. 4, when the “playback” button is selected, a playback process described later is executed as a subroutine.

When the “composite” button is selected, the CPU 21 of the terminal device 20 generates material composition management data by converting the array of material IDs formed on each track in the music material composition field 60 into sequence data (S400).
Subsequently, the CPU 21 generates reproduction time length data representing the total reproduction time length of the music material corresponding to the series of material IDs formed on the track in the music material composition column 60 and stores it in the RAM 22 (S410).
The CPU 21 transmits the material composition management data generated in step 400, the reproduction time length data generated in step 410, and its own user ID to the music material management server device 10 (S420).
The CPU 11 of the music material management server device 10 stores the material composition management data, playback time length data, and user ID received from the terminal device 20 in the RAM 12 (S430).

The CPU 11 generates a new material ID (S440).
The CPU 11 generates a new connect file including the material composition management data, the reproduction time length data, and the user ID stored in the RAM 12 (S450).
Subsequently, the CPU 11 adds a new record to the music material database 15a (S460).

The CPU 11 stores the material ID generated in step 440 in the “material identifier” field of the record added in step 460, and stores the connect file generated in step 450 in the “connect file” field of the record. (S470). Further, “Null” data is stored in the “piece file” field of the record added in step 460 (S480).
The CPU 11 transmits the material ID generated in step 440 to the terminal device 20 (S490).
The CPU 21 of the terminal device 20 that has received the material ID adds the material ID to the music material presentation column 50 on the editing screen for display, and deletes the material ID bar displayed on both tracks in the music material composition column 60. (S500).
The processing described above will be further described in detail with reference to a specific example.

FIG. 8 is a diagram illustrating an example of an operation via the editing screen.
The explanation here is a piece file of music material “A” and “B” obtained by recording an audio signal of 1/4 bar of a drum, and an audio signal of 1/4 bar of a guitar. Pieces of music material of “F” and “G” obtained by recording piece files of music materials of “C”, “D”, “E” and audio signals corresponding to 1/2 bars of the bus. It is assumed that the piece file of the music material “H” obtained by recording the audio signal for the two bars of the file and the keyboard is stored in the music material database 15a through the music material recording process.
Referring to the figure, in the first operation (concatenated editing operation), the creator sets the material ID bars of “A” and “B”, which are music materials recorded from the drum, to “A” → “A” → “A”. The “composite” button is selected after the first track 61 is formed in the order of “→ B”. As a result, a connect file including the material composition management data in which the material ID is arranged in one row with “AAAB” is newly generated and stored in the music material database 15a in association with the material ID “I”.
In the second operation (concatenated editing operation), the creator sets the material ID bars of “C” and “D”, which are music materials recorded from the guitar, to “C” → “C” → “C” → “D”. The “synthesize” button is selected after the first track 61 is formed in this order. As a result, a connect file including the material composition management data in which the material ID is aligned with “CCCD” in one column is newly generated and stored in the music material database 15a in association with the material ID “J”.

In the third operation (concatenated editing operation), the creator sets the material ID bar of “C” and “E”, which are music materials recorded from the guitar, to “C” → “C” → “C” → “E”. The “synthesize” button is selected after the first track 61 is formed in this order. As a result, a connect file including the material composition management data in which the material IDs are arranged in a row with the material ID “CCCE” is newly generated and stored in the music material database 15a in association with the material ID “K”.
In the fourth operation (concatenated editing operation and mixing editing operation), the creator sets the material ID bar of “I”, which is the music material obtained by synthesizing the music material of the drum, in the order “I” → “I”. In the first track 61, the material ID bars of the music materials “F” and “G” recorded from the bus are displayed in the order of “F” → “F” → “F” → “G”. The “composite” button is selected after forming in 62. As a result, a connect file including the material composition management data in which the material IDs are arranged in two columns “II” and “FFFG” is newly generated and stored in the music material database 15a in association with the material ID “L”. .

In the fifth operation (mixing editing operation), the creator forms the material ID bar of “H”, which is music material recorded from the keyboard, on the first track 61, and synthesizes the music material of the drum and bass. After the material ID bar of “L”, which is the music material, is formed on the second track 62, the “composite” button is selected. As a result, a connect file including the material composition management data in which the material IDs are arranged in two rows of “H” and “L” is newly generated and stored in the music material database 15a in association with the material ID “M”. .
In the sixth operation (mixing editing operation), the creator causes the first track 61 to form a material ID bar of “M”, which is a music material obtained by synthesizing the music material of the keyboard, drum, and bass, “J” and “K” material ID bars, which are music materials obtained by synthesizing the music material of the guitar, are formed on the second track 62 in the order of “J” → “K”, and then the “synthesize” button Is selected. As a result, a connect file including material composition management data in which material IDs are arranged in two columns of “M” and “JK” is newly generated and stored in the music material database 15a in association with the material ID “N”. .
Through the above six operations, the performance contents of two measures of an ensemble having four instrument parts, keyboard, drum, bass, and guitar, are collected as one connect file “N”.

FIG. 9 is a flowchart showing the reproduction process. This process is executed as a subroutine of the music material editing process.
When the “play” button on the editing screen displayed in step 340 is selected, the CPU 21 of the terminal device 20 performs material composition management indicating the arrangement of the material IDs input in the music material composition field 60 on the screen. Data is generated, and the generated material composition management data and its own user ID are transmitted to the music material management server device 10 (S600).
The CPU 11 of the music material management server apparatus 10 that has received the material composition management data and the user ID stores the user ID in the RAM 12 and secures a multitrack sequence area in a part of the RAM 12 (S610). This multi-track sequence area is a buffer having first to fourth four tracks.

The CPU 11 writes the array of material IDs indicated by the material composition management data into one of the tracks in the multitrack sequence area (S620). Here, when the material composition management data transmitted from the music material management server device 10 represents only one array of material IDs, the array is written in the first track of the multi-track sequence area. When two arrays are represented, these arrays are written in the first track and the second track in the same area.
The CPU 11 specifies one of the series of material IDs written in the multitrack sequence area in step 620 as a processing target (S630).
Subsequently, the record in which the “material identifier” field matches the material ID identified in step 630 is identified from the records stored in the music material database 15a (S64).
0).

The CPU 11 determines whether or not a piece file is stored in the “piece file” field of the record identified in step 640 (S650). If “Null” is not stored in the “Piece file” field, the determination result of this step is “Yes”. If “Null” is stored, the determination result of this step is “No”. become.
The CPU 11 that has determined that the piece file is stored in step 650 reads out the music material data included in the piece file and replaces it with the material ID specified in step 630 (S660).
CPU11 which performed step 660 returns to step 630, and performs subsequent processing by making another material ID into a processing target.

The CPU 11 that has determined that the piece file is not stored in step 650 reads the material composition management data included in the connect file in the “connect file” field of the record specified in step 640 (S670).
The CPU 11 determines whether the material composition management data read in step 670 represents one array of material IDs or two arrays (S680).
The CPU 11, which has determined that the material composition management data represents one array of material IDs in step 680, replaces the array with the material ID specified in step 630 (S690). That is, the arrangement of the material IDs of a plurality of music materials that are concatenated and edited to obtain the music material is restored from the material ID of one music material specified as the processing target.

The CPU 11 that has determined that the material composition management data represents two arrays of material IDs in step 680 replaces one of the arrays with the material ID specified in step 630 and writes the other array in the material ID yet. Is written to a track in the multi-track sequence area (hereinafter referred to as an “empty track”) (S700). That is, the arrangement of the material IDs of a plurality of music materials mixed and edited to obtain the music material is restored from the material ID of the specified music material to be processed.
CPU11 which performed step 690 or step 700 judges whether all the material IDs written in each track of the multitrack sequence area have been replaced with music material data (S710).

In step 710, the CPU 11 that has determined that a part of the material ID has not been replaced with the music material data, returns to step 630, specifies the material ID as a processing target, and executes the subsequent processing.
In step 710, the CPU 11 that has determined that all the material IDs have been replaced with the music material data identifies one of the tracks in the multi-track sequence area in which the music material data is written as a processing target (S 720).
The CPU 11 replaces one or a plurality of music material data written in the track specified in step 720 with an audio signal obtained by decoding the music material data (S730).
CPU11 which performed step 730 judges whether all the music material data written in the track | truck were replaced with the audio signal (S740).

In step 740, the CPU 11 that has determined that the music material data written in some of the tracks has not been replaced with the audio signal returns to step 720 and executes the subsequent processing after setting that track as the processing target.
In step 740, the CPU 11, which has determined that all the music material data written in the track has been replaced with the audio signal, mixes the audio signal written in the track other than the first track into the first track (S750). .
The CPU 11 measures the reproduction time length of the audio signal mixed in the first track, generates reproduction time length data representing the reproduction time length, and stores it in the RAM 12 (S760).

The CPU 11 generates a new material ID (S770).
The CPU 11 stores the music material data obtained by encoding the audio signal mixed into the first track, the playback time length data generated in step 760, the material ID generated in step 770, and the user ID stored in the RAM 12 in step 610. A new piece file including is generated (S780).
Subsequently, the CPU 11 adds a new record to the music material database 15a (S790).
The CPU 11 stores the material ID generated in step 770 in the “material identifier” field of the record added in step 790, and stores the piece file generated in step 780 in the “piece file” field of the record. (S800). The CPU 11 stores “Null” data in the “Connect File” field of the record added in Step 790 (S810).

CPU11 transmits the piece file produced | generated by step 780 to the terminal device 20 (S820).
The CPU 21 of the terminal device 20 that has received the piece file stores the piece file in the RAM 22 (S830).
The CPU 21 adds the material ID included in the piece file of the RAM 22 to the music material presentation field 50 on the editing screen and displays it, and also transmits the audio signal obtained by decoding the music material data included in the piece file to the speaker 28. Supply (S840). Thereby, the musical sound of the ensemble is emitted from the speaker 28.

The processing described above will be further described in detail with reference to a specific example.
11 and 12 are diagrams showing the transition of the state of the multi-track sequence area from when the material composition management data is transmitted to the music material management server device 10 until a new piece file is obtained.
In the description here, the “play” button is selected when the fifth operation (mixing editing operation) shown in FIG. 8 is performed, and the material IDs “H” and “L” are arranged in two rows. This is performed assuming that the material composition management data is transmitted to the music material management server device 10 .

Referring to FIG. 11, in step 620 that comes immediately after the multi-track sequence area is secured in the RAM 12, the material ID “H” is assigned to the first track of the sequence area, and the material ID “L” is assigned to the second track. Written (state 1).
Thereafter, the processing after step 630 is executed with the material IDs “H” and “L” as processing targets. However, since the material ID “H” has a corresponding piece file, the processing in step 650 is performed. The determination result is “YES”, and the music material data h included in the piece file is replaced at step 660 (state 2).

On the other hand, since the material ID “L” does not have a corresponding piece file, the determination result in step 650 is “NO”, and the loop after step 670 is repeated until the corresponding piece file is found. The state in which each loop is executed will be described in detail. First, the material ID “L” of the second track is replaced with the material ID “II”, and the material ID “FFFG” is written in the third track which is an empty track. (State 3).
Further, the material ID “I” of the second track is replaced with the material ID “AAAB” (state 4).

And finally, write in the order of "aaabaaab" music material data b piece file corresponding to the music material data a and the material ID "B" piece file corresponding to the material ID "A" is the second track is written, also, the music material data g piece file corresponding to the music material data f and the material ID, "G" piece file corresponding to the material ID "F" is written in the order of "fffg" the third track (State 5).
When all the material IDs are replaced with the music material data, the music material data is replaced with the encoded audio signal at step 720 to step 740 (state 6), and further at step 750, the audio signals of all the tracks are replaced. Are mixed into the first track (state 7).

Then, a 1-channel audio signal mixed into the first track is transmitted to the terminal device 20 as music material data of a piece file, and musical sounds for three tracks are emitted from the speaker 28 of the same device 20 at the same time. become.
According to this embodiment described above, the creator converts the audio signal of the music material that will appear repeatedly in each part of the chorus he creates, into piece files, and concatenates the material IDs assigned to the piece files. By combining the editing operation and the mixing editing operation, it is possible to easily create an ensemble having a plurality of instrument parts.

(Second Embodiment)
In the present embodiment, a replacement editing operation and an editing history retrospective operation can be performed through the editing screen in addition to the linked editing operation and the mixing editing operation. The replacement editing operation is an operation of replacing an arbitrary material ID dragged in the music material presentation column 50 by dropping the material ID on the material ID bar formed on the track in the music material composition column 60. The editing history retroactive operation is performed by placing the mouse pointer on the material ID bar formed on the track in the music material composition column 60 and double-clicking the right button of the mouse 24 to make the material ID bar smaller. This is an operation for conversion to a collection of material ID bars for music material.
The hardware configuration of the music material editing system according to this embodiment is the same as that of the first embodiment.

In this embodiment, the characteristic processing shown in FIG. 13 is executed as a subroutine for music material editing processing. The process shown in FIG. 13 is started when an editing history retroactive operation is performed in a state where at least one material ID bar is input to the track in the music material composition column 60.
When one of the track material IDs is double-clicked by the editing history retroactive operation, the CPU 21 of the terminal device 20 transmits the material ID to the music material management server device 10 (S900).
The CPU 11 of the music material management server device 10 that has received the material ID specifies a record in which the material ID is stored in the “material identifier” field from the music material database 15a (S910).

CPU11 may connect file to determine whether it is stored in the field "Connect file" record specified in step 910 (S920). If “Null” is not stored in the “Connect file” field, the determination result of this step is “Yes”. If “Null” is stored, the determination result of this step is “No”. become.
The CPU 11 that has determined that the connect file is not stored in step 920 transmits a message indicating that the editing history cannot be retroactively transmitted to the terminal device 20 (S930). When the terminal device 20 receives this message, the process ends.

The CPU 11 that determines that the connect file is stored in step 920 reads the connect file and transmits it to the terminal device 20 (S940).
The CPU 21 of the terminal device 20 that has received the connect file stores the connect file in the RAM 22 (S950).
Subsequently, the CPU 21 replaces the material ID bar of the series of material IDs represented by the material composition management data included in the connect file stored in the RAM 22 with the material ID bar double-clicked by the editing history retroactive operation, and the music material composition column 60. (S960).

When the “composite” button on the edit screen is selected after the material ID has been replaced, the processing after step 400 in FIG. 4 is executed, and a new connection including the material composition management data of the material ID after replacement is performed. When the “play” button is selected while the file is stored in the music material database 15a , the processing from step 600 in FIG. 9 is executed, and the audio is recorded in accordance with the material ID array indicated by the material composition management data after replacement. A new piece file including music material data obtained by connecting and mixing signals is accumulated in the music material database 15a and emitted from the speaker 28.

The processing described above will be further described in detail with reference to a specific example.
FIG. 14 is a diagram illustrating an example of an operation via the editing screen.
In the description here, the material ID bar of the material ID “L”, which is the music material obtained by the fourth operation (concatenated editing operation and mixing editing operation) in FIG. This is performed assuming that the track 61 is formed.
Referring to the figure, in the first operation (edit history retroactive operation), the creator moves the mouse pointer over the “L” material ID bar input to the first track 61 of the music material composition column 60. And double-click the right button. As a result, two “I” material ID bars are formed on the first track 61 of the music material composition column 60 in place of the “L” material bar, and “F” material ID bars are formed on the second track 62. Three and “G” material ID bars are formed.

In the second operation (replacement editing operation), the creator drops the material ID “F” dragged in the music material composition column 60 (not shown) on the material ID bar “G” of the second track 62. The “Combine” button is selected. As a result, a connect file including the material composition management data in which the material IDs are arranged in two columns of “II” and “FFFF” is newly generated and stored in the music material database 15a in association with the material ID “L ′”. The
According to this embodiment described above, the creator can create a new connect file by partially modifying the content of the material composition management data included in the connect file created in the past by performing a replacement editing operation. Can do. Further, by performing the editing history retroactive operation together, the material ID input in the music material composition column 60 can be converted into a collection of material IDs of smaller music materials, and the contents can be modified.

(Other embodiments)
This embodiment can be modified in various ways.
In the above embodiment, the music material composition field 60 on the editing screen has two tracks, the first track 61 and the second track 62, but more tracks may be provided. According to this modification, it is possible to combine a sequence of material IDs of more music materials at a time by a mixing editing operation. Further, although the multi-track sequence area secured in the RAM 12 of the music material management server apparatus 10 has four tracks, it may have a larger number of tracks.

  In the music material recording service of the above embodiment, the creator acquires the audio signal of the music material by playing the musical instrument connected to the audio interface 27 of the terminal device 20, but the sound source is connected to the audio interface 27. Then, the audio signal of the music material may be acquired by controlling the sound source.

In the second embodiment, when the material ID input in the music material composition column 60 indicates a connect file, the material ID is grouped into material IDs of smaller music materials by performing a composition history retroactive operation. It was supposed to be able to convert. On the other hand, the possibility of retroactive synthesis history may be limited according to the intention of the creator. This modification can be realized by making the data structure of the connect file as shown in FIG. The connect file shown in FIG. 15A includes history retrospective control data indicating whether the synthesis history can be retroactive in addition to the material synthesis management data, reproduction time length data, material ID, and user ID. The history retroactive control data indicates either “Primitive” that does not allow history retroactive or “Traceable” that permits retroactive history. In this modified example, when the material ID for which the right button is double-clicked by the retroactive operation of the edit history is transmitted from the terminal device 20 to the music material management server device 10, the CPU 11 of the music material management server device 10 determines the material ID. With reference to the history retroactive control data of the associated connect file, the material composition management data of the connect file is provided to the terminal device 20 only when the historical retroactive control data is “Traceable”.

Further, according to the intention of the creator of the file stored in the music material database 15a of the music material management server device 10, the provision of the file to other creators may be restricted. This modification can be realized by assigning an ID for identifying each terminal device 20 of each creator, while making the data structures of the piece file and the connect file as shown in FIGS. 15B and 15C, respectively. . The piece file shown in FIG. 15B includes access control data in addition to music material data , reproduction time length data, material ID, and user ID. This access control data is data representing a collection of IDs of one or a plurality of creators who are permitted to use the file, and the contents are determined by the file creator at the time of creation. Similarly, the connect file shown in FIG. 15C includes access control data in addition to the material composition management data, reproduction time length data, material ID, and user ID.

In the above embodiment, the contents of the music material data itself included in the piece file cannot be altered after recording. On the other hand, characteristics such as volume level and frequency of the music material data included in the piece file may be modified later. Also, effects such as reverb and distortion may be modified. According to this modification, for example, the music material data of the piece file “A” can be modified to newly generate a piece file “A ′” that is a variant of the music material data. In addition, if alteration by another creator other than the creator who recorded the music material is permitted, whether the alteration is permitted or not may be limited according to the intention of the creator of the original piece file. This modification can be realized by making the data structure of the connect file as shown in FIG. Piece file shown in FIG. 15 (d) musical material data, playback time length data, material ID, in addition to the user ID, containing the modified control data indicating whether modification of the music material data. The modification control data indicates either “Primitive” that does not allow modification of music material data or “Traceable” that allows modification.

  In the reproduction processing of the above embodiment, after the music material data written in each track of the multi-track sequence area is replaced with an audio signal, the audio signal is mixed with the first track and then provided to the terminal device 20. However, if the terminal device 20 can process audio signals of two channels, the audio signals of two channels may be mixed and then provided to the terminal device 20. Alternatively, the musical instrument part of the music material data written in each track of the multi-track sequence area is first presented to the terminal device 20, and only the audio signals of the two musical instrument parts selected by the creator from among them are displayed. May be provided.

In the above embodiment, the music material management server device 10 is installed on the network 30 assuming use by a plurality of creators, and the server device 10 provides a music material recording service in response to a request from the terminal device 20 of the creator. In the above embodiment, both the music material editing service and the music material editing service are described. However, both of these services may be provided by a stand-alone computer device.
In the above embodiment, the synthesis of music material is assumed, but the material synthesized by the present invention does not have to be a music material, and may be an image material.
In the playback processing of the above embodiment, a series of processing from step 600 to step 840 is executed each time the “playback” button on the editing screen is selected. On the other hand, after the “Play” button on the editing screen is selected and an audio signal according to the input content in the music material composition field 60 is emitted, the “Play” button is selected again with the same input content. When the music material management server device 20 has previously generated an audio signal according to the input content of the music material composition field 60 as in the case of the above, the audio is not repeated without repeating the processing of step 600 to step 840. The signal may be transmitted immediately to the terminal device 10.

It is a block diagram which shows the whole structure of a music material editing system. It is a data structure figure of a piece file. It is a flowchart which shows a music material recording process. It is a flowchart which shows a music material edit process (first half part). It is a flowchart which shows a music material edit process (second half part). It is an edit screen. It is a figure which shows the operation example of drag and drop operation. It is a figure which shows an example of operation via an edit screen. It is a flowchart which shows a reproduction | regeneration process (first half part). It is a flowchart which shows a reproduction | regeneration process (second half part). It is a state transition diagram of a multitrack sequence area (first half part). It is a state transition diagram of a multitrack sequence area (second half part). It is a flowchart which shows the characteristic process of 2nd Embodiment. It is a figure which shows an example of operation via an edit screen. It is a data structure figure of a connect file and a piece file.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Music material management server apparatus, 11, 21 ... CPU, 12, 22 ... RAM, 13, 33 ... ROM, 14, 26 ... Communication interface, 15, 29 ... Hard disk, 20 ... Terminal device, 24 ... Mouse, 25 ... Computer display 27 ... Audio interface 28 ... Speaker 30 ... Network 50 ... Music material presentation column 51 ... Scroll bar 60 ... Music material composition column 63 ... Scroll bar

Claims (8)

Each piece file that contains a music material material identifier and music material data representing the audio signal of the music material is stored, and a music material that is obtained by mixing a plurality of music materials. Storage means for storing each connect file each including an identifier and material composition management data that is a collection of material identifiers of a plurality of music materials to be mixed to obtain the mixed music material; and an optional stored in the storage means A music material editing method using a system comprising an operator for selecting a material identifier of a file of
A mixing target selection step of selecting a plurality of music materials to be mixed according to the operation of the operation element;
Generating a material identifier unique to the mixing music material obtained by mixing the plurality of music materials selected in the mixing target selection step and material composition management data that is a collection of the material identifiers of the plurality of music materials; A mixing music material storage step of storing a new connect file including the generated material identifier and material composition management data in the storage means;
A mixing music material reproduction instruction step of selecting a mixing music material to be reproduced according to the operation of the operation element;
A connect file including the material identifier of the mixing music material selected in the mixing music material reproduction instruction step is read from the storage means and associated with each of a series of material identifiers represented by the material composition management data included in the read connect file. Reading the piece file stored in the storage means,
A mixing signal output step of mixing an audio signal represented by each piece of music material data included in the piece file read in the reading step and outputting an audio signal obtained by the mixing;
Have
The reading step includes
It is determined whether there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file, and is associated with the piece file. When there is an unidentified material identifier, a connect file including a material identifier that is not associated with a piece file is identified from the storage unit, while being associated with the remaining material identifiers excluding the material identifier in the storage unit. Reading the stored piece file;
Whether the identified connect file is read from the storage means, and there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file And a step of recursively specifying a connect file including the material identifier from the storage unit each time it is determined that there is a material identifier not associated with the piece file. Editing method. The music material editing method according to claim 1,
A new piece file including a material identifier unique to the mixing music material generated in the mixing music material storage step and music material data representing the audio signal obtained in the mixing signal output step is stored in the storage means. A music material editing method further comprising a step of storing. The music material editing method according to claim 2,
The storage means
Material composition that is a collection of material identifiers of connected music materials, which are music materials obtained by connecting a plurality of music materials along the time axis, and material identifiers of a plurality of music materials connected to obtain the connected music materials A piece file containing management data is stored.
A connection target selection step of selecting a plurality of music materials to be connected according to the operation of the operation element;
Generating a material identifier unique to a connected music material obtained by connecting a plurality of music materials selected in the connection target selection step and material composition management data which is a collection of material identifiers of the plurality of music materials; A connected music material storage step of storing a new connect file including the generated material identifier and material composition management data in the storage means;
A connected music material reproduction instruction step of selecting a linked music material to be reproduced according to the operation of the operation element;
A connect file including the material identifier of the connected music material selected in the connected music material reproduction instruction step is read from the storage means and associated with each of a series of material identifiers represented by the material composition management data included in the read connect file. Reading the piece file stored in the storage means,
A music material editing method further comprising: a concatenated signal output step of concatenating audio signals represented by each of the music material data included in the piece file read in the reading step and outputting an audio signal obtained by the concatenation. The music material editing method according to claim 3,
A new piece file including a material identifier unique to the connected music material generated in the connected music material storage step and music material data representing the audio signal obtained in the connected signal output step is stored in the storage means. A music material editing method further comprising a step of storing. The music material editing method according to claim 4,
The material composition management data included in the connect file is
A music material editing method, which is sequence data in which material identifiers of a plurality of music materials to be connected, mixed, or both are divided into a plurality of tracks. The music material editing method according to any one of claims 1 to 5,
Inputting a music material audio signal via a predetermined signal input device;
A music material further comprising: generating music material data representing the input audio signal and a unique material identifier, and storing a new piece file including the generated music material data and the material identifier in the storage means. Editing method. Each piece file containing the material identifier of the material and the material data of the material is stored, and mixed to obtain the material identifier of the mixing material and the mixing material obtained by mixing a plurality of materials. Storage means for storing each connect file including material composition management data that is a collection of material identifiers of a plurality of materials, and an operator for selecting a material identifier of an arbitrary file stored in the storage means A material editing method using a system comprising:
A mixing target selection step of selecting a plurality of materials to be mixed according to the operation of the operation element;
A material generated by generating a material identifier unique to a mixing material obtained by mixing a plurality of materials selected in the mixing target selection step and material composition management data which is a collection of material identifiers of the plurality of materials A mixing material accumulation step of storing a new connect file including an identifier and material composition management data in the storage means;
A mixing material reproduction instruction step of selecting a mixing material to be reproduced according to the operation of the operation element;
The connect file including the material identifier of the mixing material selected in the mixing material reproduction instruction step is read from the storage unit, and is associated with each of a series of material identifiers represented by the material composition management data included in the read connect file. A reading step of reading the piece file stored in the storage means;
A mixing output step of mixing the material data included in the piece file read in the reading step and outputting the material data obtained by the mixing;
Have
The reading step includes
It is determined whether there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file, and is associated with the piece file. When there is an unidentified material identifier, a connect file including a material identifier that is not associated with a piece file is identified from the storage unit, while being associated with the remaining material identifiers excluding the material identifier in the storage unit. Reading the stored piece file;
Whether the identified connect file is read from the storage means, and there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file Each time it is determined whether or not there is a material identifier that is not associated with the piece file, the material editing includes a step of recursively specifying the connect file including the material identifier from the storage unit. Method. Each piece file containing a music material material identifier and music material data representing an audio signal of the music material is stored, and a material identifier of a mixing music material which is a music material obtained by mixing a plurality of music materials Storage means for storing each connect file including material composition management data that is a collection of material identifiers of a plurality of music materials mixed to obtain the mixed music material,
An operator for selecting a material identifier of an arbitrary file stored in the storage means;
A mixing target selecting means for selecting a plurality of music materials to be mixed according to the operation of the operation element;
Generate and generate a material identifier unique to the mixing music material obtained by mixing the plurality of music materials selected by the mixing target selection means and material composition management data that is a collection of the material identifiers of the plurality of music materials Mixing music material storage means for storing a new connect file including the material identifier and the material composition management data in the storage means;
Mixing music material reproduction instruction means for selecting a mixing music material to be reproduced according to the operation of the operation element;
The connect file including the material identifier of the mixing music material selected by the mixing music material reproduction instruction means is read from the storage means, and is associated with each of a series of material identifiers represented by the material composition management data included in the read piece file. Reading means for reading the piece file stored in the storage means;
Mixing signal output means for mixing an audio signal represented by each piece of music material data included in the piece file read by the reading means and outputting an audio signal obtained by the mixing;
With
The reading means includes
It is determined whether there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file, and is associated with the piece file. When there is an unidentified material identifier, a connect file including a material identifier that is not associated with a piece file is identified from the storage unit, while being associated with the remaining material identifiers excluding the material identifier in the storage unit. Means for reading the stored piece file;
Whether the identified connect file is read from the storage means, and there is a material identifier that is not associated with the piece file in the storage means in the series of material identifiers represented by the material composition management data included in the read connect file And a means for recursively identifying a connect file including the material identifier from the storage means each time it is determined that there is a material identifier not associated with the piece file. Material editing system.

Images