JP2007121935A - Method and system for editing music material - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To speedily and securely extract a music material matching an image of a user most from a database wherein music materials used to create music are collected. <P>SOLUTION: Music materials obtained from various musical instruments are stored in the database while being associated with properties (genres, atmospheres, musical instrument kinds, etc.) specified by the music materials. When the user who creates music specifies a property as a key, a specified number of music materials having the property are extracted and selected by the user. The user create concert music by connecting or mixing selected music materials. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a music material editing method.

There has been proposed a music composition support system that can create a single ensemble by synthesizing a plurality of music materials obtained from the performance sounds of various instruments (refer to Patent Document 1 and the like for music material synthesis technology). . Many of this type of system has a database that collects audio data of various music materials. A user who creates music can select a desired music material from a database and arrange it to create a music that matches his / her creative image.
JP-A-11-327550

In order to increase the degree of freedom of creation using the composition support system described above, it is necessary to enrich the stored contents of the database by collecting music materials obtained by recording musical sounds of various tones, rhythms, tempos, and keys. is there. However, as the repertoire of music materials stored in the database becomes enormous, there may be a problem that much effort is required to search for music materials that match the user's creative image.
The present invention has been devised under such a background, and it is possible to quickly and reliably extract music material that best matches the user's image from a database of music materials used for creating music. The purpose is to provide a mechanism.

  A music material editing method according to a preferred embodiment of the present invention stores each piece file including a material identifier of a music material and music material data representing an audio signal of the music material, and a part of an ensemble Alternatively, the material identifier of the synthetic music material, which is the music material obtained by combining the music materials to be performed continuously or in parallel during the time length corresponding to the entire performance section, and the performance content of the synthetic music material, File storage means for storing each connect file including material composition management data represented as one or a plurality of columns composed of material identifiers of music materials to be played in succession or in parallel, and material identifiers of the music materials And a music material editing method using a system comprising attribute storage means for storing attribute data representing the attributes of the music material in association with each other, and an operator. A search key input step for inputting one or a plurality of attributes as a material search key in accordance with the operation of the operator, and an attribute data representing an attribute common to the attribute input in the search key input step A search step of reading the material identifier stored in the attribute storage means, and outputting the read material identifier as a search result, and performing continuously or continuously for a certain length of time from each of the output material identifiers A music material composition instruction step of selecting material identifiers of a plurality of music materials to be operated according to the operation of the operation element, and inputting attributes of a composite music material obtained by collecting the plurality of selected music materials according to the operation of the operation element; A material identifier unique to the synthetic music material obtained by collecting a plurality of music materials selected in the music material synthesis instruction step, and the selection A connect file that generates material composition management data representing the plurality of material identifiers as one or a plurality of columns and stores a new connect file including the generated material identifier and material composition management data in the file storage means An accumulation step; an attribute registration step of associating the generated material identifier with attribute data representing the input attribute and storing the attribute data in the attribute storage means; and operating the operator with a synthetic music material to be played back A connection target including a reproduction target selection step selected according to the method and a material identifier of the synthetic music material selected in the reproduction target selection step is read from the file storage means, and a series of material composition management data included in the read connect file represents The piece file stored in the file storage means in association with each of the material identifiers is read. And a signal output step of outputting an audio signal obtained by connecting, mixing, or both of the audio signals represented by the music material data included in the piece file read in the reading step And have.

  In this aspect, the attribute data is data representing characteristics of an audio waveform that is one of the attributes of music material, and the search key input step includes a predetermined sound collecting device that uses a sound or a musical sound as a key of the music material The search step analyzes the characteristics of the audio waveform of the input voice or musical sound and stores it in the attribute storage means in association with attribute data close to the result of the analysis. There may be a step of reading the material identifier.

  A music material editing system according to another preferred embodiment of the present invention stores piece files each including a material identifier of a music material and music material data representing an audio signal of the music material, The material identifier of the composite music material, which is the music material obtained by combining the music materials to be played continuously or in parallel during the length of time corresponding to a part or all of the performance section, and the performance contents of the composite music material A file storage means for storing each connect file each including material composition management data represented as one or a plurality of columns comprising material identifiers of the music materials to be played in succession or in parallel; One or more attributes used as attribute storage means storing attribute identifiers and attribute data representing the attributes of the music material in association with each other, an operator, and a search key for the music material A search key input means for inputting in accordance with the operation of the recording operator, and a material identifier stored in the attribute storage means in association with attribute data representing an attribute common to the attribute input by the search key input means is read and read A search means for outputting a material identifier as a search result, and material identifiers of a plurality of music materials to be played continuously or continuously for a certain length of time among the output material identifiers according to the operation of the operator A music material composition instruction means for inputting an attribute of a composite music material obtained by combining the plurality of selected music materials according to the operation of the operator, and a plurality of music materials selected by the music material composition instruction means. The material identifier unique to the synthetic music material obtained by combining and the plurality of selected material identifiers are displayed as one or more columns. Connected file storage means for generating material composition management data and storing a new connect file including the created material identifier and material composition management data in the file storage means, the created material identifier and the input attribute Attribute registering means for associating attribute data representing the attribute data with the attribute storage means, reproduction target selection means for selecting a synthetic music material to be reproduced according to the operation of the operator, and reproduction target selection means A connect file including the material identifier of the selected synthetic music material is read from the file storage means, and stored in the file storage means in association with each of a series of material identifiers represented by the material composition management data included in the read connect file. Read means for reading the piece file, and piece file read by the read means Audio signal represented by each piece of music material data included in the file is connected, mixed, or both, and a signal output means for outputting an audio signal obtained by performing both.

  According to the present invention, it is possible to quickly and reliably extract a music material that most closely matches the user's image from a database in which music materials used for music composition are collected.

(First embodiment)
A first embodiment of the present invention will be described.
This embodiment is characterized in that the following two services are provided to each user who creates an ensemble composed of a plurality of instrument parts.
(1) Music material recording service This service provides data files of relatively short phrases (hereinafter referred to as “music material”) obtained from various musical instruments and attributes designated for each music material ( This is a service that accepts registration requests for each category (genre, atmosphere, instrument type, etc.) from each user and accumulates the data files and attributes in a database of the server device.
(2) Music material editing service This service accepts designation of an attribute as a search key from a user who creates a song, searches a database for a music material having the attribute, and edits the searched music material by a user It is a service that creates original ensembles by connecting and mixing according to.

FIG. 1 is a block diagram showing the overall configuration of the music material editing system according to the present embodiment. In this system, a music material management server device 10 and a terminal device 20 are connected via a network 30. Although only one terminal device 20 is shown in the figure, a plurality of terminal devices 20 may be provided. As shown in the figure, the music material management server device 10 includes a CPU 11 that performs various controls, a RAM 12 that provides a work area, a ROM 13 that stores an IPL (Initial Program Loader), a communication interface 14, a hard disk 15, and the like.
The hard disk 15 stores a music material database 15a, an attribute management database 15b, and a music material management program 15c.

  The music material database 15a is an aggregate of a plurality of records each corresponding to one music material. One record constituting this database has three fields of “material identifier”, “piece file”, and “connect file”. The “material identifier” field stores a material ID that is an identifier for uniquely identifying each music material. Also, a piece file is stored in the “piece file” field, and a connect file is stored in the “connect file” field. Here, an outline of the piece file and the connect file stored in both of these fields will be given.

  As shown in FIG. 2A, the piece file includes music material data, reproduction time length data, material ID, and user ID. The music material data is data representing a code string obtained by encoding an audio signal of music material. The playback time length data is data representing the playback time length of the music material, such as “1 bar”, “1/2 bar”, “1/4 bar”, “2 bar”, etc. The reproduction time length of the music material is represented by a relative value based on the length. The material ID is an identifier for identifying the music material, and its content matches the ID stored in the “material identifier” field. The user ID is an identifier for identifying the user.

As shown in FIG. 2B, the connect file includes material composition management data, reproduction time length data, material ID, and user ID. Since the contents of the reproduction time length data, material ID, and user ID are the same as those of the piece file, description thereof will be omitted. The material composition management data includes the performance contents of music materials that are played continuously or in parallel during the length of time corresponding to all or part of the performance section of the music, and is composed of the material IDs of those music materials. Sequence data represented as one or two columns.
The piece file and the connect file are generated in response to a request from the terminal device 20 using the music material recording service and the music material editing service shown at the beginning. Details of the generation procedure will be described later in the description of the operation. explain.

In FIG. 1, the attribute management database 15b is an aggregate of a plurality of records each corresponding to one music material. As shown in FIG. 3, one record constituting this database includes “material identifier”, “first attribute (genre)”, “second attribute (atmosphere)”, and “third attribute (instrument type)”. There are four fields. The material ID of each music material is stored in the “material identifier” field. In the field of “first attribute (genre)”, a first attribute representing attributes of a genre such as “rock”, “pops”, “jazz”, “classic”, “dance”, “ethnic music”, “others”. Data is stored. In the “second attribute (atmosphere)” field, second attribute data representing atmosphere attributes such as “energetic”, “urban”, “clean”, “violent”, “quiet” is stored. The In the “third attribute (instrument type)” field, third attribute data representing attributes of the instrument type such as “drum”, “guitar”, “bass”, “keyboard”, “percussion”, “trumpet” is stored. Is done. Each attribute to be stored in the fields of “first attribute (genre)”, “second attribute (atmosphere)”, and “third attribute (instrument type)”, as will be described in detail later in the operation description section. Is specified when a user using the music material recording service records his / her own music material in the music material management server device 10.
The music material management program 15c is a program that gives the CPU 11 a function specific to the present embodiment.

The terminal device 20 includes a CPU 21, a RAM 22, a ROM 23, a mouse 24 as an operator, a computer display 25, a communication interface 26, an audio interface 27, a speaker 28, a hard disk 29, and the like.
The hard disk 29 stores a music material editing program 29a. The program 29a is a program that gives the CPU 21 the functions characteristic of the present embodiment.

Next, the operation of this embodiment will be described.
The operation of this embodiment can be roughly divided into music material recording processing and music material editing processing. When the user activates his / her terminal device 20, the CPU 21 displays a main menu screen on the computer display 25. In the upper part of this screen, the text string “Please select the service you want to use” is displayed, and below that, buttons labeled “Music material recording service” and “Music material editing service” are displayed. Is done. When the “music material recording service” button is selected, the music material recording process is executed, and when the “music material editing service” button is selected, the music material editing process is executed.

4 and 5 are flowcharts showing the music material recording process.
When the button labeled “Music material recording service” on the main menu screen is selected, the CPU 21 of the terminal device 20 displays a user ID input screen on the computer display 25 (S100). A character string “Please enter user ID” is displayed in the upper part of the user ID input screen, and a user ID input field is displayed below it. The user who refers to this screen inputs his / her user ID in the input field.

When the user ID is input, the CPU 21 of the terminal device 20 stores the user ID in the RAM 22 and then transmits a message requesting the provision of the music material recording service to the music material management server device 10 (S110).
CPU11 of the music material management server apparatus 10 which received the message transmits the display data of a material input request screen to the terminal device 20 (S120).
The CPU 21 of the terminal device 20 that has received the display data displays a material input request screen on the computer display 25 (S130). In the upper part of this screen, a character string “Please input audio signal of music material” is displayed.
The user who refers to the screen connects one of the musical instruments owned by the user to the audio interface 27 of the terminal device 20. A musical material that appears in an ensemble created by itself or a highly versatile music material that frequently appears in an ensemble created by itself or another user is played using the instrument.

The CPU 21 of the terminal device 20 stores the audio signal supplied from the musical instrument via the audio interface 27 in the RAM 22 (S140).
When the supply of the audio signal is stopped, the CPU 21 measures the reproduction time length of the audio signal stored in the RAM 22, generates reproduction time length data representing the reproduction time length, and stores it in the RAM 22 (S150). For example, if the measured playback time length is one bar length, playback time length data representing “1 bar” is generated, and if the measured playback time length is 1/2 bar, the playback time length representing “1/2 bar” is generated. Data will be generated.

The CPU 21 transmits the music material data obtained by encoding the audio signal stored in the RAM 22, the reproduction time length data generated in step 150, and the user ID to the music material management server device 10 (S160).
The CPU 11 of the music material management server apparatus 10 that has received the music material data, the reproduction time length data, and the user ID generates a new material ID (S170).
The CPU 11 generates a new piece file including the music material data, playback time length data, and user ID received from the terminal device 20 and the material ID generated in step 170 (S180).

Subsequently, the CPU 11 adds a new record to the music material database 15a (S190).
The CPU 11 stores the material ID generated in step 170 in the “material identifier” field of the record added in step 190, and stores the piece file generated in step 180 in the “piece file” field of the record. (S200). Further, “Null” data is stored in the “Connect File” field of the record added in Step 190 (S210). In the music material editing process to be described later, a newly generated connect file is stored in the “connect file” field, while “Null” data is stored in the “piece file” field. Become.

Subsequently, the CPU 11 transmits display data of the attribute input request screen to the terminal device 20 (S220).
The CPU 21 of the terminal device 20 that has received the display data displays an attribute input request screen on the computer display 25 (S230). In the upper part of this screen, a character string “Please enter the attributes of the recorded music material” is displayed. Below that, a first attribute input field for inputting the genre of the music material, a second attribute input field for inputting the atmosphere, and a third attribute input field for inputting the instrument type are displayed.

The user who refers to the screen inputs at least one attribute of the genre, atmosphere, and instrument type of the music material played by his / her instrument in the input field of the attribute input request screen.
When the attribute is input to the attribute input request screen, the CPU 21 of the terminal device 20 converts the input first attribute data representing the genre, second attribute data representing the atmosphere, and third attribute data representing the instrument type into the music material. It transmits to the management server device 10 (S240).
The CPU 11 of the music material management server apparatus 10 that has received the attribute data adds a new record to the attribute management database 15b (S250).

The CPU 11 stores the material ID generated in step 170 in the “material identifier” field of the record added in step 250, and “first attribute (genre)”, “second attribute (atmosphere)”, and “first” Each attribute data received from the terminal device 20 is stored in the field of “3 attributes (instrument type)” (S260).
The CPU 11 transmits the display data of the piece file registration completion notification screen obtained by embedding the material ID generated in step 170 in a predetermined template to the terminal device 20 (S270).

The CPU 21 of the terminal device 20 that has received the display data from the music material management server device 10 displays a piece file registration completion notification screen on the computer display 25 (S280). In the upper part of this screen, the text string “New music material has been registered as a piece file. The material ID of the music material is as follows.” Is displayed, and the material ID is displayed below it. Is done. At the bottom of the screen, buttons labeled “Record another music material” and “Return to main menu” are displayed. The user who understands the material ID of the newly recorded music material by referring to this screen selects any button.
When the “Register another music material” button is selected, the process returns to step 130, and the CPU 21 displays a material input request screen on the computer display 25.
When the “return to main menu” button is selected, the CPU 21 displays the main menu screen on the computer display 25 again.

The user frequently appears in the musical material of each instrument part appearing in the ensemble created by himself or in the ensemble created by himself or another user while appropriately switching the instruments connected to the audio interface 27. Dedicated music material with high versatility will be recorded sequentially according to the guidance on the material input request screen.
As each user registers the music material recorded by the user through the music material recording service in association with the attribute, the music material having various attributes is accumulated in the music material database 15a of the music material management server device 10. Furthermore, the attribute data serving as the search key is registered in the attribute management database 15b.

6 to 8 are flowcharts showing the music material editing process.
When the button labeled “Music material editing service” on the main menu screen is selected, the CPU 21 of the terminal device 20 displays a user ID input screen on the computer display 25 (S300). The user who refers to this screen inputs his / her user ID in the input field.

When the user ID is input, the CPU 21 of the terminal device 20 stores the user ID in the RAM 22 and then transmits a message requesting provision of the music material editing service to the music material management server device 10 (S310).
CPU11 of the music material management server apparatus 10 which received the message transmits the display data of an edit screen to the terminal device 20 (S320).

CPU21 of the terminal device 20 which received display data displays an edit screen on the computer display 25 (S330).
FIG. 9 is an editing screen.
A music material presentation field 50 is provided in the upper part of the editing screen, and a music material composition field 60 is provided in the lower part of the screen. In the music material presentation column 50, material IDs of a plurality of music materials searched using the attribute as a search key are displayed as a list. In addition, a scroll bar 51 for moving the display range of the material ID up and down is provided at the right end of the presentation column. The music material composition column 60 has two tracks, a first track 61 and a second track 62. In each of these tracks, a bar (hereinafter referred to as “material ID bar”) containing the material ID of the music material selected from the music material presentation column 50 according to the user's operation is input. It has become. In addition, a scroll bar 63 for moving the display range of the track to the left and right is provided at the lower end of the music material composition field 60. Further, on the right side of the music material composition column 60, buttons labeled “composite” and “play” are displayed.

When the editing screen is displayed, the user places the mouse pointer at an arbitrary position on the music material presentation column 50 and double-clicks the left button of the mouse 24.
When this double-click operation is performed, the CPU 21 of the terminal device 20 displays the attribute input screen as a separate window on the editing screen (S340).
FIG. 10 is an attribute input screen.
In the upper part of the attribute input screen, a character string of “Please enter an attribute to be used as a search key for music material” is displayed. Below that, a genre attribute input field 81, an atmosphere attribute input field 82, and a musical instrument type attribute input field 83 are displayed.
When the attribute input screen is displayed, the user inputs an attribute as a search key for music material in one or more input fields on the screen.

When an attribute is input in the input field, the CPU 21 of the terminal device 20 causes the first attribute data indicating the attribute input in the genre attribute input field 81 and the second attribute data indicating the attribute input in the atmosphere attribute input field 82. Then, the third attribute data representing the attribute input in the musical instrument type attribute input field 83 is transmitted to the music material management server device 10 (S350 in FIG. 6).
The CPU 11 of the music material management server device 10 that has received the attribute data, “first attribute (genre)”, “second attribute (atmosphere)”, “third attribute” of each record of the attribute data and the attribute management database 15b. A predetermined number (for example, “10”) records in which attribute data having higher commonality with that received from the terminal device 20 is identified by sequentially comparing the stored contents of the “instrument type” field. (S360).
The CPU 11 reads the material ID stored in the “material identifier” field of each record specified in step 360 and transmits the material ID to the terminal device 20 (S370).

The CPU 21 of the terminal device 20 displays each material ID received from the music material management server device 10 in the music material presentation column 50 of the editing screen (S380).
When the material ID is displayed in the music material presenting column 50, the user places the mouse pointer on an arbitrary material ID in the presenting column and drags the left button of the mouse 24, and the mouse pointer is tracked in the music material synthesizing column 60. Move to and drop.

When this drag and drop operation is performed in a state where the material ID is displayed in the music material presentation field 50 of the editing screen, the CPU 21 of the terminal device 20 transmits the material ID selected by the dragging to the music material management server device 10. (S390 in FIG. 7).
The CPU 11 of the music material management server device 10 that has received the material ID specifies a record in which the material ID is stored in the “material identifier” field from the music material database 15a (S400).
The CPU 11 extracts the reproduction time length data included in the file stored in the “connect file” field of the record identified in step 400. If the reproduction time length data is not stored, the CPU 11 further extracts “piece file”. The reproduction time length data included in the file stored in the field is extracted, and the reproduction time length data is transmitted to the terminal device 20 (S410).

The CPU 21 of the terminal device 20 stores the reproduction time length data received from the music material management server device 10 in the RAM 22 (S420). Then, a material ID bar having a width corresponding to the time length indicated by the reproduction time length data is displayed at a position on the track where the material ID is dropped (S430).
After the material ID bar is displayed in the music material composition field 60 on the edit screen, when the user double-clicks again, a series of processing from step 340 to step 380 is repeated, and various attributes input by the user are searched. The material IDs of a predetermined number of music materials retrieved as are displayed in the music material presentation column 50. When a drag-and-drop operation is performed on one of the material IDs displayed in the music material presentation column 50 as a search result, the processing from step 390 to step 430 is repeated, and a new material is added to the track in the music material composition column 60. ID bars are formed sequentially.

FIG. 11 is an example of each operation by the user and a material ID bar formed in the track in accordance with those operations.
In this figure, in the first operation, after searching for “drum” as the search key, the material ID “A” is selected from the material IDs displayed in the music material presentation column 50 as a result of the search. It is dragged and dropped at the top position of the first track 61. Thus, one of the music materials associated with the “drum” attribute is formed on the first track 61 as a material ID bar “A” having a width corresponding to the length of 1/2 bar.
In the second operation, the material ID “B” is dragged from the material IDs displayed in the music material presentation column 50 without performing the re-search with the search key changed, and the material ID bar of the first track 61 is dragged. Dropping at a position to the right of “A”. As a result, one of the other music materials associated with the attribute of “drum” is adjacent to the material ID bar “A” on the right side as the material ID bar “B” having a width corresponding to the length of 1/2 bar. Formed.
In the third operation, after searching for “guitar” as the search key, the material ID “C” is dragged from the material IDs displayed in the music material presentation column 50 as a result of the search. The two tracks 62 are dropped at the top position. As a result, one of the music materials associated with the “guitar” attribute is formed on the second track 62 as a material ID bar “C” having a width corresponding to the length of one measure.

According to the series of operations shown in the figure, an array of material ID bars each representing the performance content of one measure of “drum” and “guitar” is formed on both tracks in the music material composition column 60, respectively.
In the following description, the material IDs of the music materials to be played continuously are arranged on the same track in the music material composition column 60 as in the relationship between the material ID bar “A” and the material ID bar “B” in FIG. The drag-and-drop operation is appropriately referred to as “concatenated editing operation”, and the music material to be played in parallel at the same time, such as the relationship between the material ID bars “A” and “B” and the material ID bar “C”. The drag-and-drop operation for juxtaposing the material IDs on different tracks in the music material composition column 60 is appropriately referred to as “mixing editing operation”.

The user uses various operations to form an array of material ID bars for a desired length of time (for example, one bar) on one or both tracks in the music material composition column 60, and then clicks “ Select the button labeled “Combine” or the button labeled “Play”.
In FIG. 6, when the “playback” button is selected, a playback process described later is executed as a subroutine.
When the “composite” button is selected, the CPU 21 of the terminal device 20 generates material composition management data by converting the array of material IDs formed on each track in the music material composition field 60 into sequence data (FIG. 5). 7 S440).

Subsequently, the CPU 21 generates reproduction time length data representing the total reproduction time length of the music material corresponding to the series of material IDs formed on the track in the music material composition column 60 and stores it in the RAM 22 (S450).
The CPU 21 transmits the material composition management data generated in step 440, the reproduction time length data generated in step 450, and the user ID to the music material management server device 10 (S460).
The CPU 11 of the music material management server apparatus 10 that has received the material composition management data, the reproduction time length data, and the user ID generates a new material ID (S470).

The CPU 11 generates a new connect file including the material composition management data, the reproduction time length data, and the user ID received from the terminal device 20 (S480).
Subsequently, the CPU 11 adds a new record to the music material database 15a (S490).
The CPU 11 stores the material ID generated in step 470 in the “material identifier” field of the record added in step 490 and stores the connect file generated in step 480 in the “connect file” field of the record ( S500). Further, “Null” data is stored in the “piece file” field of the record added in step 490 (S510).

The CPU 11 of the music material management server device 10 transmits display data of the attribute input request screen to the terminal device 20 (S520).
The CPU 21 of the terminal device 20 that has received the display data displays an attribute input request screen on the computer display 25 (S530). In the upper part of this screen, a character string of “Please enter the attributes of the synthesized music material” is displayed. Below that, a first attribute input field for inputting the genre of the music material, a second attribute input field for inputting the atmosphere, and a third attribute input field for inputting the instrument type are displayed.

The user who refers to the screen inputs at least one attribute of the genre, atmosphere, and instrument type of the music material synthesized by the user in the input field of the attribute input request screen. If “synthesize” is selected in a state where the material ID bars of a plurality of instrument types such as “drum” and “guitar” are formed on the track of the music material synthesis column 60, all of those instrument types are set to the third. It is desirable to enter in the attribute input field.
When the attribute is input to the attribute input request screen, the CPU 21 of the terminal device 20 converts the input first attribute data representing the genre, second attribute data representing the atmosphere, and third attribute data representing the instrument type into the music material. It transmits to the management server device 10 (S540).

The CPU 11 of the music material management server apparatus 10 that has received the attribute data adds a new record to the attribute management database 15b (S550).
The CPU 11 stores the material ID generated in step 470 in the “material identifier” field of the record added in step 550, and “first attribute (genre)”, “second attribute (atmosphere)”, and “first” Each attribute data received from the terminal device 20 is stored in the field of “3 attributes (instrument type)” (S560).
The CPU 11 transmits the display data of the connect file registration completion notification screen obtained by embedding the material ID generated in step 470 into a predetermined template to the terminal device 20 (S570).

  The CPU 21 of the terminal device 20 displays a connect file registration completion notification screen on the computer display 25 (S580). In the upper part of this screen, the text string “New music material has been registered as a piece file. The material ID of the music material is as follows.” Is displayed, and the material ID is displayed below it. Is done.

The processing described above will be further described in detail with reference to a specific example.
FIG. 12 is a diagram illustrating an example of an operation via the editing screen.
The description here is about 1/4 measure music files “A” and “B” corresponding to the “drum” attribute, and 1/4 corresponding to the “guitar” attribute. Piece files of music material “C”, “D”, “E” for the bars, and pieces of music material “F” and “G” for 1/2 bars associated with the attribute of “bus” The processing is performed on the assumption that a piece file of music material “H” corresponding to the file and the attribute of “keyboard” is stored in the music material database 15a.

Referring to the figure, in the first operation (concatenated editing operation), the user performs a search using the instrument type attribute of “drum” as a search key, and then selects the music material “A” selected from the search results. And “B” material ID bars are formed on the first track 61 in the order of “A” → “A” → “A” → “B”, and then the “composite” button is selected. As a result, a connect file including the material composition management data in which the material ID is arranged in one row with “AAAB” is newly generated and stored in the music material database 15a in association with the material ID “I”.
In the second operation (concatenated editing operation), the user performs a search using the instrument type attribute of “guitar” as a search key, and then selects the music materials “C” and “D” selected from the search results. The material ID bar is formed on the first track 61 in the order of “C” → “C” → “C” → “D”, and then the “composite” button is selected. As a result, a connect file including the material composition management data in which the material ID is aligned with “CCCD” in one column is newly generated and stored in the music material database 15a in association with the material ID “J”.

In the third operation (concatenated editing operation), the user performs a search using the instrument type attribute of “guitar” as a search key, and then selects the music materials “C” and “E” selected from the search results. After the material ID bar is formed on the first track 61 in the order of “C” → “C” → “C” → “E”, the “composite” button is selected. As a result, a connect file including the material composition management data in which the material IDs are arranged in a row with the material ID “CCCE” is newly generated and stored in the music material database 15a in association with the material ID “K”.
In the fourth operation (concatenated editing operation and mixing editing operation), the user performs a search using the instrument type attribute of “drum” as a search key, and then selects the music material “I” selected from the search results. A material ID bar is formed on the first track 61 in the order of “I” → “I”, and after performing a search using the instrument type attribute of “bus” as a search key, the music selected from the search results The material ID bar of the materials “F” and “G” is formed on the second track 62 in the order of “F” → “F” → “F” → “G”, and then the “composite” button is selected. . As a result, a connect file including the material composition management data in which the material IDs are arranged in two columns “II” and “FFFG” is newly generated and stored in the music material database 15a in association with the material ID “L”. .

In the fifth operation (mixing editing operation), the user performs a search using the instrument type attribute of “keyboard” as a search key, and then displays the material ID bar of the music material “H” selected from the search results. The first track 61 is formed, and after performing a search using the “drum” and “bass” instrument type attributes as search keys, the material ID bar of the music material “L” selected from the search results is displayed in the second. After being formed on the track 62, the “composite” button is selected. As a result, a connect file including the material composition management data in which the material IDs are arranged in two rows of “H” and “L” is newly generated and stored in the music material database 15a in association with the material ID “M”. .
In the sixth operation (mixing editing operation), the user performs a search using the instrument type attributes of “keyboard”, “drum”, and “bass” as search keys, and then selects the music selected from the search results A material ID bar of the material “M” is formed on the first track 61, and further, a search using the instrument type attribute of “guitar” as a search key is performed, and then the music material “J” selected from the search results. And the “K” material ID bar are formed on the second track 62 in the order of “J” → “K”, and then the “composite” button is selected. As a result, a connect file including material composition management data in which material IDs are arranged in two columns of “M” and “JK” is newly generated and stored in the music material database 15a in association with the material ID “N”. .

Through the above six operations, the performance contents of two measures of an ensemble having four instrument parts, keyboard, drum, bass, and guitar, are collected as one connect file “N”.
In this example, the music material is searched using only the instrument type attribute as the search key in all six operations. However, further refined search is performed using the genre attribute and atmosphere attribute as the search key. It is also possible.

13 and 14 are flowcharts showing the reproduction process. This process is executed as a subroutine of the music material editing process.
When the “play” button on the editing screen displayed in step 330 is selected, the CPU 21 of the terminal device 20 performs material composition management indicating the arrangement of the material IDs input in the music material composition field 60 on the screen. Data is generated, and the generated material composition management data is transmitted to the music material management server device 10 (S600).
The CPU 11 of the music material management server apparatus 10 that has received the material composition management data stores the user ID in the RAM 12 and secures a multitrack sequence area in a part of the RAM 12 (S610). This multi-track sequence area is a buffer having first to fourth four tracks.

The CPU 11 writes the array of material IDs indicated by the material composition management data into one of the tracks in the multitrack sequence area (S620). Here, when the material composition management data transmitted from the music material management server device 10 represents only one array of material IDs, the array is written in the first track of the multi-track sequence area. When two arrays are represented, these arrays are written in the first track and the second track in the same area.
The CPU 11 specifies one of the series of material IDs written in the multitrack sequence area in step 620 as a processing target (S630).
Subsequently, the record in which the “material identifier” field matches the material ID identified in step 630 is identified from the records stored in the music material database 15a (S640).

The CPU 11 determines whether or not a piece file is stored in the “piece file” field of the record identified in step 640 (S650). If “Null” is not stored in the “Piece file” field, the determination result of this step is “Yes”. If “Null” is stored, the determination result of this step is “No”. become.
The CPU 11 that has determined that the piece file is stored in step 650 reads out the music material data included in the piece file and replaces it with the material ID specified in step 630 (S660).
CPU11 which performed step 660 returns to step 630, and performs subsequent processing by making another material ID into a processing target.

The CPU 11 that has determined that the piece file is not stored in step 650 reads the material composition management data included in the connect file in the “connect file” field of the record specified in step 640 (S670).
The CPU 11 determines whether the material composition management data read in step 670 represents one array of material IDs or two arrays (S680).
The CPU 11, which has determined that the material composition management data represents one array of material IDs in step 680, replaces the array with the material ID specified in step 630 (S690). That is, the arrangement of the material IDs of a plurality of music materials that are concatenated and edited to obtain the music material is restored from the material ID of one music material specified as the processing target.

The CPU 11 that has determined that the material composition management data represents two arrays of material IDs in step 680 replaces one of the arrays with the material ID specified in step 630 and writes the other array in the material ID yet. Is written to a track in the multi-track sequence area (hereinafter referred to as an “empty track”) (S700). That is, the arrangement of the material IDs of a plurality of music materials mixed and edited to obtain the music material is restored from the material ID of one music material specified as the processing target.
CPU11 which performed step 690 or step 700 judges whether all the material IDs written in each track of the multitrack sequence area have been replaced with music material data (S710).
In step 710, the CPU 11 that has determined that a part of the material ID has not been replaced with the music material data, returns to step 630, specifies the material ID as a processing target, and executes the subsequent processing.

In step 710, the CPU 11 that has determined that all the material IDs have been replaced with the music material data identifies one of the tracks in the multi-track sequence area in which the music material data is written as a processing target (S 720).
The CPU 11 replaces one or a plurality of music material data written in the track specified in step 720 with an audio signal obtained by decoding the music material data (S730).
CPU11 which performed step 730 judges whether all the music material data written in the track | truck were replaced with the audio signal (S740).

In step 740, the CPU 11 that has determined that the music material data written in some of the tracks has not been replaced with the audio signal returns to step 720 and executes the subsequent processing after setting that track as the processing target.
In step 740, the CPU 11, which has determined that all the music material data written in the track has been replaced with the audio signal, mixes the audio signal written in the track other than the first track into the first track (S750). .

The CPU 11 transmits the music material data obtained by encoding the audio signal mixed into the first track to the terminal device 20 (S760).
The CPU 21 of the terminal device 20 stores the music material data received from the music material management server device 10 in the RAM 22 (S770).
The CPU 11 supplies an audio signal obtained by encoding the music material data stored in the RAM 22 to the speaker 28 (S780). Thereby, the musical sound of the ensemble is emitted from the speaker 28.

The processing described above will be further described in detail with reference to a specific example.
15 and 16 are diagrams showing the transition of the state of the multitrack sequence area from when the material composition management data is transmitted to the music material management server device 10 until a new piece file is obtained.
In the description here, the “play” button is selected when the fifth operation (mixing editing operation) shown in FIG. 12 is performed, and the material IDs “H” and “L” are arranged in two rows. This is performed assuming that the material composition management data is transmitted to the music material management server device 10.

Referring to FIG. 15, in step 620 that comes immediately after the multi-track sequence area is secured in the RAM 12, the material ID “H” is assigned to the first track of the sequence area, and the material ID “L” is assigned to the second track. Written (state 1).
Thereafter, the processing after step 630 is executed with the material IDs “H” and “L” as processing targets. However, since the material ID “H” has a corresponding piece file, the processing in step 650 is performed. The determination result is “YES”, and the music material data h included in the piece file is replaced at step 660 (state 2).
On the other hand, since the material ID “L” does not have a corresponding piece file, the determination result in step 650 is “NO”, and the loop after step 670 is repeated until the corresponding piece file is found. The state in which each loop is executed will be described in detail. First, the material ID “L” of the second track is replaced with the material ID “II”, and the material ID “FFFG” is written in the third track which is an empty track. (State 3).

Further, the material ID “I” of the second track is replaced with the material ID “AAAB” (state 4).
Finally, the music material data a of the connect file corresponding to the material ID “A” and the music material data b of the connect file corresponding to the material ID “B” are written to the second track in the order “aaabaab”. In addition, the music material data f of the connect file corresponding to the material ID “F” and the music material data g of the connect file corresponding to the material ID “G” are written in the order of “fffg” on the third track. (State 5 in FIG. 16).
When all the material IDs are replaced with the music material data, the music material data is replaced with the encoded audio signal at step 720 to step 740 (state 6), and further at step 750, the audio signals of all the tracks are replaced. Are mixed into the first track (state 7).
Then, a 1-channel audio signal mixed into the first track is transmitted to the terminal device 20 as music material data of a piece file, and musical sounds for three tracks are emitted from the speaker 28 of the same device 20 at the same time. become.

  According to the present embodiment described above, each user who uses the music material recording service frequently uses music material of each instrument part that appears in the ensemble created by himself or an ensemble created by himself or another user. Can be registered in the database of the music material management server device 10 along with its attributes. In addition, users of the music material editing service search for music material using any attribute such as genre, atmosphere, and instrument type as search keys, and compose the music material selected from the search results through various editing operations. By doing so, you can efficiently create an ensemble that matches your own creative image.

(Second Embodiment)
A second embodiment of the present invention will be described.
In the music material editing service of the first embodiment, when a user inputs an attribute in each entry field of the attribute input screen displayed as a separate window of the editing screen, the music material is searched using the attribute as a search key. It was. On the other hand, in this embodiment, the music material is searched using the phrase itself played by the user with his / her instrument as a search key.
The music material editing system according to the present embodiment has the same hardware configuration as that of the first embodiment, except for the data structure of the attribute management database 15b of the music material management server device 10.

  FIG. 17 is a data structure diagram of the attribute management database 15b. As shown in the figure, one record constituting this database includes “material identifier”, “first attribute (genre)”, “second attribute (atmosphere)”, and “third attribute (instrument type)”. And a field of “fourth attribute (waveform feature)”. In the field of “fourth attribute (waveform feature)”, a feature parameter representing the feature of the audio waveform of the music material is stored. As will be described in detail later in the description of the operation, the feature parameter stored in the “fourth attribute (waveform feature)” field is obtained by analyzing the audio waveform of the music material recorded by the user. .

Next, the operation of this embodiment will be described.
The operation of this embodiment can be roughly divided into music material recording processing and music material editing processing.
FIG. 18 is a flowchart showing the music material recording process of the present embodiment. In the figure, the contents after executing step 260 are different from those in FIG.
The CPU 11 of the music material management server apparatus 10 storing the attribute data in step 260 shown in the figure performs a predetermined analysis process on the audio signal represented by the music material data transmitted from the terminal apparatus 20 in step 160. Then, a feature parameter representing the feature of the audio waveform is acquired (S261).
Subsequently, the CPU 11 stores the feature parameter acquired in step 261 in the “fourth attribute (waveform feature)” field of the record added in step 250 (S262).
After the feature parameters are stored, processing similar to that after step 270 shown in FIG. 5 is executed.

FIG. 19 is a flowchart showing music material editing processing in the present embodiment. In the figure, the contents of steps 340 to 360 are different from those in FIG.
In step 340 shown in FIG. 6, the CPU 11 of the music material management server apparatus 10 displays the attribute input screen as a separate window on the editing screen. The attribute input screen displays “attributes used as music material search keys”. In addition to the text string “Please enter.”, The text string “Enter the performance sound from the instrument connected to the audio interface when using the actual performance sound as the search key” is displayed. Is displayed.
The user who has referred to the attribute input screen inputs an attribute to be used as a search key for the music material into one or more input fields on the screen, or plays a musical instrument connected to the audio interface 27, thereby performing a performance as a search key. Input sound.
When an attribute is entered in the input field, processing similar to that in step 350 and subsequent steps shown in FIG. 6 is executed.
On the other hand, when the performance sound is input, the CPU 21 of the terminal device 20 transmits the music material data obtained by encoding the audio signal of the performance sound to the music material management server device 10 (S351).

The CPU 11 of the music material management server apparatus 10 that has received the music material data obtains characteristic parameters representing the characteristics of the audio waveform by analyzing the audio signal obtained by encoding the received music material data (S352). .
Subsequently, the CPU 11 was played as a search key by sequentially comparing the feature parameters acquired in step 352 with the stored contents of the “fourth attribute (waveform feature)” field of each record of the attribute management database 15b. A predetermined number (for example, “10”) of records storing characteristic parameters closer to the characteristics of the waveform of the performance sound are specified (S361).
When the record is specified, the same processing as that after step 370 shown in FIG. 7 is executed, and the music material closer to the performance sound input as the search key is presented as the search result.

  According to this embodiment, since the performance sound of an instrument can be used as a search key for music material, a user using a music material editing service can more efficiently create an ensemble that matches his creation image. Can do.

(Other embodiments)
This embodiment can be modified in various ways.
In the first embodiment, the music material is searched using the three attributes of genre, atmosphere, and instrument type as search keys, but other attributes such as time signature, tempo, scale, and number of bars are searched. The search may be performed as follows.
In the above embodiment, the music material composition field 60 on the editing screen has two tracks, the first track 61 and the second track 62, but more tracks may be provided. According to this modification, it is possible to combine a sequence of material IDs of more music materials at a time by a mixing editing operation. Further, although the multi-track sequence area secured in the RAM 12 of the music material management server apparatus 10 has four tracks, it may have a larger number of tracks.
In the music material recording service of the above embodiment, the audio signal of the music material is acquired by the user himself / herself playing a musical instrument connected to the audio interface 27 of the terminal device 20, but a sound source is connected to the audio interface 27. The audio signal of the music material may be acquired by controlling the sound source.
In the reproduction processing of the above embodiment, after the music material data written in each track of the multi-track sequence area is replaced with an audio signal, the audio signal is mixed with the first track and then provided to the terminal device 20. However, if the terminal device 20 can process audio signals of two channels, the audio signals of two channels may be mixed and then provided to the terminal device 20. Alternatively, the musical instrument part of the music material data written in each track of the multi-track sequence area is first presented to the terminal device 20, and only the audio signals of the two musical instrument parts selected by the user from these are presented to the terminal device 20. You may make it provide.
In the above embodiment, the music material management server device 10 is installed on the network 30 assuming use by a plurality of users, and the server device responds to a request from the user's terminal device 20 with a music material recording service and music material. Although the aspect of providing both services of the editing service has been described, both of these services may be provided by a stand-alone computer device.
In the second embodiment, the music material is searched using the musical tone itself as a search key. However, the music material may be searched using a human voice as a search key.

It is a block diagram which shows the whole structure of a music material editing system. It is a data structure figure of a piece file. It is a data structure figure of the attribute management database 15b. It is a flowchart which shows a music material recording process. It is a flowchart which shows a music material recording process. It is a flowchart which shows a music material edit process. It is a flowchart which shows a music material edit process. It is a flowchart which shows a music material edit process. It is an edit screen. It is an attribute input screen. It is a figure which shows the operation example of drag and drop operation. It is a figure which shows an example of operation via an edit screen. It is a flowchart which shows a reproduction | regeneration process. It is a flowchart which shows a reproduction | regeneration process. It is a state transition diagram of a multitrack sequence area (first half part). It is a state transition diagram of a multitrack sequence area (second half part). It is a data structure figure of an attribute management database (2nd Embodiment). It is a flowchart which shows a music material recording process (2nd Embodiment). It is a flowchart which shows a music material edit process (2nd Embodiment).

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Music material management server apparatus, 11, 21 ... CPU, 12, 22 ... RAM, 13, 33 ... ROM, 14, 26 ... Communication interface, 15, 29 ... Hard disk, 20 ... Terminal device, 24 ... Mouse, 25 ... Computer display, 27 ... Audio interface, 28 ... Speaker, 30 ... Network, 50 ... Music material presentation column, 51, 63 ... Scroll bar, 60 ... Music material composition column

Claims (3)

Each piece file including the material identifier of the music material and the music material data representing the audio signal of the music material is stored, and continued for a length of time corresponding to part or all of the performance section of the ensemble. The material identifier of the synthetic music material that is the music material obtained by combining the music materials to be performed in parallel or in parallel, and the performance content of the synthetic music material, the material identifier of each music material to be played in succession or in parallel File storage means for storing each connect file including material composition management data represented as one or a plurality of columns,
Attribute storage means for storing material identifiers of music materials and attribute data representing attributes of the music materials in association with each other;
A music material editing method using a system including an operator,
A search key input step of inputting one or more attributes as a search key for music material in accordance with the operation of the operator;
A search step of reading a material identifier stored in the attribute storage means in association with attribute data representing a common attribute with the attribute input in the search key input step, and outputting the read material identifier as a search result;
From the output material identifiers, a material identifier of a plurality of music materials to be played continuously or continuously for a certain length of time is selected according to the operation of the operator, and the plurality of selected music materials are selected. A music material composition instruction step for inputting the attributes of the composite music material obtained in a collective manner according to the operation of the operator;
A material identifier unique to a synthetic music material obtained by collecting a plurality of music materials selected in the music material composition instruction step, and a material representing the selected material identifiers as one or a plurality of columns A connect file accumulating step for generating a composition management data and storing a new connect file including the generated material identifier and material composition management data in the file storage means;
An attribute registration step of associating the generated material identifier with attribute data representing the input attribute and storing the attribute data in the attribute storage unit;
A reproduction target selection step of selecting a synthetic music material to be reproduced according to the operation of the operation element;
A connect file including the material identifier of the synthetic music material selected in the reproduction target selection step is read from the file storage means and associated with each of a series of material identifiers represented by the material composition management data included in the read connect file. A reading step of reading the piece file stored in the file storage means;
A music material comprising: a signal output step of outputting an audio signal obtained by connecting, mixing, or both of audio signals represented by each piece of music material data included in the piece file read in the reading step Editing method. The music material editing method according to claim 1,
The attribute data is data representing the characteristics of an audio waveform that is one of the attributes of music material,
The search key input step includes:
A step of inputting voice or musical sound as a key of music material through a predetermined sound collecting device;
The search step includes
A music material editing method comprising: analyzing characteristics of an audio waveform of the input voice or musical sound, and reading a material identifier stored in the attribute storage means in association with attribute data close to the result of the analysis. Each piece file including the material identifier of the music material and the music material data representing the audio signal of the music material is stored, and continued for a length of time corresponding to part or all of the performance section of the ensemble. The material identifier of the synthetic music material that is the music material obtained by combining the music materials to be performed in parallel or in parallel, and the performance content of the synthetic music material, the material identifier of each music material to be played in succession or in parallel File storage means for storing each connect file including material composition management data represented as one or a plurality of columns,
Attribute storage means for storing material identifiers of music materials and attribute data representing attributes of the music materials in association with each other;
An operator,
Search key input means for inputting one or more attributes as search keys for music material according to the operation of the operator;
A search means for reading out a material identifier stored in the attribute storage means in association with attribute data representing an attribute common to the attribute input by the search key input means, and outputting the read material identifier as a search result;
From the output material identifiers, a material identifier of a plurality of music materials to be played continuously or continuously for a certain length of time is selected according to the operation of the operator, and the selected plurality of music materials are collected. Music material composition instruction means for inputting the attribute of the synthetic music material obtained in accordance with the operation of the operator,
A material identifier unique to a synthetic music material obtained by collecting a plurality of music materials selected by the music material composition instruction means, and a material composition management representing the selected material identifiers as one or a plurality of columns Connect file storage means for generating data and storing a new connect file including the generated material identifier and material composition management data in the file storage means;
Attribute registration means for associating and storing the generated material identifier and attribute data representing the input attribute in the attribute storage means;
Reproduction target selection means for selecting a synthetic music material to be reproduced according to the operation of the operation element;
The connect file including the material identifier of the synthetic music material selected by the reproduction target selection unit is read from the file storage unit, and is associated with each of a series of material identifiers represented by the material composition management data included in the read connect file. Reading means for reading the piece file stored in the file storage means;
Music material comprising: signal output means for outputting an audio signal obtained by connecting, mixing, or both of audio signals represented by music material data included in the piece file read by the reading means Editing system.

Images