JP6424501B2 - Performance device and performance program - Google Patents

Description

  The present invention extracts a plurality of types of music elements contained therein from sound signals (sound waveform data) of music, generates waveform data representing each music element, and uses the generated waveform data. The present invention relates to a performance apparatus and a performance program that can be played.

  BACKGROUND ART Conventionally, a playing device provided with an automatic accompaniment function is known as described in, for example, Patent Document 1 below. The playing device stores data sets of a plurality of types of accompaniment styles in advance. Each accompaniment style includes an "intro" section used as an accompaniment for the introduction of the music, a "main" section used as an accompaniment for the middle of the music, an "ending" section used as an accompaniment for the music termination , And a plurality of sections corresponding to each scene of the music. The data of each section represents a short phrase (performance pattern) of an accompaniment part (for example, a percussion part, a bass part, an ensemble such as a piano (cord) part) of music. The data in each section is so-called MIDI data. That is, the data of each section does not represent the acoustic waveform of the performance sound but is data corresponding to the score of each accompaniment part, and is converted into an acoustic waveform signal by synthesizing a musical tone by the tone source circuit.

  The operation panel of the playing device is provided with a plurality of switches for selecting a section to play. Section data is assigned to each of these switches. When the player selects a section to play using the switch and inputs a chord (chord) using the keyboard device, the control unit of the playing device receives the data of the selected section and the input code. Based on the tone generator circuit, the tone generator circuit is controlled to generate performance pattern data representing a performance pattern. The data in each section of each accompaniment style is not prepared for each chord type and its root note, but the chord type is "M (major)" and the root note is "C" Only the data of are prepared. When the type of the chord or the root note is specified, the pitch of the component sound of the data is often changed (shifted) and used. That is, when the chord input by the player using the keyboard device is "CM", the data of the currently selected section is supplied as it is to the tone generator circuit. On the other hand, when the chord inputted by the player is different from "CM", the control unit of the playing device corrects the data of the currently selected section. For example, when the chord input by the player is "Cm (minor)", the key pitch is "E" among the data (note number) of the component sounds constituting the data of the currently selected section. The data of the component sound representing a certain thing is changed to data representing that it is "E ♭".

JP, 2011-137881, A JP, 2012-203216, A

  The data of each section of the accompaniment style of the musical performance apparatus described in Patent Document 1 is MIDI data, and as described above, it is sufficient to store only the data corresponding to "CM". It can be small. However, the performance pattern of the accompaniment to be reproduced is generated by the tone generator circuit according to the MIDI data, and it may seem unattractive when compared with live performance or its recorded data.

  Therefore, for example, as described in Patent Document 2, there is also known a playing apparatus in which data of each section of each accompaniment style is composed of waveform data representing an acoustic waveform. In this performance apparatus, the waveform data of each section of each accompaniment style is exclusively produced and stored in advance by the apparatus manufacturer, and the user can not produce and add them according to his / her preference . In addition, when producing and storing waveform data of a plurality of music elements including an accompaniment style and performing, it is not possible for the user to freely select waveform data which the user desires to use as a support. Therefore, the variations of the performance pattern to be used supplementally while playing the melody or the like are limited to the preset ones.

  The present invention has been made to address the above problems, and its object is to provide a playing device capable of playing back a performance pattern of a plurality of music elements representing a performance such as a live performance, from an acoustic signal of a desired music. An object of the present invention is to provide a playing device capable of extracting music elements and reproducing a playing pattern based on the extracted music elements. In the following description of each component of the present invention, the reference numerals of corresponding parts of the embodiment are described in parentheses in order to facilitate understanding of the present invention, but each component of the present invention is It should not be construed as limited to the configuration of the corresponding portion indicated by the reference numerals of the embodiment.

  In order to achieve the above object, the present invention is characterized in that a plurality of operators (11) and an acoustic signal acquisition means (S12) for acquiring an acoustic signal representing an acoustic waveform of a played sound emitted by playing music. And the first music element from the sound signal according to one or both of the first algorithm and the second algorithm for respectively extracting the sound waveform of the first music element and the second music element included in the sound signal And music element extraction means (S14) for extracting an acoustic waveform of any one or both of the second music element, and the extracted acoustic waveform, any one or more of the plurality of operators. Assigning means (S15) for assigning to operators, and detecting that one or more operators to which the acoustic waveform has been assigned have been operated, to assign to the operated one or more operators. Using Terra acoustic waveform, play pattern data generating means (S100~S117, S200~S204) for generating performance pattern data representing the performance patterns in that the performance apparatus having a, a.

  In this case, the music element may be any one of the melody of the music, the accompaniment, the performance pattern of the rhythm performance part, and the performance pattern of the intro part, the bridge part, and the insertion phrase part of the music.

Further, in this case, the assignment unit is configured to assign the first music element and the second music element group to a first operator group and a second operator group respectively composed of one or more operators among the plurality of operators. The acoustic waveform data of two music elements are respectively assigned, and when only one of the first operator group and the second operator group is operated, the operator is assigned to the operated operator group. Performance pattern data is generated based on the acoustic waveform of the music element being played, and when both the first operator group and the second operator group are operated, the first music element and the second music element Performance pattern data may be generated based on the acoustic waveform of

In this case, the combination of the operators constituting the first operator group and the combination of the operators constituting the second operator group may be different. Note that part of the first operator group and part of the second operator group may overlap. That is, there may be operators which belong to the first operator group and also to the second group. On the other hand, the first operator group and the second operator group may be independent. That is, all the operators belonging to the first operator group do not belong to the second operator group, and all the operators belonging to the second operator group do not belong to the first operator group. Also good.

  In the present invention, the plurality of music elements included in the sound signal of music are music phrases and music patterns (hereinafter referred to as performance patterns) included in the process for each playing part of music such as melody, vocal, accompaniment, rhythm and the like As well as the ongoing introductory part of the entire song, the bridge (sabi) part, inserted music patterns, effective parts etc. For example, the first music element may represent the intro performance pattern of the accompaniment part of the music introduction part, and the second music element may represent the drum performance pattern of the rhythm part of the introduction part. The performance pattern of the second music element may be (contentically) included in the performance pattern of the first music element. Also, even if the second music element represents the performance pattern of the chorus portion of the melody part, the performance pattern of the second music element and the performance pattern of the first music element do not overlap each other and are simultaneously reproduced during the performance. The relationship may not be unnatural. Also, “operator group” means a combination of one or more operators associated with each of the performance patterns of the extracted music elements. "Operator group" is "operated" means that all the operators belonging to the operator group are operated (for example, set to the on state).

  According to the musical performance apparatus configured as described above, it is possible to extract music elements from a desired music and to generate performance pattern data based on the acoustic waveform of the extracted music elements. That is, the acoustic waveform of the music element is not stored in advance in the performance device, but the acoustic waveform of the music element is extracted from the desired music. That is, performance pattern data is not generated based on MIDI data, but is generated based on the acoustic waveform of part of music elements of the original music. Therefore, according to the playing device of the present invention, it is possible to reproduce an attractive playing pattern such as a live performance.

  In addition, by simultaneously operating all the operators belonging to the first operator group (for example, setting to the ON state), the desired performance pattern of the first music element is selected, and the selected first music element is selected. Performance pattern data can be generated based on the acoustic waveform. In addition, by simultaneously operating all the operators belonging to the second operator group (for example, setting it to the ON state), the desired performance pattern of the second music element is selected, and the selected second music element is selected. Performance pattern data can be generated based on the acoustic waveform. A performance pattern data is generated based on the acoustic waveforms of the first music element and the second music element by operating all the operators belonging to the first operator group and all the operators belonging to the second operator group. be able to. That is, the performance pattern based on the first music element and the performance pattern based on the second music element can be independently reproduced, or both performance patterns can be simultaneously reproduced. For example, if the first music element and the second music element respectively correspond to the playing parts of each instrument, the playing pattern of each instrument can be reproduced independently (that is, one of them is selected), It is also possible to reproduce a playing pattern in which they are superimposed. Therefore, according to this, it is possible to increase the variation of the playing pattern more than the conventional one.

  Further, another feature of the present invention is that the music element extraction means is a playing device provided with selection means for selecting an algorithm to be applied to the sound signal.

  According to this, since it is possible to select an algorithm (a first algorithm and a second algorithm) to be applied to the sound signal, only desired music element data can be generated.

  Further, another feature of the present invention is that the first music element is a performance pattern of an accompaniment part, and an acoustic waveform representing the first music element corresponds to a type of chord and root of the performance pattern of the accompaniment part And the performance pattern data generation unit detects a chord corresponding to the one or more operators being operated, and an acoustic waveform of the first music element corresponding to the detected chord is stored. If stored, the stored acoustic waveform is read out and reproduced, and if the acoustic waveform of the first music element corresponding to the detected chord is not stored, the one of the first music element is stored. It is a playing device capable of generating playing pattern data representing a playing sound represented by an acoustic waveform and relating to a chord in accordance with the detected chord. Located in. The "type of chord" corresponds to a part of the so-called chord name except for the root note mark, such as major (M), minor (m), and seventh (7th).

  According to this, it is possible to correct the chord of the performance sound (phrase) represented by one or both of the first music element data and the second music element data to the designated code. Therefore, the original music can be easily arranged.

  The present invention is not limited to the implementation as a musical performance apparatus, and can also be implemented as a computer program (performance program) applied to a computer included in the musical performance apparatus.

It is a schematic diagram showing the outline of the musical instrument concerning one embodiment of the present invention. It is the enlarged view to which the music element switch of FIG. 1 was expanded. It is a block diagram which shows the structure of the musical performance apparatus of FIG. It is a flowchart which shows an audio music element data set production | generation program. It is a conceptual diagram which shows the correspondence of the acoustic waveform data showing the performance of the accompaniment part of original music, reference waveform data, and the accompaniment waveform data extracted. It is a conceptual diagram which shows the correspondence of each waveform data and an operation element. It is a flowchart which shows the first half of a performance pattern data generation program. It is a flowchart which shows the second half part of a performance pattern data generation program. It is a flowchart which shows a performance pattern data supply program.

  A playing device 10 according to an embodiment of the present invention will be described. As described below, the performance device 10 takes in acoustic waveform data (for example, digital audio signal in wav format) representing the acoustic waveform of the musical performance sound of music, and generates a plurality of accompaniment waveform data from the acoustic waveform data. Rhythm waveform data and a plurality of bridge waveform data are extracted to generate an audio music element data set including the extracted waveform data. Hereinafter, the music used to generate the audio music element data set is referred to as an original music. The accompaniment waveform data is a performance pattern extracted and extracted from the accompaniment parts (for example, the ensemble of the drum part, the bass part, and the piano (cord) part) excluding the main melody part (for example, the vocal part and the melody part) of the original music. Represents the acoustic waveform of The accompaniment waveform data, like the MIDI accompaniment style data, usually represents performances of several measures, and is selected and generated for each scene (section) such as the introductory part, the intermediate part, and the end part of the original music. . The rhythm waveform data represents an acoustic waveform of the performance pattern extracted and extracted from the rhythm part (drum part) of the original music. The rhythm waveform data is configured in intervals of the original music (for example, every two measures). Further, the bridge waveform data represents an acoustic waveform of the performance of a bridge (sabi) portion including a characteristic melody line or the like in the traveling direction of the original music. In addition, the performance device 10 can store audio music element data sets of a plurality of music pieces. The player selects one audio music element data set that matches the music to be played, and selects waveform data of the desired music element from the selected audio music element data set, along the progress of the music performance. , And can be selected using an operation element to reproduce a performance pattern based on the waveform data. For example, a player specifies a desired accompaniment, rhythm, and bridge (sabi) performance pattern by actually playing the melody part with the right hand and selecting an operator with the left hand. As a result, the performance pattern of the desired music extracted and stored in advance can be used as accompaniment or auxiliary performance for the performance of the melody part.

  The performance device 10 also includes a plurality of accompaniment style data sets (hereinafter referred to as MIDI accompaniment style data sets) configured of MIDI data, as in a conventional performance device. The player can select one MIDI accompaniment style data set and play using the selected MIDI accompaniment style data set.

  As shown in FIGS. 1 to 3, the performance device 10 includes an input operator 11, a computer unit 12, a display 13, a storage device 14, an external interface circuit 15, a sound source circuit 16, and a sound system 17. Are connected via the bus BUS.

  The input operator 11 includes a switch corresponding to the on / off operation, a volume or rotary encoder corresponding to the rotation operation, a volume or linear encoder corresponding to the slide operation, a mouse, a touch panel, and the like. Furthermore, the input operator 11 also includes a keyboard device KY used when playing music. These operators are operated by the player's hand, and are used when setting various parameters, playing music, and the like. Also, the input operator 11 may include, for example, a foot keyboard of an electronic organ. When the player operates the input operator 11, operation information representing the contents of the operation is supplied to the computer unit 12 described later via the bus BUS.

  For example, as shown in FIG. 2, the input operator 11 includes a music element switch PS. The music element switch PS includes a section selection switch SS. The section selection switch SS includes an intro switch IS, a main switch MS1, a main switch MS2, a main switch MS3, a fill-in switch FS, and an ending switch ES. These switches are used to select a desired section when playing an accompaniment style (MIDI and waveform data). Therefore, two or more of the intro switch IS, the main switch MS1, the main switch MS2, the main switch MS3, the fill-in switch FS and the ending switch ES are not simultaneously set to the ON state, and only one switch is set. It is set to the on state.

  The music element switch PS includes a rhythm switch RS and a bridge switch BS. The rhythm switch RS is used when playing using rhythm waveform data. The bridge switch BS is used when playing using bridge waveform data. One of the section selection switches SS, the rhythm switch RS and the bridge switch BS can be simultaneously set to the on state. That is, the performer can play the accompaniment waveform data, the rhythm waveform data, and the bridge waveform data independently or play them in combination.

  In addition, the playing device 10 has a plurality of operation modes, and the input operator 11 is used when switching the operation modes. The operation mode includes an audio music element data set generation mode that generates an audio music element data set based on acoustic waveform data of existing music, and an audio music played using the audio music element data set generated and stored in advance. The element playing mode is included.

  The computer unit 12 comprises a CPU 12a, a ROM 12b and a RAM 12c connected to the bus BUS. The CPU 12a reads out an audio music element data set generation program, an audio music element performance program, and the like which will be described in detail later from the ROM 12b and executes the program. In addition to the audio music element data set generation program (including the first to third algorithms to be described later), the audio music element performance program, and other programs, the ROM 12b includes an initialization parameter and an image displayed on the display 13. Graphic data, character data and the like for generating display data to be represented are stored. Various data including music data are temporarily stored in the RAM 12 c when the various programs are executed.

  The display 13 is configured of a liquid crystal display (LCD). The computer unit 12 generates display data representing contents to be displayed using graphic data, character data and the like, and supplies the display data to the display 13. The display 13 displays an image based on the display data supplied from the computer unit 12. For example, the name of the currently selected audio music element data set is displayed.

  The storage device 14 is composed of a large-capacity non-volatile storage medium such as an HDD, a CD, and a DVD, and a drive unit corresponding to each storage medium. The storage unit 14 stores a plurality of pieces of acoustic waveform data respectively representing the acoustic waveforms of a plurality of music pieces. The acoustic waveform data is composed of a plurality of sample values obtained by sampling music at a predetermined sampling period (for example, 1/440 seconds), and the sample values are sequentially recorded at successive addresses in the storage device 14. The sound waveform data also includes title information indicating the title of the music, data size information indicating the volume of the sound waveform data, and the like. The acoustic waveform data may be stored in advance in the storage device 14 or may be fetched from an external device via the external interface circuit 15 described later.

  The external interface circuit 15 includes a connection terminal that enables the performance device 10 to be connected to an external device such as another electronic musical instrument or a personal computer. The playing device 10 can also be connected to a communication network such as a LAN (Local Area Network) or the Internet via the external interface circuit 15.

  Connected to the sound source circuit 16 is a waveform memory WM storing timbre waveform data representing acoustic waveforms of a plurality of musical instrument sounds such as a piano, an organ, a violin and a trumpet. The tone generator circuit 16 reads the tone waveform data specified by the CPU 12 a from the waveform memory WM, generates sound waveform data of a musical tone based on the note information of MIDI data supplied from the CPU 12 a, and supplies it to the sound system 17. For example, when playing using the MIDI accompaniment style data set, the tone generator circuit 16 generates performance pattern data representing the acoustic waveform of the performance pattern corresponding to each section, and supplies the performance system data. In addition, the musical performance device 10 is configured to be able to store the musical performance pattern data generated by the tone generator circuit 16 in the storage device 14. Note that the sound source circuit 16 also includes an effector circuit that adds various effects such as a chorus effect and a reverberation effect to the performance sound.

  The sound system 17 includes a melody part in which the tone generator circuit 16 sequentially synthesizes a tone based on MIDI performance data generated by the performer using the input operation element 11 (keyboard device KY) for performance operation. Performance sound data is also supplied. Further, as described later in detail, the sound system 17 is also supplied with performance pattern data generated from the CPU 12a based on the audio music element data set. The sound system 17 superimposes and adds the performance sound data and the performance pattern data and converts it into an analog audio signal, an amplifier which amplifies the converted analog audio signal, and an audio signal of the amplified analog audio signal. It is equipped with a pair of left and right speakers that convert into and emit sound. The whole or a part of the functions of the tone generator circuit 16 and the sound system 17 may be realized not by dedicated hardware but by a program executed by the CPU 12a.

  Next, a procedure for generating an audio music element data set will be described. When the performer sets the operation mode of the musical performance apparatus 10 to the audio music element data set generation mode using the input operator 11, the CPU 12a reads the audio music element data set generation program shown in FIG. 4 from the ROM 12b and executes it. Do. At step S10, the CPU 12a starts an audio music element data set generation process. Next, in step S11, the CPU 12a causes the display 13 to display the title of the music stored in the storage device 14. The player uses the input operator 11 to select a desired music (in this embodiment, “Song 01”). At step S12, the CPU 12a reads acoustic waveform data representing an acoustic waveform of the selected music from the storage device 14 (for example, an audio CD).

  The performance device 10 applies a first algorithm, a second algorithm, and a third algorithm to the read-in acoustic waveform data, respectively, to thereby create a plurality of accompaniment waveform data, rhythm waveform data, and a plurality of accompaniment, rhythm, and bridge music elements. Bridge waveform data can be generated. The playing device 10 is configured to be able to select one of the first algorithm, the second algorithm and the third algorithm, which is to be applied to the read acoustic waveform data. That is, in step S13, the CPU 12a allows the player to select an algorithm to be applied to the read acoustic waveform data. For example, the CPU 12a displays icons (not shown) respectively corresponding to the first algorithm, the second algorithm, and the third algorithm on the display 13. The player uses the input operator 11 to select one or more of the first algorithm, the second algorithm, and the third algorithm, and instructs start of generation of the audio music element data set.

  Next, in step S14, the CPU 12a applies the selected one or more algorithms to the read acoustic waveform data. Thus, among the plurality of accompaniment waveform data, the plurality of rhythm waveform data, and the plurality of bridge waveform data, waveform data corresponding to the selected algorithm is generated, and the generated waveform data is assigned to the input operator 11 .

  The first algorithm is a technique for extracting acoustic waveform data representing a performance pattern of accompaniment from music data of audio, and is realized, for example, by using an algorithm described in Japanese Patent Application Laid-Open No. 2014-029425. That is, the CPU 12a first causes the tone generator circuit 16 to generate performance pattern data representing each performance pattern using each MIDI accompaniment style data set, and stores the performance pattern data in the storage device 14 as reference waveform data (reference data of the present invention). The reference waveform data is generated for each accompaniment section. Furthermore, reference waveform data of each chord (ie, all root sounds and chord types) is generated for one accompaniment section. That is, as the reference waveform data, a phrase of a predetermined length (for example, two measures) generated by designating one chord while one MIDI accompaniment style data set is selected and one accompaniment section is selected. Represents the acoustic waveform of The name of the reference waveform data is set to a name obtained by connecting the name of each MIDI accompaniment style data set, the section name, and the code name with "_". For example, as shown in FIG. 5, the name of the reference waveform data is set to "Style M1_Intro_Am".

  Next, the CPU 12a applies a well-known algorithm (for example, Japanese Patent Laid-Open No. 11-38980) to the acoustic waveform data of the original song to generate acoustic waveform data of the accompaniment part excluding the vocal part and the melody part from the original song. Do. Next, the CPU 12a divides the generated acoustic waveform data of the accompaniment part into a plurality of sections t1, t2,. Next, the CPU 12a detects the reference waveform data with the highest degree of similarity for each section by comparing the acoustic waveform data of each section obtained by the division with each reference waveform data. Then, the acoustic waveform data of the section corresponding to the section of the detected reference waveform data is cut out (extracted) from the sound waveform data of the original music, and the cut out acoustic waveform data is the section name of the detected reference waveform data And it associates with the chord name and stores it as accompaniment waveform data. For example, as shown in FIG. 5, the title including the title of the original music, the section name of the detected reference waveform data, and the name including the code name are set as the name of the accompaniment waveform data, and the accompaniment waveform data is stored in the storage device 14 Do. In the example shown in FIG. 5, the title of the original song is "Song 01". Then, the section name of the reference waveform data most similar to the acoustic waveform data in the section t1 is "Intro", and the code name is "Am". Therefore, in this case, the CPU 12a sets the name of the acoustic waveform data of the section t1 to "Song01_Intro_Am.wav", and stores it in the storage device 14 as accompaniment waveform data. That is, the name of each accompaniment waveform data is set to a title in which the title of the music, the section name of the detected reference waveform data, and the chord name are connected via "_". According to this, the section and chord of the accompaniment waveform data can be determined by the name of the accompaniment waveform data. For the other sections, the names of the accompaniment waveform data are set according to the same rule as that of the section t1, and the accompaniment waveform data is stored in the storage unit 14. In the present embodiment, the reference waveform data represents a performance pattern for two measures. Therefore, the accompaniment waveform data similar to the performance pattern also represents the performance pattern for two measures.

  The second algorithm is described, for example, in "K. Miyamoto et al.," Separation of harmonic and non-harmonic sounds based on anisotropy in spectrogram ", Proc. Of ASJ Spring Meeting 2008, p. 903-904. Includes an algorithm similar to the algorithm. That is, the CPU 12a first calculates the spectrogram of the original music using the read-in acoustic waveform data. In general, the energy of the playing sound (single tone) of a percussion instrument tends to be widely distributed in the frequency axis direction and narrowly distributed in the time axis direction in the spectrogram. On the other hand, the energy of playing sounds (single tones) of a piano, a guitar or the like tends to be distributed at intervals in the frequency axis direction and distributed in a wide range in the time axis direction. Focusing on the nature of the sound played by each instrument as described above, the rhythm part of the original music and the other played parts are separated. That is, the CPU 12a generates acoustic waveform data representing the performance of only the rhythm part of the original music based on the calculated spectrogram. Then, the CPU 12a divides the generated acoustic waveform data representing the performance of the rhythm part into a plurality of sections. In the present embodiment, in order to simplify the description, the lengths of these sections are the same as the length of the accompaniment waveform data (that is, the length of two bars in the present embodiment).

  Next, the CPU 12a selects 12 pieces of acoustic waveform data having a low degree of similarity among the plurality of pieces of acoustic waveform data formed by division. Then, the names of the 12 selected acoustic waveform data are “Song01_Rhythm1.wav” and “Song01_Rhythm2.wav” in order from the acoustic waveform data located at the beginning of the music to the acoustic waveform data located at the end. .., “Song 01 _Rhythm 12. wav” is set, and stored in the storage device 14 as rhythm waveform data.

  The third algorithm includes, for example, an algorithm similar to the algorithm described in Japanese Patent Laid-Open No. 2004-233965. That is, the CPU 12a divides the read acoustic waveform data into a plurality of sections, and calculates a chroma vector of each section. Then, the similarity between chroma vectors of each interval is calculated, and based on the calculated similarity, an interval which appears repetitively is extracted as a bridge interval. In the present embodiment, 12 bridge sections are extracted. For example, 12 bridge sections are extracted in descending order of the number of appearances. In the present embodiment, in order to simplify the description, the length of each bridge section is the same as the length of the accompaniment waveform data (that is, the length of two bars in the present embodiment). Next, the CPU 12a sequentially names the extracted acoustic waveform data of the 12 bridge sections from the bridge section on the head side of the original music toward the bridge section on the end side of the original song, "Song01_Bridge1.wav", "Song01_Bridge2 .Wav ”,..., And“ Song01_Bridge12.wav ”, and store in the storage device 14 as bridge waveform data.

  Next, in step S15, the CPU 12a assigns the generated accompaniment waveform data, rhythm waveform data and bridge waveform data to a predetermined input operator 11, as shown in FIG. For example, of the section selection switches SS, the accompaniment waveform data is assigned to a switch including the same name as the section name of each stored accompaniment waveform data, and the keyboard device KY used to designate a chord is configured. Assign one key or a combination of a plurality of keys (hereinafter simply referred to as assigning accompaniment waveform data to a chord). That is, the CPU 12 a generates a table indicating the correspondence between the accompaniment waveform data and each switch and key, and stores the table in the storage device 14. When the performer performs using the accompaniment waveform data, the player performs chords using one or more keys belonging to a predetermined first key range (for example, "C2" to "B2") of the keyboard device KY. input.

  As shown in FIG. 6, for example, "Song01_Intro_Am. Wav" is assigned to the intro switch IS. In this example, only one accompaniment waveform data is assigned to the intro switch IS. In this case, "Song01_Intro_Am.wav" is assigned to all codes. That is, at the time of performance using this audio music element data set, when the intro switch IS is set to the on state and any code is inputted, "Song01_Intro_Am.wav" is a performance pattern data representing a performance pattern. Are set to be selected as data for generating.

  Also, as shown in FIG. 6, for example, “Song01_Main1_FM.wav” is assigned to the main switch MS1. In this example, there is a plurality of accompaniment waveform data whose section name is "Main 1" and whose chord name is different from "FM". These accompaniment waveform data are also assigned to the main switch MS1. As described above, when a plurality of accompaniment waveform data are assigned to the same switch, each accompaniment waveform data is first assigned to the same chord as the chord name included in the name of each accompaniment waveform data. For example, "Song01_Main1_FM.wav" is assigned to "FM". Further, accompaniment waveform data having a name including a chord name most approximate to the chord is assigned to a chord different from any chord of accompaniment waveform data. For example, when "Fm" is not assigned to any accompaniment waveform data, "Song01_Main1_FM.wav" is also assigned to "Fm". In this case, at the time of performance using this audio music element data set, when the main switch MS1 is set to the on state and "FM" or "Fm" is input as a chord, "Song01_Main_FM.wav" indicates the performance pattern. Are set to be selected as data for generating performance pattern data representing.

  Further, the CPU 12a assigns each rhythm waveform data to the rhythm switch RS, and a key belonging to a predetermined second key area (for example, "C3" to "B3") of the plurality of keys constituting the keyboard device KY. Assign to each other so that they do not overlap. That is, the CPU 12a generates a table indicating the correspondence between each rhythm waveform data and the combination of the rhythm switch RS and the key, and stores the table in the storage device 14. When a performer plays using rhythm waveform data, the rhythm waveform data is depressed by pressing one key belonging to a predetermined second key range (for example, "C3" to "B3") of the keyboard device KY. Choose As shown in FIG. 6, when playing using the audio music element data set, for example, when the rhythm switch RS is set to ON and the key "C3" of the keyboard device KY is depressed, "Song01_Rhythm1. “wav” is set to be selected as data for generating performance pattern data representing a performance pattern.

  Further, the CPU 12a assigns each bridge waveform data to the bridge switch BS and assigns the bridge waveform data to keys belonging to a predetermined third key area (for example, "C4" to "B4") of the keyboard device KY so as not to overlap with each other. That is, the CPU 12a generates a table showing the correspondence between each bridge waveform data and the combination of the bridge switch BS and the key, and stores the table in the storage device 14. As shown in FIG. 6, when playing using the audio music element data set, for example, when the bridge switch BS is set to the ON state and the key "C4" of the keyboard device KY is depressed, "Song 01_Bridge 1. “wav” is set to be selected as data for generating performance pattern data representing a performance pattern.

  Note that one of the generated accompaniment waveform data, the plurality of rhythm waveform data, and the plurality of bridge waveform data represents one acoustic waveform of the music element of the present invention. In addition, one of the music element switches PS to which one of the generated accompaniment waveform data, the plurality of rhythm waveform data, and the one of the plurality of bridge waveform data is assigned, and one or more of the music element switches PS An operator group composed of a plurality of keys corresponds to the operator group of the present invention.

  The name of an audio music element data set consisting of a plurality of accompaniment waveform data, a plurality of rhythm waveform data, and a plurality of bridge waveform data generated as described above is “Song 01” which is the title of the music piece of the generation source. It associates and is set to "Song01_Component". That is, the name of the audio music element data set is set to a name in which the title of the music and "Component" are combined by "_".

  It returns to the explanation of FIG. 4 again. After generating the audio music element data set as described above, the CPU 12a ends the audio music element data set generation processing in step S16.

  Next, a procedure of generating performance pattern data representing performance patterns such as accompaniment style, rhythm, bridge and the like using the audio music element data set and supplying the same to the sound system 17 will be described. When the performer sets the operation mode of the musical performance device 10 to the audio music element performance mode using the input operator 11, the CPU 12a reads an audio music element performance program from the ROM 12b and executes the program. The audio style performance program comprises a performance pattern data generation program shown in FIGS. 7A and 7B and a performance pattern data supply program shown in FIG.

  First, the performance pattern data generation program will be described. In step S100, the CPU 12a starts a performance pattern data generation process. Next, in step S101, the CPU 12a executes an initialization process. For example, a predetermined value (for example, “0”) is written in an area (for example, first to fourth areas described later) of the RAM 12 b used in the present program.

  Next, in step S102, the CPU 12a displays the names of the audio music element data sets stored in the storage device 14 on the display 13 in list form. The player uses the input operator 11 to select one audio music element data set (for example, “Song 01_Component”) prior to the performance operation. Next, in step S103, the CPU 12a detects whether any one of the section selection switches SS is set to the on state. If all the switches are in the off state, the CPU 12a determines as “No”, and advances the process to step S109. On the other hand, when any one of the section selection switches SS is in the on state, the CPU 12a, in step S104, presses at least one of the keys belonging to the first key area. To detect if it is If none of the keys has been depressed, the CPU 12a determines that the result is "No" and advances the process to step S109. On the other hand, if at least one key is depressed, the CPU 12a proceeds to step S105. The pitch of the currently depressed key is detected, and the currently input code is detected.

  Next, in step S106, the CPU 12a causes the accompaniment waveform data assigned to the switch currently set to the on state of the section selection switch SS and the detected chord to a predetermined first area in the RAM 12b. Read Next, in step S107, the CPU 12a determines whether or not the chord of the accompaniment waveform data read in is the same as the chord detected. If the code of the read-in accompaniment waveform data and the detected code are the same, the CPU 12a determines “Yes” and advances the process to step S109. On the other hand, when the read accompaniment waveform data code and the detected code are different, the CPU 12a determines "No" and sets the read accompaniment waveform data to the detected code in step S108. Fix it.

  As described above, the accompaniment waveform data extracted by the first algorithm of FIG. 6 is read out by an operation similar to the operation of designating the section and chord of the MIDI accompaniment style.

  For example, the intro switch IS is set to the on state, and the "A" key and the "G #" key of the first key area are depressed (simple code specification method), or the "A" key and "C" It is assumed that the "Am" code is input (designated) by pressing the key and the "E" key (the usual code designation method). In the present embodiment, as shown in FIG. 6, “Song01_Intro_Am. Wav” is assigned to the intro switch IS and all the codes. Therefore, "Song01_Intro_Am. Wav" is read into the first area. In this example, since the input chord and the chord of the accompaniment waveform data are the same, the CPU 12a advances the process to step S109 while holding "Song01_Intro_Am.wav" in the first area. On the other hand, it is assumed that the intro switch IS is set to the on state, and "AM" is input as a code. As described above, since "Song01_Intro_Am.wav" is assigned to all the codes, "Song01_Intro_Am.wav" is selected in this case as well. In this example, the chords of the input chord and the accompaniment waveform data are different. Therefore, the CPU 12a applies a known algorithm (for example, JP 2012-203219) to "Song 01_Intro_Am.wav". That is, among the tones constituting "Song01_Intro_Am. Wav", tones having a key pitch of "C" are separated, the separated tones are pitch-changed, changed to "C #", and then re-synthesized. Thus, the code of "Song01_Intro_Am.wav" is corrected to "AM".

  Next, in step S109, the CPU 12a detects whether the rhythm switch RS is set to the on state. If the rhythm switch RS is in the off state, the CPU 12a determines that the result is "No", and advances the process to step S112. On the other hand, when the rhythm switch RS is in the on state, the CPU 12a detects in step S110 whether or not at least one of the keys belonging to the second key area is depressed. If none of the keys has been depressed, the CPU 12a determines that the result is "No" and advances the process to step S113. On the other hand, when at least one key is depressed, the CPU 12a selects the key at the end of the keys currently belonging to the second key area in step S111. Detect the key pitch of the selected key. Next, in step S112, the CPU 12a reads the rhythm waveform data assigned to the detected key pitch to a predetermined second area in the RAM 12b.

  Next, in step S113, the CPU 12a detects whether the bridge switch BS is set to the on state. If the bridge switch BS is in the off state, the CPU 12a determines that the result is "No", and advances the process to step S117. On the other hand, when the bridge switch BS is in the on state, the CPU 12a detects in step S114 whether or not at least one of the keys belonging to the third key area is depressed. If none of the keys has been depressed, the CPU 12a determines that the result is "No" and advances the process to step S117. On the other hand, when at least one key is depressed, the CPU 12a selects the last key of the keys currently belonging to the third key area in step S115. Detect the key pitch of the selected key. Next, in step S116, the CPU 12a reads the bridge waveform data assigned to the detected key pitch to the predetermined third area in the RAM 12b.

  Next, in step S117, the CPU 12a superimposes and adds the accompaniment waveform data, the rhythm waveform data, and the bridge waveform data stored in the first area, the second area, and the third area, respectively, to obtain one performance pattern. Performance pattern data representing an acoustic waveform is generated and written in a predetermined fourth area of the RAM 12b. After that, the CPU 12a repeatedly executes the process including steps S103 to S117. The performance pattern data is composed of a plurality of sample values. The plurality of sample values are stored in the fourth area in the order of reproduction (D / A conversion). That is, by reading out each sample value sequentially from the top address to the end address of the fourth storage area and supplying the sample values to the sound system 17, the performance pattern represented by the performance pattern data can be reproduced. There is.

  Next, a performance pattern data supply program will be described. The CPU 12a executes a performance pattern data supply program in parallel with the above-mentioned performance pattern data generation program.

  At step S200, the CPU 12a starts a performance pattern data supply process. Next, in step S201, the CPU 12a executes an initialization process. For example, a value of a pointer pointing to an address which is one address of the fourth area and which stores one sample value constituting the performance pattern data is set to the top address of the fourth area. Next, in step S202, the CPU 12a supplies the sample value stored at the address pointed by the pointer to the sound system 17. Next, the CPU 12a advances the pointer by one in step S203. That is, the value of the pointer is set to one address after the current address. However, when the current address is at the end of the performance pattern data, the value of the pointer is set to the start address of the fourth area. Next, after waiting for the next sampling period to arrive in step S204, the CPU 12a advances the process to step S201. As a result, the CPU 12a supplies one sample value to the sound system 17 every predetermined sampling period (1 / 44,100 seconds in the present embodiment).

  Therefore, in the performance using the accompaniment waveform data of the audio music element data set, the performance pattern of the currently selected section is repeatedly played. Also, for example, even when the switch of the section different from the currently selected section is set to the on state during the playing of the section, the playing is continued without interruption. The performance of the current performance pattern is continued until the end of the current measure is reached, and thereafter, the performance is started from the beginning of the next section. That is, the CPU 12a executes step S117 when the end of the current measure is reached. In addition, when the switch of the next section is set to the on state, the performance may be continued from the position in the middle of the next section, which corresponds to the playing progress position in the current section. When a chord is newly input in the middle of a bar, when the end of the bar is reached, the chord is changed to the newly input chord, and the performance is continued. When the end of the ending section corresponding to the ending switch ES is reached, the CPU 12a ends the performance using the audio music element data set, and sets all music element switches PS belonging to the music element switch PS to the off state. . Further, even when the player selects to stop the performance using the input operator 11, the CPU 12a ends the performance using the audio music element data set, and all the switches belonging to the music element switch PS Set to off state.

  In the performance device 10 configured as described above, the accompaniment waveform data, the rhythm waveform data, and the bridge waveform data are not stored in advance in the performance device 10, but are extracted from acoustic waveform data of a desired music. The performance pattern data representing each performance pattern of the accompaniment style, rhythm and bridge is not generated by the tone generator circuit 16 based on the MIDI data, but based on the waveform data cut out from the acoustic waveform data of the original music. Generated. Therefore, according to the musical performance apparatus 10, it is possible to reproduce an attractive performance pattern such as a live performance. Further, in the musical performance apparatus 10, the operator groups to which the accompaniment waveform data, the rhythm waveform data and the bridge waveform data are respectively assigned do not overlap each other. Therefore. According to the musical performance apparatus 10, each waveform data extracted from the acoustic waveform data of the existing music is alternatively or superimposedly selected (designated) in real time, and the performance pattern is selected using the selected (designated) waveform data. It can be played back. That is, it is possible to reproduce the performance pattern using only one of the accompaniment waveform data, the rhythm waveform data and the bridge waveform data, and also to reproduce the performance pattern in which two or all of them are superimposed. Moreover, with regard to accompaniment waveform data, even if there is no accompaniment waveform data corresponding to the section and chord of the accompaniment style selected (designated) by the performer, the accompaniment is corrected by correcting the component sound of the accompaniment waveform data of the same section. The code of the waveform data can be corrected to the specified code (see S107 and S108). Therefore, the variation of the playing pattern can be increased more than before. Also, existing songs can be easily arranged. When the acoustic waveforms respectively represented by two or all of the accompaniment waveform data, the rhythm waveform data, and the bridge waveform data are superimposed, the performances of some musical instruments may overlap. In this case, a filter may be applied to any waveform data of the accompaniment waveform data, the rhythm waveform data, and the bridge waveform data to be superimposed to reduce the volume of the performance sound of the part of the musical instrument.

  Further, since an algorithm to be applied to acoustic waveform data can be selected, only necessary waveform data can be generated. For example, when bridge waveform data is unnecessary, only accompaniment waveform data and rhythm waveform data can be generated. According to this, wasteful consumption of the storage capacity of the storage device 14 can be suppressed.

  Furthermore, the implementation of the present invention is not limited to the above embodiment, and various modifications can be made without departing from the object of the present invention.

  In the above embodiment, three types of algorithms can be applied to the acoustic waveform data of music, but these algorithms are not limited to the above embodiments and may be other algorithms. For example, in the above embodiment, although the accompaniment waveform data includes the drum part, an algorithm may be applied which generates data in which the performance of the playing part excluding the drum part is included among the accompaniment parts. . Further, in the above embodiment, although the bridge waveform data includes all the performance parts, an algorithm may be applied which generates data in which only the vocal parts and the melody parts are included. As described above, if the types of instruments do not overlap between waveform data used simultaneously (in parallel), the combination of waveform data used simultaneously can be freely changed. For example, the rhythm waveform data of the middle part of the original music can be combined with the accompaniment waveform data in the introduction part of the original music. According to this, the variation of the playing pattern increases dramatically.

  In the above embodiment, the audio music element data set is generated using the entire original song, but a part of the original song may be used. In this case, it is preferable to select a part of the acquired acoustic waveform data of the original music to be used to generate the audio music element data set.

  In addition, a known algorithm for changing the tempo without changing the pitch may be applied to each waveform data of the audio music element data set. Also, the acoustic waveform data of the original music and the audio acoustic waveform data set may be stored in a server connected to the CPU 12a via the network. Furthermore, the server may execute a program for generating an audio music element data set, and the result may be made available to the CPU 12a. In the above embodiment, the keyboard device KY is used when designating a chord, but information representing a chord received from an external device may be used.

BS: bridge switch, PS: music element switch, ES: ending switch, FS: fill-in switch, IS: intro switch, KY: keyboard device, MS1: main switch, MS2: main switch, MS3: main switch, RS: rhythm switch, SS: section selection switch, WM: waveform memory, 10: performance device, 11: input operator , 12: computer unit, 13: display, 14: storage device, 15: external interface circuit, 16: sound source circuit, 17: sound system

Claims (8)

With multiple operators,
Acoustic signal acquisition means for acquiring an acoustic signal representing an acoustic waveform of the played sound emitted by playing the music;
The first music element and the second music signal are extracted from the sound signal in accordance with one or both of a first algorithm and a second algorithm that respectively extract the sound waveforms of the first music element and the second music element included in the sound signal. Music element extraction means for extracting an acoustic waveform of one or both of the music elements;
Assigning means for assigning the extracted acoustic waveform to any one or more operators of the plurality of operators;
A performance representing a playing pattern by detecting that one or more operators to which the acoustic waveform is assigned is operated, and using the acoustic waveform assigned to the operated one or more operators Performance pattern data generating means for generating pattern data;
A playing device equipped with In the playing device according to claim 1,
The music apparatus is any one of a melody of the music, an accompaniment, a performance pattern of a rhythm performance part, and a performance pattern of an intro part, a bridge part, and an insertion phrase part of the music. In the playing device according to claim 1,
The assignment unit is configured to assign the first music element and the second music element to a first operator group and a second operator group respectively composed of one or more operators among the plurality of operators. Assign waveform data respectively,
When only one of the first operator group and the second operator group is operated, based on the acoustic waveform of the music element assigned to the operated operator group. Performance pattern data is generated, and when both the first operator group and the second operator group are operated, performance pattern data is generated based on the acoustic waveforms of the first music element and the second music element A playing device to generate. In the playing device according to claim 3,
A playing device, wherein a combination of the operators constituting the first operator group and a combination of the operators constituting the second operator group are different. In the playing device according to claim 1,
The musical instrument extraction means comprises a selection means for selecting an algorithm to be applied to the acoustic signal. The musical performance apparatus according to any one of claims 1 to 5,
The first music element is a performance pattern of an accompaniment part,
The acoustic waveform representing the first music element is stored in association with the type and chord of the chord of the performance pattern of the accompaniment part,
The performance pattern data generation means
The stored sound is detected when a chord corresponding to the one or more operators being operated is detected, and an acoustic waveform of the first music element corresponding to the detected chord is stored. The waveform is read out and reproduced, and when the acoustic waveform of the first music element corresponding to the detected chord is not stored, the generation mode of the performance sound represented by the acoustic waveform of the first music element is a chord tone A musical performance apparatus capable of generating musical performance pattern data representing a musical performance sound whose generation mode relating to Y. has been changed according to the detected chord. A computer program applied to a playing device having a plurality of operators, the computer provided in the playing device comprising:
An acoustic signal acquisition step of acquiring acoustic signals,
The first music element and the second music signal are extracted from the sound signal in accordance with one or both of a first algorithm and a second algorithm that respectively extract the sound waveforms of the first music element and the second music element included in the sound signal. A music element extraction step of extracting an acoustic waveform of one or both of the music elements;
An assignment step of assigning the extracted acoustic waveform to any one or more operators among the plurality of operators.
A performance representing a playing pattern by detecting that one or more operators to which the acoustic waveform is assigned is operated, and using the acoustic waveform assigned to the operated one or more operators A computer program that executes a process including a performance pattern data generation step of generating pattern data.   A playing pattern data generation method applied to a playing device having a plurality of operators, comprising:
  An acoustic signal acquisition step of acquiring an acoustic signal;
  The first music element and the second music signal are extracted from the sound signal in accordance with one or both of a first algorithm and a second algorithm that respectively extract the sound waveforms of the first music element and the second music element included in the sound signal. A music element extraction step of extracting an acoustic waveform of one or both of the music elements;
  An assignment step of assigning the extracted acoustic waveform to any one or more operators among the plurality of operators.
  A performance representing a playing pattern by detecting that one or more operators to which the acoustic waveform is assigned is operated, and using the acoustic waveform assigned to the operated one or more operators A performance pattern data generation step of generating pattern data.

Images