JP3722035B2 - Performance signal processing apparatus, method and program, and storage medium - Google Patents

Description

[0001]
[Field of the Invention]
  The present invention relates to a performance signal processing apparatus capable of editing music data., Method and program, and storage mediumAbout.
[0002]
[Prior art]
Conventionally, automatic performance data (hereinafter referred to as “song data”) including MIDI (Musical Instrument Digital Interface) data, lyrics data, etc. is composed of only musical note information or musical tone characteristic data such as velocity is uniform. In some cases, since it is mechanical and has no facial expression, a performance signal processing apparatus is known in which expression is added to the emotional expression so as to express the music. In this apparatus, the music characteristics (velocity, expression, etc.) of the song data are changed by reading out the existing song data from the storage medium or by the user creating and inputting it with DTM (desktop music). , More natural performance, beautiful performance, lively performance can be realized.
[0003]
Here, the composition of the music generally has a consequent change, for example, intro, A melody (Melody A), A melody A (melody A 'similar to melody A), B melody, C melody, ending, etc. It can be recognized that it is divided into several categories under specific rules. The optimal setting of the musical tone characteristics of the music is influenced by the composition of the music itself. For example, there is a case where it is desired to slightly vary the volume, tone nuance and expression between the “roll” portion and the “cross” portion in the initial roll. In addition, there is a common feature in the optimal musical sound characteristics according to the composition of the music, such as “It is suitable to set the fluctuation of velocity due to music progression in this way for music with such a melody pattern”. It often appears.
[0004]
Conventionally, in order to express a song with rich expressiveness, the user has to set a musical tone characteristic for each note of the song data, which requires not only familiarity with the characteristics of music and instruments, It was complicated and time consuming.
[0005]
On the other hand, as a technique for performing facial expression even if there is little knowledge or experience, a control data template created in advance is selected and input into the song data, and then the shape of the control data template and the length in the time direction are selected. There is also known a control data input method to be corrected (Japanese Patent Laid-Open No. 9-6346).
[0006]
[Problems to be solved by the invention]
However, in the control data input method, the user must select and input an optimal control data template for each individual piece of music data, and the operation is not easy. In addition, when viewed as a whole piece of music, regardless of individual parts, the above-described conventional method is not necessarily suitable for giving a natural expression.
[0008]
In order to make it easy for a wide range of users to use, it is advantageous that the part that can be judged on the apparatus side can be automatically performed as much as possible. As described above, the conventional technique has room for improvement in performing natural expression with a simple operation.
[0009]
  The present invention has been made to solve the above-mentioned problems of the prior art, and its purpose is as follows.The division of song data is automatically performed to reduce the burden on the user,A performance signal processing device that can add natural expressions to song data with simple operations, Method and program, and storage mediumIs to provide.
[0019]
  To achieve the above object, the claims of the present invention are described.1In the performance signal processing apparatus capable of editing music data, any one of music data dividing means for dividing music data into a plurality of sections and inflection data defining temporal changes in parameters Intonation data specifying means for specifying intonation data, and intonation data expansion / contraction means for temporally expanding / contracting intonation data specified by the intonation data specifying means in accordance with at least one section divided by the music data dividing means, A musical tone characteristic control means for controlling a musical tone characteristic of the at least one section of the music data based on a temporal change of a parameter defined by intonation data expanded / contracted by the intonation data expansion / contraction means; The song data is divided into pieces by the song data dividing means and the inflection data specifying means The inflection data is specified such that the number of sections constituting the music data matches the number of sections constituting the intonation data, and the expansion / contraction of the intonation data by the intonation data expansion / contraction means is performed by the music data. Is performed for each section of the intonation data corresponding to each section, and the control of the tone characteristics by the tone characteristic control means is performed for each section of the song data corresponding to each section of the intonation data. It is characterized by that.
  Claims of the invention2The performance signal processing apparatus according to claim 11In the configuration described above, the music data is divided by the music data dividing unit based on at least one of music data to be divided and user designation.
  With this configuration, if the song data is divided based on the song data to be divided, the division can be performed semi-automatically and the burden on the user is reduced. On the other hand, if the song data is divided based on the user's designation. , More appropriate division can be performed. Therefore, it is possible to perform simpler facial expression or facial expression faithful to the user's intention and improve usability.
  Claims of the invention3The performance signal processing apparatus according to claim 11 or 2In the configuration described above, the intonation data is specified by the inflection data specifying unit based on the song data divided by the song data dividing unit.
[0020]
  With this configuration, it is possible to specify intonation data that matches the division configuration and the number of divisions of the divided music data. The inflection data is specified based on, for example, the music data division method and the number of pieces of music data, or in addition to these, the music characteristics to be changed.Yes.
[0021]
  UpTo achieve the object, the claims of the present invention4The musical performance signal processing method includes a song data dividing step for dividing song data into a plurality of sections, an inflection data specifying step for specifying any intonation data among inflection data for defining temporal changes in parameters, and the song Specified by an inflection data expansion / contraction step that temporally expands / contracts intonation data specified by the inflection data identification step according to at least one division divided by the data division step, and inflection data expanded / contracted by the inflection data expansion / contraction step A musical tone characteristic control step of controlling a musical tone characteristic of the at least one section of the music piece data based on a temporal change of a parameter to be performed, wherein the intonation data is composed of a plurality of sections, and the music piece data dividing step The division of the song data by the step and the specification of the intonation data by the intonation data specifying step are the categories constituting the song data. The number is made to coincide with the number of sections constituting the intonation data, and the expansion / contraction of the intonation data by the intonation data expansion / contraction step is performed for each section of the intonation data corresponding to each section of the music data. And the control of the musical sound characteristics by the musical sound characteristic control step is performed for each section of the music data corresponding to each section of the intonation data..
  UpTo achieve the object, the claims of the present invention5The performance signal processing program is a performance signal processing program to be executed by a computer, and includes any one of a music data division module that divides music data into a plurality of sections and an inflection data that defines temporal changes in parameters. An inflection data identification module for identifying data, an inflection data expansion / contraction module that temporally expands / contracts intonation data identified by the intonation data identification module in accordance with at least one section divided by the song data division module, A musical tone characteristic control module that controls a musical tone characteristic of the at least one section of the song data based on a temporal change of a parameter defined by intonation data expanded and contracted by an inflection data expansion and contraction module, The music data division module is composed of a plurality of sections. The song data is divided by the inflection data and the intonation data is identified by the inflection data identification module such that the number of sections constituting the song data matches the number of sections constituting the intonation data, and The expansion / contraction of the intonation data by the inflection data expansion / contraction module is performed for each section of the intonation data corresponding to each section of the music data, and the control of the musical sound characteristic by the musical sound characteristic control module is performed on the inflection data. It is performed for each section of the music data corresponding to each section.
  To achieve the above object, the claims of the present invention are described.6The storage medium of claim5The performance signal processing program described in 1) is stored in a computer-readable manner.
  Here, the music data division methods include “manual division”, “automatic division”, “equal division”, and the like. Further, “inflection data” is data for giving inflection to music, and defines temporal changes in parameters, and these temporal changes in parameters are used to control musical sound characteristics of music data classification. As the “musical sound characteristics”, for example, values of various control changes (vibrato, effect (reverb, chorus, delay, etc.), timbre change, etc.) as well as velocity, expression, and sounding timing can be targeted.
  As a technique for matching the number of sections constituting music data with the number of sections constituting inflection data, after dividing the music data, inflection data that matches the number of sections constituting the music data is used. In addition to the identification method, a method of dividing or redoing music data so as to match the specified number of intonation data categories can be considered.
[0042]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0043]
(First embodiment)
FIG. 1 is a block diagram showing the overall configuration of the performance signal processing apparatus according to the first embodiment of the present invention. The performance signal processing apparatus is configured as a personal computer capable of performing DTM (desktop music), for example.
[0044]
The performance signal processing apparatus includes a key depression detection circuit 3, a switch detection circuit 4, a ROM 6, a RAM 7, a timer 8, a display control circuit 9, a floppy disk drive (FDD) 10, a hard disk drive (HDD) 11, a CD-ROM (compact). A disk-read only memory) drive 12, a MIDI interface (MIDII / F) 13, a communication interface (communication I / F) 14, a sound source circuit 15, an effect circuit 16, and a mouse information detection circuit 20 are connected via a bus 18. Each is connected to a CPU 5 (music data dividing means, intonation data specifying means, intonation data expansion / contraction means, musical tone characteristic control means, pattern forming means, volume characteristic setting means).
[0045]
Further, the keyboard 1 is connected to the key press detection circuit 3, and the panel switch 2 is connected to the switch detection circuit 4. The mouse information detecting circuit 20 is connected to a mouse 21 (position specifying means) having a switch and having a switch, and the display control circuit 9 is connected to a display device 19 composed of, for example, an LCD or a CRT. A timer 8 is connected to the CPU 5, and another MIDI device 100 is connected to the MID II / F 13. A server computer 102 is connected to the communication I / F 14 via the communication network 101, and an effect circuit 16 and a sound system 17 are connected to the sound source circuit 15 in series.
[0046]
The key press detection circuit 3 detects the key press state of each key (not shown) of the keyboard 1. The panel switch 2 includes a plurality of switches (not shown) for inputting various information. The switch detection circuit 4 detects the pressed state of each switch of the panel switch 2. The CPU 5 controls the entire apparatus. The ROM 6 stores a control program executed by the CPU 5, table data, and the like. The RAM 7 temporarily stores various input information such as automatic performance data, musical score display image data, text data, and calculation results. The timer 8 measures the interrupt time and various times in the timer interrupt process. The display control circuit 9 displays various information such as a score on the display device 19.
[0047]
The FDD 10 drives a floppy disk (FD) 24 that is a storage medium. The FD 24 stores the control program, various application programs, various data, and the like. The HDD 11 as an external storage device stores various application programs including the control program, various data, and the like. The CD-ROM drive 12 drives a CD-ROM (not shown) in which various application programs including the control program and various data are stored.
[0048]
The MIDII / F 13 inputs a MIDI (Musical Instrument Digital Interface) signal from an external device such as another MIDI device 100 or outputs a MIDI signal to the external device. The communication I / F 14 transmits / receives data to / from the server computer 102 via the communication network 101, for example. The tone generator circuit 15 converts music data such as automatic performance data input from the FDD 10, the CD-ROM drive 12 or the MIDII / F13 into a musical sound signal. The effect circuit 16 gives various effects to the musical sound signal input from the sound source circuit 15, and the sound system 17 such as a DAC (Digital-to-Analog Converter), an amplifier, and a speaker performs the musical sound signal input from the effect circuit 16. To sound. The mouse information detection circuit 20 detects movement information of the mouse 21 and operation information such as switch on / off.
[0049]
In the present embodiment, the sound source circuit 15 is entirely configured by hardware as the name suggests, but is not limited thereto, and may be configured by a part of software and the remaining part may be configured by hardware. Alternatively, all may be configured by software.
[0050]
The HDD 11 can store a control program executed by the CPU 5 as described above. When the control program is not stored in the ROM 6, the control program is stored in the hard disk in the HDD 11, and by reading it into the RAM 7, the same operation as when the control program is stored in the ROM 6 is performed. It can be made to CPU5. In this way, it is possible to easily add a control program or upgrade a version.
[0051]
The control program and various data read from the CD-ROM by the CD-ROM drive 12 are stored in the hard disk in the HDD 11. As a result, a new installation or version upgrade of the control program can be easily performed. In addition to the CD-ROM drive 12, other devices for using various types of media such as a magneto-optical disk (MO) device may be provided as an external storage device.
[0052]
The MIDII / F 13 is not limited to a dedicated one, and may be configured by a general-purpose interface such as RS-232C, USB (Universal Serial Bus), IEEE 1394 (Eye Triple E 1394). In this case, data other than MIDI messages may be transmitted and received simultaneously.
[0053]
As described above, the communication I / F 14 is connected to the communication network 101 such as a LAN (local area network), the Internet, or a telephone line, and is connected to the server computer 102 via the communication network 101. When the above programs and various parameters are not stored in the hard disk in the HDD 11, the communication I / F 14 is used to download programs and parameters from the server computer 102. A computer serving as a client (a performance signal processing apparatus in the present embodiment) transmits a command for requesting downloading of a program and parameters to the server computer 102 via the communication I / F 14 and the communication network 101. Upon receiving this command, the server computer 102 distributes the requested program and parameters to the computer via the communication network 101, and the computer receives these programs and parameters via the communication I / F 101 and stores them in the HDD 11. Downloading is completed by accumulating on the hard disk.
[0054]
In addition, an interface for directly exchanging data with an external computer or the like may be provided.
[0055]
In the present embodiment, the song data is automatic performance data including MIDI data, lyrics data, etc., and the existing song data includes the FDD 10, the CD-ROM drive 12, the MIDII / F13, and the communication I / F14 as described above. Is read out or input via The music data can also be created by the user and input with the keyboard 1 or the mouse 21. The read or input music data is stored in the RAM 7 and displayed on the display device 19 and is subjected to musical tone generation processing (playback, etc.), facial expression processing, and various editing processing described later.
[0056]
FIG. 2 shows a flowchart of the main routine in the present embodiment. This process is started when the power is turned on.
[0057]
First, initialization is executed, that is, execution of a predetermined program is started, and various registers such as the RAM 7 are cleared and initialization is performed (step S201). Next, panel processing shown in FIGS. 3 and 4 described later, that is, operations of the panel switch 2 and the mouse 21 are accepted, and instructions such as device setting and song data editing are executed (step S202). Next, musical tone processing is executed (step S203). For example, when the reproduction process is being executed, the music data is read, the set effect process is added, amplified and output. Thereafter, the process returns to step S202.
[0058]
3 and 4 are flowcharts of the panel process executed in step S202 of FIG.
[0059]
First, it is determined whether or not there is a panel input, that is, whether or not there is any operation with the panel switch 2 or the mouse 21 (step S301). As a result of the determination, if there is no panel input, the present process is immediately terminated. On the other hand, if there is a panel input, it is determined whether or not it is an instruction for expression processing (step S302). Note that when this process is executed (when the device or software is started up), the settings at the time of the previous completion of the initial settings are read, so the song data to be processed is prepared without any special settings. ing.
[0060]
If the result of determination in step S302 is that the panel input is not a facial expression processing instruction, it is determined whether or not it is a performance-related instruction (step S303 in FIG. 4). If the panel input is not a performance-related instruction as a result of the determination, it is determined whether or not the panel input is a song change designation (step S304).
[0061]
If the result of determination in step S303 is that the panel input is a performance-related instruction, it is determined whether or not it is a reproduction instruction (step S305). As a result of the determination, if the performance-related instruction is a reproduction instruction, reproduction of the currently displayed song data is started (step S306), and the present process ends. On the other hand, if the performance-related instruction is not a reproduction instruction, The process proceeds to step S307.
[0062]
In step S307, it is determined whether or not the performance-related instruction is a stop instruction. As a result of the determination, if the performance-related instruction is a stop instruction, the performance reproduction is stopped (step S308), and this process is terminated. On the other hand, if the performance-related instruction is not a stop instruction, other instruction processing is performed. Execute, for example, advance processing (slowly advance playback points (fast forward)), return processing (slowly return playback points (fast reverse)), and start processing (return playback points to the beginning of the song) ( Step S309), the process ends.
[0063]
If the result of determination in step S304 is that the panel input is a song change designation, the designation of the song to be processed for playback or editing is accepted and changed (step S310), and the changed song data is read out. Various information is input and displayed (step S311), and the process is terminated. On the other hand, if the result of determination in step S304 is that the panel input is not a song change designation, other instruction processing is executed, for example, editing other than song data expression processing and various editing processing are performed (step S312). ), This process is terminated.
[0064]
If the result of determination in step S302 is that the panel input is a facial expression processing instruction, the facial expression processing is executed in steps S313 to S325. That is, first, a music data division method is displayed (step S313), selection of a division method is accepted (step S314), and music data division processing is executed by the accepted method (step S315) (music data division means). Corresponding). Here, the music data division methods are roughly classified into “manual division”, “automatic division”, and “equal division”.
[0065]
The “manual division” is a method in which the user manually designates the division position while viewing the music data display or listening to the reproduction of the music. For example, if the song data is created by the user himself, the composition of the song is known, such as starting and falling, and it is easy for the user to determine where the division is most appropriate. It is appropriate to select.
[0066]
“Automatic division” is a method in which the apparatus side (CPU 5) determines and automatically designates a division position. For example, a position where it can be determined that the phrase is separated is set as a division position. There are the following methods for determining the separation of phrases.
[0067]
a: When a rest length longer than a predetermined length is found, a section immediately after the rest is set as a new division section, and a rest is set as a division position.
[0068]
b: Recognize phrase breaks based on the regularity of notes, such as pitch jumps, rhythm changes, time signature changes, tempo changes, changes in the number of notes, and tone average changes.
[0069]
c: When the same melody is repeated, when the same melody appears again, it is set as a new division section, and accordingly, the division positions are set between the respective melody.
[0070]
Although partially overlapping with these methods, GTTM (a General Theory of Tonal Music) (Chapter 4) introduced in “The World of Computers and Music: Kyoritsu Publishing: Yoichi Nagashima, Shuji Hashimoto, Joe Hiraga, Junji Hirata” There is also a method of automatically determining the division position using structural analysis by Section 6: Yoshihiro Takeuchi). This GTTM analyzes music into a hierarchical structure based on human music perception and cognition processes. The group structure, time structure, time span reduction, and extended reduction necessary for music perception and recognition. The four components are analyzed.
[0071]
These “automatic division” methods may be applied alone or in combination. Further, when the song data includes lyrics data, the division position may be specified by analyzing the lyrics, for example, based on a break between lyrics.
[0072]
“Equal division” is a method of dividing music data into equal divisions. In “equal division”, there is a technique in which the entire music data is equally divided into a plurality of equal parts, and there is a technique in which only a specific division such as an intro and an ending is set to a specified number of bars and other parts are equally divided. “Equal division” may be performed by the number of bars or by the number of notes.
[0073]
The user specifically selects and designates a division method to be applied from among these various division methods. The music data is divided into a plurality of pieces (for example, several sections to about 10 sections) by the dividing process.
[0074]
After the division process is executed, if there is an instruction to redo the division, it is accepted. In step S316, it is determined whether or not there is an instruction to redo the division. As a result of the determination, if there is an instruction to redo the division, the process returns to step S313, and the selection of the division method and the division process are performed again. Note that, as a result of the division in step S315, if only some of the division positions do not match the user's will, the positions may be specified and the division positions may be changed manually.
[0075]
In step S317, a list of tone characteristics to be changed is displayed. As the tone characteristics, for example, values of various control changes (vibrato, effects (reverb, chorus, delay, etc.), timbre changes, etc.) as well as velocity, expression, and sounding timing can be targeted. Next, selection of a musical sound characteristic to be changed is accepted (step S318), and it is determined whether or not there is an instruction to redo the selection of musical sound characteristics (step S319). As a result of the determination, if there is an instruction to redo the selection of the musical sound characteristics, the process returns to the step S317 to display the musical sound characteristics and accept the selection again. The process proceeds to step S320.
[0076]
In step S320, inflection data candidates adapted to each segment of the divided music data are extracted and displayed. Here, the intonation data will be described.
[0077]
FIG. 5 is a diagram illustrating an example of the division of music data and inflection data. FIG. 4A shows music data before division processing, FIG. 5B shows music data after division processing, and FIG. 4C shows inflection data composed of a plurality of sections. In the same figure, the case where music data is divided into 6 sections is illustrated.
[0078]
Inflection data is data for giving inflection to music, and as shown in FIG. 5C, defines temporal changes in parameters for each section. This parameter is received in step S318 and defines the temporal change of the specified musical tone characteristic, and is used to control the musical tone characteristic in the musical tone characteristic changing process (step S324) described later. A plurality of patterns of inflection data composed of a plurality of sections (six sections are illustrated in FIG. 5C) are stored in the ROM 6 or the like in advance. The inflection data may be stored in the HDD 11, or the inflection data may be added or updated via the FDD 10, the CD-ROM 12, or the communication I / F 14. Note that the intonation data is not limited to a pattern with six sections, but there are patterns with various sections.
[0079]
In step S320, the optimum inflection data is selected from among the plurality of inflection data stored in the ROM 6, based on the above-specified music data division method, the number of music data division categories, and the tone characteristics to be changed. At least one is extracted and displayed on the display device 19 as a candidate.
[0080]
In other words, the inflection data adapted to the music data differs depending on the music data dividing method and the number of divisions. For example, by “manual division” or “automatic division” by the user, music data is divided into intro, A melody, A melody ', B melody, and A melody ending as shown in FIG. In such a case, the inflection data of the segment pattern that matches such a melody configuration is extracted. In these cases, only the inflection data whose number of divisions matches the number of divisions (six) of the music data is targeted for extraction. This makes it possible to appropriately and easily control the tone characteristics described later based on the intonation data. In the case of “equal division”, inflection data in which the number of divisions and the division pattern are set in advance as being suitable for music data divided by “equal division” is selected.
[0081]
In addition to this, the intonation data adapted to the music data also varies depending on the tone characteristics to be changed. Therefore, even if the division method and the number of division sections are the same, the applied inflection data differs depending on whether the tone characteristic to be changed is, for example, velocity or expression. In the case of a simpler configuration, intonation data may be extracted based only on the music data division method and the number of divisions of music data without considering the musical sound characteristics.
[0082]
Next, in step S321, specification of intonation data is accepted (corresponding to intonation data specifying means). That is, there may be a plurality of inflection data extracted as described above. In this case, the user specifies one inflection data from among the candidates for the inflection data. If there is only one candidate, a confirmation message or the like may be displayed to accept confirmation.
[0083]
Next, in step S322, it is determined whether or not there is an instruction to redo specifying inflection data. As a result of the determination, if there is an instruction to redo the inflection data specification, the process returns to step S320, and the display of the intonation data candidate and the specific reception are executed again, while there is no instruction to redo the inflection data specification. In the case, the process proceeds to step S323. If only some of the inflection data classifications specified in step S321 are not suitable for the user, the classification is specified by manual operation and only the other classification is selected. You may make it replace. In this case, the “other section” may be a section in another pattern. In addition, in this case, it is preferable to facilitate a large number of variations of “other sections”. Further, although all the candidates are displayed in the step S320, only one candidate may be displayed for the time being, and an operation of replacing each category by another manual operation may be performed.
[0084]
In a succeeding step S323, it is determined whether or not an instruction to start the musical sound characteristic changing process is given. As a result of the determination, if there is no instruction to start the musical tone characteristic changing process, the process returns to step S313. Note that when there is no instruction to start the tone characteristic changing process in step S323, the user may be able to specify which one of steps S313, S317, and S320 is returned to. As a result of the determination in step S323, if there is an instruction to start the tone characteristic change process, the process proceeds to step S324.
[0085]
In step S324, musical tone characteristic changing processing, that is, processing for individually changing the musical tone data characteristics of the musical piece data by applying inflection data to the musical piece data is executed. The musical sound characteristic changing process includes a processing step (corresponding to intonation data expansion / contraction means) for associating song data and intonation data for each section and decompressing inflection data, and for music data based on the decompressed intonation data. There is a processing step (corresponding to the musical tone characteristic control means) for changing the musical tone characteristic.
[0086]
First, in association for each section, as shown in FIG. 5, for example, six sections of the divided music data (FIG. 5B) and six sections of the extracted inflection data (FIG. c)) are matched in order. For example, the intro shown in FIG. 10B corresponds to the intro shown in FIG. Next, in the expansion of intonation data, the inflection data is expanded in time so that each section of intonation data matches the section of music data corresponding thereto.
[0087]
FIG. 6 and FIG. 7 are diagrams illustrating one set of song data division and intonation data division corresponding to each other. FIG. 6 shows before expansion of the intonation data, and FIG. 7 shows after expansion. FIG. 6A shows the note event data in one section in the music data, and FIG. 6B shows the velocity set in advance in the music data. This velocity setting is not only performed originally in the music data, but may also be performed in the previous musical sound characteristic changing process. In the example of FIG. 5B, the velocity is uniform for each note event data. FIG. 4C shows the temporal change of the parameter within one section of intonation data. These are the same in FIGS. 7A, 7B, and 7C.
[0088]
As shown in FIG. 6, the time lengths of the song data section and the inflection data section do not necessarily match only by performing the association processing for each section. Therefore, in the intonation data decompression process, the inflection data segment is decompressed so that both the start timing and end timing of the song data segment and the intonation data segment match. As a result, as shown in FIG. 7, the length of the inflection data in the time direction matches that of the song data.
[0089]
In the present embodiment, it has been described that the inflection data is decompressed on the assumption that the inflection data section is always shorter than the song data section. Data can be shortened in time.
[0090]
In the remaining musical tone characteristic changing process, the musical tone characteristic of the music data specified in step S318 is changed. As described above, the musical sound characteristics include velocity, expression, timing of sound generation, and the like. As described with reference to FIG. 6 and FIG.
[0091]
FIG. 8 is a diagram exemplifying one set of a song data category and intonation data category corresponding to each other. FIGS. 7A, 7B, and 7C correspond to FIGS. 7A, 7B, and 7C, and the velocity of the music data is changed based on the intonation data after the decompression process. Shows the case. In this example, the velocity of each note event is changed according to the value of the parameter indicated by the intonation data at the time of note-on of the note event. For example, the velocity of the second note event NE2 shown in FIG. 8A is set according to the parameter value V2 indicated by the inflection data at the note-on time t2 (FIG. 8C). As shown in FIG. 8B, the velocity of the note event NE2 is changed from the original velocity (FIG. 7B). In this manner, the velocity is set and changed for each note event NE.
[0092]
Note that the musical sound characteristic change processing method is not limited to the method of changing according to the parameter value at the time of note-on. For example, a parameter value at the note-off time may be adopted, or an average value of both parameter values at the note-on time and the note-off time may be adopted. Alternatively, a maximum value, a minimum value, a median value, or the like from the note-on point to the note-off point may be employed. In addition, the value after applying specific arithmetic processing such as the value at the note-off time as a result of LPF processing with the value at the note-on time as the initial value and the value at the note-off time as the target value is adopted. May be.
[0093]
In addition, as described above, the value of various control changes can be the target of the musical tone characteristic change process instead of velocity, but when applied to the value of control change, the temporal change of the parameter of the inflection data A broken line shape as shown in FIGS. Therefore, in this case, it is desirable to apply after performing appropriate arithmetic processing such as applying an LPF so as to obtain an appropriate curve. The parameter indicated by the intonation data may be either analog data or digital data.
[0094]
These are the musical sound characteristic changing processes in step S324 of FIG. 3, but this process is similarly performed for all the divisions of the music data. As a result, expression is given to the music data. Note that this processing may be performed only for the category desired by the user. The music data usually includes a plurality of musical sound characteristics. However, the processing in steps S313 to S325 may be performed for all musical sound characteristics that are desired to be changed.
[0095]
In the subsequent step S325, the music data after the musical sound characteristic has been changed in the step S324 is registered as expression-finished music data. This registration is performed by being stored in the RAM 7. At that time, the song data that has been subjected to the facial expression processing may be overwritten on the original song data, or may be stored separately from the original song data, but these can be arbitrarily selected by the user. Is preferable. Thereafter, this process is terminated.
[0096]
According to the present embodiment, inflection data adapted to the divided music data is extracted and specified, and each section of the inflection data is temporally expanded to match each section of the music data, and the expanded inflection is performed. By changing and controlling the musical tone characteristics of each segment of the song data based on the temporal change of the parameters defined by the data, “facial expression” is performed to add emotion to the song data and to make it appear like a song. Therefore, since the musical tone characteristics are appropriately controlled semi-automatically, the user does not need to set the musical tone characteristics for each note, and does not need to know the characteristics of music and musical instruments. A wide range of users can easily apply facial expressions. In particular, with “automatic division” and “equal division”, the division process is performed semi-automatically, which not only reduces the burden on the user, but “automatic division” is a mode suitable for the composition of melody of music data. Since it is divided, more appropriate control of the musical tone characteristics is performed. In addition, “manual division” can respond to a case where higher expression is desired faithfully to the user's intention. Therefore, it is possible to perform natural expression on the song data with a simple operation. In addition, since the division method can be selected according to the situation, usability can be improved.
[0097]
In addition, the control of the musical sound characteristics is performed for each section of the music data corresponding to each section of the intonation data, so that an optimal expression is performed for each section. Therefore, expression suitable for each section of the music data can be appropriately performed with a simple operation for the entire music data.
[0098]
In the present embodiment, only intonation data that completely matches the number of divisions divided by the music data division processing is extracted, but the present invention is not limited to this. For example, in the intonation data, the melody structure is approximate, but the number of sections may be slightly different from the song data. In that case, the condition for matching the number of sections may be relaxed, and if there are about 1 to 2 differences, they may be included in the extraction target. However, it is necessary to finally correspond to the number of divisions between music data and intonation data.
[0099]
In this situation, a plurality of division methods may be used in combination. For example, in the case of dividing by “automatic division”, the number of divisions may be changed manually by the user by further using “manual division”. However, there are cases where it is desirable to avoid “manual division” in order to simplify the operation. Therefore, when the number of song data divisions is less than that of inflection data, “Equal division” is used in combination with “Automatic division”, and the longest division divided by “Automatic division” is further set to “Equal division”. “Division” may be performed. On the contrary, when the number of pieces of music data is larger than that of inflection data, the conditions for determining the phrase delimitation described above may be set strictly and “automatic division” may be performed again. For example, the rest length to be specified is increased.
[0100]
(Second Embodiment)
In the second embodiment of the present invention, the panel processing is different from that of the first embodiment, and the others are the same as those of the first embodiment. Therefore, the second embodiment will be described with reference to FIGS. 1, 2, and 9 to 16.
[0101]
9 and 10 are flowcharts of the panel process executed in step S202 of FIG. 2 in the second embodiment.
[0102]
First, in steps S901 to S912, processing similar to that in steps S301 to S312 of FIGS. 3 and 4 is executed. If the result of determination in step S902 is that the panel input is an instruction for facial expression processing, facial expression processing is executed in steps S913 to S922.
[0103]
That is, first, the expression menu is displayed on the display device 19 in step S913. In the facial expression menu, it is possible to specify the type of facial expression and the time interval (hereinafter referred to as “designated section”) to which facial expression should be applied in the music data. The item indicating the type of facial expression includes at least volume change processing. The designated section may be a part or the whole of the song data. Usually specified in bars.
[0104]
Next, selection and designation of a facial expression section, that is, a designated section and a facial expression type are accepted (step S914), and it is determined whether or not “volume change processing” is selected as the facial expression type (step S915). ). As a result of the determination, if “volume change processing” is selected, the process proceeds to step S916, where a selection menu of volume change patterns is displayed on the display device 19, and then the volume change pattern is displayed on the displayed selection menu. Is accepted (step S917).
[0105]
FIG. 11 is a diagram illustrating an example of a selection menu of volume change patterns displayed on the display device 19. The volume change pattern is a waveform pattern that changes periodically. As will be described later, the volume of the designated section of the music data is changed and set according to this pattern.
[0106]
As shown in the figure, the selection menu includes “change pattern selection”, “combination waveform setting”, and “start position” as major items. In “selection of change pattern”, it is possible to set the period, level change amount, change curve type, and start direction (up / down).
[0107]
FIG. 12 is a diagram illustrating an example of a set sound volume change pattern. FIG. 13 is a diagram illustrating examples of change curve types.
[0108]
In “selection of change pattern”, in the cycle setting, the number of bars N in one cycle is set. For example, in FIG. 11, “4” is set. In the level change amount setting, the minimum value MIN and the maximum value MAX are set when the reference level P is 100% (see FIG. 12). For example, in FIG. 11, it is set to 80 to 140%. In setting the change curve type, a straight line or various curves are set. As shown in FIGS. 13A, 13B, and 13C, lines SA, SB, and SC are provided as change curve types, and a desired change curve type is selected from these lines. For example, in FIG. 11, a line SA (straight line) is set. In the setting of the start direction (up / down), it is set whether the level shifts upward or downward from the start point of the volume change pattern. For example, in FIG. 11, “up” is set and moving upward is set.
[0109]
In the next major item “setting of combination waveform”, as shown in FIG. 11, in addition to the presence or absence of the combination waveform, when the combination waveform is “present”, the period, level change amount, and change curve type for the combination waveform The start direction (up / down) can be set. The volume change pattern of the “combination waveform” is a volume change pattern combined with the original volume change pattern initially set in “select change pattern”, and a plurality of volume change patterns can be set.
[0110]
In “combination waveform setting”, “present” or “absent” is set depending on the presence or absence of the combination waveform. For example, “present” is set in FIG. In the case of “None”, the original volume change pattern set in “Selection of change pattern” is directly used as the final volume change pattern. In addition, the setting of the period, level change amount, change curve type, and start direction (up / down) is the same as in the original volume change pattern. For example, in FIG. 11, cycle = number of bars 1, level change amount = 100 to 120%, change curve type = line SA, start direction = “up”.
[0111]
In the next major item “start position”, as shown in FIG. 11, the position to be shifted in time can be selected by “+” or “−” and the note type. As will be described later, the temporal position of the start point of the volume change pattern with respect to the specified section is set with reference to the bar line in the specified section, and when the shift amount is not set by the “start position” is “0”, The starting point of the volume change pattern matches the bar line.
[0112]
The temporal position is specified by displaying a box 30 as shown in FIG. For example, when the box 30 is clicked with the mouse pointer, a plurality of combinations of “+” or “−” and note types such as half notes and eighth notes are displayed. The user selects a desired one from these by clicking. For example, as shown in FIG. 11, when a combination of “+” and an eighth note is selected, the start point of the volume change pattern can be shifted in the slow direction by the length of the eighth note.
[0113]
Returning to FIG. 9, in the subsequent step S918, a volume change pattern is generated in accordance with the set value received in step S917.
[0114]
FIG. 15 is a diagram illustrating an example of a composite volume change pattern by a generated volume change pattern and a combination. When “change pattern selection” and “combination waveform setting” as shown in FIG. 11 are performed, the “original volume change pattern” becomes as shown in FIG. 15A, and the volume change pattern of the “combination waveform” Is as shown in FIG. Then, when the “original volume change pattern” and the “combination waveform” volume change pattern are synthesized, a composite volume change pattern is generated as the final volume change pattern, as shown in FIG. . As a result, changes such as natural undulation can be expressed. From the viewpoint of realizing natural undulation, it is desirable that the volume change patterns to be combined have different periods.
[0115]
Next, the position of the volume change pattern is adjusted based on the bar line in the designated section, and the volume change pattern is made to correspond to the designated section (step S919).
[0116]
FIG. 16 is a diagram illustrating an example of correspondence between a score and a volume change pattern.
[0117]
FIG. 5A shows an example of a strong score that starts from the beginning of a measure, and FIG. 9C shows an example of a weak score that starts from the middle of a measure. For example, when the start point of the volume change pattern as shown in FIG. 5B is ST, the start point ST is set to the first bar line of the first bar with respect to the score of FIG.
[0118]
On the other hand, even when the “start position” has been set, first, as shown in FIG. 4D, the start point ST of the volume change pattern is set to a bar line with respect to the score of FIG. The However, when the “start position” is set to a combination of “−” and “dotted quarter note”, for example, as shown in FIG. A start point ST is set at the shifted position. As a result, it is possible to easily cope with a weak occurrence.
[0119]
Even in the case of a weak song, the bar line may be more important for expression than the break of the phrase, so in that case, do not set the start position shift even for a weak song. do it.
[0120]
Next, in step S920, the volume value (velocity) of the notes in the designated section is corrected and set in accordance with the volume change pattern set correspondingly. Then, the music data is updated and recorded with the corrected setting value (step S921), and this process is terminated.
[0121]
Note that in the volume value correction setting, the height of the velocity value is completely matched to the volume change pattern, but the already set velocity value depends on the value specified by the volume change pattern. You may make it correct in the ratio.
[0122]
On the other hand, as a result of the determination in step S915, if “volume change processing” is not selected, other types of facial expression are applied (step S922), and this processing ends.
[0123]
According to the present embodiment, the volume change pattern having a waveform that changes periodically is formed, and the volume characteristic of the song data is corrected based on the formed volume change pattern. Periodic changes in volume can be added, and subtle changes in volume that are not as clear as crescendo and decrescendo can be added, giving natural expression to song data. In addition, since a composite volume change pattern is formed by combining two or more types of volume change patterns, changes such as natural undulation can be expressed, and more natural expression can be achieved.
[0124]
In addition, by setting the temporal position of the volume change pattern with respect to the specified section based on the bar line, it is possible to easily cope with a strong occurrence without complicated work, and the temporal position can be arbitrarily set. Therefore, for example, it is possible to easily cope with a case of weakness, and it is possible to apply a facial expression suitable for the progression of the phrase, thereby enhancing the practicality.
[0125]
Further, since not only a straight line but also a curve is provided as a change curve type of the volume change pattern, a more vivid natural change can be given.
[0126]
Note that the period of the volume change pattern is set by the number of bars and is formed to a length related to a multiple of the bar length so that a musically natural volume change can be easily attached. However, this is not a limitation. For example, the length may be set to half the length of one measure.
[0127]
The volume change pattern is generated by calculation with various values set, but a volume change pattern table may be provided in advance, and a desired volume change pattern may be read from the table.
[0128]
In the present embodiment, the subtle inflection that does not appear in the musical notation symbol is considered. However, the clear inflection that appears in the musical notation symbol may be reproduced at the same time. In that case, if the crescendo or decrescendo obtained from the musical notation symbol is reproduced with emphasis rather than the periodic inflection due to the volume change pattern, the overall inflection due to the crescendo on the musical score can be heard. Still, it will be able to give a natural change without a certain sense.
[0129]
Music has inevitable inflections that are not described in the score. For example, inflection according to musical scale progression, or lowering the volume at the end of a phrase. By using such various volume changes in combination with the volume change by the volume change pattern, a more natural expression can be reproduced.
[0130]
Note that a storage medium in which a software program for realizing the functions of the above-described embodiments is recorded is supplied to the performance signal processing apparatus, and a computer (CPU 5 or MPU) reads out the program stored in the storage medium. It goes without saying that the object of the present invention can also be achieved by executing.
[0131]
In this case, the program itself read from the storage medium realizes the novel function of the present invention, and the storage medium storing the program constitutes the present invention.
[0132]
As a storage medium for supplying the program, for example, a portable storage such as the hard disk of the HDD 11, the disk of the CD-ROM 12, the MO, MD, FD 24, CD-R, magnetic tape, nonvolatile memory card, ROM, etc. Media can be used. The program may be transferred directly from the portable storage medium to the RAM 7 as in the above embodiments, or may be transferred from the storage medium to the hard disk in the HDD 11. The program may be supplied from the server computer 102 via another MIDI device 100 or the communication network 101.
[0133]
Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but the OS running on the computer based on the instructions of the program performs the actual processing. The functions of the above-described embodiments may be realized by performing part or all of the processing.
[0134]
Furthermore, after the program read from the storage medium is written in the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program. Alternatively, the CPU 5 or the like provided in the function expansion unit may perform part or all of the actual processing, and the functions of the above-described embodiments may be realized by the processing.
[0135]
【The invention's effect】
  As described above, the claims of the present invention1, 4, 5, 6According to this, it is possible to automatically divide and divide music data to reduce the burden on the user and to add natural expressions to music data with a simple operation. In addition, expression suitable for each segment of song data can be appropriately performed with simple operations on the entire song data..
[Brief description of the drawings]
FIG. 1 is a block diagram showing an overall configuration of a performance signal processing apparatus according to a first embodiment of the present invention.
FIG. 2 is a view showing a flowchart of a main routine in the same form.
FIG. 3 is a diagram showing a flowchart of panel processing executed in step S202 of FIG.
FIG. 4 is a view illustrating a flowchart continued from FIG. 3 of the panel processing executed in step S202 of FIG.
FIG. 5 is a diagram illustrating an example of song data division and inflection data.
FIG. 6 is a diagram exemplifying a pair of music data and inflection data corresponding to each other (before decompression of inflection data);
FIG. 7 is a diagram exemplifying a pair of music data and inflection data corresponding to each other (after expansion of inflection data);
FIG. 8 is a diagram exemplifying a pair of song data and inflection data corresponding to each other (after velocity change);
FIG. 9 is a diagram showing a flowchart of panel processing executed in step S202 of FIG. 2 in the second embodiment of the present invention.
10 is a diagram showing a flowchart of panel processing continued from FIG. 9 executed in step S202 of FIG.
FIG. 11 is a diagram showing an example of a selection menu of volume change patterns displayed on the display device.
FIG. 12 is a diagram illustrating an example of a volume change pattern to be set.
FIG. 13 is a diagram illustrating an example of a change curve type.
FIG. 14 is a diagram illustrating a method for specifying a temporal position.
FIG. 15 is a diagram illustrating an example of a composite volume change pattern by a generated volume change pattern and a combination.
FIG. 16 is a diagram illustrating an example of a correspondence between a score and a volume change pattern.
[Explanation of symbols]
2 panel switch, 3 key press detection circuit, 5 CPU (music data dividing means, inflection data specifying means, inflection data expansion / contraction means, musical sound characteristic control means, pattern forming means, volume characteristic setting means), 7 RAM, 9 display control circuit 11 hard disk drive (HDD) 15 sound source circuit 16 effect circuit 17 sound system 19 display device 20 mouse information detection circuit 21 mouse (position specifying means)

Claims (6)

In a performance signal processing apparatus capable of editing song data,
Song data dividing means for dividing the song data into a plurality of sections;
Intonation data specifying means for specifying any intonation data among inflection data that defines temporal changes in parameters;
Intonation data expansion / contraction means for temporally expanding / contracting intonation data specified by the intonation data specifying means in accordance with at least one section divided by the music data dividing means;
A tone characteristic control means for controlling a tone characteristic of the at least one section of the music data based on a temporal change of a parameter defined by intonation data expanded / contracted by the inflection data expansion / contraction means,
The intonation data is composed of a plurality of sections, and the composition of the composition data by the composition data dividing means and the specification of the inflection data by the intonation data specifying means are performed by the number of sections constituting the composition data being the inflection data. And the expansion / contraction of the intonation data by the intonation data expansion / contraction means is performed for each section of the intonation data corresponding to each section of the music data, and The performance signal processing apparatus according to claim 1, wherein the tone characteristic control by the characteristic control means is performed for each section of the music data corresponding to each section of the intonation data. The division of the music data by the music data dividing means, performance signal processing apparatus according to claim 1, wherein the done on the basis of at least one of the specified music data and user to be divided. 3. The performance signal processing apparatus according to claim 1, wherein the intonation data is specified by the intonation data specifying means based on the song data divided by the song data dividing means. A song data dividing step for dividing the song data into a plurality of sections;
An inflection data specifying step for specifying any intonation data among inflection data that defines temporal changes in parameters;
An inflection data expansion / contraction step that temporally expands / contracts the inflection data identified by the inflection data identification step according to at least one section divided by the music data division step;
A musical sound characteristic control step for controlling a musical sound characteristic of the at least one section of the music data based on a temporal change of a parameter defined by the intonation data expanded / contracted by the inflection data expansion / contraction step,
The intonation data is composed of a plurality of sections, and the composition of the composition data by the composition data division step and the specification of the intonation data by the intonation data specifying step are the number of the sections constituting the composition data is the inflection data. And the expansion / contraction of the intonation data by the inflection data expansion / contraction step is performed for each section of the intonation data corresponding to each section of the music data, and the musical sound The performance signal processing method according to claim 1, wherein the control of the musical tone characteristic by the characteristic control step is performed for each section of the song data corresponding to each section of the intonation data. A performance signal processing program to be executed by a computer,
A song data division module for dividing the song data into a plurality of sections;
An inflection data identification module that identifies any intonation data among inflection data that defines temporal changes in parameters;
An inflection data expansion / contraction module that temporally expands / contracts inflection data identified by the inflection data identification module in accordance with at least one segment divided by the song data division module;
A musical sound characteristic control module for controlling a musical sound characteristic of the at least one section of the music data based on a temporal change of a parameter defined by intonation data expanded / contracted by the inflection data expansion / contraction module;
The intonation data is composed of a plurality of sections, and the composition of the composition data by the composition data division module and the specification of the inflection data by the inflection data identification module are the number of sections constituting the composition data. And the expansion / contraction of the intonation data by the intonation data expansion / contraction module is performed for each section of the intonation data corresponding to each section of the music data, and The performance signal processing program, wherein the control of the musical tone characteristics by the characteristic control module is performed for each section of the song data corresponding to each section of the intonation data. A storage medium storing the performance signal processing program according to claim 5 in a computer-readable manner.

Images