JP3948425B2 - Performance data processing apparatus and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a performance data processing apparatus, and more particularly to a performance data processing apparatus capable of automatically giving musical expressions to performance data.
[0002]
[Prior art]
If performance data such as MIDI data (white data) including only note information is reproduced by an automatic performance device or the like, a mechanical and expressionless performance is obtained. In order to make this a more natural, beautiful, and lively performance, it is necessary to add various musical expressions and instrumentality as control data to the performance data.
[0003]
One such musical expression is a stroke technique, which is a technique for playing plucked strings such as guitars. In guitar strokes, even if the chords are shown as simultaneous chords on the score, the volume and pronunciation of each sound (each string) is used to repel multiple strings in an order that has a certain time difference rather than completely simultaneously. Variations occur in start time and pronunciation time.
[0004]
There has been proposed a technique for automatically performing facial expression imitating the stroke performance method peculiar to stringed instruments such as guitars as described above. (For example, refer to Patent Document 1.)
[0005]
[Patent Document 1]
Japanese Patent Application Laid-Open No. 2002-319552
[Problems to be solved by the invention]
According to the above-mentioned conventional technology, performance data with mechanical sounding timing and volume can be edited and performance data with sounding timing and volume corresponding to stroke performance such as guitar can be automatically generated. When the performance data was given an expression with respect to the volume from the beginning, the expression using the volume-like expression was not performed.
[0007]
An object of the present invention is to provide a performance data processing apparatus that can apply an expression of an appropriate stroke performance method by making use of an expression relating to a volume given to supplied performance data.
[0008]
[Means for Solving the Problems]
According to an aspect of the present invention, a performance data processing apparatus includes performance data supply means for supplying performance data, extraction means for extracting chords composed of a plurality of note events included in the performance data, and the plurality of performance data processing apparatuses. Volume detection means for detecting the overall volume of the note event, change characteristic storage means for storing a first correlation which is a correlation between the overall volume of the plurality of note events and the change amount of the pronunciation timing; Timing changing means for changing the sounding timing so as to shift the sounding timing between the plurality of note events based on the correlation.
[0009]
According to another aspect of the present invention, a performance data processing apparatus includes performance data supply means for supplying performance data, and extraction means for extracting chords composed of a plurality of note events included in the performance data. Volume detection means for detecting the volume of each of the plurality of note events, and change characteristic storage means for storing a correlation between the volume of the note event and the amount of change in the sounding timing, wherein the correlation is A timing change unit that shifts the sound generation timing of the plurality of note events based on the correlation and changes the sound generation start interval with the next note event. Have.
[0010]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a block diagram showing a hardware configuration of a performance data processing apparatus 1 according to an embodiment of the present invention.
[0011]
A RAM 11, ROM 12, CPU 13, detection circuit 15, display circuit 18, external storage device 20, tone generator circuit 21, effect circuit 22, MIDI interface 24, and communication interface 26 are connected to the bus 10 of the performance data processing apparatus 1.
[0012]
The user can make various settings using the setting operator 17 connected to the detection circuit 15. The setting operator 17 may be any device that can output a signal corresponding to a user input, such as a mouse, a character input keyboard, a switch, a joystick, or a jog shuttle.
[0013]
The setting operator 17 may be a soft switch or the like displayed on the display unit 19 that is operated using another operator such as a mouse.
[0014]
The display circuit 18 is connected to the display unit 19 and can display various information on the display unit 19.
[0015]
The external storage device 20 can store various parameters, various data, a program for realizing the present embodiment, performance data PD, and the like.
[0016]
The RAM 11 has a working area for the CPU 13 that stores flags, registers or buffers, various parameters, and the like. The ROM 12 can store various parameters and control programs, a program for realizing the present embodiment, and the like. The CPU 13 performs calculation or control according to a control program or the like stored in the ROM 12 or the external storage device 20.
[0017]
The timer 14 is connected to the CPU 13 and supplies a basic clock signal, interrupt processing timing, and the like to the CPU 13.
[0018]
The tone generator circuit 21 outputs musical tone signals in accordance with performance signals such as MIDI data supplied from the performance data PD recorded on the external storage device 20 or the like, the MIDI operation device 16 or the MIDI device 4 connected to the MIDI interface 24, or the like. Generated and supplied to the sound system 23 via the effect circuit 22.
[0019]
The effect circuit 22 gives various effects to the digital musical tone signal supplied from the sound source circuit 21. The sound system 23 includes a D / A converter and a speaker, converts a digital musical tone signal supplied to an analog format, and generates a sound.
[0020]
The performance operator 16 is connected to the detection circuit 15 and supplies a performance signal in accordance with the performance operation of the user. The performance operator 16 may be any operator that can output at least a performance signal such as a MIDI signal.
[0021]
The MIDI interface (MIDI I / F) 24 can be connected to an electronic musical instrument, other musical instruments, audio equipment, a computer, and the like, and can transmit and receive at least a MIDI signal. The MIDI interface 24 is not limited to a dedicated MIDI interface, and may be configured using a general-purpose interface such as RS-232C, USB (Universal Serial Bus), IEEE 1394 (I-Triple 1394). In this case, data other than MIDI messages may be transmitted and received simultaneously.
[0022]
The MIDI device 4 is an acoustic device, a musical instrument or the like connected to the MIDI interface 24. The user can also input a performance signal by playing (manipulating) the MIDI device 4.
[0023]
The MIDI device 4 can also be used as an operator for inputting various data other than performance information and various settings.
[0024]
The communication interface 26 can be connected to a communication network 3 such as a LAN (local area network), the Internet, or a telephone line, and can be connected to the server computer 2 via the communication network 3. The communication interface 26 and the communication network 3 are not limited to wired ones and may be wireless. Moreover, you may provide both.
[0025]
FIG. 2 is a conceptual diagram showing the format of the performance data PD according to this embodiment.
[0026]
The performance data PD includes initial setting information HC recorded at the head, timing data representing the sound generation timing by measures, beats, and time, and event data EV representing an event at each timing. The performance data PD can be composed of a plurality of parts.
[0027]
The initial setting information HC is data for setting various reproduction modes during reproduction of each part (track), and includes, for example, tone color setting data, volume setting data, tempo setting data, and the like.
[0028]
The timing data is data representing time for processing various events represented by the event data EV. The event processing time may be expressed as an absolute time from the start of performance, or may be expressed as a relative time that is an elapsed time from the previous event. In this embodiment, the timing data represents the event processing time by parameters of the number of bars, the number of beats in the bar, and the time (clock) in the beat. One beat is 480 clocks, for example.
[0029]
The event data EV is data representing the contents of various events for playing back music. Events include note events (note data) NE that represent notes that are directly related to the occurrence of music that is a combination of note-on and note-off events, pitch change events (pitch bend events), tempo change events, tone change events, etc. A setting event for setting the playback mode of the music is included.
[0030]
In each note event EV, for example, parameters such as pitch, tone length (gate time), volume (velocity) V, and the like are recorded. For the volume V, the minimum volume that can be set is “1”, and the maximum volume is “127”.
[0031]
Note that the performance data PD shown in FIG. 2 is the data before the performance data processing according to this embodiment is applied. If the performance data PD is reproduced as it is, the volume V differs between the first beat and the second beat. Since the sound generation timing of the constituent sounds of the chords is completely the same, it becomes unnatural as a performance of a stringed instrument such as a guitar.
[0032]
In the present embodiment, not only a plurality of note events that are sounded completely at the same time, but also a set of a plurality of note events whose sounding timings are almost the same period is used as a chord. A plurality of note events that are sounded at substantially the same time period are a set of a plurality of note events that are sounded within a time that is considered as a chord musically when played.
[0033]
FIG. 3 is a block diagram showing functions of the performance data processing apparatus 1 according to the embodiment of the present invention.
[0034]
The performance data processing apparatus 1 includes a performance data supply unit 31, a processing target performance data extraction unit 32, a volume detection unit 33, a timing change amount determination unit 34, a change characteristic storage unit 35, a timing change unit 36, and a performance data output unit 37. Consists of including.
[0035]
The performance data supply unit 31 reads, for example, performance data PD selected by the user using the setting operator 16 from the external storage device 20 or the like, or receives it from the server 2 or the like via the communication network 3. The read (received) performance data PD is supplied to the subsequent processing target performance data extraction unit 32.
[0036]
The processing target performance data extraction unit 32 searches the supplied performance data PD for a portion corresponding to the stroke performance (a set of a plurality of note events that are generated within a time that is musically considered as a chord) The performance data PD (a plurality of note events EV and their timing data) is extracted and supplied to the volume detection unit 33 and the timing change unit 36. The detection of the stroke performance location (processing target location) is not limited to automatic detection, and the user may specify the processing performance location.
[0037]
The volume detection unit 33 detects the volume V (for example, velocity, volume, expression, etc.) of the extracted performance data PD. The detected volume V is supplied to the timing change amount determination unit 34.
[0038]
The timing change amount determination unit 34 is extracted by referring to the change characteristic stored in the change characteristic storage unit 35 based on the volume V (or the entire volume TV described later) detected by the volume detection unit 33. The amount of change of timing data of each of the plurality of note events EV included in the performance data PD (hereinafter referred to as timing change amount) is determined.
[0039]
The change characteristic storage unit 35 stores a change characteristic that is a timing change amount according to the volume V, for example, in a table or an arithmetic expression, and supplies the change characteristic to the timing change amount determination unit 34. The change characteristics will be described in detail later with reference to FIG. Further, new change characteristics may be supplied from the server 2 via an external storage medium such as a CD-ROM or the communication network 3.
[0040]
The timing changing unit 36 changes the sounding start timing (and the sounding end timing if necessary) of each note event EV included in the extracted performance data PD according to the determined timing change amount.
[0041]
For example, when the down stroke performance of a stringed instrument such as a guitar is assumed, the sounding start timing is delayed by delaying the sounding timing of the highest tone (1st string), without changing the sounding timing of the 2nd string. This is done by accelerating the pronunciation timing. In this way, the timing is changed by advancing or delaying the sound generation timing according to the sound generation order.
[0042]
Further, it is preferable to change the sound generation end timing (for example, gate time) with the change of the sound generation start timing. For example, when the sounding start timing of the note event EV is delayed, the next chord and the sounding time may overlap unless the sounding end timing is advanced. In addition, when the sounding start timing of the note event EV is advanced, if the sounding end timing is not delayed, only the constituent sound whose sounding timing is advanced may end the sounding earlier. In order to avoid this, if the sound generation timing is delayed, the sound generation end timing should be advanced approximately the same. Similarly, when the sound generation start timing is advanced, the sound generation end timing may be delayed by approximately the same amount.
[0043]
The performance data output unit 37 outputs the performance data PD to which the timing is changed and the expression of the stroke performance is given (sound as musical sound via the sound source circuit 21, the effect circuit 22 and the sound system 23, and is output to the external storage device 20 and the like. Storage, transmission to the external MIDI device 4 or the like).
[0044]
FIG. 4 is a graph showing an example of the change characteristic stored in the change characteristic storage unit 35. In the figure, the horizontal axis represents the overall volume TV of a plurality of note events EV (location corresponding to stroke performance) constituting the same chord, and the vertical axis corresponds to the speed of the stroke, that is, each of the chord constituent sounds. The timing change amount of the note event EV is shown. Here, the timing change amount is a value that defines a relative time difference between the note event EV and the preceding and subsequent note events EV that make up the same chord. For example, as the timing change amount, When the time from the sounding start timing to the sounding start timing of the highest sound is recorded (in the case of a down stroke), the time difference between the constituent sounds is obtained by dividing the time by the number of constituent sounds n-1 of the chord. be able to.
[0045]
Alternatively, an offset value or the like for changing the timing of each note event EV constituting the chord may be recorded as the timing change amount. In this case, the time difference (shift) between the note events EV may not be uniform among the chord constituent sounds.
[0046]
Here, the entire volume TV is selected, for example, a simple average of the volume V of all note events EV constituting the chord, a weighted average, an average of the volume V of the partial note events EV (for example, the maximum and minimum average), or the like. The volume V of one note event EV (for example, maximum, minimum, median, etc.).
[0047]
In a natural musical instrument, generally, the stroke tends to be faster as the volume increases. This is because, when the stroke is fast, the energy for flipping the string increases, so that the volume increases. Therefore, the timing change characteristic in this embodiment is also a characteristic that the stroke is faster (= the timing change amount is smaller) as the volume is larger. However, since there is a certain limit to the speed of the stroke, the characteristics are such that it is saturated at the faster and slower speed.
[0048]
FIG. 4A shows a change characteristic when the characteristic is changed in a curve. In the case of such a curve change, for example, the relationship between the volume TV of the entire chord and the timing change amount is used as the change characteristic table. And stored in the change characteristic storage unit 35.
[0049]
FIG. 4B shows a change characteristic when the characteristic is linearly changed. In the case of such a linear change, for example, as an arithmetic expression representing the relationship between the volume TV of the entire chord and the timing change amount. And stored in the change characteristic storage unit 35.
[0050]
In addition, since a person's performance is not decided uniquely as mentioned above, a change characteristic is not restricted to the said example. It may be completely linear, or may have the opposite characteristic (the stroke speed decreases as the volume increases). A plurality of change characteristics may be stored, and any of the characteristics may be selected by a user instruction or automatically (for example, at random). Moreover, even if the change characteristics are the same, the effect level (timing change amount) may be adjusted (user instruction or automatically).
[0051]
It should be noted that the change characteristics shown in FIGS. 4A and 4B can be changed in reverse, as necessary. That is, as the volume (TV) increases, the deviation amount (L) of the sound generation start timing during the stroke performance can be gradually increased.
[0052]
FIG. 5 shows an example in which performance data PD is processed by the performance data processing apparatus 1 of the present embodiment. The stroke performance in this example is a performance by a down stroke. In the figure, the vertical axis represents the pitch of each note event EV, and the horizontal axis represents time. A white circle represents each note event EV. The lower graph of each circle representing each note event EV represents the overall volume TV of chords composed of the upper note events.
[0053]
FIG. 5A shows performance data PD before processing according to this embodiment. As is clear from the fact that the note events EV constituting the same chord are arranged in a straight line in the vertical direction, the sounding start timings of the note events EV constituting the same chord are all the same. Looking at the lower volume graph, the overall volume TV of the 1st and 3rd chords is “High”, and the overall volume of the 2nd and 4th chords is “Low”. I understand that.
[0054]
The performance data including the performance data PD in FIG. 5A is stored in, for example, the external storage device 20 in FIG. 1, and is supplied to the processing target data extraction unit 32 by the performance data supply unit 31 in FIG. . The processing target data extraction unit 32 detects four chords (note event EV group) shown in FIG. 5A from the supplied performance data, and the volume detection unit 33 detects each of the four chords detected. Are detected and sent to the timing change amount determination unit 34. The timing change amount determination unit 34 changes the timing data of the four chords based on the change characteristic supplied from the change characteristic storage unit 35 based on the detected volume. At this time, the chords of the first beat and the third beat whose volume TV is “high” are smaller than the chords of the second beat and the fourth beat whose timing change amount is “small”. The performance data PD processed as described above is as shown in FIG. That is, when the volume VL> the volume VS, the timing of the note event EV composing the chord is changed so that the change amount LS <the change amount LL.
[0055]
In the above description, for convenience of explanation, the volume TV is set to “large” or “small”, but actually, the volume TV is represented by a numerical value of 1 to 127, for example. In addition, the timing change amount is also expressed as “large” or “small” for convenience of explanation, but this is the sound that should be pronounced at the beginning of the chord component sound (minimum sound in the case of down stroke, and in the case of up stroke) Is the time difference from the highest note) to the last note to be pronounced (the highest note in the case of a downstroke, the lowest note in the case of an upstroke).
[0056]
FIG. 6 is a graph showing performance data PD when another example of the change characteristic of this embodiment and another example are applied.
[0057]
In stroke performance of a stringed instrument such as a guitar, the stroke speed may change even during one stroke performance. For example, in the case of a performance method in which a low tone string is played slowly and strongly in the down stroke, and is played quickly and lightly as it goes to a high tone string. In order to imitate such a performance, it is effective to change the stroke speed (timing) according to the volume V of the individual note events constituting the same chord.
[0058]
FIG. 6A shows an example of a change characteristic for changing the timing according to the volume V of individual note events constituting the same chord. In this example, as the volume V of each note event increases, the interval between the note event EV to be sounded next (the note event EV on the high note side in the case of the down stroke and the low note side EV in the case of the up stroke) ( (Shift amount) is increased.
[0059]
FIG. 6B shows an example in which the performance data PD is changed by applying the change characteristic shown in FIG. In this example, the volume (V1 to V6) gradually decreases from the low sound (EV1) to the high sound (EV6). By applying the change characteristic shown in FIG. 6A, the deviation amount (L1 to L5) of the sound generation start timing during the performance of the stroke is gradually reduced as the volume (V1 to V6) decreases (stroke). Will be faster).
[0060]
For example, the interval L1 between the note event EV1 and the note event EV2 is longer than the interval L2 between the note event EV2 and the note event EV3 because the volume V1 of the note event EV1 is larger than the volume V2 of the note event EV2. Yes. That is, when V1> V2, the timing of each note event EV constituting the chord is changed so that L1> L2 holds.
[0061]
Note that the change characteristics shown in FIG. 6 (A) can be changed in the opposite direction as needed. That is, according to the decrease in volume (V1 to V6), the deviation amount (L1 to L5) of the sound generation start timing during the stroke performance can be gradually increased.
[0062]
FIG. 7 is a graph showing an example in which the performance data PD is changed using both of the change characteristics shown in FIGS. 4 (A) and 6 (A).
[0063]
In this example, both of the change characteristics shown in FIGS. 4A and 6A are stored in the change characteristic storage unit 37 of FIG. 3, and both of the change characteristics are stored in the timing change amount determination unit 34. This is a case where the timing change amount is determined by referring to the timing change unit 36 and the timing data of each note event is changed according to the determined change amount.
[0064]
As shown in the figure, the volume V of the note event EV here is gradually reduced for both chords. Therefore, by applying the change characteristic shown in FIG. The interval between chord events EV is gradually reduced. For example, since the volume of the note event EV1 of the second beat chord is larger than the volume of the note event EV3, the relationship of interval L1> interval L3 is established.
[0065]
At the same time, the overall sound volume TV1 of the first beat chord is larger than the overall sound volume TV2 of the second beat chord (TV1> TV2). Therefore, the change characteristic shown in FIG. 4A is applied. Correspondingly, the time LT1 from the note event EV (lowest note) to be pronounced first to the last note event EV (highest note) of the first beat chord is 2 beats. It is shorter than that of the chord of the eye (LT2) (LT1 <LT2).
[0066]
As described above, according to the embodiment of the present invention, it is possible to detect the note event EV constituting the chord in the performance data and change the sounding start timing and the sounding end timing of the note event EV constituting the same chord. it can.
[0067]
At that time, the sound generation start interval of each note event EV can be changed based on the overall volume TV of the note events EV constituting the same chord. That is, the time from the sounding start timing of the note event EV to be pronounced first to the sounding start timing (or sounding end timing) of the note event to be sounded last is calculated as the time of the chord. It can be changed according to the overall volume. Therefore, it is possible to automatically give an appropriate stroke performance expression to the performance data.
[0068]
Further, according to the embodiment of the present invention, the sound generation start interval of each note event EV can be changed based on the individual volume V of the note event EV that constitutes the same chord. That is, the time between the sounding start timing of the note event EV constituting the same chord and the sounding start timing (or sounding end timing) of the next note event to be sounded is determined according to the volume V of each note event EV. Can be changed. Therefore, it is possible to automatically give an appropriate stroke performance expression to the performance data.
[0069]
In the above-described embodiment, only the case of the down stroke performance method has been described, but the present invention can also be applied to the up stroke performance method. In this case, the sound that should start sounding first is the highest note in the same chord component.
[0070]
In addition, there is an alternate performance method in which both downstroke and upstroke performance methods are mixed in both strokes of stringed instruments such as guitars. It is preferable to change the correlation between the timing change amount and the sound volume in the change characteristics.
[0071]
In addition, you may make it implement a present Example by the commercially available computer etc. which installed the computer program etc. corresponding to a present Example.
[0072]
In that case, the computer program corresponding to the present embodiment may be provided to the user in a state in which the computer program is stored in a computer-readable storage medium such as a CD-ROM or a floppy (registered trademark) disk. Good.
[0073]
Although the present invention has been described with reference to the embodiments, the present invention is not limited thereto. It will be apparent to those skilled in the art that various modifications, improvements, combinations, and the like can be made.
[0074]
【The invention's effect】
As described above, according to the present invention, it is possible to provide a performance data processing apparatus that can apply an expression of an appropriate stroke performance method by making use of a facial expression related to the volume given to supplied performance data. it can.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a hardware configuration of a performance data processing apparatus 1 according to an embodiment of the present invention.
FIG. 2 is a conceptual diagram showing a format of performance data PD according to the present embodiment.
FIG. 3 is a block diagram showing functions of the performance data processing apparatus 1 according to the embodiment of the present invention.
4 is a graph showing an example of a change characteristic stored in a change characteristic storage unit 35. FIG.
FIG. 5 shows an example in which performance data PD is processed by the performance data processing apparatus 1 of the present embodiment.
FIG. 6 is a graph showing performance data PD when another example and other examples of change characteristics of the present embodiment are applied.
7 is a graph showing an example in which performance data PD is changed using both of the change characteristics shown in FIGS. 4 (A) and 6 (A). FIG.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Performance data processing apparatus, 2 ... Server computer, 3 ... Communication network, 4 ... MIDI apparatus, 10 ... Bus, 11 ... RAM, 12 ... ROM, 13 ... CPU, 14 ... Timer, 15 ... Detection circuit, 16 ... Setting Operation unit, 17 ... Performance operation unit, 18 ... Display circuit, 19 ... Display unit, 20 ... External storage device, 21 ... Sound source circuit, 22 ... Effect circuit, 23 ... Sound system, 24 ... MIDI I / F, 26 ... Communication I / F, 31 ... performance data supply unit, 32 ... processing target performance data extraction unit, 33 ... volume detection unit, 34 ... timing change amount determination unit, 35 ... change characteristic storage unit, 36 ... timing change unit, 37 ... performance Data output section

Claims (6)

Performance data supply means for supplying performance data;
Extracting means for extracting a chord composed of a plurality of note events included in the performance data;
Volume detection means for detecting the overall volume of the plurality of note events;
Change characteristic storage means for storing a first correlation that is a correlation between the overall volume of a plurality of note events and the amount of change in pronunciation timing;
A performance data processing apparatus comprising timing change means for changing the sounding timing so as to shift the sounding timing between the plurality of note events based on the correlation. The change characteristic storage means further stores a second correlation which is a correlation between the volume of the note event and the change amount of the sounding timing,
2. The performance data processing apparatus according to claim 1, wherein the timing changing means further changes the sound generation timing of the plurality of note events based on the second correlation. Performance data supply means for supplying performance data;
Extracting means for extracting a chord composed of a plurality of note events included in the performance data;
Volume detecting means for detecting the volume of each of the plurality of note events;
Change characteristic storage means for storing the correlation between the volume of the note event and the amount of change in the sounding timing, the correlation changing the interval between the note events to be sounded next ;
A performance data processing apparatus comprising: timing changing means for shifting the sound generation timing of the plurality of note events based on the correlation and changing the sound generation start interval with the next note event . Performance data supply procedure for supplying performance data;
An extraction procedure for extracting a chord composed of a plurality of note events included in the performance data;
A volume detection procedure for detecting the overall volume of the plurality of note events;
A change characteristic supply procedure for supplying a first correlation which is a correlation between the overall volume of the plurality of note events and the change amount of the sound generation timing;
A program for causing a computer to execute performance data processing including a timing change procedure for changing the sound generation timing so as to shift the sound generation timing of the plurality of note events based on the correlation. The change characteristic supply procedure further supplies a second correlation which is a correlation between the volume of the note event and the amount of change in the sounding timing;
5. The program according to claim 4, wherein the timing changing procedure further changes the sound generation timing of the plurality of note events based on the second correlation. Performance data supply procedure for supplying performance data;
An extraction procedure for extracting a chord composed of a plurality of note events included in the performance data;
A volume detection procedure for detecting the volume of each of the plurality of note events;
A change characteristic supplying procedure for supplying a correlation between the volume of the note event and the amount of change in the sounding timing, the correlation changing the interval between the note events to be sounded next ;
A program for causing a computer to execute performance data processing having a timing change procedure for shifting the sound generation timing of the plurality of note events based on the correlation and changing the sound generation start interval with the next note event. .

Images