JP3449045B2 - Performance control device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a performance control device capable of arbitrarily controlling the music characteristics (tempo, dynamics, etc.) in a musical tone performance of an electronic musical instrument or the like in accordance with a player's operation.

[0002]

2. Description of the Related Art Conventionally, an automatic performance device stores performance information (note data) about each note of a melody performance or an accompaniment performance in a memory or the like, and automatically reads the stored performance information at a predetermined tempo. , Produces a melody sound or an accompaniment sound according to the read performance information. In this case, the performance tempo is determined by the frequency of the tempo clock output from a timer or the like. The frequency of the tempo clock can be freely changed by operating the tempo setting switch or the like. However, when the tempo setting switch etc. is operated to change the performance tempo during the performance, the way of the change depends on the switch operation state (operation amount, operation speed, etc.). It was very difficult to give a subtle change in tempo that corresponds to hand gestures such as. Therefore, conventionally, a performance control device (for example, a built-in sensor for a baton of an operator, which detects a sensor output according to a gesture motion thereof and controls the tempo of an automatic performance according to the detection timing thereof (for example, , Japanese Patent Publication No. 3-60119).

[0003]

Recently, an operator's baton or the like has a built-in acceleration sensor to detect the maximum value of the output of the acceleration sensor in response to a hand gesture and automatically play at the detection timing. A real-time performance control device has appeared, which controls the tempo of, and controls the dynamics of performance according to the maximum output value. This sounds when the maximum output of the acceleration sensor is detected,
By advancing the sequence data, the tempo of the performance can be controlled arbitrarily, and the dynamics of the performance according to the maximum output value of this acceleration sensor (giving strength to the sound at the time of performance to give the whole performance a lively feeling) ) Is also controlled arbitrarily. Therefore, when the cycle of the hand gesture of the operator is short, the cycle in which the maximum output value of the sensor appears is shortened, and accordingly the tempo of the performance becomes faster, and conversely, when the cycle of the hand gesture is long. , The cycle in which the maximum output value of the sensor appears becomes longer, and the tempo of the performance becomes slower accordingly. In addition, the output of the acceleration sensor increases when the hand gesture motion speed is fast, and accordingly the dynamics of the performance become stronger. Conversely, when the hand gesture motion speed is low, the output of the acceleration sensor becomes smaller, and accordingly Dynamics weaken.

In such a real-time performance control device, depending on how familiar the operator is with the conducting method (whether the hand gesture can be accurately performed at a predetermined cycle and operation speed). The output waveform of the acceleration sensor is very different. For example, when the operator is proficient in the commanding method, the waving motion is regularly performed at a predetermined cycle and operating speed, so that the output of the acceleration sensor does not vary and a stable output waveform is obtained. If you are a beginner, etc., the cycle and movement speed of the hand gesture are inaccurate,
The output of the acceleration sensor varies, resulting in an unstable output waveform. Therefore, depending on how familiar the operator is with the command method, how the output of the acceleration sensor is reflected in the control of music characteristics such as tempo and dynamics, the degree of follow-up (following degree) Must be set in advance and the music characteristics such as tempo and dynamics must be controlled according to the following degree. For example, if the operator is proficient in conducting, by increasing the follow-up degree to a certain degree, the musical characteristics such as tempo and dynamics can be controlled by reacting sharply to the output value of the acceleration sensor according to the hand gesture. To be done. If the operator is a beginner, the followability of tempo control is lowered so that the music characteristics such as tempo and dynamics can be controlled by reacting insensitively to the output value of the acceleration sensor according to the hand gesture. .

In such a performance control device, the degree of follow-up may differ depending on the genre of music. For example, in the case of rock or the like, the tempo does not change significantly during the song, so the follow-up degree is set to a low level to prevent the tempo from changing due to variations in the output value of the acceleration sensor. In the enka song, the tempo drops at the ending part, and in classical music, the literary dund occurs at the part where the sentiment changes, so the follower is set to a high degree, and the tempo at the corresponding part is made sensitive to changes in the hand gesture. However, the scene where the music characteristics such as tempo and dynamics change greatly in one song
It is often a small part of a song, such as the beginning of the song, the ending of the song, or the part where the sentiment changes. Therefore, once the follow-up degree is set, all performances will be performed with that follow-up degree. Therefore, when the follow-up degree is set high, the output value of the acceleration sensor is sensitively followed by tempo, dynamics, etc. Since the music characteristics of the player will change, the operator must concentrate all his or her nerves on the hand gesture during the performance so that the predetermined cycle and operation speed are achieved, and conversely, the followability is set low. In this case, since the output value of the acceleration sensor follows the insensitivity, there is a problem that the operator has to greatly change the gesture motion to change the music characteristics such as tempo and dynamics.

The present invention has been made in view of the above-mentioned points, and it is desired to perform a great change in musical characteristics such as tempo and dynamics with expressive thoughts, or to perform a stable operation with little change. It is an object of the present invention to provide a performance control device that can realize performances in different performance forms such as a case of playing in one song.

[0007]

According to a first aspect of the present invention, there is provided a musical performance control device for supplying automatic musical performance data, and a musical performance data supplying means for supplying automatic musical performance data. , Characteristic data supplying means for supplying data regarding the musical characteristics of the performance while changing the moment,
Be those supplied by changing at least once in how much follow are not follow degree data in a series of playing for determining whether to change the performance in accordance with the automatic performance data to changes in the data relating to the musical characteristics The tracking degree
Data is included in the automatic performance data,
Tracking data supplying means for supplying the tracking data with the supply of performance data, and control means for performing a performance according to the automatic performance data in accordance with the data relating to the music characteristics and the tracking data. characterized in that it comprises a.

[0008]

The performance data supply means supplies the automatic performance data, and supplies the automatic performance data stored in the memory or the floppy disk to the control means. The control means performs a performance according to the automatic performance data supplied from the performance data supply means. Since the control means receives the data regarding the music characteristics such as tempo and dynamics which change from moment to moment during the performance, the control means changes the music characteristics from moment to moment. For example, this characteristic data supply means detects the type and amount of movement based on the gesture motion of the operator, that is, the conductor's gesture motion or swing motion, and outputs it as data relating to music characteristics such as tempo and dynamics. To do. Therefore, the characteristic data supply means outputs data relating to the musical characteristics which change momentarily according to the operation of the operator. At this time, the control means is supplied with the follow-up degree data that determines how much the change in the performance should be made to follow the change in the data relating to the music characteristic, so that the follow-up degree according to the follow-up degree data is used. Perform while changing the music characteristics. Further, the follow-up degree data supplying means changes and supplies the follow-up degree data at least once during a series of performances , and the follow-up degree data is the automatic performance data.
It is included in the
Since the follow-up degree data is supplied ,
Before and after the change of the follow-up degree data included in an arbitrary performance portion, the rate of follow-up of the performance change with respect to the change of the data relating to the music characteristic is different. Therefore, if you want to change the musical characteristics such as tempo and dynamics with a lot of expressive thoughts and make a big change, or if you want to perform stably without changing too much, you can change the tracking data It is possible to combine different types of performance in a song , and
Incorporating subordinate data arbitrarily in automatic performance data
It is possible to change the following degree at any point in the song.
Therefore, various controls can be performed.

[0009]

Embodiments of the present invention will now be described in detail with reference to the accompanying drawings. FIG. 1 shows a detailed configuration of an electronic musical instrument 1H including a keyboard, a tone generator circuit and an automatic performance device, and a baton 20 which outputs a tempo control signal to the electronic musical instrument 1H according to an operator's hand gesture, and the connection between the two. It is a hardware block diagram which shows a relationship. First, the configuration of the electronic musical instrument 1H will be described. Microprocessor unit (CPU) 11
Controls the overall operation of the electronic musical instrument 1H.
ROM1 to the CPU11 via the bus 1G
2, RAM 13, key depression detection circuit 14, switch detection circuit 15, display circuit 16, tone generator circuit 17, effect imparting circuit 1
8, timer 19, floppy disk drive (FD
D) 1A and MIDI interface (I / F) 1B
Are connected respectively.

In this embodiment, an electronic musical instrument in which the CPU 11 performs key depression detection processing, tempo control data transmission / reception processing, sound generation processing, etc. will be described.
It is needless to say that the present invention can be similarly applied to a module configured by the above and a module configured by the tone generator circuit 17, which are separately configured, and data is exchanged between the modules by a MIDI interface.
The ROM 12 stores various programs of the CPU 11 and various data, and is a read-only memory (RO
M). RAM13 is performance information and CPU
Reference numeral 11 temporarily stores various data generated when the program is executed, and predetermined address areas of a random access memory (RAM) are allocated to each and used as registers and flags.

The keyboard 1C is provided with a plurality of keys for selecting the pitch of a musical tone to be generated, has a key switch corresponding to each key, and if necessary, a key depression speed detecting device. And a touch detection unit such as a pressing force detection device.
It is needless to say that the keyboard 1C is a basic operator for playing music, and may be a performance operator other than this, such as a drum pad. The key depression detection circuit 14 is configured to include a circuit composed of a plurality of key switches provided corresponding to each key of the keyboard 1C that specifies the pitch of a musical tone to be generated, and a new key is depressed. The key-on event information is output when the key is released, and the key-off event information is output when the key is newly released. In addition, a process of generating touch data is performed by determining the key pressing operation speed or the pressing force when the key is pressed, and the generated touch data is output as velocity data. As described above, the key-on / key-off event information and the velocity information are expressed by the MIDI standard and include the data indicating the key code and the assigned channel.

The panel switch 1D starts / starts automatic performance.
It includes a stop switch, a pause (pause) switch, and various switches for selecting, setting, and controlling tones, volume, effects, and the like. The panel switch 1D has various other switches, but the details thereof are publicly known, and thus the description thereof will be omitted. The switch detection circuit 15 detects the operation state of each operator on the panel switch 1D and outputs a switch event corresponding to the operation state to the CPU 11 via the bus 1G. The display circuit 16 displays various information such as the control status of the CPU 11 and the contents of setting data on the display unit 1.
It is displayed on E. The display unit 1E is composed of a liquid crystal display panel (LCD) or the like, and its display operation is controlled by the display circuit 16.

The tone generator circuit 17 can simultaneously generate musical tone signals on a plurality of channels, inputs performance information (data conforming to the MIDI standard) given via the bus 1G, and based on this data, musical tone signals are input. To occur. Any tone signal generation method in the tone generator circuit 17 may be used. For example, a memory reading method for sequentially reading the musical tone waveform sample value data stored in the waveform memory according to the address data that changes corresponding to the pitch of the musical tone to be generated, or a predetermined frequency with the address data as phase angle parameter data. A well-known method such as an FM method for performing a modulation operation to obtain musical tone waveform sample value data or an AM method for performing a predetermined amplitude modulation operation using the address data as phase angle parameter data to obtain a tone waveform sample value data. You may employ suitably.

The effect imparting circuit 18 imparts various effects to the musical tone signal from the tone generator circuit 17, and outputs the musical tone signal to which the effect has been imparted to the sound system 1F. Effect application circuit 1
The tone signal to which the effect is added by 8 is sounded through a sound system 1F including an amplifier and a speaker (not shown). The timer 19 counts time intervals and generates a clock pulse for determining the tempo of automatic performance. Since this clock pulse is given to the CPU 11 as an interrupt instruction, the CPU 1
1 executes various processes by interrupt processing. The floppy disk drive (FDD) 1A is an interface for fetching automatic performance data from an external storage medium, that is, a floppy disk into the electronic musical instrument 1H, and writing automatic performance data processed in the electronic musical instrument 1H to a floppy disk.

MIDI interface (I / F) 1B
Connects between the bus 1G of the electronic musical instrument 1H and the MIDI interface (I / F) 27 of the baton 20,
Interface 27 is bus 2E of baton 20 and MID
It is connected to the I interface 1B. Therefore, the bus 1G of the electronic musical instrument 1H and the bus 2E of the baton 20 are connected to each other via the MIDI interfaces 1B and 27, so that data can be exchanged bidirectionally according to the MIDI standard. It has become.

Next, the structure of the baton 20 will be described. The microprocessor unit (CPU) 21 controls the operation of the baton 20. This CPU2
1 to the ROM 22 and the RAM 2 via the bus 2E.
3, switch detection circuit 24, A / D converters 25, 26,
The MIDI interface 27 and the timer 28 are connected to each other. The ROM 22 stores various programs of the CPU 21 and various data, and is composed of a read only memory (ROM). The RAM 23 is for temporarily storing various data generated when the CPU 21 executes the program, and is assigned with a predetermined address area of a random access memory (RAM) and used as a register or a flag. The switch group 29 is composed of an on / off switch of the baton 20, a delay time switch for adjusting the output timing of the tempo control signal, and the like. The switch detection circuit 24 detects the operating state of the switch group 29, and outputs data according to the operating state to the CPU 21 via the bus 2E.

X-direction piezoelectric vibration gyro sensor 2A and Y
The directional piezoelectric vibration gyro sensor 2B is a two-axis (X-axis) orthogonal to the piezoelectric vibration gyro sensor that generates a voltage proportional to the Coriolis force proportional to the angular velocity of the rotation when the sensor rotates about one rotation axis. And Y axis). Therefore, the X-direction piezoelectric gyro sensor 2A
The angular velocity ωX in the X-axis direction can be detected based on the voltage output from the Y axis direction, and the angular velocity ωY in the Y axis direction can be detected based on the voltage output from the Y-direction piezoelectric gyro sensor 2B.

The noise removal circuits 2C and 2D remove noise components inside the sensor included in the sensor output signals from the X-direction piezoelectric vibration gyro sensor 2A and the Y-direction piezoelectric gyro sensor 2B, and have a high frequency higher than the response frequency. It is composed of a low-pass filter that removes components. A /
The D converters 25 and 26 convert the sensor output signal from which the high frequency components have been removed by the noise removing circuits 2C and 2D into a digital signal. This A / D converter 25
The digital signals converted by 26 and 26 are read by the CPU 21 at a predetermined cycle, and are used for the motion determination process of the entire baton 20 by a predetermined data process.

The timer 28 generates an operating clock for the baton 20, and this operating clock is given to the CPU 21 as an interrupt command. The CPU 21 detects the operating state of the baton 20 by an interrupt process and the operating state. A tempo control signal for determining the tempo of the automatic performance is output to the electronic musical instrument 1H side via the MIDI interfaces 27 and 1B.

Next, an example of processing executed by the microcomputer (CPU 21) in the baton 20 is shown in FIG.
From now on, it will be explained based on the flowchart of FIG. FIG. 2 is a diagram showing an example of sensor output processing performed by a microcomputer (CPU 21) in the baton 20. This sensor output process is a timer interrupt process that is executed in synchronization with the operation clock from the timer 28 (cycle of about 10 ms). The sensor output process is a series of processes according to the control program stored in the program ROM 22, and is sequentially executed in the following steps.

Step 1: Outputs of the X-direction piezoelectric vibration gyro sensor 2A and the Y-direction piezoelectric vibration gyro sensor 2B,
That is, the digital signals output from the A / D converters 25 and 26 are taken in via the bus 2E. Step 2: Remove the DC component. That is, baton 2
When the operator who operates 0 performs a low-speed rotation operation such as a turning operation other than a hand-shake operation, a DC component, that is, a drift component, is generated accordingly, so that the digital signal captured in step 1 has a low-frequency cutoff frequency. It is removed by passing it through a high pass filter.

Step 3: An absolute angular velocity is calculated based on the outputs X and Y of the X-direction piezoelectric vibration gyro sensor 2A and the Y-direction piezoelectric vibration gyro sensor 2B from which the DC component is removed, and the absolute angular velocity is stored in the absolute angular velocity register A_SPEED. . The absolute angular velocity is calculated by taking the route of the sum of squares of the outputs X and Y and the arithmetic expression as shown in step 3 of FIG. The absolute angular velocity value calculated in this step is plotted on the time axis of abscissa, as shown in FIG. 8 (A). Step 4: The average value of the absolute angular velocities calculated in step 3 at each timing from the current timer interrupt time to the timer interrupt time m times before is calculated and stored in the moving average register M_AVERAGE as a moving average value. For example, when m is “8”, the moving average value is obtained by dividing the sum of the eight absolute angular velocities calculated at each timing by 8. Step 5: Calculate the average value of the moving average values stored in the moving average register M_AVERAGE calculated in step 4 of each timing from the current timer interrupt time to the timer interrupt time of n times before, and make it dynamic. Dynamic threshold register DY as threshold value
Store in NA_THRE.

Step 6: The value stored in the previous value register NOW is stored in the value register OLD two times before, the value stored in the current value register NEW is stored in the previous value register NOW, and the moving average value calculated this time (moving average register M_AVER) is stored.
The stored value of AGE) is stored in the current value register NEW.
That is, the two-previous value register OLD and the previous value register N
The values stored in the OW and the current value register NEW are shifted to new values. Step 7: Perform peak detection processing based on the stored values of the two-preceding value register OLD, the previous value register NOW and the current value register NEW. FIG. 3 is a diagram showing details of this peak detection processing. This peak detection process is sequentially executed in the following steps.

Step 70: Whether the value stored in the previous value register NOW is greater than or equal to the value stored in the two-previous value register OLD and the value stored in the current value register NEW, that is, the moving average detected at the time of the previous timer interrupt. It is determined whether or not the value is the maximum value (peak). If YES, the process proceeds to the next step 71, and if NO, the process proceeds to step 8 in FIG. Step 71: Since it was determined in Step 70 that the time point of the previous timer interrupt was the maximum value (peak) of the moving average value, the time point of the current peak judgment is calculated from the time point of the previous peak and a predetermined time has elapsed. If the predetermined time has elapsed (YES), the process proceeds to the next step 72, and the predetermined time has not elapsed (NO).
In that case, the process immediately proceeds to step 8 in FIG. That is, since the peak determined to be YES again in step 70 when the predetermined time has not elapsed from the time of the previous peak determination means that it is a pseudo peak value caused by the disturbance of the hand movement of the operator. is there.

Step 72: It is judged whether or not the value stored in the previous value register NOW is larger than a certain threshold value. If it is larger (YES), the process proceeds to the next step 73, and if it is smaller (NO), it is immediately shown in FIG. Go to step 8. That is, the fact that the value stored in the previous value register NOW is smaller than the fixed threshold value means that the values are stored in steps 70 and 71.
This is because the peak determined to be YES means that the peak value is a pseudo peak value caused by the disturbance in the hand movement of the operator. Step 73: The value stored in the previous value register NOW is calculated in step 5 of FIG.
It is determined whether it is larger than the dynamic threshold value stored in YNA_THRE. If it is larger (YES), the process proceeds to the next step 74, and if it is smaller (NO), the process immediately proceeds to step 8 in FIG. That is, the peak value is always larger than the dynamic threshold value.

Step 74: It is judged whether or not the stored value of the previous value register NOW is larger than the previous stored value of the peak value register LAST_PEAK multiplied by a predetermined coefficient A of 1 or less. Step 75, and if it is smaller, immediately go to Step 8 in FIG. That is, it is considered that the peak value will be a value approximately approximate to the previous peak value. Step 75: It is judged whether or not a valley is detected by the peak detection processing or the valley detection processing before the time of the current timer interruption, and the previously detected valley is (YES).
In this case, the peak detected this time is considered to be correct, so the process proceeds to the next step 76, and if the previous detection was a peak (NO), the peaks cannot be continuous, so the peak detected this time. Is considered to be erroneous, the process immediately proceeds to step 8 in FIG.

Step 76: Previous peak value register LA
The value stored in the previous value register NOW is stored in ST_PEAK. Step 77: A peak type determination process is performed to determine what kind of operation the peak detected this time is. That is, it is a process of determining in which direction of the baton 20 the peak determined by the processes of steps 70 to 75 is caused.

FIG. 4 is a diagram showing details of this peak type determination processing. This peak type determination process is sequentially executed in the following steps. Step 770: An angle is calculated based on the output X of the X-direction piezoelectric vibration gyro sensor 2A from which the DC component is removed and the output Y of the Y-direction piezoelectric vibration gyro sensor 2B, and the calculated angle is stored in the angle register θ. The angle is step 77 in FIG.
It is calculated by an arithmetic expression shown in 0, that is, an arc tangent of a value obtained by dividing the output Y by the output X.

Step 771: It is judged whether or not the stored value of the angle register θ is larger than 180 ° and equal to or smaller than 300 °. If YES, the process proceeds to the next step 772, and if NO, the process proceeds to step 773. Step 772: Since the current peak is caused by the hand gesture of the motion type “1”, the current peak is set as the peak of the motion “1” here. Step 773: It is judged whether the stored value of the angle register θ is 60 ° or less and is larger than 300 °,
If YES, the process proceeds to the next step 774, and if NO, the process proceeds to step 775. Step 774: Since the current peak is caused by the hand gesture of the motion type “2”, the current peak is set as the peak of the motion “2” here. Step 775: The determination of NO in Step 771 and Step 773 means that the stored value of the angle register θ is 180 ° or less and larger than 60 °, that is, the current peak is the operation type “3”. This means that the current peak is the peak of the motion “3”, since it means that the current motion is caused by the hand gesture motion.

FIG. 7 is a diagram showing the relationship between the angle θ obtained by the arithmetic expression of step 770 and its operation types “1”, “2” and “3”. That is, the angle θ is 1
Greater than 80 ° and less than or equal to 300 ° (step 77)
It is determined as YES in 1) means that the angle θ is 60 ° or less in the direction of the operation “1” as shown in FIG.
It is determined that the angle is greater than 0 ° (YES in step 773), which means that in the direction of the operation "2" as shown in the figure,
It is determined that the angle θ is 180 ° or less and larger than 60 ° (NO in step 773), which means that the baton 20 is swung in the direction of the movement “3” as shown in the figure. To do.

Step 78: A dynamics calculation process for calculating dynamics based on the peak value detected this time is performed. FIG. 5 is a diagram showing details of this dynamics calculation processing. In this dynamics calculation processing, FIG.
For each peak type (that is, operation type) “1”, “2”, and “3” determined by the peak type determination process of, the peak value is multiplied by a different coefficient, and the moving average value is calculated according to the following degree. , That is the dynamics. This dynamics calculation process is sequentially executed in the following steps.

Step 780: It is judged whether or not the peak type, that is, the operation type is "1", and "1" (YE
In the case of S), the process proceeds to step 782 and is "2" or "3".
In the case of (NO), the process proceeds to step 781. Step 781: It is determined whether or not the type of peak, that is, the type of operation is "2". If "2" (YES), the process proceeds to step 785, and if "3" (NO), the process proceeds to step 789.

Step 782: 16 registers LAST16, LAST15, L for storing the past 16 peak values in preparation for the moving average calculation processing of the next step.
The values of AST14, ..., LAST1 are respectively updated. That is, the stored value of the register LAST15 is stored in the register LAST16, the stored value of the register LAST14 is stored in the register LAST15, the stored value of each register is sequentially shifted, and the stored value of the previous value register NOW is stored in the register LAST1. ..

Step 783: The moving average of the peak values is calculated based on the moving average order α corresponding to the follow-up degree, and this is taken as the dynamics. This moving average order α is a value corresponding to the following degrees A, B, and C as shown in FIG. That is, in the case of the follow-up degree A, the moving average order α becomes 1, and the peak value of the motion type “1” detected this time is used as it is as the dynamics to register the dynamics register DYNAM.
Store in ICS. When the follow-up degree is B, the moving average order α
Becomes 4 and registers LAST1, LAST2, LAST3 and LAST that store the peak values of the past four times.
4 is added and the moving average value ((LAST1 + LAST2 + LAST3
+ LAST 4) / 4) is stored in the dynamics register DYNAMICS as dynamics. In the case of the follow-up degree C, the moving average order α is 16, and the registers LAST1 and LAST that store the peak values of the past 16 times are stored.
2, ..., The stored values of LAST16 are added, and the values are divided by the order α = 16 to obtain a moving average value ((LAST1
Dynamics register DYNAMICS with + LAST2 + ... + LAST16) / 16) as dynamics
To store. It should be noted that the above-mentioned moving average order α values 1, 4,
Reference numeral 16 is for two-beat or four-beat, and in the case of three-beat, the moving average order α is 1, 3, 12. Step 784: Key code "C" corresponding to the operation "1"
3 ”and the dynamics obtained in step 783 are output, and the process proceeds to step 8 in FIG.

Step 785: Since it is determined in step 781 that the peak is the motion type "2" (YES), the peak value is multiplied by the coefficient a. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient a, and the multiplied value is stored again in the previous value register NOW. Step 786: Similar to the step 782, 16 registers LAST16 storing the peak values of the past 16 times in preparation for the moving average calculation processing of the next step,
The values of LAST15, LAST14, ..., LAST1 are respectively updated. Step 787: Similar to step 783, the moving average of the peak value is calculated based on the moving average order α corresponding to the follow-up degree, and this is taken as the dynamics. Step 788: Key code "C" corresponding to operation "2"
The key-on of "# 3" and the dynamics obtained in step 787 are output, and the process proceeds to step 8 in FIG.

Step 789: Since it is determined in step 781 that the motion type "3" is the peak (NO), here it is determined whether or not the previous motion type is "1", and "1" is determined. If yes, step 78A.
And if "2" (NO), proceed to step 78B. That is, the peak of the motion "1" and the peak of the motion "2" appear alternately in the vertical hand-moving motion in the two-beat and four-beat, and the peak of the motion "1" and the peak of the motion "2" in the triangular hand-moving motion in the three-beat, The peaks of motion "3" appear in order. Therefore, the output value of the angular velocity sensor is different between the case where the operation "1" is changed to the operation "3" and the case where the operation "2" is changed to the operation "3". Therefore, here, the coefficient value for the motion "3" is made different between the case of the vertical hand gesture motion and the case of the triangular hand gesture motion.

Step 78A: Since it was determined in step 789 that the previous operation type was "1" (YES),
The peak value is multiplied by the coefficient c. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient c,
The multiplication value is stored again in the previous value register NOW. Step 78B: Since it was determined in step 789 that the previous operation type was "2" (NO), the peak value is multiplied by the coefficient b. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient b, and the multiplied value is stored again in the previous value register NOW.

For example, the peak value during the swing-down motion is the largest, then the peak value during the swing-up motion during the triangular hand-swing motion, the peak value during the side-swing motion during the triangular hand-swing motion, and the peak value during the swing-up motion during the vertical hand-swing motion. In that order, the size is getting smaller. Therefore, the coefficient a in the lateral swing motion of the motion type “2” in the triangular hand swing motion is set to 1.75, and the coefficient b in the swing motion of the motion type “3” is set to 1.5, and the motion in the vertical hand swing motion is set. By setting the coefficient c in the swing-up motion of the type “3” to 1.875, the dynamics can be made uniform as a whole. Needless to say, these coefficient values are examples, and each operator may arbitrarily set a desired value.

Step 78C: Similar to step 782, 16 registers L for storing the peak values of the past 16 times are prepared for the moving average calculation process of the next step.
AST16, LAST15, LAST14, ..., L
The value of AST1 is updated. Step 78D: Similar to step 783, the moving average of the peak value is calculated based on the moving average order α corresponding to the follow-up degree, and this is taken as the dynamics. Step 78E: Key code "D" corresponding to operation "3"
3 ”and the dynamics calculated in step 78D are output, and the process proceeds to step 8 in FIG.

Step 8: Valley detection processing is performed based on the stored values of the two-preceding value register OLD, the previous value register NOW and the present value register NEW. FIG. 6 is a diagram showing the details of this valley detection processing. This valley detection process is sequentially executed in the following steps. Step 80: Whether the value stored in the previous value register NOW is less than or equal to the value stored in the value register OLD two times before, and less than or equal to the value stored in the current value register NEW, that is, the movement detected at the time of the previous timer interrupt. It is determined whether or not the average value is the minimum value (valley). If YES, the process proceeds to the next step 81, and if NO, the process returns and waits until the next timer interrupt timing. Step 81: The previous timer interruption time point is the time point when the minimum value (valley) of the moving average value is reached.
Since it is judged as 0, it is judged here whether or not a predetermined time has elapsed since the current valley judgment time was calculated from the previous valley judgment time, and if the predetermined time has elapsed (YES), the next step 82, the predetermined time has not elapsed (N
In the case of O), the current valley judgment is considered to be incorrect, and therefore the routine returns and waits until the next timer interrupt timing.

Step 82: It is judged whether or not the value stored in the previous value register NOW is smaller than a certain threshold value. If smaller (YES), the process proceeds to the next step 83, and if larger (NO), the current valley judgment is made. Is suspected to be incorrect, so return and wait until the next timer interrupt timing. Step 83: It is determined whether or not the value stored in the previous value register NOW is smaller than the dynamic threshold value stored in the dynamic threshold value register DYNA_THRE, and if it is smaller (YES), the process proceeds to the next step 84 and is larger ( In the case of NO), it is considered that the current valley judgment is erroneous, so the routine returns and waits until the next timer interrupt timing.

Step 84: It is judged whether or not the peak is detected by the peak detection processing or the valley detection processing before the time of the current timer interruption, and if the peak was previously detected (YES), it is detected this time. Since the detected valley is considered to be correct, the process proceeds to the next step 85. If the previously detected valley is NO (NO), the valley detected this time is considered to be incorrect, so return and return to the next timer interrupt timing. Wait until. Step 85: It is determined that the minimum value detected this time is an official valley. When the valley is detected as described above, the peak is detected by the peak detection process of FIG. That is, the peak detection processing shown in FIG. 3 and the valley detection processing shown in FIG. 6 are alternately performed, so that the peak and the valley are reliably detected.

Next, an example of the operation will be described with reference to FIG. 8 as to how the sensor output processing is performed by moving the baton 20 according to the gesture motion of the operator. FIG. 8 is a schematic diagram showing the concept of sensor output processing in a triangular hand waving motion corresponding to a gesture of three beats so that the baton 20 draws a triangular locus. FIG. 8 (A)
FIG. 8 is a diagram showing an output waveform of the absolute angular velocity when the baton 20 is moved by a triangular hand waving motion of 3 beats, and FIG. 8B is a diagram showing a peak detection time point of the absolute angular velocity in the triangular hand waving motion. .

When the baton 20 is moved by the triangular waving motion as shown in FIG. 8B, the absolute angular velocity value calculated in step 3 has a shape as shown in FIG. 8A. Peaks and valleys appear alternately in the order of the first peak, the valley, the second peak, the valley, the third peak, and the valley. First, when the baton 20 is swung in the direction of 240 ° in FIG. 7 (obliquely leftward and downward), the first peak is detected by the processing of steps 70 to 75. And the previous peak value register LA
The value stored in the previous value register NOW is stored in ST_PEAK. By the processing of step 771 in FIG. 4, it is determined that the first peak is the peak of the operation “1”. In FIG. 8 (B), the detection time of the first peak is indicated by a circle. Then, the dynamics corresponding to the peak value of the first peak is calculated by the dynamics calculation processing of step 78 by the processing of steps 782 and 783, and is output together with the key-on of the key code "C3" corresponding to the operation type "1". become.

Thereafter, the baton 20 is moved to 240 in FIG.
When it is shaken in the direction of 0 ° (obliquely leftward downward) in the direction of 0 ° (horizontal rightward direction), a valley is detected this time by the processing of steps 80 to 85 in FIG. Then, when the baton 20 is swung in the direction of 0 ° (horizontal right direction) in FIG. 7, the second peak is detected as the peak of the motion “2” in response to this, and the peak value of the second peak is obtained. The corresponding dynamics are calculated by the processing of steps 785, 786 and 787,
The key code "C # 3" is output together with the tempo key-on signal.

When the baton 20 is swung from the direction of 0 ° (horizontal right side) to the direction of 120 ° (obliquely leftward upward) in FIG. 7, a valley is detected at the change point of the hand movement.
After that, the third peak is detected this time as the peak of the operation “3”. The dynamics corresponding to the peak value of the third peak is calculated by the processing of steps 78B, 78C and 78D, and is output together with the tempo key-on signal of the key code "D3". Then, when the baton 20 is swung again from the direction of 120 ° (obliquely leftward upward) to the direction of 240 ° (obliquely downward leftward) in FIG. 7, a valley is detected at the change point of the waving action, and waving thereafter. The above-described processing is repeatedly executed according to the operation.

On the right side of FIG. 8B, the baton 20
Shows the peak detection time when the hand waving motion (or oscillating motion) is performed in the vertical direction with 2 or 4 beats. In this case, when the baton 20 is swung in the direction of 270 ° (downward) in FIG. 7, the first peak is detected as the peak of the motion “1”, and the dynamics corresponding to the peak value of the first peak is stepped. It is calculated by the processing of 782 and 783, and is output together with the tempo key-on signal of the key code "C3". After that, the baton 20 is changed to 2 in FIG.
When shaken in the direction of 70 ° (downward) to the direction of 90 ° (upward), a valley is detected at the change point of the hand movement,
This time, the second peak is detected as the peak of the operation "3", and the dynamics corresponding to the peak value of this second peak is calculated by the processing of steps 78A, 78C and 78D, and together with the tempo key-on signal of the key code "D3". It will be output. Then, when the baton 20 is swung again from the direction of 90 ° (upward direction) to the direction of 270 ° (downward direction) in FIG. 7, a valley is detected at the change point of the hand shaking action, and the above-described processing is repeatedly executed. To be done.

In this manner, when the operator moves the baton 20, the baton 20 outputs the tempo key-on signal and the intended dynamics at the operator's intended interval in accordance with the operator's waving motion. Since the electronic musical instrument 1H reproduces the sequence data according to the tempo key-on signal and the dynamics, the tempo and performance dynamics can be controlled arbitrarily. As will be described later, the electronic musical instrument 1H controls the tempo of the automatic performance so that the output timing of the tempo key-on signal and the beat timing of the automatic performance substantially coincide with each other. The timing and the beat timing of the automatic performance will match.

Next, an example of how the microcomputer (CPU 11) in the electronic musical instrument 1H performs the reproduction processing of musical tones by inputting this tempo key-on signal will be described with reference to the flowcharts of FIGS. 9 to 13. Explain. FIG. 9 is a diagram showing an example of a musical sound reproduction process performed by the microcomputer (CPU 11) in the electronic musical instrument 1H. This reproduction process is a timer interrupt process executed in synchronization with the operation clock from the timer 19 (cycle of about 1 ms). This reproduction processing is performed by the program ROM 1
This is a series of processes according to the control program stored in No. 2, and is executed in order by the following steps.

Step 40: It is judged whether or not the traveling state flag RUN is "1". If "1" (YES), it means that the reproduction processing of the automatic performance data is performed. If it is "0" (NO), it means that the reproduction process is not performed, and therefore the process immediately returns.
Wait until the next interrupt timing. Step 41: It is judged whether or not the pause flag PAUSE is "0". If it is "0" (YES), it means that the vehicle is temporarily stopped. To do. The suspension will be described later. Step 42: It is determined whether or not the timing counter TIME is "0". If "0" (YES), the process proceeds to the next step 43, and if the value is other than "0" (NO), the process jumps to the next step 49. To do.

Step 43: Since it is judged that the timing counter TIME is "0" at the step 42 or the step 47, the address of the RAM 12 is advanced and the automatic performance data is read from the address position. Automatic performance data is event data (including channel number)
And a combination of delta time data. Step 44: It is judged whether or not the data read out in the step 43 is delta time data, and if it is delta time data (YES), the process proceeds to step 45, and if it is other event data (NO), step 46.
Proceed to. Step 45: The delta time data read in step 43 is stored in the timing counter TIME.

Step 46: Processing corresponding to the event data read in step 43 (event corresponding processing)
To execute. FIG. 10 is a diagram showing details of this event handling process. This event handling process is sequentially executed in the following steps. Step 460: In this embodiment, the automatic performance data is 1 to
Data of 16 channels are included, of which the channel number CH1 is used as a tempo control and follow-up degree control channel, a key-on event is used as a tempo control mark, and a key-off event is used as a follow-up degree control mark. Therefore, here, it is determined whether or not the event data read in step 43 is the event of the channel number CH1. If YES, step 46
If it is NO, the process proceeds to step 467 because it is an event of a channel number other than this. The key-on event of the channel number CH1 is stored at the position of each beat timing, and the key code of each event is
C3, C # 3, D3, C3, C # for 3-beat songs
In the order of 3, D3, ...
They are arranged in the order of 3, C3, D3. The key-off event of the channel number CH1 is stored at an arbitrary position for changing the follow-up degree, and the key code of each event is A, B, or C. Although the key-on event and the key-off event of the channel number CH1 are used as the tempo control mark and the follow-up degree control mark, respectively, dedicated data representing each mark may be provided.

Step 461: Since it is determined in step 460 that the event is the channel number CH1,
Here, it is determined whether or not the event is a key-off event for tracking control, and if the key-off event for tracking control (YES), the process proceeds to step 462, and if it is a key-on event for tempo control (NO), the step proceeds. 46
Go to 3. Step 462: Since it is determined in the step 461 that the key-off event is for the follow-up degree control, the moving average order, the difference limit, the lower limit value, and the upper limit value shown in FIG. , Are stored in the corresponding registers α, β, γ, δ, and the process proceeds to step 47.

Step 463: Since it is determined in step 461 that the key-on event is for tempo control, it is determined here whether the key-on receive flag KON_RCV is "1". If "1" (YES), step If it is “0” (NO), the process proceeds to step 465. Step 464: The fact that the key-on receive flag KON_RCV is “1” in step 463 means that
This means that the tempo key-on signal has already been input from the baton 20 via the MIDI interfaces 27 and 1B before the key-on event for the tempo control of the channel number CH1 is read out, so here, the key-on receive flag KON_RCV is set to " 0 ”is set and the process proceeds to step 47.

Step 465: The fact that the key-on receive flag KON_RCV is "0" at the step 463 means that the tempo key-on signal corresponding to the key-on event for the tempo control of the channel number CH1 read at the step 43 is not yet present. Since it means that the key code register KE has not been entered,
The key code of the read key-on event for tempo control is stored in YCODE. Step 466: Since the tempo key-on signal has not been inputted yet, the pause flag PAUSE is set to "1" and the routine proceeds to the next step 47. Pause flag PAUS
By setting "1" to E, the determination at step 41 becomes NO thereafter, and steps 42 to 4A are not executed.

Step 467: Since it is determined in the step 460 that the event is other than the channel number CH1, the event is output to the tone generator circuit 17 here. At this time, when the event is a note event, the velocity is corrected according to the dynamics calculated in step 78 of FIG. By correcting the velocity, it is possible to arbitrarily control the volume of the musical sound according to the action such as the swing speed of the baton 20. Elements other than velocity, such as tone color, pitch, and effects, may be controlled arbitrarily.

Step 47: Since the delta time data read out in step 45 may be "0",
Here, it is again determined whether the timing counter TIME is "0". If "0" (YES), the process proceeds to the next step 43, and if the value is other than "0" (NO), the process jumps to the next step 49. To do. Delta time data is "0"
This means that multiple events exist at the same timing. Step 48: The stored value of the timing register TIME is multiplied by the stored value (tempo coefficient) of the tempo coefficient register T_COEF. Here, the tempo coefficient is a value based on "1", and the tempo is controlled according to this value. For example,
When the tempo coefficient is "0.5", the tempo is doubled, and when it is "2", the tempo is halved.

Step 49: Timing register TIM
The value of E is decremented by "1". Step 4A: Delta Accumulate Register DELT
The value of A_ACM is incremented by "1".
The delta accumulation register DELTA_ACM counts the time between events read from the channel number CH1. Step 4B: Interval register INTERVAL
The value of is incremented by "1". The interval register INTERVAL measures the time interval of the tempo key-on signal transmitted from the baton 20.

Step 4C: Perform tempo key-on reception processing. This tempo key-on reception process is a process performed each time a tempo key-on signal is received from the baton 20.
Therefore, when the tempo key-on signal is not received, no substantial process is performed. FIG. 11 is a diagram showing details of the tempo key-on reception processing. This tempo key-on reception process is sequentially executed in the following steps. Step 4C0: It is judged whether or not the tempo key-on signal is received from the baton 20 via the MIDI interfaces 27 and 1B. If the reception is present (YES), the process proceeds to step 4C1. Then, the process returns to the playback process of and waits until the next interrupt timing.

Step 4C1: Pause flag PAUS
It is determined whether E is "1". If "1" (YES), the process proceeds to step 4C2, and if "0" (NO), the process proceeds to step 4C9. Step 4C2: The fact that the pause flag PAUSE is determined to be "1" in the step 4C1 means that
This means that the key-on event data for tempo control of the channel number CH1 has been read out before the reception of the tempo key-on signal, and that key code has already been stored in the key code register KEYCODE in step 465. It is determined whether the key code of the received tempo key-on signal and the key code stored in the key code register KEYCODE match. If they match (YES), the process proceeds to step 4C3, and if they do not match (NO), the figure The process returns to the reproduction process of No. 9 and waits until the next interrupt timing.

Step 4C3: Interval register I
NTERVAL value and Delta accumulated register D
The ratio with the value of ELTA_ACM is set to the rate register RATE
To store. That is, the ratio between the time interval of the tempo key-on signal transmitted from the baton 20 and the time interval at which the event of the channel number CH1 is actually read is stored in the rate register RATE. Step 4C4: Perform tempo coefficient calculation processing. This tempo coefficient calculation processing is processing for calculating a new tempo coefficient based on the value of the rate register RATE calculated in step 4C3 and the moving average order α corresponding to the follow-up degree set in step 462. . FIG. 12 is a diagram showing details of the tempo coefficient calculation processing. The tempo coefficient calculation process is also executed in step 4CF. This tempo coefficient calculation process is sequentially executed in the following steps.

Step 4C51: 16 registers TC16 and TC1 storing tempo coefficients for the past 16 times
5, TC14, ..., TC2, respectively. That is, the value stored in the register TC15 is set to the register T
The value stored in the register TC14 is stored in the register TC14, the stored value in the register TC14 is stored in the register TC15, the stored value in each register is sequentially shifted, and the stored value in the register TC1 is stored in the register TC2. Step 4C52: The stored value (tempo coefficient) of the tempo coefficient register T_COEF is multiplied by the rate value RATE calculated in the step 4C3, and the multiplication value (T_COE
F × RATE) is stored in the register TC1.

Step 4C53: The moving average of the tempo coefficient is calculated based on the moving average degree α corresponding to the follow-up degree, and this is used as a new tempo coefficient in the tempo coefficient register T_C.
Store in OEF. This moving average order α is a value corresponding to the following degrees A, B, and C, as shown in FIG. That is, in the case of the follow-up degree A, the moving average order α becomes 1,
The stored value of the register TC1 calculated in step 4C52 is stored as it is in the tempo coefficient register T_COEF as a new tempo coefficient. In the case of the follow-up degree B, the moving average order α becomes 4, and the stored values of the registers TC1, TC2, TC3, and TC4 that store the tempo coefficients for the past four times are added, and the result is divided by the order α = 4. Obtained moving average value ((TC1 + TC2 + TC3 + TC4) / 4)
As a new tempo coefficient, tempo coefficient register T_CO
Store in EF. In the case of the follow-up degree C, the moving average order α is 16, and the stored values of the registers TC1, TC2, ..., TC16, which store the tempo coefficients for the past 16 times, are added, and the order is α = 16. The moving average value ((TC1 + TC2 + ... + TC16) / 16) obtained by dividing is used as a new tempo coefficient in the tempo coefficient register T_COE.
Store in F.

Step 4C5: Tempo coefficient limit processing is performed so that the value of the tempo coefficient obtained by the tempo coefficient calculation processing of step 4C4 and the difference from the previous value fall within a predetermined range corresponding to the follow-up degree. FIG. 13 is a diagram showing details of the tempo coefficient limit processing. The tempo coefficient limiting process is also executed in step 4CG. This tempo coefficient limit processing is sequentially executed in the following steps. Step 4C54: Difference between the value of the tempo coefficient (current value) obtained by the tempo coefficient calculation processing of step 4C4 and the value of the tempo coefficient (previous value) obtained by the tempo coefficient calculation processing of the previous tempo key-on reception processing Is within the range of the difference limit β corresponding to the follow-up degree, and if it is within the range of the difference limit β (YES), the process proceeds to step 4C56 and is outside the range of the difference limit β (NO).
In the case of, proceed to Step 4C55. Step 4C55: Since it is determined in step 4C54 that the difference between the current value and the previous value is outside the predetermined range (NO), the value of the tempo coefficient register T_COEF is set so that the difference value is within the difference limit β. Limit This difference limit β is as shown in FIG.
It is a value corresponding to B and C. That is, the difference limit β for the follow-up degree A is 0.2, the difference limit β for the follow-up degree B is 0.1, and the difference limit β for the follow-up degree C is 0.05. Therefore, the difference between the current value and the previous value, that is, the magnitude of the change in the tempo coefficient, differs depending on the follow-up degree.

Step 4C56: It is determined whether or not the value of the tempo coefficient obtained by the tempo coefficient calculation processing of step 4C4 is equal to or more than the lower limit value γ corresponding to the follow-up degree and less than or equal to the upper limit value δ, and if YES Goes to step 4C6 in FIG. 11, and if NO, goes to step 4C57. Step 4C57: Since it is determined in step 4C56 that the value of the tempo coefficient is outside the predetermined range (NO),
The value of the tempo coefficient register T_COEF is limited so that the value of the tempo coefficient is not less than the lower limit value γ and not more than the upper limit value δ. The lower limit value γ and the upper limit value δ are values corresponding to the following degrees A, B, and C, as shown in FIG. That is, the lower limit value γ for the followability A is 0.5, the upper limit value δ is 2.0, the lower limit value γ for the followability B is 0.7, and the upper limit value δ.
Is 1.6, the lower limit value γ is 0.8 and the upper limit value δ is 1.2 in the case of the follow-up degree C. Therefore, the range of possible tempo coefficient values varies depending on the follow-up degree.

Step 4C6: "0" is set in the delta accumulation register DELTA_ACM in order to measure the time interval from the reception of the current tempo key-on to the reading of the event of the next channel number CH1. Step 4C7: "0" is set in the interval register INTERVAL in order to measure the time interval from the time of receiving the current tempo key-on to the time of receiving the next tempo key-on signal. Step 4C8: "0" is set to the pause flag PUASE. As a result, the reproduction process of FIG. 9 is started again.

Step 4C9: The fact that the pause flag PAUSE is determined to be "0" at the step 4C1 means that the event data of the channel number CH1 has not been read yet. The event of the next channel number CH1 that first appears at is searched for and read. Step 4CA: It is determined whether or not the key code of the received tempo key-on signal and the key code of the searched channel number CH1 match. If they match (YES), the procedure proceeds to step 4CA.
Then, the process returns to the playback process of and waits until the next interrupt timing.

Step 4CB: The accumulated value of the delta time data of each event read until the event of the channel number CH1 searched in step 4C8 is searched for is multiplied by the tempo coefficient of the tempo coefficient register T_COEF. , The value of the timing register TIME at that time, and the delta accumulation register D
Add to ELTA_ACM. Step 4CC: Delta time and timing register TIM until the event searched in Step 4C8
Multiply the value of E by 1 / K. Here, K is a value of 1 or more. That is, the delta time of each event and the value of the timing register TIME are decreased in order to increase the reproduction speed after the time when the tempo key-on signal is received from the baton 20 and bring the tempo key-on signal reception timing close to the beat timing. . Step 4 CD: Key-on receive flag KON_RC
Set "1" to V and proceed to step 4CE. From step 4CE to step 4CJ, the above-mentioned step 4C3
To Step 4C7, the description thereof will be omitted.

Next, an operation example of how the microcomputer (CPU 11) in the electronic musical instrument 1H performs reproduction processing by inputting this tempo key-on signal will be described with reference to FIG. FIG. 15 shows the baton 2
It is a figure which shows the relationship between the input timing of the tempo key-on signal taken into the electronic musical instrument 1H from 0, and the reading timing of automatic performance data. The baton 20 is assumed to have a triangular hand movement as shown in FIG. 12 songs in total
It consists of measures, the first 3 measures are the followability B, the middle 6 measures are the measure C, and the last 3 measures are the measure A.
It is composed of. In the figure, the relationship between the input timing of the tempo key-on signal and the read timing of the automatic performance data at the portion where the follow-up degree C is switched to the follow-up degree A is shown.

At timing t1, steps 40 to 40 in FIG.
After step 42, the key-off event of the channel number CH1, that is, the key-off event of the follow-up degree A, is read out in step 43, and the value corresponding to the follow-up degree A is read in each register register α, β in step 462 of FIG.
It is stored in γ and δ. Then, in the next step 43, the delta time D0 is read, and in step 45, the delta time D0 is written in the timing register TIME. Here, the delta time D0 is "0", indicating that the key-on event of the channel number CH1 exists at the same timing.

Therefore, at the same timing t1, in step 43, the key-on event of the channel number CH1, that is, the key-on event for tempo control is read. Since the tempo key-on signal is not yet received at this timing t1, it is determined to be NO in step 463 through step 460 and step 461 of FIG. Register KEYCOD
It is stored in E and the pause flag PAUSE is set to "1". Then, in the next step 43, the delta time D1 is read, and in step 45, the delta time D1 is written in the timing register TIME.

At timing t2, which is a little later than timing t1, the baton 20 transmits the tempo key-on signal of the key code "C3" and the dynamics to the electronic musical instrument 1H. As a result, the processing of steps 4C3 to 4C8 is performed through the steps 4C0 to 4C2 of the tempo key-on reception processing of FIG. At this time, since the tempo key-on signal is received at almost the same timing as the key-on event of the channel number CH1, the ratio between the value of the interval register INTERVAL and the value of the delta accumulation register DELTA_ACM is a value close to 1. Therefore, step 4C
At 3, a value close to 1 is newly stored in the rate register RATE. At step 4C4, the tempo coefficient having the almost same value as the previous time is stored in the tempo coefficient register T_COEF. In steps 4C6 to 4C8, the interval register INTERVAL, the delta accumulation register DELTA_ACM, and the pause flag PAUSE are set to "0".

After that, as the time corresponding to the delta time D1 elapses, the value of the timing register TIME also becomes 0, and the channel number C at the timing t3.
The event of H2 is read, and step 467 of FIG.
Then the event is output to the tone generator circuit. At this time, the velocity of the note event is modified according to the received dynamics. Delta time D in the next step 43
2 is read out, and the timing register T is read in step 45.
The delta time D2 is written in the IME. Less than,
Similarly, at timings t3 to t7, events of channel numbers CH3 to CH6 and delta times D3 to D6.
Are sequentially read and each event is output to the tone generator circuit.

Thereafter, at a timing t8 when the time corresponding to the delta time D6 is being measured (during the decrement processing of the timing register TIME), the tempo key of the key code "C # 3" is turned on from the baton 20 to the electronic musical instrument 1H this time. Signals and dynamics are received. As a result, the processing of steps 4C9 to 4CJ is performed through steps 4C0 and 4C1 of the tempo key-on reception processing of FIG. In step 4C9, channel number CH1
The event with the key code "C # 3" is searched. Then, after step 4CA, the process of step 4CB is performed. In step 4CB, the channel number CH
Since there was no delta time until the event of 1 was searched, the accumulated value of delta time is "0", and only the value of the timing register TIME is added to the delta accumulation register DELTA_ACM. It As a result, the value of the delta accumulation register DELTA_ACM and the value of the interval register IN
The relationship with the TERVAL value is the delta accumulation D
ELTA_ACM is the interval register INTE
Greater than RVAL.

At step 4CC, the delta time of each event and the value of the timing register TIME are multiplied by 1 / K in order to increase the reproduction speed (tempo is increased) after the timing t8 when the tempo key-on signal is received. However, since there was no delta time until the event of the channel number CH1 was searched, the value of the timing register TIME is multiplied by 1 / K. In Step 4CD, key-on receive flag K
"1" is set to ON_RCV and step 4CE-
In step 4CJ, the interval register INTERV
AL value and delta accumulated register DELTA_
The ratio to the value of ACM (value smaller than 1) is newly stored in the rate register RATE. At step 4CF, a tempo coefficient smaller than the previous time is stored in the tempo coefficient register T_COEF. Step 4CH and Step 4CJ
Then Delta Accumulate Register DELTA_ACM
And "0" is set in the interval register INTERVAL.

After that, the value of the timing register TIME becomes 0, and the channel number CH1 is set at the timing t9.
When the key-on event "C # 3" for tempo control is read, the key-on receive flag KON_RCV is set to "0" in step 464 of FIG. Similarly, at each timing, the channel number event and the delta time are calculated in the tempo coefficient register T_.
The events are sequentially read out while being modified by a tempo coefficient smaller than 1 stored in COEF, and each event is output to the tone generator circuit while being modified by the received dynamics. That is, if the reception timing of the tempo key-on signal from the baton 20 is earlier than the read timing of the automatic performance data, the tempo of the automatic performance data reproduction processing increases,
In the opposite case, the tempo of the automatic performance data reproduction process is lowered.

In the above-described embodiment, an example of various values relating to the follow-up degree has been described using FIG. 14, but the present invention is not limited to this, and various values may be changed as appropriate. For example, the user may be allowed to arbitrarily set, or a plurality of sets of values may be prepared in advance and any one of them may be selected. Further, one or a plurality of optimum sets may be provided for each music piece, or a plurality of sets may be prepared and the optimum set according to the music piece may be automatically selected from among them. . Further, the following degree is not limited to three types, and may be two types or four or more types. Moving average order, difference limit,
The case where the tempo coefficient and the dynamics are controlled by using the four values of the lower limit value and the upper limit value has been described, but some of these may be appropriately combined, or other conditions may be controlled.

In the embodiment, the example in which the tempo control signal and the dynamics are generated according to the gesture motion of the operator, such as a baton, has been described as an example. Alternatively, the tempo control signal may be generated. Further, in the embodiment, the case where there are three types of motions has been described, but more types of motions may be detected.

In the above-mentioned embodiment, the sensor for detecting the gesture motion is not limited to the piezoelectric gyro sensor, but may be an acceleration sensor, a magnet or light. For example, the gesture motion may be captured and the gesture motion may be detected by image processing. Also, a plurality of these sensors may be combined. In addition, in the above-described embodiment, the case where the peak and the valley of the output from the piezoelectric gyro sensor are extracted as the characteristic point of the gesture motion is described, but the present invention is not limited to this, and the type of the sensor may be changed to meet other conditions. You may make it extract the feature point using. Further, in the above-described embodiment, the baton 20 and the electronic musical instrument 1 connected via the MIDI interface are used.
Although H has been described as an example, it goes without saying that both may be integrally formed. Alternatively, the tempo clock generated by the electronic musical instrument 1H may be supplied to an external device to control the performance tempo of the external device.

In the above-mentioned embodiment, the case where the baton 20 detects the peak and the valley and further detects the operation type thereof is explained. However, the baton 20 simply outputs the sensor value according to the gesture motion, It goes without saying that the musical instrument 1H side may perform detection processing (peak and valley detection, operation type detection) according to this output. Further, in the above embodiment, the case where the gesture motion is detected by using two piezoelectric gyro sensors has been described, but it goes without saying that three or more may be used. In this case, sensors provided at different positions for three beats and two quarter beats may be used respectively, or a gesture motion may be detected by comprehensively judging outputs of three or more sensors. Good.

In the above embodiment, the case where the sensor is built into the baton has been described. However, the sensor is attached to the operator's body (for example, hand), a microphone or other device (for example, remote controller of a karaoke device, etc.) ) May be built in. In this case, the sensor output may be sent by wire or wirelessly. For example, in the case of being built in a microphone, the tempo control may be enabled only in the intro portion of karaoke, and the performance tempo of karaoke may be determined according to the gesture motion of the microphone. In the embodiment, the case where the tempo is always controlled during the performance has been described, but it may be used when the tempo is decided prior to the performance. In the embodiment, the case where the performance data is composed of the event and the delta time has been described, but it goes without saying that a storage method other than this may be used. For example, performance data is composed of a set of event and absolute time. The unit of delta time is m
Even if a time unit such as s is used, the length of the note (for example, 4
(Eg, 1 / 24th of a quarter note) may be used.

In the embodiment, the tempo is controlled by multiplying the value of delta time by the tempo coefficient and increasing or decreasing the value of delta time, but by changing the cycle of processing (interrupt timing). The tempo may be changed. In the embodiment, the tempo control data and the automatic performance data are mixed,
I explained the case of distinguishing by channel number,
Both may be provided separately in advance. For example, the memory for storing the address of the memory corresponding to the note position for controlling the tempo may be used as the tempo control data. When the tempo changes, the value of the tempo coefficient register T_COEF may be interpolated with the previous value so that the tempo changes smoothly. The dynamics control may be changed smoothly as well.

In the embodiment, the case where the peak value is multiplied by a predetermined value to calculate the dynamics has been described, but the predetermined value may be added to calculate the dynamics. Further, the value to be multiplied or added may be changed based on the change in the peak size, or may be selected from a plurality of predetermined values. Alternatively, a plurality of tables may be provided, one of the tables may be appropriately selected according to the peak size, and the dynamics may be obtained by referring to the tables. In the above embodiment, the case where the velocity is changed according to the dynamics has been described, but the tone color, pitch, effect, etc. may be changed according to the dynamics. The number of performance parts may be increased or decreased without being limited to this, and the dynamics of the performance may be controlled by controlling at least one of them.

In the embodiment, the case where the same moving average order α is used for the dynamics and the tempo has been described, but they may be different from each other. Moreover, the case where the dynamics calculation processing is performed on the baton 20 side has been described.
You may perform on the electronic musical instrument 1H side. In the embodiment, the key-on event data for the tempo control of the channel number CH1 is read prior to the reception of the tempo key-on signal, and conversely, the key-on event for the tempo control of the channel number CH1 is received after the reception of the tempo key-on signal. The case where the tempo coefficient calculation processing and the tempo coefficient limit processing are performed based on the same moving average order α, difference limit β, lower limit value γ, and upper limit value δ when data is read has been described, but in both cases These various values may be different. For example, by setting various values in the case where the reception of the tempo key-on signal precedes the reading of the key-on event data to be larger than the various values in the case where the reception of the tempo key-on signal occurs after the reading of the key-on event data, You can make the tempo response more sensitive and the tempo response slightly sluggish.

[0085]

According to the performance control device of the present invention, when the player wants to perform the music characteristic such as tempo and dynamics with a large variation with expressive feeling, or when the performance is desired to be stable without much variation. It is possible to combine different performance forms such as, for example, in one song.

[Brief description of drawings]

FIG. 1 is a hardware block diagram showing a detailed configuration of an electronic musical instrument and a baton that outputs a tempo control signal according to a hand gesture of an operator to the electronic musical instrument and a connection relationship between the two.

FIG. 2 is a diagram showing an example of a sensor output process performed by a microcomputer in the baton of FIG.

FIG. 3 is a diagram showing details of a peak detection processing step in FIG.

FIG. 4 is a diagram showing details of a peak type determination processing step in FIG.

5 is a diagram showing details of a dynamics calculation processing step in FIG.

FIG. 6 is a diagram showing details of a valley detection processing step in FIG.

FIG. 7 is a diagram showing a relationship between an angle θ obtained by an arithmetic expression and a motion type.

FIG. 8 is a schematic diagram showing the concept of sensor output processing when the baton is waving in three beats so as to draw a triangular locus.

FIG. 9 is a diagram showing an example of a musical tone reproduction process performed by a microcomputer in the electronic musical instrument.

FIG. 10 is a diagram showing details of an event handling processing step in FIG. 9.

FIG. 11 is a diagram showing details of a tempo key-on reception processing step in FIG. 9.

FIG. 12 is a diagram showing details of the tempo coefficient calculation processing step in FIG. 11;

FIG. 13 is a diagram showing details of the tempo coefficient limit processing step in FIG. 11.

FIG. 14 is a diagram showing a relationship between the follow-up degree and various values in a table format.

FIG. 15 is a diagram showing a relationship between an input timing of a tempo key-on signal fetched from a baton into an electronic musical instrument and a timing of reading automatic performance data.

[Explanation of symbols]

11, 21 ... CPU, 12, 22 ... ROM, 13, 23
... RAM, 14 ... Key pressing detection circuit, 15, 24 ... Switch detection circuit, 16 ... Display circuit, 17 ... Sound source circuit, 18 ... Effect applying circuit, 19, 28 ... Timer, 1A ... Floppy disk drive (FDD), 1B , 27 ... MIDI interface (I / F), 1C ... keyboard, 1D, 29 ... panel switch, 1E ... display section, 1F ... sound system, 1G, 2E ... bass, 1H ... electronic musical instrument, 20 ... baton, 25, 26 ... A / D, 2A ... X-direction piezoelectric vibration gyro sensor, 2B ... Y-direction piezoelectric vibration gyro sensor, 2
C, 2D ... Noise removal circuit

─────────────────────────────────────────────────── ─── Continuation of the front page (56) Reference JP-A-4-156594 (JP, A) JP-A-56-154797 (JP, A) JP-A-4-133097 (JP, A) JP-A-4-13594 133095 (JP, A) JP 5-173560 (JP, A) JP 8-314454 (JP, A) JP 6-67668 (JP, A) JP 5-249957 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) G10H 1/00-7/00

Claims (5)

(57) [Claims] 1. Performance data supply means for supplying automatic performance data; characteristic data supply means for supplying data relating to the music characteristics of the performance while changing the performance when performing according to the automatic performance data. be those supplied by changing at least once the degree of following data to determine how much and to follow changes the performance in accordance with the automatic performance data to changes in the data relating to the music properties in a series of performance , The tracking degree
Data is included in the automatic performance data,
Tracking data supply means for supplying the tracking data with the supply of performance data, and control means for performing a performance according to the automatic performance data in accordance with the data relating to the music characteristics and the tracking data.
Performance control apparatus comprising: a. 2. Performance data supply for supplying automatic performance data
The music of the performance when the performance according to the supply means and the automatic performance data is performed.
Supply data regarding characteristics while changing it from moment to moment
Of the characteristic data supply means and the change in the data relating to the music characteristic.
Accordingly, the performance according to the automatic performance data is changed.
The follow-up data that determines
Tracking degree data supplying means for changing and supplying at least once and a performance according to the automatic performance data are related to the music characteristics.
Control means for performing data according to the
The control means sequentially stores the data relating to the music characteristic supplied from the characteristic data supplying means every moment, averages the data in accordance with the follow-up degree data, and responds to the automatic performance data. A performance control device for performing a performance according to the averaged value. 3. Performance data supply for supplying automatic performance data
The music of the performance when the performance according to the supply means and the automatic performance data is performed.
Supply data regarding characteristics while changing it from moment to moment
Of the characteristic data supply means and the change in the data relating to the music characteristic.
Accordingly, the performance according to the automatic performance data is changed.
Small a degree of following data to determine whether to have you in a series of performance
Tracking degree data supplying means for changing and supplying at least once and a performance according to the automatic performance data are related to the music characteristics.
Control means for performing data according to the
The follow-up degree data is composed of a plurality of control parameters.
The control means changes the data regarding the music characteristic to be supplied from the characteristic data supplying means every moment.
The follow-up degree of conversion is set for each control parameter of the follow-up degree data.
To control the characteristic data supply means so that
A performance control device characterized in that 4. Performance data supply for supplying automatic performance data
The music of the performance when the performance according to the supply means and the automatic performance data is performed.
Supply data regarding characteristics while changing it from moment to moment
Of the characteristic data supply means and the change in the data relating to the music characteristic.
Accordingly, the performance according to the automatic performance data is changed.
The follow-up data that determines
Tracking degree data supplying means for changing and supplying at least once and a performance according to the automatic performance data are related to the music characteristics.
Control means for performing data according to the
And the characteristic data supplying means includes a plurality of types of music characteristics.
Data is intended to respectively supply about, said control means supplies all every moment from the characteristic data supply means
It said the follow-up of the changes in each of the data relating to each sound music characteristic can add
The characteristic data should be set in accordance with the corresponding data.
A performance control device for controlling a supply means . 5. Performance data supply for supplying automatic performance data
The music of the performance when the performance according to the supply means and the automatic performance data is performed.
Supply data regarding characteristics while changing it from moment to moment
Of the characteristic data supply means and the change in the data relating to the music characteristic.
Accordingly, the performance according to the automatic performance data is changed.
The follow-up data that determines
Tracking degree data supplying means for changing and supplying at least once and a performance according to the automatic performance data are related to the music characteristics.
Control means for performing data according to the
The performance control device is characterized in that the characteristic data supply means supplies dynamics control data relating to performance dynamics as the music characteristic data.