JPH08339181A - Playing dynamics controller - Google Patents

Abstract

PURPOSE: To make it possible to control playing with dynamics intended by an operator by eliminating the variations in the playing dynamics accompanying the habit of the gesture and motion of the operator. CONSTITUTION: A motion detecting means detects the kind and quantity of the motion in accordance with the gesture and motion (hand waving motion, oscillation motion, etc.) of the operator. For example, this motion detecting means detects the directions where a baton 20 is swung as the motion kinds and the max. values of sensor outputs as the motion quantity in accordance with the sensor outputs meeting the operator's vertical or triangular hand waving motions in the case where the baton 20 is internally provided with the motion detecting means consisting of two orthogonally crossing angular speed sensors 2A, 2B. A correcting means does not make correction in the case of a swinging down motion and corrects the sensor outputs so as to increase the outputs in the case of a waving up motion or a cross waving motion. Thereby, the variations in the motion quantity accompanying the habits of the operator's gestures and motions are made uniform. A control means 21 controls the dynamics of playing in accordance with the corrected operation quantity by the correcting means and, therefore, the operator is allowed to make the playing meeting his desired dynamics without the variations accompanying the habit of the operator's gestures and motions.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a performance dynamics control device capable of controlling the dynamics of a musical tone performance of an electronic musical instrument or the like according to a gesture of a player.

[0002]

2. Description of the Related Art Conventionally, an automatic performance device stores performance information (note data) about each note of a melody performance or an accompaniment performance in a memory or the like, and automatically reads the stored performance information at a predetermined tempo. , Produces a melody sound or an accompaniment sound according to the read performance information. In this case, the performance tempo is determined by the frequency of the tempo clock output from a timer or the like. The frequency of the tempo clock can be freely changed by operating the tempo setting switch or the like. However, when the tempo setting switch etc. is operated to change the performance tempo during the performance, the way of the change depends on the operation state (operation amount, operation speed, etc.) of the switch. It was very difficult to give a subtle change in tempo that corresponds to hand gestures such as.

Therefore, recently, an accelerometer is built into the baton of an operator, the maximum value of the output of the accelerometer is detected according to the waving motion, and the tempo of automatic performance is controlled at the detection timing. The one that you made is appearing. This sound can be played at the time when the maximum output value of the acceleration sensor is detected, or the sequence data can be advanced to control the tempo of the performance arbitrarily. The dynamics of (making the sound at the time of playing dynamics to give a feeling of dynamism to the whole performance) can be controlled arbitrarily. That is, when the operator's waving motion is large, the output of the acceleration sensor is large, the performance dynamics is correspondingly large, the rate of change in the sound is large, and the overall performance is strong. vice versa,
When the operator's waving motion is small, the output of the acceleration sensor becomes small, the performance dynamics becomes small accordingly, the rate of change in sound becomes small, and the performance becomes weak overall.

[0004]

In the performance by the actual conducting method, depending on various factors such as the conductor's hitting motion, acceleration / deceleration motion, clicking motion, and the shape of the line drawn by the tip of the baton connecting the hitting points. And the playing dynamics are controlled. However, in the past, the performance dynamics were controlled according to the operator's hand movements, that is, the output of the acceleration sensor. Therefore, the operator's proficiency in conducting method, the mood of the operator at that time, and the content of music (music Depending on the genre), variations in the strength and speed of hand movements will occur, and the variations will appear as variations in the output value of the acceleration sensor, making it extremely difficult to perform with the dynamics intended by the operator. There was a problem that was. For example, in the up-and-down hand gesture motion in 2 and 4 beats and the triangular hand movement in 3 and
If you shake your hand without being particularly aware, even if you think that the operator himself is shaking at the same strength and speed, in most cases, the swing-down motion (down beat) is the swing-up motion (up beat). The swinging motion is stronger and faster than the lateral swinging motion of the second beat of the three beats. Therefore, even if the operator intends to shake with uniform strength and speed, the output value of the acceleration sensor also changes according to the difference in this swinging motion, and the acceleration sensor output due to the swinging down motion (downbeat). , The performance naturally becomes larger, and as a result, the performance dynamics when swinging down (down beat) become larger than those of other swinging motions, and it seems that the performance dynamics depend on the habit of the operator's hand gesture. Will make a big change.

The present invention has been made in view of the above points, and is a performance dynamics control capable of eliminating the variation of the performance dynamics due to the habit of the operator's gestures and giving the performance dynamics intended by the operator. The purpose is to provide a device.

[0006]

A performance dynamics control device according to the present invention includes a motion detecting means for detecting a motion type and a motion amount based on a gesture motion of an operator, and the motion detecting means for detecting the motion type and motion amount. It comprises a correction means for correcting the movement amount in accordance with the movement type, and a control means for controlling the dynamics of the performance based on the movement amount corrected by the correction means.

[0007]

The motion detecting means detects the type and amount of motion based on the gesture motion of the operator, that is, the gesture motion or swing motion of the conductor. For example, in the case where the motion detecting means including two orthogonal angular velocity sensors is provided in the baton,
When the operator moves the baton in a vertical waving motion or a triangular hand waving motion, the motion detecting means detects the swaying direction of the baton as the motion type based on the two sensor outputs, and the maximum value of the sensor output at this time is detected. Is detected as an operation amount. The correction means does not correct when the direction in which the baton is swung is a swinging down motion (down beat), and the sensor output increases when swinging up (up beat) or a sideways motion of a triangular hand swing motion. Correct so that As a result, the variation in the movement amount due to the habit of the gesture movement of the operator is equalized. Since the control means controls the dynamics of the performance based on the movement amount corrected by the correction means, it is possible to perform the performance in accordance with the dynamics intended by the operator without variation due to the habit of the operator's gestures. Will be able to. In addition to the performance dynamics control, the control means may control the tempo of the performance based on the type of motion and the amount of motion detected by the motion detection means as described in claim 2.

[0008]

Embodiments of the present invention will now be described in detail with reference to the accompanying drawings. FIG. 1 shows a detailed configuration of an electronic musical instrument 1H including a keyboard, a tone generator circuit and an automatic performance device, and a baton 20 which outputs a tempo control signal to the electronic musical instrument 1H according to an operator's hand gesture, and the connection between the two. It is a hardware block diagram which shows a relationship. First, the configuration of the electronic musical instrument 1H will be described. Microprocessor unit (CPU) 11
Controls the overall operation of the electronic musical instrument 1H.
ROM1 to the CPU11 via the bus 1G
2, RAM 13, key depression detection circuit 14, switch detection circuit 15, display circuit 16, tone generator circuit 17, effect imparting circuit 1
8, timer 19, floppy disk drive (FD
D) 1A and MIDI interface (I / F) 1B
Are connected respectively.

In this embodiment, an electronic musical instrument in which the CPU 11 performs key depression detection processing, tempo control data transmission / reception processing, sound generation processing, etc. will be described.
It is needless to say that the present invention can be similarly applied to a module that is configured separately from each other and a module that includes the tone generator circuit 17 and that is configured to exchange data between the modules using a MIDI interface.
The ROM 12 stores various programs of the CPU 11 and various data, and is a read-only memory (RO
M). RAM13 is performance information and CPU
Reference numeral 11 temporarily stores various data generated when the program is executed, and predetermined address areas of a random access memory (RAM) are allocated to each and used as registers and flags.

The keyboard 1C is provided with a plurality of keys for selecting the pitch of a musical tone to be produced, has a key switch corresponding to each key, and if necessary, a key depression speed detecting device. And a touch detection unit such as a pressing force detection device.
It is needless to say that the keyboard 1C is a basic operator for playing music, and may be a performance operator other than this, such as a drum pad. The key-depression detection circuit 14 is configured to include a circuit composed of a plurality of key switches provided corresponding to each key of the keyboard 1C that specifies the pitch of a musical tone to be generated, and a new key is pressed. When the key is newly released, the key-on event information is output, and when the key is newly released, the key-off event information is output. In addition, a process of generating touch data is performed by determining a key pressing operation speed or a pressing force when a key is pressed, and the generated touch data is output as velocity data. As described above, the key-on / key-off event information and the velocity information are expressed by the MIDI standard and include the data indicating the key code and the assigned channel.

The panel switch 1D starts / starts automatic performance.
It includes a stop switch, a pause (pause) switch, and various switches for selecting, setting, and controlling tones, volume, effects, and the like. The panel switch 1D has various other switches, but the details thereof are publicly known, and thus the description thereof will be omitted. The switch detection circuit 15 detects the operation state of each operator on the panel switch 1D and outputs a switch event corresponding to the operation state to the CPU 11 via the bus 1G. The display circuit 16 displays various information such as the control status of the CPU 11 and the contents of setting data on the display unit 1.
It is displayed on E. The display unit 1E is composed of a liquid crystal display panel (LCD) or the like, and its display operation is controlled by the display circuit 16.

The tone generator circuit 17 is capable of simultaneously generating tone signals on a plurality of channels, inputs performance information (data conforming to the MIDI standard) given via the bus 1G, and based on this data, tone signals are generated. To occur. Any tone signal generation method in the tone generator circuit 17 may be used. For example, a memory reading method for sequentially reading tone waveform sample value data stored in a waveform memory according to address data that changes corresponding to the pitch of a tone to be generated, or a predetermined frequency using the above address data as phase angle parameter data. A well-known method such as an FM method for performing a modulation operation to obtain musical tone waveform sample value data or an AM method for performing a predetermined amplitude modulation operation using the address data as phase angle parameter data to obtain a tone waveform sample value data. You may employ suitably.

The effect imparting circuit 18 imparts various effects to the musical tone signal from the tone generator circuit 17, and outputs the musical tone signal to which the effect has been imparted to the sound system 1F. Effect application circuit 1
The tone signal to which the effect is added by 8 is sounded through a sound system 1F including an amplifier and a speaker (not shown). The timer 19 counts time intervals and generates a clock pulse for determining the tempo of automatic performance. Since this clock pulse is given to the CPU 11 as an interrupt instruction, the CPU 1
1 executes various processes by interrupt processing. The floppy disk drive (FDD) 1A is an interface for loading automatic performance data from an external storage medium, that is, a floppy disk into the electronic musical instrument 1H, and writing automatic performance data processed in the electronic musical instrument 1H to a floppy disk.

MIDI interface (I / F) 1B
Connects between the bus 1G of the electronic musical instrument 1H and the MIDI interface (I / F) 27 of the baton 20,
Interface 27 is bus 2E of baton 20 and MID
It is connected to the I interface 1B. Therefore, the bus 1G of the electronic musical instrument 1H and the bus 2E of the baton 20 are connected to each other via the MIDI interfaces 1B and 27, so that data can be exchanged bidirectionally according to the MIDI standard. It has become.

Next, the structure of the baton 20 will be described. The microprocessor unit (CPU) 21 controls the operation of the baton 20. This CPU2
1 to the ROM 22 and the RAM 2 via the bus 2E.
3, switch detection circuit 24, A / D converters 25, 26,
The MIDI interface 27 and the timer 28 are connected to each other. The ROM 22 stores various programs of the CPU 21 and various data, and is composed of a read only memory (ROM). The RAM 23 is for temporarily storing various data generated when the CPU 21 executes the program, and is assigned with a predetermined address area of a random access memory (RAM) and used as a register or a flag. The switch group 29 is composed of an on / off switch of the baton 20, a delay time switch for adjusting the output timing of the tempo control signal, and the like. The switch detection circuit 24 detects the operating state of the switch group 29, and outputs data according to the operating state to the CPU 21 via the bus 2E.

X-direction piezoelectric vibration gyro sensor 2A and Y
The directional piezoelectric vibration gyro sensor 2B is a two-axis (X-axis) orthogonal to the piezoelectric vibration gyro sensor that generates a voltage proportional to the Coriolis force proportional to the angular velocity of the rotation when the sensor rotates about one rotation axis. And Y axis). Therefore, the X-direction piezoelectric gyro sensor 2A
The angular velocity ωX in the X-axis direction can be detected based on the voltage output from the Y-axis piezoelectric gyro sensor 2B, and the angular velocity ωY in the Y-axis direction can be detected based on the voltage output from the Y-direction piezoelectric gyro sensor 2B.

The noise removing circuits 2C and 2D remove noise components inside the sensors contained in the sensor output signals from the X-direction piezoelectric vibration gyro sensor 2A and the Y-direction piezoelectric gyro sensor 2B, and have a high frequency higher than the response frequency. It is composed of a low-pass filter that removes components. A /
The D converters 25 and 26 convert the sensor output signal from which the high frequency components have been removed by the noise removing circuits 2C and 2D into a digital signal. This A / D converter 25
The digital signals converted by 26 and 26 are read by the CPU 21 at a predetermined cycle, and are used for the motion determination process of the entire baton 20 by a predetermined data process.

The timer 28 generates an operating clock for the baton 20, and this operating clock is given to the CPU 21 as an interrupt command. The CPU 21 detects the operating state of the baton 20 by an interrupt process and operates. A tempo control signal for determining the tempo of the automatic performance is output to the electronic musical instrument 1H side via the MIDI interfaces 27 and 1B.

Next, an example of processing executed by the microcomputer (CPU 21) in the baton 20 is shown in FIG.
From now on, it will be explained based on the flowchart of FIG. Figure 2
Is a microcomputer (CPU 21) in the baton 20
It is a figure which shows an example of the sensor output process which is processed. This sensor output process is a timer interrupt process that is executed in synchronization with the operation clock from the timer 28 (cycle of about 10 ms). The sensor output process is a series of processes according to the control program stored in the program ROM 22, and is sequentially executed in the following steps.

Step 1: Outputs of the X-direction piezoelectric vibration gyro sensor 2A and the Y-direction piezoelectric vibration gyro sensor 2B,
That is, the digital signals output from the A / D converters 25 and 26 are taken in via the bus 2E. Step 2: Remove the DC component. That is, baton 2
When the operator who operates 0 performs a low-speed rotation operation such as a turning operation other than a hand-shake operation, a DC component, that is, a drift component, is generated accordingly, so that the digital signal captured in step 1 has a low-frequency cutoff frequency. It is removed by passing it through a high pass filter.

Step 3: An absolute angular velocity is calculated based on the outputs X and Y of the X-direction piezoelectric vibration gyro sensor 2A and the Y-direction piezoelectric vibration gyro sensor 2B from which the DC component has been removed, and stored in the absolute angular velocity register A_SPEED. . The absolute angular velocity is calculated by taking the route of the sum of squares of the outputs X and Y and the arithmetic expression as shown in step 3 of FIG. The value of the absolute angular velocity calculated in this step is plotted on the time axis of abscissa, as shown in FIG. 12 (A). Step 4: The average value of the absolute angular velocities calculated in step 3 at each timing from the current timer interrupt time point to the timer interrupt time point m times before is calculated, and stored in the moving average register M_AVERAGE as a moving average value. For example, when m is “8”, the moving average value is obtained by dividing the sum of the eight absolute angular velocities calculated at each timing by 8. Step 5: Calculate the average value of the moving average values stored in the moving average register M_AVERAGE calculated in step 4 at each timing from the current timer interrupt time to the timer interrupt time n times before, and make it dynamic. Dynamic threshold register DY as threshold value
Store in NA_THRE.

Step 6: The value stored in the previous value register NOW is stored in the value register OLD two times before, the value stored in the current value register NEW is stored in the previous value register NOW, and the moving average value calculated this time (moving average register M_AVER) is stored.
The stored value of AGE) is stored in the current value register NEW.
That is, the two-previous value register OLD and the previous value register N
The values stored in the OW and the current value register NEW are shifted to new values. Step 7: Perform peak detection processing based on the stored values of the two-preceding value register OLD, the previous value register NOW and the current value register NEW. FIG. 3 is a diagram showing details of this peak detection processing. This peak detection process is sequentially executed in the following steps.

Step 70: Whether the value stored in the previous value register NOW is greater than or equal to the value stored in the two-previous value register OLD and the value stored in the current value register NEW, that is, the moving average detected at the time of the previous timer interrupt. It is determined whether or not the value is the maximum value (peak). If YES, the process proceeds to the next step 71, and if NO, the process proceeds to step 8 in FIG. Step 71: Since it was determined in step 70 that the time point of the previous timer interrupt was the maximum value (peak) of the moving average value, the time point of the present peak judgment is calculated from the time point of the previous peak and a predetermined time has elapsed. If the predetermined time has elapsed (YES), the process proceeds to the next step 72, and the predetermined time has not elapsed (NO).
In that case, the process immediately proceeds to step 8 in FIG. That is, the peak determined to be YES again in step 70 when the predetermined time has not elapsed from the previous peak determination time means that it is a pseudo peak value generated by the disturbance of the hand movement of the operator. is there.

Step 72: It is judged whether or not the value stored in the previous value register NOW is larger than a certain threshold value. If it is larger (YES), the process proceeds to the next step 73, and if it is smaller (NO), it is immediately shown in FIG. Go to step 8. That is, the fact that the value stored in the previous value register NOW is smaller than the fixed threshold value means that the values are stored in steps 70 and 71.
This is because the peak determined to be YES means that the peak value is a pseudo peak value caused by the disturbance in the hand movement of the operator. Step 73: The value stored in the previous value register NOW is calculated in step 5 of FIG.
It is determined whether it is larger than the dynamic threshold value stored in YNA_THRE. If it is larger (YES), the process proceeds to the next step 74, and if it is smaller (NO), the process immediately proceeds to step 8 in FIG. That is, the peak value is always larger than the dynamic threshold value.

Step 74: It is judged whether or not the stored value of the previous value register NOW is larger than the previous stored value of the peak value register LAST_PEAK multiplied by a predetermined coefficient A of 1 or less. Step 75, and if it is smaller, immediately go to Step 8 in FIG. That is, it is considered that the peak value will be a value approximately approximate to the previous peak value. Step 75: It is judged whether or not the valley is detected by the peak detection processing or the valley detection processing before the time of the current timer interruption, and the valley is previously detected (YES).
In this case, the peak detected this time is considered to be correct, so the process proceeds to the next step 76, and if the previous detection was a peak (NO), the peaks cannot be continuous, so the peak detected this time. Is considered to be erroneous, the process immediately proceeds to step 8 in FIG.

Step 76: Previous peak value register LA
The value stored in the previous value register NOW is stored in ST_PEAK. Step 77: A peak type determination process is performed to determine what kind of operation the peak detected this time is. That is, it is a process of determining in which direction of the baton 20 the peak determined by the processes of steps 70 to 75 is caused.

FIG. 4 is a diagram showing the details of the peak type determination process. This peak type determination process is sequentially executed in the following steps. Step 770: Calculate an angle based on the output X of the X-direction piezoelectric vibration gyro sensor 2A from which the DC component is removed and the output Y of the Y-direction piezoelectric vibration gyro sensor 2B, and store it in the angle register θ. The angle is step 77 in FIG.
It is calculated by an arithmetic expression shown in 0, that is, an arc tangent of a value obtained by dividing the output Y by the output X.

Step 771: It is judged whether the stored value of the angle register θ is more than 180 ° and not more than 300 °. If YES, the process proceeds to the next step 772, and if NO, the process proceeds to step 773. Step 772: Since the current peak is caused by the hand gesture of the motion type “1”, the current peak is set as the peak of the motion “1” here. Step 773: It is judged whether the stored value of the angle register θ is 60 ° or less and is larger than 300 °,
If YES, the process proceeds to the next step 774, and if NO, the process proceeds to step 775. Step 774: Since the current peak is caused by the hand gesture of the motion type “2”, the current peak is set as the peak of the motion “2” here. Step 775: The determination of NO in Step 771 and Step 773 means that the stored value of the angle register θ is 180 ° or less and larger than 60 °, that is, the current peak is the operation type “3”. This means that the current peak is the peak of the motion “3”, since it means that the current motion is caused by the hand gesture motion.

FIG. 11 is a diagram showing the relationship between the angle θ obtained by the arithmetic expression of step 770 and its operation types “1”, “2” and “3”. That is, the angle θ is larger than 180 ° and not larger than 300 ° (step 7).
It is determined YES in step 71, which means that the angle θ is 60 ° or less in the direction of the operation “1” as shown in the figure and 3
It is determined that the angle θ is larger than 00 ° (YES in step 773), which means that the angle θ is 180 ° or less and larger than 60 ° in the direction of the operation “2” as illustrated (NO in step 773). ), It means that
This means that the baton 20 is swung in the direction of the operation "3" as shown in the figure. Note that the method of determining the peak type is not limited to the above-described method, and for example, the type of the previous peak, the angular difference from the previous peak, or the like may be considered.

Step 78: Based on the peak value detected this time, one of the dynamics calculation processes 1 to 5 is executed to calculate the dynamics, and step 8 in FIG.
Proceed to. Details of the dynamics calculation processes 1 to 5 will be described later. Step 8: Perform valley detection processing based on the respective stored values of the two-preceding value register OLD, the previous value register NOW and the current value register NEW. FIG. 5 is a diagram showing details of the valley detection process. This valley detection process is sequentially executed in the following steps.

Step 80: The value stored in the previous value register NOW is less than or equal to the value stored in the value register OLD two times before,
At the same time, it is determined whether the value is less than or equal to the value stored in the current value register NEW, that is, the moving average value detected at the time of the previous timer interrupt is the minimum value (valley).
If S, the process proceeds to the next step 81. If NO, the process returns and waits until the next timer interrupt timing. Step 81: The previous timer interruption time point is the time point when the minimum value (valley) of the moving average value is reached.
Since it is determined as 0, it is determined here whether or not the current valley determination time has counted from the previous valley determination time and a predetermined time has passed. If the predetermined time has passed (YES), the next step 82, the predetermined time has not elapsed (N
In the case of O), the current valley judgment is considered to be incorrect, and therefore the routine returns and waits until the next timer interrupt timing.

Step 82: It is judged whether or not the value stored in the previous value register NOW is smaller than a certain threshold value. If smaller (YES), the process proceeds to the next step 83, and if larger (NO), the current valley judgment is made. Is suspected to be incorrect, so return and wait until the next timer interrupt timing. Step 83: It is judged whether or not the value stored in the previous value register NOW is smaller than the dynamic threshold value stored in the dynamic threshold value register DYNA_THRE, and if it is smaller (YES), the process proceeds to the next step 84 and is larger ( In the case of NO), it is considered that the current valley determination is incorrect, and therefore the routine returns and waits until the next timer interrupt timing.

Step 84: It is judged whether or not the peak is detected by the peak detection processing or the valley detection processing before the time of the current timer interruption, and if the peak was previously detected (YES), it is detected this time. Since the detected valley is considered to be correct, the process proceeds to the next step 85. If the previously detected valley is NO (NO), the valley detected this time is considered to be incorrect, so return and return to the next timer interrupt timing. Wait until. Step 85: It is determined that the minimum value detected this time is an official valley. When the valley is detected as described above, the peak is detected by the peak detection process of FIG. That is, the peak detection processing shown in FIG. 3 and the valley detection processing shown in FIG. 5 are alternately performed to reliably detect the peak and the valley.

Next, details of the dynamics calculation processes 1 to 5 in step 78 of FIG. 3 will be described. 6 to 10 are diagrams showing details of the dynamics calculation processes 1 to 5, respectively. In the dynamics calculation process 1 of FIG. 6, a different table is referred to for each of the peak types (that is, operation types) “1”, “2”, and “3” determined by the peak type determination process of FIG. Output the table-converted values as dynamics.

In the dynamics calculation processing 2 of FIG.
The dynamics are calculated by multiplying the peak value by a different coefficient for each of the peak types (that is, the operation types) "1", "2", and "3" determined by the peak type determination process of. The dynamics calculation process 2 is sequentially executed in the following steps. Step 780: It is judged whether or not the peak type, that is, the operation type is "1". If "1" (YES), the process proceeds to step 782, and "2" or "3" (NO).
In the case of, the process proceeds to step 781. Step 781: It is judged whether or not the peak type, that is, the operation type is "2". If "2" (YES), the process proceeds to step 784, and if "3" (NO), the process proceeds to step 786.

Step 782: Since it is determined in step 780 that the peak is the motion type "1" (YES), the peak value is used as it is as dynamics. That is, the peak value stored in the previous value register NOW is stored in the dynamics register DYNAMICS as dynamics. In this step, the coefficient is 1.0. Step 783: Key code "C" corresponding to the operation "1"
And the dynamics obtained in step 782 are output. Step 784: Operation type “2” in step 781
Since it is determined that the peak value is (YES), here, the peak value is multiplied by the coefficient α, and the value is taken as the dynamics. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient α, and the multiplication result (α × N
OW) as a dynamics dynamics register DY
Store in NAMICS. Step 785: The key code "C" corresponding to the operation "2"
The key-on of "# 3" and the dynamics obtained in step 784 are output. Step 786: Operation type “3” in step 781
Since it was determined to be the peak of (NO), here,
The peak value is multiplied by the coefficient β, and the value is taken as the dynamics. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient β, and the multiplication result (β × NO
W) as dynamics register DYN
Store in AMICS. Step 787: Key code "D" corresponding to operation "3"
3 ”and the dynamics calculated in step 786 are output.

In the dynamics calculation processing 3 shown in FIG.
As in the dynamics calculation process 2 of, the operation type “1”,
The dynamics are calculated by taking a moving average for each of "2" and "3" and multiplying the moving average value by a different coefficient. Note that, in FIG. 8, the same steps as those in FIG. 7 are denoted by the same reference numerals, and a description thereof will be omitted.

Step 788: Since it is determined in step 780 that the peak is the motion type "1" (YES),
Here, the moving average of the peak value of the operation type “1” is calculated and used as the dynamics. That is, the previous three-time value register LAST13, the previous two-time value register LAST12, and the two-previous-time value register LAS that store the peak value of the operation type “1” detected before the previous value register NOW.
Add each stored value of T11 and the previous value register NOW,
Moving average value ((NOW + LA
Dynamics register DYNAMICS with ST11 + LAST12 + LAST13) / 4) as dynamics
To be stored. Step 789: In preparation for the next dynamics calculation processing 3, the registers LAST13 and LAST1 of the operation type "1"
2 and the value of LAST11 are updated, respectively. That is, the value of the previous twice value register LAST12 is stored in the previous three times value register LAST13, and the previous two times value register LAST is stored.
The value of the previous-previous-time value register LAST11 is stored in 12, and the value of the previous-time value register NOW is stored in the previous-previous-time value register LAST11.

Step 78A: Since it is determined in step 781 that it is the peak of the motion type "2" (YES), the moving average of the peak values of the motion type "2" is taken as the moving average value. Multiply the coefficient α to obtain the dynamics. That is, the previous three-time value register LAST23 and the previous two-time value register LA that store the peak value of the operation type "2" detected before the previous value register NOW are stored.
ST22, the two-previous value register LAST21 and the previous value register NOW are added together, and the value divided by 4 is multiplied by a coefficient α, and the multiplication result (α × (NOW + LAS
T21 + LAST22 + LAST23) / 4) is stored as dynamics in the dynamics register DYNAMICS. Step 78B: In preparation for the next dynamics calculation process 3, the values of the registers LAST23, LAST22, and LAST21 of the operation type “2” are updated, as in step 789.

Step 78C: Since it is determined in step 781 that the peak of the motion type "3" is (NO), here, the moving average of the peak values of the motion type "3" is taken and the moving average value is obtained. Multiply the coefficient β to obtain the dynamics. That is, the previous three-time value register LAST33 and the previous two-time value register LA that store the peak value of the operation type "3" detected before the previous value register NOW.
The stored values of ST32, the two-previous value register LAST31 and the previous value register NOW are added, and the value (moving average value) obtained by dividing it by 4 is multiplied by a coefficient β, and the multiplication result (β ×
(NOW + LAST31 + LAST32 + LAST3
Store 3) / 4) as dynamics in the dynamics register DYNAMICS. Step 78D: In preparation for the next dynamics calculation process 3, the values of the registers LAST33, LAST32, and LAST31 of the operation type “3” are updated respectively, as in step 789.

In the dynamics calculation processing 4 shown in FIG.
As in the dynamics calculation process 2 of, the operation type “1”,
The peak value is multiplied by a different coefficient for each of "2" and "3", and for the operation types "2" and "3", the average between the multiplication result and the peak value of the operation type "1" is taken. By doing so, the dynamics are calculated. Note that, in FIG. 9, the same steps as those in FIG. 7 are denoted by the same reference numerals, and a description thereof will be omitted.

Step 78E: The motion type "1" is the same as the dynamics calculation process 2 of FIG. 7, but the motion types "2" and "3" are averaged with the peak value of the motion type "1". Therefore, the peak value of the previous value register NOW, that is, the peak value of the operation type "1" is stored in the value register LAST two times before. Step 78F: Operation type “2” in step 781
Since it has been determined that the peak value is (YES), here, the peak value of the operation type “2” is multiplied by the coefficient α, and the average of the product value and the previous peak value of the operation type “1” is calculated. Let's call it dynamics. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient α,
The multiplication value and the value stored in the two-preceding value register LAST are added, and the result is divided by 2 to obtain an average value ((α × NOW + LAS
T) / 2) is stored as dynamics in the dynamics register DYNAMICS. Step 78G: Operation type “3” in step 781
Since it was determined to be the peak of (NO), here,
The peak value of the motion type “3” is multiplied by the coefficient β, and the product of the multiplied value and the previous peak value of the motion type “1” is averaged to obtain the dynamics. That is, the previous value register N
The peak value stored in the OW is multiplied by the coefficient β, the product value is added to the value stored in the last-preceding value register LAST, and the result is divided by 2 to obtain an average value ((β × NOW + LAST) /
Dynamics register DYN with 2) as dynamics
Store in AMICS.

In the dynamics calculation processing 5 of FIG. 10, the operation type "1", as in the dynamics calculation processing 4 of FIG.
The peak value is multiplied by a different coefficient for each of "2" and "3", and for the operation types "2" and "3", the average between the multiplication result and the peak value of the operation type "1" is taken. To calculate the dynamics. Then, regarding the operation type “3”, the coefficient value is made different depending on whether the previous peak type (operation type) is “1” or “2”. That is, the peak of the motion "1" and the peak of the motion "2" alternately appear in the vertical hand gesture motion in the two-beat and four-beat beats, and the peak of the motion "1" and the peak of the motion "2" in the triangular hand-movement motion in the three-beat, The peaks of motion "3" appear in order. Therefore, the output value of the angular velocity sensor is different between the case where the operation "1" is changed to the operation "3" and the case where the operation "2" is changed to the operation "3". Therefore, here, the coefficient value for the motion "3" is made different between the case of the vertical hand gesture motion and the case of the triangular hand gesture motion. In addition, in FIG.
The same reference numerals are given to the same steps as, and the description thereof will be omitted.

Step 78H: Since it is determined in step 781 that the motion type "3" is the peak (NO), here it is determined whether or not the previous motion type is "1" and "1". If yes, step 78J
If it is "2", the process proceeds to step 78G. Step 78J: Since it was determined in step 78H that the previous motion type was “1”, here, the peak value of the motion type “3” is multiplied by the coefficient γ, and the product value and the previous motion type “1” are multiplied. Take the average with the peak value of and use it as the dynamics. That is, the peak value stored in the previous value register NOW is multiplied by the coefficient γ, the product value and the value stored in the two-previous value register LAST are added, and the result is divided by 2 to obtain an average value ((γ × NOW + LAST) / 2. ) As a dynamics dynamics register DYNAMICS
To be stored.

For example, since the peak value during the swing-down motion is the largest and the peak value during the swing-up motion is the smallest, the coefficient α for the swing-up motion of motion type "3" in the triangular hand swing motion is 1.75, The dynamics as a whole is set by setting the coefficient β in the lateral swing motion of the motion type “2” to 1.5 and the coefficient γ in the swing motion of the motion type “3” in the vertical hand shaking vibration to 1.875. Can be made uniform. Needless to say, these coefficient values are examples, and each operator may arbitrarily set a desired value.

Next, an example of the operation will be described with reference to FIG. 12 as to how the sensor output processing is performed by moving the baton 20 according to the gesture motion of the operator. FIG. 12 is a schematic diagram showing a concept of sensor output processing in a triangular hand waving motion corresponding to a gesture of three beats so that the baton 20 draws a triangular locus. 12
FIG. 12 (A) is a diagram showing an output waveform of the absolute angular velocity when the baton 20 is moved by a triangular hand waving motion of 3 beats, and FIG. 12 (B) shows a peak detection time point of the absolute angular velocity in the triangular hand waving motion. It is a figure.

When the baton 20 is moved by the triangular waving motion as shown in FIG. 12 (B), the absolute angular velocity value calculated in step 3 has a shape as shown in FIG. 12 (A). Peaks and valleys appear alternately in the order of the first peak, the valley, the second peak, the valley, the third peak, and the valley. First, when the baton 20 is swung in the direction of 240 ° (obliquely leftward downward) in FIG. 11, the first peak is detected by the processing of steps 70 to 75. Then, the value stored in the previous value register NOW is stored in the previous peak value register LAST_PEAK. First by the processing of step 771 in FIG.
The peak is determined to be the peak of operation "1". 12
In (B), the detection time of the first peak is indicated by a circle.
Then, the dynamics corresponding to the peak value of the first peak is calculated by any of the dynamics calculation processes 1 to 5 in step 78 and is output together with the key-on of the key code "C3" corresponding to the operation type "1". Become.

Thereafter, the baton 20 is moved to 24 in FIG.
When it is shaken in the direction of 0 ° (obliquely leftward downward) to the direction of 0 ° (horizontal rightward direction), a valley is detected this time by the processing of steps 80 to 85 in FIG. . And the baton 20 is 0 ° in FIG.
When it is shaken in the direction of (the right horizontal direction), the second peak is detected accordingly as the peak of the motion “2”,
The dynamics corresponding to the peak value of this second peak are calculated and output together with the tempo key-on signal of the key code "C # 3".

In FIG. 11, the baton 20 is in a direction of 0 ° (horizontal right side) to 120 ° (obliquely upward left direction).
When the hand is shaken, a valley is detected at the change point of the hand movement. After that, the third peak is detected this time as the peak of the operation “3”. The dynamics corresponding to the peak value of the third peak is calculated and output together with the tempo key-on signal of the key code "D3". Then, when the baton 20 is swung again from the direction of 120 ° (obliquely leftward upward) to the direction of 240 ° (obliquely downward leftward) in FIG. 11, a valley is detected at the change point of the hand gesture, and The process is repeatedly executed.

On the right side of FIG. 12B, the baton 2
The peak detection time is shown when 0 is waving (or rocking) in the up-down direction with two or four beats. In this case, when the baton 20 is swung in the direction of 270 ° (downward) in FIG. 11, the first peak is detected as the peak of the motion “1”, and the dynamics corresponding to the peak value of this first peak is calculated. And is output together with the tempo key-on signal of the key code "C3". After that, baton 2
0 is 90 from the direction of 270 ° (downward) in FIG.
When it is shaken in the direction of ° (upward), a valley is detected at the change point of the hand movement, and this time the second peak is detected as the peak of the movement “3”, which corresponds to the peak value of this second peak. The dynamics are calculated and output together with the tempo key-on signal of the key code "D3". Then, when the baton 20 is swung again from the direction of 90 ° (upward) to the direction of 270 ° (downward) in FIG. 11, a valley is detected at the change point of the hand gesture, and the above-described processing is repeatedly executed. To be done.

In this way, when the operator moves the baton 20, the baton 20 outputs the tempo key-on signal and the intended dynamics at the operator's intended interval according to the operator's waving motion. Since the electronic musical instrument 1H reproduces the sequence data according to the tempo key-on signal and the dynamics, the tempo and performance dynamics can be controlled arbitrarily. As will be described later, the tempo of the automatic performance is controlled in the electronic musical instrument 1H so that the output timing of the tempo key-on signal and the beat timing of the automatic performance substantially coincide with each other. The timing and the beat timing of the automatic performance will match.

Next, by inputting this tempo key-on signal, how the microcomputer (CPU 11) in the electronic musical instrument 1H performs the reproduction processing of the musical tone will be described with reference to the flowcharts of FIGS. Explain. FIG. 13 is a diagram showing an example of a musical sound reproduction process performed by the microcomputer (CPU 11) in the electronic musical instrument 1H. This reproduction process is a timer interrupt process executed in synchronization with the operation clock from the timer 19 (cycle of about 1 ms). This reproduction process is a program RO
It is a series of processes according to the control program stored in M12, and is sequentially executed by the following steps.

Step 40: It is determined whether or not the running state flag RUN is "1". If "1" (YES), it means that the reproduction processing of the automatic performance data is performed. If it is "0" (NO), it means that the reproduction process is not performed, and therefore the process immediately returns.
Wait until the next interrupt timing. Step 41: It is judged whether or not the pause flag PAUSE is "0". If "0" (YES), it means that the vehicle is temporarily stopped, so the procedure advances to the next step 42, and if "1" (NO), jump to step 4B. To do. The suspension will be described later. Step 42: It is determined whether or not the timing counter TIME is "0". If "0" (YES), the process proceeds to the next step 43, and if it is a value other than "0" (NO), the process jumps to the next step 49. To do.

Step 43: Since it is determined in step 42 or step 47 that the timing counter TIME is "0", the address of the RAM 12 is advanced and the automatic performance data is read from that address position. Automatic performance data is event data (including channel number)
And a combination of delta time data. Step 44: It is judged whether or not the data read out in the step 43 is delta time data, and if it is delta time data (YES), the process proceeds to step 45, and if it is other event data (NO), step 46.
Proceed to. Step 45: The delta time data read in step 43 is stored in the timing counter TIME.

Step 46: Processing corresponding to the event data read in step 43 (event corresponding processing)
To execute. FIG. 14 is a diagram showing details of this event handling process. This event handling process is sequentially executed in the following steps. Step 460: In this embodiment, the automatic performance data is 1 to
Since 16 channels of data are included, of which the channel number CH1 is used as the tempo control channel and the key-on event is used as the tempo control mark, the event data read in step 43 is the channel number. It is determined whether the event is CH1. If YES, the process proceeds to step 461 and NO.
In the case of, since it is an event of a channel number other than this, the process proceeds to step 465. The channel number CH1
The key-on event of is stored in each beat timing position, and the key code of each event is C3, C # 3, D3, C3, C # 3, D3, ... , 2 and 4 beats, they are arranged in the order of C3, D3, C3, D3.

Step 461: Since it is determined in step 460 that the event is the channel number CH1,
Here, it is determined whether the key-on receive flag KON_RCV is "1". If "1" (YES), the process proceeds to step 462, and if "0" (NO), the process proceeds to step 463. Step 462: The fact that the key-on receive flag KON_RCV is “1” in step 461 means that
Before the event of the channel number CH1 is read from the baton 20 to the MIDI interfaces 27 and 1B.
Since it means that the tempo key-on signal has already been input via, the key-on receive flag KO will be described here.
"0" is set in N_RCV, and the process proceeds to step 47.

Step 463: The key-on receive flag KON_RCV being "0" in the step 461 means that the tempo key-on signal corresponding to the event of the channel number CH1 read in the step 43 has not been input yet. Therefore, here, the key code of the read event is stored in the key code register KEYCODE. Step 464: Since the tempo key-on signal has not been input yet, the pause flag PAUSE is set to "1" and the routine proceeds to the next step 47. Pause flag PAUS
By setting "1" to E, the determination at step 41 becomes NO thereafter, and steps 42 to 4A are not executed. Step 465: Since the event is determined to be an event other than the channel number CH1 in the step 460, the event is output to the tone generator circuit 17 here. At this time, when the event is a note event, the velocity is corrected according to the dynamics calculated in step 78 of FIG. By correcting the velocity, it is possible to arbitrarily control the volume of the musical sound according to the action such as the swing speed of the baton 20. Elements other than velocity, such as tone color, pitch, and effects, may be controlled arbitrarily.

Step 47: Since the delta time data read in step 45 may be "0",
Here, it is again determined whether the timing counter TIME is "0". If "0" (YES), the process proceeds to the next step 43, and if it is a value other than "0" (NO), the process jumps to the next step 49. To do. Delta time data is "0"
This means that multiple events exist at the same timing. Step 48: The stored value of the timing register TIME is multiplied by the stored value (tempo coefficient) of the tempo coefficient register T_COEF. Here, the tempo coefficient is a value based on "1", and the tempo is controlled according to this value. For example,
When it was "0.5", the tempo doubled, and "2"
Then the tempo is halved.

Step 49: Timing register TIM
The value of E is decremented by "1". Step 4A: Delta Accumulate Register DELT
The value of A_ACM is incremented by "1".
The delta accumulation register DELTA_ACM counts the time between events read from the channel number CH1. Step 4B: Interval register INTERVAL
The value of is incremented by "1". The interval register INTERVAL measures the time interval of the tempo key-on signal transmitted from the baton 20.

Step 4C: Perform tempo key-on reception processing. This tempo key-on reception process is a process performed each time a tempo key-on signal is received from the baton 20.
Therefore, when the tempo key-on signal is not received, no substantial process is performed. FIG. 15 is a diagram showing details of the tempo key-on reception processing. This tempo key-on reception process is sequentially executed in the following steps. Step 4C0: It is judged whether or not the tempo key-on signal is received from the baton 20 via the MIDI interfaces 27 and 1B. If it is received (YES), the process proceeds to step 4C1, and if it is not received (NO), the process shown in FIG. Then, the process returns to the playback process of and waits until the next interrupt timing.

Step 4C1: Pause flag PAUS
It is determined whether E is "1". If "1" (YES), the process proceeds to step 4C2, and if "0" (NO), the process proceeds to step 4C9. Step 4C2: The fact that the pause flag PAUSE is determined to be "1" in the step 4C1 means that
Event data of the channel number CH1 is read prior to the reception of the tempo key-on signal, and the key code thereof is already read in step 463 in the key code register KEYCO.
Since it means that the key code of the received tempo key-on signal matches the key code stored in the key code register KEYCODE, it means that the key code is stored in the DE, and if they match (YES). Proceeds to step 4C3, and if they do not match (NO), the process shown in FIG.
Then, the process returns to the playback process of and waits until the next interrupt timing.

Step 4C3: Interval register I
NTERVAL value and Delta accumulated register D
The ratio with the value of ELTA_ACM is set to the rate register RATE
To be stored. That is, the ratio between the time interval of the tempo key-on signal transmitted from the baton 20 and the time interval at which the event of the channel number CH1 is actually read is stored in the rate register RATE. Step 4C4: Multiply the value of the rate register RATE by the tempo coefficient of the tempo coefficient register T_COEF. Step 4C5: As a result of the processing of step 4C4, limit processing is performed so that the value of the tempo coefficient register T_COEF does not become larger or smaller than a predetermined value. Step 4C6: Delta accumulated register DEL
Set "0" to TA_ACM. Step 4C7: Interval register INTERVA
Set “0” to L. Step 4C8: "0" is set to the pause flag PUASE. As a result, the reproduction process of FIG. 13 is started again.

Step 4C9: The fact that the pause flag PAUSE is determined to be "0" in the above step 4C1 means that the event data of the channel number CH1 has not been read yet. The event of the next channel number CH1 that first appears at is searched for and read. Step 4CA: It is determined whether or not the key code of the received tempo key-on signal matches the key code of the searched channel number CH1. If they match (YES), the process proceeds to step 4CA, and if they do not match (NO), the process shown in FIG.
The process returns to the reproduction process of No. 3 and waits until the next interrupt timing.

Step 4CB: The accumulated value of the delta time data of each event read until the event of the channel number CH1 searched in step 4C8 is searched for is multiplied by the tempo coefficient of the tempo coefficient register T_COEF. , The value of the timing register TIME at that time, and the delta accumulation register D
Add to ELTA_ACM. Step 4CC: Delta time and timing register TIM until the event searched in Step 4C8
Multiply the value of E by 1 / B. Here, B is a value of 1 or more. That is, the delta time of each event and the value of the timing register TIME are reduced in order to increase the reproduction speed after the time when the tempo key-on signal is received from the baton 20 and bring the tempo key-on signal reception timing close to the beat timing. . Step 4 CD: Key-on receive flag KON_RC
Set "1" to V and proceed to step 4CE. From step 4CE to step 4CJ, the above-mentioned step 4C3
To Step 4C7, the description thereof will be omitted.

Next, by inputting the tempo key-on signal, how the microcomputer (CPU 11) in the electronic musical instrument 1H performs the reproduction process,
An example of the operation will be described with reference to FIG. FIG. 16 is a diagram showing the relationship between the input timing of the tempo key-on signal fetched from the baton 20 into the electronic musical instrument 1H and the reading timing of the automatic performance data. At timing t0, the event of the channel number CH3 is read at step 43 through steps 40 to 42 in FIG. 13, and the event is output to the tone generator circuit at step 465 in FIG. In the next step 43, the delta time D0 is read out, and in step 45, the timing register TIM
The delta time D0 is written in E.

After that, since the time corresponding to the delta time D0 has elapsed, the value of the timing register TIME also becomes 0, and at timing t1, the event of the channel number CH1 is read by step 43 through steps 40 to 42. This timing t
Since the tempo key-on signal has not been received in No. 1 in step 1, NO is determined in step 461 of FIG. 14, the key code "C3" of the event is stored in the key code register KEYCODE in step 463, and "1" is set in the pause flag PAUSE. ] Is set. Next step 43
In step 45, the delta time D1 is read out, and in step 45, the delta time D1 is written in the timing register TIME. At timing t2, which is a little later than timing t1, the baton 20 receives the tempo key-on signal of the key code "C3" and the dynamics from the baton 20 to the electronic musical instrument 1H. As a result, the processing of steps 4C3 to 4C8 is performed through steps 4C0 to 4C2 of the tempo key-on reception processing of FIG. 15, and the ratio of the value of the interval register INTERVAL and the value of the delta accumulation register DELTA_ACM is
For example, a value close to 1 is newly stored in the rate register RATE, almost the same tempo coefficient as the previous time is stored in the tempo coefficient register T_COEF, and "0" is stored in the interval register INTERVAL, the delta accumulation rate register DELTA_ACM and the pause flag PAUSE. Is set.

After that, since the time corresponding to the delta time D1 has elapsed, the value of the timing register TIME also becomes 0, and the channel number C at the timing t3.
The event of H2 is read, and step 465 of FIG. 14 is performed.
Then the event is output to the tone generator circuit. At this time, the velocity of the note event is modified according to the received dynamics. Delta time D in the next step 43
2 is read out, and the timing register T is read in step 45.
The delta time D2 is written in the IME. Less than,
Similarly, at timings t3 to t7, events of channel numbers CH3 to CH6 and delta times D3 to D6.
Are sequentially read and each event is output to the tone generator circuit. After that, at a timing t8 when the time corresponding to the delta time D6 is being measured (during decrement processing of the timing register TIME), this time the baton 20 sends to the electronic musical instrument 1H the tempo key-on signal of the key code "C # 3" and the dynamics. Is received. As a result, FIG.
After the step 4C0 and the step 4C1 of the tempo key-on reception process of 5, the processes of steps 4C9 to 4CJ are performed. In step 4C9, the event of the key code "C # 3" of the channel number CH1 is immediately searched, so the processing of step 4CB is performed after step 4CA. In step 4CB, the channel number CH
Since the delta time did not exist until the 1 event was searched, the accumulated value of the delta time is "0", and only the value of the timing register TIME is added to the delta accumulation register DELTA_ACM. It As a result, the value of the delta accumulation register DELTA_ACM and the value of the interval register IN
The relationship with the TERVAL value is: Delta accumulation D
ELTA_ACM is the interval register INTE
Greater than RVAL.

In step 4CC, the delta time of each event and the value of the timing register TIME are multiplied by 1 / B in order to increase the reproduction speed after the timing t8 when the tempo key-on signal is received. In step 4CD, the key-on receive flag KON_RCV is set to "1", and in steps 4CE to 4CJ, the ratio (value smaller than 1) between the value of the interval register INTERVAL and the value of the delta accumulation rate register DELTA_ACM is newly added to the rate register RATE. Stored,
The tempo coefficient register T_COEF stores a smaller tempo coefficient than the previous time, and the delta accumulation register DELTA_ACM and the interval register INTE are stored.
"0" will be set in RVAL. afterwards,
The value of the timing register TIME becomes 0, and the event of the channel number CH1 is read at the timing t9, so that the key-on receive flag KON_RCV is set to "0" in step 462 of FIG. Similarly, at each timing, the channel number event and the delta time are calculated in the tempo coefficient register T_.
The events are sequentially read out while being corrected by the tempo coefficient smaller than 1 stored in the COEF, and the respective events are output to the tone generator circuit. That is, if the reception timing of the tempo key-on signal from the baton 20 is earlier than the read timing of the automatic performance data, the tempo of the reproduction processing of the automatic performance data is increased, and in the opposite case, the reproduction of the automatic performance data is performed. Processing tempo goes down.

In the above-described embodiment, the sensor for detecting the gesture motion is not limited to the piezoelectric gyro sensor, but may be an acceleration sensor, or a magnet or light sensor. For example, the gesture motion may be captured and the gesture motion may be detected by image processing. Also, a plurality of these sensors may be combined. Further, in the above-described embodiment, the case where the peak and the valley of the output from the piezoelectric gyro sensor are extracted as the characteristic point of the gesture motion is described, but the present invention is not limited to this, and the type of the sensor is changed, and other conditions You may make it extract the feature point using. Further, in the above-described embodiment, the baton 20 and the electronic musical instrument 1 connected via the MIDI interface are used.
Although H has been described as an example, it goes without saying that both may be integrally formed. Alternatively, the tempo clock generated by the electronic musical instrument 1H may be supplied to an external device to control the performance tempo of the external device.

In the above-mentioned embodiment, the case where the baton 20 detects the peak and the valley and further detects the operation type thereof is explained. However, the baton 20 simply outputs the sensor value according to the gesture motion, and It goes without saying that the musical instrument 1H side may perform detection processing (peak and valley detection, operation type detection) according to this output. Further, in the above embodiment, the case where the gesture motion is detected by using two piezoelectric gyro sensors has been described, but it goes without saying that three or more may be used. In this case, sensors provided at different positions for three beats and two quarter beats may be used respectively, or a gesture motion may be detected by comprehensively judging outputs of three or more sensors. Good.

In the above embodiment, the case where the sensor is built into the baton has been described. However, the sensor is attached to the operator's body (for example, hand), a microphone or other device (for example, remote controller of a karaoke device, etc.). ) May be built in. In this case, the sensor output may be sent by wire or wirelessly. For example, when the microphone is built in, the tempo control may be enabled only in the intro portion of karaoke, and the performance tempo of karaoke may be determined according to the gesture motion of the microphone. In the embodiment, the case where the tempo is always controlled during the performance has been described, but it may be used when the tempo is decided prior to the performance. In the embodiment, the case where the performance data is composed of the event and the delta time has been described, but it goes without saying that a storage method other than this may be used. For example, performance data is composed of a set of event and absolute time. The unit of delta time is m
Even if a time unit such as s is used, the length of the note (for example, 4
(Eg, 1 / 24th of a quarter note) may be used.

In the embodiment, the tempo control is performed by multiplying the delta time value by the tempo coefficient and increasing or decreasing the delta time value, but by changing the processing cycle (interrupt timing). The tempo may be changed. In the embodiment, the tempo control data and the automatic performance data are mixed,
I explained the case of distinguishing by channel number,
Both may be provided separately in advance. For example, the memory for storing the address of the memory corresponding to the note position for controlling the tempo may be used as the tempo control data. When the tempo changes, the value of the tempo coefficient register T_COEF may be interpolated with the previous value so that the tempo changes smoothly. The dynamics control may be changed smoothly as well.

In the embodiment, the case where the peak value is multiplied by a predetermined value to calculate the dynamics has been described, but the predetermined value may be added to calculate the dynamics. Further, the value to be multiplied or added may be changed based on the change in the peak size, or may be selected from a plurality of predetermined values. As for the dynamics calculation processing 1 shown in FIG. 6 in which the dynamics are obtained by referring to the tables, a plurality of tables may be provided and any one of the tables may be appropriately selected according to the peak size. In the above embodiment, the case where the velocity is changed according to the dynamics has been described, but the tone color, pitch, effect, etc. may be changed according to the dynamics. The number of performance parts may be increased or decreased without being limited to this, and the dynamics of the performance may be controlled by controlling at least one of them.

In the dynamics calculation process 3 of FIG. 8, a case has been described in which the moving average of four peak values is taken and used as the dynamics, but the moving average of the peak values of other numbers is taken and used as the dynamics. It goes without saying that it is good. Further, in the dynamics calculation processing of FIGS. 9 and 10, a case has been described in which the average of the previous peak value of the operation type “1” is taken and the average is taken as the dynamics, but the steps 782, 784 and 786 of FIG. Each calculated motion type “1”,
You may take the average with the dynamics of "2" and "3", and output it as the dynamics in the operation type.

[0075]

According to the dynamics control device of the present invention, it is possible to eliminate the variation in dynamics due to the habit of the operator's hand movements and to provide the dynamics intended by the operator.

[Brief description of drawings]

FIG. 1 is a hardware block diagram showing a detailed configuration of an electronic musical instrument and a baton that outputs a tempo control signal to the electronic musical instrument in response to a hand gesture of an operator, and a connection relationship between the two.

FIG. 2 is a diagram showing an example of a sensor output process performed by a microcomputer in the baton of FIG.

FIG. 3 is a diagram showing details of the peak detection process of FIG.

FIG. 4 is a diagram showing details of peak type determination processing of FIG.

FIG. 5 is a diagram showing details of the valley detection process of FIG.

6 is a diagram showing details of a dynamics calculation process 1 which is an example of the dynamics calculation process of FIG.

7 is a diagram showing details of a dynamics calculation process 2 which is an example of the dynamics calculation process of FIG.

FIG. 8 is a diagram showing details of a dynamics calculation process 3 which is an example of the dynamics calculation process of FIG.

9 is a diagram showing details of a dynamics calculation process 4 which is an example of the dynamics calculation process of FIG.

10 is a diagram showing details of a dynamics calculation process 5 which is an example of the dynamics calculation process of FIG.

FIG. 11 is a diagram showing a relationship between an angle θ obtained by an arithmetic expression and a motion type.

[Fig. 12] The baton draws a triangular locus and 3
It is a schematic diagram which shows the concept of a sensor output process at the time of a hand gesture motion.

FIG. 13 is a diagram showing an example of a reproduction process of a musical sound processed by a microcomputer in the electronic musical instrument.

14 is a diagram showing details of the event handling process of FIG.

FIG. 15 is a diagram showing details of the tempo key-on reception process of FIG. 13.

FIG. 16 is a diagram showing a relationship between an input timing of a tempo key-on signal fetched from a baton into an electronic musical instrument and a reading timing of automatic performance data.

[Explanation of symbols]

11, 21 ... CPU, 12, 22 ... ROM, 13, 23
... RAM, 14 ... Key pressing detection circuit, 15, 24 ... Switch detection circuit, 16 ... Display circuit, 17 ... Sound source circuit, 18 ... Effect applying circuit, 19, 28 ... Timer, 1A ... Floppy disk drive (FDD), 1B , 27 ... MIDI interface (I / F), 1C ... keyboard, 1D, 29 ... panel switch, 1E ... display section, 1F ... sound system, 1G, 2E ... bass, 1H ... electronic musical instrument, 20 ... baton, 25, 26 ... A / D, 2A ... X-direction piezoelectric vibration gyro sensor, 2B ... Y-direction piezoelectric vibration gyro sensor, 2
C, 2D ... Noise removal circuit

Claims (2)

[Claims] 1. A motion detection unit that detects a motion type and a motion amount based on a gesture motion of an operator, and a correction that corrects the motion amount according to the motion type detected by the motion detection unit. A performance dynamics control device comprising: means and control means for controlling performance dynamics based on the amount of movement corrected by the correction means. 2. The performance dynamics control device according to claim 1, wherein the control means controls the tempo of the performance based on the type of motion and the amount of motion detected by the motion detecting means.