JP2004302011A - Device which conducts performance in synchronism with the operating timing of baton - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize performance technique in which not only performance is conducted with tempo intended by a conductor but also sound to be produced is generated with the timing of a baton being swung down by the conductor. <P>SOLUTION: A storage device stores music data 12 in which rhythm data 18 and 24, that specify sound to be generated when a baton is swung down by the conductor are added to melody describing data 10. A performance controller 36 outputs rhythm timing signals when sound generation specified by the rhythm data is instructed. A timing controller 32 receives the rhythm timing signals and specifies the time when the baton is swung down and the operating period of the baton. When the input timing of the signals is faster than the swing down operation of the baton, tempo signals in which operating period of the baton is slow down, are outputted to the controller 36. When the input timing of the signals is slower than the swing down operation of the baton, tempo signals in which operating period of the baton is speeded up, are outputted. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for playing or reproducing a melody by controlling a sound source using data describing a melody, for example, data described in a MIDI (Musical Instrument Digital Interface) format.
[0002]
2. Description of the Related Art There is known a technique in which melody is generated from a sound source by inputting data describing a melody, for example, data described in a MIDI format, to a computer and controlling the sound source by the computer in accordance with the data. At this time, a technique for adjusting the performance speed and volume intended by the conductor is described in Patent Document 1.
In the technique disclosed in Patent Document 1, a swing cycle and amplitude are detected from the movement of a baton, a tempo signal is generated from the cycle, a volume signal is generated from the amplitude, and the generated tempo signal and volume signal are used as a sound source control computer. To enter. In order to control the sound source according to the input tempo signal, volume signal and melody description data, the sound source control computer plays or reproduces the melody at the tempo and volume intended by the conductor.
[0003]
[Patent Document 1]
JP-A-6-301381
The melody is played or reproduced at the tempo and volume intended by the conductor, but does not provide a natural performance.
The conductor not only specifies the tempo at the timing of swinging down the baton, but also intends to produce a specific sound at the timing of swinging down the baton. In the example illustrated in FIG. 5, it is intended that the melody 52 is played in accordance with the swing-down timing 50. When the melody 54, 56, etc. are played in synchronization with the swing-down timing 50, it is extremely unnatural.
Just because the melody is played at the tempo intended by the conductor, the relationship between the swing-down timing and the melody is not uniquely determined, and which of the melody 52, 54, or 56 is played according to the swing-down timing 50 Is not decided. In any of the melody 52, 54, 56, the tempo is the tempo intended by the conductor.
In order to guarantee the performance according to the swing-down timing 50, it is necessary to generate the sound indicated by a circle in synchronization with the swing-down timing, for example, to prevent the sound illustrated by a square from being generated. There is.
In the conventional technology, the melody is played at the tempo intended by the conductor, and the sound that the conductor wants to be pronounced is guaranteed when the conductor swings down the conductor bar. Absent.
The present invention provides a performance technique that not only plays a melody at a tempo intended by a conductor, but also plays a sound that the conductor intends to produce at the timing of swinging down a baton. Realize. In the case of the example shown in FIG. 5, a performance technique is realized in which the melody 52 is not played as in the melody 54 and the melody 52 is played.
[0005]
The performance device created by the present invention has a storage device, a performance control device, and a timing control device. The storage device stores music data in which beat data for specifying a sound to be generated when the baton is swung down is added to data describing the melody. This storage device can be configured by setting a medium such as a CDROM storing music data in the data reading device, or can be configured by a hard disk or the like. The performance control device reads out the music data from the storage device, controls the sound source based on the read music data, and outputs a beat timing signal when instructing the sound of the sound specified by the beat data. The timing control device inputs a beat timing signal from the performance control device. Also, a signal indicating the movement of the baton is input, the time when the baton is swung down is specified, and the swing cycle of the baton is specified from the time difference between the last specified time and the current specified time. In addition, if the beat timing signal is input earlier than the time when the baton swings down, a tempo signal with a slower batting cycle is output to the performance control device, and the beat timing signal is input when the beat timing signal is input. If it is later than the time of swinging down, a tempo signal in which the swing cycle of the baton is accelerated is output to the performance control device.
The performance control device and the timing control device may be constituted by separate computers, or may be constituted by the same computer. Instead of a general-purpose computer, a dedicated sequencer or processor may be used. Also in this case, the performance control device and the timing control device may be constituted by separate sequencers or processors, or may be constituted by the same sequencer or processor.
[0006]
Although the data describing the melody has the data of the scale and the pitch, it does not have the data specifying the sound to be pronounced when the baton is swung down. In the example shown in FIG. 5, the melody description data includes information for designating whether to play (or reproduce) the melody 52, perform the melody 54, or perform the melody 56. Absent.
Therefore, in the present invention, beat data for specifying a sound to be pronounced when the baton is swung down is added. In the case of FIG. 5, beat data for specifying the sound of “do, do, tsu, do, ret, ret, ret” is added. This specifies that the melody 52 should be played. Although it is unnatural, it is also possible to add data that specifies the sound of “wa, na, wa”, in which case it is specified that the melody 54 should be played.
A sound source such as an electronic musical instrument or a musical instrument with a performance actuator is controlled by a performance control device to generate sound. At this time, the melody is played (or reproduced) because the performance control device controls the sound source by the melody description data. The performance control device outputs a beat timing signal when instructing the sound generation of the sound specified by the beat data. In the previous example, a beat timing signal is output each time the sound of "do, do, tsu, do, rei, rei, rei" is produced.
The timing control device inputs a signal indicating the movement of the baton (for example, image data obtained by capturing the movement of the baton, an output of an acceleration sensor attached to the baton, etc.), and detects when the baton is swung down. The swing cycle of the baton is identified from the time difference between the time specified last time and the time specified this time. That is, the timing of swinging down the conductor bar and the tempo intended by the conductor are recognized. Further, the timing control device inputs a beat timing signal each time the sound of “do, do, tsu, do, ret, ret, ret” is produced. The timing control device compares the timing at which the baton swings down with the input timing of the beat timing signal. If the input of the beat timing signal is earlier than the time of the downstroke of the conductor bar, it is understood that the performance (or reproduction) is progressing faster than the conductor's intention. In this case, the timing control device outputs to the performance control device a tempo signal in which the tempo intended by the conductor, which is determined from the swinging cycle of the baton, is reduced. As a result, the premature performance (or reproduction) is made slow tempo, and the intended sound can be produced at the time of the next swinging down of the baton. Conversely, if the time when the beat timing signal is input is later than the time when the baton swings down, it can be understood that the performance (or reproduction) is behind the intention of the conductor. In this case, the timing control device outputs to the performance control device a tempo signal obtained by accelerating the tempo intended by the conductor, which is determined from the swing cycle of the baton. As a result, the performance (or reproduction) that is too slow is made up-tempo, and the intended sound can be produced at the time of the next swing of the baton.
As described above, not only the melody is played at the tempo that the conductor intends, but also the sound that the conductor intends to sound at the timing of swinging down the baton ( Or playback).
[0007]
The above-described performance control device itself, that is, music data in which beat data specifying a sound to be emitted when the baton is swung down is added to the melody description data, a sound source is controlled by the read music data, and The device itself that outputs a beat timing signal when instructing the generation of the sound specified by the above is the device created by the present invention.
[0008]
Similarly, the timing control device itself, that is, a beat timing signal output when a sound to be pronounced when the baton is swung down is input, a signal indicating the motion of the baton is input, and the baton is swung down. Identify the time when the command was performed, and determine the pitching cycle of the conductor from the time difference between the time specified last time and the time specified this time.If the beat timing signal is input earlier than the time when the commander swings down, conduct the command. The present invention also provides a device that outputs a tempo signal in which the bar swing cycle is slowed down and outputs a tempo signal in which the command bar swing cycle is accelerated if the input of the beat timing signal is slower than the command bar swing down. It is a device created.
[0009]
DESCRIPTION OF THE PREFERRED EMBODIMENTS The main features of the embodiment described below are listed first.
(Mode 1) The melody data is described in the MIDI format, and beat data is added to a part (channel) in which no melody data is stored. The added beat data has a volume of zero and indicates a sound that is not actually played. This sound is added at the same timing as the sound to be produced when the baton is swung down.
(Mode 2) A performance control device is a device that controls a sound source in accordance with MIDI format data to perform or reproduce and controls a performance or reproduction tempo by inputting a tempo signal.
(Mode 3) The timing control device is configured by a general-purpose computer, and outputs a corrected tempo signal to a synthesizer. The synthesizer converts the input tempo signal into a format that can be input by the performance control device, and outputs the converted tempo signal to the performance control device.
(Mode 4) The timing control device adjusts the tempo correction amount in accordance with the length of the time difference between when the beat timing signal is input and when the baton swings down.
(Mode 5) The timing control device analyzes image data obtained by photographing the motion of the baton, and specifies the time of swinging down the baton.
[0010]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference numeral 10 in FIG. 1 schematically shows the storage contents of melody data used for performance (or reproduction). The melody data stores, in MIDI format, data indicating the scales and pitches that make up the melody. In the MIDI format, melody data can be stored for each part (or channel), and the sounding timing relationship between parts is also stored. For example, it is stored that sounds 6 and 8 should be pronounced simultaneously. The melody data does not plan to play along with the conductor waving the conductor, and has no data indicating the sound to be produced when the conductor is swung down. This causes the problem shown in FIG.
[0011]
Prior to playing (or playing), data indicating the sound to be produced when the baton is swung down is added. For that purpose, a part (or channel) that is not used is used. As shown at 12 in FIG. 1, a sound 18 to be produced simultaneously with the sound to be produced when the baton is swung down (referred to as 14 and 16) is added to the unused part N. Do this for all sounds that should be pronounced when the baton is swung down. A sound 24 is added to the sounds 20 and 22.
The sounding timing of the added sounds 18 and 24 coincides with the swinging down of the baton, and coincides with the so-called beat timing. Since the sound stored in part N is played at zero volume, it is not actually played. By adding beat data indicating the sound generation timing of the sounds 18 and 24, the sound to be generated when the baton is swung down is specified.
The music data 12 to which the beat data 18 and 24 have been added is used by the MIDI performance PC 36. The music data 12 may be stored on a medium such as a CVD, or may be stored on the hard disk of the MIDI performance PC 36. In the former case, a storage device for the music data 12 is configured in the MIDI performance PC 36 by setting a medium such as CVD in the MIDI performance PC 36. In the latter case, the hard disk of the MIDI performance PC 36 is a storage device for the music data 12.
FIG. 2 shows a procedure of a preparation process to be performed before the performance starts, and the above process is performed in a process S2.
[0012]
The playing device is composed of a video camera 30, a conductor analysis PC (personal computer) 32, a MIDI synthesizer 34, a MIDI playing PC 36, a sound source 38 such as an electronic musical instrument or a musical instrument with a performance actuator, and a speaker 40. I have.
The video camera 30 takes an image of the tip 28 of the baton shaken by the conductor 26 and sends the captured video signal to the baton analysis PC 32. The command bar analysis PC 32 analyzes the temporal displacement of the height of the command bar tip 28 (graph 42), and the timing when the command bar tip 28 reaches the bottom dead center (when the command bar is swung down) t1, t2. ... is specified. The conductor bar analysis PC 32 specifies the swing period (T2) of the conductor bar from the time difference (T2 in this case) between the time specified last time (for example, t1) and the time specified this time (for example, t2). When the conductor 26 changes the tempo, the swing period T of the conductor changes. The command bar analysis PC 32 is used as a timing control device. The command bar analysis PC 32 also specifies the amplitude of the swing of the command bar tip 28.
The conductor bar analysis PC 32 analyzes the temporal displacement of the height of the conductor bar tip 28 (graph 42), and specifies the performance start timing designated by the conductor. The operator may manually input the performance start timing to the conductor analysis PC 32 in case the performance start timing specified by the conductor cannot be specified by analyzing the position of the conductor tip 28.
[0013]
The MIDI synthesizer 34 is used as an interface between the conductor analysis PC 32 (general-purpose personal computer) and the MIDI performance PC 36, and converts a signal.
[0014]
The MIDI performance PC 36 reads the music data 12 and controls the sound source 38 using the read music data 12. It corresponds to a performance control device. The music data 12 has data indicating a scale, a pitch, and a sound to be pronounced when the baton is swung down, but does not have data for specifying a tempo and a volume. Data designating the tempo and the volume is sent from the conductor analysis PC 32 to the MIDI performance PC 36 via the MIDI synthesizer 34. The MIDI performance PC 36 controls the sound source 38 so that a scale and a pitch determined by the melody data are obtained at the specified tempo and volume. At this time, as will be described later, the sound to be emitted when the baton is swung down is played (or reproduced) at the timing when the baton is swung down.
[0015]
When the MIDI performance PC 36 instructs the sound source 38 to produce a sound (described in Part N) to be produced at the beat timing, the MIDI performance PC 36 sends a pulse signal C to the conductor analysis PC 32 via the MIDI synthesizer 34. Since the sound described in Part N is played at zero volume, it is not actually played. If it is desired to generate a sound in synchronization with the beat timing, the volume of the sound described in Part N may be set to a value other than zero.
[0016]
FIG. 3 shows a processing procedure executed by the conducting-bar analysis PC 32 during a performance. In step S4, the position of the tip 28 of the bar is analyzed, and the process waits for a change in position to be observed when the conductor instructs to start playing. When a change in the position performed when the conductor instructs the start of performance is observed, the conductor analysis PC 32 sends the performance start signals A and B (signal B is converted to MIDI format) to the MIDI performance PC 36 via the MIDI synthesizer 34. (S6). An operator may manually output the performance start signal A from the conductor analysis PC 32 at the performance start timing.
FIG. 4 shows a processing procedure executed by the MIDI performance PC 36 during performance. In step S30, the process waits for a performance start signal B to be input. When the performance start signal B is input, a performance (or reproduction) process is started at a preset tempo and volume (step S32). The MIDI performance PC 36 waits for the sound source 38 to instruct the sound source 38 to sound a sound to be sounded at the beat timing described in Part N (step S34), and instructs the sound source 38 to sound the sound to be sounded at the beat timing. At times, the pulse signal C is sent to the command bar analysis PC 32 via the MIDI synthesizer 34. The pulse signal C is converted by the MIDI synthesizer 34 into a pulse signal D that can be input to the baton analysis PC 32.
[0017]
The command bar analysis PC 32 waits for the input of the pulse signal D in step S8 in FIG. The subscript n indicates the number of inputs. When the pulse signal Dn is input, timing is started (S10), and the control waits until the timing tn for swinging down the baton is specified. When the command bar swing-down timing tn is specified, the time difference from when the pulse signal Dn is input to the command bar swing-down timing tn is stored in ΔT (S14).
Reference numeral 44 in FIG. 1 indicates a case where the pulse signal D3 is input before the swing-down timing t3. In this case, step S8 becomes YES, and the processing of steps S10 to S14 described above is performed. Be executed.
In this case, it is equivalent to that the sound to be produced at the timing t3 when the baton is swung down is generated before the timing t3 when the baton is swung down. That is, it means that the performance or the reproduction is too early. In this case, if the performance is performed or reproduced more slowly than the conductor's intended tempo (T3) determined at the timing t3 when the conductor is dropped, the sound to be generated at the next timing t4 is generated. It should be corrected as follows. In step S16 of FIG. 3, a tempo converted into a slow tempo by a time ΔT that is too early for the performance than the tempo Tn intended by the conductor is calculated, and a signal E indicating the corrected tempo is output.
[0018]
If the swing-down timing tn of the baton is specified while waiting for the input of the pulse signal Dn in step S8 of FIG. 3, step S18 becomes YES. When the timing of depressing the baton down tn is specified first, timing is started (S20), and input of the pulse signal Dn is waited. When the pulse signal Dn is input, the time difference from the timing at which the baton swings down tn to the time when the pulse signal Dn is input is stored in ΔT (S24).
Reference numeral 46 in FIG. 1 indicates a case where the swing-down timing t4 is input before the pulse signal D4. In this case, step S18 becomes YES, and the processing of steps S20 to S24 is executed. Is done.
In this case, it is equivalent to that the sound to be pronounced at the timing of the downstroke of the baton is generated after the timing t4 of downstroke of the baton. In other words, it means that performance or reproduction is too slow. In this case, if the performance is performed or reproduced earlier than the tempo (T4) intended by the conductor determined at the timing t4 when the conductor is dropped, the sound to be generated at the next timing t5 is generated. Should be corrected to In step S26 in FIG. 3, a tempo that is increased by a time ΔT that is too slow for the performance than the tempo Tn intended by the conductor is calculated, and a signal E indicating the corrected tempo is output.
As shown at the timing t2, if the input timing of the pulse signal D2 and the swing-down timing t2 of the baton match, the sound to be generated at the swing-down timing t2 of the baton is emitted at that timing. There is no need to correct the tempo, and the tempo signal E indicating the tempo T2 intended by the conductor is output.
[0019]
The tempo signal E output from the conductor analysis PC 32 is converted into a MIDI format tempo signal F by the MIDI synthesizer 34 and input to the MIDI performance PC 36 (step S38 in FIG. 4).
[0020]
The command bar analysis PC 32 also specifies the amplitude of the swing of the command bar tip 28. Then, data G specifying the volume from the specified amplitude is sent to the MIDI synthesizer 34 (step S28 in FIG. 3). The MIDI synthesizer 34 converts the volume designation data G into a MIDI format volume signal H and sends it to the MIDI performance PC 36 (step S38 in FIG. 4).
The MIDI performance PC 36 plays the melody described in the MIDI format according to the input tempo signal F and volume signal H. Step S34 and subsequent steps are repeated until the MIDI format data ends and the music performance ends. When the conductor 26 stops moving the baton, the tempo is slowed down to infinity and the performance is paused.
[0021]
According to the present technology, the conductor bar analysis PC 32 basically specifies the tempo specified by the cycle T of the conductor bar swing (steps S16 and S24 in FIG. 3), and thus performs at the tempo intended by the conductor. Or it will be played.
On the other hand, it is determined whether the performance is too early or too late based on the difference between the timing at which the baton is swung down and the actual sounding timing of the sound to be pronounced at that timing. The correction is made (S16 in FIG. 3), and if the performance is too slow, the performance tempo is corrected earlier (S26 in FIG. 3). Therefore, the timing at which the conductor is swung down and the actual sounding timing of the sound to be generated at that timing Is corrected so as to be zero, and at the timing when the baton is swung down, the sound to be produced at that timing is played or reproduced so that it is actually produced.
[0022]
According to the present invention, not only the melody is played at the tempo intended by the conductor, but also the sound that the conductor intends to produce at the timing of swinging down the baton is actually produced. Therefore, the conductor can comfortably and comfortably conduct the performance device without feeling uncomfortable.
[Brief description of the drawings]
FIG. 1 is a diagram comprehensively showing the main points of the present invention.
FIG. 2 is a processing procedure diagram of a preparation stage.
FIG. 3 is a processing procedure diagram executed by the timing control device.
FIG. 4 is a processing procedure diagram executed by the performance control device.
FIG. 5 is a diagram showing the relationship between the swing of the baton and the progress of the melody.
10: MIDI melody data 12: Music data to which beat data is added 30: Conducting bar photographing camera 32: Conducting bar analysis PC (timing control device)
34: MIDI synthesizer 36: MIDI performance PC (performance control device)
38: Sound source

Claims (3)

A storage device that stores music data in which beat data for specifying a sound to be pronounced when the baton is dropped down is added to data describing the melody,
A performance control device that reads out music data from the storage device, controls a sound source by the read music data, and outputs a beat timing signal when instructing sounding of a sound specified by the beat data;
Input the beat timing signal, input the signal indicating the movement of the baton, specify when the baton was swung down, and determine the time of the baton from the time difference between the time specified last time and the time specified this time. When the beat timing signal is input earlier than when the baton swings down, the swing cycle of the baton is output to the performance control device, and the beat timing signal is output to the performance control device. A timing control device for outputting to the performance control device a tempo signal in which the swinging cycle of the conductor bar is accelerated if it is later than when the bar is swung down. Reads song data with beat data specifying the sound to be pronounced when the baton is dropped down to the data describing the melody, controls the sound source with the read song data, and sounds the sound specified by the beat data A performance control device that outputs a beat timing signal when an instruction is given. Enter the beat timing signal that is output when the sound to be pronounced when the baton is dropped down, input the signal indicating the movement of the baton, specify when the baton was down, From the time difference between the time specified and the time specified this time, the swing cycle of the conductor is specified, and if the beat timing signal is input earlier than the swing of the conductor, the tempo is reduced. A timing control device that outputs a tempo signal that outputs a signal, and if the beat timing signal is input later than when the baton swings down, the baton swing cycle is accelerated.

Images