JP2002023743A - Sounding control system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a sounding control system which allows a user to participate in the performance of a piece of music by an easy operation and renders the performance of music more accessible. SOLUTION: A performance controller 3 automatically plays the music of plural parts based on automatic performance data. Plural users swing respectively different hand controllers 1 and instruct a tempo and sound volume. The operation data are inputted through a communication unit 2 to the performance controller 3. The performance controller 3 controls the tempo and sound volume of the respectively different parts based on the operation data inputted from the respective hand controllers 1. Thus, the performance like an ensemble is enjoyed by the plural users.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a musical performance, and more particularly to a sound control system for performing an ensemble.

[0002]

2. Description of the Related Art A keyboard is the most popular performance device used for playing electronic musical instruments. The keyboard has keys (keys) of 5 to 6 octaves, and the pitch and tone can be selected by pressing any key, and the strength of the sound can be controlled by the strength of the key pressed. Although it is possible to perform, it requires skill to perform and takes a long time to learn.

There is also an electronic musical instrument having an automatic performance function of reading out automatic performance data such as MIDI sequence data in accordance with a tempo clock and inputting this to a sound source to perform an automatic performance. When a start operation such as pressing a play button is performed, the music is automatically played, and there is no room for the user to operate thereafter, and the user cannot participate in the performance or control the performance.

[0004]

As described above, when playing a musical piece using an electronic musical instrument, it is not easy to operate the keyboard by yourself, because it requires skill. If it is performed, the user can hardly participate in the performance and cannot get the feeling that the user himself is also participating in the performance. Did not. In particular, in the case of an ensemble in which a plurality of players play together, there is a problem that a good performance cannot be performed unless the skills of the respective players are uniform.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a sound control system that can participate in music performance by an easy operation and can lower the threshold for music performance.

[0006]

According to a first aspect of the present invention, there is provided a plurality of sensors including a sensor for detecting a movement mode or a posture state of a body, and a transmitting unit for transmitting the detected content of the sensor as operation data. An operation unit and automatically plays a music based on automatic performance data including at least pitch data of the music, and controls performance elements such as a tempo and a volume of the automatic performance based on operation data received from the plurality of operation units. And a control device provided with performance control means for performing the performance. According to a second aspect of the present invention, in the first aspect of the invention, the performance control means performs an automatic performance based on the automatic performance data of a plurality of parts, and converts the performance elements of each part into operation data received from different operation units. It is characterized in that control is performed based on the above. According to a third aspect of the present invention, in the first aspect of the invention, the performance control means includes:
The performance element of the automatic performance is controlled using one piece of total operation data determined based on a plurality of operation data received from the plurality of operation units.

[0007] The operation unit detects a movement mode or a posture state of each part of the body. The part of the body to be detected may be anywhere such as an arm, a foot, or a finger. When detecting the motion mode, the motion of the body part to be detected, such as rocking or bending, is detected. The motion mode to be detected is not limited to bending and stretching or rocking, and may be any mode. This movement is detected by sensor means attached to a body part or sensor means operated by a body part such as a hand. As the sensor means, a sensor means such as a key switch or an impact pad which makes a predetermined contact with a predetermined part of the body temporarily by the movement of the body may be used. Sensor means that move with the body by being operated on the body part are preferred. As such a sensor means, an acceleration sensor, a speed sensor, an impact sensor, or the like can be used.

The posture state refers to a static state such as the direction of the body part or the angle at which the joint is bent. When this posture state is detected, it is attached to the body part. This is detected by the sensor means operated by a body part such as a hand or a hand part. As this sensor means, a gyro sensor, an angle sensor, or the like can be used.

In the automatic performance of music, a predetermined tone, pitch and volume are generated at a predetermined timing for a predetermined pitch, and the musical tones are generated one after another at a predetermined tempo. In the present invention (automatic performance control mode), at least one of the performance elements such as the tone color, pitch (pitch), tone quality, volume, timing, tone length, tempo, and the like is controlled based on the operation data. For example, the pitch and duration (note type) of the tones to be pronounced are based on the automatic performance data, the tempo of the performance is determined based on the movement mode such as rocking or tapping, and the volume is rocked or tapped. For example, the pitch of a musical tone to be generated is based on that of automatic performance data, and the generation timing is set to a local peak of operation data. The basic pitch may be that of automatic performance data, and the subtle pitch fluctuation may be controlled by operation data. In any case,
By reading some performance elements from the automatic performance data and releasing the rest of the performance elements to the user (operation unit), the user can control some of the performance elements via the operation unit. You can participate in the performance and lower the threshold of music performance.

According to the present invention, a plurality of operation units transmit operation data to a control device for performing an automatic performance. Each of the plurality of operation units outputs different operation data according to an operation of a user who operates the operation unit. If the automatic performance data consists of multiple parts, assigning each operation unit to a different part will result in some performance elements of each part being controlled by a different operation unit. Participants can perform and include ensemble-like elements with easy operation.

According to the third aspect of the present invention, the performance is controlled by determining one overall operation data based on the operation data output from the plurality of operation units. As a result, it becomes possible for a large number of users to participate and control one music piece together. The method of determining one comprehensive operation data from a plurality of operation data is to average all the operation data, exclude the operation data having the maximum / minimum values, average the remaining operation data, and extract the median operation data Extract the maximum value operation data, extract the minimum value operation data,
And the like, and these may be switched and used depending on the scene. As a result, an automatic performance that reflects the operations of a plurality of users operating a plurality of operation units becomes possible.

The plurality of operation units do not necessarily have to be operated by a plurality of users one by one. For example, when the operation unit is mounted on both arms or both feet and one user operates four operation units. Such as to operate
One user may operate a plurality of operation units to generate a plurality of operation data.

According to a fourth aspect of the present invention, in the first to third aspects of the present invention, recording means is provided for recording automatic performance data in which performance elements are controlled based on operation data. According to a fifth aspect of the present invention, in the above invention, the performance control means automatically performs a music piece based on the automatic performance data recorded by the recording means.

The automatic performance data in which some of the performance elements are controlled by the operation unit are output to a sound source device, which generates a musical tone. According to the present invention, the automatic performance data in which some of the performance elements are controlled is recorded and stored as the automatic performance data corrected by the user. Further, according to the invention of claim 5, the performance control means outputs the automatic performance data corrected by the user.
It is read out again as automatic performance data in which some performance elements are controlled by the operation unit again. Thus, it is possible to control the performance elements part by part by one automatic performance and control the performance elements of all parts by multiple automatic performances. It is also possible to control some performance elements by one automatic performance and to control a plurality of desired performance elements by multiple performances.

In the case where the performance elements are controlled by the plurality of automatic performances, it is not always necessary to provide a plurality of operation units, and the invention can be achieved even with one operation unit.

According to a sixth aspect of the present invention, there is provided a plurality of operation units each comprising: sensor means for detecting a movement mode or a posture state of a body; and transmission means for transmitting the detection content of the sensor means as operation data. And a control device having sound control means for controlling the sound of the corresponding pitch based on the operation data received from each operation unit. It is characterized by the following. The invention of claim 7 is
In the above invention, the sounding control means reads out automatic performance data including the pitch and sounding timing of each note of the music at a predetermined tempo, and generates performance guide information indicating the pitch and sounding timing of each note. It is characterized by.

According to the present invention, musical tones having different pitches are assigned to the respective operation units. For example, when the swing of each operation unit is detected, control such as generating a musical tone having a corresponding pitch is performed. If different users operate the operation units, it becomes possible to perform a so-called handbell in which each user plays a tune while in charge of one or several different tones. In this case, the control device reads out the song data of the song to be played, and generates operation guide information for the operation unit corresponding to the pitch to be sounded, so that each user can respond to this. The music can be easily played by operating the operation unit. In the case of a handbell, one person may be in charge of two or three bells. In the case of the present invention, one person assigns a plurality of pitches to one operation unit. , It is possible to have a performance form similar to that in which one person is in charge of a plurality of bells. In this case, it is possible to determine which pitch of the plurality of pitches is to be produced in response to the operation of the operation unit by monitoring the progress of the music using the music data, and determining the current time according to the operation of the operation unit. What is necessary is just to determine whether a pitch should be pronounced.

According to an eighth aspect of the present invention, in the above-mentioned invention, the plurality of operation units include a plurality of sensor means attached to each part of one person's body, and the transmitting means separates the detection contents of each sensor means into individual ones. It is characterized by being transmitted as operation data. According to a ninth aspect of the present invention, in the above-mentioned invention, the plurality of sensor means include:
It is a shock sensor attached to a thigh or the like. Thereby, the generation of music of a plurality of parts and the musical tones of a plurality of pitches can be controlled by the movement of each part of the body of a person, particularly, by the movement of swinging the arm and hitting the sensor with the hand in the invention of claim 9. Can be.

[0019]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A sound control system according to an embodiment of the present invention will be described with reference to the drawings. FIG.
FIG. 2 is a diagram illustrating a schematic configuration of the entire sound generation control system. This sound generation control system includes a plurality of hand controllers 1 as operation units, a communication unit 2, a performance control device 3 including a personal computer, a sound source device 4, an amplifier 5, and a speaker 6. Each of the plurality of hand controllers 1 has a different ID number (= 1 to 1).
24) is set. The hand controller 1 has a baton shape, and the user performs a swing operation. The built-in acceleration sensor 17 (see FIG. 2) detects the acceleration due to the swing operation. The detected acceleration is wirelessly transmitted from the hand controller 1 to the communication unit 2 as operation data.
The communication unit 2 receives operation data wirelessly transmitted from the plurality of hand controllers 1 and transfers the operation data to the performance control device 3. The performance control device 3 analyzes the input operation data and controls the tone generation of the tone generator 4.
The tone generator 4 has a function of forming a musical tone waveform and giving an effect to the musical tone waveform formed. The tone generation control by the performance control device 3 controls the formation of the musical tone waveform and the generated musical tone waveform. Includes both control of the applied effects.

The basic usage of the plurality of hand controllers 1 is such that different users swing the respective hand controllers 1 to control the performance. A performance control device 3, which is a control device, automatically plays a music of a plurality of parts based on music data. Each of the plurality of parts is assigned to a separate hand controller 1, and the performance is controlled by the swing operation of each hand controller 1. Performance control includes controlling the performance tempo based on the swing tempo (interval at which the swing peak is detected) and controlling the volume based on the magnitude of the swing acceleration (or speed). Since each part is controlled by a different user (hand controller 1) in this manner,
The user can enjoy a simple ensemble performance. It is also possible to assign a different pitch to each hand controller and perform an ensemble like a so-called handbell. In this case, when a certain hand controller 1 is rocked, a musical tone having a pitch assigned to the hand controller 1 is generated at a volume corresponding to the magnitude of the acceleration of the rocking. When each user swings the hand controller 1 at the timing of the pitch (note) to which he / she is responsible according to the music, the music progresses.

In FIG. 2, the hand controller 1
It has a baton shape in which the center is thinner, and the housing is composed of an upper housing 10 and a lower housing 1 with a center at the thinnest center.
1 can be separated. A cord-shaped antenna 18 is drawn out from the bottom of the lower housing 11. A circuit board 13 on which a receiving circuit, a CPU, a switch group, and the like, which will be described later, are mounted is provided inside.

On the upper casing 10 side of the circuit board 13, four color LEDs 14 (14a to 14d) and a switch group 15 (1
5a to 15d) A 2-digit 7-segment display 16, a 3-axis acceleration sensor 17, and the like are mounted. LED14
a, 14b, 14c, and 14d are LEDs for emitting blue light, green light, red light, and orange light, respectively. When the upper housing 10 is removed from the lower housing 11, the upper side of the circuit board 13 is exposed, and the switch group 15 can be operated. The switch 15a is a power switch, the switch 15b is a single sound generation mode selection switch, 15c is an automatic performance control mode selection switch, and 15d is an ENTER switch. When the mode is selected by the switches 15b and 15c and the ENTER switch 15d is turned on, the selected mode is transmitted as mode selection data. However, only the mode selection data transmitted by the hand controller in which the ID number = 1 is set is input to the performance control device 3.

Among the modes selected by the mode selection switch, the single sound generation mode is a mode in which a predetermined musical sound is generated at a local peak point of the acceleration due to the swing operation of the hand controller 1.
In this mode, musical tones of different pitches are assigned to each other, and a ensemble like a handbell is performed. In the automatic performance control mode, the performance control device 3 controls the tempo and volume of the automatic performance processing operation for sequentially outputting the automatic performance data stored in the storage device to the sound source device 4 by the hand controller 1.
In this mode, each part of the music data composed of a plurality of parts is separately controlled by the plurality of hand controllers 1. In this embodiment, the tempo of the automatic performance is controlled by the local peak interval (period) of the swing operation of the hand controller 1, and the volume and sound quality of the automatic performance are controlled by the speed and magnitude of the swing.

FIG. 3 is a block diagram of a control unit of the hand controller 1. The control unit 20 is configured by a microcomputer in which a CPU, a memory, an interface, and the like are built in one chip, and controls the operation of the hand controller 1. The control unit 20 is connected with a three-axis acceleration sensor 17, a switch group 15, an ID setting switch 21, a modem 23, a modulation circuit 24, a demodulation circuit 27, an LED display circuit 22, and the like.

The acceleration sensor 17 is a semiconductor sensor and can respond to a sampling frequency of about 400 Hz.
The one having a resolution of about 8 bits is used. When the acceleration sensor 17 swings due to the swing of the hand controller 1,
8bi for each of X-axis, Y-axis and Z-axis
The acceleration data of t is output. The acceleration sensor 17
The hand controller 1 is built in the distal end portion such that the axes, the Y axis, and the Z axis are in the directions shown in FIG. The acceleration sensor 17 is not limited to a three-axis sensor, but may be a two-axis sensor or a non-directional sensor.

The ID setting switch 21 is a 5-bit dip switch, and can set ID numbers 1 to 24. The ID setting switch 21 is connected to the lower housing 1
The circuit board 13 is mounted on the circuit board 13 on one side.
Is pulled out of the lower housing 11 and operated.

The control section 20 outputs the acceleration data input from the acceleration sensor 17 to the modem 23 as operation data. An ID number set by the ID setting switch 21 is added to this operation data. The mode selected by the mode selection switches 15b and 15c is output to the modem 23 as mode selection data different from the operation data.

The modem 23 is a circuit that converts the baseband data input from the control unit 20 into phase transition data. The modulation circuit 24 is a circuit that enables GMSK modulation of a 2.4 GHz band carrier signal with the phase transition data to enable wireless transmission. 2.4 GHz output from the modulation circuit 24
The band signal is amplified by the transmission output amplifier 25 to about weak power, and is copied and output from the antenna 18. Also,
The antenna 18 has an isolator, and is connected to the transmitting output amplifier 25 and the receiving circuit 26 via the isolator. The receiving circuit 26 is a circuit that receives and amplifies the 2.4 GHz band signal incident on the antenna 18, and the demodulation circuit 27 and the modem 23 convert GMDK-modulated data included in the received signal into baseband data. The signal is demodulated and input to the control unit 20. The control unit 20
Among them, the data with its own ID is taken in as data addressed to its own station.

Although the hand controller 1 is configured to wirelessly communicate with the communication unit 2 as described above, it may be configured to perform wired communication via a USB interface or the like. Further, a short-range wireless interface using a spread spectrum method such as Bluetooth can be applied.

FIG. 6 is a diagram showing a format of data transmitted from the hand controller 1 to the communication unit 2. FIG. 3A is a diagram showing a configuration of operation data. The operation data includes a controller ID number (5 bits), a code indicating the operation data (3 bits),
X-axis direction acceleration data (8 bits), Y-axis direction acceleration data (8 bits), Z-axis direction acceleration data (8 bits)
Consists of FIG. 3B is a diagram showing a configuration of the mode selection data. The mode selection data includes a controller ID number (5 bits), a code (3 bits) indicating that there is mode selection data, and a mode number (8 bits).

FIG. 4 is a block diagram of the communication unit 2. The communication unit 2 receives data (operation data, mode selection data) transmitted by the hand controller 1,
This is a device for transferring to the performance control device 3 which is a personal computer. The communication unit 2 includes a main control unit 30,
A plurality of individual communication units 31, a USB interface 3
9. Different ID numbers are respectively set for the plurality of individual communication units 31, and the corresponding I
It communicates with the hand controller 1 of the D number.

In FIG. 1A, an individual communication unit 31 and a USB interface 39 are connected to a main control unit 30 composed of a microprocessor. The USB interface 39 (see FIG. 5) of the performance control device 3 is connected to the USB interface 39.

The structure of the individual communication unit 31 is shown in FIG.
Shown in An ID switch 38, a demodulation circuit 35, and a modulation circuit 36 are connected to the individual control unit 33 composed of a microprocessor. The ID switch 38 is constituted by a dip switch, and the same ID number as that of the corresponding hand controller 1 is set. A receiving circuit 34 is connected to the demodulation circuit 35. The receiving circuit 34 selectively receives the 2.4 GHz band signal input from the antenna 32, and from among these, receives the GMSK modulated signal transmitted by the hand controller 1 from the signal. Is a circuit for detecting and outputting. The demodulation circuit 35 demodulates the data (operation data, mode selection data) of the hand controller 1 from the GMSK modulation signal. The individual control unit 33 reads out the ID number added to the head of the demodulated and input data, and
It is determined whether the ID number is the same as the ID number set by the D switch 38. If the same, this individual communication unit 3
The data is taken as data for one, and is input to the main control unit 30.

A transmission circuit 37 is connected to the modulation circuit 36, and the transmission circuit 37 is connected to the antenna 32. The modulation circuit 36 performs GMSK modulation on the data output from the individual control unit 33 in the same manner as the modem 23 described above. The transmission circuit 37 GMSK-modulates the 2.4 GHz band carrier with the GMSK-modulated signal and outputs the result from the antenna 32. If there is data (performance guide information) to be transmitted to the corresponding hand controller 1, the modulation circuit 3
5 and the transmission circuit 37 to the hand controller 1.

The transmission of the data to be transmitted is performed immediately after receiving the data from the corresponding hand controller 1. By performing at this timing, transmission and reception do not collide in the hand controller 1.

FIG. 5 is a block diagram of the performance control device 3 which is a control device. The CPU 41 for controlling the entire apparatus includes:
The ROM 42, the RAM 43, the mass storage device 44, the MIDI interface 45, the USB interface 46, the keyboard 47, the pointing device 48, the display unit 49, and the communication interface 50 are connected via the bus. The MIDI interface 45 is connected to a sound source device 51 which is an external device.

The ROM 42 stores a start-up program and the like. The mass storage device 44 includes a hard disk,
It is composed of a CD-ROM, MO, etc., and stores system programs, application programs, music data, and the like. The RAM 43 is loaded with a system program, an application program, and the like from the large-capacity storage device 44 when or after the performance control device 3 is started. Further, a storage area necessary for executing the application program is secured in the RAM 43. The USB interface 46 is connected to the USB interface 39 of the communication unit 2. The keyboard 47 and the pointing device 48 are used to select a song to be played.
It is used when a user operates an application program. Alternatively, the device may be connected to a server device (not shown) via the Internet or a subscriber line using the communication interface 50, and music data may be downloaded from the server device. The downloaded music data is stored in the RAM 43 or the mass storage device 44.

The tone generator 4 connected to the MIDI interface 45 generates musical tones based on performance data (MIDI data) input from the performance controller 3, and applies effects such as echo to the generated musical tones. Give. This tone is output to the amplifier 5. The amplifier 5 amplifies this tone and outputs it to the speaker 6. The speaker 6 emits this musical sound as sound. The sound source device 4 may be configured to form a musical tone waveform by any method, and may be capable of selecting the method according to the type of sound such as a sustained sound or an attenuated sound.

FIG. 7 is a diagram showing the structure of music data stored in the large-capacity storage device 44 of the performance control device 3. As shown in FIG.

FIG. 5A is a diagram showing the structure of music data for playing music of a plurality of parts. It has a plurality of performance data tracks corresponding to a plurality of parts. In the performance data track of each part, event data in which the pitch, volume, and the like of the musical sound to be generated are written, and timing data indicating the read timing of the event data are written in a time series. In the automatic performance control mode, each track (each part) is assigned to a different hand controller. Further, it has a control track on which data specifying the tempo and the like are recorded separately from the track of each part. This track is ignored when each part is played at the tempo specified by the hand controller in the automatic performance control mode.

FIG. 4B is a diagram showing the structure of music data dedicated to the single sound generation mode. This data is composed of a performance track for a handbell, an accompaniment track, and a control track. The performance track is a track on which musical tones to be generated by operating a plurality of hand controllers 1 to which different pitches are assigned are written, and the event data of this track is used only for a performance guide. It is not used for pronunciation. The performance data written in the performance track need not be a single tone sequence, but may be a multiple tone sequence in which a plurality of musical tones are generated simultaneously. The accompaniment track is
In a normal automatic performance track, the event data of this track is transmitted to the tone generator 4. The control track is a track on which tempo setting data and the like are written, and the music data is played at this tempo.

When the tracks have different timbres, the tracks may correspond to different MIDI channels. Alternatively, the music data shown in FIG. 9A may be selected in the monophonic sound mode, and one of the plurality of parts may be used as a handbell track and the other part may be used as an accompaniment track for automatic performance.

Hereinafter, the operation of the tone generation control system will be described with reference to a flowchart. FIG. 8 is a flowchart showing the operation of the hand controller 1. When the power switch 15a is turned on, first, a reset operation such as a chip reset is executed (s1). Next, I
The D number is read (s2). The ID number is set on an ID number setting switch 21 which is a dip switch.
The read ID number is displayed on the 7-segment display 16 for a predetermined time (s3).

Next, an operation mode selection is accepted (s
4). Turning on the single sound generation mode selection switch 15b selects the single sound generation mode, and turning on the automatic performance control mode selection switch 15c selects the automatic performance control mode. Next, when the ENTER switch 15d is turned on,
The mode selected at that time is set, this is edited into mode selection data, and transmitted to the communication unit 2 (s
Together with 5), the set mode is displayed on the 7-segment display 16 (s6). This completes the initial setting operation and shifts to the swing detection operation.

The following swing detection operation is executed every 2.5 ms. From the three-axis acceleration sensor 17, acceleration in the X-axis direction,
The three-axis acceleration of the Y-axis direction acceleration and the Z-axis direction acceleration is detected (s7), and this is edited into the operation data of FIG.
8), and transmits it to the communication unit 2 (s9). And L
The lighting control of the EDs 14a to 14d is performed (s10).

The mode of lighting control of the LEDs 14a to 14d is as follows. When the acceleration in the + direction in the X-axis direction is equal to or more than a certain value, the blue light emitting LED 14a is turned on. X
When the acceleration in the negative axial direction is equal to or more than a predetermined value, the green light emitting LED 14b is turned on. When the acceleration in the + direction in the Y-axis direction is equal to or more than a certain value, the red light emitting LED 14c is turned on. When the acceleration in the-direction in the Y-axis direction is equal to or more than a certain value, the orange LED 14d is turned on. Also,
When the acceleration in the + direction in the Z-axis direction is equal to or more than a certain value, LE
D14a and LED 14b are turned on simultaneously. When the acceleration in the negative direction in the Z-axis direction is equal to or more than a certain value, the LEDs 14c and 14d are simultaneously turned on. In the above-described lighting control, the LEDs 14a to 14d may be lit with a light amount corresponding to the magnitude of the swing acceleration.

The above operation is executed every 2.5 ms,
By detecting accelerations in the X, Y, and Z axes with a resolution of about 2.5 ms, it is possible to detect a user's swing operation with a high resolution while removing fine vibration noise.

FIG. 9 shows a communication unit 2 for receiving operation data and mode selection data from the hand controller 1.
6 is a flowchart showing the operation of the first embodiment. Communication unit 2
Receives the data from the hand controller 1 and performs the performance control device 3 via the USB interface 39.
Communicate with

FIG. 9A is a flowchart showing the operation of the individual communication unit 31 (individual control unit 33). The individual communication unit 31 is a 2.4 GHz band ID switch 3
The frequency assigned to the ID set in 8 is constantly monitored, the signal of this frequency is decoded among the received signals, and the ID at the head of the demodulated data is read. If the ID matches the ID set in the own device (s11), the data is taken in (s12). Then, this data is input to the main control unit 30 (s13).

FIG. 7B is a flowchart showing the operation of the main control unit 30. When data received from the connected individual communication unit 31 is input (s2
0), it is determined whether the data is operation data or mode selection data (s21). If the data is mode selection data, only one individual communication unit 31 is connected. If the data is input from the individual communication unit 31, the individual communication unit 31 is connected as it is. If there is, only when the ID assigned to the input mode selection data is 1 (s22),
This data is output to the performance control device 3 (s23).

On the other hand, if the input data is operation data (s21), it is determined whether or not operation data of all IDs (individual communication units) has been prepared (s24). That is, as shown in FIG. 4, since a plurality of individual communication units 31 are connected to the main control unit 30, all of the individual communication units receive different IDs received from the hand controller 1 for the performance control device 3. Is edited into one packet, which is input to the performance control device 3. When operation data is input from all of the connected individual communication units 31, the operation data is edited into a packet (s25) and input to the performance control device 3 (s2).
6). Since the individual communication unit 31 receives the operation data from the corresponding hand controller 1 every 2.5 ms, the operation data of all IDs is input in a maximum of 2.5 ms, and the operations of s25 and s26 are also performed in 2.5 ms. It is executed every time.

FIGS. 10 to 14 are flowcharts showing the operation of the performance control device 3. FIG. 10 is a flowchart showing the mode setting operation. When the mode selection data is input from the hand controller 1 via the communication unit 2 (s30), it is determined whether the mode selection data is data for selecting the automatic performance control mode or data for selecting the monophonic sound generation mode. (S31). In the case of data for selecting the automatic performance control mode, first, music data as shown in FIG. 7A capable of automatic performance control of a plurality of parts is selected (s32). The music data is read into the RAM 43 (s33), and an automatic performance is performed at a tempo according to the operation of the hand controller 1 corresponding to each track (part) (s34).

On the other hand, in the case of the monophonic sound generation mode, each hand controller receives one or a plurality of pitches and accepts selection of music data for performing like a handbell (s35). In this music selection input, music data having a configuration as shown in FIG. 7B is selected from a plurality of music data stored in the mass storage device 44.
Select song data as shown in (A), and select one of them
Alternatively, a plurality of parts may be selected and input as performance parts for the handbell. The selected music data is read from the large-capacity storage device 44 to the RAM 43 (s3
6) The total pitch included in the performance part is calculated and assigned to each hand controller (s37). This assignment is not limited to one pitch for one hand controller. A plurality of pitches may be assigned to one hand controller.

Then, the process stands by until there is a start instruction from the pointing device 48, the keyboard 47 or the hand controller 1 of ID = 1 (s38). When there is a start instruction, a metronome sound for one measure is generated to indicate the tempo. After that, the performance controller reads out the performance track of the music data, outputs performance guide information to the corresponding hand controller, and sets the hand controller 1
A tone is generated according to the operation data input from the (communication unit 2) (s40). When the accompaniment is performed using the accompaniment track, the automatic performance is performed at the instructed tempo. However, the execution of the accompaniment using the accompaniment track is not essential, and the operation input from the hand controller 1 to the sound source device 4 is performed. Only the pronunciation based on the data may be performed.

FIG. 11 is a flowchart showing an operation for processing operation data input from the hand controller 1 via the communication unit 2. This operation is performed for each hand controller (ID). Here, only one hand controller will be described. When the operation data is input (s50), it is determined whether the current mode is the automatic performance control mode or the single sound generation mode (s51). In the case of the automatic performance control mode, the swing acceleration is detected based on the operation data (s52). The oscillating acceleration is X-axis acceleration and Y-axis acceleration, or
This is an acceleration vector obtained by combining the X-axis direction acceleration, the Y-axis direction acceleration, and the Z-axis direction acceleration. The volume of the corresponding part is controlled according to the magnitude of this vector (s5
3). Then, it is detected whether or not this is a local peak based on the change in the magnitude and direction of this vector (s5).
4). If no local peak is detected, s55
And returns to s50. When a local peak is detected (s55), the swing tempo is calculated according to the interval from the previous (or several past) local peaks (s56), and based on this, the corresponding part (track) is determined. The tempo of the automatic performance is set (s57). The set tempo is used for reading control of track data (automatic performance data) of a corresponding part in an automatic performance processing operation described later.

On the other hand, when the current mode is the monophonic sound generation mode, when the swing data is inputted (s50), the swing acceleration is calculated based on the swing data (s60).
Then, based on this swing acceleration vector, it is detected whether or not it is a local peak (s61). If it is not the local peak, the process returns from s62. On the other hand, when a local peak is detected, the pitch assigned to the hand controller 1 is read (s63). When a plurality of pitches are assigned, the music data is read out in accordance with the progress of the music, and it is only necessary to determine which pitch of the musical tone is to be produced. Then, sound generation data of this pitch is generated (s64). The sound data includes volume information determined based on the pitch information and the swing acceleration. By transmitting the sound data to the tone generator 4, a tone signal is generated.

FIG. 12 is a flowchart showing the automatic performance processing operation. In the automatic performance control mode, this operation is performed for each part at a tempo set by operating the hand controller, and the read event data (sound generation data) is output to the tone generator 4. In the single sound mode, this operation is executed at the tempo written in the control unit. The read event data is not output to the tone generator 4.

First, the timing data is counted by the set tempo clock (s70), and it is determined whether or not it is time to read the next event data (sound generation data) (s71). The reading of s70 is continued until the timing of reading the next event data. However,
In the case of the automatic performance control mode, the tempo of the clock is appropriately changed according to the operation of the hand controller 1.
When the next event data read timing comes, a process corresponding to the event data is executed (s72), the next timing data is read (s73), and the process returns to s70. The event data (sound generation data) correspondence processing is an operation of outputting the event data to the tone generator 4 in the automatic performance control mode, and of the performance data in the single sound generation mode. This is an operation of creating and outputting performance guide information to the hand controller corresponding to the pitch. The performance guide information created at this time may be a content merely for notifying that it is the sounding timing (static text), or may be a content including the volume of the sounding data.

In the above embodiment, only the tempo control and the volume control are described for the tone control by the hand controller 1.
It can control tone color and the like. The control of the sounding timing is, for example, control of detecting a peak point of the swing acceleration and generating a musical sound at the timing of the peak point. The control of the timbre is, for example, control of changing a musical tone to a soft timbre or a hard timbre according to a change rate or a change waveform of the swing acceleration.

FIG. 13 is a flowchart showing the operation of the communication unit 2 and the hand controller 1 when the performance guide information is transmitted.

FIG. 7A is a flowchart showing the data transfer operation of the main control unit 30 of the communication unit 2.
When performance guide information, which is data to be transmitted to the hand controller 1, is input from the performance control device 3 (s8).
0), and transfers this to the corresponding individual communication unit 31 (s81).

FIG. 7B is a flowchart showing the operation of the individual communication unit 31. This operation is an operation executed instead of the operation of FIG. The individual communication unit 31 constantly monitors the frequency assigned to the ID set by the ID switch 38 in the 2.4 GHz band, decodes the signal of this frequency among the received signals, and decodes the demodulated data. Reading the ID at the beginning. If the ID matches the ID set in the own device (s82), the data is fetched (s8).
3). Then, this data is input to the main control unit 30 (s84). Thereafter, it is determined whether data (performance guide information) to be transmitted has been input from the main control unit 30 (s85), and if there is data, the data is transmitted to the hand controller 1 (s86). As described above, by transmitting data at a timing immediately after receiving data from the controller main body 1, data transmission does not collide even if synchronization is not established between the hand controller 1 and the communication unit 2. .

FIG. 9C is a flowchart showing the receiving operation of the hand controller 1. When the FM-modulated performance guide information is transmitted from the communication unit 2, the FM demodulation circuit 27 and the modem 23 demodulate the information and input it to the control unit 20. The control unit 20 takes this in (s8
7), a performance guide operation is executed (s88). As the performance guide operation, an operation of making all the LEDs 14 emit light to notify the sounding timing, an operation of displaying a designated volume value on a 7-segment display, and the like can be applied.

In the automatic performance control mode, it is ideal that all parts perform at the same progress. However, since the tempo control of each part is left to the operation of a different user, the progress of each part is controlled. Some deviation is allowed. However, if the progress of the performance is too different between the parts, it will not be possible to perform as a performance. Therefore, the performance of the performance (the total number of clock counts since the start of the performance) is delayed by more than a predetermined value from the other parts. In the case where there is an advanced part which is advanced as described above, advance / delay control may be performed to stop the performance progress of some parts or to skip the performance and align the performances.

FIG. 14 is a flowchart showing an example of the advance / delay control operation. This operation is executed in parallel with the automatic performance control operation of FIG. First, all clock counts from the start of performance of all parts are compared (s9
0). As a result of the comparison, when there is a delayed part that is delayed by a predetermined value or more compared to the other part (s91), the clock of the other part is stopped (s92). That is, the operation of s70 of FIG. 12 for that part is stopped. Then, it generates and outputs performance guide information to the effect that the hand controller 1 of the delayed part is late (s93).
On the other hand, as a result of the comparison, if there is an advanced part that is ahead of the other part by a predetermined value or more (s94), the clock of this advanced part is stopped (s95). That is, the operation of s70 of FIG. 12 for that part is stopped.
Then, performance guide information to the effect that the player has advanced too much is generated and output to the hand controller 1 of this advance part (s
96). In this operation, if there is a delayed part, the clock of the other part is stopped. However, the performance of the delayed part may be skipped (clock count value is added at a stretch).

In the above-described embodiment, the plurality of hand controllers (operation units) 1 are in charge of different parts. However, one comprehensive operation is performed based on the operation data generated by the plurality of hand controllers 1. Data may be generated, and all parts may be uniformly controlled based on the operation data. In that case, a plurality of operation data input as a packet from the communication unit 2 are averaged to generate one data, and the processing operation of FIG. 11 is performed by one system based on this data. The processing of FIG. 12 is collectively performed for all tracks of the music data.

Instead of averaging the raw operation data, each operation data is processed as shown in FIG. 11 (s53, s5).
7) to calculate the swing acceleration and tempo data for each operating hand controller, average the swing acceleration and the tempo data to determine the total swing acceleration and the total tempo data, and The processing of FIG. 12 may be collectively performed for all tracks by controlling the volume and setting the tempo.

Further, the plurality of hand controllers 1
When comprehensive data is calculated based on the operation data of the above and the music data is controlled collectively, other than a method of averaging the operation data (or swing acceleration, tempo data) input from a plurality of hand controllers 1 and calculating the total data , Excluding the operation data with the maximum / minimum value, averaging the remaining operation data, extracting the median operation data, extracting the maximum operation data, extracting the minimum operation data,
Such a method can be adopted.

In the automatic performance control mode, one hand controller 1 and one part correspond one-to-one in the above embodiment, but the correspondence is not limited to one-to-one and one hand controller 1 May be assigned to a plurality of tracks, or one part may be controlled by a plurality of hand controllers.

When one track is controlled by a plurality of hand controllers, total data for each part is determined based on operation data input from each hand controller, and based on this, the corresponding part (track of music data) is determined. To control the performance of.

In the above-described embodiment, all the musical tones of a plurality of parts (a plurality of timbres) are generated by one sound source device 4. ) May be connected, and individual sound sources (instruments) may be assigned to (all or part of) each part. FIG. 15 shows an example in which a normal tone generator 4, a tone generator 60 for an electronic wind instrument, and an electromagnetically driven piano 61 are connected to the performance controller 3. Then, the sound source device 4 and the electronic wind instrument sound source device 60 are respectively assigned to a plurality of parts, and the electromagnetically driven piano 61 is assigned only to the piano part. For example, as the sound source device 4, a fundamental wave combining type F
An M sound source, a PCM sound source that processes a PCM waveform and synthesizes a musical tone, or the like is applied. Also, as the electronic wind instrument sound source device 60, a physical model sound source or the like in which an actual wind instrument is simulated by software with a processor is applied. The electromagnetically driven piano 61 is a piano in which a solenoid is connected to each hammer, and is a natural musical instrument that can drive the solenoid with performance data such as MIDI data. As described above, the sound source that can be connected to the performance control device 3 is not limited to an electronic sound source, and a sound source device that generates an electrically driven natural musical sound can be connected. By connecting a plurality of sound sources having different sounding forms in this way, an ensemble-like ensemble can be obtained both audibly and visually.

Further, in the above-described embodiment, the hand controller 1 is used as the operation unit that the user holds and swings with the hand, but the operation unit is not limited to the hand controller. For example, it is possible to incorporate an acceleration sensor into a singing microphone so that singing and automatic performance control can be performed together. If this microphone with a built-in hand controller is applied to a karaoke apparatus, a singer can control the karaoke song while singing. Further, the operation unit is not limited to the one that performs the swing operation, and it is also possible to use a tap switch that detects the intensity of pressing by the finger. This tap switch
It can be constituted by a piezoelectric sensor or the like.

As shown in FIG. 16, a shoe is used as an operation unit 50, and a three-axis acceleration sensor 51 is embedded in the heel of the shoe, and a kick operation for moving the foot back and forth, a waving motion, and a stepping motion for moving up and down are performed. Detection may be performed, and the tone generation may be controlled based on the detection.

Further, as shown in the upper part of FIG. 17, a fingertip operation unit 52 having a three-axis acceleration sensor 53 is attached to the fingertip of the user to detect the three-dimensional movement of the finger and control the generation of musical sounds. You can also. In this case, by attaching a separate sensor to each finger, it is possible to control a different musical tone for each finger.

By attaching a wrist operation unit 54 having a three-dimensional acceleration sensor 55 and a pulse sensor 56 to the wrist as shown in the lower part of the figure, the pulse can be detected in addition to the swing of the arm. In this case, by attaching wrist operators to both wrists, it is also possible to control two musical sounds with both arms.

Also, a plurality of sensors are attached to the user's arms, legs, torso, etc., and a plurality of operation data corresponding to the movement and posture of the body are output, thereby controlling the performance of a plurality of parts.
It is also possible to control the pronunciation of a plurality of pitches. FIG.
FIG. 19 shows an embodiment in which an acceleration sensor is provided in each part of the body. FIG. 18 is a diagram showing a user wearing the operation unit. The operation unit has a plurality of sensors 71 embedded in upper and lower clothes, a control box 70 attached to the belt, and LEDs 72 attached to the upper and lower clothes and the belt. As the sensor, an acceleration sensor, an impact sensor, or the like can be applied.

Hereinafter, a case where an acceleration sensor is applied as the sensor 71 will be described. The acceleration sensor 71 is provided on the left and right arms, chest, waist, thighs, legs, etc. of the clothes,
Detecting the swing mode of the arm, leg, upper body, etc. Each acceleration sensor 71 is connected to the control box 70. The control box 70 has a built-in control unit 73 which is a microcomputer, and transmits a detection value (acceleration) of each acceleration sensor 71 to the communication unit as operation data.

FIG. 19A is a block diagram of this operation unit. The control unit 73 is connected to the plurality of acceleration sensors 71, a switch group 74, a transmitting unit 75, and an LED lighting circuit 76. The switch group 74 is a switch for setting an operation mode and the like as in the first embodiment. In this operation unit, an ID number is assigned to each of the plurality of acceleration sensors 71 in advance, and the acceleration detected by each acceleration sensor 71 is assigned an ID of each acceleration sensor as shown in FIG. Is transmitted to the communication unit 2 as a series of operation data. Transmission unit 75
Includes the modem 23, the modulation circuit 24, the transmission output amplifier 25, and the antenna 18 of FIG.
The signal is modulated and transmitted as a 2.4 GHz band signal. Also,
The LED lighting circuit 76 is provided at each part of the body (clothes) according to the acceleration detected by each acceleration sensor 71.
The lighting of is controlled.

By providing such an operation unit, a single person can control the performance of music of a plurality of parts, and if one person exercises in various modes, the musical tones of a plurality of pitches can be produced in accordance with the movement. Or be able to do so.

In the above embodiment, an example in which an acceleration sensor is used as the sensor 71 has been described. However, an impact sensor may be used as the sensor 71. In this case, the user may hit or touch the sensor. Thus, the operation mode can be detected and the musical sound can be controlled.

In the above embodiment, the user controls the performance based on the operation of swinging the hand controller 1. However, the user may control the performance based on the static posture of the user. Good.

In the case of performing a ensemble like a handbell in the monophonic sound generation mode, in the above embodiment,
Although a tone generator is connected to the performance control device 3 to generate musical tones, a tone generator may be built in the operation unit so that the operation unit itself generates musical tones. In this case, only the receiving function is provided in the operation unit 1,
The communication unit 2 may be provided with only the transmission function.

In the above-described embodiment, the performance data controlled in the automatic performance control mode is used only for inputting to the tone generator 4 to generate sound. However, a performance data recording means is provided, and the operation unit is used. The operated performance data may be recorded. Then, the recorded performance data may be read out again as automatic performance data and set as an object of the automatic performance control mode.

In this case, the automatic performance data of a plurality of parts is automatically played, and the performance elements of some parts are controlled by one or a plurality of operation units, and the performance elements including the performance elements are recorded as the automatic performance data. Then, it is possible to automatically perform the performance again and control the performance elements of the remaining parts.

Further, in this case, in one automatic performance, some performance elements such as tempo are controlled, and in the next automatic performance, other performance elements such as volume are controlled, and a plurality of automatic performances are controlled. It is also possible to control all desired performance elements in the performance.

[0086]

As described above, according to the present invention, it is possible to control some performance elements such as the tempo and volume of music performance based on the exercise mode and posture state of a plurality of users. It is possible to perform ensemble performances with easy operation,
It becomes possible to reduce the threshold of music performance.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of a sound generation control system according to an embodiment of the present invention;

FIG. 2 is an external view of a hand controller which is an operation unit of the sound generation control system.

FIG. 3 is a block diagram of a hand controller.

FIG. 4 is a block diagram of a communication unit.

FIG. 5 is a block diagram of a personal computer.

FIG. 6 is a diagram showing a format of data sent from the hand controller to the communication unit.

FIG. 7 is a diagram showing a configuration of automatic performance data.

FIG. 8 is a flowchart showing the operation of the hand controller.

FIG. 9 is a flowchart showing the operation of the communication unit.

FIG. 10 is a flowchart showing the operation of the personal computer.

FIG. 11 is a flowchart showing the operation of the personal computer.

FIG. 12 is a flowchart showing the operation of the personal computer.

FIG. 13 is a flowchart showing an operation of transmitting and receiving performance guide information.

FIG. 14 is a flowchart showing the advance / delay control operation of the personal computer.

FIG. 15 is a diagram showing another embodiment of the sound generation control system according to the embodiment of the present invention;

FIG. 16 is a diagram showing another mode of the operation unit.

FIG. 17 is a diagram showing another mode of the operation unit.

FIG. 18 is a diagram showing another mode of the operation unit.

FIG. 19 is a block diagram of the operation unit.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Hand controller (operation unit), 2 ... Communication unit, 3 ... Performance control device (personal computer), 4 ... Sound source device, 14a-14d ... LED, 15a
~ 15d ... switch group, 16 ... 7 segment display, 1
7 ... 3-axis acceleration sensor, 22 ... LED lighting circuit, 23 ...
Modem, 24 ... Modulation circuit, 25 ... Transmission output amplifier, 26
... Receiving circuit, 30 ... Main control unit, 31 ... Individual communication unit

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5D378 HA04 KK13 MM54 MM64 MM65 QQ01 QQ25 QQ27 SC01 SC06 SC07 SC09 SF02 SF09 SF15 SF16 SF17 SF18 SF19 XX24 XX25

Claims (9)

[Claims] 1. A plurality of operation units each comprising: sensor means for detecting a movement mode or a posture state of a body; and transmission means for transmitting the detection content of the sensor means as operation data; A control device comprising performance control means for automatically playing a music piece based on the automatic performance data including, and controlling performance elements such as a tempo and a volume of the automatic performance based on operation data received from the plurality of operation units, A pronunciation control system having: 2. The performance control means performs an automatic performance on the basis of automatic performance data of a plurality of parts, and converts performance elements of some or all of the plurality of parts into operation data received from different operation units. The sound generation control system according to claim 1, wherein the control is performed based on the sound generation. 3. The performance control unit according to claim 1, wherein the performance control unit controls the performance element of the automatic performance using one piece of general operation data determined based on a plurality of operation data received from the plurality of operation units. Sound control system. 4. The sound generation control system according to claim 1, further comprising recording means for recording automatic performance data in which performance elements are controlled based on operation data. 5. The sound generation control system according to claim 4, wherein said performance control means automatically performs a musical piece based on the automatic performance data recorded by said recording means. 6. A plurality of operation units each comprising: sensor means for detecting a movement mode or a posture state of a body; and transmission means for transmitting the detection content of the sensor means as operation data. A sound control system comprising: sound control means for allocating musical tones of different pitches respectively and controlling the generation of musical tones of corresponding pitches based on operation data received from each operation unit. 7. The sounding control means reads out automatic performance data including the pitch and sounding timing of each note of the music at a predetermined tempo, and generates performance guide information for instructing the pitch and sounding timing of each note. The sound generation control system according to claim 4. 8. The plurality of operation units include a plurality of sensor units attached to each part of one body, and the transmission unit transmits detection contents of each sensor unit as individual operation data. The sound control system according to any one of claims 1 to 7. 9. The sound control system according to claim 8, wherein the plurality of sensor means are impact sensors attached to a user's upper arm, chest, thigh, and the like.