JP6111526B2 - Music generator - Google Patents

Description

  The present invention relates to a musical sound generator.

2. Description of the Related Art Conventionally, there has been proposed a musical sound generator (performance device) that generates an electronic sound (musical sound) corresponding to a performance operation when a performance operation of a performer (user) is detected. For example, a device (air drum) that emits a percussion instrument sound when a performer performs an operation of swinging a rod-like member corresponding to a stick of a percussion instrument is known (see, for example, Patent Document 1 and Patent Document 2). In such a device, a sensor is provided on a rod-shaped member, and when a player holds and shakes the member by hand, the sensor detects the operation and generates a percussion instrument sound corresponding to the detection result. It is configured.
For example, an actual musical instrument such as a percussion instrument is heavy and requires a large space for installation, so that it is difficult to easily perform and practice at home.
In this regard, according to the musical sound generating device that detects the performance operation of the performer and generates a musical sound according to this, the musical sound of the musical instrument can be generated without the need for an actual musical instrument. You can easily enjoy the performance without any restrictions on the performance space.

JP-A-63-191195 JP 2011-252994 A

However, for example, if it is an actual drum, it is composed of 10 or more parts, and many instruments are played simultaneously, such as playing a snare drum and a hi-hat at the same time while playing a bass drum by foot operation. . On the other hand, in the musical sound generating device that generates the electronic sound described in Patent Literature 1 and Patent Literature 2 and the like, the player can selectively play so many instrument sounds due to the problem of sensor accuracy. Difficult to do.
For example, the performance area in front of the performer is divided into 3 to 4 in the horizontal direction, and the sound of the musical instrument assigned to each performance area is detected by detecting in which area the performance operation is performed. The number of musical instruments that can be played is limited to 3-4.
For this reason, there is a problem that the expressive power of music is greatly inferior to that of an actual musical instrument.

In addition, in such a musical sound generating device that emits electronic sounds, a performance is performed only by the movement of an operator such as a rod-shaped member held in the hand. Even what is to be operated must be expressed by hand.
For this reason, there is a problem that the performer's performance operation is uncomfortable, and there are problems that the number of musical instruments that can be played is further reduced by assigning a few movements of both hands to an instrument that is normally operated with feet.
For example, when playing different instruments by dividing the performance area in front of the performer into three in the horizontal direction and dividing the performance area as described above, one of these is an actual instrument such as a bass drum. Then, if it is assigned to the one operated with the foot, only the remaining two instruments can be played.

  The present invention has been made in view of the above circumstances, and when performing a virtual musical instrument, a performance area is assigned to as many musical instruments as possible so that many musical instruments can be played simultaneously. Therefore, an object of the present invention is to provide a musical sound generating device capable of improving the expressiveness of a musical instrument.

In order to solve the above-described problem, the musical sound generating device of the present invention includes:
Movement detection means for detecting the movement of the performance operator;
Operation determination for determining whether the movement of the performance operator detected by the movement detection means is a performance operation by a performer or a pattern recording operation for recording a loop pattern for loop performance by the performer. Means,
If the loop pattern for the loop performance is judged to be pattern recording operation for recording by said operation determination means, corresponding to the movement of the performance operator, which is detected by the motion detecting means from said being determined Pattern storage control means for storing the loop pattern for loop performance in the storage means;
When the loop pattern for the loop performance is stored in the storage means, the sound for controlling the sound based on the movement of the performance operator and the sound based on the loop pattern for the loop performance to be generated from the sound generation means Control means;
It is characterized by having.

  According to the present invention, when performing a virtual musical instrument performance, the performance area can be assigned to as many musical instruments as possible and many musical instruments can be performed simultaneously, so that the expressive power of the musical instrument can be improved. There is an effect.

(A) is a figure which shows the outline | summary of one Embodiment of the musical sound generator based on this invention, (B) is the figure which showed the virtual drum set in this embodiment. It is a block diagram which shows the function structure of a musical sound generator. It is a perspective view of the stick part shown in FIG. It is a figure showing the change of the acceleration of the vertical direction of a motion sensor part. It is a figure which shows the structural example of a loop pattern memory | storage part. It is explanatory drawing explaining the input operation of a loop pattern. It is explanatory drawing which shows an example of the loop pattern in the case of performing a bass drum on a loop. It is a flowchart which shows a loop pattern recording process. It is a flowchart which shows a loop performance process.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. The embodiments described below are given various technically preferable limitations for carrying out the present invention, but the scope of the present invention is not limited to the following embodiments and illustrated examples.

[Outline of musical tone generator]
First, with reference to FIG. 1 (A) and FIG. 1 (B), the whole structure of one Embodiment of the musical sound generator based on this invention is demonstrated.
FIG. 1A is a diagram showing an outline of a device configuration of a musical sound generating device according to the present embodiment.
As shown in FIG. 1A, the musical sound generating device 1 of the present embodiment is configured to include stick units 10A and 10B and a center unit unit 20. In addition, in order to implement | achieve the virtual drum performance using two sticks, the musical tone generator 1 of this embodiment shall be provided with two stick parts 10A and 10B, However, the number of stick parts is this. The number is not limited, and may be one or three or more. Hereinafter, when the stick portions 10A and 10B are not distinguished from each other, they are collectively referred to as “stick portion 10”.

The stick unit 10 includes a rod-like performance operator main body extending in the longitudinal direction, and functions as a performance operator that can be held by the performer. That is, a performer performs a performance operation by holding one end (base side) of the stick unit 10 in his / her hand and performing a swing-up / down operation centering on the wrist or the like.
In order to detect such a player's performance operation, in this embodiment, the other end (front end side) of the stick unit 10 is provided with various sensors such as an acceleration sensor (a motion sensor unit 14 described later, see FIG. 2). It has been.
The stick unit 10 generates a sound generation instruction signal (sound generation sound signal) from a sound output unit 251 such as a speaker as a sound generation unit according to detection results of various sensors (motion sensor unit 14 described later) from the stick unit 10. Note on event) is generated and output to the center unit 20.

  When the center unit unit 20 receives a sound generation instruction signal (note-on event) from the stick unit 10, it determines whether this is a normal performance operation or a pattern recording operation for recording a loop pattern for loop performance, In the former case, a musical sound is generated from the sound output unit 251 such as a speaker based on a sound generation instruction signal (note-on event). In the latter case, the loop pattern for the loop performance is obtained based on the signal from the stick unit 10 and stored in a storage means such as a ROM (not shown), and then the normal performance is started. In addition, the musical sound based on the loop pattern for loop performance is generated together with the normal performance.

[Configuration of Musical Sound Generation Device 1]
Hereinafter, the tone generator 1 according to the present embodiment will be specifically described.
FIG. 2 is a block diagram showing a functional configuration of the musical tone generator 1.
First, with reference to FIG. 2, the structure of the stick part 10 and the center unit part 20 which comprise the musical sound generator 1 in this embodiment is demonstrated in detail.

[Configuration of Stick Unit 10]
As shown in FIG. 2, each stick unit 10 (stick units 10A and 10B in FIG. 2) includes a stick control unit 11, a motion sensor unit 14, a data communication unit 16, a power supply circuit 17, a battery 18, and the like. ing.

The motion sensor unit 14 is a motion detection unit that detects the movement of the main body of the stick unit 10 (performance operator) generated by the player's operation.
That is, the motion sensor unit 14 is provided in the stick unit 10, for example, and is a variety of sensors for detecting the state of the stick unit 10 (for example, swinging position, swinging speed, swinging angle, etc.) The sensor unit 14 outputs a predetermined sensor value (motion sensor data) as a detection result. A detection result (motion sensor data) detected by the motion sensor unit 14 is sent to the stick control unit 11.
Here, as a sensor which comprises the motion sensor part 14, an acceleration sensor, an angular velocity sensor, a magnetic sensor, etc. can be used, for example.

As the acceleration sensor, a biaxial sensor that outputs acceleration generated in each of two axial directions of the X axis, the Y axis, and the Z axis can be used. As for the X axis, Y axis, and Z axis, as shown in FIG. 2, the axis that coincides with the longitudinal axis of the stick 10 is defined as the Y axis, and a substrate (not shown) on which an acceleration sensor is arranged. An axis that is parallel and orthogonal to the Y-axis can be an X-axis, and an axis that is orthogonal to the X-axis and the Y-axis can be a Z-axis. The acceleration sensor may acquire the acceleration of each component of the X axis, the Y axis, and the Z axis, and may calculate a sensor composite value obtained by combining the respective accelerations.
In the present embodiment, when performing using the musical tone generator 1, the performer holds one end (the base side) of the stick unit 10 and the other end (the tip side) of the stick unit 10 around the wrist or the like. By performing a swing-up and swing-down operation that moves up and down, the stick unit 10 is caused to rotate. Here, when the stick unit 10 is stationary, the acceleration sensor calculates a value corresponding to the gravitational acceleration 1G as a sensor composite value, and when the stick unit 10 is rotating, the acceleration sensor. Calculates a value larger than the gravitational acceleration 1G as a sensor composite value. The sensor composite value is obtained, for example, by calculating the square root of the sum of the squares of the accelerations of the X-axis, Y-axis, and Z-axis components.

Moreover, as an angular velocity sensor, the sensor provided with the gyroscope, for example can be used. In the present embodiment, as shown in FIG. 2, the angular velocity sensor outputs a rotation angle 501 of the stick unit 10 in the Y-axis direction and a rotation angle 511 of the stick unit 10 in the X-axis direction.
Here, the rotation angle 501 in the Y-axis direction can be referred to as a roll angle because it is the rotation angle of the front-rear axis viewed from the player when the player holds the stick unit 10. The roll angle corresponds to an angle 502 indicating how much the XY plane is tilted with respect to the X axis, and the player holds the stick unit 10 in his hand and rotates it left and right around the wrist. Caused by.
Further, the rotation angle 511 in the X-axis direction can be referred to as a pitch angle since it is the left-right rotation angle viewed from the player when the player holds the stick unit 10. The pitch angle corresponds to an angle 512 indicating how much the XY plane is tilted with respect to the Y axis, and is generated when the player holds the stick unit 10 in his / her hand and swings his / her wrist up and down.
Although not shown, the angular velocity sensor may also output the rotation angle in the Z-axis direction. At this time, the rotation angle in the Z-axis direction has basically the same property as the rotation angle 511 in the X-axis direction, and is generated when the player holds the stick unit 10 in his hand and swings his wrist in the left-right direction. The pitch angle.

  As the magnetic sensor, a sensor capable of outputting magnetic sensor values in the biaxial directions of the X axis, the Y axis, and the Z axis shown in FIG. 2 can be used. From such a magnetic sensor, a vector indicating north (magnetic north) by a magnet is output in each of the X-axis direction, the Y-axis direction, and the Z-axis direction. Since the components in the respective axial directions that are output differ depending on the posture (orientation) of the stick unit 10, the stick control unit 11 determines the roll angle of the stick unit 10 and the rotation angles in the X-axis direction and the Z-axis direction from these components. Can be calculated.

Here, the detection result (motion sensor data) detected by the motion sensor unit 14 will be described with reference to FIG. Here, a detection result by an acceleration sensor among the various sensors is shown.
When the performer performs using the stick unit 10, generally, the same operation as the operation of hitting an actual musical instrument (for example, drum) is performed. In such a (performance) operation, the performer first raises the stick unit 10 and then swings it down toward the virtual musical instrument's strike surface (performance surface). Since the hitting surface does not actually exist, the performer exerts a force to stop the operation of the stick unit 10 immediately before hitting the stick unit 10 against a virtual musical instrument.
FIG. 4 is a diagram showing a change in acceleration in the vertical direction of the motion sensor unit 14 when a performance operation is performed using such a stick unit 10, and is transmitted from the stick unit 10 to the center unit unit 20. It shows an example of motion sensor data.
The vertical acceleration means the acceleration in the vertical direction with respect to the horizontal plane, and may be calculated by decomposing from the acceleration of the Y-axis component. The acceleration in the Z-axis direction (acceleration in the X-axis direction depending on the roll angle) It is good also as decomposing and calculating from. In FIG. 4, a negative acceleration indicates a downward acceleration applied to the stick unit 10, and a positive acceleration indicates an upward acceleration applied to the stick unit 10.

Even when the stick unit 10 is stationary (portion indicated by “a” in FIG. 4), since the gravitational acceleration is applied to the stick unit 10, the motion of the stick unit 10 is stationary against the gravitational acceleration. The sensor unit 14 detects a constant acceleration in the vertically downward direction, that is, in the minus direction. It should be noted that the acceleration applied to the stick unit 10 is zero when the stick unit 10 is in a free fall state.
Next, when the player raises the stick unit 10 in association with the swing-up operation in a state where the stick unit 10 is stationary as in the section indicated by b in FIG. 4, the player moves in a direction more against gravity acceleration. As a result, the acceleration applied to the stick portion 10 increases in the negative direction. Thereafter, when the lifting speed is decreased in order to make it stand still, the acceleration changes from the minus direction to the plus direction, and the acceleration at the time when the swing-up operation reaches the highest speed (see p1 in FIG. 4) is only the gravitational acceleration ( That is, the gravitational acceleration is 1G).

Next, as in the section indicated by c in FIG. 4, when the stick unit 10 reaches the apex by the swing-up operation, the performer performs the swing-down operation of the stick unit 10. In the swing-down operation, the stick unit 10 moves in a direction according to the gravitational acceleration, so that the acceleration applied to the stick unit 10 increases in a plus direction with respect to the gravitational acceleration. Thereafter, when the swing-down operation reaches the highest speed, only the gravitational acceleration (that is, the gravitational acceleration 1G) is again applied to the stick portion 10 (see p2 in FIG. 4).
Thereafter, when the swing-up operation is performed again with respect to the stick unit 10 as in the section indicated by d in FIG. 4, the applied acceleration increases in the negative direction. When the swing-up operation is attempted to be stopped, the applied acceleration is in the negative direction. Turn to the plus direction.
While the performance operation continues, the change in acceleration as shown in FIG. 4 is repeated according to the player swinging up and down the stick unit 10, and this change in acceleration is detected by the motion sensor unit 14.

The stick control unit 11 is composed of, for example, an MCU (Micro Control Unit) or the like, and a CPU (Central Processing Unit), a memory such as a ROM (Read Only Memory), a timer as a timing unit, and the like are included in one integrated circuit. It is built in.
The memory of the stick control unit 11 stores processing programs for various processes executed by the stick control unit 11.
The stick control unit 11 performs control of the entire stick unit 10. Various functions of the stick control unit 11 are realized by the cooperation of the CPU and a program stored in the memory.
In the present embodiment, the stick control unit 11 includes a sound generation instruction generation unit 111 that generates a sound generation instruction signal (note-on event) based on the detection result acquired by the motion sensor unit 14.

The sound generation instruction generation unit 111 performs the operation of the stick unit 10 (performance operator) detected by the motion sensor unit 14 that is a detection unit each time a performance operation is performed by the performer using the stick unit 10 (performance operator). A sound generation instruction signal (note-on event) is generated corresponding to the detection result (motion sensor data) related to the position and movement.
Here, the note-on event (sound generation instruction signal) includes information such as shot timing (sound generation timing), volume, tone color (that is, instrument type), and the like.
The sound generation instruction signal (note on event) generated by the sound generation instruction generation unit 111 is output to the center unit unit 20, and the main body control unit 21 of the center unit unit 20 receives the sound generation instruction signal (note on event). Based on this, a sound is generated from the sound output unit 251 such as a speaker.

  Specifically, first, when a detection result (motion sensor data) regarding the position and movement of the stick unit 10 (performance operator) detected by the motion sensor unit 14 is acquired, the sound generation instruction generation unit 111 receives the acceleration sensor. Based on the acceleration (or sensor composite value) output from the virtual instrument, the timing of hitting the virtual instrument by the stick unit 10 (shot timing) is detected.

Here, the detection of shot timing by the sound generation instruction generation unit 111 will be described with reference to FIG.
As described above, FIG. 4 is a diagram illustrating a change in acceleration in the vertical direction of the motion sensor unit 14 when a performance operation is performed using the stick unit 10.
Since the performer assumes that the musical sound is generated at the moment when the stick unit 10 is struck on the virtual musical instrument, it is desirable that the musical sound generating device 1 can generate the musical sound at the timing assumed by the performer. . Therefore, in the present embodiment, the musical sound is generated at the moment when the player strikes the stick portion on the virtual musical instrument hitting surface or slightly in front of it.

That is, in the present embodiment, the sound generation instruction generation unit 111 is the moment when the player performs the swing-down operation and then the swing-up operation is started as the moment when the player strikes the stick unit 10 on the virtual musical instrument hitting surface. Is detected. That is, the sound generation instruction generation unit 111 further reduces the predetermined value in the minus direction from the stationary state in the section indicated by d in FIG. 4, in other words, from the time when the applied acceleration is only the gravitational acceleration (see p <b> 2 in FIG. 4). The increased point A is detected as shot timing (sound generation timing).
Then, the sound generation instruction generation unit 111 generates a note-on event (a sound generation instruction signal) so as to perform sound generation when this shot timing is detected.

  Further, the sound generation instruction generation unit 111 performs a swing-down operation of the stick unit 10 (performance operator) by the performer based on the detection result (motion sensor data) regarding the movement of the stick unit 10 detected by the motion sensor unit 14. The speed and strength, the position and angle where the stick unit 10 is swung down are detected. Specifically, for example, it is determined which of the three performance areas ar1 to ar3 is the position where the stick unit 10 is swung down from the detection result of the magnetic sensor, etc. The strength of impact is determined from the acceleration at the time of lowering.

In the present embodiment, the storage unit such as a ROM (not shown) of the stick control unit 11 is associated with the performance area identified by the motion sensor unit 14 and the position coordinates of the virtual drum set D (see FIG. 1B). I remember the data.
The number of performance areas that can be identified by the motion sensor unit 14 and the number and type of musical instruments associated therewith are not particularly limited. However, in this embodiment, as shown in FIG. The performance areas ar1 to ar3 (see FIG. 1A) are set. Then, for example, a virtual drum set D (FIG. 1) assumed in this embodiment, such as “hi-hat” in the performance area ar1, “snare drum” in the performance area ar2, and “floor tom” in the performance area ar3. Percussion instruments constituting (B) are stored in storage means such as a ROM in association with the position coordinates of the performance areas ar1 to ar3 (see FIG. 1A) in the space of each instrument.
Then, the sound generation instruction generation unit 111 is based on the position coordinate data of the virtual drum set D and the position coordinate data specified from the detection result by the motion sensor unit 14 (for example, the direction detected by the geomagnetic sensor or the like). In addition to specifying the musical instrument struck by the stick unit 10, it is determined how fast, how strong, and at what timing the musical instrument is struck, and based on the determination result, a predetermined musical sound is A sound generation instruction signal (note-on event) is generated to instruct the sound to be generated at a predetermined shot timing at a volume corresponding to the speed and strength of the hit. The sound generation instruction signal (note-on event) generated by the sound generation instruction generation unit 111 is output to the center unit unit 20 in association with identification information (stick identification information) that can distinguish the stick units 10A and 10B. .
In addition, the kind of musical instrument matched with each performance area ar1-ar3 is not limited to the said example. A performer or the like may be able to change and set the types of musical instruments associated with the performance areas ar1 to ar3 afterwards.

  Returning to FIG. 2, the data communication unit 16 performs predetermined wireless communication with at least the center unit unit 20. The predetermined wireless communication may be performed by any method, and in the present embodiment, wireless communication is performed with the center unit unit 20 by infrared communication. Note that the communication method by the data communication unit 16 is not limited to wireless communication. For example, the stick unit 10 and the center unit unit 20 may be connected by a cable, and the data communication unit 16 may perform wired communication.

Further, the stick unit 10 includes a battery 18, and the battery 18 supplies power to each operation unit of the stick unit 10 via the power supply circuit 17.
The battery 18 may be a primary battery or a rechargeable secondary battery. In addition, it is not essential that the battery 18 is built in, and a configuration may be adopted in which power is supplied from the outside via a cable or the like.

[Configuration of Center Unit 20]
Next, as shown in FIG. 2, the center unit unit 20 includes a main body control unit 21, a sound source data storage unit 22, a loop pattern storage unit 23, an operation unit 24, an audio circuit 25, an audio output unit 251, and a data communication unit 26. , A power supply circuit 27, a battery 28, and the like.

  The sound source data storage unit 22 is a virtual drum set D (see FIG. 5) assumed in the present embodiment, such as waveform data of various timbres (namely, sound source data of each instrument), such as bass drum, hi-hat, snare drum, floor tom, and cymbal. 1 (B)) is stored. Of these, the bass drum stores loop sound data for loop performance. In this embodiment, the tone waveform data stored in the sound source data storage unit 22 is not limited to these percussion instruments. For example, wind instruments such as flute, saxophone, and trumpet, keyboard instruments such as piano, and stringed instruments such as guitar. Timbre waveform data may be stored in the sound source data storage unit 22.

The loop pattern storage unit 23 stores loop pattern data generated by a main body control unit 21 described later. FIG. 5 is a diagram illustrating a data configuration example of the loop pattern storage unit 23.
As shown in FIG. 5, the loop pattern storage unit 23 records “Note Number” for specifying one musical tone, “sounding intensity” of each musical tone, and loop pattern data of the first tone. Thereafter, the “elapsed time” is stored in association with each other.
In the present embodiment, loop pattern data of up to 16 sounds can be recorded. FIG. 5 shows that six tones (Note 1 to Note 6 of “Note Number”) are recorded.

The main body control unit 21 is composed of, for example, an MCU (Micro Control Unit) or the like, and a memory such as a CPU (Central Processing Unit) and ROM (Read Only Memory), a timer as a time measuring means, and the like are integrated into one integrated circuit. It is built in.
The main body control unit 21 executes control of the entire center unit unit 20. Various functions of the main body control unit 21 are realized by the cooperation of the CPU and a program stored in the memory.
The memory of the main body control unit 21 stores processing programs for various processes executed by the main body control unit 21. The memory stores identification information (stick identification information) for distinguishing the stick portions 10A and 10B from each other, and the main body control unit 21 attaches to the information sent from the stick portions 10A and 10B. By comparing the stick identification information stored in the memory with the stick identification information stored in the memory, the stick units 10A and 10B that are the information transmission sources can be specified.

Further, in the present embodiment, the main body control unit 21 records a loop pattern for loop performance based on the motion detected by the motion sensor unit 14 which is motion detection means, whether the player's operation is a performance operation. It functions as operation determination means for determining whether the operation is for pattern recording.
Specifically, when the main body control unit 21 receives a sound generation instruction signal generated according to the movement detected by the motion sensor unit 14 from the stick unit 10, the sound generation instruction signal is received from the two stick units 10A and 10B. It is determined whether or not they are sent simultaneously. When the sound generation instruction signal is simultaneously sent from the two stick portions 10A and 10B, that is, when the player performs the operation of swinging down the stick portions 10A and 10B held in the left and right hands at the same time, the main body control unit 21 Determines that the operation by the performer is a pattern recording operation for recording a loop pattern for loop performance. In a normal performance, the performer operates the stick units 10A and 10B held on the left and right hands separately to strike a hi-hat, a snare drum, etc., so that both the stick units 10 are simultaneously operated as a performance operation. It cannot be assumed to operate. Therefore, when the two stick portions 10A and 10B are simultaneously swung down, it can be determined that the operation is a pattern recording operation for recording a loop pattern for loop performance, which is distinguished from a normal performance operation.
In the present embodiment, the main body control unit 21 sets the timing at which the two stick portions 10A and 10B are simultaneously swung down as the start of the loop pattern, and there is a swing motion of only one of the left and right stick portions 10A and 10B. Sometimes the timing ends, or when there is no swing motion from any stick unit 10 for a predetermined period or more, the loop pattern ends when a predetermined time elapses.

In addition, the main body control unit 21 serves as an operation determination unit, and when it is determined that the operation by the performer is a pattern recording operation, the stick unit that is a performance operator detected by the motion sensor unit 14 that is a motion detection unit It functions as a pattern storage control means for storing a loop pattern for loop performance based on the movement of the main body 10 in the loop pattern storage unit 23 which is a storage means.
Then, as shown in FIG. 5, the main body control unit 21 as the pattern storage control means stores a “Note Number” for specifying one musical tone in the loop pattern storage unit 23 and “ The “sounding intensity” and the “elapsed time” after recording the loop pattern data of the first sound are stored in association with each other. For example, in the example shown in FIG. 5, in the case of a musical note “Note 1”, the “sounding intensity” is “120”, and the “elapsed time” after the loop pattern data of the first sound is recorded is “120”. 0 ". In the case of the musical note “Note 3”, “sounding intensity” is “100”, and “elapsed time” after recording the loop pattern data of the first sound is “400”. Since the sixth note "Note 6" is only meant to indicate the end of the loop pattern data, the "sounding intensity" is "0" and the "elapsed time" is "800". is there.

FIG. 6 is an explanatory diagram for explaining a loop pattern input operation.
In the present embodiment, when only one of the stick parts 10A and 10B held by the left and right hands of the performer is operated (in FIG. 6, the stick part 10B held by the left hand), The signal from the stick unit 10B is regarded as a noise signal, and the loop pattern is not recorded.
When sound generation instruction signals are simultaneously sent from both the stick units 10A and 10B held by the left and right hands of the performer (portion surrounded by a one-dot chain line in FIG. 6), it is determined that the loop pattern starts. The main body control unit 21 serving as the pattern storage control means specifies the musical tone by using the sound generation intensity and the elapsed time from the start of the loop included in this signal (elapsed time 0 for the first sound of the loop pattern). Recorded in the loop pattern storage unit 23 together with “Number”. Note that the tone intensity in this case is set by taking the average value of the signals transmitted from the left and right stick units 10A and 10B. Note that the sound intensity is not limited to the average value, and for example, the sound intensity of the musical tone in the loop pattern may be set to the one with the stronger sound intensity of the left and right stick portions 10A and 10B.
When a signal is sent from only one of the left and right stick portions 10A and 10B, it is determined that the loop pattern is finished, and the tone intensity of the musical tone (“Note 6” in FIG. 6) is “ 0 ”and only the elapsed time (“ 800 ”in FIG. 6) is recorded in the loop pattern storage unit 23.

  When the main body control unit 21 determines that the operation by the performer is a performance operation as the operation determination means, the main body of the stick section 10 which is a performance operator detected by the motion sensor section 14 which is a motion detection means. Based on the movement of the sound, the sound generation means for generating a predetermined musical tone is given a sound generation instruction, and when a loop pattern for loop performance is stored in the loop pattern storage section 23 which is a storage means, the stick section 10 And a predetermined tone based on the movement of the main body, and a tone generation control means for causing the tone generation means to generate a tone based on the loop pattern for loop performance.

FIG. 7 is a diagram showing an example of a performance pattern.
In this embodiment, as described above, it is possible to perform hi-hat, snare drum, and floor tom corresponding to the three performance areas ar1 to ar3, respectively, and by recording a bass drum loop pattern in advance. Loop performance is possible for the bass drum part.
Thereby, for example, at the third beat and the fourth beat of the second measure, three sounds of hi-hat, floor tom and bass drum are generated. As described above, in this embodiment, by incorporating a loop performance for one of a plurality of instrument parts, a performance that cannot be expressed by the two stick units 10 can be performed, and the range of performance is widened. .

  Returning to FIG. 2, the operation unit 24 receives input information based on an input operation by a performer or the like. The input information includes, for example, instructions for changing the volume of the tone to be generated and the tone color of the tone to be generated, starting and ending the performance operation, and the like. In the present embodiment, the bass drum performs a loop performance using a loop pattern, and an instruction to start and end the loop performance may be input from the operation unit 24.

The center unit 20 includes an audio circuit 32 and an audio output unit 251 configured with a speaker or the like.
Musical sound data based on the sound generation instruction signal is output from the main body control unit 21 to the audio circuit 32. The audio circuit 32 converts the musical sound data output from the main body control unit 21 into an analog signal, The converted analog signal is amplified and output to the audio output unit (speaker) 251.
The audio output unit 251 is, for example, a speaker and is a sound generation unit that generates a musical sound based on the musical sound data generated by the main body control unit 21. Note that the audio output unit 251 is not limited to a speaker, and may be an output terminal that outputs sound to headphones or the like.

The data communication unit 26 performs predetermined wireless communication with at least the stick unit 10. The predetermined wireless communication may be performed by any method. In the present embodiment, wireless communication with the stick unit 10 is performed by infrared communication. Note that the communication method by the data communication unit 26 is not limited to wireless communication. For example, the center unit unit 20 and the stick unit 10 may be connected by a cable and the data communication unit 26 may perform wired communication.
The main body control unit 21 performs communication control with the stick unit 10 via the data communication unit 26. In the present embodiment, the main body control unit 21 passes through the data communication unit 26. Motion sensor data is received from the stick unit 10.

Further, the center unit unit 20 includes a battery 28, and the battery 28 supplies power to each operation unit of the center unit unit 20 via the power circuit 27.
The battery 28 may be a primary battery or a rechargeable secondary battery. In addition, it is not essential that the battery 28 is built in, and power may be supplied from the outside via a cable or the like.

[Processing of the musical tone generator 1]
Next, with reference to FIG.8 and FIG.9, the process of the musical sound generator 1 is demonstrated.
FIG. 8 is a flowchart showing a loop pattern recording process, and FIG. 9 is a flowchart showing a performance process using the loop pattern.

[Loop pattern recording process]
As shown in FIG. 8, when performing a loop pattern recording process for recording a loop pattern for loop performance, first, the timer of the main body control unit 21 of the center unit unit 20 is reset (step S1). Further, the memory of the loop pattern storage unit 23 is erased and reset (step S2). In addition, the memory of the storage buffer that stores data sent from the stick unit 10 is also erased and reset (step S3).
The main body control unit 21 always determines whether or not a performance signal (sound generation instruction signal) has been received from any of the stick units 10 (step S4). If received (step S4; YES), the main body control unit 21 stores it in the storage buffer. It is determined whether or not there is stored data (that is, whether or not data based on the performance signal received from any stick unit 10 has been stored) (step S5). When it is determined that there is no data stored in the storage buffer (step S5; NO), if the timer is stopped, the timer is started (step S6) and the performance signal received from the stick unit 10 is started. Based on (sound generation instruction signal), information on the sound generation intensity, the elapsed time, and which stick unit 10 the performance signal is transmitted from, and information on the signal generation stick units 10A and 10B are written in the storage buffer ( Step S7). The signal generation stick units 10A and 10B are determined based on identification information (stick identification information) attached to the signal sent from the stick unit 10. Then, the main body control unit 21 sends an instruction signal to the audio circuit 25 to generate the musical tone of the musical instrument designated as the loop sound, thereby causing the voice output unit 251 such as a speaker to produce a predetermined musical tone (step S8). ). In this embodiment, the bass drum sound is designated as the loop sound, and the main body control unit 21 reads the waveform data of the bass drum from the sound source data storage unit 22 and outputs it to the audio circuit 25, and from the audio output unit 251. The sound of this bass drum is pronounced. In this case, when the series of processes is completed, the process returns to step S4 and is repeated.
On the other hand, if it is determined that there is data stored in the storage buffer (step S5; YES), the main body control unit 21 further determines that the signal received this time is the same as the data stored in the storage buffer. It is determined whether or not it is generated from the stick unit 10 (step S9). Whether the signal received this time is generated from the same stick unit 10 is determined based on identification information (stick identification information) attached to the signal sent from the stick unit 10. When it is determined that the signal received this time is not generated from the same stick unit 10 as the data stored in the storage buffer (step S9; NO), the main body control unit 21 uses two sticks. The loop pattern storage unit 23 stores the data related to the sound intensity and the elapsed time out of the data stored in the storage buffer by determining that the performance signals are the pattern recording operations that are simultaneously operated by the units 10A and 10B. (Step S10). Then, the memory in the storage buffer is erased and reset (step S11), and the process returns to step S4 to repeat the process.
On the other hand, when it is determined that no performance signal (sound generation instruction signal) has been received from any stick unit 10 (step S4; NO), the main body control unit 21 has data stored in the storage buffer. (Step S12), and if there is no stored data (step S12; NO), the process returns to step S4 and the process is repeated. On the other hand, when it is determined that there is data already stored in the storage buffer (step S12; YES), the main body control unit 21 further calculates the time stored in the storage buffer and the current performance signal. It is determined whether or not the time difference from the received time is equal to or less than a threshold value (step S13). If it is determined that the time difference is equal to or smaller than the threshold (step S13; YES), the process returns to step S4 and the process is repeated.
On the other hand, when it is determined that the time difference is equal to or less than the threshold (step S13; NO) and when a new signal is received, the signal received this time is generated from the same stick unit 10 as the data stored in the storage buffer. If it is determined that it has been (step S9; YES), the main body control unit 21 determines that the loop pattern has ended, and causes the loop pattern storage unit 23 to record only the time information stored in the storage buffer. (Step S14). That is, in this embodiment, after entering the loop pattern recording process, when a time more than a predetermined threshold value is available, and after entering the loop pattern recording process, an operation different from the loop pattern recording operation (that is, 2). When the operation of operating the two stick units 10A and 10B is performed), the main body control unit 21 ends the loop pattern recording process.
In this case, a value obtained by subtracting the time (time interval) stored in the storage buffer from the current timer value is set as “total loop time” (step S15).
As a result, the loop pattern recording process ends, and the process proceeds to the loop performance process.

[Loop performance processing]
When performing the loop performance process, the main body control unit 21 first determines whether or not the memory of the loop pattern storage unit 23 is empty (step S21). If it is determined that the memory of the loop pattern storage unit 23 is empty (step S21; YES), the loop performance is not performed and the process is terminated as it is. On the other hand, when it is determined that the memory of the loop pattern storage unit 23 is not empty (step S21; NO), the loop sound for starting the loop performance is set as “index = 1” (step S22), and the designated loop sound data is set. Is read from the loop pattern storage unit into the storage buffer (step S23).
For example, when performing a loop performance continuously from the loop pattern recording process, since the first sound of the loop pattern has already been sounded, the loop sound data of “Note 2” (see FIG. 5 etc.) is changed to “index”. = 1 ”, and the loop sound data of“ Note 2 ”is read from the loop pattern storage unit into the storage buffer.
The main body control unit 21 reads the sound generation intensity from the read data and determines whether the sound generation intensity is 0 (step S24). If it is determined that the tone generation intensity is not 0 (step S24; NO), the main body control unit 21 further determines whether or not the time in the storage buffer is smaller than the elapsed time of the loop sound data ( Step S25). When it is determined that the time of the storage buffer is smaller than the elapsed time of the loop sound data (step S25; YES), the main body control unit 21 until the time of the storage buffer exceeds the elapsed time of the loop sound data, that is, The process of step S25 is repeated until a predetermined timing for generating a musical sound based on the loop sound data comes.
When it is determined that the predetermined timing for generating the musical sound based on the loop sound data has come (step S25; NO), the main body control unit 21 performs the musical sound (for example, bass drum) of the instrument designated as the loop sound. Sound) from the voice output unit 251 (step S26).
The main body control unit 21 always determines whether or not there is an instruction to end the loop performance (step S27), and when there is an instruction to end the loop performance (step S27; YES), the loop performance is ended.
On the other hand, if there is no instruction to end the loop performance (step S27; NO), the main body control unit 21 increments the loop sound to be sounded next in the loop performance and puts “index = index + 1” ( Step S28), returning to step S23, the process is repeated. In other words, in the present embodiment, the loop sound “Note 3” to be sounded next is set as “index = index + 1”, and the processes in and after step S23 are repeated.
When it is determined that the tone generation intensity is 0 (step S24; YES), the main body control unit 21 finishes the loop pattern (in this embodiment, “Note 1” to “Note 6”) (one cycle). And “index = 0” is set, and the timer is reset to 0 (step S29). And the process after step S23 is repeated. As a result, the loop sound set as “Note 1” is pronounced at the timing when a predetermined elapsed time (“800” in FIG. 6) stored as “Note 6” has elapsed. The loop performance in which the loop sounds of “No. 6” are sequentially generated is repeated.

As described above, according to the musical sound generating apparatus 1 of the present embodiment, a pattern for recording a loop pattern for loop performance based on the motion detected by the motion sensor unit 14 whether the player's operation is a performance operation. When it is determined whether the operation is a recording operation, and when the operation by the performer is determined to be a pattern recording operation, based on the movement of the main body of the stick unit 10 detected by the motion sensor unit 14, it is used for loop performance. The main body control unit 21 stores the loop pattern in the loop pattern storage unit 23, and the main body control unit 21 detects the stick unit detected by the motion sensor unit 14 when the player's operation is determined to be a performance operation. Based on the movement of the 10 main body, a sound generation instruction is given to the sound output unit 251 that generates a predetermined musical sound At the same time, when a loop pattern for loop performance is stored in the loop pattern storage unit 23, a musical sound based on the movement of the stick unit 10 body and a musical sound based on the loop pattern for loop performance are generated from the audio output unit 251. It is supposed to let you.
Thus, for example, a musical instrument sound that is repeated in a predetermined pattern during performance, such as a bass drum, is stored in advance as a loop pattern, and the movement of the stick unit 10 is performed during performance using the stick unit 10. Together with the musical sounds of other musical instruments that are sounded accordingly, it is possible to produce a loop sound based on the loop pattern. For this reason, in addition to the performance of both hands, it is possible to increase the number of musical sounds that can be played by another sound, and the range of performance expressions is widened, making it possible to perform performances that are more diverse and close to live instruments.
In addition, the instrument part that is usually played with feet, such as bass drums, is automatically played as a loop pattern, so that both hands can concentrate on playing the instrument part that is operated with ordinary hands, making it closer to a live instrument performance. Natural performance is possible.
In this embodiment, a plurality of stick units 10 (two in this embodiment) are provided as performance operators, and the main body control unit 21 operates the plurality of stick units 10 at the same time based on the detection result by the motion sensor unit 14. When it is determined that the operation has been performed, it is determined that the operation by the performer is a pattern recording operation. Therefore, the loop pattern can be recorded by a simple method of operating the stick unit 10 at the same time, and a loop performance can be easily realized.

  In the present embodiment, the performance areas ar1 to ar3 are associated with the musical instruments without distinguishing between the stick portions 10A and 10B, and the same musical tone can be obtained if the same performance area is hit by any of the stick portions 10A and 10B. The case where it is pronounced is taken as an example. In this case, since it cannot be assumed that the same performance area is simultaneously hit with the two stick parts 10, when the same performance area is simultaneously hit with the two stick parts 10, an operation for recording the loop pattern is performed. It can be easily determined that there is. For this reason, it is not necessary to input from the operation unit 24 in particular when performing the loop pattern recording operation, which is convenient for the performer.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and it goes without saying that various modifications can be made without departing from the scope of the invention.

For example, in the above-described embodiment, an example is described in which a loop pattern is recorded by determining that it is a pattern recording operation for recording a loop pattern when the stick unit 10 is operated simultaneously. Any device that can be distinguished from normal performance operations in the main body control unit 21 may be used, and the present invention is not limited to the examples given here.
For example, it may be determined that the operation is for pattern recording when two performance operators (stick unit 10) are brought into contact with each other. According to this method, the simultaneity of signals transmitted from a plurality of performance operators (stick unit 10) can be significantly increased. Furthermore, since the movements of the performance operators (stick unit 10) themselves are also in opposite phases, it is very easy to distinguish them from normal performance operations.

  Moreover, in the said embodiment, when the stick part 10 was operated simultaneously, recording of a loop pattern was started, and the case where the recording of a loop pattern was complete | finished when operation with the single stick part 10 was performed was made into an example. However, the start and end of the recording of the loop pattern is not limited to the case where it is performed by such an operation. For example, the stick unit 10 or the like is equipped with a reset key, and after the reset key is depressed, the single stick unit 10 is used. The loop pattern recording may be started when the operation is performed, and the loop pattern recording may be ended when the simultaneous operation by the plurality of stick units 10 is detected.

  Further, even if the operation is performed by a single stick unit 10, it is not performed by a normal performance operation, for example, when the operation is outside the performance area or when the swinging operation is performed with the stick unit 10 raised upward. When an operation is performed, it may be determined that the operation is a pattern recording operation for recording a loop pattern. In this case, the loop pattern can be recorded even when the number of the stick unit 10 is one.

If it is easy to distinguish the pattern recording operation for recording the loop pattern from the normal performance from the posture of the stick unit 10 in the performance area and the operation, the performance of the loop pattern is performed in parallel with the normal performance. It is also possible to record and redefine a new loop pattern even during (reproduction).
That is, when recording of the loop pattern is started (that is, when a performance operation different from the normal performance operation is performed), the loop pattern storage unit 23 is cleared and loop pattern data is newly recorded. It is also possible to freely change the loop pattern during performance.
In addition, since it is possible to shift to a loop pattern recording operation using a performance operation different from a normal performance operation as a trigger, it is not necessary to provide an operation button or the like for instructing the start of loop pattern recording on the operation unit.

  In this embodiment, only one pattern is input as a loop pattern. However, the timing restriction of loop pattern data is tightened by inputting two loops, or two loops are input. By averaging the timing of the loop pattern data, variations in the loop pattern may be suppressed and a more accurate loop pattern may be recorded.

In the present embodiment, the performance areas ar1 to ar3 are associated with the musical instruments without distinguishing between the stick portions 10A and 10B, and the same musical tone can be obtained if the same performance area is hit by any of the stick portions 10A and 10B. For example, a different musical instrument is assigned to each of the stick units 10A and 10B. For example, when the performance area ar1 is hit with the stick unit 10A, a hi-hat musical sound is generated and the same performance area ar1 is generated. Even if it exists, when it hits with the stick part 10B, you may make it sound a musical sound of a cymbal.
In this case, it is possible to perform normal performance of six kinds of musical instruments and loop performance of one kind of musical instruments using two stick parts (performance operators).

In the present embodiment, only the acceleration data measured by the acceleration sensor is exemplified as the motion sensor data acquired by the motion sensor unit 14 as the detection means, but the content of the motion sensor data is not limited to this. For example, the angular acceleration may be measured by a gyro and the measured value may be used.
In the present embodiment, the rotation around the axis parallel to the stick portion 10 is not described. However, these rotations may be measured by an angular acceleration sensor or the like.

  In the present embodiment, the musical sound generator 1 is a detection means for detecting the state of the stick unit 10 (performance operator) based on the performance operation of the performer (for example, the swing-down position, swing-down speed, swing-down angle, etc.). The motion sensor unit 14 of the stick unit 10 is provided. However, the detection means is not limited to those exemplified here. For example, the motion sensor unit 14 may include a pressure sensor or the like. In addition to the image sensor, laser, ultrasonic waves, and other detection means using various sensors capable of measuring distances and angles may be applied.

  In the present embodiment, the virtual drum set D (see FIG. 1B) is described as an example of the virtual percussion instrument. However, the present invention is not limited to this, and the present invention can swing the stick unit 10 down. It can be applied to other musical instruments such as xylophones that generate musical sounds by movement.

  Further, in this embodiment, the case where the sound output unit 251 that is a sound generation unit is provided in the center unit unit 20 has been described as an example, but the sound generation unit is configured separately from the center unit unit 20. Also good. In this case, the sounding means and the center unit 20 are connected by wire or wirelessly, and the sounding means performs a predetermined sounding according to an instruction signal from the center unit 20.

In the present embodiment, the performance operator is a stick-shaped stick unit 10 as an example, but the performance operator is not limited to this. For example, a portable terminal device such as a mobile phone may be used as a performance operator.
The musical sound generating device 1 generates a sound of a predetermined musical instrument by performing a performance operation of hitting a space with a performance operator, and does not actually strike the performance operator on the strike surface of the instrument. Even when a precision electronic device such as a device is used as a performance operator, there is no possibility that the performance operator will be damaged.

Although several embodiments of the present invention have been described above, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof. .
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
A performance operator that the performer can hold,
Movement detecting means for detecting movement of the performance operator body generated by the player's operation;
Based on the movement detected by the movement detection means, an operation determination means for determining whether the operation by the performer is a performance operation or a pattern recording operation for recording a loop pattern for loop performance;
When the operation determining means determines that the operation by the performer is the pattern recording operation, the loop pattern for loop performance is determined based on the movement of the performance operator main body detected by the movement detecting means. Pattern storage control means for storing in the storage means;
When the operation determining means determines that the operation by the performer is a performance operation, the sound generating means generates a predetermined musical sound based on the movement of the performance operator main body detected by the movement detecting means. When a sound generation instruction is given to the loop and the loop pattern for the loop performance is stored in the storage means, the musical sound based on the loop pattern for the loop performance is played together with the musical sound based on the movement of the performance operator body. Pronunciation control means for generating sound from the pronunciation means;
A musical sound generating device comprising:
<Claim 2>
A plurality of the performance operators are provided,
The operation determining means determines that the operation by the performer is the pattern recording operation when it is determined from the detection result by the motion detecting means that the performance operation main bodies of the plurality of performance operators are simultaneously operated. The musical tone generator according to claim 1, wherein:

DESCRIPTION OF SYMBOLS 1 Musical sound generator 10 Stick part 11 Stick control unit 14 Motion sensor part 20 Center unit part 21 Main body control unit 111 Sound generation instruction generation part 251 Audio | voice output part D Drum set

Claims (3)

Movement detection means for detecting the movement of the performance operator;
Operation determination for determining whether the movement of the performance operator detected by the movement detection means is a performance operation by a performer or a pattern recording operation for recording a loop pattern for loop performance by the performer. Means,
If the loop pattern for the loop performance is judged to be pattern recording operation for recording by said operation determination means, corresponding to the movement of the performance operator, which is detected by the motion detecting means from said being determined Pattern storage control means for storing the loop pattern for loop performance in the storage means;
When the loop pattern for the loop performance is stored in the storage means, the sound for controlling the sound based on the movement of the performance operator and the sound based on the loop pattern for the loop performance to be generated from the sound generation means Control means;
A musical sound generating device comprising:   When the movement of the performance operator is a performance operation, the sound generation control means provides the sound generation means with a sound generation instruction for sounding a musical sound based on the movement of the performance operator detected by the movement detection means, and When a loop pattern for the loop performance is stored in the storage means, a sound generation instruction for causing the sound generation means to generate a sound based on the loop pattern for the loop performance is given together with the music based on the movement of the performance operator. The musical tone generator according to claim 1, wherein: A plurality of the performance operators are provided,
2. The method according to claim 1, wherein when the plurality of performance operators are operated simultaneously from the detection result of the motion detection means, it is determined that the simultaneous operation by the plurality of performance operators is the pattern recording operation. The musical tone generator according to claim 2.

Images