JP2006098517A - Operation expression device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable an operation expression device to be utilized by a user in realizing the articulation of a performance while expressing mechanical actions in accordance with a musical conception. <P>SOLUTION: In the operation expression device, retention parts 21L, 21R are configured so that sticks 22L, 22R can be inserted respectively into the retention parts 21L, 21R and they operate respectively to the X-axis direction and the Y-axis direction independently. A key is determined every time a 1st beat comes and when the 1st beat is a major key, the sticks 22 operate to the X-axis (+) direction at the 1st beat and operate to the X-axis (-) direction and return to the initial position at a 2nd beat and repeat these operations at 3rd and 4th beats. When a next 1st beat is a minor key, the sticks 22 operate back and forth in the Y-axis direction. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a motion expression device used for musical instrument performance practice.

  In order to be able to say that a musical instrument performance is good, it is necessary not only to be able to play accurately, but also to provide an impressive performance expression. Such performance expression is made by organically combining dynamics, subtle tempo shift (1 / f fluctuation, etc.), accenting, etc., and these are called “articulations”. To gain articulation, it is usually necessary to learn from a good musical instrument teacher and to practice under a good conductor. For example, an excellent conductor does not move the tact monotonously, but moves the tact with an optimal trajectory and timing according to the situation such as the music.

By the way, as an apparatus for performance practice, as provided in Patent Document 1 below, one having a key pressing guide function is widely known. On the other hand, there is also known an apparatus that gives a visual enjoyment by moving a doll or the like in accordance with a performance.
Japanese Utility Model Publication No. 56-74492 Japanese Patent No. 2522132

  However, although the device of Patent Document 1 can learn to play correctly, it cannot learn advanced articulation. Moreover, the apparatus of the above-mentioned patent document 2 is not intended for learning.

  The present invention has been made in order to solve the above-described problems of the prior art, and its purpose is to express a mechanical action according to a musical idea and to use it for the acquisition of performance articulation. To provide an apparatus.

  In order to achieve the above object, a motion expression device according to claim 1 of the present invention comprises a composition detection means (1) for detecting a composition of performance data, and a mechanical expression means (1) for representing a mechanical operation based on the performance data. , MC), and the mechanical expression unit varies the mode of the mechanical operation in accordance with the musical composition detected by the musical composition detection unit.

  Preferably, it has a beat detection means (1) for detecting a beat based on the performance data, and the mechanical expression means expresses the mechanical operation in conjunction with the beat detected by the beat detection means ( Claim 2). More preferably, the music detection means detects the key of the performance data as the music, and the mechanical expression means expresses the detected key characteristic by the mechanical action. (Claim 3).

  Alternatively, the music detection means detects note information in the performance data as the music, and the mechanical expression means expresses the characteristic of the note corresponding to the detected note information by the mechanical action ( Claim 4).

  Preferably, the mechanical expression means expresses the mechanical operation in a plurality of dimensions. More preferably, it has sound generation means (8) for generating a musical sound according to the direction of movement in conjunction with the movement of the mechanical expression means. More preferably, it has a musical tone element input means (5, 223) for inputting musical tone elements, and the mechanical expression means operates at least one of members constituting the musical tone element input means, thereby A mechanical operation is expressed (claim 7). More preferably, the musical tone element input means includes a stick member (22) for inputting rhythm data and a holding portion (21) for holding the stick member (claim 8). Alternatively, the musical tone element input means is a sliding operation element (221) for inputting musical tone parameters (claim 9).

  In order to achieve the above object, a motion expression apparatus according to claim 10 of the present invention includes a storage means (2) for storing automatic performance data, a manual performance section (6, 223) capable of performing manual performance, and the storage means. A reading means (1) for sequentially reading stored automatic performance data, and performing automatic performance based on the automatic performance data read by the reading means, and generating musical sounds based on manual performance by the manual performance section Musical expression generating means (8), composition detection means (1) for detecting the composition of the automatic performance data read by the reading means, and mechanical expression for expressing a mechanical operation based on the automatic performance data read by the reading means And the mechanical representation means is a music piece detected by the fantasy idea detection means. Accordingly, the performance of the manual performance unit is expressed using the mechanical motion expressed by the mechanical expression means as an index to express the performance as an index of performance by changing the mode of the mechanical motion according to It is characterized by being configured to be able to learn.

  In order to achieve the above object, a motion expression apparatus according to claim 11 of the present invention is based on a musical composition detection means for detecting a musical composition of musical performance data, an image display means (70) capable of stereoscopic display, and the performance data. A stereoscopic display control unit that stereoscopically displays an image representing an operation on the image display unit, and the stereoscopic display control unit is configured to perform the operation according to the musical idea detected by the musical composition detection unit. It is characterized by making different.

  In addition, the code | symbol in the said parenthesis is an illustration.

  According to the motion expression device according to claim 1 of the present invention, it is possible to express a mechanical motion corresponding to a musical idea and to use it to acquire performance articulation.

  According to the motion expression device according to claim 10 of the present invention, it is possible to express a mechanical motion corresponding to a musical idea, to learn performance expression using this as an index, and to use it for learning performance articulation. Can do.

  According to the motion expression device according to claim 11 of the present invention, the motion corresponding to the musical composition can be displayed in three dimensions and used for the acquisition of performance articulation.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1A is an external perspective view of the motion expression device according to the first embodiment of the present invention. Note that (b) and (c) in the figure will be described later. FIG. 2 is a block diagram showing the overall configuration of the operation expression device.

  As shown in FIG. 1, the motion expression device is configured as an electronic percussion instrument 20, for example. The electronic percussion instrument 20 includes a performance input unit 6 configured as a drum unit (see also FIG. 2). When performing, usually, the performance input unit 6 is hit with two sticks 22 (22L, 22R), so that a hitting sound as a musical tone element can be input or generated in real time.

  When manual performance is not performed, the sticks 22L and 22R are inserted and held in the respective holding portions 21 (21L and 21R). As will be described later, the holding portions 21L and 21R are configured to be independently operable. In plan view, when the arrangement direction of the holding portions 21L and 21R is the X axis and the direction perpendicular to the X axis is the Y axis, the holding portions 21L and 21R can operate in the two-dimensional direction of the X axis and the Y axis, When 22L and 22R are inserted, the sticks 22L and 22R also operate in conjunction therewith.

  As shown in FIG. 2, the electronic percussion instrument 20 includes a storage device 2, a ROM 3, a RAM 4, a timer 13, an operation input unit 5, a performance input unit 6, a display unit 7, a sound source unit 8, a power output unit 9, and various interfaces 14. And connected to the CPU 1 via the bus 10. The timer 13 is also connected to the CPU 1.

  The CPU 1 controls the entire apparatus. The ROM 3 stores a control program executed by the CPU 1 and various table data. The RAM 4 temporarily stores various input information such as performance data and text data, various flags, buffer data, and calculation results. The timer 13 measures the interrupt time and various times in the timer interrupt process. The storage device 2 is configured by a flash memory or the like, and can store automatic performance data and the like, as well as various application programs including the control program.

  The operation input unit 5 includes various operators such as a tempo setting operator 12 shown in FIG. The display unit 7 is composed of an LCD or the like and displays various information. The sound source unit 8 includes a sound system (not shown) and a speaker 11 (see FIG. 1). The sound source unit 8 reproduces music based on automatic performance data stored in the storage device 2, and also generates musical sounds due to manual performance of the performance input unit 6. Can be made. The power output unit 9 includes motor control circuits 32 and 33 which will be described later.

  The various interfaces 14 include MIDII / F (interface) that transmits and receives MIDI (Musical Instrument Digital Interface) signals to and from MIDI devices (not shown), as well as external devices (not shown) via an external line such as the Internet or an intranet. A network I / F that performs data communication with the apparatus is included. The external line is not limited to wireless, but may be wired or may be connected to a plurality of external devices.

  FIG. 3A is a perspective view illustrating an example of a configuration of a drive mechanism that drives the holding unit 21. FIG. 3B is a side view of one worm in the drive mechanism. This drive mechanism MC corresponds to one holding portion 21, and the structure of the mechanism corresponding to the other one is the same.

  The drive mechanism MC is related to driving in the X-axis and Y-axis directions by motor control circuits 32 and 33, motors 23 and 27, worms 29 and 25, moving plates 30 and 26, guides 28 and 24, and covers 34 and 35, respectively. Composed. For example, with respect to the X axis, a gear portion 30 b is formed at one end of the moving plate 30, and the gear portion 30 b meshes with the worm 29. The motor 23 rotates the worm 29 according to the drive signal supplied from the motor control circuit 32. The other end of the moving plate 30 is slidable in the X-axis direction along a groove (not shown) formed in the guide 28.

  The covers 35 and 34 are fixed to the case of the electronic percussion instrument 20 and cover the periphery of the worms 29 and 25. For example, as shown in FIG. 3B, the cover 35 is formed with openings 35a and 35b that are partially cut out in a slit shape, and the gear portion of the moving plate 30 is formed between the openings 35a and 35b. The vicinity of 30b is interposed. Accordingly, when the worm 29 rotates, the moving plate 30 moves in the X-axis direction while being guided by the groove portion of the guide 28 and the openings 35a and 35b. The mechanism related to the Y axis is configured in the same manner as the X axis. Thus, when the moving plates 30 and 26 are moved, the respective gear portions 30b and the like are not detached from the worms 29 and 25.

  The moving plates 30 and 26 have elongated holes 30a and 26a, respectively, which are orthogonal to each other. One of the holding portions 21 passes through the long holes 30a and 26a. The holding portion 21 has the base portion 21a pivotally fixed to the moving plate 30 so that the tip portion can freely rotate and displace in both the X axis and the Y axis with the base portion 21a as a fulcrum. In addition, limiter switches (only the limiter switch 31 at one end of the guide 24 is shown) are provided at both ends in the longitudinal direction of the guides 28 and 24 to restrict the movement limit of the corresponding moving plates 30 and 26. Yes.

  The motor control circuits 32 and 33 are publicly known (Toshiba bipolar linear integrated circuit “TA7257P”), and both are combinations of “0” or “1” inputs to the two input terminals (IN1, IN2). Thus, the corresponding motors 23 and 27 can be controlled. Specifically, the brake control is performed when IN1 and IN2 are “1, 1”, the forward rotation is performed when “0, 1”, the reverse rotation is performed when “1, 0”, and the stop control is performed when “0, 0”. By using “1, 1”, the tact expression by the operation of the stick 22 which will be described later becomes sharp and crisp rhythm expression is possible.

  With such a configuration, the drive mechanism MC moves the moving plates 30 and 26 in the X-axis and Y-axis directions, so that the holding portion 21 and the stick 22 inserted into the holding portion 21 are moved to the X-axis and Y-axis. It is designed to operate in two dimensions in the axial direction.

  Further, as shown in FIG. 3A, IC (integrated circuit) voltage stabilizing electrolytic capacitor C1, motor stabilizing capacitor C2, and current regulator CC are provided as peripheral circuits of motor control circuits 32 and 33, respectively. ing. In FIG. 2A, T1 is an IC drive power supply terminal. The current regulator CC is provided between the motor power terminal T2 of the IC and the power terminal V2 for driving the motor. The current regulator CC is composed of an IC circuit such as a transistor, a FET (field effect transistor), or a differential amplifier, and a current (output) flowing into each motor power supply terminal T2 of the motor control circuits 32 and 33 is controlled by an input IN3. (This is touch data to be described later.) In other words, it can be said that “the internal resistance of the current regulator CC changes due to a change in the control input (input voltage value)”.

  The drive mechanism MC is an example, and other mechanisms may be adopted as long as the mechanism can operate the holding unit 21 two-dimensionally.

  In the present embodiment, as the main operation modes, an “automatic performance mode” for performing automatic reproduction based on automatic performance data and a “performance mode” for operating the holding unit 21 based on automatic performance data can be set. The mode can also be set by overlapping. These operation modes are realized by the processes shown in FIGS. 5 and 6 to be described later. First, a specific operation example of the performance mode will be described.

  FIG. 4A shows the operation in the performance mode. FIGS. 2B and 2C will be described in a second embodiment to be described later.

  Hereinafter, when the stick 22 is inserted into the holding unit 21, the movements of the two are linked, so that the description will be made by paying attention to how the stick 22 operates as a representative. Further, since the stick 22L and the stick 22R operate symmetrically with respect to the X-axis direction, the sign (+) indicates the left / right direction in FIG. It shall correspond. Regarding the Y-axis direction, the sign (+) corresponds to the upper part of FIG.

  In the performance mode, the stick 22 operates according to automatic performance data sequentially read from the storage device 2. The operation speed of the stick 22 (the speed of one operation, not the operation interval) is determined by the current values of the corresponding motors 23 and 27, and these current values are determined by the tempo value temp (step S202 in FIG. 6). This tempo value temp value is set by the tempo setting operator 12 (steps S104 → S105 in FIG. 5). The axial direction of the movement of the stick 22 depends on whether the key of the first beat detected from the automatic performance data is major or minor, and the second and subsequent beats operate in the same axial direction as the first beat. In each axial direction, the (+) direction and the (−) direction are switched each time the next beat comes. Therefore, as long as the tone does not change, the reciprocating operation in the X-axis or Y-axis direction is repeated for each beat. Hereinafter, a state in which the stick 22 is upright is referred to as an initial position of the stick 22.

  For example, taking the time signature of 4 as an example, the key is determined every time the first beat, which is important for interpretation of the musical composition, is reached (steps S203 → S204 → S205 in FIG. 6). 4 (a), the stick 22 moves in the X-axis (+) direction at the first beat and moves to the positions indicated by 22L (P1) and 22R (P1) (steps S205 to S208 in FIG. 6). At the second beat, it moves in the X-axis (−) direction and returns to the initial position (steps S206 → S208 in FIG. 6), and at the third beat, it moves again to the positions indicated by 22L (P1) and 22R (P1) (FIG. 6 (step S206 → S208), the fourth position returns to the initial position (step S206 → S208 in FIG. 6).

  When the next first beat is minor, the stick 22 moves in the Y-axis (+) direction at the first beat and moves to positions indicated by 22L (P2) and 22R (P2) (step S205 in FIG. 6). → S207) In the subsequent second to fourth beats, the movement between the initial position and the positions 22L (P2) and 22R (P2) is repeated in the same manner as described above (steps S206 to S207 in FIG. 6). However, when the major or minor key cannot be discriminated, the stick 22 reciprocates in the axial direction that was the control target immediately before the X axis or the Y axis (steps S205 → S209, S206 → S209 in FIG. 6).

  When the automatic performance mode is set regardless of whether the performance mode is set, automatic performance is performed according to the automatic performance data that is sequentially read (steps S210 → S211 → S212 → S213 in FIG. 6).

  If the automatic performance mode is not set, automatic performance is not performed and only the operation of the stick 22 can be performed. In addition, real-time sound generation by manual performance is possible (step S108 in FIG. 5), and the user can make sound by striking the performance input unit 6 with the two sticks 22. Here, it can be said that the operation of the stick 22 exemplified above imitates the operation of a conductor by a conductor. Accordingly, if two sticks 22 for manual performance are prepared in addition to the two sticks 22 inserted into the holding portion 21, the stick 22 can be regarded as a conductor and practiced for drum performance. You can also learn how to practice, and you can turn the pronunciation on and off automatically, so you can change your practice depending on your progress.

  Next, the operation will be described along the flowchart. FIG. 5 is a flowchart of the main process. FIG. 6 is a flowchart of the timer process. This timer process is started and executed in response to a timer interrupt that occurs, for example, 96 times within a quarter note time interval. Therefore, the execution interval of this process varies according to the tempo value temp set in step S105 of FIG. 5 described later, or the timer interrupt value corresponding thereto.

  First, in FIG. 5, initialization is executed, that is, execution of a predetermined program is started, initial values are set in various registers, and initial setting is performed (step S101). Next, an instruction for mode setting and change by the operation input unit 5 is received, and the operation mode is set and changed according to the instruction (steps S102 and S103).

  Next, the change of the tempo value temp by the operation of the tempo setting operator 12 is accepted. If there is a change, the setting of the tempo value temp is changed and the timer interrupt value is set according to the tempo value temp (step S105). ). Thereby, the operation speed is controlled in real time in synchronization with the tempo value temp. The tempo value temp indicates the number of quarter notes in one minute, and is set in the range of 40 to 150, for example.

  Next, it is determined whether or not the movable plates 30 and 26 are in contact with the limiter switch (limiter switch 31 or the like). Only when there is a contact, the motor control corresponding to the contacted moving plates 30 and 26 is performed. By supplying an emergency stop signal to the input terminals (IN1, IN2) of the circuits 32, 33, the rotation of the corresponding motors 23, 27 is stopped (steps S106, S107).

  Next, manual performance processing is executed (step S108). That is, based on the batting operation on the performance input unit 6, channel data, key-on / key-off data, and touch data (velocity) are sent to the sound source unit 8 to perform sound generation and mute processing. Next, in addition to the selection of other instructions, for example, selection of music, instructions for changing various parameters such as timbre, volume, and various effects are received, and other processing is executed in accordance with the instructions (steps S109 and S110). Return to S102.

  In step S201 in FIG. 6, it is determined whether or not the operation mode is the performance mode. If the operation mode is not the performance mode, the process proceeds to step S210. Is set to a value (for example, a proportional value) corresponding to the tempo value temp (step S202). As a result, the moving speed of the stick 22 corresponds to the progress of the automatic performance data, and a natural operation is realized at any tempo value temp. That is, if the tempo is slow, the movement of the stick 22 is slow, and if the tempo is fast, it is fast.

  Next, it is determined based on the tempo counter T whether or not it is the beginning of a beat (step S203). Here, as will be described later, the tempo counter T is incremented every time in step S214 and reset to 0 every measure (step S216). As described above, since the process of FIG. 6 is executed at a time interval of 1 / 96th of the quarter note length, if the time signature is taken as an example, the tempo counter T is 0, 96, 192 or When it is 288, it is determined that it is the beginning of the beat.

  If it is not the beginning of the beat, the process proceeds to step S210. If it is the beginning of the beat, it is determined whether or not the current beat is the first beat (step S204). This determination is also made based on the tempo counter T. When the tempo counter T is 1, it is determined that the first beat. As a result of the determination, in steps S205 to S209, performance operation processing is performed according to whether the first beat or the second beat or later and according to the key (long / short).

  That is, if it is the first beat, the channel data for the first beat and the pronunciation data KC are pooled, and it is determined from these whether the key is a major key or a minor key (step S205). As a key determination method, a known method can be adopted. For example, it can be determined using a code table disclosed in FIG. 23 of Japanese Patent No. 2663939. This chord table includes a column indicating a number, a column indicating a chord type, a chord pattern column serving as a detection rule to be compared with a chord constituent sound candidate, and a reference pattern column, and is based on the detected chord constituent sound. A code type is specified.

  As a result of the key determination, if the key is a major key, the sign of the X-axis parameter that defines the movement of the stick 22 in the X-axis direction is reversed to control the movement in the X-axis direction (step S208). That is, the motor 23 is rotated. For example, when the sign (−) is immediately before, the sign (+) is obtained, and the sticks 22L and 22R move in the direction away from each other in the X-axis direction (22L (P1) in FIG. 4A). 22R (P1)).

  On the other hand, in the case of a minor key, the sign of the Y-axis parameter is reversed, the operation in the Y-axis direction is controlled, and the motor 27 is rotated (step S207). For example, when the sign is (−), the sticks 22L and 22R operate in the Y-axis (+) direction (see 22L (P2) and 22R (P2) in FIG. 4A). On the other hand, when the major or minor key cannot be determined, the sign of the parameter of the control target axis that has been controlled immediately before the X axis or Y axis is reversed to control the operation of the control target axis. (Step S209).

  As a result of the determination in step S204, if the current beat is not the first beat, it is determined whether the previously determined key is a major key or a minor key (step S206). If YES in step S207, the process advances to step S207. If the key cannot be determined, the process advances to step S209. Therefore, it operates by inverting the sign in the same axial direction as the first beat.

  After execution of steps S207 to S209, the process proceeds to step S210, and it is determined whether or not the automatic performance mode is set. If it is not the automatic performance mode, the process proceeds to step S214. If it is the automatic performance mode, it is determined whether or not the data currently indicated by the address pointer T0 in the automatic performance data is end mark data (step S211). ). The address pointer T0 points to the beginning of the automatic performance data, and when the currently indicated data is processed, the next data is sequentially shifted.

  If the data indicated by the address pointer T0 is not end mark data, it is determined whether or not the sounding data KC currently indicated by the address pointer T0 has reached the sounding timing (step S212). All the sounding data KC indicated by the pointer T0 is sounded (step S213). Next, in step S214, the tempo counter T is incremented by “1”, and the tempo counter T is a value indicating a bar line (T = 383, for example, when the time signature is 4). 1) is determined (step S215). Only when the value (383) indicating the bar line is reached (step S216), the tempo counter T is reset to 0 (step S216), and this process is terminated. Since the timing at the time of the next interrupt processing (when T = 0) is the time of 384, the time of “bar line-1” is determined in step S215.

  On the other hand, if it is determined in step S211 that the data currently indicated by the address pointer T0 is end mark data, the performance mode and automatic performance mode are canceled, and the tempo counter T is reset to 0. Each sign of the X-axis and Y-axis parameters is set to (-) (step S217), and this process is terminated.

  According to the present embodiment, in the performance mode, according to the automatic performance data, the operation like a conductor's command stick is mechanically expressed in conjunction with the beat, and the operation direction is changed according to the determined tone. You can learn the articulation of the performance, and it is fun not only to listen to the automatic performance but also to watch the movement. Furthermore, manual performance is possible in accordance with the above operation, and if the automatic performance mode is canceled, it is possible to perform only the operation with no sound. The performance expression can be learned, and it is easier to learn articulation.

  Moreover, since the motion of the stick 22 is expressed in two dimensions, the mode of motion is not monotonous. Furthermore, since the stick 22 and the holding part 21 which are components normally provided in the drum-shaped electronic percussion instrument 20 are used to express the mechanical operation, the operation can be realized without providing a dedicated component for the operation. Is possible.

  If the key cannot be determined as a result of the determination in step S205 or S209, the X axis and the Y axis are not controlled, but the stick 22 is tilted in an oblique direction, instead of controlling the immediately preceding control target axis. You may control. In this case, the stick 22 moves in both the X axis and the Y axis, and therefore, as shown in FIG. 4A, between the initial position and the positions indicated by 22L (P3) and 22R (P3). Repeat the move.

(Second Embodiment)
In the second embodiment of the present invention, in contrast to the first embodiment, the timer process uses FIG. 7 instead of FIG. 6, and FIG. 4A is used as an example of performance mode operation. The second embodiment will be described with reference to FIGS. 4B and 4C.

  FIG. 7 is a flowchart of the timer process in the second embodiment. The performance mode is realized by the processes in FIGS. 5 and 7. First, a specific operation example of the performance mode in the present embodiment will be described.

  FIGS. 4B and 4C show only the operation of the stick 22R out of the two sticks 22, but the operation of the stick 22L is the same as that shown in FIG. Omitted. The numbers shown in FIGS. 4B and 4C are the numbers of the notes that are read sequentially.

  In the present embodiment, in the performance mode, the stick 22 is operated each time a note in the automatic performance data comes into sound. In the automatic performance data, the channel relating to the operation of the stick 22 is, for example, only the melody channel.

  In the performance mode, the current value that defines the operating speed of the stick 22 is doubled only when the note is the first note of the measure (first beat) (step S307). Further, the rotation of the motors 23 and 27 is controlled by the time width corresponding to the touch data (velocity) in the note information (steps S306 and S307). Accordingly, the larger the touch data, the longer the movement distance of the stick 22. In this embodiment, the beat position and touch data are detected as a melody. However, with respect to the beat position, the operation speed of the stick 22 is set to 2 even for the first beat note having a slight delay. By controlling to be doubled, it is possible to perform not only a metronome-like operation but also an operation that allows fluctuations (step S305).

  Taking a simple melody song with 4 beats and a quarter note for each beat as an example, as shown in FIG. 4 (b), if touch data of consecutive notes is the same, The stick 22R moves in the X-axis (+) direction at the sounding timing of the first note (Steps S304 → S305 → S307), and reciprocates in the Y-axis direction at the sounding timings of the second to fourth notes (Step S304). In S304 → S305 → S306, the sound moves in the X-axis (−) direction at the fifth note sounding timing, and reciprocates in the Y-axis direction at the sounding timing of the sixth to eighth notes to return to the initial position.

  In the example of FIG. 4B, the motion trajectory of the stick 22R is rectangular. However, when the touch data of successive notes is not the same, the stick 22R does not have a rectangular shape and does not always return to the initial position.

  Next, the operation will be described along the flowchart. First, in step S301 of FIG. 7, it is determined whether or not the operation mode is the performance mode and the automatic performance mode is set. Only when both modes are set, the process is performed in step S302. 6 is executed, and in step S303, the same process as in step S211 in FIG. 6 is executed.

  As a result of the determination in step S303, if the data currently indicated by the address pointer T0 in the automatic performance data is not end mark data, the sounding data KC currently indicated by the address pointer T0 is the same as in step S212. It is determined whether or not the sound generation timing has been reached (step S304). As described above, here, only the pronunciation data KC which is the note information detected in the melody channel is discriminated.

  As a result of the determination, if the sound generation data KC indicated by the address pointer T0 has reached the sound generation timing, it is determined whether or not 0 ≦ T ≦ 2 (step S305). Here, not T = 1 indicating the beginning of the first beat but the T value from 0 to 2 is allowed in advance in the automatic performance data by slightly shifting the sound generation timing in spite of being the first beat. This is because certain note information can be present, so that the performance operation can be faithfully reproduced even with such fluctuating notes. This makes it easier to learn performance articulations.

  If 0 ≦ T ≦ 2 as a result of the determination, the current sounding data KC indicates the note of the first beat, so the current value of the motor 23 in the X-axis direction that is currently set is 2 The value is set to a double value, the sign of the X-axis parameter is reversed, and the motor 23 is rotated by the time width corresponding to the touch data of the current sounding data KC (step S307). Thereby, in the X-axis direction, the stick 22 operates by a distance twice as long as the other beats compared to other beats (see “1, 5” in FIG. 4B).

  On the other hand, when 0 ≦ T ≦ 2, the current value of the motor 27 in the Y-axis direction that is currently set is left as it is, the sign of the Y-axis parameter is inverted, and the touch data of the current sounding data KC The motor 27 is rotated by the time width corresponding to (step S306). Thereby, at the sounding timing of the note that is not the first beat, the stick 22 reciprocates at a normal (1 time) speed in the Y-axis direction (see “2-4 or 6-8” in FIG. 4B). ).

  Next, all of the sound generation data KC indicated by the address pointer T0 is sounded (step S308), and in the subsequent steps S309 to S311, processing similar to steps S214 to S216 in FIG. 6 is executed, and this processing is terminated.

  On the other hand, if it is determined in step S303 that the data currently indicated by the address pointer T0 in the automatic performance data is end mark data, the process proceeds to step S312 and the same process as in step S217 in FIG. 6 is executed. To end this process.

  According to the present embodiment, in the performance mode, in accordance with the automatic performance data, the mechanical performance is expressed according to the sound generation timing and the touch data of each note while performing the automatic performance sound. It is possible to obtain the same effect as that of the first embodiment with respect to making performance expression learnable as an index and using it to acquire performance articulation.

  In addition, if there is a note at the beginning of a measure, it is visually recognized as being exaggerated by a fast action, making it easier to recognize the bar line, making it easier to learn articulation.

  In particular, since an allowable range is given to the determination of the T value in step S305 of FIG. 7, for example, the performance mode is executed using automatic performance data obtained by recording a performance by a good player in real time. For example, it is possible to visually express the sound generation timing accompanied by a subtle deviation, and to perform performance practice using a 1 / f fluctuation command as an index.

  In the present embodiment, in step S306 or S307, different special sounds may be associated with the X axis and the Y axis, and sounded in conjunction with the operation. For example, in step S307, it may be emphasized that it is the first beat by generating a sound effect such as a good hand in accordance with the operation in the X-axis direction.

  In the first and second embodiments, each operation may be a reciprocating operation, as shown in FIG. 4C, instead of one-way operation. For example, in the second embodiment, in one operation, the stick 22 is operated for a time width corresponding to the touch data in the note information and then immediately returned to the initial position. In this way, it becomes closer to the movement of the baton. In addition, when the return operation is performed every time as described above, the operation amount in the X-axis and Y-axis directions may be set according to the touch data in the note information. When the value is less than or equal to a predetermined value, the operation is performed only in the X-axis direction. When the value is larger than the predetermined value, the Y-axis component may be added by an angle corresponding to the value to operate in the oblique direction.

  In the first and second embodiments, the movement direction of the stick 22L and the stick 22R is not limited to left-right symmetry. For example, when the stick 22L moves in the X-axis direction, the stick 22R moves in the Y-axis direction. You may make it like this, the reverse may be sufficient and can take various aspects.

(Third embodiment)
The motion expression device according to the third embodiment of the present invention is applied to a keyboard instrument type device 220 shown in FIG. The data used for the motion expression is the same as the automatic performance data in the second embodiment, but the mode of the motion expression is different, and the liquid crystal display unit 70 displays a three-dimensional image instead of physically operating the stick 22. . In other words, an image of a state in which the pseudo command stick corresponding to the stick 22 is operated in three dimensions is displayed. The image display is a three-dimensional display using, for example, a formogram, but is not limited thereto.

  The pseudo command stick is operated only by two-dimensional data (X-axis and Y-axis parameters) out of three-dimensional data, and the remaining one-dimensional data is configured to be set by manual operation, for example, displaying operation Is used to set which direction (front, oblique, rear, etc.) is to be considered. Of course, the viewing direction may be fixed. Further, the two-dimensional data defining the operation is not limited to the combination of the X axis and the Y axis, and may be configured to be switchable to the combination of the X axis and the Z axis or the combination of the Y axis and the Z axis.

  As a specific method of control, in the steps of controlling the rotation of the motors 23 and 27 (steps S107, S202, S302, and S307) in the processes of FIGS. It is only necessary to control the operation of the pseudo baton. Therefore, the movement of the pseudo baton is similar to the movement of the stick 22 in the second embodiment, but the viewing direction can be variously changed.

  According to the third embodiment, the same effect as in the second embodiment can be obtained. In the first and second embodiments, the movement of the stick 22 is two-dimensional, but it may be configured to operate in three dimensions. Further, the mode of operation is not limited to those illustrated as long as it is a mechanical operation. Furthermore, what is necessary is just to make the aspect of mechanical operation | movement differ according to a song, and it is not limited to what illustrated the change of the aspect.

  In the first and second embodiments, the operation of the stick 22 in the performance mode is not limited to being performed based on the stored automatic performance data, but based on performance data generated by manual performance. The stick 22 may be operated in real time. In this case, the performance input unit 6 functions as a performance source unit.

  In the first and second embodiments, the electronic percussion instrument 20 is shown as an example of the motion expression device. However, the present invention is not limited to this. For example, an animal shape device 120 as shown in FIG. Alternatively, a keyboard instrument type device 220 as shown in FIG. In the animal shaped device 120, the tail 121 is a portion that operates corresponding to the stick 22, and operates two-dimensionally. Further, the nose 122 corresponds to the tempo setting operator 12.

  As described above, in any of the examples, the components that are normally provided in the apparatus are used for operating members and the like. Note that members used for the operation are not limited to those exemplified.

  In addition, the external appearance of the apparatus that expresses the mechanical operation is not limited to the exemplified ones, and various types such as a humanoid robot, a dog, and a cat can be considered and are not limited to musical instruments.

  In particular, in the keyboard instrument type device 220, a slide volume operator 221 for inputting a set volume as a musical tone parameter (for example, one used as an instrument input operator described in Japanese Patent No. 2669107 is applied. Is equivalent to the stick 22 and operates one-dimensionally. In place of the slide volume operator 221, a sound setting slide operator may be used. A tempo setting operator 222 corresponding to the tempo setting operator 12 is provided in a normal keyboard device. The keyboard unit 223 serves as an input unit for inputting musical tone elements.

  When the keyboard instrument type device 220 is applied as the motion expression device, more specifically, it is configured as follows. First, the entire configuration of the keyboard instrument type apparatus 220 is the same as that shown in FIG. The tone generator unit 8 can also generate a musical tone by manual performance of the keyboard unit 223. Also, the keyboard instrument-type device 220 is provided with sticks 22L and 22R and holding portions 21L and 21R (not shown) as in the first and second embodiments. The mechanism for operating the stick 22 is the same as that in the second embodiment, as shown in FIG. What corresponds to the cover 35 is fixed to the case of the keyboard instrument type device 220. The process used for the control is the same as in the second embodiment (FIGS. 5 to 7).

  In the performance mode, instead of the stored automatic performance data, the stick 22 is operated in real time based on performance data generated by performance by manual performance of the keyboard unit 223. That is, when performing manually in the performance mode, it is possible to proceed from step S201 in FIG. 6 to step S202 by setting a flag indicating this. Thereby, the stick 22 provided in the keyboard instrument type device 220 performs the same operation as in the second embodiment according to the manual performance.

  In the keyboard instrument type apparatus 220, in addition to the stick 22 and the holding unit 21, a pad unit similar to the performance input unit 6 is provided to perform the same operation as in the first and second embodiments. Can do.

  The electronic percussion instrument 20 and the keyboard instrument-type device 220 are connected via the various interfaces 14 so that data can be transmitted and received, and performance data generated by manual performance of the keyboard unit 223 in the keyboard instrument-type device 220 is transmitted to the electronic percussion instrument 20. By transmitting the received performance data in the electronic percussion instrument 20 instead of the automatic performance data, it is possible to operate the stick 22 of the electronic percussion instrument 20 in real time by the performance on the keyboard instrument type device 220. Note that the device that performs the motion expression based on the performance data transmitted from the keyboard instrument type device 220 is not limited to the electronic percussion instrument 20, and may be a device similar to the keyboard instrument type device 220. The expression may be either physical expression or expression by stereoscopic image display.

  In each embodiment, the detected melody is not limited to the key and note information, and the trigger for the operation of the stick 22 or the like is not limited to the beat timing or the sound generation timing. In addition, the composition in each of the above embodiments may include not only “key” alone, but also a combination of tempo and note strength, or a combination of these and “key”.

It is the external appearance perspective view (figure (a)) of the movement expression apparatus which concerns on the 1st Embodiment of this invention, and the external appearance perspective view (figure (b), (c)) of the movement expression apparatus which shows a modification. It is a block diagram which shows the whole structure of the action expression apparatus. FIG. 4 is a perspective view (a diagram (a)) illustrating a configuration of a drive mechanism that drives a holding unit, and a side view (a diagram (b)) of one worm in the drive mechanism. It is a figure (Drawing (a)) showing operation in a performance mode in a 1st embodiment, and a figure (Drawing (b) and (c)) showing operation in a performance mode in a 2nd embodiment. It is a flowchart of a main process. It is a flowchart of a timer process. It is a flowchart of the timer process in 2nd Embodiment.

Explanation of symbols

  1 CPU (part of mechanical expression means, composition detection means, beat detection means, reading means), 2 storage device (storage means), 5 operation input section (musical sound element input means), 6 performance input section (manual performance section) 8 sound source part (sounding means, musical sound generating means), 9 power output part, 20 electronic percussion instrument (motion expression device), 21 holding part, 22 stick (stick member), 221 slide volume operator (sliding type operator), 223 Keyboard part (musical element input means, manual performance part), MC drive mechanism (part of mechanical expression means)

Claims (11)

Composition detection means for detecting composition of performance data;
Mechanical expression means for expressing a mechanical operation based on the performance data,
The motion expression device, wherein the mechanical expression unit varies the mode of the mechanical operation in accordance with the composition detected by the composition detection unit.   2. The apparatus according to claim 1, further comprising beat detecting means for detecting a beat based on the performance data, wherein the mechanical expressing means expresses the mechanical operation in conjunction with the beat detected by the beat detecting means. The action expression device according to 1.   2. The music detection means detects a key of the performance data as the music, and the mechanical expression means expresses the detected key characteristic by the mechanical action. 3. The motion expression device according to 2.   The music detection means detects note information in the performance data as the music, and the mechanical expression means expresses the characteristic of a note corresponding to the detected note information by the mechanical operation. The motion expression device according to claim 1.   The motion expression device according to claim 1, wherein the mechanical expression unit represents the mechanical operation in a plurality of dimensions.   6. The motion expression device according to claim 5, further comprising sound generation means for sounding a musical sound corresponding to the operation direction in conjunction with an operation by the mechanical expression means.   It has musical tone element input means for inputting musical tone elements, and the mechanical expression means expresses the mechanical movement by operating at least one member constituting the musical tone element input means. The motion expression device according to any one of claims 1 to 6.   8. The motion expression device according to claim 7, wherein the musical sound element input means includes a stick member for inputting rhythm data and a holding unit for holding the stick member.   8. The motion expression device according to claim 7, wherein the musical tone element input means is a slide type operator for inputting musical tone parameters. Storage means for storing automatic performance data;
A manual performance section that allows manual performance,
Reading means for sequentially reading out automatic performance data stored in the storage means;
A musical sound generating means capable of performing an automatic performance based on the automatic performance data read by the reading means and generating a musical sound based on a manual performance by the manual performance section;
Composition detection means for detecting composition of automatic performance data read by the reading means;
Mechanical expression means for expressing a mechanical operation based on automatic performance data read by the reading means,
The mechanical expression means expresses an operation that serves as an index of performance by changing the mode of the mechanical operation in accordance with the composition detected by the composition detection means,
An action expression device configured to perform learning of performance expression by the manual performance unit using a mechanical action expressed by the mechanical expression means as an index. Composition detection means for detecting composition of performance data;
Image display means capable of stereoscopic display;
Three-dimensional display control means for three-dimensionally displaying an image representing an action on the image display means based on the performance data;
The three-dimensional display control unit changes the mode of the operation according to the musical composition detected by the musical composition detection unit.

Images