JP6650101B2 - Music sound generating apparatus, music sound generating method, program and electronic musical instrument - Google Patents

Description

  The present invention relates to a musical sound generator, a musical sound generating method, a program, and an electronic musical instrument that implement vibrato with a simple and intuitive operation.

  2. Description of the Related Art Conventionally, there has been known a musical sound generating apparatus which imparts vibrato as an effect of periodically varying the pitch (pitch) of generated musical sounds to express a feeling of fluctuation. In this type of apparatus, a waveform readout phase (waveform readout speed) is determined according to a vibrato waveform (LFO waveform) determined according to a rate (speed of shaking) or a depth (magnitude of shaking) set by an operation of a control by a user. Is frequency-modulated, and such a technique is disclosed in Patent Document 1.

  Also, for example, in Patent Document 2, in an electronic keyboard musical instrument, each key of a keyboard can be assigned to either a sounding key for sounding or an effect key for effect giving, and after the sounding key is pressed, the sounding key is pressed. When a key at a position away from the key by a predetermined range is depressed, it is regarded as a key depression of the effect key, and the vibrato added to the tone generated by the key depression of the sounding key is controlled according to the key depression time difference of the effect key A technique for performing this is disclosed.

  Further, Patent Document 3 discloses that an initial sensor for detecting a key press and two after sensors for detecting a key press pressure and a key press depth direction are provided for each key of a keyboard, and a key press detected by the initial sensor is provided. While performing aftertouch control in accordance with the output of either of the two independent after sensors, the tone generated according to the key is expressed in a key-pressing manner (tilt, shake, etc.) expressed by the output difference between the two independent after sensors. Techniques for changing the depth and speed of vibrato and other various effects imparted to musical sounds have been disclosed.

  In addition, Patent Literature 4 provides an initial touch sensor for each key on the keyboard and an after touch sensor for detecting pressing in the vicinity of the key pressing end position, and based on the output of both sensors, a playing style (standard A technique is disclosed that detects (play / push play) and applies vibrato, for example, during push play, or prevents vibrato, during standard play, according to the detected playing style.

  Japanese Patent Application Laid-Open No. H11-163873 has a structure in which a keyboard unit can be moved in a horizontal direction with respect to a supporting cabinet (housing). There is disclosed a technique for performing tone control such as pitch bend, thereby enabling the player to easily control the tone without releasing his / her hand from the keyboard.

JP 05-100666 A JP 2010-60583 A JP-A-4-146493 JP 2005-189869 A JP 2001-296868 A

  By the way, in recent years, with the spread of smart devices known as tablet terminals and the like, images of each key (white key, black key) of a keyboard displayed on a liquid crystal display screen are displayed on a touch panel laid on the liquid crystal display screen. A so-called touch panel keyboard for performing a key operation (touch operation) through the keyboard is often used. In a touch panel keyboard, as in the technique disclosed in Patent Document 1, when an operation icon imitating an operator for setting a vibrato parameter (rate / depth) is provided on the touch panel, a beginner user who is unfamiliar with the keyboard has a key. There is an adverse effect that the operation of the operator is not noticeable because the user concentrates on the operation.

  In the technique disclosed in Patent Document 2, each key of the keyboard is regarded as a switch operator (a sounding key for sound generation or an effect key for effect addition), and a plurality of effect keys are pressed after the sounding key is pressed. Since a key operation different from a normal performance such as depressing a key is required, a key operation which is extremely difficult for a beginner user who is unfamiliar with the keyboard.

  In addition, the techniques disclosed in Patent Documents 3 to 5 are applied to a touch panel keyboard because each key of the keyboard is provided with an after touch sensor or a mechanism for detecting a variation of the keyboard is provided. I can't do that.

  Therefore, in other words, in the conventional technique, when using the touch panel keyboard, there is a problem that vibrato cannot be realized by a simple and intuitive operation.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a musical sound generating device, a musical sound generating method, a program, and an electronic musical instrument capable of realizing vibrato with a simple and intuitive operation. .

To achieve the above object, a musical sound generating device according to one embodiment of the present invention,
A touch panel keyboard capable of displaying a plurality of operators to which different pitches are assigned, and detecting which of the plurality of displayed operators is specified ,
In response to detection of a first operation that designates at least one of the plurality of operators, the sounding unit is instructed to sound at a pitch assigned to the operator designated by the first operation. ,
After the detection of the first operation, a transition is made to an effect imparting mode for imparting a tone processing effect by modulation in accordance with the detection of a second operation performed in the area of the operator designated by the first operation. ,
After shifting to the effect imparting mode, in response to detection of a third operation of sliding within the area of the operation element designated by the first operation, the pitch of the pitch indicated by the first operation is changed. An effect imparting control unit that imparts a tone processing effect of performing modulation at a rate or depth according to the third operation to a musical tone, and instructs the sounding unit to sound the musical tone to which the musical tone processing effect is applied And characterized in that:

  According to the present invention, vibrato can be realized by a simple and intuitive operation.

1 is an external view showing an external appearance of a musical sound generating device 100 according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of the musical sound generating device 100. 5 is a flowchart illustrating an operation of a main routine executed by a CPU 10. 5 is a flowchart illustrating an operation of a key pressing process executed by a CPU 10. 5 is a flowchart illustrating an operation of a key pressing process executed by a CPU 10. FIG. 9 is a diagram for describing an example of an operation of a key pressing process. 4 is a flowchart illustrating an operation of a vibrato process executed by a CPU 10; FIG. 4 is a waveform diagram for explaining a relationship between a vibrato rate VR and a vibrato depth VD in a vibrato waveform. FIG. 4 is a diagram illustrating an example of a rate conversion table RT and a depth conversion table DT. FIG. 14 is a diagram illustrating an example of an operation of changing a vibrato depth VD according to a drag width DW. 5 is a flowchart illustrating an operation of a key release process executed by a CPU 10. FIG. 7 is a diagram for describing a specific operation example of the present embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
A. 1. External Appearance FIG. 1 is an external view showing an external appearance of a musical sound generating apparatus 100 according to an embodiment of the present invention. The tone generator 100 shown in this figure is an example using a well-known smart device, and has a rectangular housing in a top view. On the front of the housing, there is provided a touch panel keyboard TKB for operating a key image of a key (white key, black key) displayed on the liquid crystal display screen via a touch panel laid on the liquid crystal display screen. .

  On a liquid crystal display panel (display unit 12 described later) constituting the touch panel keyboard TKB, for example, images of 26 keys (15 white keys and 11 black keys) are displayed on the screen. On this liquid crystal display panel (display section 12 described later), a touch panel (touch panel section 13 described later) having a capacitive multi-touch detection function using transparent electrodes arranged in a two-dimensional matrix is laid.

  In the touch panel keyboard TKB, as described later, a pressing operation (touch operation) of touching the image of a key displayed on the screen with a finger is a “key press”, and an operation of releasing the touched finger and releasing the touch is “key release”. ". In the touch panel keyboard TKB, touch position information output from the touch panel unit 13 in response to a key press / release operation by the user is treated as a key number (or note number).

B. Configuration FIG. 2 is a block diagram showing a configuration of the musical sound generating device 100. In this figure, the CPU 10 sets the processing operation of each unit of the device in accordance with a switch event output from the switch unit 11 or responds to touch position information output from the touch panel unit 13 constituting the touch panel keyboard TKB described above. A note-on note-off event is generated and supplied to the sound generator 16. The characteristic processing operation of the CPU 10 according to the gist of the present invention will be described later in detail.

  The switch unit 11 is composed of various operation switches such as a power switch and a volume switch provided on the side of the apparatus and the lower part of the panel, and generates a switch event of a type corresponding to the switch operation. The switch event generated by the switch unit 11 is captured by the CPU 10. The display unit 12 includes a liquid crystal display panel and the like. Under the control of the CPU 10, the display unit 12 displays a key image on a screen in a display form corresponding to the depressing and releasing of each key constituting the touch panel keyboard TKB. On the upper margin side of the keyboard TKB, the setting state and operation state of each unit of the apparatus are displayed on the screen as necessary.

  As described above, the touch panel unit 13 is provided on the liquid crystal display panel constituting the display screen of the display unit 12 and includes a capacitive touch panel using transparent electrodes arranged in a two-dimensional matrix. The touch panel unit 13 detects a touch position on a display screen including the touch panel keyboard TKB and outputs touch position information. When an icon that functions as an operation switch is provided in the touch detection area other than the touch panel keyboard TKB in the touch panel section 13, touch position information corresponding to the touch operation of the icon is generated.

  The ROM 14 stores various control programs loaded on the CPU 10, and also stores image data of each key (an image indicating a key pressed state / an image indicating a key released state) to be displayed on the screen of the display unit 12. The various control programs stored in the ROM 14 include a main routine, a key pressing process, a vibrato process, and a key release process described later.

  The RAM 15 includes a work area WA and a data area DA. In the work area WA of the RAM 15, various register / flag data used for the processing of the CPU 10 is temporarily stored. The data area DA stores a rate conversion table RT for converting the drag speed DS to the vibrato rate VR and a depth conversion table DT for converting the drag width DW to the vibrato depth VD. The intention of the rate conversion table RT and the depth conversion table DT will be described later.

  The sound generator 16 includes a sound source 16a and a sound system 16b. The sound source section 16a has a plurality of tone generation channels configured by a well-known waveform memory reading method, generates musical tone waveform data W in accordance with note-on / note-off events supplied from the CPU 10, and performs a predetermined drag operation (described later). Is performed, vibrato is added to the generated musical sound. The sound system 16b converts the tone waveform data W output from the sound source unit 16a into an analog tone signal, performs filtering such as removing unnecessary noise from the tone signal, amplifies the signal, and amplifies the filtered signal. From the beginning.

C. Operation Next, with reference to FIGS. 3 to 12, each operation of the main routine, the key pressing process, the vibrato process, and the key release process executed by the CPU 10 of the musical sound generating device 100 having the above configuration will be described. In the following description of the operation, the CPU 10 operates as the main unit unless otherwise specified.

(1) Operation of Main Routine FIG. 3 is a flowchart showing the operation of the main routine executed by the CPU 10. When the musical sound generator 100 is powered on in accordance with the power switch on setting, the CPU 10 executes a main routine and proceeds to step SA1 shown in FIG. 3 to execute initialization for initializing each unit of the apparatus. Then, in the next step SA2, the touch panel keyboard TKB (see FIG. 1) is displayed on the display unit 12 (liquid crystal display panel) using the image data of each key stored in the ROM 14. In this case, all keys on the touch panel keyboard TKB are displayed on the screen in a released state.

  Next, in step SA3, a switch event output from the switch unit 11, such as adjusting the volume of a generated musical tone in response to a volume switch operation, or a touch operation of an icon provided in a touch detection area excluding the touch panel keyboard TKB. Switch processing for setting the operation of each unit of the device in accordance with the touch event to be performed.

  Next, in step SA4, it is determined whether or not the end switch provided in the switch unit 11 has been operated (end operation). If the user has performed the ending operation, the determination result is “YES”, and this routine ends. If the ending operation is not performed, the determination result is “NO”, and the flow advances to next Step SA5.

  In step SA5, it is determined whether or not there is a key press (press operation) on the touch panel keyboard TKB (touch panel section 13). Here, the key press (press operation) means a case where the image area of the key on the touch panel keyboard TKB is touched for the first time, and a case where the key operation is dragged left and right within the image area of the touched key after the initial touch. . The drag operation refers to a slide operation of moving while touching a touch panel with a finger. When a key press (press operation) on the touch panel keyboard TKB is detected, the result of the determination in step SA5 becomes “YES”, and the flow advances to next step SA6 to execute a key press process.

  In the key pressing process, as described later, each of the keys pressed on the touch panel keyboard TKB determines whether the key is an unpressed key that has been first touched or a pressed key that is dragged after the first touch. Determine. If the key has not been pressed yet for the first time, the press flag OF corresponding to the key is set to "1" to set the key to the pressed state. Thereafter, when the left and right drag operation is repeated a predetermined number of times or more (a plurality of times) within the image range of the key in the key pressed state, the key becomes a vibrato-giving key, and the drag speed DS and the drag width DW of the left and right drag operation are obtained. Is converted into a vibrato rate VR and a vibrato depth VD, respectively, and the sound source section 16a is instructed to generate a vibrato waveform (LFO waveform) determined by these parameters. As a result, the vibrato in the mode specified by the vibrato rate VR and the vibrato depth VD is given to a musical tone generated at a pitch (pitch) corresponding to the key number of the key in the key pressed state.

  On the other hand, if the key is in a pressed state in which a drag operation is performed after the first touch, it is determined whether or not the key is a vibrato-given key. If the key is a vibrato-given key, the center X coordinate of the drag width DW is changed. When a left-right drag operation that fits within the image range of the key is performed, the vibrato rate VR and the vibrato depth VD are updated according to the drag speed DS and the drag width DW of the left-right drag operation, and are determined by the updated parameters. It instructs the sound source section 16a to generate a vibrato waveform (LFO waveform). As a result, if a left-right drag operation is performed around the key to which the vibrato is applied, the mode of the vibrato is changed by changing the drag speed DS and the drag width DW of the left-right drag operation.

  On the other hand, if the key is not pressed (pressing operation) on the touch panel keyboard TKB, the result of the determination in step SA5 is “NO”, the process proceeds to step SA7, and the key is released based on the key change detection result in step SA5 (step SA5). Touch release; release touch). If the key being depressed is not released, the determination result is "NO", and the process proceeds to Step SA9 described later. If the key being released is released, the determination result is "YES". , And the flow advances to the next Step SA8 to execute a key release process.

  In the key release process of step SA8, as described later, after generating a note-off event corresponding to the released key and instructing the sound source section 16a to mute the sound, the image of the mute key is released from the key pressed state. Switch to state. Then, the press flag OF and the vibrato flag VIF associated with the released key are set to “0”, the number of left / right drag operations LRDC is cleared, and the flow advances to the next Step SA9.

  In step SA9, in response to the key press / release performed on the touch panel keyboard TKB, the image of the key pressed (depressed operation) is replaced with the image of the key pressed state, and the image of the key released (touch released) is displayed. After updating the display of the image in the key released state, the process returns to step SA3.

  In step SA9, the display is not updated for the image of the key that is not pressed and released. The image of the key pressed state / key released state referred to here is, for example, a display that represents the key pressed state by lowering the luminance of the key image, or represents the key released state by restoring the luminance. Refers to control. The present invention is not limited to this, and the display color, color, and contrast of the key image may be changed to express the key pressed state / key released state or to display the key pressed state / key released state in 3D.

  When the process returns to step SA3, steps SA3 to SA9 are repeated until the end switch provided on the switch unit 11 is operated. When the end switch provided in the switch section 11 is operated, the result of the determination in step SA4 becomes "YES", and this routine is completed.

(2) Operation of Key Pressing Process Next, the operation of the key pressing process will be described with reference to FIG. FIG. 4 is a flowchart showing the operation of the key pressing process. When this processing is executed via step SA6 (see FIG. 3) of the main routine described above, the CPU 10 proceeds to step SB1 shown in FIG. 4, and depresses (touches) each key of the touch panel keyboard TKB. The total number of touched keys is acquired, and this is temporarily stored as the total number T of touches. Here, the total touch number T refers to the key that has been pressed as described above, that is, the key that has been touched for the first time on the touch panel keyboard TKB or the key that has been dragged after the first touch.

  Subsequently, in step SB2, a pointer i designating the pressed key is set to an initial value "0". Then, in step SB3, it is determined whether or not the value of the pointer i is smaller than the total number of touches T, that is, whether or not the stapling process has been repeatedly executed for the number of total touches T. If the value of the pointer i is smaller than the total number of touches T, the determination result is "YES", and the flow proceeds to the next Step SB4.

  In step SB4, it is determined whether or not the pressed flag OF of the key (i) designated by the pointer i is "0" among the pressed keys. The press flag OF becomes “1” in the key pressed state and “0” in the unpressed state. That is, here, it is determined whether or not the key (i) designated by the pointer i is in an unpressed state immediately after the first touch. The operation of the key (i) specified by the pointer i will be described separately for a case where the key is not pressed immediately after the first touch and a case where the key (i) is pressed.

a. When the key (i) specified by the pointer i is in an unpressed state immediately after the first touch In this case, since the press flag OF of the key (i) specified by the pointer i is “0”, the determination result in step SB4 Is "YES", and the routine proceeds to step SB5. In step SB5, the press flag OF of the key (i) designated by the pointer i is set to "1", indicating that the key is pressed according to the first touch.

  Then, in a step SB6, it is determined whether or not the drag operation is performed right and left within the image range of the key (i) touched for the first time. Now, for example, as shown in FIG. 6A, after touching the key image of the key number 72 (C5: C) for the first time on the touch panel keyboard TKB, as shown in FIG. It is assumed that the user drags left and right within the image range of.

  Then, the result of the determination in step SB6 is "YES", and the flow proceeds to step SB7. In step SB7, a counter LRDC for counting the number of left and right drag operations is incremented to advance. Hereinafter, the value of the counter LRDC will be referred to as a left / right drag operation count LRDC.

  Next, in step SB8, it is determined whether or not the stepped left / right drag operation count LRDC is larger than a predetermined count α. The predetermined number α is a threshold for determining whether or not to apply vibrato. When the number of left and right drag operations LRDC exceeds a predetermined number α (threshold), the result of the determination in step SB8 becomes “YES”, and the vibrato process is executed via step SB9.

  In the vibrato process, as described later, the vibrato flag VR and the vibrato depth VD of the key (i) designated by the pointer i are set to "1", and then the vibrato rate VR and the vibrato depth VD are set to default values. set. Then, the drag speed DS and the drag width DW of the left and right drag operation performed on the touch panel keyboard TKB are detected, and the detected drag speed DS and drag width DW are converted into a vibrato rate VR and a vibrato depth VD, respectively, and are determined by these parameters. It instructs the sound source section 16a to generate a vibrato waveform (LFO waveform).

  Subsequently, in step SB10, a sound generation process is executed in which a note-on event including the key number of the key (i) designated by the pointer i and in the depressed state is generated and sent to the tone generator 16a. For example, as illustrated in FIG. 6A, when the key of the key number 72 (C5: C) is touched for the first time on the touch panel keyboard TKB and the key is in a pressed state, the key number 72 is included. By generating a note-on event and sending it to the sound source section 16a, the sound generating section 16 generates a C5 sound (d).

  Further, as shown in FIG. 6B, when the image range of the key (i) in the key pressed state is repeatedly dragged in the left and right direction by a predetermined number of times α or more, the left and right dragging is performed in the vibrato process in step SB9. The sound source unit 16a is instructed to generate a vibrato waveform (LFO waveform) determined by vibrato parameters (vibrato rate VR and vibrato depth VD) converted based on the drag speed DS and the drag width DW of the operation.

  As a result, the tone generator 16a frequency-modulates the waveform readout phase (waveform readout speed) using the generated vibrato waveform (LFO waveform) to correspond to the key number 72 of the key that has been depressed by the first touch. Vibrato is applied to the musical sound being generated at the pitch (pitch) to be played.

  Note that if the left and right drag operation is not performed on the image range of the key (i) that is in the key pressed state after the first touch, or if the left and right drag operation is not repeated a predetermined number of times α or more, the determination in steps SB6 and SB8 described above is made. The result is "NO", and the flow proceeds to step SB10. In such a case, in step SB10, no vibrato is given, and a musical tone is generated at a pitch (pitch) corresponding to the key number of the key in the depressed state.

  When the sound generation processing in step SB10 is completed in this way, the CPU 10 advances the processing to the next step SB11, increments the pointer i to advance, and returns to the above-described step SB3.

  Thereafter, the operations in and after step SB3 are repeated until the stepped pointer i exceeds the total number of touches T, that is, until all the keys touched for the first time on the touch panel keyboard TKB or the keys dragged after the first touch have been processed. When the stepped pointer i exceeds the total number of touches T and the processing is completed for all of them, the result of the determination in step SB3 becomes "NO", and this processing ends.

b. In the case where the key (i) specified by the pointer i is in the key pressed state In this case, the press flag OF of the key (i) specified by the pointer i is “1”, and the result of the determination in step SB4 is “NO”. Then, the process proceeds to Step SB12 shown in FIG. In step SB12, it is determined whether or not the vibrato flag VIF of the key (i) specified by the pointer i is "1", that is, the key to which vibrato is to be applied. If the vibrato flag VIF of the key (i) specified by the pointer i is “0” (a key not to add vibrato), the determination result is “NO”, and the process proceeds to the above-described step SB6 (see FIG. 4). .

  On the other hand, if the vibrato flag VIF of the key (i) designated by the pointer i is “1” (the key to which vibrato is to be applied), the result of the determination in step SB12 is “YES”, and the flow proceeds to step SB13. In step SB13, it is determined whether a left-right drag operation has been performed on the touch panel keyboard TKB. If the left and right drag operation has not been performed, the determination result is “NO”, and the process proceeds to Step SB16.

  In step SB16, the vibrato flag VIF of the key (i) specified by the pointer i is set to "0" to indicate that the key is not a vibrato. Subsequently, in step SB17, after resetting the number of left and right drag operations LRDC to zero, the above-described sound generation processing in step SB10 is executed.

  As described above, if the key (i) specified by the pointer i is in the pressed state and is a key to which vibrato is to be applied, a key to which vibrato is not applied is not performed unless a left-right drag operation is performed on the touch panel keyboard TKB. A tone having a pitch (pitch) corresponding to the key number of a depressed key is generated.

  On the other hand, when the key (i) specified by the pointer i is in the pressed state and is the key to which vibrato is to be applied, the left and right drag operation is performed on the touch panel keyboard TKB (the touch panel unit 13). Then, the result of the determination in step SB13 becomes "YES", and the flow proceeds to step SB14.

  In step SB14, a drag width DW is detected from touch position information generated by a left-right drag operation performed on the touch panel keyboard TKB, and a center X coordinate of the drag width DW is acquired. Note that the X coordinate here indicates a position in the longitudinal direction (lateral direction) of the touch panel keyboard TKB.

  Subsequently, in step SB15, it is determined whether or not the acquired center X coordinate is within the key image range of the key (i) specified by the point i. Now, for example, when the key (i) to which vibrato is to be applied is the key number 72 (C5: C) on the touch panel keyboard TKB as in the example shown in FIG. ) To a key with a key number 74 (D5: レ).

  Then, since the center X coordinate of the drag width DW falls within the key image range of the key (i) to which the vibrato is applied, the determination result in step SB15 becomes “YES”, and the process proceeds to step SB9 (see FIG. 4) described above. Then, the vibrato process (see FIG. 7) is performed. In this case, in the vibrato process, as described later, the drag speed DS and the drag width DW of the left-right drag operation are detected, and the detected drag speed DS and the drag width DW are converted into a vibrato rate VR and a vibrato depth VD, respectively. The sound source unit 16a is instructed to generate a vibrato waveform (LFO waveform) determined by parameters.

  Further, for example, when the key (i) to which vibrato is to be applied is the key number 72 (C5: C) on the touch panel keyboard TKB as in the example shown in FIG. ) To the key with the key number 76 (E5: M). Then, also in this case, since the center X coordinate of the drag width DW falls within the key image range of the key (i) to which vibrato is to be applied, the determination result of step SB15 becomes “YES”, and the above-described step SB9 (see FIG. 4). ) To execute a vibrato process (see FIG. 7).

  In the vibrato process, as will be described later, if the drag speed DS of the left and right drag operation does not change, the vibrato depth VD is updated with an increase in the drag width DW. Further, when the drag speed DS of the left and right drag operation also changes as the drag width DW increases, the vibrato rate VR is updated according to the change in the drag speed DS.

  As described above, in the key pressing process, it is determined whether each key pressed on the touch panel keyboard TKB is a key in an unpressed key state touched for the first time or a key in a pressed state dragged after the first touch. If it is determined that the key has been touched for the first time and has not been pressed, the pressing flag OF corresponding to the key is set to “1” and the key is set to the pressed state. When the left and right drag operations are repeated, the drag speed DS and the drag width DW of the right and left drag operations are converted into a vibrato rate VR and a vibrato depth VD, respectively, and a vibrato waveform (LFO waveform) determined by these parameters Is instructed to the sound source unit 16a. As a result, the vibrato in the mode specified by the vibrato rate VR and the vibrato depth VD is given to a musical tone generated at a pitch (pitch) corresponding to the key number of the key in the key pressed state.

  On the other hand, if the key is in the pressed state where the drag operation is performed after the first touch, it is determined whether or not the key is a vibrato-given key. If the key is a vibrato-given key, the center X coordinate of the drag width DW is set to the key. Is performed, the vibrato rate VR and the vibrato depth VD are updated according to the drag speed DS and the drag width DW of the left-right drag operation, and the vibrato waveform determined by the updated parameters (LFO waveform) is instructed to the sound source unit 16a. As a result, if a left-right drag operation is performed around the key to which the vibrato is applied, the mode of the vibrato is changed by changing the drag speed DS and the drag width DW of the left-right drag operation.

(3) Operation of Vibrato Process Next, the operation of the vibrato process will be described with reference to FIGS. 7 is a flowchart showing the operation of the vibrato process, FIG. 8 is a waveform diagram for explaining the relationship between the vibrato rate VR and the vibrato depth VD in the vibrato waveform, and FIG. 9 shows an example of the rate conversion table RT and the depth conversion table DT. FIG.

  When this processing is executed via the above-described key pressing step SB9 (see FIG. 4), the CPU 10 advances the processing to step SC1 shown in FIG. The vibrato flag VIF is set to “1.” When the vibrato flag VIF is “1”, the vibrato is added, and when “0”, the vibrato is not added.

  Subsequently, in steps SC2 to SC3, the vibrato rate VR and the vibrato depth VD are respectively set to predetermined default values. Here, the relationship between the vibrato rate VR and the vibrato depth VD in the vibrato waveform will be described with reference to FIG. The vibrato waveform (LFO waveform) frequency-modulates the waveform reading phase (waveform reading speed) to periodically change the pitch of the generated musical sound (original sound). Although the vibrato waveform in the example shown in FIG. 8 is a sine waveform, it is not limited to this, and a periodic waveform such as a triangular wave may be used.

  The vibrato rate VR specifies the cycle of the vibrato waveform, that is, the speed of fluctuation of the pitch. When the vibrato rate VR is increased, the modulation frequency is increased and the speed of the swing is increased. Conversely, when the vibrato rate VR is decreased, the modulation frequency is decreased and the speed of the swing is decreased. The vibrato depth VD specifies the amplitude of the vibrato waveform, that is, the magnitude of the pitch fluctuation. Increasing the vibrato depth VD increases the modulation depth and increases the fluctuation, and conversely, decreasing the modulation depth decreases the modulation depth and reduces the fluctuation.

  Returning to FIG. 7, the operation of the vibrato process will be described. After setting the default values of vibrato rate VR and vibrato depth VD in steps SC2 to SC3, the process proceeds to step SC4. In step SC4, the drag speed DS is obtained from the temporal change of the touch position information generated by the left and right drag operation performed on the touch panel keyboard TKB. Is detected. The detected drag speed DS is an average speed.

  Subsequently, in step SC5, the drag speed DS detected in step SC4 is converted into a vibrato rate VR with reference to the rate conversion table RT stored in the data area DA of the RAM 15. As shown in FIG. 9A, the rate conversion table RT is a data table in which rate values of preset conversion characteristics are stored, and from which a vibrato rate VR corresponding to the drag speed DS is read. In the example illustrated in FIG. 9A, linear conversion characteristics are used. However, the present invention is not limited thereto, and nonlinear conversion characteristics may be used.

  Next, in step SC6, a drag width DW is detected from touch position information generated by a left-right drag operation performed on the touch panel keyboard TKB. In step SC7, the drag width DW detected in step SC6 is converted into a vibrato depth VD with reference to the depth conversion table DT stored in the data area DA of the RAM 15. As shown in FIG. 9B, the depth conversion table DT is a data table in which depth values of preset conversion characteristics are stored, and from which a vibrato depth VD corresponding to the drag width DW is read. The example illustrated in FIG. 9B is a linear conversion characteristic, but is not limited thereto, and may be a nonlinear conversion characteristic.

  Next, in step SC8, the sound source unit 16a is instructed to generate a vibrato waveform (LFO waveform) determined by the vibrato rate VR according to the drag speed DS and the vibrato depth VD according to the drag width DW, and the process ends. In the sound source section 16a, the waveform readout phase (waveform readout speed) is frequency-modulated using a vibrato waveform (LFO waveform) generated in accordance with the parameter designation, and vibrato is added to the generated musical sound (original sound).

  As described above, in the vibrato processing, the vibrato flag VR and the vibrato depth VD are set to the default values after setting the vibrato flag VIF of the key (i) designated by the pointer i and subjected to the vibrato addition to "1". I do. Then, the drag speed DS and the drag width DW of the left and right drag operation performed on the touch panel keyboard TKB (the touch panel unit 13) are detected, and the detected drag speed DS and drag width DW are converted into a vibrato rate VR and a vibrato depth VD, respectively. The sound source unit 16a is instructed to generate a vibrato waveform (LFO waveform) determined by these parameters.

(4) Operation of Key Release Processing Next, the operation of the key release processing will be described with reference to FIG. FIG. 11 is a flowchart showing the operation of the key release process. When this processing is executed through step SA8 (see FIG. 3) of the main routine described above, the CPU 10 proceeds to step SD1 shown in FIG. 12, and executes a note-off event corresponding to the released key (touch release). And instructs the sound source section 16a to mute the sound. As a result, the tone generator 16a silences the musical tone having the pitch specified by the note-off event.

  Subsequently, in step SD2, an instruction is issued to switch the key image muted by the key release from the key pressed state to the key released state. In accordance with the switching instruction, the display of the keyboard image is updated in step SA9 (see FIG. 3) described above. Next, in steps SD3 and SD4, the press flag OF and the vibrato flag VIF associated with the released key are set to “0”, and in the subsequent step SD5, the number of left and right drag operations LRDC is cleared and the present processing is performed. Finish.

  As described above, in the present embodiment, when the key image of the key having the key number 72 (C5: C) is pressed on the touch panel keyboard TKB as in the example illustrated in FIG. Is generated and sent to the sound source unit 16a, thereby generating a tone having a pitch of C5 (d).

  Then, as shown in FIG. 7B, when the left and right drag operation is repeated a predetermined number of times α or more within the key image range of the key number 72 (C5: C) in the depressed state, the key to which the vibrato is applied is given. , The drag speed DS and the drag width DW of the left and right drag operation are converted into a vibrato rate VR and a vibrato depth VD, respectively, and the sound is being produced at a pitch of C5 (d) according to a vibrato waveform (LFO waveform) determined by these parameters. Since the vibrato is added to the musical tone of, the vibrato can be realized by an easy and intuitive operation.

  Thereafter, as shown in FIG. 3C, when a left-right drag operation is performed in which the center X coordinate of the drag width DW falls within the image range of the key to which the vibrato is applied, that is, the center of the key to which the vibrato is applied Is performed, the vibrato rate VR and the vibrato depth VD are updated in accordance with the drag speed DS and the drag width DW of the left / right drag operation, so that the musical tone being generated at the pitch of C5 (d) is updated. The attribute of the vibrato to be given can be changed by a simple and intuitive operation.

  In the above-described embodiment, since the left and right drag operation is repeated a predetermined number of times or more within the image range of the key in the key pressed state, the key is set as a vibrato-giving target key. The timing of applying vibrato can be adjusted by a drag operation / slow left / right drag operation).

  Alternatively, when the left and right drag operation is performed for a certain period of time or more within the image range of the key in the key pressed state, or when the acceleration of the left and right drag operation exceeds a predetermined threshold, the vibrato addition target is added. The key may be set. The acceleration of the left and right drag operation is calculated based on touch position information that changes with time according to the drag operation.

  Further, in the present embodiment, the left and right drag operations are repeated within the image range of the key in the key pressed state to set the key to which the vibrato is to be applied. When an upward or downward flick operation is performed within the image range of the key, a mode in which the key is set as a vibrato-given key is also possible. Note that the flick operation referred to here refers to an operation of swiping a finger that is in contact within the image range of the key upward or downward.

  In addition, in the above-described embodiment, an example in which the pitch of the generated musical tone is modulated to provide vibrato has been described.However, the present invention is not limited to vibrato, and a wah wah that modulates the tone color of the generated musical tone, and a volume of the generated musical tone. In addition to the tremolo that modulates, the present invention can be applied to a form in which a musical effect (effect) for processing a musical sound such as chorus or flanger, which is a modulation effect, is applied.

  As mentioned above, although one Embodiment of this invention was described, this invention is not limited to it, It is included in the invention as described in the claim of this application, and its equivalent range. Hereinafter, each invention described in the claims at the beginning of the filing of the present application will be additionally described.

(Note)
[Claim 1]
Multiple controls to which different pitches are assigned,
When detecting a first operation for designating at least one of the plurality of operators, the controller instructs the sound generator to generate a sound at a pitch assigned to the operator designated by the first operation. ,
After the first operation, if a second operation is detected in the area of the operation element specified by the first operation, a tone having a pitch instructed by the first operation is generated. And an effect application control unit that applies a tone processing effect corresponding to the second operation, and instructs the sounding unit to generate a tone to which the tone processing effect has been added. apparatus.

[Claim 2]
2. The musical sound generating apparatus according to claim 1, wherein the second operation is an operation in which the operator repeatedly slides the specified operation element on the operation panel in a bidirectional manner a plurality of times.

[Claim 3]
The effect imparting control unit imparts the musical tone processing effect to a musical tone having a pitch specified by the first operation at a rate and a depth corresponding to an operation speed and an operation width of the second operation. The tone generator according to claim 1 or 2, wherein:

[Claim 4]
When the center of the operation width of the second operation is within the area of the operation element specified by the first operation, the effect imparting control unit may set the operation speed and the operation width of the second operation to be different. 4. The tone generator according to claim 1, wherein the tone processing effect is applied to a tone having a pitch indicated by the first operation at a corresponding rate and depth.

[Claim 5]
The tone generator according to claim 1, further comprising an operation panel on which the plurality of operators are displayed.

[Claim 6]
At least a tone generator according to any one of claims 1 to 5,
A sound generating unit that generates a musical tone instructed by the effect imparting control unit;
An electronic musical instrument comprising:

[Claim 7]
A method performed by a tone generator including a plurality of operators to which different pitches are assigned,
When detecting a first operation for designating at least one of the plurality of operators, the controller instructs the sound generator to generate a sound at a pitch assigned to the operator designated by the first operation. ,
After the first operation, if a second operation is detected in the area of the operation element specified by the first operation, a tone having a pitch instructed by the first operation is generated. Providing a tone processing effect corresponding to the second operation, and instructing the sounding unit to sound the tone to which the tone processing effect has been applied.

[Claim 8]
A computer used as a tone generator including a plurality of operators to which different pitches are assigned,
When detecting a first operation for designating at least one of the plurality of operators, the sound generator is instructed to sound at a pitch assigned to the operator specified by the first operation. Steps and
After the first operation, if a second operation is detected in the area of the operation element specified by the first operation, a tone having a pitch instructed by the first operation is generated. Providing a tone processing effect corresponding to the second operation, and instructing the sounding unit to sound the tone to which the tone processing effect has been added;
A program characterized by executing

10 CPU
DESCRIPTION OF SYMBOLS 11 Switch part 12 Display part 13 Touch panel part 14 ROM
15 RAM
Reference Signs List 16 sound generator 16a sound generator 16b sound system 100 tone generator TKB touch panel keyboard

Claims (10)

A touch panel keyboard capable of displaying a plurality of operators to which different pitches are assigned, and detecting which of the plurality of displayed operators is specified ,
In response to detection of a first operation that designates at least one of the plurality of operators, the sounding unit is instructed to sound at a pitch assigned to the operator designated by the first operation. ,
After the detection of the first operation, a transition is made to an effect imparting mode for imparting a tone processing effect by modulation in accordance with the detection of a second operation performed in the area of the operator designated by the first operation. ,
After shifting to the effect imparting mode, in response to a third operation of sliding within the area of the operation element specified by the first operation, a tone having a pitch instructed by the first operation is generated. And an effect applying control unit that gives a tone processing effect of performing modulation at a rate or depth according to the third operation, and instructs the sounding unit to sound a tone to which the tone processing effect has been given. A musical sound generator equipped. 2. The tone generating apparatus according to claim 1, wherein the effect imparting control unit does not instruct the application of the tone processing effect even before detecting the third operation before shifting to the effect imparting mode. 3. . The second operation is an operation in which the operator repeatedly slides on the specified operator of the touch panel keyboard a plurality of times in two directions,
The musical sound generating device according to claim 1, wherein the effect imparting control unit shifts to the effect imparting mode when the number of times of the bidirectional slide operation is equal to or greater than a predetermined number. The effect imparting control unit is configured to, when a center of an operation width of the third operation is within a region of the operation element specified by the first operation, generate a tone of the musical tone to which the musical tone processing effect is imparted. The musical sound generator according to any one of claims 1 to 3, which instructs the sound generator. The effect applying control unit may be configured such that, during the application of the tone processing effect according to the second operation, the center of the operation width of the third operation is set within the range of the operation element specified by the first operation. The tone generator according to claim 4 , wherein the application of the tone processing effect is stopped when the tone is deviated. A touch panel keyboard capable of displaying a plurality of operators to which different pitches are assigned, and detecting which of the plurality of displayed operators is specified,
A sound generating unit that generates a musical tone having a specified pitch and imparts a musical sound processing effect to the generated musical tone by modulating a specified rate or depth;
Information for converting the speed of a slide by a slide operation performed on the touch panel keyboard into a rate for performing the modulation, or information for converting the width of the slide by the slide operation to a depth for performing the modulation. A storage unit storing certain conversion information;
When detecting a first operation specifying at least one of the plurality of operators, instructs the sounding unit to generate a sound at a pitch assigned to the operator specified by the first operation. And
If, after the first operation, a second operation of sliding within the area of the operation element designated by the first operation is detected, the slide by the second operation is performed based on the conversion information. Performing a conversion process, which is a process of converting the speed of the slide into a rate when performing the modulation, or a process of converting the width of the slide by the second operation into a depth when performing the modulation,
An effect instructing the sounding unit to give a tone processing effect by a modulation of a rate or a depth obtained by conversion by the conversion process to a tone having a pitch instructed by the first operation. Control unit and
A tone generator comprising: The tone processing effects, vibrato effect to modulate the pitch of sound tone, timbre and modulates wah effect of generating musical tones, comprising at least one of tremolo effect to modulate the volume of musical tones to be generated, to claim 1 7. The musical sound generator according to any one of 6 . At least a tone generator according to any one of claims 1 to 5 ,
A sound generating unit that generates a musical tone instructed by the effect imparting control unit;
An electronic musical instrument comprising: A musical sound generator including a touch panel keyboard capable of displaying a plurality of operators to which different pitches are assigned and detecting which of the displayed plurality of operators is designated. The method to be performed,
In response to detection of a first operation that designates at least one of the plurality of operators, the sounding unit is instructed to sound at a pitch assigned to the operator designated by the first operation. ,
After the detection of the first operation, a transition is made to an effect imparting mode for imparting a tone processing effect by modulation in accordance with the detection of a second operation performed in the area of the operator designated by the first operation. ,
After shifting to the effect imparting mode, in response to detection of a third operation of sliding within the area of the operation element designated by the first operation, the pitch of the pitch indicated by the first operation is changed. Applying a tone processing effect of performing modulation at a rate or depth according to the third operation to the tone, and instructing the sounding unit to generate a tone to which the tone processing effect is applied. Musical sound generation method. A musical sound generator including a touch panel keyboard capable of displaying a plurality of operators to which different pitches are assigned and detecting which of the displayed plurality of operators is designated. In the computer used,
In response to detection of a first operation that specifies at least one of the plurality of operators, the sounding unit is instructed to sound at a pitch assigned to the operator specified by the first operation. Steps and
After the detection of the first operation, a transition is made to an effect imparting mode for imparting a tone processing effect by modulation in accordance with the detection of a second operation performed in the area of the operator designated by the first operation. ,
After shifting to the effect imparting mode, in response to detection of a third operation of sliding within the area of the operation element designated by the first operation, the pitch of the pitch indicated by the first operation is changed. Providing a tone processing effect of performing modulation at a rate or depth according to the third operation to the tone, and instructing the sounding unit to sound the tone to which the tone processing effect has been added;
A program characterized by causing the program to execute.

Images