JP2010191124A - Sound effect generation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To properly change tone of waveform data that is output on the basis of acceleration and jerk that is the amount of variation of the acceleration. <P>SOLUTION: A CPU 11 calculates acceleration or jerk of input waveform data that is input via a waveform data input I/F 17. Further, the CPU 11 generates new output waveform data on the basis of the previous waveform data in preset waveform data read from a ROM 12 and the calculated acceleration or jerk so that the acceleration or jerk at the present time becomes the acceleration or jerk of the output waveform data at the present time, and outputs the new output waveform data to a sound source part 12. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a sound effect generator for controlling a timbre by using acceleration of input waveform data and jerk that is a change amount thereof.

  A technology is known that extracts the pitch from waveform data based on sound input from a microphone or musical sound waveform data output from a guitar, and generates and outputs waveform data for output based on the extracted pitch. ing. For example, in Patent Document 1 and Patent Document 2, the pitch (pitch) and envelope of musical sound waveform data emitted from six strings of a guitar are extracted, and musical sound waveform data of a predetermined tone color is extracted from a ROM or the like. Reading is performed based on the extracted pitch, and an extracted envelope is given to generate new musical sound waveform data. Moreover, in patent document 3, the pitch is extracted based on the audio | voice input from the microphone.

  In Patent Document 1, the input waveform data is filtered, the zero-cross point of the filtered waveform data is detected, the time when the waveform data takes a positive value is measured by a counter, and the waveform data The time for which takes a negative value is measured by another counter, the vibration of the fundamental wave of the string is detected by referring to both counter values, and the pitch of the waveform data is extracted. In Patent Document 3, the time interval of the zero cross point that changes from negative to positive is measured, and the time interval of the zero cross point that converts from positive to negative is measured. The pitch is determined from the interval.

JP 63-298396 A Japanese Patent Laid-Open No. 9-6351 JP-A-6-95662

  In order to extract the pitch from the input waveform data as described above, it is necessary to measure the time of at least one half wave. For example, if this is considered in the bass range, there will be a delay of several tens of milliseconds. Even in the guitar range, it takes at least a few milliseconds to extract the pitch.

  Therefore, there is a demand for a method of generating output waveform data reflecting input waveform data with an excellent response using elements other than the pitch in the input waveform data.

  For example, acceleration is considered to be an element that makes the presence of a speed change or vibration. Further, jerk indicating a change in acceleration is considered to be an element that causes a change in force. Therefore, when the acceleration changes from positive to negative, it can be felt that the force is reversed due to the change in jerk.

  What musical sound is played by the waveform data is defined not only by the pitch (pitch), but also by the acceleration that is the change in velocity in the waveform data and the jerk that is the change in acceleration. Conceivable.

  Accordingly, an object of the present invention is to provide a sound effect generating device that can appropriately change the tone color of output waveform data based on acceleration and jerk that is the amount of change.

An object of the present invention is a sound effect generator for generating a sound effect based on input waveform data,
Acceleration calculation means for calculating the acceleration of the input waveform data;
Original waveform data storage means for storing predetermined original waveform data, which is the basis of musical sound waveform data to be output;
Output waveform data generating means for generating new output waveform data to be output based on the acceleration calculated by the acceleration calculating means and the past original waveform data stored in the original waveform data storage means; This is achieved by a sound effect generator characterized by comprising:

  In a preferred embodiment, the output waveform data generating means causes the acceleration A (t) so that the acceleration A (t) at the current time t becomes the acceleration of the output waveform data X (t) at the current time t. The output waveform data X (t) is calculated based on the past original waveform data g (t−t1) and g (t−t2) (t1 <t2).

In a more preferred embodiment, the output waveform data generating means is
X (t) = A (t) · Δt ² +2 g (t−1) −g (t−2)
(Δt is the sampling period of waveform data)
Based on the above, output waveform data X (t) is calculated.

In another preferred embodiment, when the output waveform data generating means is time t is a multiple of n · Δt (n is a predetermined constant),
X (t) = A (t) · Δt ² +2 g (t−1) −g (t−2)
(Δt is the sampling period of waveform data)
When time t is not a multiple of n · Δt,
X (t) = g (t)
Based on the above, output waveform data X (t) is calculated.

In still another preferred embodiment, the output waveform data generating means is
X (t) = A (t) .T ² +2 g (t−n) −g (t−2n)
(T = n · Δt, Δt is a sampling period of waveform data, and n is a predetermined constant)
Based on the above, output waveform data X (t) is calculated.

  Further, in a preferred embodiment, the output waveform data generating means generates waveform data generated based on the acceleration and past original waveform data from the start of output waveform data until a predetermined timing. Then, it is output as new output waveform data, and after the predetermined timing has arrived, the original waveform data is output as new output waveform data.

In another preferred embodiment, it comprises pitch extraction means for extracting the pitch of the input waveform data,
The output waveform data generation means outputs the waveform data generated based on the acceleration and the past original waveform data as new output waveform data from the start of the sound generation of the output waveform data until a predetermined timing. Then, after the predetermined timing has arrived, waveform data obtained by reading the original waveform data stored in the original waveform data storage means according to the extracted pitch is output as new output waveform data.

Another object of the present invention is a sound effect generator for generating a sound effect based on input waveform data,
Acceleration calculation means for calculating the jerk of the input waveform data;
Original waveform data storage means for storing predetermined original waveform data, which is the basis of musical sound waveform data to be output;
Output waveform data generation means for generating new output waveform data to be output based on jerk calculated by the acceleration calculation means and past original waveform data stored in the original waveform data storage means And achieving the sound effect generator.

  In a preferred embodiment, the output waveform data generating means is configured so that the jerk P (t) at the current time t becomes the acceleration of the output waveform data X (t) at the current time t. Based on P (t), past original waveform data g (t−t1), g (t−t2) and g (t−t3) (t1 <t2 <t3), the output waveform data X (t) is It is configured to calculate.

In a more preferred embodiment, the output waveform data generating means is
X (t) = P (t) · Δt ³ +3 g (t−1) −3 g (t−2) + g (t−3)
(Δt is the sampling period of waveform data)
Based on the above, output waveform data X (t) is calculated.

In another preferred embodiment, when the output waveform data generating means is time t is a multiple of n · Δt (n is a predetermined constant),
X (t) = P (t) · Δt ³ +3 g (t−1) −3 g (t−2) + g (t−3)
(Δt is the sampling period of waveform data)
When time t is not a multiple of n · Δt,
X (t) = g (t)
Based on the above, output waveform data X (t) is calculated.

In still another preferred embodiment, the output waveform data generating means is
X (t) = P (t) · T ³ +3 g (t−n) −3 g (t−2n) + g (t−3n)
(T = n · Δt, Δt is a sampling period of waveform data, and n is a predetermined constant)
Based on the above, output waveform data X (t) is calculated.

  In a preferred embodiment, the output waveform data generating means generates a waveform generated based on the jerk and past original waveform data from the start of output waveform data until a predetermined timing is reached. The data is output as new output waveform data, and after the predetermined timing has arrived, the original waveform data is output as new output waveform data.

In another preferred embodiment, it comprises pitch extraction means for extracting the pitch of the input waveform data,
The output waveform data generation means generates new output waveform data from the waveform data generated based on the jerk and the past original waveform data until the predetermined timing is reached after the output waveform data starts sounding. After the predetermined timing has arrived, the waveform data obtained by reading the original waveform data stored in the original waveform data storage means according to the extracted pitch is output as new output waveform data To do.

  According to the present invention, it is possible to provide a sound effect generating device capable of appropriately changing the tone color of the output waveform data based on the acceleration and the jerk that is the amount of change.

FIG. 1 is a block diagram showing a configuration of a sound effect generator according to a first embodiment of the present invention. FIG. 2 is a flowchart showing a process executed by the sound effect generator according to the present embodiment. FIG. 3 is a flowchart showing an example of the switch processing according to the present embodiment. FIG. 4 is a flowchart showing an example of the input waveform storage process according to the present embodiment. FIG. 5 is a flowchart showing an example of performance processing according to the present embodiment. FIG. 6 is a diagram showing an example of input waveform data, its speed, acceleration, and jerk in the present embodiment. FIG. 7 is a flowchart showing an example of acceleration calculation processing according to the present embodiment. FIG. 8 is a flowchart showing an example of jerk calculation processing according to the present embodiment. FIG. 9 is a flowchart showing an example of the composite mode process according to the present embodiment. FIG. 10 is a flowchart showing an example of the crossfade process according to the present embodiment. FIG. 11 is a diagram for explaining crossfading in the composite mode according to the present embodiment. FIG. 12 is a flowchart showing an example of the sound generation process according to the present embodiment. FIG. 13 is a flowchart illustrating an example of acceleration calculation processing according to the second embodiment. FIG. 14 is a flowchart illustrating an example of jerk calculation processing according to the second embodiment. FIG. 15 is a flowchart illustrating an example of acceleration calculation processing according to the third embodiment. FIG. 16 is a flowchart illustrating an example of jerk calculation processing according to the third embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a block diagram showing a configuration of a sound effect generator according to a first embodiment of the present invention. As shown in FIG. 1, the sound effect generator 10 according to the present embodiment includes a CPU 11, a ROM 12, a RAM 13, a sound system 14, a display unit 15, a waveform data input interface (I / F) 17, and an operation unit 18. .

  The CPU 11 controls the entire sound effect generator 10, detects the operation of a switch (not shown) constituting the operation unit 18, stores the input waveform data input via the waveform data input I / F 17 in the RAM 13, Various processes such as calculation of acceleration and jerk based on input waveform data and generation of output waveform data based on the calculation result are executed.

The ROM 12 detects the operation of the switch constituting the operation unit 18, stores the input waveform data input via the waveform data input I / F 17 in the RAM 13, calculates and calculates acceleration and jerk based on the input waveform data. A processing program for generating output waveform data based on the result is stored. The ROM 12 includes a preset waveform data area for storing original waveform data (hereinafter referred to as “preset waveform data”) for generating musical sounds such as piano and guitar. The RAM 13 is read from the ROM 12. Stored programs and data generated during processing. The data generated in the course of processing includes input waveform data obtained via a waveform data input I / F 17 described later, speed data based on the input waveform data, acceleration data, jerk data, and presets stored in the ROM 12. New output waveform data obtained based on the waveform data and acceleration data or jerk data is included.

  The sound system 14 reads out output waveform data from the output waveform data area of the RAM 13 in accordance with an instruction from the CPU 11, and generates and outputs musical sound data. The audio circuit 22 D / A converts and amplifies the musical sound data. Thereby, an acoustic signal is output from the speaker 23.

  The waveform data input I / F 17 has an external connection terminal, can receive an electric signal from a guitar or a keyboard instrument, and can output data obtained by A / D converting the received electric signal.

  FIG. 2 is a flowchart showing processing executed by the sound effect generator 10 according to the present embodiment. The CPU 11 of the sound effect generator 10 performs, for example, initialization processing including clearing of input waveform data temporarily stored in the RAM 13, speed, acceleration, jerk, output waveform data based on the input waveform data (step) 201). When the initialization process (step 201) ends, the CPU 11 detects a switch operation of the operation unit 18 and executes a switch process for executing a process according to the detected operation (step 202).

  In the switch process, an operation of a switch (not shown) for designating a sound generation mode, an operation of a tone color designation switch (not shown), etc. are detected, and a process corresponding to the operation is executed. FIG. 3 is a flowchart showing an example of the switch processing according to the present embodiment. In the present embodiment, as will be described in detail later, based on the input waveform data input via the waveform data input I / F 17, new output waveform data is generated based on the preset waveform data stored in advance in the ROM 12. Is generated. Four different methods can be set for generating the new output waveform data.

  In the pitch extraction mode, the pitch (pitch information) is extracted from the input waveform data, and output waveform data according to the extracted pitch is generated based on the preset waveform data. In the acceleration mode, the acceleration of the input waveform data is calculated, the preset waveform data is transformed based on the calculated acceleration, and new output waveform data is calculated. In the jerk mode, the acceleration of the input waveform data is calculated, and based on the calculated jerk, the preset waveform data is transformed and new output waveform data is calculated. Further, in the composite mode, in the output waveform data, new output waveform data according to either the acceleration mode or jerk mode is adopted in the first predetermined portion, and in the subsequent portion, the pitch extraction mode is used. Output waveform data is adopted.

  In the present embodiment, in order to set the mode, the operation unit 18 includes a pitch extraction mode switch, an acceleration mode switch, a jerk mode switch, and a composite mode switch. If the pitch extraction switch is on (step 301), the CPU 11 sets the mode to the pitch extraction mode (step 302). The set mode information is stored in a predetermined area of the RAM 13. If the acceleration mode switch is on (Yes at step 303), the CPU 11 sets the mode to the acceleration mode (step 304), and if the jerk mode switch is on (Yes at step 305), the mode is set. Are set to the jerk mode (step 306). Furthermore, if the combined mode switch is on (Yes in step 307), the CPU 11 sets the mode to the combined mode (step 308). In the case of the composite mode, whether the acceleration or jerk is based is specified by the operation of the operation unit 15, and information indicating which is based is stored in a predetermined area of the RAM 13 together with the information indicating the mode. Is done.

  After the switch process (step 202), the CPU 11 executes an input waveform storage process (step 203). FIG. 4 is a flowchart showing an example of the input waveform storage process according to the present embodiment. The CPU 11 determines whether or not a signal is input to the waveform data input I / F 17 (step 401). If it is determined NO in step 401, the process is terminated. When it is determined Yes in step 401, a time parameter tin that specifies the input waveform data is acquired (step 402). This time parameter tin is initially “1” and is stored in a predetermined data area of the RAM 13. Next, the CPU 11 generates a value A / D converted from the waveform data input I / F 17 as input waveform data G (tin) at time tin (step 403) and stores it in a predetermined input waveform data area of the RAM 13. (Step 404).

  If there is unprocessed data (Yes in Step 405), the CPU 11 increments the time parameter tin (Step 406) and returns to Step 403. In the case of No in step 405, the CPU 11 stores the time parameter tin in a predetermined data area of the RAM 13. This time parameter tin is used in the next input waveform storage process. FIG. 6 is a diagram showing an example of input waveform data and its speed, acceleration, jerk in the present embodiment. In FIG. 6, with respect to the input waveform (symbol 600), corresponding gains G1, G2,..., Gn so as to correspond to the respective times t1, t2,. Is acquired and stored in the input waveform data area of the RAM 13.

  After the input waveform storage process (step 203), the CPU 11 executes a performance process (step 204). FIG. 5 is a flowchart showing an example of performance processing according to the present embodiment. In the performance process, a process according to the mode set in the switch process in step 202 is executed. When the mode is the pitch extraction mode (step 501), the CPU 11 executes a pitch extraction process (step 501). As the pitch extraction process, a known method such as the method described in Patent Document 1 or Patent Document 2 can be employed. For example, in the pitch extraction process, the CPU 11 reads the input waveform data G (t) stored in the predetermined data area of the RAM 13 by the input waveform storage process 203 and extracts the pitch of the input waveform data G (t). . For example, as described in Patent Document 1, a filter process is performed on input waveform data, a zero-cross point of the waveform data subjected to the filter process is detected, and a time at which the waveform data takes a positive value is used as a counter. Measure the time when the waveform data takes a negative value with another counter, detect the vibration of the fundamental wave of the string by referring to both counter values, and extract the pitch of the input waveform data You may do it. Alternatively, as described in Patent Document 3, the time interval of the zero cross point that changes from negative to positive is measured, and the time interval of the zero cross point that converts from positive to negative is measured, and the time interval is stabilized Thus, the pitch may be determined from the time interval. Further, the CPU 11 reads the preset waveform data according to the pitch (pitch information) of the input waveform data extracted in the pitch extraction process, and generates waveform data g ′ (t). As a result, a musical tone based on the preset waveform data according to the pitch of the input waveform data is generated.

  When it is determined No in step 501, the CPU 11 determines whether or not the mode is an acceleration mode (step 503). When it is determined Yes in step 503, the CPU 11 executes acceleration calculation processing (step 504). FIG. 7 is a flowchart showing an example of acceleration calculation processing according to the present embodiment. As shown in FIG. 7, the CPU 11 obtains a time parameter ta for specifying input waveform data to be read in the acceleration calculation process (step 701). The time parameter ta is initially “1” and is stored in a predetermined data area of the RAM 13.

  The CPU 11 acquires input waveform data G (ta-2) to G (ta) from time ta-2 to time ta (step 702), and calculates speeds V (ta-1) and V (ta) from these. (Step 703).

  The speeds V (ta-1) and V (ta) can be obtained as follows.

V (ta-1) = (G (ta-1) -G (ta-2)) / Δt
V (ta) = (G (ta) −G (ta−1)) / Δt
(Δt is the sampling period)
Next, the CPU 11 calculates an acceleration A (ta) from the speeds V (ta-1) and V (ta) (step 704).

  The acceleration A (ta) can be obtained as follows.

A (ta) = (V (ta) −V (ta−1)) / Δt
= (G (ta) -2 · G (ta-1) + G (ta-2)) / Δt ²
Thereafter, the CPU 11 generates new output waveform data X (ta) based on the calculated acceleration A (ta) and preset waveform data g (ta-2) to g (ta-1) in the past from the time ta. Calculate (step 705). In step 705, X (ta) is calculated so that the acceleration obtained based on the preset waveform data g (ta-2), g (ta-1) and X (ta) matches A (ta). Is done.

That is,
Based on A (ta) = (X (ta) −2 · g (ta−1) + g (ta−2)) / Δt ² ,
X (ta) = A (ta) · Δt ² +2 g (ta-1) -g (ta-2)
And can be obtained.

  The CPU 11 stores the calculated output waveform data X (ta) in a predetermined output waveform data area of the RAM 13 and stores the calculated speed V and acceleration A in the predetermined data area of the RAM 13 (step 706). . Although the acceleration calculation process is repeatedly executed, the speed and acceleration calculated once need not be newly calculated in the next process, and need only be read from the data area of the RAM 13. If there is unprocessed, that is, input waveform data for which the related speed or the like has not been calculated (Yes in Step 707), the CPU 11 increments the time parameter ta (Step 708) and returns to Step 702.

  When it is determined Yes in step 707, the CPU 11 stores the time parameter ta in a predetermined data area of the RAM 13 (step 709). In the present embodiment, accelerations A2, A3, A4,... Of the input waveform (see reference numeral 600 in FIG. 6) are sequentially calculated (see reference numeral 611), and the acceleration A (ta) at time ta is New output waveform data X (ta) is calculated based on the past preset waveform data g (ta-2) and g (ta-1) so that the acceleration of the output waveform data X (ta) at time ta is obtained. Is done.

  If it is determined No in step 503, the CPU 11 determines whether or not the mode is the jerk mode (step 505). If it is determined Yes in step 505, the CPU 11 A speed calculation process is executed (step 506). FIG. 8 is a flowchart showing an example of jerk calculation processing according to the present embodiment. As shown in FIG. 8, the CPU 11 acquires a time parameter tb for specifying input waveform data to be read in the jerk calculation process (step 801). The time parameter tb is initially “1” and is stored in a predetermined data area of the RAM 13.

  The CPU 11 acquires input waveform data G (tb-3) to G (tb) from time tb-3 to time tb (step 802), and calculates speeds V (ta-2) to V (tb) from these. (Step 803).

  As in the case of the acceleration calculation process, the speeds V (tb-2) to V (tb) can be obtained as follows.

V (tb-2) = (G (tb-2) -G (tb-3)) / Δt
V (tb-1) = (G (tb-1) -G (tb-2)) /. DELTA.t
V (tb) = (G (tb) −G (tb−1)) / Δt
(Δt is the sampling period)
Next, the CPU 11 calculates accelerations A (tb-1) and A (tb) from the speeds V (tb-2) to V (tb) (step 804).

  The accelerations A (tb-1) and A (tb) can be obtained as follows.

A (tb-1) = (V (tb-1) -V (tb-2)) / Δt
= (G (tb-1) -2 · G (tb-2) + G (tb-3)) / Δt ²
A (ta) = (V (tb) −V (tb−1)) / Δt
= (G (tb) −2 · G (tb−1) + G (tb−2)) / Δt ²
Further, the CPU 11 calculates the jerk P (tb) from the accelerations A (tb-1) and A (tb) (step 805).

  The jerk P (tb) can be obtained as follows.

P (tb) = (A (tb) −A (tb−1)) / Δt
= (V (tb) −2 · V (tb−1) + V (tb−2)) / Δt ²
= (G (tb) -3G ( tb-1) + 3G (tb-2) -G (tb-3)) / Δt 3
Thereafter, the CPU 11 calculates new output waveform data X (tb) based on the calculated jerk P (tb) and preset waveform data g (tb-3) to g (tb-1) in the past from the time tb. ) Is calculated (step 806). In step 806, the jerk obtained based on the preset waveform data g (tb-3), g (tb-2), g (tb-1) and X (tb) matches P (tb). Thus, X (tb) is calculated.

That is,
Based on P (tb) = (G (tb) −3G (tb−1) + 3G (tb−2) −G (tb−3)) / Δt ³ ,
X (tb) = P (tb) · Δt ³ +3 g (tb−1) −3 g (tb−2) + g (tb−3)
And can be obtained.

  The CPU 11 stores the calculated output waveform data X (tb) in a predetermined output waveform data area of the RAM 13, and stores the calculated speed V, acceleration A, and jerk in the predetermined data area of the RAM 13. (Step 807). As described with reference to the acceleration calculation process, the jerk calculation process is repeatedly executed. However, the once calculated speed, acceleration, and jerk need not be newly calculated in the next process, and the RAM 13 Reading from the data area is sufficient. If there is input waveform data that has not been processed, that is, the related speed or the like has not been calculated (Yes in Step 808), the CPU 11 increments the time parameter tb (Step 809) and returns to Step 802.

  If it is determined Yes in step 808, the CPU 11 stores the time parameter tb in a predetermined data area of the RAM 13 (step 810). In the present embodiment, jerks P3, P4, P5,... Of the input waveform (see reference numeral 600 in FIG. 6) are sequentially calculated (see reference numeral 612), and the jerk P at time tb (see reference numeral 612). Based on the past preset waveform data g (tb-3), g (tb-2), and g (tb-1) so that tb) becomes the acceleration of the output waveform data X (tb) at time tb, New output waveform data X (tb) is calculated.

  If NO is determined in step 505, the CPU 11 determines whether or not the mode is the combined mode (step 507). If YES is determined in step 507, the CPU 11 performs the combined mode process. Is executed (step 508). FIG. 9 is a flowchart showing an example of the composite mode process according to the present embodiment. In combined mode, when preset waveform data is attacked, the same processing as acceleration calculation processing and jerk calculation processing is executed based on the selection of either acceleration or jerk, and output waveform data is obtained by calculation. Is done. On the other hand, after the attack (that is, during decay or sustain), pitch extraction processing is performed, preset waveform data is read out based on the extracted pitch information, and the read output waveform is read out. Data g ′ (t) becomes output waveform data.

  As shown in FIG. 9, in the composite mode process, the CPU 11 acquires a time parameter tc for specifying input waveform data to be read in the composite mode process (step 901). The time parameter tc is initially “1” and is stored in a predetermined data area of the RAM 13. Next, the CPU 11 determines whether or not the preset waveform data g (tc) at time tc belongs at the time of attack (step 902). If NO in step 902, that is, if the preset waveform data is determined to be after the attack time (decay time, sustain time, etc.), the CPU 11 executes pitch extraction processing (step 903). In the pitch extraction process, the CPU 11 reads the preset waveform data according to the pitch (pitch information) of the extracted input waveform data, and generates waveform data g ′ (tc). If there is unprocessed input waveform data (Yes in step 904), the CPU 11 increments the time parameter tc (step 905) and returns to step 902.

If Yes in step 902, the CPU 11 determines whether acceleration is used for calculation in the composite mode (step 906). When it is determined Yes in step 906, the CPU 11 executes processing corresponding to steps 702 to 706 in FIG. 7 (step 907). Thereby, as described with reference to FIG. 7, output waveform data X (tc) = A (tc) · Δt ² + 2g (tc−1) −g (tc−2) can be obtained.

On the other hand, when it is determined No in step 906, that is, when the jerk should be used for the calculation in the composite mode, the CPU 11 executes processing corresponding to steps 802 to 807 in FIG. 8 (step 908). . Thus, as described with reference to FIG. 8, output waveform data X (tc) = P (tc) · Δt ³ + 3g (tc−1) −3g (tc−2) + g (tc−3) is obtained. be able to.

  Thereafter, the CPU 11 executes a cross fade process (step 909). FIG. 10 is a flowchart showing an example of the crossfade process according to the present embodiment. As shown in FIG. 10, for example, the CPU 11 obtains the crossfade period tx, the crossfade start time tx0 and the crossfade end time tx1 for the preset waveform data in the composite mode stored in the ROM 12 (step 1001). Note that the relationship tx0 + tx = tx1 is established.

  Next, the CPU 11 determines whether or not the time tc is within the crossfade period (that is, tx0 ≦ tc ≦ tx1) (step 1002). When it is determined No in step 1002, the CPU 11 ends the process. If YES is determined in step 1002, the CPU 11 gx is a crossfade output of the preset waveform data g ′ (tc) read based on the pitch (pitch information) extracted from the input waveform data. (Tc) is obtained as follows (step 1003).

gx (tc) = ((tc−tx0) / tx) · g ′ (tc)
Further, the CPU 11 outputs Xx (tc), which is the output waveform data calculated according to the acceleration of the input waveform data, or the crossfade output of the waveform data calculated according to the jerk of the input waveform data as follows. Obtain (step 1004).

Xx (tc) = ((tx1-tc) / tx) · X (tc)
Next, the CPU 11 adds the calculated cross-fade outputs gx (tc) and Xx (tc) to obtain new output waveform data X (tc) at time tc (step 1005). As shown in FIG. 11, the crossfade output Xx (tc) (see reference numeral 1100) coincides with the waveform data X (tx0) at the crossfade start time tx0 (see reference numeral 1101), and then decreases monotonously. It becomes “0” at the crossfade end time tx1. On the other hand, the crossfade output gx ′ (tc) (see reference numeral 1110) is “0” at the crossfade start time tx0, and then monotonously increases. At the crossfade end time tx1, the waveform data g ′ It matches (tx1) (symbol 1111).

  When the performance process (step 204 in FIG. 2) ends, the sound generation process is executed (step 205). FIG. 12 is a flowchart showing an example of the sound generation process according to the present embodiment. As shown in FIG. 12, the CPU 11 acquires a time parameter tot that specifies output waveform data (step 1201). The time parameter tout is initially “1” and is stored in a predetermined data area of the RAM 13. Next, the CPU 11 determines whether there is output waveform data that has not been generated yet in the output waveform data area of the RAM 13 (step 1202). If it is determined No in step 1202, the process ends. If it is determined Yes in step 1202, the CPU 11 determines whether or not it is time to sound the output waveform data X (tout) at time tout (step 1203). When it is determined No in step 1203, the CPU 11 stores the time parameter tout in a predetermined data area of the RAM 13 (step 1209) and ends the process.

  If it is determined Yes in step 1203, the CPU 11 instructs the sound source unit 21 to generate the output waveform data X (tout). In response to the instruction, the sound source unit 21 reads the output waveform data X (tout) from the output waveform data area of the RAM 13 (step 1204). If there is other necessary data such as velocity data, the sound source unit 21 reads other data from the ROM 12 or RAM 13 (step 1205). Next, the sound source unit 21 generates musical sound data based on the read output waveform data X (tout) and the like, and outputs it to the audio circuit 22 (step 1206). Thereby, the musical sound based on musical sound data is output from the speaker 23.

  If the CPU 11 determines that there is unprocessed output waveform data in the output waveform data area of the RAM 13 (Yes in step 1207), the time parameter tout is incremented and the processing returns to step 1203. If it is determined No in step 1207, the CPU 11 stores the time parameter tout in a predetermined data area of the RAM 13 (step 1209) and ends the process.

  According to the present embodiment, new output waveform data to be output is generated based on the calculated acceleration and past waveform data in the preset waveform data stored in the ROM 12. The acceleration can be obtained from three sample points of the input waveform data. Therefore, output waveform data based on input waveform data can be generated at a very high speed as compared with pitch extraction. Further, based on the direction of fluctuation in the input waveform data and the presence of vibration, output waveform data reflecting these can be generated.

In addition, according to the present embodiment, the acceleration A (t) and the past original are set so that the acceleration A (t) at the current time t becomes the acceleration of the output waveform data X (t) at the current time t. The output waveform data X (t) is calculated based on the waveform data g (t−t ₁ ) and g (t−t ₂ ) (t ₁ <t ₂ ). For example, if t ₁ = 1 and t ₂ = 2, acceleration is obtained from three consecutive sample points, and the output waveform data X (t) is X (t) = P (t) · Δt ³ + 3g ( t-1) -3g (t-2) + g (t-3) (Δt is a sampling period of waveform data).

  In the present embodiment, in the composite mode, waveform data generated based on the acceleration and past original waveform data from the start of sound generation of the output waveform data until a predetermined timing is used as a new output waveform. After the predetermined timing has arrived, the waveform data obtained by reading the original waveform data stored in the original waveform data storage means according to the extracted pitch is used as new output waveform data. Output. Thereby, when the output waveform data is attacked, a waveform reflecting the acceleration of the input waveform data can be obtained.

  According to the present embodiment, new output waveform data to be output is generated based on the calculated jerk and past waveform data in the preset waveform data stored in the ROM 12. The jerk can be obtained from four sample points of the input waveform data. Therefore, output waveform data based on input waveform data can be generated at a very high speed as compared with pitch extraction. Further, based on the change in force in the input waveform data, output waveform data reflecting this can be generated.

Further, according to the present embodiment, the jerk P (t) is such that the jerk P (t) at the current time t becomes the acceleration of the output waveform data X (t) at the present time t. Based on the past original waveform data g (t−t ₁ ), g (t−t ₂ ), and g (t−t ₃ ) (t ₁ <t ₂ <t ₃ ), the output waveform data X (t ) Is calculated. For example, if t ₁ = 1, t ₂ = 2 and t ₃ = 3, the output waveform data X (t) is X (t) = P (t) · Δt ³ + 3g (t−1) −3g ( t−2) + g (t−3) (Δt is a sampling period of waveform data).

  Furthermore, in the present embodiment, in the composite mode, waveform data generated based on the jerk and the past original waveform data from when the output waveform data starts sounding until a predetermined timing is obtained. Output as new output waveform data, and after the predetermined timing has arrived, the waveform data obtained by reading out the original waveform data stored in the original waveform data storage means according to the extracted pitch Output as output waveform data. As a result, when the output waveform data is attacked, a waveform reflecting the jerk of the input waveform data can be obtained.

  Next, a second embodiment of the present invention will be described. In the first embodiment, the velocity, acceleration, and jerk are calculated at the sampling period Δt, and the preset waveform data and acceleration or the preset waveform are calculated for each sampling period, that is, for each sample point. New output waveform data is calculated based on the data and jerk. In the second embodiment, the time interval for calculating the speed and jerk is variable. For example, the time interval T can be set to Δt, 2Δt, 3Δt,. The user can input a time interval T (= n · Δt) by operating a predetermined switch of the operation unit 18. In the switch process, the CPU 11 stores the input time interval T (= n · Δt) in a predetermined data area of the RAM 13.

  FIG. 13 is a flowchart illustrating an example of acceleration calculation processing according to the second embodiment, and FIG. 14 is a flowchart illustrating an example of jerk calculation processing according to the second embodiment. As shown in FIG. 13, in the acceleration calculation process according to the second embodiment, the CPU 11 acquires a time parameter ta that specifies waveform data to be read in the acceleration calculation process (step 1301). Next, the CPU 11 determines whether ta is a multiple of n · Δt (step 1302). If it is determined Yes in step 1302, the CPU 11 executes the processing of steps 702 to 706 in FIG. 7 to store the preset waveform data g (ta-2), g (ta-1), and X (ta). The output waveform data X (ta) is calculated so that the acceleration obtained based on it matches A (ta). The calculated output waveform data X (ta) is stored in the output waveform data area of the RAM 13, and the other calculated data is also stored in a predetermined data area of the RAM 13 (step 1305).

  On the other hand, if it is determined No in step 1304, the CPU 11 reads preset waveform data g (ta) at time ta from the ROM 12 (step 1304). The CPU 11 stores the read preset waveform data g (ta) as output waveform data X (ta) in the output waveform data area of the RAM 13 (step 1305). If there is unprocessed, that is, input waveform data for which the related speed or the like has not been calculated (Yes in Step 1306), the CPU 11 increments the time parameter ta (Step 1307) and returns to Step 1302. If it is determined Yes in step 1306, the CPU 11 stores the time parameter ta in a predetermined data area of the RAM 13 (step 1308).

  Further, as shown in FIG. 14, in the jerk calculation process according to the second embodiment, the CPU 11 acquires a time parameter tb for specifying the waveform data to be read (step 1401). Next, the CPU 11 determines whether ta is a multiple of n · Δt (step 1302). If it is determined Yes in step 1302, the CPU 11 executes the processing of steps 802 to 807 in FIG. 8 to preset waveform data g (tb-3), g (tb-2), g (tb-1). ) And X (tb), output waveform data X (tb) is calculated so that the jerk obtained based on X (tb) matches P (tb). The calculated output waveform data X (tb) is stored in the output waveform data area of the RAM 13, and the other calculated data is also stored in the predetermined data area of the RAM 13 (step 1405).

  On the other hand, if it is determined No in step 1404, the CPU 11 reads preset waveform data g (tb) at time tb from the ROM 12 (step 1404). The CPU 11 stores the read preset waveform data g (tb) as output waveform data X (tb) in the output waveform data area of the RAM 13 (step 1405). If there is input waveform data that has not been processed, that is, the related speed or the like has not been calculated (Yes in Step 1406), the CPU 11 increments the time parameter tb (Step 1407) and returns to Step 1402. If it is determined Yes in step 1406, the CPU 11 stores the time parameter tb in a predetermined data area of the RAM 13 (step 1408).

  According to the second embodiment, since preset waveform data (original waveform data) partially appears, output waveform data having sound quality approximate to the sound quality of the original waveform can be output.

  Next, a third embodiment of the present invention will be described. In the first embodiment, in the first embodiment, the speed for adjacent input waveform data (for example, input waveform data X (t) and X (t−1)) at the sampling period Δt interval. Acceleration and jerk are calculated. In the third embodiment, calculation of velocity, acceleration, and jerk is not used as adjacent sample points, but sample points separated by a set time interval (for example, X (t) and X (t− 2) etc.), the speed, acceleration and jerk are calculated. For example, the time interval can be Δt, 2Δt, 3Δt,. The user can input a time interval T (= n · Δt) by operating a predetermined switch of the operation unit 18. In the switch process, the CPU 11 stores the input time interval T (= n · Δt) in a predetermined data area of the RAM 13.

  FIG. 15 is a flowchart illustrating an example of acceleration calculation processing according to the third embodiment, and FIG. 16 is a flowchart illustrating an example of jerk calculation processing according to the third embodiment. As shown in FIG. 15, in the acceleration calculation process according to the third embodiment, the CPU 11 obtains a time parameter ta that specifies waveform data to be read in the acceleration calculation process (step 1501), and The time interval T = n · Δt stored in the RAM 13 is acquired (step 1502). In the present embodiment, coefficients “n” and “T” that define time intervals are used.

  In the third embodiment, the CPU 11 acquires input waveform data G (ta-2n), G (ta-n), and G (ta) (step 1503). For example, if T = 2 · Δt, input waveform data G (ta-4), G (ta-2), and G (ta) are acquired. Next, the CPU 11 calculates the speeds V (ta−n) and V (ta) from the acquired input waveform data as follows (step 1504).

V (ta-n) = (G (ta-n) -G (ta-2n)) / T
V (ta) = (G (ta) -G (ta-n)) / T
Next, the CPU 11 calculates the acceleration A (ta) from the speeds V (ta-n) and V (ta) as follows (step 1505).

A (ta) = (V (ta) −V (ta−n)) / ΔT
= (G (ta) -2 · G (ta-n) + G (ta-2n)) / T ²
Thereafter, the CPU 11 generates new output waveform data X (ta) based on the calculated acceleration A (ta) and preset waveform data g (ta-2n) and g (ta-n) in the past from the time ta. Calculate (step 1506). In step 1506, X (ta) is calculated so that the acceleration obtained based on the preset waveform data g (ta-2n), g (ta-n), and X (ta) matches A (ta). Is done.

That is,
Based on A (ta) = (X (ta) −2 · g (ta−n) + g (ta−2n)) / ΔT ² ,
X (ta) = A (ta) · ΔT ² +2 g (ta−n) −g (ta−2n)
And can be obtained.

  Steps 1507 to 1510 are the same as steps 706 to 709 in FIG.

  Further, as shown in FIG. 16, in the jerk calculation process according to the third embodiment, the CPU 11 acquires a time parameter tb that specifies waveform data to be read in the jerk calculation process (step 1601). ) And the time interval T = n · Δt stored in the RAM 13 is acquired. In the present embodiment, coefficients “n” and “T” that define time intervals are used.

  The CPU 11 acquires input waveform data G (tb-3n), G (tb-2n), G (tb-n), and G (tb) (step 1603), and from these, the speed V (ta-2n), V (Tb-n) and V (tb) are calculated as follows (step 1604).

V (tb-2n) = (G (tb-2n) -G (tb-3n)) / T
V (tb-n) = (G (tb-n) -G (tb-2n)) / T
V (tb) = (G (tb) -G (tb-n)) / T
Next, the CPU 11 calculates accelerations A (tb-n) and A (tb) from the speeds V (tb-2n), V (tb-n), and V (tb) as follows (step 1605). .

A (tb-n) = (V (tb-n) -V (tb-2n)) / T
= (G (tb−n) −2 · G (tb−2n) + G (tb−3n)) / T ²
A (ta) = (V (tb) −V (tb−n)) / T
= (G (tb) -2 · G (tb-n) + G (tb-2n)) / T ²
Further, the CPU 11 calculates the jerk P (tb) from the accelerations A (tb−n) and A (tb) as follows (step 1606).

P (tb) = (A (tb) −A (tb−n)) / T
= (V (tb) −2 · V (tb−n) + V (tb−2n)) / T ²
= (G (tb) -3G (tb-n) + 3G (tb-2n) -G (tb-3n)) / T ³
Thereafter, the CPU 11 performs a new operation based on the calculated jerk P (tb) and preset waveform data g (tb-3n), g (tb-2n), and g (tb-n) from the time tb. Output waveform data X (tb) is calculated (step 1607). In step 1607, the jerk obtained based on the preset waveform data g (tb-3n), g (tb-2n), g (tb-n) and X (tb) matches P (tb). Thus, X (tb) is calculated.

That is,
Based on P (tb) = (G (tb) −3G (tb−n) + 3G (tb−2n) −G (tb−3n)) / T ³ ,
X (tb) = P (tb) · T ³ +3 g (tb−n) −3 g (tb−2n) + g (tb−3n)
And can be obtained.

  Steps 1608 to 1611 are the same as steps 807 to 810 in FIG.

  According to the third embodiment, by increasing the time width when calculating the acceleration and jerk, compared to the first embodiment, the input waveform data changes (speed changes and It is possible to obtain output waveform data that gently changes with respect to (acceleration change).

  The present invention is not limited to the above embodiments, and various modifications can be made within the scope of the invention described in the claims, and these are also included in the scope of the present invention. Needless to say.

  For example, when the preset waveform data is attacked in the composite mode according to the first embodiment, processing similar to acceleration calculation processing and jerk calculation processing is executed based on the selection of either acceleration or jerk. The output waveform data is acquired by the calculation. On the other hand, after the attack (that is, during decay or sustain), pitch extraction processing is performed, preset waveform data is read out based on the extracted pitch information, and the read output waveform is read out. Data g ′ (t) becomes output waveform data. However, after the attack (that is, at the time of decay or sustain), the preset waveform data g (t) may be simply read without performing pitch extraction.

  Thus, when the output waveform data is attacked, a waveform reflecting the acceleration or jerk of the input waveform data can be obtained.

10 sound effect generator 11 CPU
12 ROM
13 RAM
14 Sound System 15 Display 17 Waveform Data Input I / F
18 Operation part 21 Sound source part 22 Audio circuit 23 Speaker

Claims (14)

A sound effect generator for generating a sound effect based on input waveform data,
Acceleration calculation means for calculating the acceleration of the input waveform data;
Original waveform data storage means for storing predetermined original waveform data, which is the basis of musical sound waveform data to be output;
Output waveform data generating means for generating new output waveform data to be output based on the acceleration calculated by the acceleration calculating means and the past original waveform data stored in the original waveform data storage means; A sound effect generator comprising: The output waveform data generating means determines that the acceleration A (t) and past original waveform data so that the acceleration A (t) at the current time t becomes the acceleration of the output waveform data X (t) at the current time t. _{2. The} output waveform data X (t) is calculated based on g (t−t ₁ ) and g (t−t ₂ ) (t ₁ <t ₂ ). The sound effect generator described in 1. The output waveform data generating means is
X (t) = A (t) · Δt ² +2 g (t−1) −g (t−2)
(Δt is the sampling period of waveform data)
The sound effect generator according to claim 2, wherein the output waveform data X (t) is calculated based on When the output waveform data generating means is time t is a multiple of n · Δt (n is a predetermined constant),
X (t) = A (t) · Δt ² +2 g (t−1) −g (t−2)
(Δt is the sampling period of waveform data)
When time t is not a multiple of n · Δt,
X (t) = g (t)
The sound effect generator according to claim 2, wherein the output waveform data X (t) is calculated based on The output waveform data generating means is
X (t) = A (t) .T ² +2 g (t−n) −g (t−2n)
(T = n · Δt, Δt is a sampling period of waveform data, and n is a predetermined constant)
The sound effect generator according to claim 2, wherein the output waveform data X (t) is calculated based on   The output waveform data generation means outputs the waveform data generated based on the acceleration and the past original waveform data as new output waveform data from the start of the sound generation of the output waveform data until a predetermined timing. 6. The sound effect generator according to claim 1, wherein the original waveform data is output as new output waveform data after the predetermined timing has arrived. Pitch extraction means for extracting the pitch of the input waveform data,
The output waveform data generation means outputs the waveform data generated based on the acceleration and the past original waveform data as new output waveform data from the start of the sound generation of the output waveform data until a predetermined timing. Then, after the predetermined timing has arrived, waveform data obtained by reading the original waveform data stored in the original waveform data storage means according to the extracted pitch is output as new output waveform data The sound effect generator according to any one of claims 1 to 5, wherein A sound effect generator for generating a sound effect based on input waveform data,
Acceleration calculation means for calculating the jerk of the input waveform data;
Original waveform data storage means for storing predetermined original waveform data, which is the basis of musical sound waveform data to be output;
Output waveform data generation means for generating new output waveform data to be output based on jerk calculated by the acceleration calculation means and past original waveform data stored in the original waveform data storage means And a sound effect generator. The output waveform data generating means determines that the jerk P (t), the past so that the jerk P (t) at the current time t becomes the acceleration of the output waveform data X (t) at the present time t. Based on the original waveform data g (t−t ₁ ), g (t−t ₂ ) and g (t−t ₃ ) (t ₁ <t ₂ <t ₃ ), 9. The sound effect generator according to claim 8, wherein the sound effect generator is configured to calculate. The output waveform data generating means is
X (t) = P (t) · Δt ³ +3 g (t−1) −3 g (t−2) + g (t−3)
(Δt is the sampling period of waveform data)
10. The sound effect generator according to claim 9, wherein the output waveform data X (t) is calculated based on When the output waveform data generating means is time t is a multiple of n · Δt (n is a predetermined constant),
X (t) = P (t) · Δt ³ +3 g (t−1) −3 g (t−2) + g (t−3)
(Δt is the sampling period of waveform data)
When time t is not a multiple of n · Δt,
X (t) = g (t)
10. The sound effect generator according to claim 9, wherein the output waveform data X (t) is calculated based on The output waveform data generating means is
X (t) = P (t) · T ³ +3 g (t−n) −3 g (t−2n) + g (t−3n)
(T = n · Δt, Δt is a sampling period of waveform data, and n is a predetermined constant)
10. The sound effect generator according to claim 9, wherein the output waveform data X (t) is calculated based on   The output waveform data generation means generates new output waveform data from the waveform data generated based on the jerk and the past original waveform data until the predetermined timing is reached after the output waveform data starts sounding. 13. The sound effect generator according to claim 8, wherein the original waveform data is output as new output waveform data after the predetermined timing has been reached. Pitch extraction means for extracting the pitch of the input waveform data,
The output waveform data generation means generates new output waveform data from the waveform data generated based on the jerk and the past original waveform data until the predetermined timing is reached after the output waveform data starts sounding. After the predetermined timing has arrived, the waveform data obtained by reading the original waveform data stored in the original waveform data storage means according to the extracted pitch is output as new output waveform data The sound effect generator according to claim 8, wherein the sound effect generator is provided.

Images