JP2002215163A - Wave data analysis method, wave data analyzer, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To secure the synchronization between automatic performance information and wave data when adding a new track to the automatic performance information which is originally present to insert wave data acquired with a sampler. SOLUTION: Automatic performance information consisting of automatic performance tracks 202 and 204 is first reproduced. A user starts waveform sound recording at suitable timing while listening to the automatic performance. Recorded wave data are recorded on a waveform data track 224. Besides, synchronous data for performing the synchronization between the waveform data track 224 and the automatic performance tracks 202 and 204 are recorded on a waveform timing track 222. It is recorded on the track 222 that to what number of samples of wave data each cadence timing of the automatic performance tracks 202 and 204 corresponds, for example. Then, the wave data are divided on the basis of the cadence timing of the automatic performance information or the like to meet the change of a tempo at a subsequent reproduction or the like.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a waveform data analyzing method, a waveform data analyzing apparatus, and a recording medium suitable for use in automatic performance, particularly, automatic accompaniment in personal computers, electronic musical instruments, amusement equipment, and the like.

[0002]

2. Description of the Related Art Conventionally, there has been known a technique of recording a natural musical instrument sound or the like having a certain length and automatically and repeatedly reproducing the sound at a speed corresponding to a set tempo. Although this technique is used for automatic accompaniment of rhythm sounds and the like, it is necessary to compress or expand the original waveform according to the set tempo. In order to execute such processing, the following devices or software are conventionally known.

(1) Sampler Samplers sample analog waveforms and convert them into digital waveform data, and are known to record a single sound waveform and to record a phrase waveform composed of multiple sounds. . The latter is especially called a phrase sampler.

(2) Slicer The slicer assigns a note number to the divided waveform data in order from the beginning, and performs automatic performance information including the assigned note number and timing (separation position), that is, the divided waveform data. Is generated and stored. Based on this automatic performance information, when the automatic performance is performed at the recording tempo, and the waveform data separated by the reproduced note-on event is triggered, the original waveform data (the waveform data before the separation) is reproduced. Here, when the tempo is changed, the timing of the note-on event changes according to the tempo, and the waveform data is expanded and contracted in the time axis direction as a whole.

(3) Sequencer The sequencer reproduces the above sequence data. However, not only the sequence data is reproduced as it is, but also the sequence data can be reproduced at a desired tempo by appropriately increasing or decreasing the reproduction speed. Note that, by editing the sequence data in advance, it is of course possible to independently change the reproduction timing of each unit waveform data. When this sequence data is supplied to an appropriate sound source, a musical tone waveform based on the reproduction sequence data is reproduced.

Next, the state of the reproduced tone waveform will be described in more detail with reference to FIGS. 2 (a) and 2 (b). Same figure
(a) is original waveform data of a natural instrument sound or the like recorded in stereo. When the original waveform data is divided at the rising portion of the envelope (broken line portion in the figure, hereinafter referred to as “control point”), the original waveform data is divided into a plurality of sections (called original sections) as shown in FIG. ) 1r-1
It can be divided into 2r. When performing automatic rhythm accompaniment or the like using the original waveform data, if the original waveform data is reproduced at the same tempo as that at the time of recording, the original waveform data may be repeatedly reproduced without any particular processing.

When the tempo at the time of reproduction is faster than at the time of recording, it is necessary to shorten the reproduction portion of each of the original sections 1r to 12r. For this purpose, the end portion of each section may be cut at a fixed rate. For example, the tempo during recording is “100”, and the tempo during playback is “12”.
5 ", each original section 1r ~
It is preferable to cut the end portion of 12r by 20% and reproduce the remaining waveform data.

On the other hand, a problem arises when the tempo at the time of reproduction is slower than the tempo at the time of recording. That is, if the reproduction start timing of each section is simply delayed in accordance with the tempo at the time of reproduction, a silent section is generated in a gap between the sections, which is annoying. Therefore, it is general that the gap between the sections is reproduced by adding the waveform data of the immediately preceding section by a required length. At this time, the initial value of the amplitude of the portion to be added is set so as to match the amplitude of the immediately preceding portion.

[0009]

Here, a new track is added to some originally existing sequence data (original sequence data) such as automatic performance information, etc., and the sequence data (additional sequence data) obtained by the above technique is obtained. Is written to this added track, and the sequence data of both ensembles (composite sequence data)
Let's assume that you want to create

[0010] Here, since the original sequence data and the additional sequence data are recorded without relation, if the additional sequence data is simply written on a new track, there arises a problem that the timings of both are shifted.
For this reason, it is necessary to carefully adjust the timing of both, which is extremely complicated. In particular, when the tempo of the original sequence data changes on the way, it is necessary to adjust the timing throughout the music. Further, conventionally, since the waveform data is divided based only on the break positions obtained by analyzing the envelope of the waveform data, the break positions may be erroneously detected or may be divided at positions that are not musically appropriate. there were.

The present invention has been made in view of the above circumstances, and has as its object to provide a waveform data analysis method, a waveform data analysis device, and a recording medium that can record waveform data in association with original sequence data. And

[0012]

Means for Solving the Problems In order to solve the above problems, the present invention is characterized by having the following constitution. Note that the contents in parentheses are examples. 2. The synchronization control data according to claim 1, wherein a step of starting the reproduction of the automatic performance information, a step of starting the recording of the waveform data, and a timing relationship between the automatic performance information and the waveform data. And recording the waveform data while recording the data. Further, in the configuration according to claim 2, in the waveform data analysis method according to claim 1, based on the step of obtaining an envelope level of the waveform data, the synchronization control data, and the envelope level. Delimiter position detection step for determining a break position (control point) of waveform data (step SP106)
To SP118). Further, in the configuration according to the third aspect, in the waveform data analysis method according to the second aspect, the delimiter position detecting step (steps SP106 to SP118) is performed based on the automatic performance information and the synchronization control data. An estimation step of determining an estimated break position (reference position) of the waveform data, a detection step of detecting a rise position of the waveform data within a predetermined range corresponding to the estimated break position, and a detected rise position And an extraction step of extracting any one of them as a delimiter position.
Further, in the configuration of the fourth aspect, in the waveform data analysis method according to the third aspect, the estimating step is performed based on a beat timing, a note-on timing or a note-off timing of the automatic performance information. It is characterized in that an estimated break position of data is determined. Further, in the configuration according to the fifth aspect, in the waveform data analysis method according to the third aspect, in the extracting step, any one of the rising positions is determined based on a characteristic (intensity) of the detected rising position. It is characterized in that it is extracted as a break position. Furthermore, in the configuration according to claim 6,
2. The waveform data analysis method according to claim 1, wherein an estimated beat position is determined based on the automatic performance information and the synchronization control data, and a break position for obtaining a break position of the waveform data based on the estimated beat position. And a determining step. Further, in the configuration according to claim 7, in the waveform data analysis method according to claim 1, a step of determining an estimated rising position based on the note-on timing of the automatic performance information and the synchronization control data; A step of determining a break position of the waveform data based on the estimated rising position. Further, in the configuration according to claim 8, in the waveform data analysis method according to claim 1,
Determining an estimated break position based on the automatic performance information and the synchronization control data; analyzing an area near the estimated break position in the waveform data; and analyzing the waveform data based on the analysis result. And a step of determining a break position for obtaining the whole break position. Further, in the configuration according to claim 9, claim 8
In the described waveform data analysis method, the analysis step includes:
The method is characterized in that a rising position is detected by analyzing an envelope of the waveform data.
Further, in the configuration according to claim 10, in the waveform data analysis method according to claim 8, the delimiter position determining step is performed for each estimated delimiter position based on a plurality of rising positions included in the analysis result. In this case, one break position is determined. Further, in the configuration according to claim 11, in the waveform data analysis method according to any one of claims 1 to 10, a tempo clock of the automatic performance and a sampling cycle of the waveform data are synchronized, The synchronization control data includes timing data indicating a recording start timing of the waveform data. Further, in the configuration according to claim 12, in the waveform data analysis method according to any one of claims 1 to 10, the synchronization control data includes timing data indicating a recording start timing of the waveform data; It includes a tempo clock for automatic performance and synchronization data for synchronizing the sampling period of the waveform data. According to a thirteenth aspect of the present invention, the waveform data analyzing method according to any one of the first to twelfth aspects is performed. Claim 14
In the configuration described above, a program for executing the waveform data analysis method according to any one of claims 1 to 12 is stored.

[0013]

BEST MODE FOR CARRYING OUT THE INVENTION Hardware Configuration of Embodiment Next, a hardware configuration of a waveform editing system according to an embodiment of the present invention will be described with reference to FIG. The present waveform editing system includes an application program and a driver that operate on a general-purpose personal computer.

In FIG. 1, reference numeral 102 denotes a display, which displays various information to a user. 104 is an operator,
It is composed of a keyboard, a mouse and the like. A microphone 106 detects a tone signal (analog waveform) of a natural musical instrument or the like. An AD converter 108 samples the analog waveform and converts it into a digital signal. A recording circuit 110 directly accesses the hard disk 112 (performs a DMA operation) and stores the digital signal on the hard disk 112 as waveform data. In addition to the waveform data, the hard disk 112 stores an operating system of a general-purpose personal computer, a waveform editing application program described later, and the like.

A reproduction circuit 114 directly accesses the hard disk 112 (performs a DMA operation), reads out waveform data to be reproduced, and outputs the read data to the mixer 11.
6 Reference numeral 122 denotes a sound source, and a bus line 136
The musical tone signal is synthesized based on the performance information supplied through the mixer, and the synthesized musical tone signal is supplied to the mixer. In the mixer 116, the reproduction circuit 114 and the sound source 122
Are synthesized from the waveform data and the tone signal supplied from.

Reference numeral 118 denotes a DA converter, which is a mixer 1
The 16 mixing results are converted into analog signals. 12
Numeral 0 denotes a sound system which amplifies the analog signal to generate sound. A MIDI interface 124 exchanges MIDI signals with an external MIDI device. Reference numeral 126 denotes another interface for exchanging waveform data and the like with an external device. A timer 128 generates a timer interrupt every predetermined time.

Reference numeral 130 denotes a CPU, which controls each section of the waveform editing system via a bus line 136 based on a program described later. A ROM 132 stores an initial program loader and the like. 134 is R
AM, which is read and written by the CPU 130.

2. Operation of Embodiment 2.1. Recording process of original waveform data Next, the operation of the present embodiment will be described. First, when the power of the personal computer is turned on, the initial program loader stored in the ROM 132 is executed, and the operating system is started. When a predetermined operation is performed in this operating system, the waveform editing application program of the present embodiment is started. When a predetermined operation is performed in this application program, an automatic performance & waveform recording processing routine shown in FIG. 20 is started.

In FIG. 20, the processing is step SP202.
Then, preparation processing relating to automatic performance and waveform recording is performed. Then, a waveform recording control window 150 shown in FIG. 21 is displayed on the display 2. In the waveform recording control window 150, an automatic performance file text box 151 is provided for designating an automatic performance file name. An automatic performance start button 152 is provided for instructing the start of reproduction of a specified automatic performance file. Reference numeral 154 denotes an automatic performance stop button, which is provided to instruct reproduction stop of the automatic performance file.

Reference numeral 156 denotes a waveform recording start button, which is provided to instruct the start of waveform recording via the AD converter 108 and the recording circuit 110. A waveform recording stop button 158 is provided to instruct the stop of the waveform recording. Reference numeral 159 denotes a cancel button, which is provided to instruct cancellation of all processes. In the initial state, only the automatic performance file text box 151 among the elements in the waveform recording control window 150 is active (operable).
State, and the buttons 152 to 159 are set to an inactive (operation prohibited) state.

Here, when the user inputs an appropriate file name of an automatic performance file (for example, a file in the standard MIDI format) into the automatic performance file text box 151, the automatic performance start button 1
52 and the cancel button 159 are set to the active state, and the other elements are set to the inactive state.

Next, when the process proceeds to step SP204, an operation event of each element in the active state is detected in the waveform recording control window 150. next,
When the process proceeds to step SP206, step SP20
The process branches based on the detection result of No. 4. First, when no operation event is detected, the process returns to step SP204, and detection of the operation event is continued.
When the cancel button 159 is clicked on the waveform recording control window 150 with a mouse, the processing of the application program ends immediately.

On the other hand, if automatic performance start button 152 is clicked on with mouse in waveform recording control window 150, the process proceeds to step SP208. Here, reproduction of the previously specified automatic performance file is started. In step SP208, the automatic performance stop button 154 and the waveform recording start button 15
6 is set to the active state and the other elements are set to the inactive state.

Next, when the process proceeds to step SP210, an operation event of each element in the active state is detected in the waveform recording control window 150. next,
When the process proceeds to step SP212, step SP21
The process branches based on the detection result of “0”. First, when no operation event is detected, the process returns to step SP210, and detection of the operation event is continued.
When the automatic performance stop button 154 is clicked on with a mouse, the reproduction process of the automatic performance file is stopped, and the process of the application program is immediately terminated.

On the other hand, if waveform recording start button 156 is clicked on mouse in waveform recording control window 150, the process proceeds to step SP214. Here, recording of the waveform data obtained through the microphone 6, the AD converter 8, and the recording circuit 10 in order is started. That is, the waveform data is sequentially transmitted to the hard disk 1 via the DA converter 118 and the recording circuit 110.
It will be recorded on 12. Further, in step SP214, the automatic performance stop button 154 and the waveform recording stop button 158 are set to the active state, and the other elements are set to the inactive state.

Here, the details of the waveform recording process are shown in FIG.
This will be described with reference to FIG. FIG. 7A shows the musical score of the automatic performance information, and the timing marked with “↑” is the beat timing. FIG. 3B shows a phrase waveform (original waveform data) to be recorded, which is displayed in accordance with the corresponding timing in FIG. Also, FIG.
It is a figure which shows the relationship between the waveform data (original waveform data) recorded above, and automatic performance information.

In FIG. 2C, reference numerals 202 and 204 denote automatic performance tracks, which are included in the original automatic performance information (original sequence data). A waveform data track 224 records the recorded original waveform data. Reference numeral 222 denotes a waveform timing track, and the automatic performance tracks 202 and 204 and the waveform data track 2
24 for recording synchronization control data. Here, the synchronization control data is data such as a recording start timing and synchronization data to be described later. The waveform timing track 222 and the waveform data track 224 are tracks added to the automatic performance information when performing the recording process.

As is clear from the processing contents up to step SP214, when the waveform recording is started, the automatic performance has already been started. Therefore, as shown in FIGS. 16A and 16B, the start timing of the waveform recording is specified by the timing on the performance information of the automatic performance (for example, the number of timing clocks after the automatic performance starts). The specified start timing is the waveform timing track 2
22.

Thereafter, the waveform recording process and the automatic performance process are continued, but both processes are executed in synchronization with each other. Specifically, the following method is adopted. (1) Synchronize the sampling frequency of the waveform data with the tempo clock for automatic performance. In this case, there is no need to store synchronization data described later. (2) While sampling the waveform data, the synchronization data is recorded on a predetermined track (the waveform timing track 222 in the example of FIG. 16) of the automatic performance data.

In the above method (2), the following variations can be considered according to the synchronous data to be recorded. It is needless to say that the method for ensuring synchronization between the automatic performance processing and the waveform recording processing is not limited to the method described here. (2-1) For each predetermined number of tempo clocks, the sample number of the waveform data at that point is recorded. (2-2) The sample number of the waveform data at each beat timing (for example, the timing marked with “↑” in FIG. 16A) is recorded. (2-3) Every predetermined number of samples of waveform data (for example, 10
The sequence position of each (00 sample) is recorded.

Returning to FIG. 20, next, the processing proceeds to step SP2.
In step 16, the operation event of each element in the active state is detected in the waveform recording control window 150. Next, when the process proceeds to step SP218, the process branches based on the detection result of step SP216.
First, when no operation event is detected, the process returns to step SP216, and the detection of the operation event is continued. If automatic performance stop button 154 is clicked on with a mouse, the process proceeds to step SP222, and the reproduction process of the automatic performance file is stopped. on the other hand,
If waveform recording stop button 158 is clicked on with a mouse, the process proceeds to step SP220, and the recording of waveform data is stopped.

In any case, the process proceeds to step SP224, and it is determined whether both the automatic performance and the waveform recording are stopped. Here, if at least one of the processes is continuing, the determination is “NO”, the process returns to step SP216, and the detection of the operation event is continued. Then, when both the automatic performance and the waveform recording are stopped, "YES" is determined when the process proceeds to step SP224, and the process of this routine ends.

By the above processing, it is understood that the recorded waveform data (original waveform data) is recorded while being associated with the timing of the automatic performance information by the synchronization control data. However, in the processing contents so far, since a series of original waveform data is recorded on the waveform data track 224 as it is, it is not possible to cope with an increase or a decrease in the tempo of the automatic performance. Therefore, processing such as dividing the original waveform data into a plurality of original sections is required, and the contents of such processing will be described in detail below.

2.2. Reproduction waveform data generation processing 2.2.1. Trimming Process (SP2, SP4) When a predetermined operation is performed after the original waveform data is obtained by the waveform recording process, the program shown in FIG. 4 is started in the waveform editing application program. First, in the original waveform data, there may be a silent section at the start portion and the end portion. Therefore, when the process proceeds to step SP2, both silent sections are automatically trimmed (deleted).

However, when noise is included in the original waveform data, trimming may not always be performed at an appropriate position. Therefore, when the process proceeds to step SP4, the user can arbitrarily correct the automatically determined default trimming position.

2.2.2. Parameter Setting (SP6) Next, when the process proceeds to step SP6, the user specifies various parameters for control point detection. The specified parameters include the following. (1) Waveform type: This parameter specifies, for example, the type of waveform data.
They are broadly classified into "sustained systems" and the like, and are further classified into a plurality of variations suitable for original waveform data of various musical instruments.
Based on this waveform type, default values of other parameters to be described later, such as thresholds, are determined.

The selection of the "waveform type" is performed as follows. That is, FIG.
Are displayed, and when the user clicks one of the buttons with a mouse, the corresponding waveform type is selected. The above-mentioned "percussion system" is not only suitable for use for percussion system waveform data,
It is also desirable to apply it to intermittent waveform data of other systems. As shown in the figure, an intermittent waveform is drawn on the percussion system selection button 80, and a continuous waveform is drawn on the continuous system selection button 82, so that the user can determine at a glance the desired waveform type. can do.

(2) Resolution: This parameter specifies the resolution at which the waveform data is searched per bar in order to detect the control points of the strong beat and the weak beat. For example, when “beat” is “4/4”, “resolution” is “4 minutes”, “4 minutes + 3”, “8 minutes”.
Either “minute”, “8 minutes + 3”, “16 minutes”, “16 minutes + 3” or “32 minutes” can be designated (however, “+”
"3" indicates division into triplets). Here, "4 minutes" is 1
Timing to divide the bar into quarters (quarter note timing),
“Quarter + 3” means timing to divide into twelve, “8 minutes” means timing to divide into eight (timing of eighth notes),
“3” is a timing of 24 minutes, “16 minutes” is a timing of 16 minutes, “16 minutes + 3” is a timing of 48 minutes,
“32 minutes” means that waveform data is searched at a timing of 32 minutes. Note that when setting the resolution, it is necessary to specify the “beat”, but since this is originally included as a parameter of the automatic performance information, the value of the parameter is used.

2.2.3. Unwanted Band Removal Filter Processing (SP8) The trimmed waveform data contains various frequency components, including a component (unnecessary band) that becomes an obstacle for control point detection. Therefore, when the process next proceeds to step SP8, a filtering process is performed to remove these unnecessary bands. This filtering process is roughly classified into two types, a band cut process and a high-pass process. Since the manner in which unnecessary bands are distributed differs depending on the music or musical instrument, the content of the filtering process is described in the above “Waveform type”. It is preferable to determine according to. That is,
According to the waveform type, both or one of the band cut process and the high-pass process is executed, and the parameters of the filter process are also determined according to the waveform type.

Here, an example of setting parameters in the filtering process will be described. First, in the waveform data, a component having a pitch such as a melody has a high possibility of becoming an obstacle in detecting a control point. As a result of analyzing various kinds of music, such components, that is, components of a sustained portion such as vocals and bass, appear in a band of “80 Hz to 8 kHz”,
In particular, it often appears in the band of “100 Hz to 300 Hz”. Therefore, in the band cut processing, “80 Hz to 8 kHz”
attenuate the band of "z", especially "100Hz-300Hz"
Is performed so as to strongly attenuate the band. In addition, since the attack part (consonant, attack noise, etc.) such as a vocal and a bass spreads beyond the band, even if the filter processing is performed, the control point can be detected.

In a band performance or the like, high-frequency sounds such as cymbals are often regularly carved. In such a case, it is preferable to perform a high-pass process for extracting only the regular high-frequency components. Note that a sharp filter characteristic is not required in any of the band-cut processing and the high-pass processing. Therefore, it is practically sufficient to use a primary filter in the high-pass processing and a secondary filter in the band-cut processing. As an example of the result of the unnecessary band elimination filter processing, FIG. 5A shows the waveform data after trimming, and FIG. 5B shows the waveform of the filter processing. In this example of the waveform data, the number of measures is "2 measures", the time signature is "4/4 time", and the resolution is "8 minutes".

2.2.4. Determination of Default Control Point (SP12) Next, when the process proceeds to step SP12, a default control point is automatically determined based on the beat timing of the automatic performance information reproduced at the time of recording. Since the beat timing is determined by the time signature of the automatic performance information,
It occurs at quarter note or eighth note intervals. In addition,
If the tempo changes during the automatic performance, the beat timing changes according to the changed tempo.

On the other hand, with respect to the waveform data, the start position, the peak position, and the like of the volume envelope are detected.
A default control point is set based on the relationship between these detection results and beat timing. The default control points determined in this way are displayed on the display 8 together with the waveform data. Fig. 2 (a) shows a display example.
Shown in In the figure, the waveform data is recorded in stereo, and is shown in two systems, left (upper) and right (lower). The control points are indicated by vertical dashed lines on the window in the figure, and are common to both systems. Hereinafter, the process of determining the default control point will be described in detail with reference to FIG.

(1) Downsampling Process (SP102) In FIG. 6, when the process proceeds to step SP102, the downsampling process is performed on the waveform data from which the unnecessary band has been removed. This is because the sampling frequency required to determine the control points is much lower than the sampling frequency of the audio data for viewing,
This is because it is preferable to lower the sampling frequency in order to speed up the subsequent processing. (2) Absolute Value Conversion Processing (SP104) Next, when the processing proceeds to step SP104, the absolute value of the downsampled waveform data is obtained. FIG. 7A shows an example of the absolute value obtained corresponding to the waveform of FIG.

(3) Envelope follower processing (SP1
06) Next, when the process proceeds to step SP106, an envelope follower process is performed on the absolute value waveform of FIG. This is the process of obtaining the envelope waveform of the absolute value waveform. The point is that the envelope waveform rises sharply at the rising edge of the absolute value waveform and gradually falls at the falling edge of the absolute value waveform. There are features. Here, FIG. 8 shows an example in which the algorithm of the envelope follower processing is expressed by an equivalent circuit block. This is a low-pass filter that uses different coefficients when the input rises and when the input falls.

In FIG. 8, reference numeral 60 denotes a delay circuit, which stores the envelope level one sampling cycle (the cycle after down sampling, the same applies hereinafter). A subtractor 62 subtracts the envelope level one sampling cycle earlier from the absolute waveform level of the current sampling cycle, and outputs the result as a difference signal d. Reference numerals 66 and 68 denote multipliers which, when supplied with the difference signal d, multiply them by coefficients a1 and a2 (where 1>a1>a2> 0) and output the result.

A switch 64 selects a multiplier 66 when the difference signal d is equal to or greater than "0", and selects a multiplier 68 when the difference signal d is less than "0".
The difference signal d is supplied to the multiplier on the selected side. 7
Reference numeral 0 denotes an adder, which outputs the result of adding the output signals of the multipliers 66 and 68 on the selected side and the envelope level one sampling cycle earlier as the envelope level in the current sampling cycle. FIG. 7B shows a waveform obtained by the envelope follower processing. In order to remove small fluctuations from this waveform, step SP1
At 06, low-pass filter processing is further performed. The result of the low-pass filter processing is shown in FIG.

(4) Compressor Process (SP108) In FIG. 6, when the process proceeds to step SP108,
A compressor process is performed. That is, an average value of the envelope level based on the result of the envelope follower processing is calculated, and the envelope level is corrected so that a level higher than the average value is lower and a level lower than the average value is higher. The result of such processing is shown in FIG.

(5) Edge detection filter processing (SP11)
0) In FIG. 6, when the process next proceeds to step SP110,
Edge detection filtering is performed. This is a process for emphasizing the rise and fall with respect to the envelope level. Here, FIG. 9A shows an example in which the algorithm of the edge detection filter processing is expressed by an equivalent circuit block (comb filter).

In FIG. 9A, reference numeral 72 denotes a delay circuit.
The envelope level subjected to the compressor processing is used as an input signal, and the input signal is delayed by n sampling periods (n is a natural number of 2 or more) and output. A subtractor 74 subtracts the input signal of n sampling cycles before from the input signal of the current sampling cycle, and outputs the result as an edge detection filter processing result. Fig. (B) shows an example of input signal, Fig. (C)
An example of a signal obtained by delaying this by n sampling periods and inverting
FIG. 9C shows an example of the filter output signal (the result of subtraction of the waveforms in FIGS. 9B and 9C). FIG. 10A shows the result of applying such processing to the waveform of FIG. 7D.

(6) Edge Start Position / Peak Position Detection Process (SP112) In FIG. 6, when the process proceeds to step SP112,
Edge start position / peak position detection processing is executed. In this process, a rising edge and a peak position of the input signal are detected using the result of the edge detection filter processing as an input signal. An outline of this processing will be described with reference to FIG. Same figure
(a) shows a diagram in which a part of the input signal is enlarged on the time axis. In this figure, the input signal is compared with a predetermined threshold value Th, and the time when the input signal exceeds the threshold value Th is defined as an edge start position (time t1).

The output signal level shown in FIG. 4B is set to "0" before time t1, and at time t1, "-M" (M
Is set to a predetermined value). Further, at the peak position of the input signal, the output signal is set to the peak value for one sampling period, and then falls to "0" again. FIG. 10A shows a result obtained by performing a process on the waveform of FIG.
It is shown in (b).

In the signal shown in FIG.
The timing of falling to "M" is the "edge start position", and the time during which the level of "-M" continues is equal to the time from the edge start position to the peak position (rise time Tt). Further, the peak level is equal to the peak level of the edge detection filter processing result (FIG. 10A). Note that the edge start position, the rise time Tt, and the peak level are collectively referred to as “edge information”.

(7) Strong beat extraction process (SP114) In FIG. 6, when the process proceeds to step SP114,
A strong beat extraction process is performed. First, as described above, the original waveform data includes the automatic performance track 202 of the automatic performance information,
Since the recording is performed in synchronization with the automatic performance information 204, the detection window is determined according to the beat timing of the automatic performance information. This detection window uses the head of each section (hereinafter referred to as an estimated strong beat section) within one bar divided according to the time signature as a reference position,
These estimated strong beat sections have a width of 1/8 to 1/2. It should be noted that which value in the range of 1/8 to 1/2 is specifically adopted is determined according to the parameter of "waveform type".

Here, the number of measures in the waveform data is "2", the time signature is "4/4", and the window width is "1/1" of the estimated strong beat section.
FIG. 10C shows the detection window in the case of “6” superimposed on the waveform of FIG. 10B. In this figure, the shaded portion is the detection window, and the "1/3" (1/18 of the estimated strong beat section width) portion of each detection window is "2" before the reference position.
/ 3 "(2/18 of the estimated strong beat section width) is set to be located after the reference position.

Next, edge information whose peak level exceeds a predetermined threshold value Th1 is extracted from edge information to which a peak position belongs to each detection window. However, when a plurality of pieces of edge information exist in one detection window, only the edge information having the maximum peak level is extracted. FIG. 10D shows the result of the extraction performed on the waveform of FIG. 10C.
In FIG. 3C, the first (leftmost) detection window has two peak positions of the edge information exceeding the threshold value Th1, but with reference to FIG. Only information has been extracted. Also, FIG.
In the figure, edge information temporarily exists in the sixth detection window from the left end, but since the peak level does not exceed the threshold value Th1, it is not extracted in FIG.

(8) Weak Beat Extraction Process (SP116) In FIG. 6, when the process proceeds to step SP116,
A weak beat extraction process is performed. In this process, the reference position of the detection window is set at the position where each bar is divided based on the parameter of “resolution” specified in the above-described parameter setting process (SP6). However, the reference position corresponding to the detection window in which a strong beat has already been detected in step SP114 is excluded in this step.

Therefore, if a strong beat is detected in each detection window in step SP114, for example, a new eight-minute beat timing between the four-minute beat timings of the automatic performance information is set as a new reference position. A detection window will be provided. On the other hand, regarding the detection window from which no strong beat was previously extracted (the sixth detection window from the left end in FIG. 10C), in this step, the detection window for weak beat extraction is again in the same position, that is, It is set at a beat timing position of 4 minutes. As a result, the detection window for weak beat extraction is shown in FIG.
The setting is made as shown in the shaded portion of (a).

Also in this processing, "1/1 /"
3 ”(1/18 of the estimated strong beat section width) is located before the reference position, and“ 2/3 ”(2/18 of the estimated strong beat section width) is located after the reference position. Is set to Next, edge information exceeding a predetermined threshold value Th2 is extracted from the edge information to which the peak position belongs to each detection window. However, when a plurality of pieces of edge information exist in one detection window, only the edge information having the maximum peak level is extracted.

Here, the threshold value Th2 is "１ ／" of the threshold value Th1.
And the threshold value Th is set to the threshold level Th.
It is set to a value smaller than 2. The figure shows the extraction results of the strong beat and weak beat extracted by the processing up to this point.
It is shown in (b). According to FIG. 6B, the current extraction process
Edge information that is not extracted because the peak level was insufficient in the previous strong beat extraction process (SP114) is also extracted. Of the edge information extracted in steps SP114 and SP116, the edge start position is the control point described in FIG. 2A.

(9) Control point compulsory setting processing (SP1)
18) Next, when the process proceeds to step SP118, the control point is forcibly set to the reference position of the detection window from which no edge information has been detected, if necessary. “When necessary” specifically means a case where “continuous” has been designated as the waveform type. The reason for making such a setting is that the envelope of the “sustained” waveform is not regularly attenuated (it is simply attenuated), so the control point is forcibly applied even at the position where the rise is not detected. The reason for this is that the time axis control that is musically appropriate can be performed by setting.

2.2.5. Control point edit processing (SP
14) Next, when the process proceeds to step SP14, this default control point is edited by the user. Specifically, control points are added, deleted, or moved on the window as needed.

2.2.6. Insertion sections 1i to 12i
Determination of Flattened Waveform Data As described above, a section divided by the start point, end point, and control point of the waveform data is referred to as an “original section” in this specification. If the control points are determined as shown in FIG. 2A, the waveform data must be divided into 12 original sections 1r to 12r as shown in the upper rectangular column of FIG. 2B. become.

Next, as shown in the lower rectangular column of FIG. 10B, 12 sections (insertion sections 1i to 12i) having the same length as each original section.
Are created, and the inserted sections 1i to 12i store the waveform data following the original sections 1r to 12r. This allows each original section 1
r to 12r and the corresponding insertion sections 1i to 12i are connected to form a connection section 1t as shown in FIG.
~ 12t is obtained. Therefore, the details of such processing will be described below.

Referring back to FIG. 4, when the process proceeds to step SP16, the user sets the waveform data (before envelope adjustment) set in the insertion sections 1i to 12i by the user.
(1) As shown in FIG. 13 (a), the next waveform data (n + 1) r of the corresponding original section nr (where n = 1 to 12) is copied as it is, or
(2) As shown in FIG. 7B, one of the waveform data obtained by inverting the waveform data of the corresponding original section nr on the time axis is selected. Here, in the default state, when the waveform type is “continuous”, the waveform data shown in FIG. 7A is selected, and when the waveform type is “percussion”, the waveform data shown in FIG. The reason will be described.

<Regarding Continuous Sound> First, in the continuous sound, since the original section nr and the inserted section ni = (n + 1) r are originally continuous sections, the original section nr to the inserted section ( A smooth connection to (n + 1) r is guaranteed. Here, it is possible to use a section other than the insertion section (n + 1) r as an insertion section. However, in a sustained sound, a portion having no attack (in the middle of a continuous waveform).
May be set to the control point (step SP
118) must be considered. That is, in this case, if the phase of the original section nr and that of the inserted section do not match, annoying noise is generated, so that it is necessary to perform phase matching between the two and the processing becomes complicated. On the other hand, as in the example described above, the section (n + 1) r next to the original section nr
Is used as the insertion section, the waveform data of the insertion section can be created based on more stable waveform data.

Further, it is assumed that a continuous sound has an attack of the next sound immediately after the control point. In this case, the pitch of the next sound is generally different from the pitch of the previous sound. The difference in pitch between the original section and the inserted section is not originally desirable, but experimental results have shown that even if the two sections have different pitches, they are not very noticeable. This is considered to be due to the fact that the envelope level of the insertion section is controlled so as to continuously and smoothly attenuate from the previous original section. In other words, when the tone and pitch change in the attack portion of the newly starting sound, the tone and pitch change in the middle of the attenuated waveform. It is thought that there is not.

<For percussion sounds>
Since percussion-based sounds originally have many noise-like components, noticeable noise often does not occur at the connection from the original section nr to the insertion section ni. However, if the original section nr or the next original section (n + 1) r or the like is used as it is as the insertion section ni, the attack noise at the beginning of the waveform may be somewhat annoying. Therefore,
Such inconvenience can be solved by using the waveform data obtained by inverting the waveform data of the original section nr on the time axis as the insertion section ni. Furthermore, when the connecting section between the original section nr and the insertion section ni is cross-fade, it is possible to connect both sections more smoothly. When the inverted waveform data is read to the end, attack noise is reproduced at the end of the inverted waveform data, which may be somewhat annoying. In such a case, at a point in the middle of the inverted waveform data (for example, a point having a length of about ／ from the beginning), the inverted waveform data may be read back (further inverted on the time axis).

The insertion section is not limited to the default section described above. The user can specify a desired insertion section generation mode for each original section. Good to do. In step SP16,
When the waveform data of the insertion section is selected, the level of each part of the waveform data is divided by the envelope level of the waveform data. Thus, the waveform data of the insertion section is converted into waveform data having a flat envelope.

2.2.7. Insertion sections 1i to 12i
Next, when the process proceeds to step SP18, the envelope waveforms of the insertion sections 1i to 12i are determined. The determination method will be described with reference to FIG. In the figure, the maximum value of the envelope level of the original section nr is L1, the envelope level at the end of the original section nr is L2, and the time from the appearance of the maximum value L1 to the end of the original section nr is T. During this period, the decay rate d of the envelope level
r can be obtained by dr = (L1 / L2) ^{1 / T.}

Next, the initial value of the envelope level of the inserted section ni corresponding to the original section nr is set to L2, and the envelope of the inserted section ni is determined so that the attenuation rate dr is maintained. In particular,
When the start time t of the inserted section ni is set to 0, the envelope level of each section in the inserted section ni is L2
/ Is determined by dr ^t. Thereby, as shown in FIG. 14, the envelope characteristics of the insertion section ni are:
It is set so as to be naturally connected to the original section nr.

However, when the simple determination mode is selected when the control point is determined, the envelope level may be maximized at the end of the original section nr. In such a case, as shown in FIG. 15, the envelope level of the insertion section ni is:
It is limited to the level at the end of the original section nr. Specifically, when the attenuation rate dr obtained by the above formula becomes smaller than 1, the attenuation rate dr for obtaining the envelope value of the insertion section is forcibly set to 1,
Alternatively, the lower limit "d
r_min ”may be determined, and control may be performed so that the attenuation rate dr is always larger than that.

As described above, when the envelope of each insertion section is determined, each of the insertion sections 1i to 12i is determined.
Is multiplied by the determined envelope. Thus, the waveform data of each insertion section has the determined envelope.

As described above, the insertion sections 1i to 12i
Are determined, the combined sections 1t to 1t
This is nothing but the determination of the 2t waveform data. The waveform data of these combined sections 1t to 12t is replaced with the waveform data track 2 of the automatic performance information instead of the original waveform data.
24 is written. Further, in the waveform timing track 222, the start timing (the number of timing clocks) of each of the coupled sections 1t to 12t and the rise time Tt of the waveform data of these coupled sections are written. Note that the rise time Tt is not essential, but writing the rise time Tt makes it possible to reproduce the waveform data at a more preferable timing (refer to the reproduction tempo setting / change processing described later).

2.3. Playback tempo setting / change processing The user can set / change the playback tempo as appropriate before the performance processing or during the performance processing. Here, if the set tempo is equal to the tempo at the time of recording,
The number of clocks recorded on the waveform timing track 222 (see FIG. 16) may be used as it is. However, when the tempo at the time of reproduction is different from the tempo at the time of recording, simply controlling the reproduction start timing of each section in accordance with the ratio between the two causes a problem that "leaking" occurs particularly in a waveform with a slow rise. .

The contents will be described with reference to FIG. In FIG. 9A, the time from the reproduction start time (0) to the start of the rise of the waveform is the edge start time Ts, and the time from the start of the rise until the waveform level reaches the peak is the rise time. Tt.

The solid line in FIG. 9A shows the envelope level of the waveform data reproduced at the tempo at the time of recording. In human hearing, it is felt that a beat occurs at the peak position of the envelope level, that is, at the timing when “Ts + Tt” has elapsed after the start of reproduction. Next, the alternate long and short dash line in the same figure (a) shows an example in which the tempo at the time of recording is expanded to n times and the waveform data is reproduced. In the illustrated example, the drawing is performed on the assumption that “n = 2”. In this case, the edge start time is n times “nTs” at the time of recording, but the time for actually sensing a beat with human hearing is n times “n (Ts + T) at the time of recording.
t)), which is shorter than “nTs + Tt”.

As a result, when the waveform is expanded and reproduced, it is felt that a beat is generated at a timing earlier than the preferable timing. Conversely, if the tempo is compressed more than during recording, it will be felt that a beat occurs later than the preferred timing.

Therefore, in the present embodiment, when the reproduction tempo is set or changed, the number of generation start clocks recorded on the waveform timing track 222 is equal to the time (clock number × clock number) corresponding to the clock number. (Period) is corrected to a value that is (or is closest to) “n (Ts + Tt) −Tt”. As a result,
As shown in FIG. 3 (b), the beat on the auditory sense, that is, the peak position is a timing after the rising time Tt has elapsed, ie, “n (Ts + Tt)”. Instead of changing the number of generation start clocks according to the tempo, the clock cycle may be increased or decreased according to the rise time Tt. That is, every time a tempo clock is generated, the period up to the next tempo clock is appropriately increased or decreased,
The timing control according to the tempo can be performed while keeping the number of generation start clocks constant.

2.4. Performance Processing Next, an operation of performing automatic performance processing based on automatic performance information (synthesized sequence data) obtained by adding the above-described waveform timing track 222 and waveform data track 224 will be described. First, when the start of the automatic performance is instructed, "1/6" of the quarter note is based on the designated tempo.
A tempo clock is generated at intervals of "4". During the automatic performance, the program shown in FIG. 17 is executed every time a tempo clock is generated.

In FIG. 17, when the process proceeds to step SP32, the variable tcount is incremented by "1". The variable tcount is initially set to "0" at the start of the automatic performance, and is a variable for counting the number of tempo clocks from the start of the automatic performance to the present. Next, when the process proceeds to step SP34, it is determined whether or not an event timing other than the waveform data has been reached based on the value of the variable tcount.

That is, the automatic performance tracks 202 and 20
In No. 4, event data such as note-on and note-off are recorded in the order of occurrence, and these event data include timing data corresponding to a tempo clock at which the event should be generated. Therefore, by referring to the timing data in the event data at the head of each track, it can be determined whether or not the event timing has been reached.

If "YES" is determined in the step SP34, the process proceeds to a step SP36, and an event process corresponding to the event data is executed. For example, if the event data is a note-on event, C
A new tone generation channel is assigned to the tone generator 122 based on the instruction from the PU 130, and a tone signal is synthesized in the tone generation channel. The synthesized tone signal is emitted through a mixer 116, a DA converter 118, and a sound system 120 in that order. If the event data is a note-off event, the mute processing is performed on the corresponding sounding channel.

On the other hand, if the event timing of the next event data has not yet been reached, "NO" is determined in the step SP34, and the process proceeds to a step SP38. Here, it is determined whether or not the reading start timing of the waveform data of any of the coupled sections has been reached. As described above, the default read start timing of the waveform data of the combined section is recorded in the waveform timing track 222. However, the read start timing here is the timing after correction based on the rise time Tt, that is, the above-mentioned “n (T
s + Tt) -Tt ”.

If "YES" is determined here, the process proceeds to step SP40, and reading of the corresponding waveform data is started. Here, the reading speed is controlled according to a value of a pitch shift amount described later. When the pitch shift amount is "0", the read speed is set to the same speed as the write speed at the time of recording, and when the pitch shift amount is positive, it is faster than that, and when the pitch shift amount is negative, it is slower than it. Speed. As is well known, the pitch of the read waveform data increases as the reading speed increases, and decreases as the reading speed decreases.

When the reading of the corresponding waveform data is started, even if the reading process of another waveform data has been performed until immediately before this point in time, in step SP40, the waveform data is replaced with another waveform data. Then, reading of new waveform data is started. On the other hand, if “NO” is determined in the step SP38, the process proceeds to the step S38.
P40 is skipped, and the processing of this routine ends without changing the waveform data being read.

According to the above processing, when the variable tcount reaches the read start timing of the head combined section 1t,
Immediately, waveform reading of the coupled section 1t is started.
Thereafter, when the variable tcount reaches the read start timing of the next combined section 2t, the reading of the waveform data of the combined section 1t is stopped, and the reading of the waveform data of the combined section 2t is started. In order to smoothly connect the connection section 1t and the connection section 2t, the waveform data of the portion where the reading of the connection section 1t is stopped and the waveform data of the portion where the reading of the connection section 2t is started may be cross-fade connected. Good. By the above processing, the waveform data that is sequentially read is stored in the reproduction circuit 1.
14, the mixer 116, the DA converter 118, and the sound system 120 sequentially emit sound.

Similarly, reading from the combined section 3t and thereafter is sequentially started in accordance with the increase of the variable tcount.
Next, a musical tone waveform actually generated by such processing will be described with reference to FIG. FIG. 6B shows a section read when the tempo ratio during playback and during recording is set to 1.00. In such a case, the reading of the next combined section is started when "1/2" of each combined section, that is, when the original section is completely read. Thereby, the reproduced tone waveform matches the original waveform data.

FIG. 11A shows a section which is read out when the tempo ratio during reproduction and during recording is set to 0.67. In such a case, reading of the next section is started when about "67%" is reproduced based on the length of the original section. As described above, the timing at which the reading of the next section is actually started differs depending on the rise time Tt of the next section. This results in the rest of each original section (about 33%) and the inserted section not being played.

FIG. 9C shows a section read out when the tempo ratio during reproduction and during recording is set to 1.65. In such a case, reading of the next section is started when about "165%" is reproduced based on the length of the original section. Thus, each original section and the first half of each inserted section are approximately 6
A 5% portion will be reproduced.

The user can change the tempo at the time of reproduction and the waveform data used for the reproduction in real time through the operation unit 104. Similarly, the speed at which each section is read, that is, the pitch shift amount can be changed in real time via the operation unit 104. Also, the reproduced waveform data, tempo, or pitch shift amount may be automatically changed based on a predetermined sequence. Thus, the waveform data is reproduced and sounded in various modes based on the user's operation or a predetermined sequence.

3. Effects of Embodiment As described above, according to the present embodiment, when the original waveform data is recorded on the waveform data track 224, the synchronization data for the automatic performance information is recorded on the waveform timing track 222. The original waveform data and the waveform data for reproduction generated based on the original waveform data can be automatically synchronized with the original automatic performance information.

Further, in this embodiment, the number of generation start clocks is corrected according to the relationship between the original edge start time Ts and the rise time Tt and the tempo (tempo expansion / contraction ratio n) at the time of reproduction. , "N (Ts +
Since the reproduction of each original section can be started at the timing of “Tt) −Tt”, consistency between the tempo expansion / contraction rate n and the audible beat timing can be ensured.

4. Modifications The present invention is not limited to the embodiments described above,
For example, various modifications are possible as follows. (1) In the above-described embodiment, the waveform editing system is realized by an application program operating on a personal computer, but the same function is used for various electronic musical instruments, mobile phones, amusement devices, and other devices for generating musical sounds. Is also good. Further, the software used in the above embodiment can be stored in a recording medium such as a CD-ROM or a floppy (registered trademark) disk and distributed, or can be distributed through a transmission path.

(2) In the above embodiment, the envelope of the entire waveform data is analyzed. However, the envelope may be analyzed only in a portion near the reference position, for example, a portion corresponding to each detection window.

(3) In the above embodiment, the waveform data of the inserted section is generated in advance in correspondence with each original section. Alternatively, it may be generated immediately before starting the reproduction of the waveform data. As a result, the storage capacity for storing the waveform data can be reduced.

(4) It goes without saying that the processing for determining the division position (control point) for the original waveform data is not limited to the above embodiment. For example, in the above embodiment, the control point is determined using the beat timing of the automatic performance information as the reference position of the detection window, but instead of the beat timing, each note-on timing of the automatic performance information (each Note timing or note-off timing may be used as the reference position of the detection window.

(5) In the above-described embodiment, the processing for determining the control point is performed after the original waveform data is once recorded on the waveform data track 224.
If the processing capacity of the T.30 is sufficiently high, the control points may be determined at the same time as recording the original waveform data.

(6) In the above embodiment, the resolution for determining the control point is specified after the recording of the original waveform data. However, the resolution may be specified before the recording of the original waveform data or after the recording. Is also good.

(7) In the unnecessary band elimination processing in step SP8 of the above-described embodiment, the filtering processing by the high-pass processing and the band cutting processing is performed. Processing for attenuating the frequency range, processing for boosting the high frequency range, and the like may be performed.

(8) Step SP110 of the above embodiment
In the above, filter processing by a comb filter was performed to detect an edge portion. Alternatively, edge detection may be performed by any filter processing that generates a value corresponding to the slope of the envelope. For example, a filter process for simply differentiating the envelope level may be used,
Further, a low-pass filter process may be performed on the result of the differentiation.

(9) Step SP116 of the above embodiment
In, the reference position of the detection window for weak beat detection is provided at a position that divides each estimated strong beat section into two, that is, a position that bisects the reference position for strong beat detection. However, the position of the detection window for detecting a weak beat is not limited to this. That is, a position that divides the interval between the edge start positions of the strong beats or the peak positions that are actually extracted in step SP114 into two is obtained, and the obtained position is also used as the reference position of the detection window for detecting a weak beat. Good.

(10) Step SP16 of the above embodiment
In the above, as the waveform data of the inserted section before the envelope adjustment, the waveform data of the corresponding original section or the inverted data thereof was used as it is. However, especially in the case of waveform data of a melody part or the like having a stable pitch component, the pitch of the latter half of the original section is detected, and a part (partial waveform) of the original section is repeated in units of this pitch. An insertion section may be generated. This allows
It is possible to prevent the instability inherent in the attack portion from appearing in the insertion section.

The size of the partial waveform may be constant (loop waveform) or may be set to a random length. If the pitch is detected stably in the second half of the original section, a part of the original section is repeated. If no pitch is detected, the entire original section (or its inverse) is copied. Thus, the waveform data before the envelope adjustment of the insertion section may be set.

(11) In the above embodiment,
Each insertion section is created based on the waveform data of the immediately preceding original section (or its inverse), but each insertion section may be generated based on the waveform data of the next original section. For example, the inserted section 1i is the original section 2r
May be generated based on the waveform data.

(12) In the above embodiment,
Waveform data types are "percussion" and "persistence"
However, the waveform data may be divided into three or more types.

(13) In the above embodiment,
Although the detection window for extracting a strong beat is set according to the setting of the time signature, and the detection window for extracting the weak beat is set according to the setting of the resolution, these need not necessarily be set according to the time signature and the resolution. For example, a detection window for extracting a strong beat and a detection window for extracting a weak beat may be independently specified. Alternatively, a detection window for extracting a strong beat and a detection window for extracting a weak beat may be set according to the set time signature. There is also a method of setting both detection windows based on the metronome timing at the time of recording as described above.

[0108]

As described above, according to the present invention, the waveform data is recorded while the synchronization data indicating the timing relationship between the automatic performance information and the waveform data is recorded. Can be easily synchronized. Further, an envelope level of the waveform data is obtained, and based on the synchronization data and the envelope level,
According to the configuration for obtaining the break position of the waveform data, an effective rising position can be efficiently extracted as the break position. Furthermore, by extracting the rising position corresponding to the estimated beat position, erroneous detection can be prevented, and the rising position can be detected stably. In other words, a position that is expected to be delimited and that is more musically appropriate can be set as a delimiter position, and a delimiter position is erroneously detected or divided at a position that is not musically appropriate. Such a situation can be prevented beforehand.

Further, according to the configuration in which the estimated beat position is determined based on the beat timing, note-on timing, or note-off timing of the automatic performance information, the information originally included in the automatic performance information can be efficiently used. Further, it is possible to detect a break position. Further, according to the above-mentioned beat timing, note-on timing or note-off timing, according to the configuration in which one of the rising positions belonging to one predetermined range based on the note-off timing is selected and extracted as a waveform data delimiting position, Unnecessary rising positions can be efficiently removed.

[Brief description of the drawings]

FIG. 1 is a block diagram of a waveform editing system according to an embodiment of the present invention.

FIG. 2 is an operation explanatory diagram of a process of generating an insertion section and a connection section in the embodiment.

FIG. 3 is an explanatory diagram of an operation of a reproduction process in a conventional example and the embodiment.

FIG. 4 is a flowchart of a reproduction waveform data generation process in the embodiment.

FIG. 5 is a diagram illustrating an unnecessary band removal process (S
It is a wave form diagram before and after P8).

FIG. 6 is a flowchart of a default control point determination process.

FIG. 7 is an output waveform diagram of an absolute value conversion process (SP104).

FIG. 8 is an equivalent circuit diagram of an envelope follower process (SP106).

FIG. 9 is an equivalent circuit diagram of the edge detection filter processing and a waveform diagram of each part thereof.

FIG. 10 shows an edge detection filter process, an edge start position / peak position detection process, and a strong beat extraction process (SP11).
0 to SP114).

FIG. 11 shows an edge start position / peak position detection process (S
It is operation | movement explanatory drawing of P112).

FIG. 12 is an operation explanatory diagram and an output waveform diagram of a weak beat extraction process (SP116).

FIG. 13 is an operation explanatory diagram of a setting process of waveform data in an insertion section ni.

FIG. 14 is an operation explanatory diagram of an envelope level setting process in an insertion section ni.

FIG. 15 is a diagram illustrating an operation of an envelope level setting process in an insertion section ni.

FIG. 16 is a diagram showing a timing relationship between automatic performance information and original waveform data.

FIG. 17 is a flowchart of a performance processing routine.

FIG. 18 is an explanatory diagram of compression / expansion processing of reproduced waveform data.

FIG. 19 is a diagram showing a percussion system selection button 80 and a continuous system selection button 82.

FIG. 20 is a flowchart of an automatic performance & waveform recording processing routine.

21 is a diagram illustrating a display example of a waveform recording control window 150. FIG.

[Explanation of symbols]

1i to 12i insertion section, 1r to 12r original section, 1t to 12t connection section, 60 delay circuit, 62 subtractor, 64 switch, 66, 68 multiplier, 70 …… Adder, 72…
... delay circuit, 74 ... subtractor, 80 ... percussion system selection button, 82 ... continuous system selection button, 102 ...
Display unit, 104, operation unit, 106, microphone, 108, AD converter, 110, recording circuit,
112 ... hard disk, 114 ... reproduction circuit, 11
6: Mixer, 118: DA converter, 120:
Sound system, 122 ... sound source, 124 ... MID
I interface, 126... Interface, 12
8 ... timer, 130 ... CPU, 132 ... ROM,
134 RAM RAM 150 waveform recording control window 151 automatic performance file text box 1
52: Automatic performance start button, 154: Automatic performance stop button, 156: Waveform recording start button,
158: Waveform recording stop button, 159: Cancel button, 202, 204: Automatic performance track, 2
22: Waveform timing track, 224: Waveform data track.

Claims (14)

[Claims] A step of starting reproduction of automatic performance information; a step of starting recording of waveform data; and recording synchronization control data indicating a timing relationship between the automatic performance information and the waveform data. Recording the waveform data. 2. The method according to claim 1, further comprising: determining an envelope level of the waveform data; and detecting a break position of the waveform data based on the synchronization control data and the envelope level. Claim 1
The described waveform data analysis method. 3. The step of detecting a break position includes the steps of:
An estimation step of determining an estimated break position of the waveform data; a detection step of detecting a rise position of the waveform data within a predetermined range corresponding to the estimated break position; and dividing any one of the detected rise positions. 3. An extraction step for extracting as a position.
The described waveform data analysis method. 4. The waveform according to claim 3, wherein said estimating step determines an estimated break position of said waveform data based on a beat timing, a note-on timing or a note-off timing of said automatic performance information. Data analysis method. 5. The waveform data analysis method according to claim 3, wherein in the extracting step, any one of the rising positions is extracted as the separation position based on a characteristic of the detected rising position. 6. A step of determining an estimated beat position based on the automatic performance information and the synchronization control data, and a step of determining a break position of the waveform data based on the estimated beat position. The waveform data analysis method according to claim 1, wherein: 7. A step of determining an estimated rising position based on the note-on timing of the automatic performance information and the synchronization control data, and a step of determining a separating position of the waveform data based on the estimated rising position. 2. The waveform data analysis method according to claim 1, comprising: 8. A step of determining an estimated break position based on the automatic performance information and the synchronization control data; an analysis step of analyzing a portion near the estimated break position in the waveform data; 2. A method according to claim 1, further comprising the step of: determining a break position of the entire waveform data based on the break position. 9. The waveform data analysis method according to claim 8, wherein the analysis step is a step of detecting a rising position by analyzing an envelope of the waveform data. 10. The waveform according to claim 8, wherein the step of determining a break position determines one break position for each estimated break position based on a plurality of rising positions included in the analysis result. Data analysis method. 11. The automatic performance tempo clock and a sampling period of the waveform data are synchronized, and the synchronization control data includes timing data indicating a recording start timing of the waveform data. Item 11. The waveform data analysis method according to any one of Items 1 to 10. 12. The synchronization control data includes timing data indicating a recording start timing of the waveform data, and synchronization data for synchronizing a tempo clock of the automatic performance and a sampling cycle of the waveform data. The waveform data analysis method according to any one of claims 1 to 10, wherein 13. A waveform data analysis apparatus for executing the waveform data analysis method according to claim 1. Description: 14. A recording medium storing a program for executing the waveform data analysis method according to claim 1. Description: