JP6519316B2 - Sound material processing apparatus and sound material processing program - Google Patents

Description

  The present invention relates to a sound material processing apparatus and a sound material processing program for processing a plurality of sound materials.

  Time stretching is performed to change the tempo without changing the pitch of the audio data (audio data). Various methods have been proposed as a method of time stretch. The time required for processing varies depending on the time stretch method. Therefore, when time stretching is performed on a plurality of sound materials by different methods, a silent state occurs when switching the method, or a sound deviation occurs in which the same sound is reproduced twice.

  In the music processing apparatus and program described in Patent Document 1, a first time axis companding process which is a high speed and low sound quality processing system and a second time axis companding process which is a low speed and high sound quality processing system Is used. In response to a reproduction instruction, musical tone data obtained as a result of the first time axis decompression process is output, and triggered by the number of musical tone data obtained as a result of the second time axis decompression process reaching a sufficient number. The tone data obtained as a result of the second time axis decompression process is output instead of the first time axis decompression process.

Patent 5359203 gazette

  According to the method described in Patent Document 1, no sound displacement occurs when switching from the first time axis stretching process to the second time axis stretching process. However, in the above method, it is necessary to use a processing method that can obtain low-quality processing results as well as a processing method that can obtain high-quality processing results. Therefore, it is not possible to process each of a plurality of sound materials by a desired processing method. In order to reproduce a plurality of sound materials respectively processed by a desired processing method without causing the user to shift the sound, knowledge and experience about each processing method and signal processing of musical tones are required.

  An object of the present invention is a sound material processing apparatus and a sound material processing program capable of processing each of a plurality of sound materials by an arbitrary processing method and easily securing the continuity of the plurality of sound materials after processing. It is to provide.

  (1) The sound material processing apparatus according to the present invention comprises a plurality of processing modules for processing sound materials in different processing methods, a determination means for determining the processing method for each of the plurality of sound materials, and a plurality of sound materials. Input means for inputting each processing module corresponding to the determined processing method, output means for outputting a sound material processed by the processing module corresponding to the determined processing method, and sound for each of the plurality of processing modules Acquisition means for acquiring the time required for processing the material as a processing delay amount, and first setting means for setting a reference delay amount that is equal to or greater than the maximum processing delay amount among the processing delay amounts acquired for the plurality of processing modules And the time from the input of the sound material to the processing module determined by the input means to the output of the sound material by the output means is equal to the reference delay amount. And a delay imparting section for delaying a sound material in the process from the input of the sound material by means to the output of the sound material by the output means.

  In the sound material processing apparatus, the processing method is determined for each of the plurality of sound materials. Also, the processing delay amount for each processing module is acquired, and the reference delay amount that is equal to or greater than the maximum processing delay amount is set. When reproducing a plurality of sound materials, each sound material is input to a processing module corresponding to the determined processing method, processed by the processing module, and then the processed sound material is output. In this case, a delay is given to the sound material such that the time from the input of the sound material to the processing module to the output of the sound material becomes equal to the reference delay amount. Thereby, it becomes possible to process each of the plurality of sound materials by an arbitrary processing method and easily ensure the continuity of the plurality of sound materials after the processing. As a result, it is possible to perform natural reproduction on hearing without any deviation of sound. In addition, it is possible to obtain a suitable processing result without requiring the user to have particular knowledge about each processing method and performing work such as setting of the delay amount for each processing method. Furthermore, the processing method suitable for the sound material can be arbitrarily selected.

  (2) The delay giving means calculates the difference between the processing delay amount and the reference delay amount for the determined processing module, and corresponds to the difference when the sound material is input by the input device or when the sound material is output by the output device Delay may be given to the sound material. In this case, it is possible to easily ensure the continuity of a plurality of processed sound materials with a simple configuration.

  (3) The sound material processing apparatus further includes second setting means for setting parameter values related to processing of the plurality of processing modules, and each of the plurality of processing modules has a processing delay according to the value of the set parameter It may have an amount, and the acquisition means may acquire the processing delay amount according to the value of the parameter set for a plurality of processing modules. In this case, even when the processing delay amount of each processing module differs depending on the value of the parameter, it is possible to easily ensure the continuity of the plurality of sound materials after processing.

  (4) The determination means may determine the processing method based on the characteristics of each sound material. In this case, it becomes possible to appropriately process a plurality of sound materials by the processing method according to the characteristics of each sound material, and it is possible to easily ensure the continuity of the plurality of sound materials after processing.

  (5) The sound material processing program according to the present invention comprises the steps of determining the processing method for each of the plurality of sound materials, and processing corresponding to the processing method determined among the plurality of processing modules for each of the plurality of sound materials. The step of inputting to the module, the step of outputting the sound material processed by the processing module corresponding to the determined processing method, and the time required to process the sound material for each of the plurality of processing modules is acquired as the processing delay amount Step, setting a reference delay amount equal to or greater than the maximum processing delay amount among processing delay amounts acquired for a plurality of processing modules, and from input of a sound material to the determined processing module to output of a sound material Delay the sound material in the process from the input of the sound material to the output of the sound material so that the time of And-up, to be executed by a computer.

  According to the sound material processing program, it becomes possible to process each of the plurality of sound materials by an arbitrary processing method and easily ensure the continuity of the plurality of sound materials after the processing.

  According to the present invention, it is possible to process each of the plurality of sound materials by an arbitrary processing method and easily ensure the continuity of the plurality of sound materials after the processing.

FIG. 1 is a block diagram showing a configuration of an electronic music apparatus including a sound material processing apparatus according to an embodiment of the present invention. It is a block diagram which shows the functional structure of the sound material processing apparatus which concerns on embodiment of this invention. FIG. 5 is a flow chart showing processing of a plurality of sound materials performed by the sound material processing device of FIGS. 1 and 2; FIG. FIG. 5 is a flow chart showing processing of a plurality of sound materials performed by the sound material processing device of FIGS. 1 and 2; FIG. It is a timing diagram which shows an example of processing of a plurality of sound materials by the sound material processing apparatus. It is a block diagram which shows the other functional structure of a sound material processing apparatus.

  Hereinafter, a sound material processing apparatus and a sound material processing program according to an embodiment of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Electronic Music Device FIG. 1 is a block diagram showing the configuration of an electronic music device including a sound material processing device according to an embodiment of the present invention. According to the electronic music apparatus 1 of FIG. 1, the user can perform performance, produce music, and the like. Further, the user can process various sound materials by the electronic music apparatus 1 and reproduce the processed sound materials.

  The electronic music apparatus 1 includes a performance data input unit 2, an input I / F (interface) 3, a setting operator 4, a detection circuit 5, a touch panel display 6, a detection circuit 7 and a display circuit 8. The performance data input unit 2 includes a pitch designation operation element such as a keyboard or a microphone, and is connected to the bus 19 via the input I / F 3. Performance data based on a user's performance operation is input by the performance data input unit 2. The setting operator 4 includes a switch that is turned on and off, a rotary encoder that is rotated, a linear encoder that is slid, and the like, and is connected to the bus 19 via the detection circuit 5. The setting control 4 is used to adjust the volume, to turn on / off the power, and to make various settings.

  The touch panel display 6 is connected to the bus 19 via the detection circuit 7 and the display circuit 8. Various information is displayed on the touch panel display 6. The user can instruct various operations by operating the touch panel display 6.

  The electronic music apparatus 1 further includes a RAM (random access memory) 9, a ROM (read only memory) 10, a CPU (central processing unit) 11, a timer 12, and a storage device 13. The RAM 9, the ROM 10, the CPU 11 and the storage device 13 are connected to the bus 19, and the timer 12 is connected to the CPU 11. An external device such as the external storage device 15 may be connected to the bus 19 via the communication I / F (interface) 14. The RAM 9, the ROM 10, the CPU 11, and the timer 12 constitute a computer.

  The RAM 9 is, for example, a volatile memory, is used as a work area of the CPU 11, and temporarily stores various data. The ROM 10 is, for example, a non-volatile memory, and stores a computer program such as a system program and a sound material processing program. The CPU 11 executes a sound material processing program stored in the ROM 10 on the RAM 9 to process sound materials described later. The timer 12 provides time information such as the current time to the CPU 11.

  The storage device 13 includes a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card. The storage device 13 stores a plurality of sound materials. The user selects a series of sound materials that constitute the music. Each sound material is sound data (audio data) composed of a sampling data string indicating a sound waveform. Sounds are not limited to musical sounds, but include voices or any other sounds. The sound material has an arbitrary length, and may have a length corresponding to one beat or a plurality of beats or a length of one pronunciation less than one beat, and corresponds to one bar or a plurality of bars of music. It may have a length that Further, the storage device 13 stores automatic performance data and automatic accompaniment data. The sound material processing program described above may be stored in the storage device 13.

  Similar to the storage device 13, the external storage device 15 may include a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card, and may store various data such as music data or a sound material processing program.

  The sound material processing program according to the present embodiment may be provided in the form of being stored in a computer readable recording medium, and may be installed in the ROM 10 or the storage device 13. Further, when the communication I / F 14 is connected to the communication network, a sound material processing program distributed from a server connected to the communication network may be installed in the ROM 10 or the storage device 13.

  The electronic music apparatus 1 further comprises a sound source 16, an effect circuit 17 and a sound system 18. The sound source 16 and the effect circuit 17 are connected to the bus 19, and the sound system 18 is connected to the effect circuit 17. The sound source 16 generates a tone signal based on the performance data input from the performance data input unit 2 or the automatic performance data or the automatic accompaniment data supplied from the storage device 13. The effect circuit 17 applies an acoustic effect to a tone signal generated by the sound source 16 or a sound material given from the CPU 11.

  Sound system 18 includes digital to analog (D / A) conversion circuitry, amplifiers and speakers. The sound system 18 converts a tone signal given from the sound source 16 through the effect circuit 17 or a sound material given from the CPU 11 through the effect circuit 17 into an analog sound signal to generate a sound based on the analog sound signal. Thereby, the tone signal or the sound material is reproduced. In the electronic music apparatus 1, the touch panel display 6, the RAM 9, the ROM 10, the CPU 11, the timer 12 and the storage device 13 mainly constitute the sound material processing apparatus 100.

(2) Functional Configuration of Sound Material Processing Apparatus 100 FIG. 2 is a block diagram showing a functional configuration of the sound material processing apparatus 100 according to the embodiment of the present invention. As shown in FIG. 2, the sound material processing apparatus 100 includes a reproduction instruction unit 110, a sound material input unit 120, a plurality of delay units 130, a plurality of processing modules 140, and a sound material output unit 150. Further, the sound material processing apparatus 100 includes a processing method determination unit 160, a feature information acquisition unit 161, a suitability information acquisition unit 162, a processing module selection unit 170, a differential delay amount calculation unit 180, a processing delay amount acquisition unit 190, and a parameter value. A setting unit 200 and a processing module registration unit 210 are included. The function of each block of the sound material processing apparatus 100 of FIG. 2 is realized by the CPU 11 executing a sound material processing program stored in the ROM 10 or the storage device 13.

  Hereinafter, in order to distinguish each of the plurality of delay units 130, the plurality of delay units 130 will be referred to as delay units 130a to 130d, respectively. Further, in the case of distinguishing each of the plurality of processing modules 140, the plurality of processing modules 140 will be referred to as processing modules 140a to 140d, respectively.

  The plurality of processing modules 140a to 140d process the sound material by different processing methods A to D, respectively. Here, different processing methods are methods for performing processing for the same purpose. Note that different processing methods may be methods for performing processing for similar purposes, instead of methods for performing processing for exactly the same purpose.

  In the present embodiment, the process is time stretch. Time-stretching means compressing or expanding acoustic data on a time axis. In the present embodiment, the processing methods A to D are different time stretch methods. The plurality of processing modules 140a to 140d respectively hold sound feature suitability information PRa to PRd of the processing methods A to D. The sound feature suitability information PRa to PRd will be described later. The time required for processing the sound material according to each processing method is called processing delay amount. The processing delay amount is the time from when the sound material is input to each processing module 140 until it is output. The processing modules 140a to 140d hold processing delay amounts DLa to DLd. In the present embodiment, the sound feature suitability information PRa to PRd and the processing delay amounts DLa to DLd are described in the program constituting the processing modules 140a to 140d.

  The processing delay amount acquisition unit 190 acquires the processing delay amounts DLa to DLd from the plurality of processing modules 140a to 140d. Difference delay amount calculation unit 180 calculates a value equal to or greater than the maximum value of processing delay amounts DLa to DLd as a reference delay amount, and calculates the difference between processing delay amounts DLa to DLd and the reference delay amount as difference delay amounts ΔDa to ΔDd. Do. Further, the differential delay amount calculation unit 180 sets the calculated differential delay amounts ΔDa to ΔDd in the delay units 130a to 130d corresponding to the processing modules 140a to 140d, respectively.

  The parameter value setting unit 200 sets values of variable parameters PA related to the processing of the processing modules 140a to 140d based on the operation of the touch panel display 6 of FIG. 1 by the user. In the present embodiment, the parameter is a stretch ratio. The stretch ratio is the ratio of the reproduction time of the sound material after time stretch to the reproduction time of the sound material before time stretch. The processing delay amounts DLa to DLd of the processing modules 140a to 140d change depending on the value of the parameter PA.

  The processing module registration unit 210 registers the processing module 140 used for processing a plurality of sound materials among the plurality of processing modules 140a to 140d based on the operation of the touch panel display 6 of FIG. 1 by the user. When all the processing modules 140 are registered, all the processing modules 140 can be used. When only some of the processing modules 140 are registered, only the registered processing modules 140 can be used to process each sound material. It becomes.

The sound material input unit 120 inputs a plurality of sound materials stored in the storage device 13 of FIG. 1 based on an operation of the touch panel display 6 by the user. The plurality of sound materials may be a plurality of sound materials continuously or discontinuously selected from one music data, or a plurality of sound materials discontinuously selected from a plurality of music data. The input order of the plurality of sound materials to the sound material input unit 120 is predetermined. In this embodiment, N pieces of sound material _SI 1 _{~SI N} is input. N is a natural number of 2 or more.

Feature information obtaining unit 161, respectively acquires feature information _SM 1 to SM _N representing a feature from a plurality of sound materials _SI 1 _{~SI N} input by sound material input unit 120. The suitability information acquisition unit 162 acquires sound feature suitability information PRa to PRd from the plurality of processing modules 140a to 140d. The processing method determination unit 160 uses the processing method used to process each sound material based on the feature information acquired by the characteristic information acquisition unit 161 and the sound feature suitability information PRa to PRd acquired by the suitability information acquisition unit 162. decide. In the present embodiment, the processing method used for processing each of the _N sound materials SI _{1 to} SIN is determined in advance before reproduction of the sound materials.

At the time of reproduction of the sound material, the reproduction instruction unit 110 instructs reproduction of a plurality of sound materials based on the operation of the touch panel display 6 of FIG. 1 by the user. Thereby, sound material input unit 120 inputs a plurality of sound materials _SI 1 _{~SI N} sequentially. In this case, a rest section may be inserted between the sound material to be input. In addition, each sound material may be input with the scheduled playback start time or the scheduled playback start time may be calculated. The processing module selection unit 170 selects the processing module 140 corresponding to the processing method determined by the processing method determination unit 160 for each input of the sound material, and inputs the sound material to the selected processing module 140 as the sound material input unit It instructs the sound material output unit 150 to output the sound material processed by the processing module 140 by instructing the processing module 140.

The sound material input unit 120 inputs each sound material to the processing module 140 instructed by the processing module selection unit 170 through the delay unit 130. At this time, the delay unit 130 applies a delay of a preset difference delay amount to the sound material. The selected processing module 140 processes the input sound material. The sound material output unit 150 outputs the sound material processed by the processing module 140 instructed by the processing module selection unit 170. In this embodiment, sound material output section 150 outputs the sound material _SI 1 _{~SI N} sound material _SO 1 obtained by performing time-stretching to SO _N sequentially.

(3) Determination method of processing method The characteristic of the sound material is, for example, whether the sound material is pitch sound or non-pitch sound, or single sound or mixed sound when the sound material is pitch sound Or whether there is a silent section in the sound material.

  A pitch sound is a sound that can be clearly perceived by people. The waveform of the pitch sound has periodicity. The pitch sound includes, for example, a sustained sound or a decaying sound emitted from human voice or a stringed instrument and a keyboard instrument. Further, among the percussion instruments, sounds such as marimba, iron chopsticks, toms and timpani are also included in the pitch sound. The non-pitched sound is a sound that a person can not clearly perceive the pitch. The non-pitched sound waveform has no periodicity. Pitchless sounds include the sounds of waterfalls or rain, and the sounds of percussion instruments such as snare drums and maracas.

  Pitch sounds include single tones and mixed tones. A single sound is a sound that a person perceives as one sound. A single tone waveform has a single period. A mixed sound is a sound in which a plurality of single sounds are mixed. A guitar or a piano can emit mixed sound alone. In addition, a combination of a plurality of single tones emitted simultaneously by a plurality of instruments also corresponds to a mixed tone.

  As the plurality of processing methods, for example, there are a slice method, a PSOLA (pitch synchronous superposition addition) method, a phase vocoder method, and a waveform cross fading method.

  The slicing method is suitable for a sound material (for example, percussion performance) in which a silent section exists between a plurality of sounds on a time axis. On the other hand, the slice method is not suitable for a sound material in which a plurality of consecutive sounds on the time axis overlap each other and there is no silent section, or a sound material with few silent sections. The PSOLA method is suitable for a single sound, and a constant sound quality can be obtained even for non-pitched sound. On the other hand, PSOLA method is not suitable for mixed sound. The phase vocoder system is suitable for pitch tones (both single tones and mixed tones) whose pitch is clear, and not suitable for non-pitch sound where the pitch is not clear. The waveform cross fade method can obtain constant sound quality for various sound materials including no pitch sound, single sound and mixed sound, but the single sound is inferior to the PSOLA sound in sound quality and the mixed sound is in phase Sound quality is inferior to vocoder system.

  The sound feature suitability information PRa to PRd indicates the degree of suitability of the processing methods A to D for a plurality of features. For example, in the processing method A, the highest sound quality is obtained when the sound material having the feature a is processed, and the lowest sound quality is obtained when the sound material having the feature b is processed, and the sound material having the feature c Intermediate tone quality is obtained when processing In this case, the sound feature preference information PRa has the highest preference for feature a, the lowest preference for feature b, and the middle preference for feature c. The processing method determination unit 160 performs processing having the highest suitability for the features of each sound material from the plurality of processing methods A to D based on the feature information and the sound feature suitability information PRa to PRd for each sound material. Determine the method.

(4) Operation of Sound Material Processing Apparatus 100 FIGS. 3 and 4 are flowcharts showing processing of a plurality of sound materials performed by the sound material processing apparatus 100 of FIGS. 1 and 2. FIG. 5 is a timing chart showing an example of processing of a plurality of sound materials by the sound material processing apparatus 100. The processing of the plurality of sound materials of FIGS. 3 and 4 is performed by the CPU 11 of FIG. 1 executing the sound material processing program stored in the ROM 10 or the storage device 13. Hereinafter, processing of a plurality of sound materials will be described in association with the operation of each unit of the sound material processing apparatus 100 of FIG.

  In this example, it is assumed that the processing modules 140a to 140d are registered as the processing modules 140 that can be used to process a plurality of sound materials by the processing module registration unit 210 in FIG. The parameter value setting unit 200 sets values of the parameters PA of the plurality of processing modules 140 a to 140 d.

First, the sound material input unit 120 of FIG. 2 obtains _N sound materials SI _{1 to} SIN to be reproduced from the plurality of sound materials stored in the storage device 13 of FIG. 1 based on the user's operation. To do (step S1). Next, the processing method determination unit 160 determines the processing method to be used for processing the _N sound materials SI _{1 to} SIN acquired by the sound material input unit 120 (step S2). In this example, it is assumed that each processing method A~D is used to process the sound material _SI 1 _{~SI 4.}

  Thereafter, the processing delay amount acquisition unit 190 acquires the processing delay amounts DLa to DLd from the processing modules 140a to 140d corresponding to the determined processing methods (step S3). In this example, the processing delay amounts DLa to DLd have a relationship of DLa <DLb <DLc <DLd.

  The differential delay amount calculating unit 180 determines the reference delay amount DR based on the processing delay amounts DLa to DLd acquired by the processing delay amount acquiring unit 190 (step S4). In the present example, the reference delay amount DR is determined to be the maximum processing delay amount DLd among the processing delay amounts DLa to DLd. Further, the differential delay amount calculation unit 180 calculates differences between the reference delay amount DR and the processing delay amounts DLa to DLd of the processing modules 140a to 140d as differential delay amounts ΔDa to ΔDd (step S5). Furthermore, the differential delay amount calculation unit 180 sets differential delay amounts ΔDa to ΔDd in the delay units 130a to 130d corresponding to the processing modules 140a to 140d (step S6).

Next, the processing method decision unit 160 determines the output start time of each sound material _SO 1 to SO _N by sound material input section 120 (step S7). The output start time corresponds to the time when reproduction of each sound material is started. The time difference between the output start time of each sound material and the output start time of the next sound material is determined by the reproduction time of each sound material after processing. In this example, when the input sound material does not include the rest section, but the input sound material includes the rest section, the rest section is added to the reproduction time. FIG. 5 shows the output start times r1 to r5 of the sound materials SO _{1 to} SO ₅ after the processing.

The processing method decision unit 160 determines the input start time of each sound material _SI 1 _{~SI N} by sound material input section 120 (step S8). In this case, each input start time is determined to be a time point earlier than the corresponding output start time by the reference delay amount DR. 5 shows, the input start time t1~t5 of sound material _SI 1 _{~SI 5} is shown.

  Based on the user's operation, the reproduction instruction unit 110 instructs the start of reproduction of a plurality of sound materials (step S9). Also, the reproduction instruction unit 110 activates the timer 12 of FIG. 1 (step S10). The processing module selection unit 170 sets the variable i to 1 (step S11). Next, the processing module selection unit 170 sets the processing module 140 used for processing the i-th (first) sound material as the current processing module 140 (step S12). In the present example, the processing module 140 a is the current processing module 140.

Thereafter, the processing module selection unit 170 determines whether the i-th (first) input start time t1 has arrived based on the output of the timer 12 of FIG. 1 (step S13). When the i-th (first) input start time t1 arrives, the processing module selection unit 170 starts the input of the i-th (first) sound material SI ₁ through the delay unit 130 a to the current processing module 140 a. The sound material input unit 120 is controlled to do this (step S14). In this case, as shown in FIG. 5, the delay unit 130 a adds the difference delay amount ΔDa to the sound material SI ₁ . Thereby, sound material SI ₁ is input to the processing module 140a from the input start time t1 after the elapse of the differential delay amount? Da. Processing module 140a starts processing the sound is input material SI _1, the output of the sound material SO ₁ that was processed after the processing delay amount DLa is possible.

Thereafter, the processing module selection unit 170 determines whether the i-th (first) output start time r1 has arrived based on the output of the timer 12 of FIG. 1 (step S15). When the i-th (first) output start time r1 arrives, the processing module selection unit 170 controls the sound material output unit 150 to output the sound material SO ₁ processed by the current processing module 140a. (Step S16). In the example of FIG. 5, the sound material output section 150, the output start time r1, and outputs while the first sound material SO ₁ that has been processed by the processing module 140a is faded in.

Next, based on the user's operation, the processing module selection unit 170 determines whether or not the reproduction instruction unit 110 instructs the end of reproduction (step S17). If the end of reproduction is not instructed, the processing module selection unit 170 adds 1 to the variable i (step S18). Next, the processing module selection unit 170 sets the processing module 140 used for processing the i-th (second) sound material SI ₂ as the next processing module 140 (step S19). In this example, the processing module 140 b is the next processing module 140.

Thereafter, the processing module selection unit 170 determines whether the i-th (second) input start time t2 has arrived based on the output of the timer 12 of FIG. 1 (step S20). When the i-th (second) input start time t2 arrives, the processing module selection unit 170 starts the input of the i-th (second) sound material SI ₂ through the delay unit 130 b to the next processing module 140 b. The sound material input unit 120 is controlled to do this (step S21). In this case, as shown in FIG. 5, the difference delay ΔDb the sound material SI ₂ by the delay unit 130b is applied. Thereby, sound material SI ₂ is input to the processing module 140b from the input start time t2 after the elapse of the differential delay Delta] Db. The processing module 140 b starts processing the input sound material SI ₂ , and can output the processed sound material SO ₂ after the processing delay amount DLb has elapsed.

Thereafter, the processing module selection unit 170 determines whether the i-th (second) output start time r2 has arrived based on the output of the timer 12 of FIG. 1 (step S22). When the i-th (second) output start time r2 arrives, the processing module selection unit 170 causes the sound material output unit 150 to stop the output of the sound material SO ₁ processed by the current processing module 140a. Are controlled (step S23). In the example of FIG. 5, the sound material output unit 150 fades out the sound material SO ₁ .

Next, the processing module selection unit 170 sets the next processing module 140b as the current processing module 140 (step S24). Processing module selection unit 170 controls the sound material output section 150 to output a sound material SO _2, which is processed by the current processing module 140b (step S25). In the example of FIG. 5, at the output start time r2, sound material output section 150 causes the fade in the sound material SO ₂ that has been processed by the processing module 140b.

Thereafter, the processing module selection unit 170 returns to step S17 and repeats steps S17 to S25. Thus, in the example of FIG. 5, the input start time t3 is a third sound material SI ₃ is input to the processing module 140c through the delay unit 130c, the processing of sound material SI ₃ after a differential delay ΔDc is initiated . Furthermore, the output start time r3 after the lapse of the processing delay DLc, 2-th sound material SO ₂ is faded out, the third sound material SO ₃ that has been processed by the processing module 140c is faded in. Similarly, the input start time t4 4 th sound material SI ₄ is input to a processing module 140d through the delay section 130d, processing sound material SI ₄ after a differential delay ΔDd is initiated. Furthermore, the output start time r4 after the elapse of the processing delay DLd, 3-th sound material SO ₃ is the fade-out, the processing module 4 th sound material SO ₄ treated with 140d are faded in.

  In step S17, when termination of reproduction is instructed, the processing module selection unit 170 stops the timer 12 (step S26), and the processing module selection unit 170 inputs the sound material to the current processing module 140. The sound material input unit 120 is controlled to stop (step S27), and the sound material output unit 150 is controlled to stop the output of the sound material processed by the current processing module 140 (step S28).

  In this example, since the preceding sound material fades out and the subsequent sound material fades in at the time of switching of the processing method, cross-fading is performed, so that a natural reproduced sound can be obtained.

  In the processing of the plurality of sound materials described above, when the parameter value setting unit 200 changes the value of the parameter PA, the processing delay amount of each processing method changes. Therefore, the output start time and the input start time of each sound material also need to be changed. In the present embodiment, since the parameter is a stretch ratio, when the value of the stretch ratio is changed, the processing delay amount of each processing module 140 and the reproduction time of the sound material after processing are also changed. In this case, the process returns to step S3, and the processing delay amount acquiring unit 190 acquires the processing delay amount according to the value of the parameter PA after the change, and the output start time and input start time of each sound material again in steps S4 to S8. It is determined. Thereafter, steps S9 to S28 are performed.

(5) Effects of the Embodiment According to the sound material processing apparatus 100 according to the present embodiment, each sound material can be processed by an appropriate processing method according to the feature. Further, delay is given to the sound material so that the time from the input of the sound material to the processing modules 140a to 140d to the output of the sound material becomes equal to the reference delay amount DR. As a result, no sound shift occurs when the processing methods A to D are switched. In this case, the user does not have to consider the processing delay amount of each processing method and the signal processing of the musical tone. As a result, even if the user has little knowledge and experience with each processing method and musical tone signal processing, each sound material is processed by an appropriate processing method and the continuity of a plurality of processed sound materials is easily secured. It is possible to

(6) Other Functional Configuration of Sound Material Processing Apparatus 100 FIG. 6 is a block diagram showing another functional configuration of the sound material processing apparatus 100. As shown in FIG. The sound material processing apparatus 100 of FIG. 6 is different from the sound material processing apparatus 100 of FIG. 2 in that a suitability information acquisition unit 163 is provided instead of the feature information acquisition unit 161 and the suitability information acquisition unit 162 of FIG. It is.

  The plurality of processing modules 140a to 140d respectively hold parameter value suitability information PPa to PPd of the processing methods A to D. Here, the parameter value suitability information PPa to PPd indicates the degree of suitability of the processing methods A to D with respect to a plurality of values of the parameter PA. Also in this example, the parameter is a stretch ratio. The parameter value suitability information PPa to PPd is described in the program constituting the processing modules 140a to 140d.

  In the plurality of processing methods A to D, the sound quality changes depending on the value of the parameter PA. In the processing method A, for example, the highest sound quality is obtained when the value of the stretch ratio is 100%, and the sound quality is degraded as the value of the stretch ratio increases or decreases. In this case, the parameter value preference information PPa indicates the highest preference when the value of the stretch ratio is 100%, and indicates the preference that decreases as the value of the stretch ratio increases or decreases. In the processing method B, for example, high sound quality is obtained when the value of the stretch ratio is within a certain range including 100%, but the sound quality is degraded when the value of the stretch ratio is outside the range. In this case, the parameter value preference information PPb shows high suitability when the value of the stretch ratio is within a certain range including 100%, and low preference when the value of the stretch ratio is outside the range. Show.

  In the processing method C, for example, the sound quality rises when the value of the stretch ratio exceeds a certain value, and the sound quality deteriorates when the value of the stretch ratio is less than a certain value. In this case, the parameter value preference information PPc indicates the preference to increase when the value of the stretch ratio exceeds a certain value, and indicates the low preference when the value of the stretch ratio is less than a certain value. In the processing method D, for example, relatively good sound quality can be obtained with a relatively wide range of values of the stretch ratio. In this case, the parameter value preference information PPd indicates relatively high preference at relatively wide range values of the stretch ratio.

  The suitability information acquisition unit 163 acquires parameter value feature suitability information PPa to PPd from the plurality of processing modules 140a to 140d. The processing method determination unit 160 uses the processing of each sound material based on the value of the parameter PA set by the parameter value setting unit 200 and the parameter value suitability information PPa to PPd acquired by the suitability information acquisition unit 163. Determine the method.

  The configuration and operation of the other parts of the sound material processing apparatus 100 of FIG. 6 are the same as the configuration of the sound material processing apparatus 100 of FIG. 2 and the operations of FIGS. 3 to 4. In the sound material processing apparatus 100 according to the present embodiment, it is possible to process each sound material with an appropriate processing method according to the value of the parameter PA and easily ensure continuity of a plurality of sound materials after processing. .

(7) Other Embodiments In the above embodiment, the plurality of delay units 130 are provided between the sound material input unit 120 and the plurality of processing modules 140, but the plurality of delay units 130 are provided in the plurality of processing modules 140. And the sound material output unit 150.

  In the above embodiment, each delay unit 130 of the sound material processing apparatus 100 of FIG. 2 adds a delay of the difference delay amount to each sound material, but without providing the plurality of delay units 130, the sound material input unit 120 A delay of the difference delay amount may be given to each sound material by adjusting the time when the sound material is input to each processing module 140. For example, the sound material input unit 120 may input a sound material to the processing module 140 corresponding to the processing delay amount DLa to DLd before the output start times r1 to r5 of FIG. 5 respectively. In this case, the sound material is input to the corresponding processing module 140 with a time delay corresponding to the difference delay amounts ΔDa to ΔDd than the input start times t1 to t4. Alternatively, the delay of the difference delay amount may be added to each sound material by adjusting the time when the sound material output unit 150 outputs the sound material processed by each processing module 140.

  In the above embodiment, the reference delay amount is set equal to the maximum processing delay amount among the processing delay amounts of the plurality of processing modules 140, but the reference delay amount is set to a value larger than the maximum processing delay amount It is also good. In the above embodiment, the time from the input of the sound material to the plurality of processing modules to the output of the sound material is calculated by calculating the difference delay amount between the reference delay amount and the processing delay amount of each processing module. A delay is given to each sound material to be equal to the amount, but the time from the input of the sound material to the plurality of processing modules to the output of the sound material may be fixed without calculating the difference delay amount.

  In the above embodiment, although the processing delay amount is described in each processing module 140, for example, the processing delay amounts of the plurality of processing modules 140 are stored in the form of a table or the like in the storage device 13 or the external storage device 15. It is also good. In the above embodiment, although the reference delay amount is set based on the processing delay amounts of the plurality of processing modules 140 registered by the processing module registration unit 210, the reference delay is set based on the processing delay amounts of all the processing modules 140. An amount may be set.

  Although a plurality of sound materials are stored in the storage device 13 in the above embodiment, a plurality of sound materials may be acquired by the communication I / F 14 via the communication network. Further, a plurality of sound materials may be acquired from the performance data input unit 2 or sound data input from the outside. Furthermore, depending on the type of processing, each sound material may be processed and reproduced while the processing method of each sound material is determined, or a plurality of sound materials may be acquired from sound data input by an input device such as a microphone. The determination of the processing method for each sound material, the processing and reproduction in the determined processing method may be sequentially performed.

  In the above embodiment, time stretch is performed as the process, but the present invention detects a code by performing an acoustic effect process that applies an acoustic effect to a plurality of sound materials, or analyzing and reproducing a plurality of sound materials. The present invention is also applicable to other processing such as code detection processing. In the code detection process, the processing time is short, but for example, a rough method in which the code is detected every measure, the type of the detected code is only the basic code, and the accuracy of the detection result of the code is very high There is a method without the method, a method with a long processing time, and a method with high accuracy, for example, in which a code is detected for each beat. By applying the present invention to code detection processing, natural reproduction of a plurality of sound materials can be performed, and a code suitable for each sound material can be detected.

  In the above embodiment, the processing method determination unit 160 automatically determines the processing method of each sound material on the basis of the feature or parameter value of each sound material, but the processing method determination unit 160 determines the processing method on the basis of the user's operation. The processing method of each sound material may be determined.

  In the above embodiment, the sound material processing apparatus 100 is provided in the electronic music apparatus 1. However, even if the sound material processing apparatus 100 is applied to an electronic device such as a personal computer, a smart device (smart device) or a game machine Good. The sound material processing apparatus 100 according to the above embodiment is realized by hardware such as the CPU 11 and software such as a sound material processing program, but each component of the sound material processing apparatus 100 of FIG. 2 or FIG. It may be realized by hardware such as a circuit.

(8) Correspondence between each component of the claim and each part of the embodiment Hereinafter, an example of correspondence between each component of the claim and each part of the embodiment will be described, but the present invention is limited to the following example. I will not. As each component of a claim, various other elements having the configuration or function described in the claim can be used.

  In the above embodiment, the processing modules 140 and 140a to 140d are examples of processing modules, the sound material input unit 120 is an example of input means, and the sound material output unit 150 is an example of output means. The acquisition unit 190 is an example of acquisition means, the differential delay amount calculation unit 180 is an example of first setting means, the delay units 130 and 130 a to 130 d are examples of delay giving means, and the parameter value setting unit 200 is It is an example of the 2nd setting means.

  The present invention can be used, for example, to process a plurality of sound materials.

DESCRIPTION OF SYMBOLS 1 ... Electronic music apparatus, 6 ... Touch-panel display, 9 ... RAM, 10 ... ROM, 11 ... CPU, 12 ... Timer, 13 ... Storage device, 15 ... External storage device, 18 ... Sound system, 19 ... Bus, 100 ... Sound Material processing apparatus 110: reproduction instruction unit 120: sound material input unit 130, 130a to 130d delay unit 140, 140a to 140d processing module 150: sound material output unit 160: processing method determination unit 161 ... characteristic information acquisition unit 162, 163 ... suitability information acquisition unit, 170 ... processing module selection unit, 180 ... differential delay amount calculation unit, 190 ... processing delay amount acquisition unit, 200 ... parameter value setting unit, 210 ... processing module Registration department

Claims (5)

A plurality of processing modules for processing the sound material by different processing methods;
Determining means for determining a processing method for each of the plurality of sound materials;
Input means for inputting each of the plurality of sound materials into a processing module corresponding to the determined processing method;
Outputting means for outputting the sound material processed by the processing module corresponding to the determined processing method;
Acquisition means for acquiring the time required to process the sound material for each of the plurality of processing modules as a processing delay amount;
First setting means for setting a reference delay amount that is equal to or greater than a maximum processing delay amount among the processing delay amounts acquired for the plurality of processing modules;
The input means from the input of the sound material by the input means such that the time from the input of the sound material to the determined processing module by the input means to the output of the sound material by the output means is equal to the reference delay amount And a delay applying means for delaying the sound material in the process up to the output of the sound material. The delay giving means calculates the difference between the processing delay amount for the determined processing module and the reference delay amount, and the input means for the sound material by the input means or the output of the sound material by the output means The sound material processing apparatus according to claim 1, wherein a delay corresponding to the difference is given to the sound material. The apparatus further comprises second setting means for setting values of parameters related to processing of the plurality of processing modules,
Each of the plurality of processing modules has a processing delay amount according to the value of the set parameter,
The sound material processing apparatus according to claim 1, wherein the acquisition unit acquires the processing delay amount according to the value of the parameter set for the plurality of processing modules. The sound material processing apparatus according to any one of claims 1 to 3, wherein the determination means determines the processing method based on the characteristics of each sound material. Determining a processing scheme for each of the plurality of sound material;
Inputting each of the plurality of sound materials into a processing module corresponding to the determined processing method among the plurality of processing modules;
Outputting the sound material processed by the processing module corresponding to the determined processing method;
Acquiring a time required for processing the sound material for each of the plurality of processing modules as a processing delay amount;
Setting a reference delay amount that is equal to or greater than the maximum processing delay amount among the processing delay amounts acquired for the plurality of processing modules;
Applying a delay to the sound material in the process from the input of the sound material to the output of the sound material such that the time from the input of the sound material to the processing module to the output of the sound material is equal to the reference delay amount And
Sound material processing program to be run on a computer.

Images