JP5651328B2 - Music signal processor - Google Patents

Description

  The present invention relates to a musical tone signal processing apparatus, and more particularly to a musical tone signal processing apparatus that can extract a musical tone signal to be subjected to signal processing over a plurality of localizations.

  As a musical tone signal processing apparatus that performs signal processing on a musical tone signal at a desired localization, for example, an apparatus described in Japanese Patent Application Laid-Open No. 2006-1000086 is known. In this device, the input musical sound signals (left channel signal and right channel signal) are divided into a plurality of frequency bands (converted into spectral components), respectively, and the level ratio and phase difference between the left channel signal and the right channel signal. Are compared for each frequency band. When the comparison result falls within the preset level ratio and phase difference ranges, the musical sound signal in that frequency band is attenuated. As a result, the tone signal at the desired localization is attenuated.

Japanese Patent Laid-Open No. 2006-1000086

  In the above-described apparatus, a desired localization is determined (set) by using a phase difference range. Here, in this apparatus, the range of the phase difference that can be set is limited to one type of range. Therefore, extraction of a signal to be subjected to signal processing represented by attenuation, that is, extraction of a musical sound signal to be subjected to signal processing is limited to one phase difference range (limited to 1 localization). . Therefore, the above-described apparatus has a problem that it is not possible to extract a musical sound signal to be subjected to signal processing over a plurality of localizations.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a musical tone signal processing apparatus capable of performing extraction of musical tone signals to be subjected to signal processing over a plurality of localizations. It is said.

Means for Solving the Problems and Effects of the Invention

In order to achieve this object, according to the musical sound signal processing apparatus according to claims 1, 2 , and 3 , the extraction means has an output direction indicated by the localization information within a direction range in the output direction set in the setting means. When it is determined by the determining means that the signal falls within the range, the signal of each channel in the frequency band corresponding to the localization information determined to be within is extracted as an extraction signal from the tone signal for each direction range used for the determination. . In this way, the extraction means can extract the extraction signal from the signal of each channel for each set direction range, that is, for each desired localization. Therefore, there is an effect that signal processing can be performed on a desired localization signal included in the signal of each channel. In addition, the extraction means extracts signals for each set direction range from the signals of each channel, so after performing signal processing on the extracted signals (extraction signals), those signals (signal processing) It is possible to re-synthesize the extracted signal).

Further, according to the tone signal processing device according to claim 1, 2, 3, wherein, in addition to the above effects, the following effects can be obtained. When a plurality of extracted signals for each of a plurality of directional ranges are extracted by the extraction means, the signal of each channel in the frequency domain that is not included in any of the frequency bands of the plurality of extracted signals is extracted as a removal signal. It is. Then, the removal signal or the removal signal subjected to the signal processing is combined with the extraction signal or the extraction signal subjected to the signal processing for each output channel by the combining unit. Therefore, there is an effect that the signal output from each output channel after the synthesis can be made into a signal similar to the input musical sound signal, that is, a wide natural musical sound.

According to the musical sound signal processing device according to claim 4 , in addition to the effect produced by the musical sound signal processing device according to any one of claims 1 to 3 , the signal processing means performs an extraction signal extracted for each direction range. Thus, independent signal processing is performed for each direction range. Therefore, there is an effect that independent signal processing can be performed for each set direction range, that is, for each desired localization.

According to the musical sound signal processing device according to claim 5 , in addition to the effect produced by the musical sound signal processing device according to any one of claims 1 to 4 , the extraction means is a band range of the frequency band set by the frequency setting means. If it is determined by the frequency determination means that the frequency band corresponding to the localization information falls within, the frequency band corresponding to the localization information determined to fall within the set direction range has already been determined. The signal of each channel existing in both the frequency band corresponding to the localization information being extracted is extracted from the musical sound signal as an extraction signal for each direction range used for the determination. As described above, in the extraction of the extraction signal, the extraction unit uses the band range of the frequency band in addition to the direction range. Therefore, it is possible to suppress the influence from noise or the like generated outside the band range. Therefore, a musical sound signal at a desired localization, that is, an extraction signal can be extracted more accurately.

According to the musical sound signal processing device according to claim 6 , in addition to the effect produced by the musical sound signal processing device according to any one of claims 1 to 5 , the extraction means is within an allowable range set by the level setting means. When it is determined by the level determination means that the band level falls, the frequency band corresponding to the band level determined to fall within, and the frequency corresponding to the localization information already determined to fall within the set direction range The signal of each channel existing in both the bands is extracted as an extraction signal from the musical sound signal for each direction range used for the determination. As described above, in the extraction of the extraction signal, the extraction unit uses the allowable range of the band level in addition to the direction range. Therefore, it is possible to suppress the influence from noise or the like generated at a level exceeding the allowable range or at a level below the allowable range. Therefore, a musical sound signal at a desired localization, that is, an extraction signal can be extracted more accurately. In the musical tone signal processing apparatus according to claim 9, the “band level” indicates a level in the frequency band, the maximum level of the signal of each channel in the frequency band, the sum of the levels of the channel signals in the frequency band, And the average of the signal level of each channel in the frequency band.

According to the musical tone signal processing device according to claim 7, in addition to the effects of the tone signal processing device according to any one of claims 1 to 6, the signal processing means, output channel signals of each channel to be processed And each of the distributed signals is subjected to independent signal processing. Since a plurality of output means are provided corresponding to the above independent signal processing, after extracting the extraction signal for each desired localization, the extraction signal at the desired localization (that is, one localization) is distributed. In addition, there is an effect that after each signal after distribution is subjected to independent signal processing, they can be output from separate output means.

It is the block diagram which showed the effector (an example of a musical tone signal processing apparatus) which is one Embodiment of this invention. It is the figure which showed typically the process performed with DSP using a functional block. It is the figure which showed the process performed by each part S10, S20, S60-S90. It is the figure which showed the process performed by main process part S30. It is the figure which showed the detail of the process performed by 1st extraction process S100, 1st signal process S110, 2nd extraction process S200, and 2nd signal process S210. It is the figure which showed the detail of the process performed by process S300 which takes out other than designation | designated, and signal process S310 which is not designated. (A), (b) is a graph for demonstrating each coefficient determined by the localization w [f] and the target localization.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram showing an effector 1 (an example of a musical tone signal processing apparatus) that is an embodiment of the present invention. The effector 1 extracts a musical tone signal (hereinafter referred to as an “extraction signal”) to be subjected to signal processing over a plurality of conditions (each of a set of frequency, localization and maximum level). Is something that can be done.

  The effector 1 includes an Lch analog-digital converter (hereinafter referred to as “A / D converter”) 11L, an Rch A / D converter 11R, a digital signal processor (hereinafter referred to as “DSP”) 12, and an Lch A first digital-analog converter (hereinafter referred to as “D / A converter”) 13L1, an Rch first D / A converter 13R1, an Lch second D / A converter 13L2, and an Rch second D / A converter 13R2. The CPU 14, the ROM 15, the RAM 16, and the bus line 17 are included. The units 11 to 16 are electrically connected to each other via the bus line 17.

  The Lch A / D converter 11L converts the left channel signal (part of the musical tone signal) input from the IN_L terminal from an analog signal to a digital signal, and converts the digitized left channel signal to the bus line 17. It is a converter which outputs to DSP12 via this. The Rch A / D converter 11R converts the right channel signal (a part of the musical sound signal) input from the IN_R terminal from an analog signal to a digital signal, and converts the digitized right channel signal to the bus line. 17 is a converter that outputs the signal to the DSP 12 via 17.

  When the DSP 12 receives the left channel signal output from the Lch A / D converter 11L and the right channel signal output from the Rch A / D converter 11R, the DSP 12 performs signal processing on the input left channel signal and right channel signal. The left channel signal and the right channel signal subjected to the signal processing are converted into an Lch first D / A converter 13L1, an Rch first D / A converter 13R1, an Lch second D / A converter 13L2, and an Rch second D / A. It is a processor that outputs to the A converter 13R2.

  The Lch first D / A converter 13L1 and the Lch second D / A converter 13L2 convert the left channel signal subjected to signal processing by the DSP 12 from a digital signal to an analog signal, and convert the analog signal to the main speaker. It is a converter that outputs to terminals (OUT1_L terminal, OUT2_L terminal) to which the L channel side (not shown) is connected. It should be noted that the left channel signal that is output after the DSP 12 performs independent signal processing is input to the Lch first D / A converter 13L1 and the Lch second D / A converter 13L2.

  The first D / A converter 13R1 for Rch and the second D / A converter 13R2 for Rch convert the right channel signal, which has been subjected to signal processing by the DSP 12, from a digital signal to an analog signal, and convert the analog signal to the main speaker. This is a converter for outputting to terminals (OUT1_R terminal, OUT2_R terminal) to which the R channel side (not shown) is connected. The Rch first D / A converter 13R1 and the Rch second D / A converter 13R2 each receive a right channel signal that has been subjected to independent signal processing by the DSP 12 and output.

  The CPU 14 is a central control device that controls the units 11L to 13R2, 15, and 16. The ROM 15 is a non-rewritable memory that stores a control program executed by the effector 1. Processing performed by the DSP 12 to be described later with reference to FIGS. 2 to 6 is stored in the ROM 15 as a control program. The RAM 16 is a memory for temporarily storing various data.

  Next, the processing of the DSP 12 will be described with reference to FIG. FIG. 2 is a diagram schematically showing processing executed by the DSP 12 using functional blocks. The DSP 12 has a first processing unit S1 and a second processing unit S2 as functional blocks. The DSP 12 repeatedly executes the process shown in FIG. 2 while the effector 1 is powered on.

  The DSP 12 receives a left channel signal (hereinafter referred to as “IN_L [t] signal”) input from the IN_L terminal in the time domain. [T] indicates that the signal is indicated in the time domain, and the IN_R terminal. The right channel signal (hereinafter referred to as “IN_R [t] signal”) in the time domain input from is input, and the processes in the first processing unit S1 and the second processing unit S2 are executed.

  Here, the processing in the first processing unit S1 and the second processing unit S2 is the same processing and is executed at predetermined intervals, but the processing in the second processing unit S2 is the first processing. Execution is started with a predetermined time delay from the start of execution of processing in the part S1. Thereby, the process in the second processing unit S2 supplements the joint from the end of the execution of the process in the first processing unit S1 to the start of the execution, and the process in the first processing unit S1 ends the execution of the process in the second processing unit S2 It supplements the joint from the start to the execution. Therefore, a signal obtained by combining the signal generated by the first processing unit S1 and the signal generated by the second processing unit S2, that is, the first left channel signal in the time domain (hereinafter, “ OUT1_L [t] signal ”, a first right channel signal in the time domain (hereinafter referred to as“ OUT1_R [t] signal ”), and a second left channel signal in the time domain (hereinafter referred to as“ OUT2_L [t] ”). The second right channel signal in the time domain (hereinafter referred to as “OUT2_R [t] signal”) is prevented from becoming discontinuous. In the present embodiment, the first processing unit S1 and the second processing unit S2 are executed every 0.1 second, and the processing in the second processing unit S2 is 0 from the start of the processing in the first processing unit S1. .Start execution after 05 seconds. However, the execution interval between the first processing unit S1 and the second processing unit S2 and the delay time from the start of the processing in the first processing unit S1 to the start of the processing in the second processing unit S2 are 0.1 seconds. The value according to the sampling frequency and the number of musical sound signals can be appropriately used.

  The first processing unit S1 and the second processing unit S2 are Lch analysis processing unit S10, Rch analysis processing unit S20, main processing unit S30, L1ch output processing unit S60, R1ch output processing unit S70, and L2ch output processing unit as functional blocks. S80 and R2ch output processing unit S90 are provided.

  The Lch analysis processing unit S10 refers to the input IN_L [t] signal as a left channel signal (hereinafter referred to as “IN_L [f] signal”) indicated in the frequency domain. [F] indicates that the signal is indicated in the frequency domain. The Rch analysis processing unit S20 converts the input IN_R [t] signal into a right channel signal (hereinafter referred to as “IN_R [f] signal”) shown in the frequency domain. To be output. Details of the Lch analysis processing unit S10 and the Rch analysis processing unit S20 will be described later with reference to FIG.

The main processing unit S30 performs first signal processing, second signal processing, which will be described later, on the IN_L [f] signal input from the Lch analysis processing unit S10 and the IN_R [f] signal input from the Rch analysis processing unit S20. Further, non-designated signal processing is performed, and a left channel signal and a right channel signal shown in the frequency domain are output based on output results from each processing. Details of the processing of the main processing unit S30 will be described later with reference to FIGS.

  When one of the left channel signals (hereinafter referred to as “OUT_L1 [f] signal) indicated by the frequency domain output from the main processing unit S30 is input to the L1ch output processing unit S60, the OUT_L1 [f] The signal is converted into a left channel signal (hereinafter referred to as “OUT1_L [t] signal”) shown in the time domain. When one of the right channel signals (hereinafter referred to as “OUT_R1 [f] signal) output in the frequency domain output from the main processing unit S30 is input, the R1ch output processing unit S70 receives the OUT_R1 [f]. The signal is converted into a right channel signal (hereinafter referred to as “OUT1_R [t] signal”) shown in the time domain.

  When an L2ch output processing unit S80 receives a left channel signal (hereinafter referred to as an “OUT_L2 [f] signal) output from the main processing unit S30 and indicated by another frequency domain, the OUT_L2 [f] The signal is converted into a left channel signal (hereinafter referred to as “OUT2_L [t] signal”) shown in the time domain. The R2ch output processing unit S90 receives the OUT_R2 [f] when a right channel signal (hereinafter referred to as an “OUT_R2 [f] signal) output from the main processing unit S30 and indicated by another frequency domain is input. The signal is converted into a right channel signal (hereinafter referred to as “OUT2_R [t] signal”) shown in the time domain. Details of the processes of the L1ch output processing unit S60, the R1ch output processing unit S70, the L2ch output processing unit S80, and the R2ch output processing unit S90 will be described later with reference to FIG.

Note that the OUT 1 —L [t ] signal, OUT 1 —R [t ] signal, OUT 2 —L [t ] signal, and OUT 2 —R [t ] signal output from the output processing units S60 to S90 of the first processing unit S1. If, OUT 1 _L [t] signal output from the output processing section S60~S90 of the second processing unit S2, OUT 1 _R [t] signal, OUT 2 _L [t] signal, and OUT 2 _R [t] Each signal is synthesized by cross-fading.

  Next, referring to FIG. 3, the Lch analysis processing unit S10, the Rch analysis processing unit S20, the L1ch output processing unit S60, the R1ch output processing unit S70, the L2ch output processing unit S80, and the R2ch output processing, excluding the main processing unit 30, are performed. Details of the processing executed in unit S90 will be described. FIG. 3 is a diagram illustrating processing executed in each unit S10, S20, and S60 to S90.

  First, the Lch analysis processing unit S10 and the Rch analysis processing unit S20 will be described. In the Lch analysis processing unit S10, first, a window function process that is a process of applying a Hanning window to the IN_L [t] signal is executed (S11). Thereafter, Fast Fourier Transform (FFT) is performed on the IN_L [t] signal (S12). By this fast Fourier transform, the IN_L [t] signal is converted into an IN_L [f] signal (becomes a spectrum signal having the horizontal axis of each Fourier-transformed frequency [f]). The IN_L [f] signal is expressed by an expression having a real part and an imaginary part (hereinafter referred to as “complex expression”). Here, the reason why the Hanning window is applied to the IN_L [t] signal in the process of S11 is to reduce the influence of the start point and the end point in the input IN_L [t] signal on the fast Fourier transform. .

  After the processing of S12, in the Lch analysis processing unit S10, the level of the IN_L [f] signal (hereinafter referred to as “INL_Lv [f]”) and the phase of the IN_L [f] signal (hereinafter referred to as “INL_Ar [f]”). ) Is calculated for each frequency [f] (S13). Specifically, INL_Lv [f] is a sum of a value obtained by squaring the real part of the complex expression of the IN_L [f] signal and a value obtained by squaring the imaginary part of the complex expression of the IN_L [f] signal. It is obtained by calculating the square root of the sum of the values. Further, INL_Ar [f] is obtained by calculating an arc tangent (tan ^ (-1)) of a value obtained by dividing the imaginary part in the complex expression of the IN_L [f] signal by the real part. After the process of S13, the process proceeds to the process of the main processing unit S30.

  In the Rch analysis processing unit S20, the processes of S21 to S23 are performed on the IN_R [t] signal. Note that the processing of S21 to S23 is the same as the processing of S11 to S13, and is different from the processing of S11 to S13 in that the processing target is the IN_R [t] signal, and the IN_R [f] signal is This is the output point. Therefore, the detailed description of the processing of S21 to S23 is omitted. In addition, after the process of S23, it transfers to the process of main process part S30.

  Next, the L1ch output processing unit S60, the R1ch output processing unit S70, the L2ch output processing unit S70, and the R2ch output processing unit S90 will be described.

  In the L1ch output processing unit S60, first, inverse fast Fourier transform (inverse FFT) is performed (S61). In this process, specifically, a complex expression is obtained by using the OUT_L1 [f] signal calculated by the main processing unit S30 and the INL_Ar [f] calculated by S13 of the Lch analysis processing unit S10. The inverse fast Fourier transform is performed on the complex expression. Thereafter, a window function process for applying the same window as the Hanning window used in the Lch analysis processing unit S10 and the Rch analysis processing unit S20 is executed on the value calculated by the inverse fast Fourier transform (S62). For example, if the window function used in the Lch analysis processing unit S10 and the Rch analysis processing unit S20 is a Hanning window, the Hanning window is applied to the value calculated by the inverse fast Fourier transform in the processing of S62. Thereby, an OUT1_L [t] signal is generated. The reason why the Hanning window is applied to the value calculated by the inverse fast Fourier transform in the processing of S62 is to synthesize the signals output from the output processing units S60 to S90 while cross-fading.

  In the R1ch output processing unit S70, the processes of S71 to S72 are performed. Note that the processing of S71 to S72 is the same as the processing of S61 to S62. The difference from the processing of S61 to S62 is that the value for obtaining the complex expression used in the inverse fast Fourier transform is the main processing. The OUT_R1 [f] signal calculated in the unit S30 and the INR_Ar [f] calculated in the process of S23 of the Rch analysis processing unit S20. Other than that, it is the same as the process of S61-S62. Therefore, detailed description of the processing of S71 to S72 is omitted.

  In the L2ch output processing unit S80, the processes of S81 to S82 are performed. Note that the processing of S81 to S82 is the same as the processing of S61 to S62. The difference from the processing of S61 to S62 is that the value for obtaining the complex expression used in the inverse fast Fourier transform is the main processing. This is the OUT_L2 [f] signal calculated in the unit S30 (the same applies to the INL_Ar [f] calculated in the process of S13 of the Lch analysis processing unit S10). Other than that, it is the same as the process of S61-S62. Therefore, detailed description of the processing of S81 to S82 is omitted.

  In the R2ch output processing unit S90, the processes of S91 to S92 are performed. Note that the processing of S91 to S92 is the same as the processing of S61 to S62. The difference from the processing of S61 to S62 is that the value for obtaining the complex expression used in the inverse fast Fourier transform is the main processing. The OUT_R2 [f] signal calculated in the unit S30 and the INR_Ar [f] calculated in the process of S23 of the Rch analysis processing unit S20. Other than that, it is the same as the process of S61-S62. Therefore, details of the processing of S91 to S92 are omitted.

  Next, with reference to FIG. 4, the detail of the process performed by main process part S30 is demonstrated. FIG. 4 is a diagram illustrating processing executed in the main processing unit S30.

  In the main processing unit S30, first, the localization w [f] is obtained for each frequency obtained by the Fourier transform (S12, S22) performed on the IN_L [t] signal and the IN_R [t] signal, and the INL_Lv [ The larger level of f] and INR_Lv [f] is set as the maximum level ML [f] at each frequency (S31). The localization w [f] obtained in S31 and the set maximum level ML [f] are stored in a predetermined area of the RAM 16. In S31, the localization w [f] is obtained by (1 / π) × (arctan (INR_Lv [f] / INL_Lv [f]) + 0.25. Therefore, a musical sound is received at an arbitrary reference point. In this case, that is, when IN_L [t] and IN_R [t] are input at an arbitrary reference point, if the INR_Lv [f] is sufficiently larger than the INL_Lv [f], the localization w [f] is 0.75. On the other hand, if INL_Lv [f] is sufficiently larger than INR_Lv [f], the localization w [f] is 0.25.

  Next, the memory is cleared (S32). Specifically, the 1L [f] memory, 1R [f] memory, 2L [f] memory, and 2R [f] memory provided in the RAM 16 are cleared to zero. The 1L [f] memory and the 1R [f] memory are memories used when changing the localization formed by the OUT_L1 [f] signal and the OUT_R1 [f] signal output from the main processing unit S30. The 2L [f] memory and the 2R [f] memory are memories used when changing the localization formed by the OUT_L2 [f] signal and the OUT_R2 [f] signal output from the main processing unit S30.

After the execution of S32, a first extraction process (S100), a second extraction process (S200), and a process for extracting items other than the designation (S300) are executed. The first extraction process (S100) is a process of extracting a signal to be subjected to signal processing under a first condition set in advance, that is, an extraction signal, and the second extraction process (S200) is preset. This is a process of extracting the extraction signal under the second condition. Further, the process (S300) for extracting other than specified is a process for extracting a signal extracted under the first condition or a signal other than the signal extracted under the second condition. In addition, since the process (S300) for taking out items other than the designation uses the processing results of the first take-out process (S100) and the second take-out process (S200), the first take-out process (S100) and the second take-out process (S200). It is executed after the process is completed.

  After the execution of the first extraction process (S100), a first signal process for performing signal processing on the extracted signal extracted in the process (S100) is executed (S110). Further, after the execution of the second extraction process (S200), a second signal process is performed (S210) for performing signal processing on the extracted signal extracted in the process (S200). Further, after execution of the processing for extracting non-designation (S300), non-designated signal processing for performing signal processing on the extracted signal extracted in the processing (S300) is executed (S310).

  Here, the first extraction process (S100), the first signal process (S110), the second extraction process (S200), and the second signal process (S210) will be described with reference to FIG. Referring to FIG. 4, the process for extracting non-designation (S300) and the non-designation signal process (S310) will be described.

  First, the first extraction process (S100), the first signal process (S110), the second extraction process (S200), and the second signal process (S210) will be described. FIG. 5 is a diagram showing details of processing performed in the first extraction processing (S100), the first signal processing (S110), the second extraction processing (S200), and the second signal processing (S210).

  In the first extraction process (S100), the frequency [f] is within the preset first frequency range, and the localization w [f] and the maximum level ML [f] at the frequency within the first frequency range are set. It is determined whether or not each is within a preset first setting range, that is, whether or not the musical sound signal satisfies the first condition (S101). The frequency [f] is within a preset first frequency range, and the localization w [f] and the maximum level ML [f] at a frequency within the first frequency range are each set to a preset first setting. If it is within the range (S101: Yes), the tone signal (left channel signal and right channel signal) at that frequency [f] is determined to be an extracted signal, and 1 is assigned to the array rel [f] [1]. .0 is substituted (S102). It should be noted that the frequency at the time point determined as Yes in S101 is substituted for f described in the array rel [f] [1]. Moreover, 1 described in the array rel [f] [1] indicates that the array rel [f] [1] is an extraction signal in the first extraction process (S100).

  Note that the frequency [f] is not within the preset first frequency range, or the localization w [f] at the frequency [f] within the first frequency range is not within the first set range, or When the maximum level ML [f] at the frequency [f] within one frequency range is not within the first setting range (S101: No), the tone signal (left channel signal and right channel signal) at that frequency [f] Is not an extracted signal, and 0.0 is substituted into the array rel [f] [1] (S103).

  After the process of S102 or S103, it is determined whether or not the process of S101 is completed for all the Fourier-transformed frequencies (S104). If the determination of S104 is negative (S104: No), the process of S101 On the other hand, if the determination in S104 is affirmative (S104: Yes), the process proceeds to the first signal process (S110).

  In the first signal processing (S110), the level of the 1L [f] signal that is a part of the OUT_L1 [f] signal is adjusted, and the level of the 1R [f] signal that is a part of the OUT_R1 [f] signal is adjusted. Thus, the process of S111 for adjusting the localization (the amount output from the main speaker) formed by the extraction signal in the first extraction process (S100) is performed. In parallel with the processing of S111, in the first signal processing (S110), the level of the 2L [f] signal that is a part of the OUT_L2 [f] signal is adjusted and a part of the OUT_R2 [f] signal is adjusted. By adjusting the level of the 2R [f] signal, the process of S114 for adjusting the localization (the amount output from the sub-speaker) formed by the extracted signal in the first extraction process (S100) is performed.

  In the processing of S111, a 1L [f] signal that is a part of the OUT_L1 [f] signal is calculated. Specifically, “INL_Lv [f] × ll + INR_Lv [f] × lr) × rel [f] [1] × a” is a Fourier transform performed on the IN_L [t] signal and the IN_R [t] signal ( This is performed for all the frequencies obtained in S12, S22), and a 1L [f] signal is calculated. Similarly, in the process of S111, a 1R [f] signal that is a part of the OUT_R1 [f] signal is calculated. Specifically, “INL_Lv [f] × rl + INR_Lv [f] × rr) × rel [f] [1] × a” is performed for all the frequencies subjected to Fourier transform in S12 and S22, and 1R [f ] Signal is calculated.

  Here, a is a coefficient predetermined for the first signal processing, and ll, lr, rl, rr are localization w [f] obtained from the musical sound signals (left channel signal, right channel signal); It is a coefficient determined in accordance with a target localization (for example, a value within a range of 0.25 to 0.75) predetermined for the first signal processing. Here, ll, lr, rl, and rr will be described with reference to FIG. FIG. 7 is a graph for explaining each coefficient determined according to the localization w [f] and the target localization. In the graph of FIG. 7, the horizontal axis is a value of (target localization−localization w [f] +0.5), and the vertical axis is each coefficient (ll, lr, rl, rr, ll ′, lr ′). , Rl ′, rr ′).

  The relationship between ll and rr is as shown in FIG. Therefore, when the value of (target localization−localization w [f] +0.5) is 0.5, ll and rr are the maximum coefficients. On the other hand, the relationship between lr and rl is as shown in FIG. 7B, and when the value of (target localization-localization w [f] +0.5) is 0.5, rl is the smallest (zero) coefficient between each other.

  Returning to the description of FIG. After the processing of S111, processing for performing pitch change, level change, and reverberation is performed on the 1L [f] signal (S112). Note that pitch change, level change, and reverberation (so-called convolution reverb) are all well-known techniques and will not be described in detail. When the process of S112 is performed on the 1L [f] signal, the 1L_1 [f] signal constituting the OUT_L1 [f] signal is generated. Similarly, after the processing of S111, processing for performing pitch change, level change, and reverberation is performed on the 1R [f] signal (S113). When the process of S113 is performed on the 1R [f] signal, the 1R_1 [f] signal constituting the OUT_R1 [f] signal is generated.

  In the process of S114, a 2L [f] signal that is a part of the OUT_L2 [f] signal is calculated. Specifically, “INL_Lv [f] × ll ′ + INR_Lv [f] × lr ′) × rel [f] [1] × b” was performed on the IN_L [t] and IN_R [t] signals. This is performed for all the frequencies obtained by the Fourier transform (S12, S22), and a 2L [f] signal is calculated. Similarly, in the process of S114, a 2R [f] signal that is a part of the OUT_R2 [f] signal is calculated. Specifically, “INL_Lv [f] × rl ′ + INR_Lv [f] × rr ′) × rel [f] [1] × b” is performed for all the frequencies subjected to Fourier transform in S12 and S22. A 2R [f] signal is calculated.

Note that b is a coefficient predetermined for the first signal processing. This coefficient b may be the same as or different from the coefficient a. In addition, ll ′, lr ′, rl ′, rr ′ are the localization w [f] obtained from the musical tone signal and the target localization predetermined for the first signal processing (for example, 0.25-0) A value in the range of .75). Here, ll ′, lr ′, rl ′, rr ′ will be described with reference to FIG. The relationship between ll ′ and rr ′ is as shown in FIG. 7A. When the value of (target localization−localization w [f] +0.5) is 0.0, ll ′ is While it is the largest coefficient, rr ′ is the smallest (zero) coefficient. Conversely, when the value of (target localization-localization w [f] +0.5) is 1.0, ll ′ is the minimum (zero) coefficient, while rr ′ is the maximum coefficient. It becomes.

  Similarly, the relationship between lr ′ and rl ′ is as shown in FIG. 7B, and when the value of (target localization−localization w [f] +0.5) is 0.0, lr ′ is the largest coefficient, while rl ′ is the smallest (zero) coefficient. Conversely, when the value of (target localization-localization w [f] +0.5) is 1.0, lr ′ is the minimum (zero) coefficient, while rl ′ is the maximum coefficient. It becomes.

  Returning to the description of FIG. After the process of S114, processing for changing the pitch, changing the level, and applying reverb is performed on the 2L [f] signal (S115). When the process of S115 is performed on the 2L [f] signal, the 2L_1 [f] signal constituting the OUT_L2 [f] signal is generated. Similarly, after the process of S114, a process for changing the pitch, changing the level, and applying a reverb is performed on the 2R [f] signal (S116). When the process of S116 is performed on the 2R [f] signal, the 2R_1 [f] signal constituting the OUT_R2 [f] signal is generated.

  In the second extraction process S200 that is executed in parallel with the first extraction process S100, the frequency [f] is within a preset second frequency range, and the localization w [ It is determined whether or not f] and maximum level ML [f] are within a preset second setting range, that is, whether or not the musical tone signal satisfies the second condition (S201). In the present embodiment, the second frequency range is a range different from the first frequency range (a range where the range start and the range end do not completely match), and the second set range is different from the first set range. A range (a range where the start and end of the range do not completely match) is assumed. The second frequency range may be a range that partially overlaps the first frequency range, or may be a range that completely coincides with the first frequency range. The second setting range may also be a range that partially overlaps the first setting range, or may be a range that completely matches the first setting range.

  The frequency [f] is within a preset second frequency range, and the localization w [f] and the maximum level ML [f] at a frequency within the second frequency range are each preset second settings. If it is within the range (S201: Yes), the tone signal (left channel signal and right channel signal) at the frequency [f] is determined to be an extracted signal, and 1 is assigned to the array rel [f] [2]. .0 is substituted (S102). Note that 2 described in the array rel [f] [2] indicates that the array rel [f] [2] is an extraction signal in the second extraction process S200.

  The frequency [f] is not within the preset second frequency range, the localization w [f] at the frequency [f] within the second frequency range is not within the second set range, or the first When the maximum level ML [f] at the frequency [f] within the two frequency range is not within the second setting range (S201: No), the tone signal (left channel signal and right channel signal) at the frequency [f] Is not an extracted signal, and 0.0 is substituted into the array rel [f] [2] (S203).

  After the process of S202 or S203, it is determined whether or not the process of S201 has been completed for all the Fourier-transformed frequencies (S204). If the determination of S204 is negative (S204: No), the process of S201 On the other hand, if the determination in S204 is affirmative (S204: Yes), the process proceeds to the second signal process (S210).

  In the second signal processing (S210), the level of the 1L [f] signal that is a part of the OUT_L1 [f] signal is adjusted, and the level of the 1R [f] signal that is a part of the OUT_R1 [f] signal is adjusted. Thus, the process of S211 for adjusting the localization (the amount output from the main speaker) formed by the extracted signal in the second extraction process (S200) is performed. In parallel with the processing of S211, in the second signal processing (S210), the level of the 2L [f] signal that is a part of the OUT_L2 [f] signal is adjusted, and a part of the OUT_R2 [f] signal is adjusted. By adjusting the level of the 2R [f] signal, the process of S214 for adjusting the localization (the amount output from the sub-speaker) formed by the extracted signal in the second extraction process (S200) is performed.

  Here, each process of S211 to S216 in the second signal process (S210) is the same as each process of S111 to S116 in the first signal process (S110) except that the points described below are different. Therefore, the description thereof is omitted. The first difference between the second signal processing (S210) and the first signal processing (S110) is that the signal input to the first signal processing is an extraction signal from the first extraction processing (S100). On the other hand, the signal input to the second signal processing is an extraction signal from the second extraction processing (S200), and the second difference is that in the first signal processing, the array rel [f] [1 ] Is used in the second signal processing, the array rel [f] [2] is used, and the third difference is that the signal output from the first signal processing is 1L_1 [f]. 1R_1 [f], 1L_2 [f], and 1R_2 [f], the signals output from the second signal processing are 2L_1 [f], 2R_1 [f], 2L_2 [f], and 2R_2. The point is [f].

  Note that the target localization in the first signal processing (S110) and the target localization in the second signal processing (S210) may be the same or different. That is, when the target localization is different between the first signal processing and the second signal processing, the coefficients ll, rr, rl, rr, ll ′, rr ′, rl ′, rr ′ used in the first signal processing The coefficients ll, lr, rl, rr, ll ′, lr ′, rl ′, rr ′ used in the second signal processing are different. Further, the coefficients a and b used in the first signal processing and the coefficients a and b used in the second signal processing may be the same or different. The contents of the processing processes S112, S113, S115, and S116 executed in the first signal processing and the contents of the processing processes S212, S213, S215, and S216 executed in the second signal processing (S210) are as follows. , May be the same or different.

  Next, a process for extracting non-designation (S300) and a non-designation signal process (S310) will be described. FIG. 6 is a diagram showing the details of the processing performed in the processing for extracting non-designation (S300) and the non-designated signal processing (S310).

  In the process of extracting other than specified (S300), first, rel [f] [1] at the lowest frequency among the frequencies subjected to Fourier transform in S12 and S22 is 0.0, and rel [f] at the lowest frequency is selected. f] [2] is 0.0, that is, the tone signal (left channel signal and right channel signal) at the lowest frequency is used as an extraction signal, the first extraction process (S100) or the second extraction process (S200). (S301). In the present embodiment, the value of rel [f] [1] set in S102 and S103 in the first extraction process (S100) and the rel set in S202 and S203 in the second extraction process (S200). Assume that the determination in S301 is performed using the values of [f] and [2]. Further, before performing the process of S301, a process similar to the first and second extraction processes (S100, S200) is separately executed, and the value of rel [f] [1] and rel [f obtained at that time are obtained. ] The determination in S301 may be performed using the value of [2].

  When rel [f] [1] at the lowest frequency is 0.0 and rel [f] [2] at the lowest frequency is 0.0 (S301: Yes), at the lowest frequency It is determined that the tone signal has not yet been extracted as an extraction signal in the first extraction process (S100) or the second extraction process (S200), and 1.0 is substituted into the array remain [f] (S302). Here, 1.0 assigned to “remain [f]” indicates that the tone signal at the lowest frequency is an extracted signal in the process (S300) for extracting a non-designated signal. It should be noted that the frequency at the time when Yes is determined in S301 is substituted for f described in “remain [f]”.

  On the other hand, when rel [f] [1] at the lowest frequency is 1.0, or when rel [f] [2] at the lowest frequency is 1.0, or both are 1.0. In some cases (S301: No), it is determined that the musical tone signal at the lowest frequency has already been extracted as the extraction signal in the first extraction process S100 or the second extraction process S200, and the array remain [f] contains 0. .0 is substituted (S302). Here, 0.0 assigned to “remain [f]” indicates that the tone signal at the lowest frequency is not an extraction signal in the process (S300) for extracting other than specified.

  After the process of S302 or S303, it is determined whether or not the process of S301 has been completed for all the frequencies subjected to Fourier transform in S12 and S22 (S304). If the determination of S304 is negative (S304: No) ), The process returns to the process of S301, and the determination of S301 is performed for the lowest frequency among the frequencies for which the determination of S301 has not been performed. On the other hand, if the determination of S304 is affirmative (S304: Yes) ), The process proceeds to non-designated signal processing (S310).

  In the non-designated signal processing (S310), the level of the 1L [f] signal that is a part of the OUT_L1 [f] signal is adjusted, and the level of the 1R [f] signal that is a part of the OUT_R1 [f] signal is adjusted. Thus, the process of S311 for adjusting the localization (the amount output from the main speaker) formed by the extracted signal in the process (S300) of extracting other than the designation is performed. In parallel with the processing of S311, in the non-designated signal processing (S310), the level of the 2L [f] signal that is a part of the OUT_L2 [f] signal is adjusted, and a part of the OUT_R2 [f] signal is adjusted. By adjusting the level of the 2R [f] signal, the process of S314 is performed to adjust the localization (the amount output from the sub-speaker) formed by the extracted signal in the process (S300) of extracting other than the designation. .

  In the process of S311, a 1L [f] signal that is a part of the OUT_L1 [f] signal is calculated. Specifically, “INL_Lv [f] × ll + INR_Lv [f] × lr) × remain [f] × c” is performed for all the frequencies subjected to Fourier transform in S12 and S22, and the 1L [f] signal is obtained. Calculated. Similarly, in the process of S311, a 1R [f] signal that is a part of the OUT_R1 [f] signal is calculated. Specifically, “INL_Lv [f] × rl + INR_Lv [f] × rr) × remain [f] × c” is performed for all the frequencies Fourier-transformed in S12 and S22, and the 1R [f] signal is obtained. Calculated. Note that c is a predetermined coefficient for calculating 1L [f] and 1R [f] in the non-designated signal processing (S310), and this coefficient c is the same as the above-described coefficients a and b. It may or may not be.

After the processing in S311, processing for performing pitch change, level change, and reverberation is performed on the 1L [f] signal (S312). When the process of S312 is performed on the 1L [f] signal, the 1L_3 [f] signal constituting the OUT_L1 [f] signal is generated. Similarly, after the processing in S311, processing for performing pitch change, level change, and reverberation is performed on the 1R [f] signal (S313). When the process of S313 is performed on the 1R [f] signal, the 1R_3 [f] signal constituting the OUT_R1 [f] signal is generated.

  In the process of S314, a 2L [f] signal that is a part of the OUT_L2 [f] signal is calculated. Specifically, “INL_Lv [f] × ll ′ + INR_Lv [f] × lr ′) × remain [f] × d” is performed for all frequencies Fourier-transformed in S12 and S22, and 2L [f ] Signal is calculated. Similarly, in the process of S314, a 2R [f] signal that is part of the OUT_R2 [f] signal is calculated. Specifically, “INL_Lv [f] × rl ′ + INR_Lv [f] × rr ′) × remain [f] × d” is performed for all frequencies Fourier-transformed in S12 and S22, and 2R [f ] Signal is calculated. Note that d is a predetermined coefficient for calculating 2L [f] and 2R [f] in the non-designated signal processing (S310), and this coefficient d is the coefficient a, b, c described above. They may be the same or different.

  After the processing of S314, processing for changing the pitch, changing the level, and applying reverb is performed on the 2L [f] signal (S315). When the process of S315 is performed on the 2L [f] signal, the 2L_3 [f] signal constituting the OUT_L2 [f] signal is generated. Similarly, after the processing of S314, processing for changing the pitch, changing the level, and applying reverb is performed on the 2R [f] signal (S316). When the process of S316 is performed on the 2R [f] signal, the 2R_3 [f] signal constituting the OUT_R2 [f] signal is generated.

  As described above, in the main processing unit S30, as shown in FIGS. 5 and 6, in addition to the processes of S111, S211, and S311, the processes of S114, S214, and S314 are executed. Accordingly, the left channel signal and the right channel signal in the extracted extracted signal can be distributed, and independent signal processing can be performed on the distributed left channel signal and right channel signal. Therefore, different signal processing (processing for changing the localization) can be performed on each of the left and right channel signals distributed from the extracted signal. Of course, the same signal processing can be performed on each of the left and right channel signals distributed from the extracted signal. Here, the signals generated by the processes of S111, S211, and S311 are output from the OUT1_L terminal and the OUT1_R terminal, which are terminals for the main speaker, after the processing process, and are generated by the processes of S114, S214, and S314. The processed signal is output from the OUT2_L terminal and the OUT2_R terminal, which are sub-speaker terminals, after the processing. Therefore, after extracting an extraction signal for each desired condition, different signal processing and processing are performed on the extraction signal under the desired condition (in other words, the extraction signal under the one condition). Each extraction signal subjected to signal processing and processing can be output separately from each of the OUT1 terminal and the OUT2 terminal.

  Returning to the description of FIG. When the first signal processing (S110), the second signal processing (S210), and the non-designated signal processing (S310) are completed, the 1L_1 [f] signal generated in the first signal processing (S110) and the second signal processing ( The 1L_2 [f] signal generated in S210) and the 1L_3 [f] signal generated in the non-designated signal processing (S310) are combined to generate the OUT_L1 [f] signal. When the OUT_L1 [f] signal is input to the L1ch output processing unit S60 (see FIG. 3), the L1ch output processing unit S60 converts the input OUT_L1 [f] signal to OUT1_L [t], and The signal is output to the first D / A converter 13L1 for Lch (see FIG. 1) via the line 17.

  Similarly, the 1R_1 [f] signal generated in the first signal processing (S110), the 1R_2 [f] signal generated in the second signal processing (S210), and 1R_3 [generated in the non-designated signal processing (S310). The signal f] is combined with the signal OUT_R1 [f]. When the OUT_R1 [f] signal is input to the R1ch output processing unit S70 (see FIG. 3), the R1ch output processing unit S70 converts the input OUT_R1 [f] signal into an OUT1_R [t] signal, The data is output to the first D / A converter 13R1 for Rch (see FIG. 1) via the bus line 17. Note that generation of the OUT_L2 [f] signal and OUT_R2 [f] signal and conversion of the OUT2_L [t] signal and OUT2_R [t] signal are performed in the same manner as described above.

  Thus, in the generation of the OUT_L1 [f] signal, the 1L_1 [f] signal generated in the first signal processing (S110) and the 1L_2 [f] signal generated in the second signal processing (S210) are combined. In addition, the 1L_3 [f] signal generated in the non-designated signal processing (S310) is synthesized. Similarly, in the generation of the OUT_R1 [f] signal, the 1R_1 [f] signal generated in the first signal processing (S110) and the 1R_2 [f] signal generated in the second signal processing (S210) are combined. In addition, the 1R_3 [f] signal generated in the non-designated signal processing (S310) is synthesized. Therefore, a signal that has not been extracted in the first signal processing (S110) or the second signal processing (S210) can be synthesized with the extracted signal extracted for each desired condition. Therefore, the OUT_L1 [f] signal and the OUT_R1 [f] can be made to be the same signal as the input musical sound signal, that is, a natural sound having a spread.

  As described above, in the effector 1 of the present embodiment, signal processing (S110, S210) is performed on the extraction signal extracted in the first extraction process (S100) or the second extraction process (S200). Here, the first extraction process (S100) and the second extraction process (S200) satisfy each condition for each set condition (for each condition in which the frequency, localization, and maximum level are a set). A musical sound signal (left channel signal and right channel signal) is extracted as an extraction signal. Therefore, extraction of an extraction signal to be subjected to signal processing can be performed over a plurality of conditions (each of which is a set of frequency, localization and maximum level).

  As described above, the present invention has been described based on the present embodiment, but the present invention is not limited to the above-described embodiment, and various modifications can be easily made without departing from the spirit of the present invention. It can be guessed.

  In the above-described embodiment, the extraction signal extraction in the first extraction process (S100) and the second extraction process (S200) is performed using a condition in which the frequency, the localization, and the maximum level are set as one set. It is not a thing. That is, only the frequency, the localization, or the maximum level may be used as a condition for extracting the extraction signal. Alternatively, these may be appropriately combined (for example, a frequency and a localization may be combined).

  For example, when only the frequency is used as a condition for extracting the extraction signal, the determination content of S101 in the first extraction process (S100) is set to “frequency [f] is within a preset first frequency range. It may be changed to “whether or not.” Further, for example, when only the localization is used as a condition for extracting the extraction signal, the determination content of S101 in the first extraction process (S100) is set to “first localization w [f] set in advance. It may be changed to “whether it is within the setting range”. For example, when only the maximum level is used as a condition for extracting the extraction signal, the determination content of S101 in the first extraction process (S100) is set to “maximum level ML [f] is set in advance. It may be changed to “whether it is within the first setting range”. Here, when the determination content of S201 in the second extraction process (S200) is changed in accordance with the determination content change of S101, the same change as the determination content change of S101 may be performed.

  In the above-described embodiment, a condition in which the frequency, localization, and maximum level are set as a set is used as a condition for extracting the extraction signal. It is possible to suppress the influence of noise having a level or noise having a level lower than the condition. Therefore, in the above-described embodiment, the extraction signal can be accurately extracted.

  In S101 and S201 of the above-described embodiment, it is determined whether the frequency f, the localization w [f], and the maximum level ML [f] are within preset ranges. f] and an arbitrary function having at least two of the maximum levels ML [f] as variables may be used to determine whether or not a value obtained by the function is within a set range. . Thereby, a more complicated range can be set.

  In each processing (S112, S113, S115, S116, S212, S213, S215, S216, S312, S313, S315, and S316) executed in the above-described embodiment, pitch change, level change, and reverberation were performed. However, these changes and reverberation may be set to the same contents in all the machining processes, or the contents of each machining process may be different. For example, the processing in the first signal processing (S112, S113, S115, S116), the processing in the second signal processing (S212, S213, S215, S216), and the processing in the non-designated signal processing (S312, S313) S315 and S316) may be set to different contents. In addition, when the contents of each processing in the first signal processing, the second signal processing, and the non-designated signal processing are different, different signal processing is performed on each extracted signal extracted for each condition. it can.

  In the above-described embodiment, the left and right two-channel musical sound signals are input to the effector 1 as a signal processing target. However, the left and right two-channel music signals are not limited to the left and right, and the two channels are localized in two directions. A configuration may be adopted in which a musical sound signal is input to the effector 1 as an object to be subjected to signal processing. Further, the tone signal input to the effector 1 may be a tone signal of three or more channels. When a sound signal of three or more channels is input to the effector 1, a localization w [f] (localization information) corresponding to the localization of each channel is calculated, and each calculated localization w [f] falls within the setting range. Or not. For example, in addition to the left and right localization w [f], the vertical and / or front / rear localization is calculated, and whether the calculated left / right localization w [f] and the vertical and / or front / rear localization are within the set range. Determine. Taking the left and right four-channel music signal as an example, the localization of two pairs of music signals (left and right, front and rear) is calculated, and whether the calculated left and right localization and the calculated localization are within the set range Determine.

  In the above-described embodiment, in the extraction process (S100, S200), the amplitude of the tone signal is used as the level (maximum level ML [f]) of each signal to be compared with the set range. A configuration using power may also be used. That is, in the above-described embodiment, in order to obtain INL_Lv [f], the value obtained by squaring the real part of the complex expression of the IN_L [f] signal and the imaginary part of the complex expression of the IN_L [f] signal are squared. The value is added together and the square root of the added value is calculated. For example, the value obtained by squaring the real part in the complex expression of the IN_L [f] signal and the complex expression of the IN_L [f] signal INL_Lv [f] may be obtained by adding together the value obtained by squaring the imaginary part.

  In the above-described embodiment, the localization w [f] is calculated based on the level ratio of the left and right channel signals. However, the localization w [f] may be calculated based on the level difference between the left and right channel signals.

  In the above-described embodiment, the localization w [f] is uniquely obtained for each frequency band from the two-channel musical sound signals. However, a plurality of continuous frequency bands are grouped based on the localization obtained in each frequency band. The localization probability distribution within the group may be obtained, and the localization probability distribution may be used as localization information (localization w [f]). In such a case, for example, it is possible to extract a desired musical sound signal by determining whether or not a range in which the localization is equal to or greater than a predetermined probability falls within a set range (a range set as a direction range).

  In the above-described embodiment, the localization w [f obtained from the left and right musical sound signals (ie, the extracted signals) extracted by the respective extraction processes (S100, S200, S300) in S111, S114, S211, S214, S311, and S314. ] And the target localization, the localization formed by the extracted signal is adjusted. Instead, a monaural tone signal is synthesized from the extracted left and right tone signals, for example, by simply adding them together, and extracted based on the target localization for the synthesized monaural tone signal. It is good also as a structure which adjusts the localization formed with a signal.

  In the above-described embodiment, after extraction signals and signals other than the designation are respectively extracted by the extraction processes (S100, S200, S300), each signal processing (S110, S210, S310) is performed on the extraction signals and signals other than the designation. Then, the obtained signals (that is, the extracted signal after processing and the signal other than the designation) are synthesized for each output channel, and the synthesized signals (OUT_L1 [f], OUT_R1 [f], OUT_L2 [ f] and OUT_R2 [f]), and then applying an inverse FFT process (S61, S71, S81, S91) to the combined signals, the time domain signal for each output channel is obtained. It was set as the structure to obtain.

  Instead, after extracting the extracted signal and signals other than the designation by each extraction processing (S100, S200, S300), each signal processing (processing corresponding to S110 and the like) is performed on the extracted signal and the signals other than the designation. After that, each obtained signal (ie, the extracted signal after processing and the signal other than the designated signal) is subjected to inverse FFT processing (processing corresponding to S61 etc.) to be converted into a time domain signal. After that, by synthesizing each obtained signal (that is, the extracted signal after processing represented in the time domain and the signal other than the designation) for each output channel, a signal in the time domain for each output channel is obtained. Also good. In such a case as well, signal processing on the frequency axis is possible as in the above-described embodiment.

  Alternatively, after extraction signals and signals other than specified are respectively extracted by each extraction process (S100, S200, S300), inverse FFT processing (processing corresponding to S61 and the like) is performed on the extracted signals and signals other than the specification, respectively. Is converted to a time domain signal, and then each signal processing (ie, a process corresponding to S110) is performed on each obtained signal (ie, the extracted signal represented in the time domain and a signal other than that specified). After that, by synthesizing each obtained signal (that is, the extracted signal after processing represented in the time domain and the signal other than the designation) for each output channel, a signal in the time domain for each output channel is obtained. Also good.

  In the above-described embodiment, the maximum level ML [f] is used as one of the conditions for extracting the extraction signal from the left and right channel signals. However, instead of the maximum level ML [f], a plurality of channel signals are used. It is also possible to use a sum or average of levels in each frequency band as extraction conditions.

  In the above-described embodiment, two extraction processes (first extraction process S100 and second extraction process S200) are performed for extracting the extraction signal, but three or more extraction processes may be provided. That is, the extraction condition (for example, a condition in which the frequency, localization, and maximum level are set as one set) is not two, but may be three or more. Further, when there are three or more extraction processes for extracting the extraction signal, the signal processing may be increased according to the number of extraction processes.

  In the above-described embodiment, a process (S300) for extracting data other than the designation is provided and a signal other than the extracted signal in the left and right channel signals is extracted. However, a process for extracting the data other than the designation (S300) may be omitted. That is, a configuration may be adopted in which signals other than the extracted signals in the left and right channel signals are not extracted. In the case where the process for extracting data other than the designation (S300) is not provided, the signal process other than the designation (S310) may not be provided.

  In the above-described embodiment, the left and right output terminal sets are two sets (that is, a set of OUT1_L terminal and OUT1_R terminal and a set of OUT2_L terminal and OUT2_R terminal). A set may be sufficient and three or more sets may be sufficient. For example, it may be 5.1 channel. When there is one set of output terminals, distribution of each channel signal is not performed in each signal processing, and the range of 0.25 to 0.75 in the graphs of FIGS. The calculation of S111, S211 and S311 may be performed using a graph stretched to 0 to 1.0 (that is, doubled).

  In each signal processing (S110, S210, S310) of the above-mentioned embodiment, the processing comprised from the change of the localization of the extracted musical sound (extracted signal), a pitch change, a level change, and reverb addition shall be performed. However, the signal processing performed on the extracted musical sounds may not always be the same processing. In other words, the execution contents of the signal processing may be appropriately selected for each extraction condition, and the execution contents of the signal processing may be different for each extraction condition. Further, as the contents of the signal processing, other known signal processing may be performed in addition to the localization change, the pitch change, the level change, and the reverb addition.

  In the above-described embodiment, the coefficients ll, lr, rl, rr, ll ′, lr ′, rl ′, rr ′ are linear with respect to the horizontal axis as shown in FIGS. Although it is assumed to change, the portion that increases or decreases may not be linearly increased or decreased, but may be increased or decreased in a curved line (for example, a sine curve).

In the above-described embodiment, the Hanning window is used as the window function, but a Hamming window or a Blackman window may be used.
<Others>
<Means>
The musical sound signal processing apparatus of the technical idea 1 includes an input means for inputting a musical sound signal composed of signals of a plurality of channels, and a signal of each channel constituting the musical sound signal input to the input means, each having a plurality of frequencies. Based on the level determined by the level calculating means, the level calculating means for determining the level of the signal of each channel in each of the frequency bands divided by the dividing means, and the level calculated by the level calculating means in advance Localization information calculation means for calculating localization information indicating the output direction of the musical sound signal with respect to a predetermined reference point in association with each of the frequency bands; and setting means capable of setting a plurality of direction ranges in the output direction of the musical sound signal And the musical tone signal indicated by the localization information calculated by the localization information calculation means within the direction range set by the setting means. Determining means for determining whether the output direction of the sound signal falls within the set direction range, and when the output direction of the musical sound signal indicated by the localization information falls within the direction range set by the setting means When determined by the determination means, the signal of each channel in the frequency band corresponding to the localization information determined to fit is extracted as an extraction signal from the musical sound signal for each direction range used for the determination. An extraction means, a signal processing means for obtaining an extraction signal after processing by performing signal processing on the extraction signal extracted for each direction range by the extraction means, and a post-processing extraction signal obtained by the signal processing means A synthesis unit that synthesizes all of the directional ranges for each preset output channel corresponding to each channel, and a combination by the synthesis unit. Conversion means for converting each of the signals obtained by the above into a time domain signal to obtain a time domain signal, and an output means for outputting the time domain signal obtained by the conversion means for each output channel. ing.
The musical sound signal processing apparatus of the technical idea 2 is an extraction means for extracting, from the musical sound signal, a signal of each channel other than the extraction signal extracted by the extraction means as a removal signal in the musical sound signal processing apparatus of the technical idea 1. The signal processing means performs signal processing on the extraction signal extracted for each of the direction ranges by the extraction means, obtains an extracted signal after processing, and applies to the removal signal extracted by the extraction means Signal processing is performed to obtain a post-processing removal signal, and the synthesis means synthesizes all the post-processing extraction signals in the direction range and the post-processing removal signal for each of the output channels. It is.
The musical sound signal processing apparatus according to the technical idea 3 includes an input means for inputting a musical sound signal composed of signals of a plurality of channels, and a signal for each channel constituting the musical sound signal input to the input means, each having a plurality of frequencies. Based on the level determined by the level calculating means, the level calculating means for determining the level of the signal of each channel in each of the frequency bands divided by the dividing means, and the level calculated by the level calculating means in advance Localization information calculation means for calculating localization information indicating the output direction of the musical sound signal with respect to a predetermined reference point in association with each of the frequency bands; and setting means capable of setting a plurality of direction ranges in the output direction of the musical sound signal And the musical tone signal indicated by the localization information calculated by the localization information calculation means within the direction range set by the setting means. Determining means for determining whether the output direction of the sound signal falls within the set direction range, and when the output direction of the musical sound signal indicated by the localization information falls within the direction range set by the setting means When determined by the determination means, the signal of each channel in the frequency band corresponding to the localization information determined to fit is extracted as an extraction signal from the musical sound signal for each direction range used for the determination. An extraction means, a signal processing means for obtaining an extraction signal after processing by performing signal processing on the extraction signal extracted for each direction range by the extraction means, and a post-processing extraction signal obtained by the signal processing means Conversion means for converting to a time domain extraction signal, and the time domain extraction signal converted by the conversion means are preset for each channel. For each output channel are provided with a combining means for combining all of the directional range, and output means for outputting a signal of the time domain obtained by the combining means to each of the output channels.
The musical sound signal processing apparatus according to the technical idea 4 is an extraction means for extracting the signal of each channel other than the extracted signal extracted by the extracting means from the musical sound signal as a removal signal in the musical sound signal processing apparatus according to the technical idea 3. The signal processing means performs signal processing on the extraction signal extracted for each of the direction ranges by the extraction means, obtains an extracted signal after processing, and applies to the removal signal extracted by the extraction means The signal is processed and obtained as a post-processing removal signal, and the conversion means obtains the post-processing extraction signal obtained by the signal processing means and the post-processing removal signal obtained by the removal signal processing means, Each of the signals is converted into a time-domain post-process extraction signal and a time-domain post-process removal signal. And processing after extraction signals of all the time domain direction range, is to combine the process after removal signal of the time domain.
The musical sound signal processing apparatus according to the technical idea 5 includes an input means for inputting a musical sound signal composed of signals of a plurality of channels, and a signal of each channel constituting the musical sound signal input to the input means, each having a plurality of frequencies. Based on the level determined by the level calculating means, the level calculating means for determining the level of the signal of each channel in each of the frequency bands divided by the dividing means, and the level calculated by the level calculating means in advance Localization information calculation means for calculating localization information indicating the output direction of the musical sound signal with respect to a predetermined reference point in association with each of the frequency bands; and setting means capable of setting a plurality of direction ranges in the output direction of the musical sound signal And the musical tone signal indicated by the localization information calculated by the localization information calculation means within the direction range set by the setting means. Determining means for determining whether the output direction of the sound signal falls within the set direction range, and when the output direction of the musical sound signal indicated by the localization information falls within the direction range set by the setting means When determined by the determination means, the signal of each channel in the frequency band corresponding to the localization information determined to fit is extracted as an extraction signal from the musical sound signal for each direction range used for the determination. Extraction means, conversion means for converting the extraction signal extracted for each direction range by the extraction means into a time domain extraction signal, and signal processing for the time domain extraction signal converted by the conversion means A signal processing means obtained as a time domain post-processing extraction signal, and the time domain post-processing extraction signal subjected to signal processing by the signal processing means, Synthesis means for synthesizing all of the direction ranges for each output channel set in advance corresponding to the channel; and output means for outputting the time-domain signal obtained by the synthesis means for each output channel. It has.
The musical sound signal processing apparatus according to the technical idea 6 is the musical sound signal processing apparatus according to the technical idea 5, in which the signal of each channel other than the extracted signal extracted by the extracting means is extracted from the musical sound signal as a removal signal. The conversion means converts the extraction signal extracted for each direction range by the extraction means and the removal signal extracted by the extraction means into a time-domain extraction signal and a time-domain removal signal, respectively. The signal processing means performs processing on the time-domain extracted signal and the time-domain removed signal obtained by the converting means, and the time-domain post-processed extracted signal and the time-domain extracted signal, respectively. Obtained as a post-processing removal signal, and the combining means, for each output channel, the post-processing extraction signals of all the time domains in the direction range, And a processing after removal signal between regions is to synthesize.
The musical sound signal processing apparatus according to the technical idea 7 is any one of the technical ideas 1 to 6, wherein the signal processing means is independent for each direction range with respect to the extracted signal extracted for each direction range. Apply signal processing.
The musical tone signal processing apparatus according to the technical idea 8 is the musical tone signal processing apparatus according to any one of the technical ideas 1 to 7, wherein the setting means determines a band range of the frequency band in the signal of each channel for each direction range. A frequency setting means for setting the frequency information corresponding to the localization information calculated by the localization information calculation means within the band range set by the frequency setting means. Frequency determining means for determining each direction range is provided, and the extracting means is determined by the frequency determining means when a frequency band corresponding to the localization information is within the band range set by the frequency setting means. The frequency band corresponding to the localization information determined to fall within the direction range and the localization information that has already been decided to fall within the direction range. The signals of the respective channels present in the band of both the frequency band, for each direction range used in the judgment, is extracted as the extraction signal from the tone signal.
The musical sound signal processing apparatus according to the technical idea 9 is the musical sound signal processing apparatus according to any one of the technical thoughts 1 to 8, in the frequency band based on the level of the signal of each channel calculated by the level calculation means. Band level determining means for determining a band level is provided, and the setting means includes level setting means for setting an allowable range of the band level determined by the band level determining means for each direction range, and the determining means The level determining unit includes, for each direction range, a level determining unit that determines whether the band level determined by the band level determining unit is within the allowable range set by the level setting unit. If the level determination means determines that the band level falls within the allowable range set by the level setting means. Each of the channels existing in both the frequency band corresponding to the band level determined to fall within the band and the frequency band corresponding to the localization information already determined to fall within the direction range. A signal is extracted as an extraction signal from the musical sound signal for each direction range used for the determination.
The musical tone signal processing apparatus according to technical idea 10 is the musical tone signal processing apparatus according to any one of technical ideas 1 to 9, wherein the signal processing means distributes the signal of each channel to be processed according to the output channel. Each of the distributed signals is subjected to independent signal processing, and a plurality of the output means are provided corresponding to the independent signal processing.
<Effect>
According to the musical sound signal processing apparatus of the technical ideas 1, 3, and 5, the extracting means determines that the output direction indicated by the localization information is within the direction range in the output direction set in the setting means. In this case, the signal of each channel in the frequency band corresponding to the localization information determined to fall within is extracted as an extraction signal from the tone signal for each direction range used for the determination. In this way, the extraction means can extract the extraction signal from the signal of each channel for each set direction range, that is, for each desired localization. Therefore, there is an effect that signal processing can be performed on a desired localization signal included in the signal of each channel. In addition, the extraction means extracts signals for each set direction range from the signals of each channel, so after performing signal processing on the extracted signals (extraction signals), those signals (signal processing) It is possible to re-synthesize the extracted signal).
According to the musical sound signal processing apparatus of the technical idea 2, the following effects are produced in addition to the effects produced by the musical sound signal processing apparatus of the technical idea 1. Further, according to the musical sound signal processing device of the technical idea 4, in addition to the effects produced by the musical sound device of the technical idea 3, the following effects are produced. Moreover, in addition to the effect which the musical tone signal processing apparatus of the technical idea 6 has, the following effect is produced. A signal of each channel other than the extraction signal extracted by the extraction means is taken out as a removal signal, and the removal signal or the removal signal subjected to the signal processing is extracted for each output channel by the synthesis means. And synthesize. Therefore, there is an effect that the signal output from each output channel after the synthesis can be made into a signal similar to the input musical sound signal, that is, a wide natural musical sound.
According to the musical sound signal processing device of the technical idea 7, in addition to the effects exhibited by any one of the musical sound signal processing devices of the technical thoughts 1 to 6, the signal processing means performs an extraction signal extracted for each direction range. Independent signal processing is performed for each direction range. Therefore, there is an effect that independent signal processing can be performed for each set direction range, that is, for each desired localization.
According to the musical sound signal processing device of the technical idea 8, in addition to the effect exhibited by any of the musical sound signal processing devices of the technical thoughts 1 to 7, the extraction means is within the band of the frequency band set by the frequency setting means. In addition, when it is determined by the frequency determination means that the frequency band corresponding to the localization information falls, it is already determined that the frequency band corresponds to the localization information determined to fall within the set direction range. The signal of each channel existing in both the frequency band corresponding to the localization information is extracted as an extraction signal from the musical sound signal for each direction range used for the determination. As described above, in the extraction of the extraction signal, the extraction unit uses the band range of the frequency band in addition to the direction range. Therefore, it is possible to suppress the influence from noise or the like generated outside the band range. Therefore, a musical sound signal at a desired localization, that is, an extraction signal can be extracted more accurately.
According to the musical sound signal processing device of the technical idea 9, in addition to the effect exhibited by any of the musical sound signal processing devices of the technical thoughts 1 to 8, the extraction means has a bandwidth within the allowable range set by the level setting means. When it is determined by the level determination means that the level falls, the frequency band corresponding to the band level determined to fall within, and the frequency band corresponding to the localization information already determined to fall within the set direction range The signal of each channel existing in both bands is extracted as an extraction signal from the tone signal for each direction range used for the determination. As described above, in the extraction of the extraction signal, the extraction unit uses the allowable range of the band level in addition to the direction range. Therefore, it is possible to suppress the influence from noise or the like generated at a level exceeding the allowable range or at a level below the allowable range. Therefore, a musical sound signal at a desired localization, that is, an extraction signal can be extracted more accurately. In the musical sound signal processing apparatus of the technical idea 9, “band level” indicates a level in the frequency band, and the maximum level of the signal of each channel in the frequency band, the sum of the levels of the channel signals in the frequency band, And the average of the signal level of each channel in the frequency band.
According to the musical sound signal processing device of the technical idea 10, in addition to the effects produced by any of the musical sound signal processing devices of the technical thoughts 1 to 9, the signal processing means uses the signal of each channel to be processed as an output channel. In accordance with the distribution, each of the distributed signals is subjected to independent signal processing. Since a plurality of output means are provided corresponding to the above independent signal processing, after extracting the extraction signal for each desired localization, the extraction signal at the desired localization (that is, one localization) is distributed. In addition, there is an effect that after each signal after distribution is subjected to independent signal processing, they can be output from separate output means.

1 Effector (musical sound signal processor)
11L, 11R A / D (input means)
D / A for 13L1, 13L2 Lch
D / A for 13R1, 13R2 Rch
S12, S22 FFT processing (dividing means)
S13, S23 Processing in the analysis processing unit (level calculation means)
S31 Processing in the main processing unit (localization information calculation means, band level determination means)
S60, S80 Output processing unit (combining means, converting means)
S70, S90 Output processing unit (combining means, converting means)
S100, S200 Extraction processing (setting means, frequency setting means, level setting means)
S101, S201 Processing in extraction processing (determination means, frequency determination means, level determination means)
S102, S202 Processing in extraction processing (extraction means)
S110, S210 Signal processing (signal processing means)
S302 Processing in processing other than specified (extraction means)
S310 Non-designated signal processing (signal processing means)

Claims (7)

Input means for inputting a musical sound signal composed of signals of a plurality of channels;
Dividing means for dividing each channel signal constituting the musical sound signal input to the input means into a plurality of frequency bands;
Level calculating means for obtaining the level of the signal of each channel in each of the frequency bands divided by the dividing means;
Localization information calculation means for calculating localization information indicating an output direction of the musical sound signal with respect to a predetermined reference point in association with each of the frequency bands based on the level obtained by the level calculation means;
Setting means capable of setting a plurality of direction ranges in the output direction of the musical sound signal;
Determining means for determining, for each of the set direction ranges, whether the output direction of the musical sound signal indicated by the localization information calculated by the localization information calculating means falls within the direction range set by the setting means; ,
When the determination means determines that the output direction of the musical sound signal indicated by the localization information falls within the direction range set by the setting means, the frequency band corresponding to the localization information determined to fall within Extracting means for extracting the signal of each channel in the musical sound signal as an extraction signal for each direction range used for the determination;
When a plurality of the extracted signals for each of the plurality of directional ranges are extracted by the extraction means, the musical sound is used as a signal to remove the signal of each channel in a frequency band that does not include any of the plurality of extracted signals. Taking out means from the signal;
The extraction means by performing signal processing on the extracted signal extracted for each of the direction range both obtains a post-processing the extracted signal, performs signal processing on the extracted cancellation signal by said extracting means, after treatment Signal processing means obtained as a removal signal ;
Before SL for each output channel that is set in advance corresponding to each channel, and synthesizing means for synthesizing all of the processing after extraction signal of the directional range, and the processing after removal signal,
Conversion means for converting signals obtained by the synthesis by the synthesis means into respective time domain signals to obtain time domain signals;
A musical tone signal processing apparatus comprising: output means for outputting the time domain signal obtained by the converting means for each output channel. Input means for inputting a musical sound signal composed of signals of a plurality of channels;
Dividing means for dividing each channel signal constituting the musical sound signal input to the input means into a plurality of frequency bands;
Level calculating means for obtaining the level of the signal of each channel in each of the frequency bands divided by the dividing means;
Localization information calculation means for calculating localization information indicating an output direction of the musical sound signal with respect to a predetermined reference point in association with each of the frequency bands based on the level obtained by the level calculation means;
Setting means capable of setting a plurality of direction ranges in the output direction of the musical sound signal;
Determining means for determining, for each of the set direction ranges, whether the output direction of the musical sound signal indicated by the localization information calculated by the localization information calculating means falls within the direction range set by the setting means; ,
When the determination means determines that the output direction of the musical sound signal indicated by the localization information falls within the direction range set by the setting means, the frequency band corresponding to the localization information determined to fall within Extracting means for extracting the signal of each channel in the musical sound signal as an extraction signal for each direction range used for the determination;
When a plurality of the extracted signals for each of the plurality of directional ranges are extracted by the extraction means, the musical sound is used as a signal to remove the signal of each channel in a frequency band that does not include any of the plurality of extracted signals. Taking out means from the signal;
Wherein performing signal processing on the direction range extracted extracted signal for each by the extraction means and obtained as the processed extracted signals, performs signal processing on the extracted removed signal by the extracting means, processing after removal Signal processing means for obtaining a signal;
Conversion means for converting the post-processing extraction signal and post-processing removal signal obtained by the signal processing means into a time-domain post-processing extraction signal and a time-domain post-processing removal signal, respectively ;
Before SL for each output channel that is set in advance corresponding to each channel, and combining means for combining the processed extract signals of all the time domain of the direction range, and a process after removal signal of the time domain,
A musical tone signal processing apparatus comprising: output means for outputting the time domain signal obtained by the synthesizing means for each output channel. Input means for inputting a musical sound signal composed of signals of a plurality of channels;
Dividing means for dividing each channel signal constituting the musical sound signal input to the input means into a plurality of frequency bands;
Level calculating means for obtaining the level of the signal of each channel in each of the frequency bands divided by the dividing means;
Localization information calculation means for calculating localization information indicating an output direction of the musical sound signal with respect to a predetermined reference point in association with each of the frequency bands based on the level obtained by the level calculation means;
Setting means capable of setting a plurality of direction ranges in the output direction of the musical sound signal;
Determining means for determining, for each of the set direction ranges, whether the output direction of the musical sound signal indicated by the localization information calculated by the localization information calculating means falls within the direction range set by the setting means; ,
When the determination means determines that the output direction of the musical sound signal indicated by the localization information falls within the direction range set by the setting means, the frequency band corresponding to the localization information determined to fall within Extracting means for extracting the signal of each channel in the musical sound signal as an extraction signal for each direction range used for the determination;
When a plurality of the extracted signals for each of the plurality of directional ranges are extracted by the extraction means, the musical sound is used as a signal to remove the signal of each channel in a frequency band that does not include any of the plurality of extracted signals. Taking out means from the signal;
An extraction signal extracted for each of the direction range by the extracting means, converting means for converting the cancellation signal extracted by said extraction means, respectively, into a removal signal of the extracted signal and the time domain of the time domain,
Signal processing means for performing signal processing on the time domain extraction signal and the time domain removal signal obtained by the conversion means, and obtaining a time domain post-processing extraction signal and a time domain post-processing removal signal , respectively ;
Before SL for each output channel that is set in advance corresponding to each channel, and combining means for combining the processed extract signals of all the time domain of the direction range, and a process after removal signal of the time domain,
A musical tone signal processing apparatus comprising: output means for outputting the time domain signal obtained by the synthesizing means for each output channel. Said signal processing means, the relative said extracted signal extracted for each direction range, tone signal according to any one of claims 1 to 3, characterized by applying independent signal processing for each of the direction range Processing equipment. The setting means includes a frequency setting means for setting a band range of the frequency band in the signal of each channel for each direction range,
The determination means determines, for each direction range, whether the frequency band corresponding to the localization information calculated by the localization information calculation means falls within the band range set by the frequency setting means. With
When the frequency determination unit determines that the frequency band corresponding to the localization information falls within the band range set by the frequency setting unit, the extraction unit adds the localization information determined to fall within the band range. The direction range used for the determination of the signal of each channel existing in both the corresponding frequency band and the frequency band corresponding to the localization information already determined to be within the direction range. every musical tone signal processing device according to any one of 4 claims 1, characterized in that the extraction as the extraction signal from the tone signal. Band level determining means for determining a band level in the frequency band based on the level of the signal of each channel calculated by the level calculating means,
The setting means includes level setting means for setting a permissible range of the band level determined by the band level determining means for each direction range,
The determination means includes level determination means for determining, for each direction range, whether or not the band level determined by the band level determination means is within the allowable range set by the level setting means,
The extraction means, when the level determination means determines that the band level falls within the allowable range set by the level setting means, the frequency band corresponding to the band level determined to fall within And the signal of each channel existing in both the frequency band corresponding to the localization information that has already been determined to fall within the direction range, for each direction range used for the determination, tone signal processing device according to claim 1, characterized in that the extraction as the extraction signal from the signal 5. The signal processing means distributes the signal of each channel to be processed according to the output channel, and performs independent signal processing on each distributed signal,
And the output means, the tone signal processing device according to any one of claims 1 to 6, characterized in that is provided with a plurality to correspond to the separate signal processing.

Images