US8554349B2 - High-frequency interpolation device and high-frequency interpolation method - Google Patents

High-frequency interpolation device and high-frequency interpolation method Download PDF

Info

Publication number
US8554349B2
US8554349B2 US12/680,899 US68089908A US8554349B2 US 8554349 B2 US8554349 B2 US 8554349B2 US 68089908 A US68089908 A US 68089908A US 8554349 B2 US8554349 B2 US 8554349B2
Authority
US
United States
Prior art keywords
frequency
section
interpolation
signal
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/680,899
Other languages
English (en)
Other versions
US20100222907A1 (en
Inventor
Takeshi Hashimoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faurecia Clarion Electronics Co Ltd
Original Assignee
Clarion Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Clarion Co Ltd filed Critical Clarion Co Ltd
Assigned to CLARION CO., LTD. reassignment CLARION CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HASHIMOTO, TAKESHI
Publication of US20100222907A1 publication Critical patent/US20100222907A1/en
Application granted granted Critical
Publication of US8554349B2 publication Critical patent/US8554349B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques

Definitions

  • the present invention relates to a high-frequency interpolation device and a high-frequency interpolation method and, more particularly, to a high-frequency interpolation device and a high-frequency interpolation method capable of generating a suitable high-frequency interpolation signal in accordance with the frequency band of an audio signal.
  • a digital audio equipment that outputs music information recorded in a recording medium such as a CD or a DVD using a reproduction device such as a CD player or a DVD player is in widespread use. Since music information is recorded as digital information in a recording medium such as a CD in such a digital audio equipment, deterioration of the music quality accompanied by repeated reproduction/recording operation can be prevented, allowing a user to always enjoy high quality music.
  • general digital information (music information) recorded in such a recording medium is limited to information within a frequency range that can be generally perceived by the human ear, and high-frequency music information higher than a predetermined frequency is deleted.
  • the frequency that can be generally perceived by the human ear is from 20 Hz to 20 kHz.
  • the sampling frequency used in a music CD is 44.1 kHz, and the frequency range that can be reproduced by this CD is 20 kHz or less.
  • music information having a frequency higher than a frequency (20 kHz) that can be perceived by the human ear is deleted.
  • a high-frequency interpolation device disclosed in Patent Document 1 performs up-sampling for a predetermined upper limit frequency in a high-frequency limited audio signal, i.e., applies zero-order interpolation to the center of the signal and then performs low-pass filtering processing so as to remove a high-frequency signal for down-sampling. Further, the high-frequency interpolation device performs envelope processing so as to allow the audio signal to have prescribed characteristics, thereby achieving high-frequency interpolation.
  • An application of such high-frequency interpolation enables removal of feeling of lack of high-frequency range at the time of sound reproduction.
  • the up-sampling is performed for a predetermined upper limit frequency of the audio signal in the above high-frequency interpolation device, so that the sampling frequency (sampling rate) doubles or more.
  • the sampling frequency doubles or more.
  • the up-sampling frequency doubles to 88.2 kHz.
  • the up-sampling frequency doubles to 192 kHz.
  • the present invention has been made in view of the above problem, and an object thereof is to provide a high-frequency interpolation device capable of generating an interpolation signal in which spectrum in frequency characteristics develops in a continuous manner according to a reproduced music without increasing the sampling rate (sampling frequency) in up-sampling processing.
  • a high-frequency interpolation device including: a frequency band determination section that determines a bandwidth type of an audio signal as a frequency band determination value preset for each bandwidth according to the frequency characteristics of the audio signal; and an interpolation signal generation section that selects a filter coefficient of a high-pass filter in accordance with the frequency band determination value, performs filtering for the audio signal by using the high-pass filter having the selected filter coefficient, and generates a high-frequency interpolation signal for the audio signal.
  • a high-frequency interpolation method including: a frequency band determination step in which a frequency band determination section determines a bandwidth type of an audio signal as a frequency band determination value preset for each bandwidth according to the frequency characteristics of the audio signal; and an interpolation signal generation step in which an interpolation signal generation section selects a filter coefficient of a high-pass filter in accordance with the frequency band determination value, performs filtering for the audio signal by using the high-pass filter having the selected filter coefficient, and generates a high-frequency interpolation signal for the audio signal.
  • the filter coefficient of a high-pass filter is selected based on the frequency band determination value, and then the filtering of the audio signal is performed using a high-pass filter having the selected filter coefficient, followed by generation of a high-frequency interpolation signal for the audio signal, whereby a high-frequency interpolation signal to be generated can be adjusted in accordance with the bandwidth of the audio signal, and an optimum high-frequency interpolation signal can be generated in accordance with the bandwidth of the audio signal.
  • a high-frequency interpolation signal to be generated can be adjusted in accordance with the bandwidth of the audio signal, and an optimum high-frequency interpolation signal can be generated in accordance with the bandwidth of the audio signal.
  • the high-frequency interpolation device of the present invention may comprise a frequency conversion section that performs frequency conversion of the interpolation signal generated by the interpolation signal generation section in accordance with the frequency band determination value determined by the frequency band determination section.
  • the high-frequency interpolation method of the present invention may include a frequency conversion step in which a frequency conversion section performs frequency conversion of the interpolation signal generated in the interpolation signal generation step in accordance with the frequency band determination value determined in the frequency band determination step.
  • the frequency conversion of the interpolation signal is performed in accordance with the frequency band determination value, which allows the interpolation signal to be adjusted in accordance with the frequency level of the audio signal.
  • the frequency band determination value which allows the interpolation signal to be adjusted in accordance with the frequency level of the audio signal.
  • the interpolation signal generation section may include: a down-sampling section that performs down-sampling processing for the signal that has been subjected to the filtering of the audio signal by the high-pass filter; an up-sampling section that performs up-sampling processing for the audio signal that has been subjected to the down-sampling processing; and a subtraction processing section that subtracts the signal that has been subjected to the filtering of the audio signal by the high-pass filter from the signal that has been subjected to the up-sampling processing.
  • the interpolation signal generation step may comprise: a down-sampling step in which a down-sampling section performs down-sampling processing for the signal that has been subjected to the filtering of the audio signal by the high-pass filter; an up-sampling step in which an up-sampling section performs up-sampling processing for the signal that has been subjected to the down-sampling processing; and a subtraction processing step in which a subtraction processing section subtracts the signal that has been subjected to the filtering of the audio signal by the high-pass filter from the signal that has been subjected to the up-sampling processing.
  • the sampling rate (frequency) of the signal that is subjected to the down-sampling and up-sampling processing is not increased to the integral multiple of the sampling rate (frequency) of the original audio signal, thereby suppressing a processing load.
  • the frequency band and frequency level of the interpolation signal can be corrected/adjusted in accordance with the bandwidth of the audio signal, allowing generation of an interpolation signal in which spectrum in frequency characteristics of the audio signal develops in a continuous manner.
  • the down-sampling processing and up-sampling processing are applied to a signal having the same sampling rate (frequency) as the sampling rate (frequency) of the audio signal so as to generate an interpolation signal, thereby suppressing a processing load in the generation of the interpolation signal.
  • FIG. 1 is a block diagram showing a schematic configuration of a high-frequency interpolation device according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing a schematic configuration of a frequency analysis section according to the present embodiment.
  • FIGS. 3( a ) and 3 ( b ) are graphs showing examples of operation of an FFT section and a threshold detection section according to the present embodiment, wherein FIG. 3( a ) shows an example of operation in the case where pink noise is set as an audio signal, and FIG. 3( b ) shows an example of operation in the case where music is set as an audio signal.
  • FIG. 4 is a table showing bandwidths obtained by frequency band division that a frequency band determination section according to the present embodiment uses to determine a frequency band determination value.
  • FIG. 5 is a graph showing an offset amount changing with the inclination of the frequency.
  • FIG. 6( a ) shows frequency characteristics of the pink noise of FIG. 3( a ) whose maximum value is held and an example of first-order regression analysis curve calculated from the inclination of the frequency
  • FIG. 6( b ) shows frequency characteristics of the music of FIG. 3( b ) whose maximum value is held and an example of first-order regression analysis curve calculated from the inclination of the frequency.
  • FIG. 7 is a block diagram showing a schematic configuration of an interpolation signal generation section according to the present embodiment.
  • FIG. 8 is a table showing correspondence of filter coefficients one of which is selected based on an HPF frequency band determination value in a filter coefficient table section according to the present embodiment.
  • FIG. 9 is a graph showing filter characteristics of a high-pass filter (HPF) corresponding to the respective filter coefficient.
  • the high-pass filter shown in FIG. 9 is a 32-tap FIR filter using Black-man window, in which cut-off frequencies from 4 kHz to 16 kHz are set with 1 kHz intervals.
  • FIG. 10 is a block diagram showing a schematic configuration of a sampling conversion section according to the present embodiment.
  • FIG. 11( a ) shows the frequency characteristics of the audio signal that has been subjected to the filtering by the HPF section and
  • FIG. 11( b ) shows the frequency characteristics of a signal obtained through the down-sampling processing applied to the audio signal shown in FIG. 11( a ).
  • FIG. 12( a ) shows the frequency characteristics of a signal obtained through the up-sampling processing applied to the signal resulting from the gain correction performed by the gain correction section
  • FIG. 12( b ) shows the frequency characteristics of a signal obtained through the subtraction processing applied to the signal that has been subjected to the up-sampling processing.
  • FIG. 13 is a block diagram showing a schematic configuration of a frequency conversion section according to the present embodiment.
  • FIG. 14 is a table showing a relationship between a sine wave frequency that a sine wave generation section according to the present embodiment generates in accordance with the frequency band determination value and its phase.
  • FIG. 15( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device applies the interpolation processing to pink noise having a frequency band of 15 kHz and
  • FIG. 15( b ) shows frequency characteristics of an audio signal after the high-frequency interpolation device has applied the high-frequency interpolation processing.
  • FIG. 16( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device applies the interpolation processing to music having a frequency band of 15 kHz and
  • FIG. 16( b ) shows frequency characteristics of an audio signal after the high-frequency interpolation device has applied the high-frequency interpolation processing.
  • FIG. 17( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device applies the interpolation processing to music having a frequency band of 10 kHz and
  • FIG. 17( b ) shows frequency characteristics of an audio signal after the high-frequency interpolation device has applied the high-frequency interpolation processing.
  • FIG. 1 is a block diagram showing a schematic configuration of a high-frequency interpolation device according to the present invention.
  • a high-frequency interpolation device 1 includes a frequency analysis section 2 , an interpolation signal generation section (interpolation signal generation section) 3 , a frequency conversion section (frequency conversion section) 4 , a delay section 5 , and an addition section 6 .
  • the functions of the frequency analysis section 2 (including a frequency band determination section and a cut-off frequency section to be described later), interpolation signal generation section 3 (including a sampling conversion section to be described later), frequency conversion section 4 and the like that constitute the high-frequency interpolation device 1 may be achieved by a microprocessor suitable for general digital signal processing. More specifically, the high-frequency interpolation device 1 may be implemented as a general digital signal processor. Alternatively, a versatile central processing unit may execute the functions of the frequency analysis section 2 , interpolation signal generation section 3 , frequency conversion section 4 and the liked according to a program (i.e., central processing unit may realize the functional blocks).
  • the high-frequency interpolation device 1 adds a high-frequency interpolation signal to an audio signal stored in a CD or a DVD in which high-frequency acoustic data has been cut off so as to enhance the richness or punch of the sound.
  • the frequency analysis section 2 analyzes the frequency of an input audio signal
  • the interpolation signal generation section 3 generates a high-frequency interpolation signal in accordance with the analyzed frequency
  • the frequency conversion section 4 performs frequency conversion for the generated interpolation signal in consideration of the frequency band of the audio signal. After that, the resultant interpolation signal is combined with the audio signal to thereby generate an audio signal in which the high-frequency interpolation has been made.
  • FIG. 2 is a block diagram showing a schematic configuration of the frequency analysis section 2 .
  • the frequency analysis section 2 analyzes an audio signal to determine the frequency band to which the audio signal belongs based on a frequency band determination value and applies offset processing to the frequency band determination value to calculate an HPF frequency band determination value.
  • the frequency analysis section 2 includes an FFT section 8 , a threshold detection section 9 , a majority determination section 10 , a frequency band determination section (frequency band determination section) 11 , and a cut-off frequency calculation section 12 .
  • the FFT section 8 performs high-speed Fourier transformation (i.e., FFT calculation) for the audio signal at predetermined intervals. Through the high-speed Fourier transformation, the audio signal is transformed into a frequency domain. The FFT section 8 performs the high-speed Fourier transformation to transform the audio signal into a frequency domain and, at the same time, performs averaging processing and decibel conversion. After performing the above processing, the FFT section 8 performs maximum value hold processing for each FFT sample.
  • high-speed Fourier transformation i.e., FFT calculation
  • the threshold detection section 9 calculates the signal level of a low-medium-frequency band component and signal level of a high-frequency band component based on the frequency characteristics of the audio signal calculated by the FFT section 8 . Then, based on the calculated signal levels of the low-medium-frequency band and high-frequency band components, the threshold detection section 9 sets the intermediate value between the signal levels as a threshold and detects the bandwidth of the audio signal based on the threshold.
  • the threshold detection section 9 cannot detect the threshold, and the high-frequency interpolation processing in the high-frequency interpolation device is not performed.
  • FIGS. 3( a ) and 3 ( b ) are graphs showing examples of operation of the FFT section 8 and threshold detection section 9 .
  • FIG. 3( a ) shows an example of operation in the case where pink noise having a sampling rate (frequency) of 48 kHz and a bandwidth of 15 kHz is set as an audio signal.
  • FIG. 3( b ) shows an example of operation in the case where music having the same sampling rate and same bandwidth as those of the pink noise shown in FIG. 3( a ) is set as an audio signal.
  • the FFT length is set to 256 samples, the number of averaged frames is set to 4 frames, and the number of frames holding maximum value is set to 16 frames.
  • one frame corresponds to 128-sample length which is half the FFT length.
  • the signal level of the low-medium-frequency band component is set to 10 kHz or less, and signal level of the high-frequency band component is set to 20 kHz or more.
  • the signal level of the low-medium-frequency band component corresponds to a level of 53 points or less, and signal level of the high-frequency band component corresponds to a level of 107 points or more.
  • the threshold in the pink noise is set to ⁇ 56 dB (refer to FIG. 3( a ))
  • threshold in the music is set to ⁇ 81 dB (refer to FIG. 3( b ))
  • the bandwidth in the FFT sample point is detected as 82 points in the cases of both the pink noise and music.
  • the majority determination section 10 determines, at one frame interval (i.e., as described above, at intervals of 128 samples in the present embodiment), an optimum detection value by majority decision from among the detection values of the bandwidths output from the threshold detection section 9 .
  • the number of detection values to be determined is set to, e.g., “4” and where four values of “82”, “79”, “82”, and “81” are detected as the detection value of the bandwidth, “82”, which is a most frequently detected value, is determined as the optimum detection value.
  • the number of detection values to be determined is set to 4 in the present embodiment as an example, it is not limited to 4 but may be smaller or larger than 4.
  • the averaging processing and maximum value hold processing are performed in a combined manner by the FFT section 8 , thereby improving the detection accuracy of the bandwidth in the majority determination section 10 .
  • the frequency band determination section 11 determines which frequency band the bandwidth determined by the majority determination section 10 belongs to as a frequency band determination value.
  • the frequency band is divided into 9 ranges with intervals of 1.0 kHz for the frequency band determination.
  • the FFT sample point is 82 points in the cases of both the pink noise and music shown in FIGS. 3( a ) and 3 ( b ), so that the frequency band determination value is obtained as “7” based on Table 1.
  • the cut-off frequency calculation section 12 calculates the inclination of the frequency of the audio signal whose maximum value is held in the FFT section 8 using first-order regression analysis.
  • the cut-off frequency calculation section 12 performs offset processing for the frequency band determination value determined by the frequency band determination section 11 based on the inclination of the frequency calculated using the first-order regression analysis to calculate an HPF frequency band determination value.
  • FIG. 5 is a graph showing an offset amount changing with the inclination of the frequency.
  • the offset amount is 0.
  • the offset amount increases as the inclination of the frequency becomes larger in the negative direction.
  • FIG. 6( a ) shows frequency characteristics of the pink noise of FIG. 3( a ) whose maximum value is held and an example of first-order regression analysis curve calculated from the inclination of the frequency.
  • FIG. 6( b ) shows frequency characteristics of the music of FIG. 3( b ) whose maximum value is held and an example of first-order regression analysis curve calculated from the inclination of the frequency.
  • the frequency characteristics of the pink noise shown in FIG. 6( a ) are comparatively flat, so that the offset amount is 0.
  • the value of the high-frequency band component is lower than that of the low-frequency band component in the frequency characteristics of the music shown in FIG. 6( b ), so that 1 is obtained as the offset amount in accordance with the inclination of FIG. 5 .
  • the interpolation signal generation section 3 generates an optimum interpolation signal based on the input audio signal. As shown in FIG. 7 , the interpolation signal generation section 3 includes a filter coefficient table section 15 , an HPF section 16 , and a sampling conversion section 17 .
  • the filter coefficient table section 15 selects a filter coefficient applied in the HPF section 16 based on the HPF frequency band determination value calculated by the cut-off frequency calculation section 12 . More specifically, as shown in Table 2 of FIG. 8 , the filter coefficient table section 15 selects, in accordance with the HPF frequency band determination value, a filter coefficient from among a plurality of filter coefficients by which cut-off frequencies of 4 kHz to 16 kHz are determined.
  • FIG. 9 is a graph showing filter characteristics of a high-pass filter (HPF) corresponding to the respective filter coefficient.
  • the high-pass filter shown in FIG. 7 is a 32-tap FIR filter using Black-man window, in which cut-off frequencies from 4 kHz to 16 kHz are set with 1 kHz intervals.
  • Table 2 of FIGS. 8 1st to 13th HPF frequency band determination values are shown. That is, the number of HPF frequency band determination values in Table 2 is larger than that shown in Table 1 of FIG. 4 in which 1st to 9th HPF frequency band determination values are shown. That is, as described above, the offset value is added to the frequency band determination value to thereby increase the number of HPF frequency bands to be determined.
  • the frequency characteristics of the pink noise shown in FIG. 6( a ) are comparatively flat, so that the offset amount is 0; on the other hand, the value of the high-frequency band component is lower than that of the low-frequency band component in the frequency characteristics of the music shown in FIG. 6( b ), so that 1 is obtained as the offset amount in accordance with the inclination of FIG. 5 . Therefore, in the case where the frequency band determination value of the frequency band determination section 11 is 7, the HPF frequency band determination value for the pink noise is 7, and HPF frequency band determination value for the music is 8 since the offset amount of 1 is added.
  • the HPF section 16 uses the high-pass filter (refer to FIG. 9 ) having a filter coefficient selected by the filter coefficient table section 15 to perform filtering for the audio signal. Through the filtering performed by the HPF section, the low-frequency signal component of the audio signal is limited.
  • the sampling conversion section 17 generates an interpolation signal based on the audio signal that has been subjected to the filtering by the HPF section 16 .
  • FIG. 10 is a block diagram showing a schematic configuration of the sampling conversion section 17 .
  • the sampling conversion section 17 includes a down-sampling section (down-sampling section) 20 , a gain correction section 21 , an up-sampling section (up-sampling section) 22 , and a subtraction processing section (subtraction processing section) 23 .
  • the audio signal that has been subjected to the filtering by the HPF section 16 is subjected to down-sampling processing by the down-sampling section 20 , then subjected to gain correction by the gain correction section 21 , and finally subjected to up-sampling processing by the up-sampling section 22 .
  • the audio signal subjected to the up-sampling processing is then subjected to subtraction processing with an audio signal that has not been subjected to the processing performed by the down-sampling section 20 , gain correction section 21 , and up-sampling section 22 by the subtraction processing section 23 to thereby generate an interpolation signal.
  • the interpolation signal thus generated serves as a mirror signal of the input audio signal.
  • FIGS. 11( a ), 11 ( b ), 12 ( a ), and 12 ( b ) are graphs each showing a change in the frequency characteristics in the case where the white noise that has been subjected to the filtering (filtering using the high-pass filter) at a bandwidth of 15 kHz by the HPF section 16 is processed by the sampling conversion section 17 .
  • FIG. 11( a ) shows the frequency characteristics of the audio signal that has been subjected to the filtering by the HPF section 16 .
  • FIG. 11( b ) shows the frequency characteristics of a signal obtained through the down-sampling processing that the down-sampling section 20 has applied to the audio signal shown in FIG. 11( a ).
  • FIG. 12( a ) shows the frequency characteristics of a signal obtained through the up-sampling processing that the up-sampling section 22 has applied to the signal resulting from the gain correction performed by the gain correction section 21 .
  • FIG. 12( b ) shows the frequency characteristics of a signal obtained through the subtraction processing that the subtraction processing section 23 has applied between the audio signal (that has not been subject to any processing) and signal that has been subjected to the up-sampling processing.
  • the sampling conversion section 17 of the high-frequency interpolation device 1 of the present embodiment generates an interpolation signal without increasing the sampling rate (sampling frequency) of the audio signal, there by preventing an increase in a processing load which has been observed in a conventional high-frequency interpolation device.
  • the frequency conversion section 4 performs frequency adjustment (frequency conversion) for the interpolation signal generated by the interpolation signal generation section 3 in accordance with the audio signal.
  • the frequency conversion section 4 includes a Hilbert transformation section 25 , a delay section 26 , a sine wave generation section 27 , multiplication processing sections 28 and 29 , and a subtraction processing section 30 .
  • the Hilbert transformation section 25 and delay section 26 generate interpolation signals having phases shifted by 0 degrees and 90 degrees relative to the interpolation signal generated by the sampling conversion section 17 .
  • the delay section 26 sets a delay corresponding to 15 samples.
  • the sine wave generation section 27 generates sine waves having a phase of 0 degrees and 90 degrees in accordance with the frequency band determination value determined by the frequency band determination section 11 of the frequency band analysis section 2 .
  • Table 3 of FIG. 14 shows a relationship between the sine wave frequency corresponding to the frequency band determination value and its phase.
  • the sine wave frequency shown in Table 3 is divided with intervals of 2 kHz which is double the intervals set in the frequency band determination section 11 .
  • the sine wave frequency corresponds to the frequency conversion amount of the interpolation signal.
  • the sine wave generation section 27 performs frequency conversion of 2 kHz to 6 kHz to the high-frequency side. More specifically, the sine wave generation section 27 outputs (from A of the sine wave generation section 27 shown in FIG. 13 ) a sine wave having a 0 degrees phase for a 0 degrees phase interpolation signal output from the delay section 26 to make the multiplication processing section 28 perform integration processing.
  • the sine wave generation section 27 outputs (from B of the sine wave generation section 27 shown in FIG. 13 ) a sine wave having a 90 degrees phase for a 90 degrees phase interpolation signal output from the Hilbert transformation section 25 to make the multiplication processing section 29 perform integration processing.
  • the sine wave generation section 27 inverts the phases of the 6th to 8th frequency bands to perform frequency conversion of 2 kHz to 6 kHz to the negative, i.e., low-frequency side. More specifically, the sine wave generation section 27 outputs (from A of the sine wave generation section 27 shown in FIG. 13 ) a sine wave having a 90 degrees phase for a 0 degrees phase interpolation signal output from the delay section 26 to make the multiplication processing section 28 perform integration processing. Further, the sine wave generation section 27 outputs (from B of the sine wave generation section 27 shown in FIG. 13 ) a sine wave having a 0 degrees phase for a 90 degrees phase interpolation signal output from the Hilbert transformation section 25 to make the multiplication processing section 29 perform integration processing.
  • the sine wave generation section 27 outputs (from A of the sine wave generation section 27 shown in FIG. 13 ) 1 for a 0 degrees phase interpolation signal output from the delay section 26 and outputs (from B of the sine wave generation section 27 shown in FIG. 13 ) 0 for a 90 degrees phase interpolation signal output from the Hilbert transformation section 25 . In this case, the frequency conversion of the interpolation signal is not performed.
  • the sine wave generation section 27 outputs 0 for a 0 degrees phase interpolation signal output from the delay section 26 and 90 degrees phase interpolation signal output from the Hilbert transformation section 25 and therefore does not perform the high-frequency interpolation using the interpolation signal.
  • the case where one of 1st and 9th frequency bands is selected by the sine wave generation section 27 is a case where the frequency band of the audio signal does not exist within an assumed range, which corresponds to a case where the frequency band is lower than 9.5 kHz or higher than 16.5 kHz (refer to the frequency range shown in Table 1 of FIG. 4 ) in the present embodiment. Further, the case where the frequency band of the audio signal does not exist within an assumed range also corresponds to a case where the threshold detection section 9 cannot detect the bandwidth.
  • the interpolation signals thus calculated in the multiplication processing sections 28 and 29 are subjected to subtraction by the subtraction processing section 30 to be a high-frequency interpolation signal achieving frequency conversion and having no aliasing.
  • the high-frequency interpolation signal generated in the frequency conversion section 4 is combined with the original audio signal in the addition section 6 , whereby an audio signal (original audio signal+high-frequency interpolation signal) in which a high-frequency band component is interpolated is generated.
  • delay processing is set for the original audio signal by the delay section 5 . This corrects the delay accompanied by the high-frequency interpolation processing.
  • FIGS. 15 to 17 are graphs showing effect of the high-frequency interpolation achieved by the high-frequency interpolation device of the present embodiment.
  • FIG. 15( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device 1 applies the interpolation processing to pink noise having a frequency band of 15 kHz.
  • FIG. 15( b ) shows frequency characteristics of an audio signal after the high-frequency interpolation device 1 has applied the high-frequency interpolation processing.
  • FIG. 16( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device 1 applies the interpolation processing to music having a frequency band of 15 kHz.
  • FIG. 15( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device 1 applies the interpolation processing to pink noise having a frequency band of 15 kHz.
  • FIG. 16( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device 1 applies the interpolation processing to music having a frequency band of 15
  • FIG. 16( b ) shows frequency characteristics of an audio signal after the high-frequency interpolation device 1 has applied the high-frequency interpolation processing.
  • FIG. 17( a ) shows frequency characteristics of an audio signal before the high-frequency interpolation device 1 applies the interpolation processing to music having a frequency band of 10 kHz.
  • FIG. 17( b ) shows frequency characteristics of an audio signal after the high-frequency interpolation device 1 has applied the high-frequency interpolation processing.
  • the high-frequency interpolation device 1 by performing the high-frequency interpolation processing using the high-frequency interpolation device 1 , it is possible to add (interpolate) an interpolation signal in which spectrum in frequency characteristics develops in a continuous manner to an original audio signal without depending on the bandwidth or frequency level of an audio source (audio signal) (or in an optimum state in accordance with the original audio signal). With the audio signal in which a high-frequency component is interpolated, it is possible to allow a listener to enjoy richness or punch of the music.
  • the sampling conversion section 17 of the interpolation signal generation section performs the down-sampling processing, up-sampling processing, and subtraction processing in a combined manner to thereby generate an interpolation signal without increasing the sampling rate (sampling frequency) of the audio signal.
  • the determination of the frequency band is made based on the bandwidth of an audio signal in the frequency analysis section 2 , and then the filtering is applied to the audio signal using a filter corresponding to the determined frequency band, followed by the processing of the sampling conversion section 17 , whereby an interpolation signal whose frequency has been adjusted to an optimum value can be generated.
  • the frequency conversion is performed in accordance with the determined frequency band in the frequency conversion section 4 , which allows the interpolation signal to be adjusted in accordance with the frequency level.
  • the generated interpolation signal can optimally be adjusted to the bandwidth/frequency level of the audio signal, allowing generation of an interpolation signal in which spectrum in frequency characteristics of the audio signal develops in a continuous manner.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
  • Noise Elimination (AREA)
  • Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)
  • Stereophonic System (AREA)
US12/680,899 2007-10-23 2008-10-22 High-frequency interpolation device and high-frequency interpolation method Active 2030-12-06 US8554349B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2007-274606 2007-10-23
JP2007274606 2007-10-23
PCT/JP2008/069089 WO2009054393A1 (ja) 2007-10-23 2008-10-22 高域補間装置および高域補間方法

Publications (2)

Publication Number Publication Date
US20100222907A1 US20100222907A1 (en) 2010-09-02
US8554349B2 true US8554349B2 (en) 2013-10-08

Family

ID=40579497

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/680,899 Active 2030-12-06 US8554349B2 (en) 2007-10-23 2008-10-22 High-frequency interpolation device and high-frequency interpolation method

Country Status (5)

Country Link
US (1) US8554349B2 (ja)
EP (1) EP2209116B8 (ja)
JP (1) JP5409377B2 (ja)
CN (1) CN101868823B (ja)
WO (1) WO2009054393A1 (ja)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130085762A1 (en) * 2011-09-29 2013-04-04 Renesas Electronics Corporation Audio encoding device
US20160217802A1 (en) * 2012-02-15 2016-07-28 Microsoft Technology Licensing, Llc Sample rate converter with automatic anti-aliasing filter
US10354675B2 (en) 2014-07-04 2019-07-16 Clarion Co., Ltd. Signal processing device and signal processing method for interpolating a high band component of an audio signal
US10586553B2 (en) 2015-09-25 2020-03-10 Dolby Laboratories Licensing Corporation Processing high-definition audio data

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5754899B2 (ja) 2009-10-07 2015-07-29 ソニー株式会社 復号装置および方法、並びにプログラム
JP5652658B2 (ja) 2010-04-13 2015-01-14 ソニー株式会社 信号処理装置および方法、符号化装置および方法、復号装置および方法、並びにプログラム
JP6103324B2 (ja) * 2010-04-13 2017-03-29 ソニー株式会社 信号処理装置および方法、並びにプログラム
JP5850216B2 (ja) 2010-04-13 2016-02-03 ソニー株式会社 信号処理装置および方法、符号化装置および方法、復号装置および方法、並びにプログラム
JP5609737B2 (ja) * 2010-04-13 2014-10-22 ソニー株式会社 信号処理装置および方法、符号化装置および方法、復号装置および方法、並びにプログラム
JP6075743B2 (ja) 2010-08-03 2017-02-08 ソニー株式会社 信号処理装置および方法、並びにプログラム
JP5707842B2 (ja) 2010-10-15 2015-04-30 ソニー株式会社 符号化装置および方法、復号装置および方法、並びにプログラム
CN102074241B (zh) * 2011-01-07 2012-03-28 蔡镇滨 一种通过快速声音波形修复实现声音还原的方法
US9093120B2 (en) * 2011-02-10 2015-07-28 Yahoo! Inc. Audio fingerprint extraction by scaling in time and resampling
JP5942358B2 (ja) 2011-08-24 2016-06-29 ソニー株式会社 符号化装置および方法、復号装置および方法、並びにプログラム
JP6305694B2 (ja) * 2013-05-31 2018-04-04 クラリオン株式会社 信号処理装置及び信号処理方法
EP3048609A4 (en) 2013-09-19 2017-05-03 Sony Corporation Encoding device and method, decoding device and method, and program
CN105849801B (zh) 2013-12-27 2020-02-14 索尼公司 解码设备和方法以及程序
BR112016015695B1 (pt) * 2014-01-07 2022-11-16 Harman International Industries, Incorporated Sistema, mídia e método para tratamento de sinais de áudio comprimidos
JP6210338B2 (ja) * 2015-12-28 2017-10-11 ソニー株式会社 信号処理装置および方法、並びにプログラム
JP6621709B2 (ja) * 2016-05-26 2019-12-18 アルパイン株式会社 音声処理装置、音声処理方法及びコンピュータプログラム
JP6439843B2 (ja) * 2017-09-14 2018-12-19 ソニー株式会社 信号処理装置および方法、並びにプログラム
JP6506424B2 (ja) * 2018-01-12 2019-04-24 パイオニア株式会社 音響装置、欠落帯域推定装置、信号処理方法及び周波数帯域推定装置
CN109243485B (zh) * 2018-09-13 2021-08-13 广州酷狗计算机科技有限公司 恢复高频信号的方法和装置

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0923127A (ja) 1995-07-10 1997-01-21 Fujitsu Ten Ltd 可聴音声信号の高域補償装置および方法
US20030044024A1 (en) * 2001-08-31 2003-03-06 Aarts Ronaldus Maria Method and device for processing sound signals
WO2003044777A1 (en) 2001-11-23 2003-05-30 Koninklijke Philips Electronics N.V. Audio signal bandwidth extension
US6708145B1 (en) * 1999-01-27 2004-03-16 Coding Technologies Sweden Ab Enhancing perceptual performance of sbr and related hfr coding methods by adaptive noise-floor addition and noise substitution limiting
US6865430B1 (en) * 1999-09-10 2005-03-08 David W. Runton Method and apparatus for the distribution and enhancement of digital compressed audio
US20060192706A1 (en) * 2005-02-28 2006-08-31 Sanyo Electric Co., Ltd. High frequency compensator and reproducing device
WO2007029796A1 (ja) 2005-09-08 2007-03-15 Pioneer Corporation 帯域拡張装置、帯域拡張方法および帯域拡張プログラム
JP2007192964A (ja) 2006-01-18 2007-08-02 Yamaha Corp オーディオ信号の帯域拡張装置
JP2009086018A (ja) 2007-09-27 2009-04-23 Sanyo Electric Co Ltd 音楽再生回路
US20090171666A1 (en) * 2005-11-30 2009-07-02 Kabushiki Kaisha Kenwood Interpolation Device, Audio Reproduction Device, Interpolation Method, and Interpolation Program

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006243041A (ja) * 2005-02-28 2006-09-14 Yutaka Yamamoto 高域補間装置及び再生装置
JP2010145426A (ja) * 2007-04-03 2010-07-01 Panasonic Corp オーディオ帯域拡張装置

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0923127A (ja) 1995-07-10 1997-01-21 Fujitsu Ten Ltd 可聴音声信号の高域補償装置および方法
US6708145B1 (en) * 1999-01-27 2004-03-16 Coding Technologies Sweden Ab Enhancing perceptual performance of sbr and related hfr coding methods by adaptive noise-floor addition and noise substitution limiting
US6865430B1 (en) * 1999-09-10 2005-03-08 David W. Runton Method and apparatus for the distribution and enhancement of digital compressed audio
US20030044024A1 (en) * 2001-08-31 2003-03-06 Aarts Ronaldus Maria Method and device for processing sound signals
WO2003044777A1 (en) 2001-11-23 2003-05-30 Koninklijke Philips Electronics N.V. Audio signal bandwidth extension
US20060192706A1 (en) * 2005-02-28 2006-08-31 Sanyo Electric Co., Ltd. High frequency compensator and reproducing device
JP2006243043A (ja) 2005-02-28 2006-09-14 Sanyo Electric Co Ltd 高域補間装置及び再生装置
WO2007029796A1 (ja) 2005-09-08 2007-03-15 Pioneer Corporation 帯域拡張装置、帯域拡張方法および帯域拡張プログラム
US20090171666A1 (en) * 2005-11-30 2009-07-02 Kabushiki Kaisha Kenwood Interpolation Device, Audio Reproduction Device, Interpolation Method, and Interpolation Program
JP2007192964A (ja) 2006-01-18 2007-08-02 Yamaha Corp オーディオ信号の帯域拡張装置
JP2009086018A (ja) 2007-09-27 2009-04-23 Sanyo Electric Co Ltd 音楽再生回路

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Japanese Office Action for corresponding JP Application No. 2009-538225, Jul. 9, 2013.
Japanese Office Action for corresponding JP Application No. 2009-538225, Oct. 23, 2012.
Supplementary European Search Report for corresponding EP Application No. 08841188, Nov. 4, 2011.

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130085762A1 (en) * 2011-09-29 2013-04-04 Renesas Electronics Corporation Audio encoding device
US20160217802A1 (en) * 2012-02-15 2016-07-28 Microsoft Technology Licensing, Llc Sample rate converter with automatic anti-aliasing filter
US10002618B2 (en) * 2012-02-15 2018-06-19 Microsoft Technology Licensing, Llc Sample rate converter with automatic anti-aliasing filter
US10157625B2 (en) 2012-02-15 2018-12-18 Microsoft Technology Licensing, Llc Mix buffers and command queues for audio blocks
US10354675B2 (en) 2014-07-04 2019-07-16 Clarion Co., Ltd. Signal processing device and signal processing method for interpolating a high band component of an audio signal
US10586553B2 (en) 2015-09-25 2020-03-10 Dolby Laboratories Licensing Corporation Processing high-definition audio data

Also Published As

Publication number Publication date
CN101868823B (zh) 2011-12-07
WO2009054393A1 (ja) 2009-04-30
EP2209116A1 (en) 2010-07-21
CN101868823A (zh) 2010-10-20
EP2209116A4 (en) 2011-12-21
EP2209116B8 (en) 2014-08-06
JP5409377B2 (ja) 2014-02-05
EP2209116B1 (en) 2014-06-18
JPWO2009054393A1 (ja) 2011-03-03
US20100222907A1 (en) 2010-09-02

Similar Documents

Publication Publication Date Title
US8554349B2 (en) High-frequency interpolation device and high-frequency interpolation method
JP5295238B2 (ja) 音響処理装置
RU2440692C2 (ru) Система и способ для компенсации безынерционного нелинейного искажения в аудиопреобразователе
US8116480B2 (en) Filter coefficient calculation device, filter coefficient calculation method, control program, computer-readable storage medium, and audio signal processing apparatus
EP0556867B1 (en) Digital equalizer apparatus enabling separate phase and amplitude characteristic modification
US7516065B2 (en) Apparatus and method for correcting a speech signal for ambient noise in a vehicle
JP5149991B2 (ja) 音声再生装置、音声再生方法及びプログラム
US8351619B2 (en) Auditory sense correction device
JP2004187283A (ja) マイクロホン装置および再生装置
JP2005501278A (ja) 音声信号の帯域幅拡張
JP2013190470A (ja) 音響信号処理装置および音響信号処理方法
WO2013183185A1 (ja) 周波数特性変形装置
JP2000115883A (ja) オーディオシステム
JP2005527141A (ja) オーディオ・フィードバック処理システム
JP4368917B2 (ja) 音響再生装置
WO2017183405A1 (ja) 音響処理装置および音響処理方法
JP4940347B1 (ja) 補正フィルタ処理装置、及びその方法
JP2021197711A (ja) 信号処理装置及び信号処理プログラム
JP2007166315A (ja) 信号処理装置及び信号処理方法
TWI760833B (zh) 用於進行音訊透通的音訊處理方法與相關裝置
JP2012100117A (ja) 音響処理装置及び方法
JP4869432B1 (ja) 補正フィルタ処理装置、及びその方法
JP5774218B2 (ja) 周波数特性変形装置
JP5032682B1 (ja) 特性補正装置および特性補正方法
JP2004297707A (ja) 電気音響変換再生器とその非線形歪低減方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: CLARION CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HASHIMOTO, TAKESHI;REEL/FRAME:024163/0877

Effective date: 20100303

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8