CN101185126B - Systems, methods, and apparatus for highband time warping - Google Patents

Systems, methods, and apparatus for highband time warping Download PDF

Info

Publication number
CN101185126B
CN101185126B CN200680018212.6A CN200680018212A CN101185126B CN 101185126 B CN101185126 B CN 101185126B CN 200680018212 A CN200680018212 A CN 200680018212A CN 101185126 B CN101185126 B CN 101185126B
Authority
CN
China
Prior art keywords
band
signal
narrow
encoded
frequency part
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200680018212.6A
Other languages
Chinese (zh)
Other versions
CN101185126A (en
Inventor
科恩·贝尔纳德·福斯
阿南塔帕德马纳卜汉·A·坎达达伊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority claimed from PCT/US2006/012232 external-priority patent/WO2006107838A1/en
Publication of CN101185126A publication Critical patent/CN101185126A/en
Application granted granted Critical
Publication of CN101185126B publication Critical patent/CN101185126B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Digital Transmission Methods That Use Modulated Carrier Waves (AREA)
  • Analogue/Digital Conversion (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Transmitters (AREA)

Abstract

In one embodiment, a method of signal processing includes encoding a low-frequency portion of a speech signal into at least an encoded narrowband excitation signal and a plurality of narrowband filter parameters; and generating a highband excitation signal based on a narrowband excitation signal. The narrowband excitation signal is based on the encoded narrowband excitation signal. The method also includes encoding a high-frequency portion of the speech signal into at least a plurality of highband filter parameters according to at least the highband excitation signal. The encoded narrowband excitation signal includes a time warping, and the method includes applying a time shift to the high-frequency portion based on information related to the time warping.

Description

For system, the method and apparatus of highband time warping
The application's case is advocated the 60/667th of being entitled as of on April 1st, 2005 application " CODING THE HIGH-FREQUENCYBAND OF WIDEBAND SPEECH ", the rights and interests of No. 901 U.S. Provisional Patent Application cases.The application's case is also advocated the 60/673rd of being entitled as of on April 22nd, 2005 application " PARAMETER CODING IN A HIGH-BANDSPEECH CODER ", the rights and interests of No. 965 U.S. Provisional Patent Application cases.
Technical field
The present invention relates to signal processing.
Background technology
The bandwidth Conventional cap of the voice communication on PSTN (PSTN) is in the frequency range of 300-3400kHz.For example, new network for voice communication (cellular phone and ip voice (Internet Protocol, VoIP)) may not have identical limit bandwidth, and may on such network, transmit and receive the voice communication that comprises broadband frequency range.For instance, may need to support to extend downwardly into 50Hz and/or until 7 or the audio frequency range of 8kHz.Also may need to support to have other application of the audio speech content in the scope beyond traditional PSTN restriction, for example high quality audio or audio/video conference.
The scope that speech coder is supported can be improved sharpness to the extension of upper frequency.For instance, distinguishing for example " s " will be in high-frequency with the fricative information spinner of " f ".High frequency band extends other quality that also can improve voice, for example, have rate.For instance, even turbid vowel also can have the spectrum energy higher than PSTN restriction far away.
A kind of method of wideband speech coding relates to convergent-divergent narrow-band speech coding technology (for example, be configured to encode 0-4kHz the technology of scope) with covering wide band spectrum.For instance, voice signal can higher rate sample to comprise in high-frequency component, and narrow-band coding techniques is reconfigurable to represent this broadband signal with more filter factors.But, for example CELP(code book Excited Linear Prediction) narrow-band coding techniques calculated amount larger, and broadband celp coder may consume too much cycle for the treatment of, to such an extent as to unrealistic for many movements and other Embedded Application.Using this technology is that required quality also may cause bandwidth greatly to increase making us accepting by the whole spectrum coding of broadband signal.In addition, even can be transferred in the system of only supporting narrow-band coding and/or before by described system decodes in the narrow-band part of this encoded signal, need to carry out code conversion to described encoded signal.
The another kind of method of wideband speech coding relates to from encoded narrow-band spectrum envelope extrapolation high frequency band spectrum envelope.Although this method can be implemented in the situation that not increasing bandwidth and not needing code conversion, rough spectrum envelope or the resonance peak structure of the highband part of the voice signal that conventionally cannot calculate to a nicety out from the spectrum envelope of narrow-band part.
May need to implement wideband speech coding, make the narrow-band part of at least encoded signal can pass through narrow-band channel (for example, PSTN channel) and send, and not carry out code conversion or other is significantly revised.Also may need broadband code extension efficient, for example, so that () avoids the number that may accept the user of service in the application of the broadcast on for example wireless cellular telephony and wired and wireless channel significantly to reduce.
Summary of the invention
In one embodiment, a kind of signal processing method comprises: the low frequency part of voice signal is encoded to at least one encoded low band excitation signal and multiple low band filter parameter; Produce high band excitation signal based on described encoded low band excitation signal.Described method also comprises at least described high band excitation signal of basis the high-frequency part of described voice signal is encoded to at least multiple high band filter parameters.In the method, described encoded low band excitation signal is described according to time dependent time deviation and with respect to the described voice signal signal of deviation in time.Corresponding multiple continuous parts in time that described method comprises that multiple different time shifts are applied to described high-frequency part by information based on relevant from described time deviation.
In another embodiment, a kind of equipment comprises: low-frequency band speech coder, and it is configured to the low frequency part of voice signal to be encoded at least one encoded low band excitation signal and multiple low band filter parameter; And high frequency band speech coder, it is configured to produce high band excitation signal based on described encoded low band excitation signal.In this equipment, described high band encoder is configured to, according at least described high band excitation signal, the high-frequency part of described voice signal is encoded to at least multiple high band filter parameters.In this equipment, described narrow-band speech coder is configured to export regularization data-signal, and described regularization data-signal is described with respect to described voice signal temporal evolution and is included in the time deviation in described encoded narrow-band pumping signal.Described equipment comprises lag line, corresponding multiple continuous parts in time that described lag line is configured to multiple different time shifts to be applied to described high-frequency part, and wherein said multiple different time shifts are based on described regularization data-signal.
In another embodiment, a kind of equipment comprises: for the low frequency part of voice signal being encoded to the device of at least one encoded low band excitation signal and multiple low band filter parameters; For produce the device of high band excitation signal based on described encoded low band excitation signal; And for the high-frequency part of described voice signal being encoded to according at least described high band excitation signal to the device of at least multiple high band filter parameters.In this equipment, described encoded narrow-band pumping signal is described according to time dependent time deviation and with respect to the described voice signal signal of deviation in time.Described equipment comprises the corresponding multiple devices of continuous part in time that for the information based on relevant from described time deviation, multiple different time shifts are applied to described high-frequency part.
Brief description of the drawings
Fig. 1 a shows according to the calcspar of the wideband speech coding device A100 of an embodiment.
Fig. 1 b shows the calcspar of the embodiment A102 of wideband speech coding device A100.
Fig. 2 a shows according to the calcspar of the broadband Voice decoder B100 of an embodiment.
Fig. 2 b shows the calcspar of the embodiment B102 of broadband Voice decoder B100.
Fig. 3 a shows the calcspar of the embodiment A112 of bank of filters A110.
Fig. 3 b shows the calcspar of the embodiment B122 of bank of filters B120.
Fig. 4 a shows that the bandwidth of the low and high frequency band of an example of bank of filters A110 covers.
Fig. 4 b shows that the bandwidth of the low and high frequency band of another example of bank of filters A110 covers.
Fig. 4 c shows the calcspar of the embodiment A114 of bank of filters A112.
Fig. 4 d shows the calcspar of the embodiment B124 of bank of filters B122.
Fig. 5 a shows the example of the Logarithmic magnitude of voice signal and the curve of frequency.
Fig. 5 b shows the calcspar of basic linear predictive coding system.
Fig. 6 shows the calcspar of the embodiment A122 of narrowband encoder A120.
Fig. 7 shows the calcspar of the embodiment B112 of narrow-band demoder B110.
Fig. 8 a shows the Logarithmic magnitude of residual signal of turbid voice and the example of the curve of frequency.
Fig. 8 b shows the Logarithmic magnitude of residual signal of turbid voice and the example of the curve of time.
Fig. 9 shows the calcspar of the basic linear predictive coding system of also carrying out long-term forecasting.
Figure 10 shows the calcspar of the embodiment A202 of high band encoder A200.
Figure 11 shows the calcspar of the embodiment A302 of high band excitation generator A300.
Figure 12 shows the calcspar of the embodiment A402 of frequency spectrum stretcher A400.
Figure 12 a shows that frequency spectrum extends the curve of the signal spectrum at each point place in the example operating.
Figure 12 b shows that frequency spectrum extends the curve of the signal spectrum at each point place in another example operating.
Figure 13 shows the calcspar of the embodiment A304 of high band excitation generator A302.
Figure 14 shows the calcspar of the embodiment A306 of high band excitation generator A302.
Figure 15 shows the process flow diagram of envelope calculation task T100.
Figure 16 shows the calcspar of the embodiment 492 of combiner 490.
Figure 17 illustrates the method for the periodic measured value that calculates high-frequency band signals S30.
Figure 18 shows the calcspar of the embodiment A312 of high band excitation generator A302.
Figure 19 shows the calcspar of the embodiment A314 of high band excitation generator A302.
Figure 20 shows the calcspar of the embodiment A316 of high band excitation generator A302.
Figure 21 shows the process flow diagram of gain calculation task T200.
Figure 22 shows the process flow diagram of the embodiment T210 of gain calculation task T200.
The figure of Figure 23 a impression window function.
Figure 23 b shows the subframe that the window function as shown in Figure 23 a is applied to voice signal.
Figure 24 shows the calcspar of the embodiment B202 of high band decoder B200.
Figure 25 shows the calcspar of the embodiment AD10 of wideband speech coding device A100.
Figure 26 a shows the schematic diagram of the embodiment D122 of lag line D120.
Figure 26 b shows the schematic diagram of the embodiment D124 of lag line D120.
Figure 27 shows the schematic diagram of the embodiment D130 of lag line D120.
Figure 28 shows the calcspar of the embodiment AD12 of wideband speech coding device AD10.
Figure 29 shows according to the process flow diagram of the signal processing method MD100 of an embodiment.
Figure 30 shows according to the process flow diagram of the method M100 of an embodiment.
Figure 31 a shows according to the process flow diagram of the method M200 of an embodiment.
The process flow diagram of the embodiment M210 of Figure 31 b methods of exhibiting M200.
Figure 32 shows according to the process flow diagram of the method M300 of an embodiment.
In each figure and the description of enclosing, same reference numerals represents same or similar element or signal.
Embodiment
Embodiment described herein comprise can be configured to provide and extend to support transmission and/or storage broadband voice signal and bandwidth only to increase approximately 800 to 1000bps(bps to narrow-band speech coder) system, method and apparatus.The potential advantage of this type of embodiment comprise support with narrow band system compatible embedded encoded, between narrow-band and high frequency band encoding channel, relatively easily distribute and reallocate, avoid the broadband synthetic operation that calculated amount is larger, and maintain the low sampling rate of the signal for the treatment of the waveform coding routine processing larger by calculated amount.
For example, unless be subject to especially context limited, otherwise used term " calculating " to represent any one of its its ordinary meaning herein, calculate, produce and select from the list of value.When this is described and uses term " to comprise " in content and claims, do not get rid of other element or operation.Use term " A is based on B " represents any one of its its ordinary meaning, comprises following situation: (i) " A equals B " and (ii) " A is at least based on B ".Term " Internet Protocol " comprises as IETF(the Internet engineering work group) RFC(Request for Comment) edition 4 and the subsequent version (for example, version 6) described in 791.
Fig. 1 a shows according to the calcspar of the wideband speech coding device A100 of an embodiment.Bank of filters A110 is configured to broadband voice signal S10 to carry out filtering to produce narrow-band signal S20 and high-frequency band signals S30.Narrowband encoder A120 is configured to encode narrow-band signal S20 to produce narrow-band (NB) filter parameter S40 and narrow-band residual signal S50.As described in further detail herein, narrowband encoder A120 is conventionally configured to as codebook index or takes another quantized versions and produce narrow band filter parameter S 40 and encoded narrow-band pumping signal S50.High band encoder A200 is configured to according to the information coding high-frequency band signals S30 in encoded narrow-band pumping signal S50 to produce high frequency band coding parameter S60.As described in further detail herein, high band encoder A200 is conventionally configured to as codebook index or takes another quantized versions and produce high frequency band coding parameter S60.A particular instance of wideband speech coding device A100 is configured in about 8.55kbps(kbps) speed under the broadband voice signal S10 that encodes, wherein about 7.55kbps is used for narrow band filter parameter S 40 and encoded narrow-band pumping signal S50, and about 1kbps is for high frequency band coding parameter S60.
May need encoded narrow-band and high-frequency band signals to be combined as single bit stream.For instance, may need by multiplexed encoded signal together using as encoded broadband voice signal for example, for transmission (, on wired, optics or wireless transmission channel) or for storage.Fig. 1 b shows the calcspar of the embodiment A102 of wideband speech coding device A100, wideband speech coding device A100 comprises multiplexer A130, and it is configured to narrow band filter parameter S 40, encoded narrow-band pumping signal S50 and high band filter parameter S 60 to be combined as multiplex signal S70.
A kind of equipment that comprises scrambler A102 also can comprise and is configured to multiplex signal S70 to be transferred to the circuit in the transmission channel of for example wired, optics or wireless channel.This equipment also can be configured to signal to carry out one or more chnnel coding operations, for example error correction code (for example, rate-compatible convolutional encoding) and/or error detection code is (for example, cyclic redundancy code), and/or one or more layers procotol coding (for example, Ethernet, TCP/IP, cdma2000).
May need multiplexer A130 to be configured to embed encoded narrow-band signal (comprising narrow band filter parameter S 40 and encoded narrow-band pumping signal S50) as separable multiplex signal S70 tributary, the another part (for example, high frequency band and/or low band signal) that makes encoded narrow-band signal can be independent of multiplex signal S70 is resumed and decodes.For instance, multiplex signal S70 can be configured encoded narrow-band signal can be recovered by divesting high band filter parameter S 60.A potential advantage of this feature is to avoid needing described encoded broadband signal to carry out code conversion before the system that encoded broadband signal is delivered to the decoding of supporting the decoding of narrow-band signal but do not support highband part.
Fig. 2 a shows according to the calcspar of the broadband Voice decoder B100 of an embodiment.Narrow-band demoder B110 is configured to decode narrow band filter parameter S 40 and encoded narrow-band pumping signal S50 to produce narrow-band signal S90.High band decoder B200 is configured to the high frequency band coding parameter S60 that decodes according to narrow-band pumping signal S80 based on encoded narrow-band pumping signal S50, to produce high-frequency band signals S100.In this example, narrow-band demoder B110 is configured to narrow-band pumping signal S80 to be provided to high band decoder B200.Bank of filters B120 is configured to narrow-band signal S90 and high-frequency band signals S100 to combine to produce broadband voice signal S110.
Fig. 2 b is the calcspar of the embodiment B102 of broadband Voice decoder B100, and broadband Voice decoder B100 comprises demultiplexer B130, and it is configured to produce encoded signal S40, S50 and S60 from multiplex signal S70.A kind of equipment that comprises demoder B102 can comprise the circuit that is configured to receive from the transmission channel of for example wired, optics or wireless channel multiplex signal S70.This equipment also can be configured to signal to carry out one or more channel-decoding operations, for example error correction (is for example decoded, rate-compatible convolution decoder) and/or error-detecting (for example decode, cyclic redundancy decoding), and/or one or more layers procotol decoding (for example, Ethernet, TCP/IP, cdma2000).
Bank of filters A110 is configured to, according to division frequency band scheme, input signal is carried out to filtering to produce low frequency sub-band and high-frequency sub-band.Depending on the design standards of application-specific, output sub-band can have the bandwidth that equates or do not wait and possible overlapping or not overlapping.The bank of filters A110 configuration that produces more than two sub-band is also possible.For instance, this bank of filters can be configured to produce one or more low band signal, and described low band signal comprises for example, component in the frequency range (scope of 50-300Hz) below the frequency range in narrow-band signal S20.This bank of filters also may be configured to produce one or more extra high-frequency band signals, and described extra high-frequency band signals comprises for example, component in frequency range (scope of 14-20,16-20 or 16-32kHz) more than the frequency range in high-frequency band signals S30.In the case, can implement wideband speech coding device A100 with this signal (one or more) of encoding separately, and multiplexer A130 can be configured to extra encoded signal (one or more) to be included in (for example,, as removable part) in multiplex signal S70.
Fig. 3 a shows the calcspar of the embodiment A112 of bank of filters A110, and bank of filters A110 is configured to produce the two sub-frequency bands signals with the sampling rate reducing.Bank of filters A110 is configured to receive the broadband voice signal S10 with high-frequency (or high frequency band) part and low frequency (or low-frequency band) part.Bank of filters A112 comprises the low-frequency band processing path that is configured to receive broadband voice signal S10 and produces narrow-band voice signal S20, and the high frequency band processing path that is configured to receive broadband voice signal S10 and produces high frequency band voice signal S30.Low-pass filter 110 carries out filtering with the low frequency sub-band by selected to broadband voice signal S10, and Hi-pass filter 130 carries out filtering with the high-frequency sub-band by selected to broadband voice signal S10.Because the bandwidth ratio broadband voice signal S10 of two sub-frequency bands signals is narrow, so its sampling rate can reduce to a certain extent without information loss.Downsampled device 120 (is for example selected factor according to required, by removing the sample of signal and/or replacing sample with mean value) reduce the sampling rate of low-pass signal, and downsampled device 140 is similarly according to another required sampling rate of selecting factor and reducing high communication number.
Fig. 3 b shows the calcspar of the corresponding embodiment B122 of bank of filters B120.Upwards sampler 150(for example, fills in and/or passes through reproduction copies by zero) increase the sampling rate of narrow-band signal S90, and low-pass filter 160 carries out filtering with only by low-frequency band part (for example,, to prevent aliasing) to sampled signal upwards.Equally, upwards sampler 170 increases the sampling rate of high-frequency band signals S100, and Hi-pass filter 180 carries out filtering only to pass through highband part to sampled signal upwards.Then, two passband signals are sued for peace to form broadband voice signal S110.In some embodiments of demoder B100, bank of filters B120 is configured to produce according to one or more flexible strategy that received and/or calculated by high band decoder B200 the weighted sum of two passband signals.Also expect the bank of filters B120 configuration of more than two passband signal combination.
Each be embodied as finite impulse response (FIR) (FIR) wave filter of wave filter 110,130,160,180 or be embodied as infinite impulse response (IIR) wave filter.The frequency response of encoder filters 110 and 130 can have symmetry between stopband and passband or the limited proportionality of dissimilar shape.Equally, the frequency response of demoder wave filter 160 and 180 can have symmetry between stopband and passband or the limited proportionality of dissimilar shape.May need (but not being to be strictly necessary) low-pass filter 110 and low-pass filter 160 to there is same response, and Hi-pass filter 130 have same response with Hi-pass filter 180.In an example, two wave filters are to the 110,130 and 160, the 180th, quadrature mirror filter (QMF) group, its median filter to 110,130 and wave filter there is same factor to 160,180.
In representative instance, low-pass filter 110 has the passband (for example, 0 to 4kHz frequency band) of the limited PSTN scope that comprises 300-3400Hz.The relative bandwidth of broadband voice signal S10, narrow-band signal S20 and high-frequency band signals S30 in Fig. 4 a and two different embodiments of 4b displaying.In these two particular instances, broadband voice signal S10 has the sampling rate (representing the frequency component within the scope of 0 to 8kHz) of 16kHz, and narrow-band signal S20 has the sampling rate (representing the frequency component within the scope of 0 to 4kHz) of 8kHz.
In the example of Fig. 4 a, between two sub-frequency bands, do not exist obviously overlapping.The Hi-pass filter 130 that high-frequency band signals S30 shown in this example can have a passband of 4-8kHz by use obtains.In the case, may need by sampling rate being reduced to 8kHz taking 2 as factor is downsampled through filtering signal.Can expect that this operation can significantly reduce the computational complexity of the further processing operation to signal, this operation will move down into passband energy within the scope of 0 to 4kHz and without information loss.
In the alternate example of Fig. 4 b, upper and lower sub-band has obviously overlapping, makes two sub-frequency bands signals all describe 3.5 to 4kHz region.The Hi-pass filter 130 that high-frequency band signals S30 in this example can have a passband of 3.5-7kHz by use obtains.In the case, may need by sampling rate being reduced to 7kHz taking 16/7 as factor is downsampled through filtering signal.Can expect that this operation can significantly reduce the computational complexity of the further processing operation to signal, this operation will move down into passband energy within the scope of 0 to 3.5kHz and without information loss.
In call type code communication handset, the obvious response in the frequency range of one or more transducers (, microphone and earphone or loudspeaker) shortage 7-8kHz.In the example of Fig. 4 b, broadband voice signal S10 in 7 and 8kHz between part be not included in encoded signal.Other particular instance of Hi-pass filter 130 has the passband of 3.5-7.5kHz and 3.5-8kHz.
In some embodiments, as provided overlapping permission to use low pass and/or the Hi-pass filter on overlay region with level and smooth decay between sub-band in the example of Fig. 4 b.This type of wave filter with have more sharply or the wave filter of " brickwall (brick-wall) " response compared with, more easily design conventionally, not too complicated in calculating, and/or the delay causing is less.The wave filter with drastic shift district often has higher secondary lobe (this may cause aliasing) than the wave filter of the similar grade with level and smooth decay.The wave filter with drastic shift district also may have long impulse response, and this may cause ring illusion.For the bank of filters embodiment with one or more iir filters, allow the level and smooth decay on overlay region can make it possible to use limit away from the wave filter (one or more) of unit circle, this is for guaranteeing that stable fixed point embodiment may be more important.
The overlapping permission low-frequency band of sub-band is mixed with the level and smooth of high frequency band, and this can cause the less illusion of hearing, reduces aliasing, and/or makes a frequency band not too obvious to the transformation of another frequency band.In addition, narrowband encoder A120(for example, wave coder) code efficiency can constantly increase and decline along with frequency.For instance, may, under low bitrate, especially in the situation that there is ground unrest, reduce the coding quality of narrowband encoder.In such cases, provide sub-band the overlapping quality that improves the frequency component copying in overlay region.
In addition, the overlapping permission low-frequency band of sub-band is mixed with the level and smooth of high frequency band, and it may cause the less illusion of hearing, reduces aliasing, and/or makes a frequency band not too obvious to the transformation of another frequency band.This feature may especially cater to the need according to the embodiment of different coding method operation for narrowband encoder A120 and high band encoder A200.For instance, different coding technology can produce the signal that sounds very different.Can produce the signal with the sound different from the scrambler that changes coding amplitude spectrum into the scrambler of codebook index form coding spectrum envelope.Time domain coding device (for example, pulse-code modulated or PCM encoder) can produce the signal with the sound different from Frequency Domain Coding device.Can produce and have and the signal with the different sound of the scrambler of spectrum envelope representation coded signal only with the scrambler of the representation coded signal of spectrum envelope and corresponding residual signal.The scrambler of the representation that is its waveform by Signal coding can produce the output with the sound different from output from sinusoidal coder.In such cases, define with the wave filter with drastic shift district that non-overlapped sub-band may cause in synthetic broadband signal the transformation between sub-band more suddenly and sensuously more obvious.
Although conventionally use the QMF bank of filters with complementary overlapping frequency response in sub-band technology, this type of wave filter is unsuitable at least some embodiments in broadband coding embodiment described herein.The QMF bank of filters at scrambler place is configured to produce aliasing largely, described in be aliasing in the corresponding QMF bank of filters at demoder place and be eliminated.This configuration may be unsuitable for signal causes the application of a large amount of distortions between bank of filters, because distortion can reduce the effect of aliasing cancellation property.For instance, application described herein comprises be configured to the coding embodiment that operates under low-down bit rate.Because bit rate is very low, so be probably rendered as obvious distortion through decoded signal compared with original signal, make the use of QMF bank of filters can cause the aliasing of not cancellation.Use the application of QMF bank of filters conventionally to there is high bit speed (for example, exceed 12kbps for AMR, and for G.722 exceeding 64kbps).
In addition, scrambler can be configured to be similar to original signal on sensigenous but in fact significantly be different from the composite signal of original signal.For instance, from narrow-band is residual, the scrambler of derivation high band excitation can produce this signal as described herein, because may not exist actual high frequency band residual completely in decoded signal.In this type of application, use QMF bank of filters can cause the distortion largely being caused by the aliasing of not cancellation.
If affected children frequency band is narrower, can reduce so the amount distortion that QMF aliasing causes, because the impact of aliasing is limited to the bandwidth equating with sub-band width.But, the example of the approximately half that comprises broadband bandwidth for wherein each sub-band described herein, the distortion being caused by the aliasing of not cancellation may affect the major part of signal.The quality of signal also may be subject to occur the position influence of the frequency band of the aliasing of not cancellation above.Near the distortion that near the distortion that for instance, broadband voice signal center (for example, 3 and 4kHz between) produces may for example, occur than (, more than 6kHz) signal edge is much harmful.
Although the response of the wave filter of QMF bank of filters is strictly relevant each other, the low-frequency band of bank of filters A110 and B120 and high frequency band path can be configured to have complete incoherent frequency spectrum except two sub-frequency bands overlapping.The distance of the point of the drop to-20dB of frequency response of the some tremendously low frequency band filter of drop to-20dB of the frequency response that we are high band filter by the overlay defining of two sub-frequency bands.In the various examples of bank of filters A110 and/or B120, this overlapping range is that about 200Hz is to about 1kHz.Approximately 400 to the scope of about 600Hz can presentation code efficiency and perception smoothness between desired trade-off.In a particular instance mentioned above, overlap near 500Hz.
May need to implement the operation that bank of filters A112 and/or B122 illustrate in some stage execution graph 4a and 4b.For instance, Fig. 4 c shows the calcspar of the embodiment A114 of bank of filters A112, a series of interpolations for embodiment A114, samples, selects the high-pass filtering and the downsampled operation that operate to carry out function equivalent with other.This type of embodiment can more easily design and/or can allow to re-use the functional block of logic and/or code.For instance, can with identical function piece carry out as shown in Fig. 4 c to 14kHz select and to the operation of selecting of 7kHz.Can pass through signal function e jn πor sequence (1) nmultiply each other to implement reversing spectrum operation, described sequence (1) nvalue between+1 and-1 alternately.Spectrum shaping operation can be embodied as and be configured so that thereby signal shaping obtains the low-pass filter of required overall filter response.
Notice, due to the cause of reversing spectrum operation, the reversing spectrum of high-frequency band signals S30.The correspondingly subsequent operation in configuration codes device and respective decoder.For instance, high band excitation generator A300 described herein can be configured to produce the high band excitation signal S120 equally with reversing spectrum form.
Fig. 4 d shows the calcspar of the embodiment B124 of bank of filters B122, and a series of interpolations bank of filters B122 for, sampling and other operate to carry out function equivalent again upwards sampling and high-pass filtering operate.Bank of filters B124 comprises the reversing spectrum operation in high frequency band, and it makes the middle similar operation reversion of carrying out of bank of filters (for example, bank of filters A114) with for example scrambler.In this particular instance, bank of filters B124 also comprises the notch filter in low-frequency band and high frequency band, and it weakens the component of signal at 7100Hz place, but this type of wave filter is optional and does not need to comprise this type of wave filter.Together the patent application case " SYSTEMS; METHODS; AND APPARATUS FOR SPEECH SIGNAL FILTERING " that is disclosed as publication number US2007/0088558 that shows of application comprises about the additional description of the response of the element of the particular of bank of filters A110 and B120 and graphic therewith, and this material is incorporated to by reference at this.
Narrowband encoder A120 implements according to source-filter model, and it is encoded to input speech signal the pumping signal that (A) a group describes the parameter of wave filter and (B) drive the synthetic duplicate of described wave filter generation input speech signal.Fig. 5 a shows the example of the spectrum envelope of voice signal.The peak value that shows the feature of this spectrum envelope represents the resonance of voice range and is called resonance peak.Most of speech coders to this rough spectrum structured coding of major general is one group of parameter (for example, filter coefficient).
Fig. 5 b shows as is applied to the example of the elementary sources-filter configuration of the coding of the spectrum envelope of narrow-band signal S20.Analysis module calculates one group of parameter describing corresponding to the wave filter of the speech sound in a period of time (common 20 milliseconds).Remove spectrum envelope so that signal is carried out to frequency spectrum leveling according to the prewhitening filter of those filter parameter configurations (also referred to as analysis or prediction error filter).The whitened signal (also referred to as residual) of gained, compared with primary speech signal, has less energy and therefore changes less and compared with easy-encode.Because the error causing that residual signal is encoded also may be dispersed on frequency spectrum more equably.Filter parameter and residual common through quantizing for effectively transmission on channel.At demoder place, encouraged to produce the synthetic version of raw tone sound by the signal based on residual according to the composite filter of filter parameter configuration.Composite filter is configured to have transfer function conventionally, and described transfer function is the inverted versions of the transfer function of prewhitening filter.
Fig. 6 shows the calcspar of the basic embodiment A122 of narrowband encoder A120.In this example, the spectrum envelope of narrow-band signal S20 is encoded to one group of linear prediction (LP) coefficient (for example, the coefficient 1/A (z) of full utmost point wave filter) by linear predictive coding (LPC) analysis module 210.Analysis module is treated to input signal a series of non-overlapped frames conventionally, wherein for each frame calculates one group of new coefficient.Frame period normally can expect the cycle that signal is static in this locality; A common example is 20 milliseconds (being equivalent to lower 160 samples of sampling rate of 8kHz).In an example, lpc analysis module 210 is configured to calculate one group of 10 LP filter coefficient to describe the resonance peak structure of each 20 milliseconds of frame.Also may implement analysis module input signal is treated to a series of overlapping frame.
Analysis module can be configured to the sample of each frame of Direct Analysis, or can first for example, be weighted sample according to window function (, Hamming window).Also the upper execution analysis of the window of frame (for example, 30 milliseconds of windows) can be greater than.This window can be symmetrical (for example 5-20-5, make its comprise 20 milliseconds of frames and then before and afterwards 5 milliseconds) or asymmetric (for example 10-20, last 10 milliseconds of making it comprise previous frame).Lpc analysis module is configured to use Levinson-Durbin recursion or Leroux-Gueguen algorithm to calculate LP filter coefficient conventionally.In another embodiment, analysis module can be configured to calculate one group of cepstrum coefficient instead of one group of LP filter coefficient of each frame.
The output speed of scrambler A120 can significantly reduce by quantizing filter coefficient, and relatively little on the impact of reproduction quality.Coefficient of linear prediction wave filter is difficult to effective quantification, and is conventionally mapped as another representation, and for example line spectrum pair (LSP) or line spectral frequencies (LSF), for quantizing and/or entropy coding.In the example of Fig. 6, described group of LP filter coefficient is transformed to one group of corresponding LSF by LP filter coefficient-LSF conversion 220.Other of LP filter coefficient one to one representation comprises partial autocorrelation coefficient, log area ratio value, adpedance and composes (ISP) and immittance spectral frequencies (ISF), and it is for GSM(global system for mobile communications) the how fast broadband of AMR-WB(self-adaptation) coder.Conventionally, the conversion between one group of LP filter coefficient and one group of corresponding LSF is reversible, but embodiment also comprises the scrambler A120 embodiment that conversion can not be reversible in error free situation.
Quantizer 230 is configured to quantize described group of narrow-band LSF(or other coefficient representation), and the result that narrowband encoder A122 is configured to export this quantification is as narrow band filter parameter S 40.This quantizer comprises vector quantizer conventionally, and input vector is encoded to the index for the corresponding vectorial entry in table or code book by it.
As shown in Figure 6, narrowband encoder A122 also by make narrow-band signal S20 by according to the prewhitening filter 260(of described group of filter coefficient configuration also referred to as analyzing or prediction error filter) produce residual signal.In this particular instance, prewhitening filter 260 is embodied as FIR wave filter, but also can use IIR embodiment.This residual signal will contain in narrow band filter parameter S 40 the sensuously more important speech frame information not representing, for example long-term structure relevant with tone conventionally.The quantization means form that quantizer 270 is configured to calculate this residual signal is using the narrow-band pumping signal S50 output as encoded.This quantizer comprises vector quantizer conventionally, and input vector is encoded to the index for the corresponding vectorial entry in table or code book by it.Or this quantizer can be configured to send one or more parameters, can from described parameter, dynamically produce at demoder place vector, instead of as in sparse code book method, from memory storage, retrieve vector.The method is for for example algebraically CELP(code book Excited Linear Prediction) encoding scheme and for example 3GPP2(third generation partnership relation 2) EVRC(enhancing variable bit rate coder) and coder.
Need narrowband encoder A120 according to the same filter parameter value that can be used for corresponding narrow-band demoder is produced to encoded narrow-band pumping signal.In this way, the encoded narrow-band pumping signal of gained may be considered the undesirable property of those parameter values, for example quantization error to a certain extent.Therefore, need to by demoder place can with same tie numerical value configure prewhitening filter.In the basic example of scrambler A122 as shown in Figure 6, quantizer 240 is to narrow-band coding parameter S40 de-quantization, income value is shone upon back one group of corresponding LP filter coefficient by LSF-LP filter coefficient conversion 250, and this group coefficient is for configuring prewhitening filter 260 to produce the residual signal being quantized by quantizer 270.
Some embodiments of narrowband encoder A120 are configured to calculate encoded narrow-band pumping signal S50 by identifying with a vector of residual signal optimum matching from one group of code book vector.But, noticing, in fact narrowband encoder A120 can not produce residual signal through implementing the quantization means form to calculate residual signal yet.For instance, narrowband encoder A120 can be configured to (for example produce corresponding composite signal with many code book vectors, according to one group of current filter parameter), and in selection and perceptual weighting territory and original narrow-band signal S20 optimum matching institute the signal correction that produces join code book vector.
Fig. 7 shows the calcspar of the embodiment B112 of narrow-band demoder B110.Quantizer 310 to narrow band filter parameter S 40 de-quantizations (in the case, de-quantization is one group of LSF), and LSF is transformed to one group of filter coefficient (for example,, as the quantizer 240 above with reference to narrowband encoder A122 and conversion 250 are described) by the conversion 320 of LSF-LP filter coefficient.Quantizer 340 to encoded narrow-band pumping signal S50 de-quantization to produce narrow-band pumping signal S80.Based on filter coefficient and narrow-band pumping signal S80, narrow-band composite filter 330 synthesis of narrow band signal S90.In other words, narrow-band composite filter 330 is configured to, according to de-quantization filter coefficient, narrow-band pumping signal S80 is carried out to spectrum shaping, to produce narrow-band signal S90.Narrow-band demoder B112 is also provided to high band encoder A200 by narrow-band pumping signal S80, and high band encoder A200 derives high band excitation signal S120 with narrow-band pumping signal S80, as described herein.In embodiments more described below, narrow-band demoder B110 can be configured to the extraneous information relevant with narrow-band signal (for example, spectral tilt, pitch gain and hysteresis, and speech pattern) to be provided to high band decoder B200.
The system of narrowband encoder A122 and narrow-band demoder B112 is the basic example of synthesis analysis Codec.Code book Excited Linear Prediction (CELP) coding is the general series of of synthesis analysis coding, and the embodiment of this type of scrambler can be carried out residual waveform coding, wherein comprise for example selector bar object operation from fixing and self-adaptation code book, error minimize operation and/or perceptual weighting operation.Other embodiment of synthesis analysis coding comprises MELP (Mixed Excitation Linear Prediction) (MELP), algebraically CELP(ACELP), lax CELP(RCELP), Regular-Pulse Excitation (RPE), multiple-pulse CELP(MPE) and vector sum Excited Linear Prediction (VSELP) encode.Correlative coding method comprises multi-band excitation (MBE) and prototype waveform interpolation (PWI) coding.The example of standard synthesis analysis Codec comprises the ETSI(ETSI that uses residual excited linear predictive (RELP)) GSM full rate coder (GSM06.10), GSM EFR coder (ETSI-GSM06.60), ITU(International Telecommunications Union (ITU)) the G.729Annex interim standard of IS(of E scrambler, IS-136 of standard 11.8kb/s) 641 coders (time division multiple access (TDMA) scheme), GSM adaptive multi-rate (GSM-AMR) coder, and 4GV tM(the 4th generation Vocoder tM) coder (Qualcomm (QUALCOMM Incorporated, San Diego, CA) of Diego California, California).Narrowband encoder A120 and corresponding demoder B110 can implement according to any one or any other speech coding technology in these technology (known or leaved for development), and described speech coding technology is expressed as voice signal that (A) a group describes the parameter of wave filter and (B) for driving the pumping signal of described wave filter reproduction speech signal.
Even after prewhitening filter is removed rough spectrum envelope from narrow-band signal S20, also may retain quite a large amount of meticulous harmonic structure (especially for turbid voice).Fig. 8 a shows the spectrum curve of an example of the residual signal (as produced by prewhitening filter) of voiced sound signal (for example, vowel).In this example, visible periodic structure is relevant with tone, and the different voiced sounds that same speaker sends may have different resonance peak structure but have similar tone structure.Fig. 8 b shows the time-domain curve of the example of this residual signal, and it shows the time series of tone pulses.
Can be by increasing code efficiency and/or voice quality by the characteristic of one or more parameter value coding tone structures.The frequency (also referred to as fundamental frequency) that a key property of tone structure is first harmonic, they are conventionally within the scope of 60 to 400Hz.This characteristic is encoded to the inverted versions of fundamental frequency conventionally, also referred to as pitch lag (pitch lag).The number of sample in a pitch period of pitch lag instruction, and may be encoded as one or more codebook index.Voice signal from male speaker often recently has larger pitch lag from women speaker's voice signal.
Another characteristics of signals relevant with tone structure is periodically, the intensity of its instruction harmonic structure, or in other words, signal is harmonic wave or non-harmonic degree.Periodic two typical designators are zero crossing and normalized autocorrelation function (NACF).Periodically also can be indicated by pitch gain, described pitch gain is encoded to code book gain (for example, quantizing the gain of self-adaptation code book) conventionally.
Narrowband encoder A120 can comprise one or more modules of the long-term harmonic structure of the narrow-band signal S20 that is configured to encode.As shown in Figure 9, a spendable typical CELP example comprises open loop lpc analysis module, and its coding short-term characteristic or rough spectrum envelope, be the closed type loop Long-run Forecasting Analysis stage afterwards, described stage coding fine pitch or harmonic structure.Short-term characteristic is encoded to filter coefficient, and long-time quality is encoded to the value of the parameter of for example pitch lag and pitch gain.For instance, narrowband encoder A120 can be configured so that for example, to comprise the encoded narrow-band pumping signal of the formal output S50 of one or more codebook index (, this index of fixed password and self-adaptation codebook index) and corresponding yield value.The calculating (for example,, by quantizer 270) of this quantization means form of narrow-band residual signal can comprise to be selected these indexes and calculates these values.The coding of tone structure also can comprise interpolation pitch prototype waveform, and described operation can comprise calculates poor between continuous tone pulse.Can be for the modeling of forbidding long-term structure corresponding to the frame of clear voice (it is similar to noise and not systematization conventionally).
Can be configured to, after long-term structure (tone or harmonic structure) has been recovered, narrow-band pumping signal S80 is outputed to high band decoder B200 according to the embodiment of the narrow-band demoder B110 of the example shown in Fig. 9.For instance, this demoder can be configured to export the de-quantization version of narrow-band pumping signal S80 as encoded narrow-band pumping signal S50.Certainly, also may implement narrow-band demoder B110, make de-quantization that high band decoder B200 carries out encoded narrow-band pumping signal S50 to obtain narrow-band pumping signal S80.
According in the embodiment of the wideband speech coding device A100 of the example shown in Fig. 9, high band encoder A200 can be configured to receive the narrow-band pumping signal being produced by short run analysis or prewhitening filter.In other words, narrowband encoder A120 can be configured to, before the long-term structure of coding, narrow-band pumping signal is outputed to high band encoder A200.But high band encoder A200 need to receive the same-code information being received by high band decoder B200 from narrow-band channel, the coding parameter that high band encoder A200 is produced may be considered the undesirable property of described information to a certain extent.Therefore, may be preferably, high band encoder A200 is from treating the identical parameters of being exported by wideband speech coding device A100 and/or quantizing to rebuild narrow-band pumping signal S80 encoded narrow-band pumping signal S50.A potential advantage of the method is to calculate more exactly high frequency band gain factor S60b described below.
Except describing the short-term of narrow-band signal S20 and/or the parameter of long-term structure, narrowband encoder A120 also can produce the parameter value relevant with other characteristic of narrow-band signal S20.These values (its may through suitable quantification to be exported by wideband speech coding device A100) can be included in narrow band filter parameter S 40 or output separately.High band encoder A200 also can be configured to for example, calculate high frequency band coding parameter S60 according to one or more (, after de-quantization) in these additional parameter.At broadband Voice decoder B100 place, high band decoder B200 via narrow-band demoder B110(for example can be configured to, after de-quantization) reception parameter value.Or high band decoder B200 can be configured to direct reception (and may be used for de-quantization) parameter value.
In an example of additional narrow frequencyband coding parameter, narrowband encoder A120 produces the spectral tilt of each frame and the value of speech pattern parameter.Spectral tilt is relevant with the shape of spectrum envelope in passband, and conventionally represents by quantizing the first reflection coefficient.For most of voiced sounds, spectrum energy reduces along with the continuous increase of frequency, makes the first reflection coefficient for bearing and can approaching-1.Most of voicelesss sound have smooth frequency spectrum, thereby make the first reflection coefficient approach zero, or have more energy under high-frequency, thereby make the first reflection coefficient for just and can approach+1.
Speech pattern (also referred to as sounding pattern) instruction present frame represents turbid voice or clear voice.This parameter can have binary value, its for example, voice activity (for example, the relation between this measured value and threshold value) based on periodic one or more measured values (, zero crossing, NACF, pitch gain) and/or frame.In other embodiments, speech pattern parameter has the pattern of one or more other states with the transformation between instruction for example noiseless or ground unrest or noiseless and turbid voice.
High band encoder A200 is configured to according to the source-filter model high-frequency band signals S30 that encodes, and wherein the excitation of this wave filter is based on encoded narrow-band pumping signal.Figure 10 shows the calcspar of the embodiment A202 of high band encoder A200, and high band encoder A200 is configured to produce the high frequency band coding parameter S60 stream that comprises high band filter parameter S 60a and high frequency band gain factor S60b.High band excitation generator A300 derives high band excitation signal S120 from encoded narrow-band pumping signal S50.Analysis module A210 produces one group of parameter value of the spectrum envelope of describing high-frequency band signals S30.In this particular instance, analysis module A210 is configured to carry out lpc analysis to produce one group of LP filter coefficient for each frame of high-frequency band signals S30.Described group of LP filter coefficient is transformed to one group of corresponding LSF by coefficient of linear prediction wave filter-LSF conversion 410.As described in above with reference to analysis module 210 and conversion 220, analysis module A210 and/or conversion 410 can be configured to use other coefficient sets (for example, cepstrum coefficient) and/or coefficient representation (for example, ISP).
Quantizer 420 is configured to quantize described group of high frequency band LSF(or other coefficient representation, for example ISP), and the result that high band encoder A202 is configured to export this quantification is as high band filter parameter S 60a.This quantizer comprises vector quantizer conventionally, and input vector is encoded to the index for the corresponding vectorial entry in table or code book by it.
High band encoder A202 also comprises composite filter A220, and its encoded spectrum envelope (for example, described group of LP filter coefficient) that is configured to produce according to high band excitation signal S120 with by analysis module A210 produces synthetic high-frequency band signals S130.Composite filter A220 is embodied as iir filter conventionally, but also can use FIR embodiment.In particular instance, composite filter A220 is embodied as sextic autoregressive filter.
It is poor that high frequency band gain factor counter A230 calculates one or more between original high-frequency band signals S30 and the level of synthetic high-frequency band signals S130, with the gain envelope of designated frame.Quantizer 430 can be embodied as input vector is encoded to the vector quantizer for the index of the corresponding vectorial entry in table or code book, it quantizes to specify the value (one or more) of gain envelope, and the result that high band encoder A202 is configured to export this quantification is as high frequency band gain factor S60b.
In embodiment as shown in figure 10, composite filter A220 is configured to from analysis module A210 receiving filter coefficient.The alternate embodiment of high band encoder A202 comprises quantizer and inverse transform, it is configured to decoding filter coefficient from high band filter parameter S 60a, and composite filter A220 is configured to change into reception through decoding filter coefficient in the case.This alternative arrangements can be supported the calculated gains envelope more exactly by high frequency band gain calculator A230.
In a particular instance, the respectively every frame output hexad LSF of analysis module A210 and high frequency band gain calculator A230 and one group of five yield value, make only to realize by 11 bonus values of every frame the broadband extension of narrow-band signal S20.Ear is often more insensitive for the frequency error under high-frequency, thereby the high frequency band of low LPC level coding can produce the signal with the perceived quality compared with can encoding with the narrow-band of higher LPC level.The typical embodiments of high band encoder A200 can be configured to 8 to 12 high-quality for spectrum envelope of every frame output and rebuild, and every frame is exported other 8 to 12 high-quality for temporal envelope reconstruction.In another particular instance, the every frame of analysis module A210 is exported one group of eight LSF.
Some embodiments of high band encoder A200 are configured to produce in the following manner high band excitation signal S120: produce and have the random noise signal of high-band frequency component, and according to the temporal envelope of narrow-band signal S20, narrow-band pumping signal S80 or high-frequency band signals S30, noise signal is carried out to which amplitude modulation.Although this method based on noise can produce suitable result for voiceless sound, but it may be undesirable for voiced sound, and the residual of voiced sound is generally harmonic wave and therefore has certain periodic structure.
High band excitation generator A300 is configured in high-band frequency range, produce high band excitation signal S120 by the frequency spectrum of narrow-band pumping signal S80 is extended to.Figure 11 shows the calcspar of the embodiment A302 of high band excitation generator A300.Quantizer 450 is configured to the encoded narrow-band pumping signal of de-quantization S50 to produce narrow-band pumping signal S80.Frequency spectrum stretcher A400 is configured to produce harmonic wave based on narrow-band pumping signal S80 and extends signal S160.Combiner 470 is configured to the temporal envelope that random noise signal that noise generator 480 is produced and envelope counter 460 calculate and combines to produce through zoop signal S170.Combiner 490 is configured to harmonic wave extend signal S160 and mix to produce high band excitation signal S120 through zoop signal S170.
In an example, frequency spectrum stretcher A400 is configured to narrow-band pumping signal S80 to carry out spectrum folding operation (also referred to as mirror) to produce harmonic wave extension signal S160.Spectrum folding can be filled in pumping signal S80 execution and then apply Hi-pass filter by zero and retain false signal.In another example, frequency spectrum stretcher A400 is configured to (for example,, via upwards sampling, multiply each other afterwards with constant frequency cosine signal) and produce harmonic wave extension signal S160 by narrow-band pumping signal S80 frequency spectrum being translated in high frequency band.
Spectrum folding and translation method can produce harmonic structure and extend signal with the discontinuous frequency spectrum of original harmonic structure of narrow-band pumping signal S80 in phase place and/or frequency.For instance, these class methods can produce has the signal that is not conventionally positioned at the peak value at the multiple place of fundamental frequency, and this may cause the illusion of microphonia in the voice signal of rebuilding.These methods produce and have the unnatural high-frequency harmonic wave of adjusting characteristic compared with forte toward contact.But, because PSTN signal can sample under 8kHz, bandwidth is restricted to and is not more than 3400Hz, so the top frequency spectrum of narrow-band pumping signal S80 may contain seldom or not contain energy, make to translate according to spectrum folding or frequency spectrum the extension signal that operation produces and can there is spectral hole more than 3400Hz.
Other method that produces harmonic wave extension signal S160 comprises one or more fundamental frequencies of identifying narrow-band pumping signal S80, and produces homophonic according to described information.For instance, the harmonic structure of pumping signal can be described together with phase information with amplitude by fundamental frequency.Another embodiment of high band excitation generator A300 produces harmonic wave extension signal S160 based on fundamental frequency and amplitude (for example,, as indicated by pitch lag and pitch gain).But, remove anharmonic wave extension signal and narrow-band pumping signal S80 relevant in phase place, otherwise the quality through decoded speech of gained may be unacceptable.
Useful nonlinear function produce with narrow-band excitation phase on phase dry doubling keep harmonic structure and there is no the high band excitation signal of phase discontinuity.Nonlinear function also can provide the noise level of the increase between high-frequency harmonic wave, and its tone high-frequency harmonic wave often producing than the method for translating by for example spectrum folding and frequency spectrum sounds more natural.Can comprise ABS function (also referred to as full-wave rectification), half-wave rectification, square, cube and slicing by the memoryless nonlinear function of typical case of the various embodiment application of frequency spectrum stretcher A400.Other embodiment of frequency spectrum stretcher A400 can be configured to apply the nonlinear function with memory.
Figure 12 is the calcspar of the embodiment A402 of frequency spectrum stretcher A400, and frequency spectrum stretcher A400 is configured to apply nonlinear function and extends the frequency spectrum of narrow-band pumping signal S80.Upwards sampler 510 is configured to narrow-band pumping signal S80 upwards to sample.May need signal to carry out fully upwards sampling so that aliasing when application nonlinear function minimizes.In a particular instance, upwards sampler 510 upwards samples signal taking 8 as factor.Upwards sampler 510 can be configured to fill in and result carried out to low-pass filtering and carry out upwards sampling operation by input signal being carried out to zero.Nonlinear function counter 520 is configured to nonlinear function to be applied to through sampled signal upwards.Extend (for example, square) for frequency spectrum, ABS function is not need energy scale with respect to a potential advantage of other nonlinear function.In some embodiments, can effectively apply ABS function by the sign bit of peeling off or remove each sample.Nonlinear function counter 520 also can be configured to carry out through upwards sampling or frequency spectrum extend the amplitude deviation of signal.
Downsampled device 530 is configured to that the frequency spectrum of application nonlinear function is extended to result and carries out downsampled.Downsampled device 530 may need to carry out bandpass filtering operation to select before frequency spectrum to extend the required frequency band of signal reducing sampling rate (for example,, to reduce or avoid the aliasing or the error that cause due to unnecessary image).Downsampled device 530 may be also need to be more than one the stage reduce sampling rate.
Figure 12 a shows that frequency spectrum extends the figure of the signal spectrum at each point place in the example operating, and wherein frequency scaling is identical on each curve.Curve (a) is shown the frequency spectrum of an example of narrow-band pumping signal S80.Curve (b) shows that signal S80 is by the frequency spectrum after factor upwards samples taking 8.Curve (c) is shown the example of the extension frequency spectrum after application nonlinear function.Curve (d) is shown the frequency spectrum after low-pass filtering.In this example, passband extends to the upper frequency limit (for example, 7kHz or 8kHz) of high-frequency band signals S30.
Curve (e) is shown the frequency spectrum after the downsampled first stage, wherein makes sampling rate reduce to obtain broadband signal taking 4 as factor.Curve (f) shows and carries out high-pass filtering operation to select to extend the frequency spectrum after the highband part of signal, and curve (g) shows the frequency spectrum after downsampled subordinate phase, wherein makes sampling rate reduce taking 2 as factor.In a particular instance, downsampled device 530 is by making broadband signal by bank of filters A112(or having other structure or the routine of same response) Hi-pass filter 130 and downsampled device 140 carry out high-pass filtering and downsampled subordinate phase, there is the frequency range of high-frequency band signals S30 and the frequency spectrum of sampling rate extends signal to produce.
As visible in curve (g), downsampled its reversing spectrum that impels of the high communication number shown in curve (f).In this example, downsampled device 530 is also configured to signal to carry out spectrum inversion operation.Curve (h) is shown the result of application spectrum inversion operation, and described spectrum inversion operation can be passed through signal function e jn πor sequence (1) nmultiply each other to carry out described sequence (1) nvalue between+1 and-1 alternately.This operation is equivalent in frequency domain the digital spectrum translocation distance π of signal.Notice, also can operate to obtain identical result by and spectrum inversion downsampled with different order application.Upwards sampling and/or downsampled operation also can be configured to comprise and sample the frequency spectrum extension signal that obtains the sampling rate (for example, 7kHz) with high-frequency band signals S30 again.
As above noticed, bank of filters A110 and B120 can be through implementing to make the one or both in narrow-band and high-frequency band signals S20, S30 have reversing spectrum form in the output of bank of filters A110, be encoded and decode with reversing spectrum form, and in broadband voice signal S110 output before at bank of filters B120 place reversing spectrum again.Certainly, in the case, by the spectrum inversion operation not needing as shown in Figure 12 a, because high band excitation signal S120 will also need to have reversing spectrum form.
The frequency spectrum that frequency spectrum stretcher A402 carries out extends the upwards sampling of operation and each downsampled task can configure and arrange by many different modes.For instance, Figure 12 b shows that frequency spectrum extends the figure of the signal spectrum at each point place in another example operating, and wherein frequency scaling is identical on each curve.Curve (a) is shown the frequency spectrum of an example of narrow-band pumping signal S80.Curve (b) shows that signal S80 is by the frequency spectrum after factor upwards samples taking 2.Curve (c) is shown the example of the extension frequency spectrum after application nonlinear function.In the case, accept contingent aliasing in upper frequency.
Curve (d) is shown the frequency spectrum after reversing spectrum operation.Curve (e) is shown frequency spectrum afterwards of downsampled single stage, wherein makes sampling rate extend signal taking 2 as factor reduces to obtain required frequency spectrum.In this example, described signal is taked reversing spectrum form, and can be used in the embodiment of the high band encoder A200 that processes the high-frequency band signals S30 that takes this form.
The frequency spectrum that nonlinear function counter 520 produces extends signal, and probably along with frequency increases, amplitude obviously reduces.Frequency spectrum stretcher A402 comprises frequency spectrum tenderizer 540, and it is configured to operating through the albefaction of sampled signal execution downwards.Frequency spectrum tenderizer 540 can be configured to carry out fixing albefaction operation or carry out adaptive whitening operation.In the particular instance of adaptive whitening, frequency spectrum tenderizer 540 comprises: lpc analysis module, and it is configured to according to calculating one group of four filter coefficient through downward sampled signal; And four analysis filters, it is configured to, according to those coefficients, signal is carried out to albefaction.Other embodiment of frequency spectrum stretcher A400 comprises frequency spectrum tenderizer 540 configuration to frequency spectrum extension signal operation before downsampled device 530.
High band excitation generator A300 can be embodied as to output harmonic wave and extend signal S160 as high band excitation signal S120.But, in some cases, only use harmonic wave to extend signal and may cause the illusion that can hear as high band excitation.The harmonic structure of voice is conventionally not so good as in low-frequency band obvious in high frequency band, and in high band excitation signal, uses too much harmonic structure may cause buzz.This illusion may be especially obvious in the voice signal from women speaker.
Embodiment comprises the embodiment that is configured to harmonic wave to extend the high band excitation generator A300 that signal S160 mixes with noise signal.As shown in figure 11, high band excitation generator A302 comprises noise generator 480, and it is configured to produce random noise signal.In an example, noise generator 480 is configured to produce unit variance white pseudo-random noise signal, but in other embodiments, noise signal do not need for white and can there is the power density along with frequency change.Noise generator 480 may need to be configured to output noise signal as determinacy function to can copy at demoder place its state.For instance, noise generator 480 for example can be configured to output noise signal, as previous information (, narrow band filter parameter S 40 and/or the encoded narrow-band pumping signal S50) qualitative function really in identical intraframe coding.
Before mixing with harmonic wave extension signal S160, the random noise signal that noise generator 480 produces can extend through which amplitude modulation the temporal envelope of the energy distribution in time of signal S160 to have approximate narrow-band signal S20, high-frequency band signals S30, narrow-band pumping signal S80 or harmonic wave.As shown in figure 11, high band excitation generator A302 comprises combiner 470, and the noise signal that its temporal envelope that is configured to calculate according to envelope counter 460 produces noise generator 480 is carried out which amplitude modulation.For instance, combiner 470 can be embodied as multiplier, and its temporal envelope that is configured to calculate according to envelope counter 460 carrys out the output of convergent-divergent noise generator 480 to produce through zoop signal S170.
As shown in the calcspar of Figure 13, in the embodiment A304 of high band excitation generator A302, envelope counter 460 is through arranging the envelope that extends signal S160 to calculate harmonic wave.As shown in the calcspar of Figure 14, in the embodiment A306 of high band excitation generator A302, envelope counter 460 is through arranging the envelope to calculate narrow-band pumping signal S80.The other embodiments of high band excitation generator A302 can otherwise be configured to extend signal S160 to harmonic wave in time according to the position of narrow-band tone pulses and add noise.
Envelope counter 460 can be configured to carry out as the task of comprising a series of subtasks envelope and calculate.Figure 15 shows the process flow diagram of the example T100 of this task.Subtask T110 calculate envelope treat the frame of the signal of modeling (for example, narrow-band pumping signal S80 or harmonic wave extend signal S160) each sample square to produce square value sequence.Subtask T120 carries out smooth operation to square value sequence.In an example, subtask T120 applies an IIR low-pass filter according to following formula to sequence:
y(n)=ax(n)+(1-a)y(n-1), (1)
Wherein x is wave filter input, and y is wave filter output, Domain Index when n is, and a is the smoothing factor with the value between 0.5 and 1.The value of smoothing factor a can be fixing, or in alternate embodiment, can be according to the instruction of noise in input signal and self-adaptation makes a in muting situation approach 1, and approach 0.5 in the situation that there is noise.Subtask T130 is applied to through each sample of level and smooth sequence square root function to produce temporal envelope.
This embodiment of envelope counter 460 can be configured to according to execute the task each subtask of T100 of serial and/or parallel mode.In the other embodiments of task T100, before the T110 of subtask, can be the logical operation of band, it is configured to the required frequency part of the signal of selecting envelope to treat modeling, for example 3-4kHz scope.
Combiner 490 is configured to harmonic wave extend signal S160 and mix to produce high band excitation signal S120 through zoop signal S170.The embodiment of combiner 490 can be configured (for example) with high band excitation signal S120 is calculated as harmonic wave extend signal S160 with through zoop signal S170's and.This embodiment of combiner 490 can be configured to by extended signal S160 and/or to through zoop signal S170 application weighting factor to harmonic wave before summation, and high band excitation signal S120 is calculated as to weighted sum.Can calculate each this type of weighting factor according to one or more standards, and described weighting factor can be fixed value, or frame by frame or the adaptation value calculating on by sub-frame basis.
Figure 16 shows the calcspar of the embodiment 492 of combiner 490, and described embodiment 492 is configured to that high band excitation signal S120 is calculated as to harmonic wave and extends signal S160 and the weighted sum through zoop signal S170.Combiner 492 is configured to extend signal S160 according to harmonic wave weighting factor S180 weighting harmonic wave, through zoop signal S170, and exports high band excitation signal S120 as the summation that is weighted signal according to noise weighting factor S190 weighting.In this example, combiner 492 comprises weighting factor counter 550, and it is configured to calculate harmonic wave weighting factor S180 and noise weighting factor S190.
Weighting factor counter 550 can be configured to calculate weighting factor S180 and S190 according to the required ratio of harmonic content and noise content in high band excitation signal S120.For instance, combiner 492 may need to produce high band excitation signal S120 to have with the harmonic energy of high-frequency band signals S30 with noise energy than similar harmonic energy and noise energy ratio.In some embodiments of weighting factor counter 550, for example, calculate weighting factor S180, S190 according to one or more parameters relevant with the periodicity of narrow-band signal S20 or narrow-band residual signal (, pitch gain and/or speech pattern).This embodiment of weighting factor counter 550 can be configured to assign (for example) value proportional to pitch gain to harmonic wave weighting factor S180, and/or is compared to turbid voice signal to the higher value of noise weighting factor S190 appointment for clear voice signal.
In other embodiments, weighting factor counter 550 is configured to calculate according to the periodic measured value of high-frequency band signals S30 the value of harmonic wave weighting factor S180 and/or noise weighting factor S190.In this type of example, weighting factor counter 550 is calculated as harmonic wave weighting factor S180 the maximal value of the present frame of high-frequency band signals S30 or the coefficient of autocorrelation of subframe, wherein in the delay that comprises a pitch lag and do not comprise on the hunting zone of delay of zero sample and carry out auto-correlation.Figure 17 shows centered by a pitch lag delay and has the length of the width that is not more than a pitch lag as the example of this hunting zone of n sample.
Figure 17 also shows that weighting factor counter 550 calculates the example of the other method of the periodic measured value of high-frequency band signals S30 in some stages.In the first stage, present frame is divided into many subframes, and delay when identifying separately coefficient of autocorrelation and be maximum for each subframe.As mentioned above, in the delay that comprises a pitch lag and do not comprise on the hunting zone of delay of zero sample and carry out auto-correlation.
In subordinate phase, by the delay of corresponding identification is applied to each subframe, connect the subframe of gained to set up optimal delay frame, and harmonic wave weighting factor S180 is calculated as to the related coefficient between primitive frame and optimal delay frame, set up deferred frame.In another alternate embodiment, weighting factor counter 550 is calculated as harmonic wave weighting factor S180 the mean value of the maximum coefficient of autocorrelation obtaining for each subframe in the first stage.The embodiment of weighting factor counter 550 also can be configured to convergent-divergent related coefficient, and/or itself and another value is combined, to calculate the value of harmonic wave weighting factor S180.
Weighting factor counter 550 may need only otherwise indicating frame to have the periodic measured value that calculates high-frequency band signals S30 in periodic situation.For instance, weighting factor counter 550 can be configured to for example, calculate according to the relation between periodic another designator (, pitch gain) of present frame and threshold value the periodic measured value of high-frequency band signals S30.In an example, the value that weighting factor counter 550 is only configured to the pitch gain (for example, the self-adaptation code book gain that narrow-band is residual) when frame be greater than 0.5(or, at least 0.5) time just high-frequency band signals S30 is carried out to auto-correlation computation.In another example, weighting factor counter 550 is configured to only for the frame (for example,, only for voiced sound signal) with special sound mode state, high-frequency band signals S30 be carried out to auto-correlation computation.In such cases, weighting factor counter 550 can be configured to assign default weighting factor for the frame with other speech pattern state and/or less pitch gain value.
Embodiment comprises and is configured to according to being different from periodically or characteristic except periodicity is calculated the other embodiments of the weighting factor counter 550 of weighting factor.For instance, this embodiment can be configured to for the voice signal with large pitch lag than assigning larger value for the voice signal with little pitch lag to noise gain factor S190.This type of embodiment of another of weighting factor counter 550 is configured to the measured value with respect to the signal energy in other frequency component place according to the signal energy at the multiple place in fundamental frequency, determines the measured value of the humorous degree of broadband voice signal S10 or high-frequency band signals S30.
Some embodiments of wideband speech coding device A100 are configured to another measured value based on pitch gain described herein and/or periodicity or humorous degree, export the instruction (for example, instruction frame is harmonic wave or non-harmonic 1 flag) of periodicity or humorous degree.In an example, corresponding broadband Voice decoder B100 indicates to configure with this operation that for example weighting factor is calculated.In another example, this instruction carrys out the value of computing voice mode parameter for scrambler and/or demoder place.
May need high band excitation generator A302 to produce high band excitation signal S120, make the energy of pumping signal roughly not be subject to the impact of the particular value of weighting factor S180 and S190.In the case, weighting factor counter 550 can be configured to calculate the value (or receiving this value from another element of memory storage or high band encoder A200) of harmonic wave weighting factor S180 or noise weighting factor S190, and derives the value of another weighting factor according to for example following formula:
(W harmonic wave) 2+ (W noise) 2=1, (2)
Wherein W harmonic waverepresent harmonic wave weighting factor S180, and W noiserepresent noise weighting factor S190.Or weighting factor counter 550 can be configured to select from multipair weighting factor S180, S190 according to the value of the periodic measurement of present frame or subframe corresponding one, wherein said to the constant energy ratio through calculating to meet in advance for example expression formula (2).For the embodiment of weighting factor counter 550 of following expression formula (2), the representative value of harmonic wave weighting factor S180 is in approximately 0.7 to approximately 1.0 scopes, and the representative value of noise weighting factor S190 is in approximately 0.1 to approximately 0.7 scope.Other embodiment of weighting factor counter 550 can be configured to operate according to expression formula (2) pattern that adds weight update according to harmonic wave extension signal S160 and the required baseline between zoop signal S170.
In the time using sparse code book (the most of code book for null value of entry) to calculate residual quantization means form, in synthetic speech signal, may there is illusion.Especially when with low bitrate coding narrow-band signal, code book can be there is sparse.The sparse illusion causing of code book is quasi periodic conventionally in time, and mainly more than 3kHz, occurs.Because thering is good time resolution for people's ear under upper frequency, so these illusions may be more obvious in high frequency band.
Embodiment comprises the embodiment that is configured to the high band excitation generator A300 that carries out anti-sparseness filtering.Figure 18 shows the calcspar of the embodiment A312 of high band excitation generator A302, and described embodiment A312 comprises anti-sparseness filtering device 600, and what it was configured to quantizer 450 to produce carries out filtering through de-quantization narrow-band pumping signal.Figure 19 shows the calcspar of the embodiment A314 of high band excitation generator A302, and described embodiment A314 comprises anti-sparseness filtering device 600, and its frequency spectrum that is configured to that frequency spectrum stretcher A400 is produced extends signal and carries out filtering.Figure 20 shows the calcspar of the embodiment A316 of high band excitation generator A302, and described embodiment A316 comprises anti-sparseness filtering device 600, and it is configured to the output of combiner 490 to carry out filtering to produce high band excitation signal S120.Certainly, expection and this disclose clearly by embodiment A304 and A306 any one feature and any one the embodiment of high band excitation generator A300 of Feature Combination of embodiment A312, A314 and A316.Anti-sparseness filtering device 600 is also configurable in frequency spectrum stretcher A400: for example, after any one of the element 510,520,530 and 540 in frequency spectrum stretcher A402.Pay particular attention to, anti-sparseness filtering device 600 also can be used for the embodiment that execution spectrum folding, frequency spectrum are translated or harmonic wave extends of frequency spectrum stretcher A400.
Anti-sparseness filtering device 600 can be configured to change the phase place of its input signal.For instance, anti-sparseness filtering device 600 may need to be configured and to arrange, and makes the phase place of high band excitation signal S120 along with Timing randomization or alternate manner distribute more equably.The response that may also need anti-sparseness filtering device 600 is frequency spectrum leveling, makes not have sizable change through the amplitude frequency spectrum of filtering signal.In an example, anti-sparseness filtering device 600 is embodied as the all-pass filter with transfer function according to following formula:
H ( z ) = - 0.7 + z - 4 1 - 0.7 z - 4 · 0.6 + z - 6 1 + 0.6 z - 6 . - - - ( 3 )
An effect of this wave filter can be that the energy dissipation of input signal is opened it is no longer only concentrated in several samples.
The sparse illusion causing of code book is conventionally more obvious for the signal of the residual similar noise that comprises less tone information wherein, and also more obvious for the voice in ground unrest.Sparsely in the situation that excitation has long-term structure, conventionally cause less illusion, and in fact phase modification can cause the noise in voiced sound signal.Therefore, may need to configure anti-sparseness filtering device 600 voiceless sound signal carried out to filtering and to make at least some voiced sound signals pass through in the situation that not making change.Voiceless sound signal is characterised in that low pitch (for example gains, quantize the gain of narrow-band self-adaptation code book) and approach zero or be positive spectral tilt (for example, quantize the first reflection coefficient), thus instruction leveling or the acclivitous spectrum envelope along with the continuous increase of frequency.The typical embodiments of anti-sparseness filtering device 600 to voiceless sound (is for example configured to, as indicated in the value of spectral tilt) carry out filtering, when pitch gain is carried out filtering to voiced sound during lower than threshold value (or, be not more than threshold value), and otherwise in the situation that not making change, signal is passed through.
The other embodiments of anti-sparseness filtering device 600 comprise two or more wave filters, and it is configured to have different maximum phase amendment angles (for example,, up to 180 degree).In the case, anti-sparseness filtering device 600 according to pitch gain (for example can be configured to, quantize self-adaptation code book or LTP gain) value in these composition wave filters, select so that by larger maximum phase amendment angle for having compared with the frame of low pitch yield value.The embodiment of anti-sparseness filtering device 600 also can comprise different composition wave filters, it is configured to revise phase place in the part more or less of frequency spectrum, so as by the wave filter that is configured to revise phase place in the wider frequency range of input signal for having compared with the frame of low pitch yield value.
In order to copy exactly encoded voice signal, may need to make the ratio between the synthetic high frequency band of broadband voice signal S100 and the level of narrow-band part to be similar to the described ratio in original broadband voice signal S10.Except the spectrum envelope that high frequency band coding parameter S60a represents, high band encoder A200 also can be configured to characterize high-frequency band signals S30 by fixed time or gain envelope.As shown in figure 10, high band encoder A202 comprises high frequency band gain factor counter A230, it is configured and arranges for example, to calculate one or more gain factors according to the relation between high-frequency band signals S30 and synthetic high-frequency band signals S130 (, difference or the ratio between the energy of described two signals in frame or its certain part).In other embodiment of high band encoder A202, high frequency band gain calculator A230 can similarly configure but change into through arranging to carry out calculated gains envelope according to this time-varying relationship between high-frequency band signals S30 and narrow-band pumping signal S80 or high band excitation signal S120.
The temporal envelope of narrow-band pumping signal S80 and high-frequency band signals S30 is probably similar.Therefore, based on high-frequency band signals S30 and narrow-band pumping signal S80(or the signal of therefrom deriving, for example high band excitation signal S120 or synthetic high-frequency band signals S130) between relation and coding gain envelope conventionally will be than only based on high-frequency band signals S30 and coding gain envelope is more effective.In typical embodiments, high band encoder A202 is configured to be output as the quantization index of 8 to 12 of 5 gain factors of each frame appointment.
High frequency band gain factor counter A230 can be configured to carry out as the task of comprising one or more serial subtasks gain factor and calculate.Figure 21 shows the process flow diagram that calculates the example T200 of the task of the yield value of corresponding subframe according to the relative energy of high-frequency band signals S30 and synthetic high-frequency band signals S130.Task 220a and 220b calculate the energy of the corresponding subframe of each signal.For instance, task 220a and 220b can be configured to by energy be calculated as each subframe sample square and.Task T230 is calculated as the gain factor of subframe the square root of the ratio of those energy.In this example, task T230 is calculated as gain factor the square root of the ratio of the energy of high-frequency band signals S30 in subframe and the energy of synthetic high-frequency band signals S130.
High frequency band gain factor counter A230 may need to be configured to calculate subframe energy according to window function.Figure 22 shows the process flow diagram of this embodiment T210 of gain factor calculation task T200.Window function is applied to high-frequency band signals S30 by task T215a, and task T215b by uniform window function application in synthetic high-frequency band signals S130.The embodiment 222a of task 220a and 220b and 222b calculate the energy of window separately, and task T230 is calculated as the gain factor of subframe the square root of the ratio of energy.
May need the overlapping window function of application and adjacent sub-frames.For instance, can be overlapping-window function of the generation gain factor of phase add mode application can help to reduce or avoid the uncontinuity between subframe.In an example, high frequency band gain factor counter A230 is configured to the trapezoidal window function of application as shown in Figure 23 a, wherein each overlapping one millisecond of window and two adjacent sub-frames.Figure 23 b shows each of five subframes that this window function is applied to 20 milliseconds of frames.Other embodiment of high frequency band gain factor counter A230 can be configured to application and have the window function of negative lap cycle not and/or different windows shape (for example, rectangle, Hamming) (it can be symmetrical or asymmetric).The frame that the embodiment of high frequency band gain factor counter A230 also may be configured to by different windows function application different subframes in frame and/or comprise the subframe with different length.
The example of following value (being not limited to this) as particular is provided.For the frame of one 20 milliseconds of these situation supposition, but can use any other duration.For the high-frequency band signals with 7kHz sampling, each frame has 140 samples.If this frame is divided into five subframes with equal length, each subframe will have 28 samples so, and window as shown in Figure 23 a will be that 42 samples are wide.For the high-frequency band signals with 8kHz sampling, each frame has 160 samples.If this frame is divided into five subframes with equal length, each subframe will have 32 samples so, and window as shown in Figure 23 a will be that 48 samples are wide.In other embodiments, can use the subframe with any width, and even may make the embodiment of high frequency band gain calculator A230 be configured to the gain factor different for each Sample producing of frame.
Figure 24 shows the calcspar of the embodiment B202 of high band decoder B200.High band decoder B202 comprises high band excitation generator B300, and it is configured to produce high band excitation signal S120 based on narrow-band pumping signal S80.Select depending on particular system design, can implement high band excitation generator B300 according to any one of the embodiment of high band excitation generator A300 described herein.Conventionally, high band excitation generator B300 need to be embodied as and there is the response identical with the high band excitation generator of the high band encoder of specific coding system.But, because narrow-band demoder B110 is conventionally by the de-quantization of carrying out encoded narrow-band pumping signal S50, so in most of the cases, high band excitation generator B300 can be embodied as from narrow-band demoder B110 and receive narrow-band pumping signal S80, and does not need to comprise the quantizer being configured to encoded narrow-band pumping signal S50 de-quantization.Narrow-band demoder B110 also can be embodied as the example that comprises anti-sparseness filtering device 600, and it carried out filtering to described signal before arranging with the narrow-band composite filter the narrow-band pumping signal through de-quantization being input to for example wave filter 330.
It is one group of LSF in this example that quantizer 560 is configured to high band filter parameter S 60a() de-quantization, and LSF-LP filter coefficient conversion 570 is configured to LSF to be transformed to one group of filter coefficient (for example,, as the quantizer 240 above with reference to narrowband encoder A122 and conversion 250 are described).In other embodiments, as mentioned above, can use different coefficient sets (for example, cepstrum coefficient) and/or coefficient representation (for example, ISP).High frequency band composite filter B204 is configured to produce synthetic high-frequency band signals according to high band excitation signal S120 and described group of filter coefficient.For system that wherein high band encoder comprises composite filter (for example, in the example of above-mentioned scrambler A202), may need high frequency band composite filter B204 to be embodied as and to there is the response identical with described composite filter (for example, identical transfer function).
High band decoder B202 also comprises the quantizer 580 being configured to high frequency band gain factor S60b de-quantization, with be configured and arrange to be applied to synthetic high-frequency band signals through the gain factor of de-quantization with the gain control element 590(that produces high-frequency band signals S100 for example, multiplier or amplifier).For the situation that wherein the gain envelope of frame is specified by more than one gain factor, gain control element 590 can comprise the logic that is configured to gain factor to be applied to according to window function each subframe, described window function can be for example, with the window function of gain calculator (, the high frequency band gain calculator A230) application by corresponding high band encoder identical or different.In other embodiment of high band decoder B202, gain control element 590 is through configuring similarly but will being applied to narrow-band pumping signal S80 through the gain factor of de-quantization or being applied to high band excitation signal S120 to change into through arrangement.
As mentioned above, may in high band encoder and high band decoder, obtain equal state (for example,, by using through de-quantization value during encoding).Therefore, may be according to guaranteeing in the coded system of this embodiment that the corresponding noise generator in high band excitation generator A300 and B300 has equal state.For instance, the high band excitation generator A300 of this embodiment and B300 can be configured and make the state of noise generator be the information of having encoded in same number of frames (for example, narrow band filter parameter S 40 or its part, and/or encoded narrow-band pumping signal S50 or its part) qualitative function really.
One or more (for example, quantizers 230,420 or 430) in the quantizer of element described herein can be configured to carry out class vector and quantize.For instance, the information that this quantizer can be configured to encode in the same number of frames based in narrow-band channel and/or in high frequency band channel is selected a code book from one group of code book.This technology provides the code efficiency of increase to store extra code book as cost conventionally.
As above discussed referring to for example Fig. 8 and 9, remove rough spectrum envelope from narrow-band voice signal S20 after, quite a large amount of periodic structures may be retained in residual signal.For instance, residual signal can contain rough recurrent pulses or spiking sequence in time.This structure (conventionally relevant with tone) especially likely occurs in voiced speech signal.The calculating of the quantization means form of narrow-band residual signal can comprise according to the model of the long term periodicities that for example, represented by () one or more code books this tone structure of encoding.
The tone structure of actual residual signals may not mated with periodic model completely.For instance, residual signal may comprise the reduced jitter of the location rule of tone pulses, makes in frame the distance between continuous tone pulse not exclusively equate and not suitable rule of described structure.These scramblings tend to reduce code efficiency.
Some embodiments of narrowband encoder A120 be configured to by quantize before or during auto-adaptive time deviation is applied to residual, or by otherwise comprise auto-adaptive time deviation in encoded pumping signal, carry out the regularization of tone structure.For instance, this scrambler can be configured to select or otherwise computing time deviation degree (for example, according to one or more perceptual weightings and/or error minimize standard), the pumping signal of gained and model the best of long term periodicities are fitted.The regularization of tone structure is carried out by the celp coder subgroup that is called lax code exciting lnear predict (RCELP) scrambler.
RCELP scrambler is configured to execution time deviation conventionally as self-adaptation time shift.This time shift can be negative several milliseconds to the just delay of several milliseconds of scopes, and it changes to avoid the uncontinuity that can hear conventionally smoothly.In some embodiments, this scrambler is configured to by segmented mode application rule, and wherein each frame or subframe deviation are fixed time shift accordingly.In other embodiments, scrambler is configured to application rule and is turned to continuous offset difference function, makes frame or subframe according to tone contour (also referred to as tone track) and deviation.In some cases (for example, described in No. 2004/0098255 U.S. Patent Application Publication case), scrambler is configured to by offset applications is comprised to time deviation in the perceptual weighting input signal for calculating encoded pumping signal in encoded pumping signal.
The encoded pumping signal of scrambler computation rule and quantification, and demoder to encoded pumping signal de-quantization with obtain for the synthesis of the pumping signal through decodeing speech signal.Therefore show the delay of the variation identical be included in delay in encoded pumping signal by regularization through decoded output signal.Conventionally, not by the communication of any specified rule amount to demoder.
Regularization often makes residual signal more easily encode, and this has improved from the coding gain of long-term predictor and has therefore advanced overall code efficiency, and conventionally can not produce illusion.May need only to unvoiced frame executing rule.For instance, narrowband encoder A124 can be configured to be only offset those and have frame or the subframe of long-term structure (for example, voiced sound signal).Even may need only to the subframe executing rule that comprises tone pulses energy.The 5th, the various embodiments of RCELP coding have been described in 704, No. 003 United States Patent (USP)s people such as () Kleijn and the 6th, 879, No. 955 United States Patent (USP)s (Rao) and No. 2004/0098255 U.S. Patent Application Publication case people such as () Kovesi.The existing embodiment of RCELP scrambler comprises as the enhancing variable bit rate coder (EVRC) described in the IS-127 of telecommunications industry association (TIA), and third generation partnership relation plan 2(3GPP2) alternative mode vocoder (SMV).
Unfortunately, regularization is for wherein for example, causing some problems from the wideband speech coding device (system that, comprises wideband speech coding device A100 and broadband Voice decoder B100) of encoded narrow-band pumping signal derivation high band excitation.Because high band excitation signal is with respect to the deflection of time deviation signal, so high band excitation signal will have the timetable different from the timetable of original high frequency band voice signal conventionally.In other words, high band excitation signal will no longer be synchronizeed with original high frequency band voice signal.
Temporal misalignment between deviation high band excitation signal and original high frequency band voice signal may cause some problems.For instance, deviation high band excitation signal may be no longer for providing suitable source forcing according to the composite filter of the filter parameter configuration of extracting from original high frequency band voice signal.Therefore, synthetic high-frequency band signals can contain the illusion of hearing reducing through the perceived quality of decoding broadband voice signal.
Temporal misalignment also may cause the poor efficiency of gain envelope coding.As mentioned above, between narrow-band pumping signal S80 and the temporal envelope of high-frequency band signals S30, probably existence is relevant.By according to the gain envelope of the relation coding high-frequency band signals between these two temporal envelope, can realize the raising of code efficiency compared with direct coding gain envelope.But, in the time of encoded narrow-band pumping signal regularization, this relevant may weakening.Temporal misalignment between narrow-band pumping signal S80 and high-frequency band signals S30 can cause occurring fluctuating in high frequency band gain factor S60b, and code efficiency may reduce.
Embodiment comprises the wideband speech coding method to high frequency band voice signal execution time deviation according to the time deviation comprising in corresponding encoded narrow-band pumping signal.The potential advantage of these class methods comprises to be improved through the quality of decoding broadband voice signal and/or the efficiency of improvement coding high frequency band gain envelope.
Figure 25 shows the calcspar of the embodiment AD10 of wideband speech coding device A100.The embodiment A124 that scrambler AD10 comprises narrowband encoder A120, described embodiment A124 is configured to executing rule during calculating encoded narrow-band pumping signal S50.For instance, narrowband encoder A124 can be according to the one or more configurations in RCELP embodiment discussed above.
Narrowband encoder A124 is also configured to output and specifies the regularization data-signal SD10 of the degree of applied time deviation.Be configured to fixing time shift to be applied to for narrowband encoder A124 the various situations of each frame or subframe, regularization data-signal SD10 can comprise a series of values, and it is designated as integer or non integer value taking sample, millisecond or a certain increment At All Other Times as unit by each time shift amount.The time scale that is configured to otherwise to revise frame or other sample sequence for narrowband encoder A124 (for example, by compressing a part and expanding another part) situation, regularization information signal SD10 can comprise the corresponding description to amendment, for example one group of function parameter.In a particular instance, narrowband encoder A124 is configured to the fixing time shift that frame is divided into three subframes and calculates each subframe, makes regularization data-signal SD10 indicate three time shift amounts of each regularization frame of encoded narrow-band signal.
Wideband speech coding device AD10 comprises lag line D120, and it is configured to the some parts that advance or block high frequency band voice signal S30 according to the retardation of being indicated by input signal, thus generation time deviation high frequency band voice signal S30a.In the example shown in Figure 25, lag line D120 is configured to according to carrying out the execution time deviation to high frequency band voice signal S30 by the deviation of regularization data-signal SD10 instruction.In this way, the same time departure comprising in encoded narrow-band pumping signal S50 was also applied to the appropriate section of high frequency band voice signal S30 before analyzing.Although this example is shown as lag line D120 the individual component of high band encoder A200, in other embodiments, lag line D120 is configured to a part for high band encoder.
The other embodiments of high band encoder A200 can be configured to carry out the not spectrum analysis of deviation high frequency band voice signal S30 (for example, lpc analysis), and before calculating high frequency band gain parameter S60b, carry out the time deviation of high frequency band voice signal S30.This scrambler can be including (for example) the embodiment of lag line D120 that is configured to execution time deviation.But, in such cases, based on describing the high band filter parameter S 60a of the not analysis of deviation signal S30 and the spectrum envelope of high band excitation signal S120 misalignment in time.
Lag line D120 can be according to being suitable for that required time biased operation is applied to the logic element of high frequency band voice signal S30 and any combination of memory element configures.For instance, lag line D120 can be configured to from impact damper, read high frequency band voice signal S30 according to required time shift.Figure 26 a shows the schematic diagram of this embodiment D122 of lag line D120, and described lag line D120 comprises shift register SR1.Shift register SR1 is the impact damper with about length m that is configured to m the most recent sample that receives and store high frequency band voice signal S30.Value m at least equals just (or " propelling ") and the summation of bearing (or " retardance ") time shift of the maximum of supporting.Value m equals the frame of high-frequency band signals S30 or the length of subframe may be more convenient.
Lag line D122 is configured to the deviation post OL output time deviation high-frequency band signals S30a from shift register SR1.The location of deviation post OL changes near reference position (zero time shift) according to the current time shift by for example regularization data-signal SD10 instruction.Lag line D122 can be configured to support equal propelling and retardance restriction, or a restriction is greater than another restriction, and making can be in one direction than carry out larger skew on other direction.Figure 26 a shows that the positive time shift of supporting is greater than the particular instance of negative time shift.Lag line D122 can be configured to once export one or more samples (for example, depending on output bus width).
The regularization time shift with the value that is greater than several milliseconds can cause the illusion of hearing in decoded signal.Conventionally, the value of the regularization time shift of being carried out by narrowband encoder A124 will be no more than several milliseconds, make the time shift of being indicated by regularization data-signal SD10 by limited.But, may need in such cases lag line D122 to be configured to align and/or negative direction on time shift force maximum constraints (for example,, to follow the more strict restriction of restriction of forcing than narrowband encoder).
Figure 26 b shows the schematic diagram of the embodiment D124 of lag line D122, and lag line D122 comprises displacement window SW.In this example, the location of the deviation post OL window SW that is shifted limits.Be greater than the situation of the width of displacement window SW although Figure 26 b shows buffer length m, lag line D124 also can equal m through the width of the window SW that implements to make to be shifted.
In other embodiments, lag line D120 is configured to, according to required time shift, high frequency band voice signal S30 is written to impact damper.Figure 27 shows the schematic diagram of the embodiment D130 of lag line D120, and described embodiment D130 comprises and is configured to receive and two shift register SR2 and the SR3 of storage high frequency band voice signal S30.Lag line D130 is configured to according to for example by the time shift of regularization data-signal SD10 instruction, the frame from shift register SR2 or subframe being written to shift register SR3.Shift register SR3 is configured to fifo buffer, and it is configured to output time deviation high-frequency band signals S30a.
In the particular instance shown in Figure 27, shift register SR2 comprises frame buffer part FB1 and delay buffer part DB, and shift register SR3 comprises frame buffer part FB2, advances bumper portion AB and retardance bumper portion RB.Advance the length of impact damper AB and retardance impact damper RB to equate, or wherein one can be greater than another one, makes the skew in a supported direction be greater than the skew on supported other direction.Delay buffer DB and retardance bumper portion RB can be configured to have equal length.Or, the comparable retardance impact damper of delay buffer DB RB is short transfers to the shift register SR3 required time interval by sample from frame buffer FB1 to consider, described transfer can comprise other processing operation that for example first made sample bias before storing shift register SR3 into.
In the example of Figure 27, frame buffer FB1 is configured to have the length equal in length with a frame of high-frequency band signals S30.In another example, frame buffer FB1 is configured to have and the length equal in length of a subframe of high-frequency band signals S30.In the case, lag line D130 can be configured to comprise for example, logic for identical (, average) being postponed to all subframes that are applied to frame to be offset.Lag line D130 also can comprise the logic for the value to be rewritten with blocking impact damper RB or propelling impact damper AB of the value from frame buffer FB1 averaged.In another example, shift register SR3 can be configured to only receive via frame buffer FB1 the value of high-frequency band signals S30, and in the case, lag line D130 can comprise the logic for carrying out interpolation on the gap between the successive frame or the subframe that are written to shift register SR3.In other embodiments, lag line D130 can be configured to before being written to shift register SR3 from the sample of frame buffer FB1, described sample implementation deviation to be operated to (for example,, according to the function of being described by regularization data-signal SD10).
Lag line D120 may need to apply based on but not be equal to the time deviation by the deviation of regularization data-signal SD10 appointment.Figure 28 shows the calcspar of the embodiment AD12 of wideband speech coding device AD10, and wideband speech coding device AD10 comprises length of delay mapper D110.It will be through mapping length of delay SD10a by the Preference-Deviation Mapping of regularization data-signal SD10 instruction that length of delay mapper D110 is configured to.Lag line D120 is configured to according to carrying out generation time deviation high frequency band voice signal S30a by the deviation of indicating through mapping length of delay SD10a.
Can expect that the time shift of narrowband encoder application makes progress in time smoothly.Therefore, conventionally computing voice is applied to the average narrow-band time shift of subframe image duration and is offset the respective frame of high frequency band voice signal S30 according to this mean value enough.In this type of example, length of delay mapper D110 is configured to the mean value of the subframe delay value of calculating each frame, and lag line D120 is configured to the mean value calculating to be applied to the respective frame of high-frequency band signals S30.In other example, for example can calculate and apply, for example, compared with the mean value in short period (, two subframes, or half frame) or longer cycle (, two frames).The non integer value that is sample at mean value, length of delay mapper D110 can be configured to before described value is outputed to lag line D120, described value is rounded to the integer number of sample.
Narrowband encoder A124 can be configured to the regularization time shift of the sample that comprises non-integer number in encoded narrow-band pumping signal.In the case, length of delay mapper D110 may need to be configured to narrow-band time shift to be rounded to the integer number of sample, and lag line D120 may need to be applied to high frequency band voice signal S30 through the time shift rounding up.
In some embodiments of wideband speech coding device AD10, narrow-band voice signal S20 may be different from the sampling rate of high frequency band voice signal S30.In such cases, length of delay mapper D110 can be configured to regulate the time shift amount of indicating in regularization data-signal SD10, to consider narrow-band voice signal S20(or narrow-band pumping signal S80) and the sampling rate of high frequency band voice signal S30 between difference.For instance, length of delay mapper D110 can be configured to the ratio convergent-divergent time shift amount according to sampling rate.In a particular instance mentioned above, with 8kHz, narrow-band voice signal S20 is sampled, and with 7kHz, high frequency band voice signal S30 is sampled.In the case, length of delay mapper D110 is configured to each side-play amount to be multiplied by 7/8.The embodiment of length of delay mapper D110 also can be configured to carry out this convergent-divergent computing and integer described herein rounds up and/or time shift average calculating operation.
In other embodiments, lag line D120 is configured to otherwise revise the time scale (for example,, by compressing a part and expanding another part) of frame or other sample sequence.For instance, narrowband encoder A124 can be configured to carry out executing rule according to the function of for example tone contour or track.In the case, regularization data-signal SD10 can comprise the corresponding description (for example one group of parameter) to described function, and lag line D120 can comprise the logic that is configured to according to the described function frame to high frequency band voice signal S30 or subframe implementation deviation.In other embodiments, length of delay mapper D110 be configured to before described function is applied to high frequency band voice signal S30 by lag line D120 to described function average, convergent-divergent and/or round up.For instance, length of delay mapper D110 can be configured to calculate one or more length of delays according to described function, each length of delay instruction number of samples, it is then applied with one or more respective frame to high frequency band voice signal S30 or subframe execution time deviation by lag line D120.
Figure 29 shows the process flow diagram of the method MD100 to high frequency band voice signal execution time deviation according to the time deviation comprising in corresponding encoded narrow-band pumping signal.Task TD100 processes broadband voice signal to obtain narrow-band voice signal and high frequency band voice signal.For instance, task TD100 can be configured to use the bank of filters (for example embodiment of bank of filters A110) with low-pass filter and Hi-pass filter to carry out filtering to broadband voice signal.Narrow-band voice signal is at least encoded to encoded narrow-band pumping signal and multiple narrow band filter parameter by task TD200.Described encoded narrow-band pumping signal and/or filter parameter can quantize, and encoded narrow-band pumping signal also can comprise other parameter of for example speech pattern parameter.Task TD200 also comprises the time deviation in encoded narrow-band pumping signal.
Task TD300 produces high band excitation signal based on narrow-band pumping signal.In the case, the narrow-band pumping signal of narrow-band pumping signal based on encoded.High frequency band voice signal is at least encoded to multiple high band filter parameters by task TD400.For instance, can be configured to high frequency band speech signal coding be multiple quantification LSF to task TD400.Time shift is applied to high frequency band voice signal by task TD500, the information of described time shift based on relevant with the time deviation comprising in encoded narrow-band pumping signal.
Task TD400 can be configured to high frequency band voice signal to carry out spectrum analysis (for example, lpc analysis), and/or calculates the gain envelope of high frequency band voice signal.In such cases, task TD500 can be configured to, before described analysis and/or the calculating of gain envelope, time shift is applied to high frequency band voice signal.
Other embodiment of wideband speech coding device A100 is configured to the time deviation of the high band excitation signal S120 being caused by the time deviation comprising in encoded narrow-band pumping signal to reverse.For instance, high band excitation generator A300 can be through implementing to comprise the embodiment of lag line D120, the described embodiment of lag line D120 is configured to receive regularization data-signal SD10 or through mapping length of delay SD10a, and the time shift of reversing is accordingly applied to narrow-band pumping signal S80, and/or be applied to the signal subsequently (for example, harmonic wave extends signal S160 or high band excitation signal S120) based on described narrow-band pumping signal S80.
Other wideband speech coding device embodiment can be configured to independently of one another narrow-band voice signal S20 and high frequency band voice signal S30 be encoded, and makes high frequency band voice signal S30 be encoded as the representation of high frequency band spectrum envelope and high band excitation signal.This embodiment can be configured to the basis information relevant with the time deviation comprising in encoded narrow-band pumping signal to high frequency band residual signal execution time deviation, or otherwise time deviation is included in encoded high band excitation signal.For instance, high band encoder can comprise the embodiment that is configured to time deviation to be applied to lag line D120 and/or the length of delay mapper D110 of high frequency band residual signal described herein.The potential advantage of this operation comprise to high frequency band residual signal compared with efficient coding, and better coupling between synthesis of narrow frequency band and high frequency band voice signal.
As mentioned above, embodiment described herein comprises and can be used for carrying out the compatible of embedded encoded embodiment, support and narrow band system and avoid needing code conversion.The support of high frequency band coding also be can be used on cost distinguishing and there is chip, chipset, device and/or the network of broadband support and backward compatibility and only there is chip, chipset, device and/or the network that narrow-band is supported.As described herein to the support of high frequency band coding also can be combined with for the technology of supporting low-frequency band coding, and according to the system of this embodiment, method or equipment can support to for example approximately 50 or 100Hz until approximately 7 or the coding of the frequency component of 8kHz.
As mentioned above, add high frequency band support to speech coder and can improve sharpness, especially about the sharpness of fricative differentiation.Although this differentiation may be derived according to specific context by human listener conventionally, high frequency band support can be served as the feature of enabling of speech recognition and other machine decipher application system of automated voice menu navigation and/or automatic call processing (for example for).
For example can be embedded into, in portable radio communication device (, cellular phone or PDA(Personal Digital Assistant)) according to the equipment of an embodiment.Or this equipment can be included in another communicator, for example VoIP mobile phone, be configured to support the personal computer of VoIP communication or be configured to routing telephone or the network equipment of VoIP communication.For instance, may be implemented in the chip or chipset of communicator according to the equipment of an embodiment.Depending on application-specific, this device also can comprise for example following characteristics: the analog to digital to voice signal and/or digital-to-analog conversion, for being carried out, amplifies and/or the circuit of other signal processing operations voice signal, and/or for launching and/or receive the radio circuit of encoded voice signal.
Clearly expection and announcement embodiment can comprise the 60/667th, No. 901 and the 60/673rd, more than any one in the further feature disclosing in No. 965 U.S. Provisional Patent Application cases or one and/or therewith, use, in the application's case, advocate the rights and interests of described temporary patent application case.This category feature comprises removal and betides the non-existent high-energy burst with the short duration substantially in high frequency band and in narrow-band.Fixing or the adaptive smooth of the coefficient representation that this category feature comprises for example high frequency band LSF.Fixing or the self-adaptation that this category feature comprises the noise being associated with the quantification of the coefficient representation of for example LSF is shaped.This category feature also comprises the fixing or adaptive smooth of gain envelope, and the adaptive attenuation of gain envelope.
Provide the above introduction to described embodiment to make those skilled in the art can manufacture or use the present invention.May make various amendments to these embodiment, and General Principle provided herein also can be applicable to other embodiment.For instance, embodiment can be embodied as to a part or whole part hard-wired circuit, be embodied as the Circnit Layout being fabricated onto in special IC, or be embodied as machine readable code and be loaded into the firmware program in Nonvolatile memory devices or load or be loaded into the software program data storage medium from data storage medium, described code is the instruction that can be carried out by the array of logic elements of for example microprocessor or other digital signal processing unit.Data storage medium can be memory element array, for example semiconductor memory (it can comprise (being not limited to) dynamically or static RAM (SRAM) (random access memory), ROM(ROM (read-only memory)) and/or quick flashing RAM), or ferroelectric, magnetic resistance, two-way switch semiconductor, polymkeric substance or phase transition storage; Or the disc type media of for example disk or CD.Any one or more than one instruction group or sequence that term " software " is interpreted as comprising source code, assembly language code, machine code, binary code, firmware, macrocode, microcode, can be carried out by array of logic elements, and any combination of this type of example.
The various elements of the embodiment of high band excitation generator A300 and B300, high band encoder A200, high band decoder B200, wideband speech coding device A100 and broadband Voice decoder B100 can be embodied as (for example) and reside on electronics and/or the optical devices on the same chip in chipset or between two or more chips, but also expection exists other configuration that there is no this restriction.One or more elements of this equipment can be embodied as one or more instruction groups in whole or in part, described instruction group be configured to one or more fix or programmable logic element (for example, transistor, door) carry out on array, described element is for example microprocessor, embedded processor, the IP kernel heart, digital signal processor, FPGA(field programmable gate array), ASSP(Application Specific Standard Product) and ASIC(special IC).One or more these class components also (for example may have common structure, for carrying out at different time corresponding to the processor of the code section of different elements, through carrying out to carry out the instruction group corresponding to the task of different elements at different time, or the configuration for electronics and/or the optical devices of different elements executable operations at different time).In addition, one or more these class components may be used for carrying out the task not directly related with the operation of equipment or other instruction group, for example to be embedded with the device of described equipment or system another operate relevant task.
Figure 30 shows the process flow diagram to the method M100 that has the described highband part of voice signal of narrow-band part and highband part and encode according to an embodiment.One group of filter parameter of the spectrum envelope of task X100 computational representation highband part.Task X200 calculates frequency spectrum extension signal by nonlinear function being applied to the signal of deriving from narrow-band part.Task X300 basis (A) described group of filter parameter and (B) high band excitation signal based on described frequency spectrum extension signal produce synthetic high-frequency band signals.Relation between the energy of the energy of task X400 based on (C) highband part and (D) signal of deriving from narrow-band part is carried out calculated gains envelope.
Figure 31 a shows the process flow diagram that produces the method M200 of high band excitation signal according to an embodiment.Task Y100 calculates through harmonic wave extension signal by nonlinear function being applied to the narrow-band pumping signal deriving from the narrow-band part of voice signal.Task Y200 will extend signal and mix to produce high band excitation signal through zoop signal through harmonic wave.Figure 31 b shows the process flow diagram that produces the method M210 of high band excitation signal according to another embodiment that comprises task Y300 and Y400.Task Y300 calculates temporal envelope according to the energy in time of narrow-band pumping signal and the one in harmonic wave extension signal.Task Y400 according to temporal envelope zoop signal with produce through zoop signal.
Figure 32 shows the process flow diagram to the method M300 that has the described highband part of voice signal of narrow-band part and highband part and decode according to an embodiment.Task Z100 receives one group of filter parameter of the spectrum envelope that characterizes described highband part and characterizes one group of gain factor of the temporal envelope of described highband part.Task Z200 calculates frequency spectrum extension signal by nonlinear function being applied to the signal of deriving from narrow-band part.Task Z300 basis (A) described group of filter parameter and (B) high band excitation signal based on described frequency spectrum extension signal produce synthetic high-frequency band signals.Task Z400 modulates the gain envelope of described synthetic high-frequency band signals based on described group of gain factor.For instance, task Z400 can be configured to by described group of gain factor is applied to from narrow-band part derive pumping signal, be applied to frequency spectrum extend signal, be applied to high band excitation signal, or be applied to synthetic high-frequency band signals, modulate the gain envelope of described synthetic high-frequency band signals.
Embodiment also comprises as herein (for example) by additional voice decoding as described in the description that is configured to the structure embodiment that carries out additional voice decoding, Code And Decode method is clearly disclosed, Code And Decode method.Each of these methods also (for example can positively be implemented, as one or more data storage mediums of above enumerating in) be one or more instruction groups that can for example, read and/or carry out by the machine that comprises logic element (, processor, microprocessor, microcontroller or other finite state machine) array.Therefore, the present invention, without wishing to be held to the embodiment showing, but should meet with herein principle and the consistent widest range of novel feature that (in the appended claims of a part that comprises submitted to the original disclosure of formation) discloses by any way above.

Claims (19)

1. a signal processing method, described method comprises:
The low frequency part of voice signal is encoded to at least one encoded narrow-band pumping signal and multiple narrow band filter parameter;
Produce high band excitation signal based on described encoded narrow-band pumping signal; And
The high-frequency part of described voice signal is encoded to at least multiple high band filter parameters, and according to the encode gain envelope of described high-frequency part of the relation between described high-frequency part and described high band excitation signal,
Wherein said encoded narrow-band pumping signal is described according to time dependent time deviation and with respect to the described voice signal signal of deviation in time, and
Corresponding multiple continuous parts in time that wherein said method comprises that multiple different time shifts are applied to described high-frequency part by information based on relevant from described time deviation, and
Wherein before the gain envelope of the described high-frequency part of described coding, carry out the multiple different time shifts of described application.
2. signal processing method according to claim 1, wherein said encoded narrow-band pumping signal is described according to the model of the tone structure of described low frequency part and the signal of deviation in time.
3. signal processing method according to claim 2, it is residual that time shift is applied to described narrow-band by the model that wherein said coding low frequency part comprises the tone structure residual according to narrow-band,
The narrow-band of wherein said encoded narrow-band pumping signal after based on time shift is residual.
4. signal processing method according to claim 3, is wherein saidly applied to residual each that different corresponding time shifts is applied to at least two residual continuous subframes of described narrow-band that comprises of described narrow-band by time shift, and
Wherein saidly time shift is applied to described high-frequency part comprises the frame that the time shift of the mean value based on described corresponding time shift is applied to described high-frequency part.
5. signal processing method according to claim 3, the multiple different time shifts of wherein said application comprise that receiving instruction is applied to the value of the residual time shift of described narrow-band, and the value of described reception is rounded to round values.
6. signal processing method according to claim 1 was wherein carried out the multiple different time shifts of described application before the described high-frequency part of described coding.
7. signal processing method according to claim 1, is wherein saidly encoded at least multiple high band filter parameters by described high-frequency part and comprises described high-frequency part is encoded to at least multiple coefficient of linear prediction wave filter.
8. signal processing method according to claim 1, the multiple different time shifts of wherein said application comprise according to the ratio between described low frequency part and the sampling rate of described high-frequency part calculates at least one of described multiple different time shifts.
9. for an equipment for signal processing, described equipment comprises:
Narrow-band speech coder, it is configured to the low frequency part of voice signal to be encoded at least one encoded narrow-band pumping signal and multiple narrow band filter parameter; And
High frequency band speech coder, it is configured to produce high band excitation signal based on described encoded narrow-band pumping signal;
Wherein said high frequency band speech coder is configured to the high-frequency part of described voice signal to be encoded at least multiple high band filter parameters, and
Wherein said narrow-band speech coder is configured to export regularization data-signal, and described regularization data-signal is described with respect to described voice signal temporal evolution and is included in the time deviation in described encoded narrow-band pumping signal, and
Wherein said equipment comprises lag line, corresponding multiple continuous parts in time that described lag line is configured to multiple different time shifts to be applied to described high-frequency part, and wherein said multiple different time shifts are based on described regularization data-signal, and
Wherein said high frequency band speech coder is configured to come according to the relation between described high-frequency part and described high band excitation signal the gain envelope of the described high-frequency part that lag line produces described in coding.
10. equipment according to claim 9, wherein said encoded narrow-band pumping signal is described according to the model of the tone structure of described low frequency part and the signal of deviation in time.
11. equipment according to claim 9, it is residual that time shift is applied to described narrow-band by the model that wherein said narrow-band speech coder is configured to the tone structure residual according to narrow-band, and the described encoded narrow-band pumping signal of the residual generation of narrow-band based on after time shift.
12. equipment according to claim 11, wherein said narrow-band speech coder is configured to different corresponding time shifts to be applied to each of at least two residual continuous subframes of described narrow-band, and
Wherein said lag line is configured to the time shift of the mean value based on described corresponding time shift to be applied to the frame of described high-frequency part.
13. equipment according to claim 11, described equipment comprises length of delay mapper, described length of delay mapper is configured to receive instruction and is applied to the value of the residual time shift of described narrow-band, and the value of described reception is rounded to round values.
14. equipment according to claim 9, wherein said high frequency band speech coder is configured to the described high-frequency part that lag line produces described in coding.
15. equipment according to claim 9, wherein said high frequency band speech coder is configured to described high-frequency part to be encoded at least multiple coefficient of linear prediction wave filter.
16. equipment according to claim 9, described equipment comprises length of delay mapper, and described length of delay mapper is configured to calculate at least one of described multiple different time shifts according to the ratio between described low frequency part and the sampling rate of described high-frequency part.
17. equipment according to claim 9, described equipment comprises cellular phone.
18. 1 kinds of equipment for signal processing, described equipment comprises:
For the low frequency part of voice signal being encoded to the device of at least one encoded narrow-band pumping signal and multiple narrow band filter parameters;
For produce the device of high band excitation signal based on described encoded narrow-band pumping signal; And
For the high-frequency part of described voice signal being encoded to the device of at least multiple high band filter parameters, wherein said encoded narrow-band pumping signal is described according to time dependent time deviation and with respect to the described voice signal signal of deviation in time, and
Wherein said equipment comprises the corresponding multiple devices of continuous part in time that for the information based on relevant from described time deviation, multiple different time shifts are applied to described high-frequency part, and
The wherein said device for the described high-frequency part of encoding is configured to according to carry out the gain envelope of coding for the described high-frequency part applying the device of multiple different time shifts and produce to the relation between described high-frequency part and described high band excitation signal.
19. equipment according to claim 18, described equipment comprises cellular phone.
CN200680018212.6A 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband time warping Active CN101185126B (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US66790105P 2005-04-01 2005-04-01
US60/667,901 2005-04-01
US67396505P 2005-04-22 2005-04-22
US60/673,965 2005-04-22
PCT/US2006/012232 WO2006107838A1 (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband time warping

Publications (2)

Publication Number Publication Date
CN101185126A CN101185126A (en) 2008-05-21
CN101185126B true CN101185126B (en) 2014-08-06

Family

ID=39406063

Family Applications (8)

Application Number Title Priority Date Filing Date
CN2006800181496A Active CN101180677B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for wideband speech coding
CN2006800182696A Active CN101185120B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband burst suppression
CN2006800181405A Active CN101180676B (en) 2005-04-01 2006-04-03 Methods and apparatus for quantization of spectral envelope representation
CN200680018212.6A Active CN101185126B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband time warping
CN2006800183519A Active CN101184979B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband excitation generation
CN200680018213.0A Active CN101185127B (en) 2005-04-01 2006-04-03 Methods and apparatus for coding and decoding highband part of voice signal
CN2006800182709A Active CN101185124B (en) 2005-04-01 2006-04-03 Method and apparatus for dividing frequency band coding of voice signal
CN2006800183538A Active CN101185125B (en) 2005-04-01 2006-04-03 Methods and apparatus for anti-sparseness filtering of spectrally extended voice prediction excitation signal

Family Applications Before (3)

Application Number Title Priority Date Filing Date
CN2006800181496A Active CN101180677B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for wideband speech coding
CN2006800182696A Active CN101185120B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband burst suppression
CN2006800181405A Active CN101180676B (en) 2005-04-01 2006-04-03 Methods and apparatus for quantization of spectral envelope representation

Family Applications After (4)

Application Number Title Priority Date Filing Date
CN2006800183519A Active CN101184979B (en) 2005-04-01 2006-04-03 Systems, methods, and apparatus for highband excitation generation
CN200680018213.0A Active CN101185127B (en) 2005-04-01 2006-04-03 Methods and apparatus for coding and decoding highband part of voice signal
CN2006800182709A Active CN101185124B (en) 2005-04-01 2006-04-03 Method and apparatus for dividing frequency band coding of voice signal
CN2006800183538A Active CN101185125B (en) 2005-04-01 2006-04-03 Methods and apparatus for anti-sparseness filtering of spectrally extended voice prediction excitation signal

Country Status (3)

Country Link
CN (8) CN101180677B (en)
ES (3) ES2351935T3 (en)
UA (6) UA94041C2 (en)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2006232361B2 (en) * 2005-04-01 2010-12-23 Qualcomm Incorporated Methods and apparatus for encoding and decoding an highband portion of a speech signal
CN101620854B (en) * 2008-06-30 2012-04-04 华为技术有限公司 Method, system and device for frequency band expansion
CN101964690B (en) * 2009-07-22 2012-07-04 联芯科技有限公司 HARQ merged decoding method, device and system
CN102044250B (en) * 2009-10-23 2012-06-27 华为技术有限公司 Band spreading method and apparatus
CN102812512B (en) * 2010-03-23 2014-06-25 Lg电子株式会社 Method and apparatus for processing an audio signal
CN102610231B (en) 2011-01-24 2013-10-09 华为技术有限公司 Method and device for expanding bandwidth
MX339764B (en) * 2011-02-18 2016-06-08 Ntt Docomo Inc Speech decoder, speech encoder, speech decoding method, speech encoding method, speech decoding program, and speech encoding program.
US9070361B2 (en) * 2011-06-10 2015-06-30 Google Technology Holdings LLC Method and apparatus for encoding a wideband speech signal utilizing downmixing of a highband component
EP2774145B1 (en) * 2011-11-03 2020-06-17 VoiceAge EVS LLC Improving non-speech content for low rate celp decoder
CN102543091B (en) * 2011-12-29 2014-12-24 深圳万兴信息科技股份有限公司 System and method for generating simulation sound effect
WO2013124445A2 (en) * 2012-02-23 2013-08-29 Dolby International Ab Methods and systems for efficient recovery of high frequency audio content
CN104321814B (en) * 2012-05-23 2018-10-09 日本电信电话株式会社 Frequency domain pitch period analysis method and frequency domain pitch period analytical equipment
CN103928031B (en) 2013-01-15 2016-03-30 华为技术有限公司 Coding method, coding/decoding method, encoding apparatus and decoding apparatus
CN103971693B (en) * 2013-01-29 2017-02-22 华为技术有限公司 Forecasting method for high-frequency band signal, encoding device and decoding device
US9728200B2 (en) * 2013-01-29 2017-08-08 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for adaptive formant sharpening in linear prediction coding
US9601125B2 (en) * 2013-02-08 2017-03-21 Qualcomm Incorporated Systems and methods of performing noise modulation and gain adjustment
US9711156B2 (en) * 2013-02-08 2017-07-18 Qualcomm Incorporated Systems and methods of performing filtering for gain determination
EP2830055A1 (en) 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Context-based entropy coding of sample values of a spectral envelope
EP2830065A1 (en) 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for decoding an encoded audio signal using a cross-over filter around a transition frequency
US9620134B2 (en) * 2013-10-10 2017-04-11 Qualcomm Incorporated Gain shape estimation for improved tracking of high-band temporal characteristics
US10083708B2 (en) * 2013-10-11 2018-09-25 Qualcomm Incorporated Estimation of mixing factors to generate high-band excitation signal
US9384746B2 (en) * 2013-10-14 2016-07-05 Qualcomm Incorporated Systems and methods of energy-scaled signal processing
US9293143B2 (en) * 2013-12-11 2016-03-22 Qualcomm Incorporated Bandwidth extension mode selection
US20150170655A1 (en) * 2013-12-15 2015-06-18 Qualcomm Incorporated Systems and methods of blind bandwidth extension
US10163447B2 (en) * 2013-12-16 2018-12-25 Qualcomm Incorporated High-band signal modeling
CN103714822B (en) * 2013-12-27 2017-01-11 广州华多网络科技有限公司 Sub-band coding and decoding method and device based on SILK coder decoder
US9984699B2 (en) * 2014-06-26 2018-05-29 Qualcomm Incorporated High-band signal coding using mismatched frequency ranges
EP2980798A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Harmonicity-dependent controlling of a harmonic filter tool
CN104143335B (en) 2014-07-28 2017-02-01 华为技术有限公司 audio coding method and related device
US9595269B2 (en) * 2015-01-19 2017-03-14 Qualcomm Incorporated Scaling for gain shape circuitry
US10847170B2 (en) * 2015-06-18 2020-11-24 Qualcomm Incorporated Device and method for generating a high-band signal from non-linearly processed sub-ranges
PT3443557T (en) 2016-04-12 2020-08-27 Fraunhofer Ges Forschung Audio encoder for encoding an audio signal, method for encoding an audio signal and computer program under consideration of a detected peak spectral region in an upper frequency band
ES2821141T3 (en) 2016-12-16 2021-04-23 Ericsson Telefon Ab L M Method and encoder for handling envelope representation coefficients
US10825467B2 (en) * 2017-04-21 2020-11-03 Qualcomm Incorporated Non-harmonic speech detection and bandwidth extension in a multi-source environment
US10431231B2 (en) * 2017-06-29 2019-10-01 Qualcomm Incorporated High-band residual prediction with time-domain inter-channel bandwidth extension
TWI723545B (en) * 2019-09-17 2021-04-01 宏碁股份有限公司 Speech processing method and device thereof
CN111402907B (en) * 2020-03-13 2023-04-18 大连理工大学 G.722.1-based multi-description speech coding method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1300833A2 (en) * 2001-10-04 2003-04-09 AT&T Corp. A method of bandwidth extension for narrow-band speech
CN1470052A (en) * 2000-10-18 2004-01-21 ��˹��ŵ�� High frequency intensifier coding for bandwidth expansion speech coder and decoder
US6732070B1 (en) * 2000-02-16 2004-05-04 Nokia Mobile Phones, Ltd. Wideband speech codec using a higher sampling rate in analysis and synthesis filtering than in excitation searching
CN1498396A (en) * 2002-01-30 2004-05-19 ���µ�����ҵ��ʽ���� Audio coding and decoding equipment and method thereof

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4805193A (en) * 1987-06-04 1989-02-14 Motorola, Inc. Protection of energy information in sub-band coding
US5455888A (en) * 1992-12-04 1995-10-03 Northern Telecom Limited Speech bandwidth extension method and apparatus
EP0732687B2 (en) * 1995-03-13 2005-10-12 Matsushita Electric Industrial Co., Ltd. Apparatus for expanding speech bandwidth
US6097824A (en) * 1997-06-06 2000-08-01 Audiologic, Incorporated Continuous frequency dynamic range audio compressor
FI113571B (en) * 1998-03-09 2004-05-14 Nokia Corp speech Coding
EP1126620B1 (en) * 1999-05-14 2005-12-21 Matsushita Electric Industrial Co., Ltd. Method and apparatus for expanding band of audio signal
US6393394B1 (en) * 1999-07-19 2002-05-21 Qualcomm Incorporated Method and apparatus for interleaving line spectral information quantization methods in a speech coder
JP4792613B2 (en) * 1999-09-29 2011-10-12 ソニー株式会社 Information processing apparatus and method, and recording medium
DE60019268T2 (en) * 1999-11-16 2006-02-02 Koninklijke Philips Electronics N.V. BROADBAND AUDIO TRANSMISSION SYSTEM
WO2001052241A1 (en) * 2000-01-11 2001-07-19 Matsushita Electric Industrial Co., Ltd. Multi-mode voice encoding device and decoding device
US6704711B2 (en) * 2000-01-28 2004-03-09 Telefonaktiebolaget Lm Ericsson (Publ) System and method for modifying speech signals
US6947888B1 (en) * 2000-10-17 2005-09-20 Qualcomm Incorporated Method and apparatus for high performance low bit-rate coding of unvoiced speech
EP1351401B1 (en) * 2001-07-13 2009-01-14 Panasonic Corporation Audio signal decoding device and audio signal encoding device
DE60208426T2 (en) * 2001-11-02 2006-08-24 Matsushita Electric Industrial Co., Ltd., Kadoma DEVICE FOR SIGNAL CODING, SIGNAL DECODING AND SYSTEM FOR DISTRIBUTING AUDIO DATA
EP1374230B1 (en) * 2001-11-14 2006-06-21 Matsushita Electric Industrial Co., Ltd. Audio coding and decoding
CN100395817C (en) * 2001-11-14 2008-06-18 松下电器产业株式会社 Encoding device and decoding device
KR100446242B1 (en) * 2002-04-30 2004-08-30 엘지전자 주식회사 Apparatus and Method for Estimating Hamonic in Voice-Encoder
KR100723753B1 (en) * 2002-08-01 2007-05-30 마츠시타 덴끼 산교 가부시키가이샤 Audio decoding apparatus and audio decoding method based on spectral band replication
CN1186765C (en) * 2002-12-19 2005-01-26 北京工业大学 Method for encoding 2.3kb/s harmonic wave excidted linear prediction speech
FI118550B (en) * 2003-07-14 2007-12-14 Nokia Corp Enhanced excitation for higher frequency band coding in a codec utilizing band splitting based coding methods
CN1598926A (en) * 2003-09-16 2005-03-23 株式会社东芝 Audio coding method and equipment with noise restaining

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6732070B1 (en) * 2000-02-16 2004-05-04 Nokia Mobile Phones, Ltd. Wideband speech codec using a higher sampling rate in analysis and synthesis filtering than in excitation searching
CN1470052A (en) * 2000-10-18 2004-01-21 ��˹��ŵ�� High frequency intensifier coding for bandwidth expansion speech coder and decoder
EP1300833A2 (en) * 2001-10-04 2003-04-09 AT&T Corp. A method of bandwidth extension for narrow-band speech
CN1498396A (en) * 2002-01-30 2004-05-19 ���µ�����ҵ��ʽ���� Audio coding and decoding equipment and method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Mikko Tammi et al..CODING DISTORTION CAUSED BY A PHASE DIFFERENCE BETWEEN THE LP FILTER AND ITS RESIDUAL.《1999 IEEE Workshop on Speech Coding Proceedings》.1999,102-104. *

Also Published As

Publication number Publication date
CN101185120A (en) 2008-05-21
CN101184979B (en) 2012-04-25
UA95776C2 (en) 2011-09-12
CN101185126A (en) 2008-05-21
UA92742C2 (en) 2010-12-10
CN101185120B (en) 2012-05-30
CN101185127B (en) 2014-04-23
CN101185125A (en) 2008-05-21
ES2351935T3 (en) 2011-02-14
CN101180677A (en) 2008-05-14
CN101185125B (en) 2012-01-11
CN101180677B (en) 2011-02-09
ES2358125T3 (en) 2011-05-05
CN101184979A (en) 2008-05-21
CN101185124A (en) 2008-05-21
UA93677C2 (en) 2011-03-10
UA92341C2 (en) 2010-10-25
CN101185124B (en) 2012-01-11
CN101185127A (en) 2008-05-21
CN101180676B (en) 2011-12-14
UA94041C2 (en) 2011-04-11
CN101180676A (en) 2008-05-14
UA91853C2 (en) 2010-09-10
ES2350494T3 (en) 2011-01-24

Similar Documents

Publication Publication Date Title
CN101185126B (en) Systems, methods, and apparatus for highband time warping
CN102411935B (en) Method and apparatus of anti-sparseness filtering for wideband extension speech predication excitation signal
CN102110440B (en) System, method, and apparatus for gain factor attenuation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1114685

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1114685

Country of ref document: HK