US20080071552A1 - Sound encoder and sound decoder - Google Patents
Sound encoder and sound decoder Download PDFInfo
- Publication number
- US20080071552A1 US20080071552A1 US11/907,928 US90792807A US2008071552A1 US 20080071552 A1 US20080071552 A1 US 20080071552A1 US 90792807 A US90792807 A US 90792807A US 2008071552 A1 US2008071552 A1 US 2008071552A1
- Authority
- US
- United States
- Prior art keywords
- sound
- code
- codes
- order
- demultiplexing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000005236 sound signal Effects 0.000 claims description 56
- 238000000034 method Methods 0.000 claims description 13
- 238000003672 processing method Methods 0.000 claims 1
- 230000006866 deterioration Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 12
- 230000036039 immunity Effects 0.000 description 5
- 238000013139 quantization Methods 0.000 description 5
- 230000001174 ascending effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/66—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission for reducing bandwidth of signals; for improving efficiency of transmission
- H04B1/667—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission for reducing bandwidth of signals; for improving efficiency of transmission using a division in frequency subbands
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
Definitions
- the present invention relates to a sound encoder that outputs a sound code acquired by compressing a digital sound signal, such as a musical sound or a voice, into a small volume of information, and a sound decoder that decodes the sound code so as to reproduce a sound signal.
- a sound encoder that outputs a sound code acquired by compressing a digital sound signal, such as a musical sound or a voice, into a small volume of information
- a sound decoder that decodes the sound code so as to reproduce a sound signal.
- Most prior art sound encoders acquire a plurality of codes having a small volume of information from a sound signal, and multiplex them into a sound code. Most prior art sound decoders demultiplex the sound code into a plurality of codes and decode them so as to reproduce the sound signal.
- Huffman codes are typical variable length codes having a feature that their code length becomes short when they have a frequently used value and becomes long otherwise.
- FIG. 10 is a block diagram showing the structure of a prior art sound encoder as disclosed in the above-mentioned reference
- FIG. 11 is a block diagram showing the structure of a prior art sound decoder as disclosed in the above-mentioned reference.
- reference numeral 1 denotes an encoding means for encoding a sound signal, which is the target to be coded, so as to produce and output a plurality of codes (i.e., an envelope code and a plurality of band-by-band codes)
- reference numeral 2 denotes a multiplexing unit for multiplexing the plurality of codes output from the encoding means 1 into a multiplexed code and for outputting the multiplexed code as a sound code
- reference numeral 3 denotes a demultiplexing means for accepting the sound code from the sound encoder and for demultiplexing the sound code into the plurality of codes (i.e., the envelope code and the plurality of band-by-band codes)
- reference numeral 4 denotes a decoding means for decoding the plurality of codes demultiplexed by the demultiplexing means 3 so as to reproduce the sound signal.
- the prior art sound encoder performs all processes on a frame-by-frame basis, each frame having a length of 20 ms.
- the encoding means 1 performs a modulated lapped transform (MLT) on the sound signal so as to acquire MLT coefficients and divides these MLT coefficients into a plurality of regions.
- the encoding means 1 calculates a mean value of the MLT coefficients for each region and encodes an amplitude envelope which consists of a plurality of acquired mean values so as to output the coded amplitude envelope as an envelope code.
- MLT modulated lapped transform
- the encoding means 1 then normalizes the MLT coefficients for each region with a value obtained by decoding the envelope code, quantizes the normalized MLT coefficients for each region, and acquires a fixed length code of length which is fixed for each quantization.
- the encoding means 1 Huffman-encodes (variable-length encodes) this fixed length code and outputs the acquired variable length code as each band-by-band code.
- the encoding means 1 further determines and outputs a category code of a fixed length for controlling the quantization stepsize for each region in addition to the envelope code and the plurality of band-by-band codes. However, for simplicity, the detailed explanation of the category code will be omitted hereafter.
- the multiplexing means 2 When the encoding means 1 outputs the envelope code and the plurality of band-by-band codes, the multiplexing means 2 multiplexes them in a fixed order which is provided in advance and outputs the multiplexed result to the sound decoder as a sound code.
- the demultiplexing means 3 of the sound decoder accepts the sound code from the sound encoder and demultiplexes the sound code into a plurality of codes so that they are arranged in the fixed order which is provided in advance and outputs the plurality of codes (i.e., the envelope code and the plurality of band-by-band codes).
- the decoding means 4 When receiving the envelope code and the plurality of band-by-band codes from the demultiplexing means 3 , the decoding means 4 decodes the envelope code so as to calculate an amplitude envelope, decodes the plurality of band-by-band codes so as to calculate normalized frequency domain coefficients. By multiplying the value of the amplitude envelope for each region by the normalized frequency domain coefficients for each region, the decoding means 4 denormalize the frequency domain coefficients and performs an Inverse MLT (IMLT) on the denormalized frequency domain coefficients so as to reproduce a sound signal.
- IMLT Inverse MLT
- FIG. 12 is an explanatory drawing for showing an example of the amplitude envelope generated by the prior art sound encoder.
- the horizontal axis indicates the frequency and the vertical axis indicate the value, i.e., envelope value of the amplitude envelope for each region.
- the total frequency region of the sound signal which is the target to be coded is divided into fourteen regions, and these fourteen regions starting from the lowest-frequency region are consecutively numbered with numbers in ascending order.
- the amplitude envelope thus becomes a fourteen-dimensional vector having mean values of the frequency domain coefficients for the fourteen frequency regions as fourteen elements of the vector, and an envelope code is obtained as a result of encoding the amplitude envelope.
- FIG. 13 is an explanatory drawing for explaining the structure of the sound code in the case of the amplitude envelope of FIG. 12 .
- the multiplexing means 2 multiplexes the plurality of variable-length codes (i.e., Huffman codes), i.e., the plurality of band-by-band codes respectively provided for the plurality of regions so that the plurality of band-by-band codes are arranged in increasing order of their respective frequencies, after multiplexing the envelope code.
- Huffman codes i.e., the plurality of band-by-band codes respectively provided for the plurality of regions so that the plurality of band-by-band codes are arranged in increasing order of their respective frequencies, after multiplexing the envelope code.
- the band-by-band code numbered 6 separated by the demultiplexing unit 15 of the sound decoder differs from the original one multiplexed by the sound encoder. Since a Huffman code is used as each of the plurality of band-by-band codes, the code length of the band-by-
- the demultiplexing means 15 cannot separate the band-by-band codes 102 - 3 numbered 7 , 9 , 10 , 11 , 13 , and 14 , which follows the one numbered 6 , from correct locations of the multiplexed code, the following codes separated by the demultiplexing means 15 become erroneous ones. These erroneously decoded regions are hatched in FIGS. 3 and 4 .
- band-by-band codes provided for high-frequency regions are often multiplexed fixedly into locations closer to the tail of the multiplexed code, there is a possibility that such band-by-band codes are separated erroneously when an bit error occurs before the locations where they are multiplexed.
- Japanese patent application publications No. 9-106299 and 2000-183751 disclose sound encoders and sound decoders different from the above-mentioned prior art example.
- the prior art sound encoder disclosed in Japanese patent application publication No. 9-106299 encodes only a selected, predetermined number of partial frequency domain coefficients (their respective amplitudes) with a larger value in order to select only the necessary ones from among all samples of frequency domain coefficients into which the sound signal is time-to-frequency domain converted and to encode them with a high degree of efficiency.
- the encoding of the partial frequency domain coefficients is carried out in such a manner that they are encoded in decreasing order of their values, when encoding the second or later largest coefficient the coefficient encoded immediately before the encoding is decoded, and the second or later largest coefficient is encoded after it is normalized with the decoded coefficient.
- Information indicating the order in which the partial frequency domain coefficients are to be encoded can be sample numbers which are converted into binary numbers, or a series of sample numbers, which is Huffman encoded, and is transmitted from the sound encoder to the sound decoder.
- the prior art sound encoder disclosed in Japanese patent application publication No. 2000-183751 sorts data to be encoded according to a predetermined reference, such as bits of each data to be encoded, or bit sensitivities determined based on data errors, in order to implement changeable bit rate encoding which is synchronized in real time with traffic (or transmission line congestions).
- the order of sorting data is predetermined to ensure that the data can be transmitted between the encoding side and the decoding side. In other words, the order of sorting data is so fixed as not to vary from frame to frame.
- a problem with such a prior art sound encoder and such a sound decoder constructed as above is that since the order in which a plurality of band-by-band codes which are variable length codes is so fixed as not to vary from frame to frame, erroneous demultiplexing can often occur in band-by-band codes provided for high-frequency regions, which are multiplexed in locations closer to the tail of the multiplexed code.
- Another problem is that since the deterioration in the tone quality of the sound signal increases when band-by-band codes with a larger envelope value are erroneously separated, the deterioration in the tone quality of the sound signal increases due to the occurrence of bit errors when band-by-band codes provided for high-frequency regions have a larger envelope value. In other words, since the multiplexing is not carried out in consideration of the distribution of bit error sensitivities that varies from frame to frame, the deterioration in the tone quality of the sound signal increases due to the occurrence of bit errors.
- Japanese patent application publication No. 9-106299 discloses a method of adding a code indicating the order in which partial frequency domain coefficients are to be encoded and encoding it by using a Huffman code.
- the other codes other than the code indicating the order are fixed length codes and therefore the problem of the occurrence of erroneous demultiplexing caused by the existence of variable length codes cannot be solved.
- the deterioration in the sound signal due to the occurrence of bit errors increases because of the addition of the code associated with the order in which partial frequency domain coefficients are to be encoded and the encoding of the second or later largest partial frequency domain coefficient after decoding the immediately-encoded partial frequency domain coefficient and normalizing the second or later largest partial frequency domain coefficient with the decoded value.
- a problem with prior art sound encoder and prior art sound decoders as disclosed in Japanese patent application publication No. 2000-183751 is that since the sound encoder does not perform multiplexing that reflects the distribution of bit error sensibilities that varies from frame to frame, but only sorts data to be encoded according to a predetermined reference so that they are arranged in a fixed order that does not vary from frame to frame, the deterioration in the sound signal due to the occurrence of bit errors cannot be sufficiently prevented, as in the case of the prior art sound encoder and the prior art sound decoder as shown in FIGS. 10 and 11 .
- the present invention is proposed to solve the above-mentioned problems, and it is therefore an object of the present invention to provide a sound encoder and a sound decoder having high bit error immunity.
- a sound encoder including: a multiplexing order determination unit for analyzing the plurality of codes produced by an encoding unit so as to determine an order in which the plurality of codes are to be multiplexed; and a multiplexing unit for multiplexing the plurality of codes in the order determined by the multiplexing order determination unit, and for outputting a multiplexed result as a sound code.
- the sound encoder can provide high bit error immunity.
- a sound decoder comprising: a demultiplexing order determination unit for accepting a sound code on a frame-by-frame basis, and for determining an order in which the sound code is to be demultiplexed into a plurality of codes part or all of which are variable length codes; and a demultiplexing unit for demultiplexing a sound code into a plurality of codes one by one in the order determined by the demultiplexing order determination unit and for outputting them.
- the sound decoder can provide high bit error immunity.
- FIG. 1 is a block diagram showing the structure of a sound encoder according to embodiment 1 of the present invention
- FIG. 2 is a block diagram showing the structure of a sound decoder according to embodiment 1 of the present invention
- FIG. 3 is an explanatory drawing for showing an example of an amplitude envelope calculated by the sound encoder according to embodiment 1 of the present invention
- FIG. 4 is explanatory drawing for explaining the structure of a sound code to in the case of the amplitude envelope of FIG. 3 ;
- FIG. 5 is an explanatory drawing for showing an evaluation result of bit error sensibility when a voice is input as the sound signal
- FIG. 6 is a block diagram showing the structure of a sound encoder according to embodiment 2 of the present invention.
- FIG. 7 is a block diagram showing the structure of a sound decoder according to embodiment 2 of the present invention.
- FIG. 8 is an explanatory drawing for explaining a power for each subframe in the sound encoder according to embodiment 2 of the present invention.
- FIG. 9 is an explanatory drawing for explaining the structure of a sound code output by the sound encoder according to embodiment 2 of the present invention.
- FIG. 10 is a block diagram showing the structure of a prior art sound encoder
- FIG. 11 is a block diagram showing the structure of a prior art sound decoder
- FIG. 12 is an explanatory drawing for showing an example of an amplitude envelope calculated by the prior art sound encoder.
- FIG. 13 is an explanatory drawing for explaining the structure of the sound code in the case of the amplitude envelope of FIG. 12 .
- FIG. 1 is a block diagram showing the structure of a sound encoder according to embodiment 1 of the present invention
- FIG. 2 is a block diagram showing the structure of a sound decoder according to embodiment 1 of the present invention.
- reference numeral 11 denotes an encoding unit that accepts a sound signal, which is the target to be encoded, for each frame of a predetermined length, and encodes the sound signal so as to produce a plurality of codes, such as an envelope code and a plurality of band-by-band codes
- reference numeral 12 denotes a multiplexing order determination unit for determining the order in which the plurality of band-by-band codes are to be multiplexed into a multiplexed code based on the envelope code output from the encoding unit 11
- reference numeral 13 denotes a multiplexing unit for multiplexing the envelope code and the plurality of band-by-band codes in the order determined by the multiplexing order determination unit 12 , and for outputting the multiplexed result as a sound
- the sound encoder performs all processes on a frame-by-frame basis, each frame having a length of 20 ms, for example.
- the encoding unit 11 performs a time to frequency domain transformation, such as a modulated lapped transform (MLT), on the sound signal so as to acquire frequency domain coefficients and divides these frequency domain coefficients into a plurality of portions respectively provided for a plurality of regions.
- MKT modulated lapped transform
- the plurality of portions which constitute each frame correspond to the plurality of frequency regions into which a frequency spectrum obtained by converting the sound signal from time domain to frequency domain is divided, respectively.
- the encoding unit 11 then calculates a mean value of the frequency domain coefficients for each region and encodes an amplitude envelope that consists of a plurality of acquired mean values so as to output the coded amplitude envelope as an envelope code.
- the encoding unit 11 then normalizes the frequency domain coefficients for each region with a value obtained by decoding the envelope code, quantizes the normalized frequency domain coefficients for each region, and acquires a fixed length code of length which is fixed for each quantization.
- the encoding unit 11 Huffman-encodes (variable-length encodes) this fixed length code and outputs the acquired variable length code as each band-by-band code.
- the encoding unit 11 can further determine and output a category control code of a fixed length for controlling the quantization stepsize for each region in addition to the envelope code and the plurality of band-by-band codes, and can multiplex the category control code as well as the envelope code and the plurality of band-by-band codes into a multiplexed code.
- the multiplexing order determination unit 12 When receiving the plurality of codes from the encoding unit 11 , the multiplexing order determination unit 12 classifies the plurality of band-by-band codes as main codes and classifies the remaining envelope code as an auxiliary code. The multiplexing order determination unit 12 then determines the order in which the plurality of band-by-band codes, which are main codes, are to be multiplexed into the multiplexed code based on the envelope code which is an auxiliary code.
- the multiplexing order determination unit 12 determines the order in the following manner. While keeping the order in which the envelope code, which is an auxiliary code, is to be multiplexed into the multiplexed code fixed so that it does not vary from frame to frame, the multiplexing order determination unit 12 determines the order in which the plurality of band-by-band codes, which are main codes, are to be multiplexed into the multiplexed code in the order of the values of the amplitude envelope's elements obtained by decoding the envelope code, for example.
- the amplitude envelope is calculated as an intermediate variable in the encoding unit 11 , it is possible to omit the decoding of the amplitude envelope in the multiplexing order determination unit 12 by delivering the amplitude envelope from the encoding unit 11 to the multiplexing order determination unit 12 .
- the order does not simply indicate the order in which processes are to be done with time, but indicates where the plurality of codes are to be placed in the sound code into which they are to be multiplexed by the multiplexing unit 13 .
- the multiplexing unit 13 When receiving the plurality of codes from the encoding unit 11 , the multiplexing unit 13 multiplexes the envelope code and the plurality of band-by-band codes in the order determined by the multiplexing order determination unit 12 and then outputs the multiplexed result as a sound code.
- the demultiplexing unit 15 of the sound decoder When receiving the sound code from the sound encoder, the demultiplexing unit 15 of the sound decoder separates only the auxiliary code, i.e., the envelope code from the sound code, and then outputs it.
- the demultiplexing unit 14 can separate only the auxiliary code without having to wait for inputting of the order determined on a frame-by-frame basis because the order in which the auxiliary code is multiplexed into the received multiplexed code is fixed in the multiplexing order determination unit 12 of the corresponding sound encoder.
- the demultiplexing order determination unit 14 determines the order in which the plurality of main codes are to be separated by the demultiplexing unit 15 based on the envelope code.
- the method of determining the order has to be made to be the same as that used by the multiplexing order determination unit 12 of the corresponding sound encoder.
- the demultiplexing unit 15 separates the plurality of main codes, i.e., the plurality of band-by-band codes from the sound code in the order determined by the demultiplexing order determination unit 14 and then outputs them.
- the decoding unit 16 decodes the envelope code so as to calculate the amplitude envelope and decodes the plurality of band-by-band codes so as to calculate the normalized frequency domain coefficients.
- the demultiplexing unit 15 then denormalizes the frequency domain coefficients by multiplying the value of the amplitude envelope for each region by the normalized frequency domain coefficients for each region, and performs a frequency to time domain transformation, such as an Inverse MLT (IMLT), on the denormalized frequency domain coefficients for each region so as to reproduce a sound signal.
- IMLT Inverse MLT
- FIG. 3 is an explanatory drawing for showing an example of the amplitude envelope calculated by the sound encoder.
- the horizontal axis indicates the frequency and the vertical axis indicates the value, i.e., the envelope value of each element of the amplitude envelope for each region.
- the total frequency region of the sound signal which is the target to be encoded is divided into fourteen regions, and these fourteen regions starting from the lowest-frequency region are consecutively numbered with numbers in ascending order.
- the amplitude envelope is a fourteen-dimensional vector having mean values of the fourteen portions of the frequency domain coefficients for the fourteen frequency regions as fourteen elements of the vector, and the envelope code is obtained as a result of encoding the amplitude envelope.
- the amplitude envelope shown in FIG. 3 has the same envelope values as those as shown in FIG. 12 .
- the regions numbered 4 , 8 , and 12 have a larger envelope value than the other regions, and the order of the envelope values is as shown in the lowest part of FIG. 3 .
- Each of the multiplexing order determination unit 12 and the demultiplexing order determination unit 14 decodes the input envelope code so as to calculate the order of the envelope values for the acquired amplitude envelope on a frame-by-frame basis.
- FIG. 4 is an explanatory drawing for explaining the structure of the sound code in the case of the amplitude envelope of FIG. 3 .
- the multiplexing unit 13 multiplexes the envelope code into the head of the multiplexed code, and multiplexes the plurality of variable length codes, which are provided for the plurality of regions, respectively, i.e., the plurality of band-by-band codes into the multiplexed code in the above-mentioned order of the plurality of corresponding envelope values calculated on a frame-by-frame basis.
- the multiplexing unit 13 multiplexes the band-by-band code numbered 4 and having the first order of envelope value, i.e., having the largest envelope value into an area of the multiplexed code next to the area in which the envelope code is placed.
- the multiplexing unit 13 then multiplexes the band-by-band code numbered 8 and having the second order of envelope value, i.e., having the second largest envelope value into an area of the multiplexed code next to the area in which the band-by-band code numbered 4 is placed.
- the multiplexing unit 13 repeatedly and sequentially multiplexes up to the band-by-band code numbered 14 and having the fourteenth order of envelope value, i.e., having the smallest envelope value. It is apparent from the comparison with the prior art sound code shown in FIG. 13 that the order in which the plurality of band-by-band codes are to be multiplexed differs from that of FIG. 13 .
- the band-by-band code numbered 6 separated by the demultiplexing unit 15 of the sound decoder differs from the original one multiplexed by the sound encoder. Since a Huffman code is used as each of the plurality of band-by-band codes, the code length of the band-by-band code numbered 6 can be erroneously estimated with a considerable probability.
- the present embodiment makes it possible to lower the probability of erroneously decoding band-by-band codes associated with regions which are determined to exert a large influence of errors (i.e., regions having a large envelope value in this case) by multiplexing those band-by-band codes into the multiplexed code so that they are arranged in areas closer to the head of the multiplexed code, thereby reducing the deterioration in the tone quality of the sound signal.
- FIG. 5 shows results of an evaluation of bit error sensibilities when a voice is input as the sound signal.
- the horizontal axis indicates the position of each bit of the sound code, and the leftmost end of the axis corresponds to the head bit of the sound code and the rightmost end of the axis corresponds to the tail bit of the sound code.
- the vertical axis indicates the signal to noise ratio SNR
- the envelope code is used as an auxiliary code to determine the order in which the plurality of input codes are to be multiplexed into the multiplexed code and the multiplexed code is to be demultiplexed into a plurality of output codes.
- the present invention is not limited to this case, and various variants can be made.
- a category control code for controlling the quantization stepsize can be multiplexed into the multiplexed code and the order in which the plurality of input codes are to be multiplexed into the multiplexed code can be modified according to the category control code.
- the order of the values of the amplitude envelope's elements obtained by decoding the envelope code is used unchanged as the order in which the plurality of input codes are to be multiplexed into the multiplexed code.
- the present embodiment makes it possible to adaptively multiplex a code that exerts a large influence upon other codes or a part of the code into a position of the sound code where there is a low possibility that the code or the part of the code is erroneously decoded.
- the present embodiment makes it possible to implement multiplexing and demultiplexing that reflect the distribution of bit error sensibilities which varies from frame to frame.
- the present embodiment offers an advantage of being able to provide a sound encoder and a sound decoder having high bit error immunity.
- FIG. 6 is a block diagram showing the structure of a sound encoder according to embodiment 2 of the present invention
- FIG. 7 is a block diagram showing the structure of a sound decoder according to embodiment 2 of the present invention.
- reference numeral 21 denotes an encoding unit for accepting a sound signal which is the target to be coded, for each frame of a predetermined length, and for encoding the sound signal so as to produce a plurality of codes (a plurality of subframe-by-subframe power codes and a plurality of subframe-by-subframe shape codes, which are respectively provided for a plurality of subframes)
- reference numeral 22 denotes a multiplexing order determination unit for determining the order in which the plurality of shape codes are to be multiplexed into a multiplexed code, based on the plurality of subframe-by-subframe power codes output from the encoding unit 21
- reference numeral 23 denotes a multiplexing unit for multiplexing the plurality of subframe-by-sub
- the sound encoder performs all processes on a frame-by-frame basis, each frame having a length of 20 ms, for example.
- the encoding unit 21 of the sound encoder accepts a sound signal
- the encoding unit 21 encodes the sound signal for each of two subframes (i.e., sections) into which each frame of the sound signal is divided.
- the encoding unit 21 acquires a power of a signal in each of the two subframes and then encodes the power so as to produce a power code.
- the encoding unit 21 then normalizes the sound signal in each of the two subframes with a value obtained by decoding the power code, and encodes the normalized sound signal so as to produce a shape code.
- the encoding unit 21 thus performs this encoding processing on each of the two subframes so as to produce and output two power codes, as subframe-by-subframe power codes, and two shape codes, as subframe-by-subframe shape codes.
- each of the two shape codes is a variable length code such as a Huffman code.
- An envelope code and a plurality of band-by-band codes which are explained in above-mentioned embodiment 1, can be used as each of the shape codes.
- Each of the shape codes is not limited to a combination of an envelope code and a plurality of band-by-band codes, and one of various combinations of a spectrum code, an adaptive sound source code, a driving sound source code, and a gain code widely used in sound coding can be used as each of the shape codes.
- the multiplexing order determination unit 22 When the multiplexing order determination unit 22 receives the plurality of codes from the encoding unit 21 , it classifies the plurality of subframe-by-subframe shape codes as main codes and classifies the plurality of subframe-by-subframe power codes as auxiliary codes. The multiplexing order determination unit 22 then determines the order in which the plurality of subframe-by-subframe shape codes, which are main codes, are to be multiplexed into a sound code based on the plurality of subframe-by-subframe power codes which are auxiliary codes. The order does not simply indicate the order in which processes are to be done with time, but indicates where the plurality of codes are to be placed in the sound code into which they are to be multiplexed by the multiplexing unit 23 .
- the multiplexing order determination unit 22 provides a frame-independent fixed order for multiplexing of the plurality of subframe-by-subframe power codes which are auxiliary codes, and determines only the order, in which the main codes are to be multiplexed into the sound code, on a frame-by-frame basis. For example, the multiplexing order determination unit 22 determines the order, in which the main codes are to be multiplexed into the sound code, according to the comparison between the subframe-by-subframe powers acquired by decoding the plurality of subframe-by-subframe power codes which are auxiliary codes.
- the encoding unit 21 can deliver the subframe-by-subframe powers to the multiplexing order determination unit 22 and it is therefore to omit the decoding of the subframe-by-subframe power codes in the multiplexing order determination unit 22 .
- the multiplexing unit 23 When receiving the plurality of codes from the encoding unit 21 , the multiplexing unit 23 multiplexes both the subframe-by-subframe power codes and the subframe-by-subframe shape codes into a multiplexed code in the order determined by the multiplexing order determination unit 22 , and outputs the multiplexed result as a sound code.
- the demultiplexing unit 25 of the sound decoder When receiving the sound code from the sound encoder, the demultiplexing unit 25 of the sound decoder demultiplexes only the auxiliary codes included in the sound code, i.e., the subframe-by-subframe power codes and then outputs them.
- the demultiplexing unit 25 can separate only the auxiliary codes without having to wait for inputting of the order determined on a frame-by-frame basis because the order in which the auxiliary codes are to be multiplexed into the received multiplexed code is fixed in the multiplexing order determination unit 22 of the corresponding sound encoder.
- the demultiplexing order determination unit 24 determines the order in which the main codes are to be demultiplexed by the demultiplexing unit 25 based on the subframe-by-subframe power codes. The method of determining the order has to be made to be the same as that used by the multiplexing order determination unit 22 of the corresponding sound encoder.
- the demultiplexing unit 25 separates the main codes included in the sound code, i.e., the subframe-by-subframe shape codes from the sound code in the order determined by the demultiplexing order determination unit 24 and outputs them.
- the decoding unit 26 receives the subframe-by-subframe power codes and the subframe-by-subframe shape codes from the demultiplexing unit 25 , it decodes the subframe-by-subframe power codes so as to calculate the subframe-by-subframe powers and produces normalized sound signals for the two subframes from the subframe-by-subframe shape codes, respectively.
- the decoding unit 26 then denormalizes the sound signals by multiplying the subframe-by-subframe powers by the normalized sound signals for the two subframes, respectively, and outputs the combination of the two denormalized sound signals as a sound signal.
- FIG. 8 is an explanatory drawing for explaining the subframe-by-subframe powers produced in the sound encoder.
- the horizontal axis indicates the time and it is assumed that the current frame is divided into two subframes: the first half which is referred to as the first subframe and the latter half which is referred to as the second subframe.
- the sound signal for the current frame is shown in the upper part and the subframe-by-subframe powers (i.e., values obtained by decoding the subframe-by-subframe power codes) calculated for the sound signal are shown in the lower part.
- the second subframe has a larger power than the first subframe.
- FIGS. 9A and 9B are explanatory drawings for explaining the structure of the sound code output by the sound encoder.
- FIG. 9A shows an example of the sound code in which the first subframe has a power equal to or greater than that of the second subframe
- FIG. 9B shows another example of the sound code in which the first subframe has a power less than that of the second subframe, as in the case of FIG. 8 .
- the subframe-by-subframe power codes which are auxiliary codes are fixedly multiplexed into the head of the sound code regardless of the difference between the power of the first subframe and that of the second subframe.
- the demultiplexing order determination unit 24 compares the power of the first subframe with that of the second subframe, and gives a higher priority to one of the subframe-by-subframe shape codes, which is associated with the subframe that provides a larger power, so that the higher-priority subframe-by-subframe shape code is multiplexed into the sound code before the other shape code is multiplexed.
- each shape code is the one into which a plurality of codes are multiplexed. Since a variable length code is used as part or all of each shape code, the code length of each shape code can be erroneously estimated when a bit error occurs. As a result, the demultiplexing unit may separate other codes, which are placed behind a shape code at which a bit error occurs, erroneously. Therefore, as the demultiplexing unit reaches the tail of the sound code, codes can be decoded erroneously with a higher probability because of the occurrence of bit errors. As shown in FIGS.
- the multiplexing unit of this embodiment 2 multiplexes one subframe-by-subframe shape code with a larger power before multiplexing the other subframe-by-subframe shape code, thereby reducing the probability of erroneously decoding the former subframe-by-subframe shape code with a larger power.
- the multiplexing as shown in FIGS. 9A and 9B makes it possible to reduce the deterioration in the tone quality of the sound signal by reducing the probability of erroneously decoding a subframe-by-subframe shape code with a larger power.
- the number of subframes included in each frame is 2, but is not limited to 2. As an alternative, the number of subframes included in each frame can be 3 or more.
- the multiplexing unit of the sound encoder multiplexes the two power codes respectively provided for the two subframes of each frame into a sound code. As an alternative, the multiplexing unit can vector quantize the two subframe-by-subframe powers as a single unit and encode the vector quantized result so as to produce a power code on a frame-by-frame basis.
- the multiplexing unit of the sound encoder can multiplex a part of each shape code into the sound code in a fixed order so that it is placed immediately behind the two power codes, and can control the order in which the remainder of the first subframe's shape code and the remainder of the second subframe's shape code are to be multiplexed according to the subframe-by-subframe powers.
- the multiplexing unit of the sound encoder can divide the shape code of each subframe into a plurality of portions, and can finely control the order in which the plurality of portions are to be multiplexed according to a plurality of powers respectively provided for them.
- only the two power codes can be used, as auxiliary codes, to determine the order in which the first subframe's shape code and the second subframe's shape code are to be multiplexed into the sound code.
- the present embodiment is not limited to the case, and any other code can be used, as an auxiliary code, if the importance of each subframe is determined using the other code.
- the combination of the other code and the two power codes are used as auxiliary codes, or only the other code is used as an auxiliary code.
- the sound encoder is so constructed as to multiplex a plurality of codes into a sound code in the order determined by the multiplexing order determination unit 22
- the sound decoder is so constructed as to demultiplex the sound code into the plurality of codes one by one in the order determined by the demultiplexing order determination unit 24 and to output them.
- the present embodiment therefore makes it possible to adaptively multiplex a code that exerts a large influence upon other codes or a part of the code into a position of the sound code where there is a low possibility that the code or the part of the code is erroneously decoded.
- the present embodiment makes it possible to implement multiplexing and demultiplexing that reflect the distribution of bit error sensibilities which varies from frame to frame.
- the present embodiment offers an advantage of being able to provide a sound encoder and a sound decoder having high bit error immunity.
- the multiplexing unit can interchange a plurality of codes multiplexed into a multiplexed code based on the order determined by the multiplexing order determination unit after multiplexing the plurality of codes into the multiplexed code in a fixed order once, instead of multiplexing the plurality of codes into the multiplexed code in the determined order. Even in this case, the same advantages are provided.
- the demultiplexing unit can demultiplex an input multiplexed code into a plurality of codes in a fixed order after interchanging the plurality of codes multiplexed into the multiplexed code based on the order determined by the demultiplexing order determination unit once, instead of demultiplexing the multiplexed code into the plurality of codes in the determined order. Even in this case, the same advantages are provided.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Time-Division Multiplex Systems (AREA)
Abstract
A sound encoder multiplexes a plurality of codes into a sound code in an order determined by a multiplexing order determination unit (12), and a sound decoder demultiplexes the sound code into a plurality of codes one by one in an order determined by a demultiplexing order determination unit (14).
Description
- 1. Field of the Invention
- This application is a Divisional of co-pending application Ser. No. 11/701,461, filed on Feb. 2, 2007, which is a Divisional of co-pending application Ser. No. 10/222,902, filed on Aug. 19, 2002, which claims priority to Japanese Application No. 2001-266253, filed Sep. 3, 2001, the entire contents of which are hereby incorporated by reference and for which priority is claimed under 35 U.S.C. § 120.
- The present invention relates to a sound encoder that outputs a sound code acquired by compressing a digital sound signal, such as a musical sound or a voice, into a small volume of information, and a sound decoder that decodes the sound code so as to reproduce a sound signal.
- 2. Description of the Prior Art
- Most prior art sound encoders acquire a plurality of codes having a small volume of information from a sound signal, and multiplex them into a sound code. Most prior art sound decoders demultiplex the sound code into a plurality of codes and decode them so as to reproduce the sound signal.
- In a sound encoder and a sound decoder disclosed in “ITU-T Recommendation G.722.” (in September, 1999), a Huffman code is used as a part of codes in order to reproduce an excellent sound signal even when those codes have a small amount of information. Huffman codes are typical variable length codes having a feature that their code length becomes short when they have a frequently used value and becomes long otherwise.
-
FIG. 10 is a block diagram showing the structure of a prior art sound encoder as disclosed in the above-mentioned reference, andFIG. 11 is a block diagram showing the structure of a prior art sound decoder as disclosed in the above-mentioned reference. In the figures,reference numeral 1 denotes an encoding means for encoding a sound signal, which is the target to be coded, so as to produce and output a plurality of codes (i.e., an envelope code and a plurality of band-by-band codes), andreference numeral 2 denotes a multiplexing unit for multiplexing the plurality of codes output from the encoding means 1 into a multiplexed code and for outputting the multiplexed code as a sound code,reference numeral 3 denotes a demultiplexing means for accepting the sound code from the sound encoder and for demultiplexing the sound code into the plurality of codes (i.e., the envelope code and the plurality of band-by-band codes), andreference numeral 4 denotes a decoding means for decoding the plurality of codes demultiplexed by the demultiplexing means 3 so as to reproduce the sound signal. - Next, a description will be made as to the operation of the prior art sound encoder. The prior art sound encoder performs all processes on a frame-by-frame basis, each frame having a length of 20 ms. When a sound signal is input to the encoding means 1 of the prior art sound encoder, the encoding means 1 performs a modulated lapped transform (MLT) on the sound signal so as to acquire MLT coefficients and divides these MLT coefficients into a plurality of regions. The encoding means 1 then calculates a mean value of the MLT coefficients for each region and encodes an amplitude envelope which consists of a plurality of acquired mean values so as to output the coded amplitude envelope as an envelope code. The encoding means 1 then normalizes the MLT coefficients for each region with a value obtained by decoding the envelope code, quantizes the normalized MLT coefficients for each region, and acquires a fixed length code of length which is fixed for each quantization. The encoding means 1 Huffman-encodes (variable-length encodes) this fixed length code and outputs the acquired variable length code as each band-by-band code. The encoding means 1 further determines and outputs a category code of a fixed length for controlling the quantization stepsize for each region in addition to the envelope code and the plurality of band-by-band codes. However, for simplicity, the detailed explanation of the category code will be omitted hereafter.
- When the encoding means 1 outputs the envelope code and the plurality of band-by-band codes, the multiplexing means 2 multiplexes them in a fixed order which is provided in advance and outputs the multiplexed result to the sound decoder as a sound code.
- The demultiplexing means 3 of the sound decoder accepts the sound code from the sound encoder and demultiplexes the sound code into a plurality of codes so that they are arranged in the fixed order which is provided in advance and outputs the plurality of codes (i.e., the envelope code and the plurality of band-by-band codes).
- When receiving the envelope code and the plurality of band-by-band codes from the demultiplexing means 3, the decoding means 4 decodes the envelope code so as to calculate an amplitude envelope, decodes the plurality of band-by-band codes so as to calculate normalized frequency domain coefficients. By multiplying the value of the amplitude envelope for each region by the normalized frequency domain coefficients for each region, the decoding means 4 denormalize the frequency domain coefficients and performs an Inverse MLT (IMLT) on the denormalized frequency domain coefficients so as to reproduce a sound signal.
-
FIG. 12 is an explanatory drawing for showing an example of the amplitude envelope generated by the prior art sound encoder. InFIG. 12 , the horizontal axis indicates the frequency and the vertical axis indicate the value, i.e., envelope value of the amplitude envelope for each region. The total frequency region of the sound signal which is the target to be coded is divided into fourteen regions, and these fourteen regions starting from the lowest-frequency region are consecutively numbered with numbers in ascending order. The amplitude envelope thus becomes a fourteen-dimensional vector having mean values of the frequency domain coefficients for the fourteen frequency regions as fourteen elements of the vector, and an envelope code is obtained as a result of encoding the amplitude envelope. -
FIG. 13 is an explanatory drawing for explaining the structure of the sound code in the case of the amplitude envelope ofFIG. 12 . The multiplexing means 2 multiplexes the plurality of variable-length codes (i.e., Huffman codes), i.e., the plurality of band-by-band codes respectively provided for the plurality of regions so that the plurality of band-by-band codes are arranged in increasing order of their respective frequencies, after multiplexing the envelope code. When a bit error occurs in the same bit position designated by X as that shown inFIG. 13 , the band-by-band code numbered 6 separated by thedemultiplexing unit 15 of the sound decoder differs from the original one multiplexed by the sound encoder. Since a Huffman code is used as each of the plurality of band-by-band codes, the code length of the band-by-band code numbered 6 can be erroneously estimated with a considerable probability. - As a result, since the demultiplexing means 15 cannot separate the band-by-band codes 102-3 numbered 7, 9, 10, 11, 13, and 14, which follows the one numbered 6, from correct locations of the multiplexed code, the following codes separated by the demultiplexing means 15 become erroneous ones. These erroneously decoded regions are hatched in
FIGS. 3 and 4 . Thus, in the prior art sound encoder and the prior art sound decoder, since band-by-band codes provided for high-frequency regions are often multiplexed fixedly into locations closer to the tail of the multiplexed code, there is a possibility that such band-by-band codes are separated erroneously when an bit error occurs before the locations where they are multiplexed. - Japanese patent application publications No. 9-106299 and 2000-183751 disclose sound encoders and sound decoders different from the above-mentioned prior art example. The prior art sound encoder disclosed in Japanese patent application publication No. 9-106299 encodes only a selected, predetermined number of partial frequency domain coefficients (their respective amplitudes) with a larger value in order to select only the necessary ones from among all samples of frequency domain coefficients into which the sound signal is time-to-frequency domain converted and to encode them with a high degree of efficiency. The encoding of the partial frequency domain coefficients is carried out in such a manner that they are encoded in decreasing order of their values, when encoding the second or later largest coefficient the coefficient encoded immediately before the encoding is decoded, and the second or later largest coefficient is encoded after it is normalized with the decoded coefficient. Information indicating the order in which the partial frequency domain coefficients are to be encoded can be sample numbers which are converted into binary numbers, or a series of sample numbers, which is Huffman encoded, and is transmitted from the sound encoder to the sound decoder.
- The prior art sound encoder disclosed in Japanese patent application publication No. 2000-183751 sorts data to be encoded according to a predetermined reference, such as bits of each data to be encoded, or bit sensitivities determined based on data errors, in order to implement changeable bit rate encoding which is synchronized in real time with traffic (or transmission line congestions). The order of sorting data is predetermined to ensure that the data can be transmitted between the encoding side and the decoding side. In other words, the order of sorting data is so fixed as not to vary from frame to frame.
- A problem with such a prior art sound encoder and such a sound decoder constructed as above is that since the order in which a plurality of band-by-band codes which are variable length codes is so fixed as not to vary from frame to frame, erroneous demultiplexing can often occur in band-by-band codes provided for high-frequency regions, which are multiplexed in locations closer to the tail of the multiplexed code. Another problem is that since the deterioration in the tone quality of the sound signal increases when band-by-band codes with a larger envelope value are erroneously separated, the deterioration in the tone quality of the sound signal increases due to the occurrence of bit errors when band-by-band codes provided for high-frequency regions have a larger envelope value. In other words, since the multiplexing is not carried out in consideration of the distribution of bit error sensitivities that varies from frame to frame, the deterioration in the tone quality of the sound signal increases due to the occurrence of bit errors.
- The prior art sound encoder and the prior art sound decoder disclosed in Japanese patent application publication No. 9-106299, do not has a method of sufficiently preventing the deterioration in the sound signal due to the occurrence of bit errors by using an error correction code, but only has a modified encoding unit. Japanese patent application publication No. 9-106299 discloses a method of adding a code indicating the order in which partial frequency domain coefficients are to be encoded and encoding it by using a Huffman code. The other codes other than the code indicating the order are fixed length codes and therefore the problem of the occurrence of erroneous demultiplexing caused by the existence of variable length codes cannot be solved. If anything, the deterioration in the sound signal due to the occurrence of bit errors increases because of the addition of the code associated with the order in which partial frequency domain coefficients are to be encoded and the encoding of the second or later largest partial frequency domain coefficient after decoding the immediately-encoded partial frequency domain coefficient and normalizing the second or later largest partial frequency domain coefficient with the decoded value.
- A problem with prior art sound encoder and prior art sound decoders as disclosed in Japanese patent application publication No. 2000-183751 is that since the sound encoder does not perform multiplexing that reflects the distribution of bit error sensibilities that varies from frame to frame, but only sorts data to be encoded according to a predetermined reference so that they are arranged in a fixed order that does not vary from frame to frame, the deterioration in the sound signal due to the occurrence of bit errors cannot be sufficiently prevented, as in the case of the prior art sound encoder and the prior art sound decoder as shown in
FIGS. 10 and 11 . - The present invention is proposed to solve the above-mentioned problems, and it is therefore an object of the present invention to provide a sound encoder and a sound decoder having high bit error immunity.
- In accordance with an aspect of the present invention, there is provided a sound encoder including: a multiplexing order determination unit for analyzing the plurality of codes produced by an encoding unit so as to determine an order in which the plurality of codes are to be multiplexed; and a multiplexing unit for multiplexing the plurality of codes in the order determined by the multiplexing order determination unit, and for outputting a multiplexed result as a sound code. As a result, the sound encoder can provide high bit error immunity.
- In accordance with another aspect of the present invention, there is provided a sound decoder comprising: a demultiplexing order determination unit for accepting a sound code on a frame-by-frame basis, and for determining an order in which the sound code is to be demultiplexed into a plurality of codes part or all of which are variable length codes; and a demultiplexing unit for demultiplexing a sound code into a plurality of codes one by one in the order determined by the demultiplexing order determination unit and for outputting them. As a result, the sound decoder can provide high bit error immunity.
- Further objects and advantages of the present invention will be apparent from the following description of the preferred embodiments of the invention as illustrated in the accompanying drawings.
-
FIG. 1 is a block diagram showing the structure of a sound encoder according toembodiment 1 of the present invention; -
FIG. 2 is a block diagram showing the structure of a sound decoder according toembodiment 1 of the present invention; -
FIG. 3 is an explanatory drawing for showing an example of an amplitude envelope calculated by the sound encoder according toembodiment 1 of the present invention; -
FIG. 4 is explanatory drawing for explaining the structure of a sound code to in the case of the amplitude envelope ofFIG. 3 ; -
FIG. 5 is an explanatory drawing for showing an evaluation result of bit error sensibility when a voice is input as the sound signal; -
FIG. 6 is a block diagram showing the structure of a sound encoder according toembodiment 2 of the present invention; -
FIG. 7 is a block diagram showing the structure of a sound decoder according toembodiment 2 of the present invention; -
FIG. 8 is an explanatory drawing for explaining a power for each subframe in the sound encoder according toembodiment 2 of the present invention; -
FIG. 9 is an explanatory drawing for explaining the structure of a sound code output by the sound encoder according toembodiment 2 of the present invention; -
FIG. 10 is a block diagram showing the structure of a prior art sound encoder; -
FIG. 11 is a block diagram showing the structure of a prior art sound decoder; -
FIG. 12 is an explanatory drawing for showing an example of an amplitude envelope calculated by the prior art sound encoder; and -
FIG. 13 is an explanatory drawing for explaining the structure of the sound code in the case of the amplitude envelope ofFIG. 12 . - The invention will now be described with reference to the accompanying drawings.
-
FIG. 1 is a block diagram showing the structure of a sound encoder according toembodiment 1 of the present invention, andFIG. 2 is a block diagram showing the structure of a sound decoder according toembodiment 1 of the present invention. In the figure, reference numeral 11 denotes an encoding unit that accepts a sound signal, which is the target to be encoded, for each frame of a predetermined length, and encodes the sound signal so as to produce a plurality of codes, such as an envelope code and a plurality of band-by-band codes, reference numeral 12 denotes a multiplexing order determination unit for determining the order in which the plurality of band-by-band codes are to be multiplexed into a multiplexed code based on the envelope code output from the encoding unit 11, reference numeral 13 denotes a multiplexing unit for multiplexing the envelope code and the plurality of band-by-band codes in the order determined by the multiplexing order determination unit 12, and for outputting the multiplexed result as a sound code, reference numeral 14 denotes a demultiplexing order determination unit for determining the order in which the sound code is to be demultiplexed into a plurality of codes, reference numeral 15 denotes a demultiplexing unit for demultiplexing the sound code into the plurality of codes, such as the envelope code and the plurality of band-by-band codes, one by one in the order determined by the demultiplexing order determination unit 14 and for outputting them, and reference numeral 16 denotes a decoding unit for decoding the envelope code and the plurality of band-by-band codes output from the demultiplexing unit 15 so as to reproduce and output a sound signal. - Next, a description will be made as to the operation of the sound encoder and the operation of the sound decoder in accordance with
embodiment 1 of the present invention. The sound encoder performs all processes on a frame-by-frame basis, each frame having a length of 20 ms, for example. When a sound signal is input to theencoding unit 11 of the sound encoder, theencoding unit 11 performs a time to frequency domain transformation, such as a modulated lapped transform (MLT), on the sound signal so as to acquire frequency domain coefficients and divides these frequency domain coefficients into a plurality of portions respectively provided for a plurality of regions. In other words, the plurality of portions which constitute each frame correspond to the plurality of frequency regions into which a frequency spectrum obtained by converting the sound signal from time domain to frequency domain is divided, respectively. - The
encoding unit 11 then calculates a mean value of the frequency domain coefficients for each region and encodes an amplitude envelope that consists of a plurality of acquired mean values so as to output the coded amplitude envelope as an envelope code. Theencoding unit 11 then normalizes the frequency domain coefficients for each region with a value obtained by decoding the envelope code, quantizes the normalized frequency domain coefficients for each region, and acquires a fixed length code of length which is fixed for each quantization. Theencoding unit 11 Huffman-encodes (variable-length encodes) this fixed length code and outputs the acquired variable length code as each band-by-band code. Theencoding unit 11 can further determine and output a category control code of a fixed length for controlling the quantization stepsize for each region in addition to the envelope code and the plurality of band-by-band codes, and can multiplex the category control code as well as the envelope code and the plurality of band-by-band codes into a multiplexed code. - When receiving the plurality of codes from the
encoding unit 11, the multiplexingorder determination unit 12 classifies the plurality of band-by-band codes as main codes and classifies the remaining envelope code as an auxiliary code. The multiplexingorder determination unit 12 then determines the order in which the plurality of band-by-band codes, which are main codes, are to be multiplexed into the multiplexed code based on the envelope code which is an auxiliary code. - Concretely, the multiplexing
order determination unit 12 determines the order in the following manner. While keeping the order in which the envelope code, which is an auxiliary code, is to be multiplexed into the multiplexed code fixed so that it does not vary from frame to frame, the multiplexingorder determination unit 12 determines the order in which the plurality of band-by-band codes, which are main codes, are to be multiplexed into the multiplexed code in the order of the values of the amplitude envelope's elements obtained by decoding the envelope code, for example. Since the amplitude envelope is calculated as an intermediate variable in theencoding unit 11, it is possible to omit the decoding of the amplitude envelope in the multiplexingorder determination unit 12 by delivering the amplitude envelope from theencoding unit 11 to the multiplexingorder determination unit 12. The order does not simply indicate the order in which processes are to be done with time, but indicates where the plurality of codes are to be placed in the sound code into which they are to be multiplexed by the multiplexingunit 13. - When receiving the plurality of codes from the
encoding unit 11, the multiplexingunit 13 multiplexes the envelope code and the plurality of band-by-band codes in the order determined by the multiplexingorder determination unit 12 and then outputs the multiplexed result as a sound code. - When receiving the sound code from the sound encoder, the
demultiplexing unit 15 of the sound decoder separates only the auxiliary code, i.e., the envelope code from the sound code, and then outputs it. Thedemultiplexing unit 14 can separate only the auxiliary code without having to wait for inputting of the order determined on a frame-by-frame basis because the order in which the auxiliary code is multiplexed into the received multiplexed code is fixed in the multiplexingorder determination unit 12 of the corresponding sound encoder. - When receiving the envelope code which is an auxiliary code from the
demultiplexing unit 15, the demultiplexingorder determination unit 14 determines the order in which the plurality of main codes are to be separated by thedemultiplexing unit 15 based on the envelope code. The method of determining the order has to be made to be the same as that used by the multiplexingorder determination unit 12 of the corresponding sound encoder. When the amplitude envelope can be calculated prior to the processing done by the demultiplexingorder determination unit 14 within thedecoding unit 16, it is possible to omit the decoding of the envelope code in the demultiplexingorder determination unit 14 by delivering the amplitude envelope from thedecoding unit 16 to the demultiplexingorder determination unit 15. - The
demultiplexing unit 15 separates the plurality of main codes, i.e., the plurality of band-by-band codes from the sound code in the order determined by the demultiplexingorder determination unit 14 and then outputs them. When receiving the envelope code and the plurality of band-by-band codes from thedemultiplexing unit 15, thedecoding unit 16 decodes the envelope code so as to calculate the amplitude envelope and decodes the plurality of band-by-band codes so as to calculate the normalized frequency domain coefficients. Thedemultiplexing unit 15 then denormalizes the frequency domain coefficients by multiplying the value of the amplitude envelope for each region by the normalized frequency domain coefficients for each region, and performs a frequency to time domain transformation, such as an Inverse MLT (IMLT), on the denormalized frequency domain coefficients for each region so as to reproduce a sound signal. -
FIG. 3 is an explanatory drawing for showing an example of the amplitude envelope calculated by the sound encoder. InFIG. 3 , the horizontal axis indicates the frequency and the vertical axis indicates the value, i.e., the envelope value of each element of the amplitude envelope for each region. The total frequency region of the sound signal which is the target to be encoded is divided into fourteen regions, and these fourteen regions starting from the lowest-frequency region are consecutively numbered with numbers in ascending order. The amplitude envelope is a fourteen-dimensional vector having mean values of the fourteen portions of the frequency domain coefficients for the fourteen frequency regions as fourteen elements of the vector, and the envelope code is obtained as a result of encoding the amplitude envelope. The amplitude envelope shown inFIG. 3 has the same envelope values as those as shown inFIG. 12 . - In the case of the amplitude envelope of
FIG. 3 , the regions numbered 4, 8, and 12 have a larger envelope value than the other regions, and the order of the envelope values is as shown in the lowest part ofFIG. 3 . Each of the multiplexingorder determination unit 12 and the demultiplexingorder determination unit 14 decodes the input envelope code so as to calculate the order of the envelope values for the acquired amplitude envelope on a frame-by-frame basis. -
FIG. 4 is an explanatory drawing for explaining the structure of the sound code in the case of the amplitude envelope ofFIG. 3 . The multiplexingunit 13 multiplexes the envelope code into the head of the multiplexed code, and multiplexes the plurality of variable length codes, which are provided for the plurality of regions, respectively, i.e., the plurality of band-by-band codes into the multiplexed code in the above-mentioned order of the plurality of corresponding envelope values calculated on a frame-by-frame basis. Concretely, the multiplexingunit 13 multiplexes the band-by-band code numbered 4 and having the first order of envelope value, i.e., having the largest envelope value into an area of the multiplexed code next to the area in which the envelope code is placed. The multiplexingunit 13 then multiplexes the band-by-band code numbered 8 and having the second order of envelope value, i.e., having the second largest envelope value into an area of the multiplexed code next to the area in which the band-by-band code numbered 4 is placed. The multiplexingunit 13 repeatedly and sequentially multiplexes up to the band-by-band code numbered 14 and having the fourteenth order of envelope value, i.e., having the smallest envelope value. It is apparent from the comparison with the prior art sound code shown inFIG. 13 that the order in which the plurality of band-by-band codes are to be multiplexed differs from that ofFIG. 13 . - When a bit error occurs in the same bit position designated by X as that shown in
FIG. 13 , the band-by-band code numbered 6 separated by thedemultiplexing unit 15 of the sound decoder differs from the original one multiplexed by the sound encoder. Since a Huffman code is used as each of the plurality of band-by-band codes, the code length of the band-by-band code numbered 6 can be erroneously estimated with a considerable probability. As a result, since thedemultiplexing unit 15 cannot separate the band-by-band codes numbered 7, 9, 10, 11, 13, and 14, which follow the one numbered 6, from correct areas of the multiplexed code, these following codes separated by thedemultiplexing unit 15 become erroneous ones. Those erroneously decoded regions are hatched inFIGS. 3 and 4 . - It is apparent from the comparison between the erroneously decoded regions shown in
FIG. 3 and those shown inFIG. 13 that the band-by-band code numbered 12 associated with a region having a large envelope value is not decoded erroneously, while the number of band-by-band codes decoded erroneously and associated with regions having a small envelope value increases. Since the tone quality of the reproduced sound signal deteriorates when one band-by-band code associated with a region having a large envelope value, i.e., a large power is erroneously decoded, the deterioration in the tone quality decreases as compared with above-mentioned prior art examples. Thus, the present embodiment makes it possible to lower the probability of erroneously decoding band-by-band codes associated with regions which are determined to exert a large influence of errors (i.e., regions having a large envelope value in this case) by multiplexing those band-by-band codes into the multiplexed code so that they are arranged in areas closer to the head of the multiplexed code, thereby reducing the deterioration in the tone quality of the sound signal. -
FIG. 5 shows results of an evaluation of bit error sensibilities when a voice is input as the sound signal. In the figure, the horizontal axis indicates the position of each bit of the sound code, and the leftmost end of the axis corresponds to the head bit of the sound code and the rightmost end of the axis corresponds to the tail bit of the sound code. When the sound signal output from the sound decoder when a bit error occurs in each bit of the sound code is x (t) and the sound signal output from the sound decoder when no bit error occurs is s (t), and the vertical axis indicates the signal to noise ratio SNR, the signal to noise ratio SNR is given by the following equation: 1 SNR=logs(t)2(s(t)−x(t))2 - The larger the signal to noise ratio, the less the deterioration in the tone quality in
FIG. 5 . It is apparent from the comparison with above-mentioned prior art examples, as shown inFIG. 5 , that the structure of thisembodiment 1 makes the signal to noise ratio SNR of the sound signal larger, thereby reducing the deterioration in the tone quality of the sound signal due to the occurrence of bit errors. Furthermore, it is understood that even when the sound code is partially protected by using an error correction code an improvement can be effected in the remaining region not protected, because the improvement is effected in most of the bit positions of the sound code. - In this
embodiment 1, only the envelope code is used as an auxiliary code to determine the order in which the plurality of input codes are to be multiplexed into the multiplexed code and the multiplexed code is to be demultiplexed into a plurality of output codes. The present invention is not limited to this case, and various variants can be made. For example, a category control code for controlling the quantization stepsize can be multiplexed into the multiplexed code and the order in which the plurality of input codes are to be multiplexed into the multiplexed code can be modified according to the category control code. Furthermore, in thisembodiment 1, the order of the values of the amplitude envelope's elements obtained by decoding the envelope code is used unchanged as the order in which the plurality of input codes are to be multiplexed into the multiplexed code. As an alternative, it is possible to determine the order in which the plurality of input codes are to be multiplexed into the multiplexed code based on the order of the values of the amplitude envelope's elements obtained by decoding the envelope code by taking the fact that the human audibility varies from frequency to frequency into consideration. It is also possible to fixedly multiplex several band-by-band codes for regions with a lower frequency into the multiplexed code prior to the multiplexing of any other codes. - As can be seen from the above description, in accordance with this
embodiment 1, since the sound encoder is so constructed as to multiplex a plurality of codes into a sound code in the order determined by the multiplexingorder determination unit 12 and the sound decoder is so constructed as to demultiplex the plurality of codes from the sound code one by one in the order determined by the demultiplexingorder determination unit 14, the present embodiment makes it possible to adaptively multiplex a code that exerts a large influence upon other codes or a part of the code into a position of the sound code where there is a low possibility that the code or the part of the code is erroneously decoded. In other words, the present embodiment makes it possible to implement multiplexing and demultiplexing that reflect the distribution of bit error sensibilities which varies from frame to frame. As a result, the present embodiment offers an advantage of being able to provide a sound encoder and a sound decoder having high bit error immunity. -
FIG. 6 is a block diagram showing the structure of a sound encoder according toembodiment 2 of the present invention, andFIG. 7 is a block diagram showing the structure of a sound decoder according toembodiment 2 of the present invention. In the figure, reference numeral 21 denotes an encoding unit for accepting a sound signal which is the target to be coded, for each frame of a predetermined length, and for encoding the sound signal so as to produce a plurality of codes (a plurality of subframe-by-subframe power codes and a plurality of subframe-by-subframe shape codes, which are respectively provided for a plurality of subframes), reference numeral 22 denotes a multiplexing order determination unit for determining the order in which the plurality of shape codes are to be multiplexed into a multiplexed code, based on the plurality of subframe-by-subframe power codes output from the encoding unit 21, reference numeral 23 denotes a multiplexing unit for multiplexing the plurality of subframe-by-subframe shape codes and the plurality of subframe-by-subframe power codes into the multiplexed code in the order determined by the multiplexing order determination unit 22, and for outputting the multiplexed result as a sound code, reference numeral 24 denotes a demultiplexing order determination unit for determining the order in which the sound code is to be demultiplexed into a plurality of codes, reference numeral 25 denotes a demultiplexing unit for demultiplexing the sound code into the plurality of codes (i.e., the plurality of subframe-by-subframe power codes and the plurality of subframe-by-subframe shape codes) one by one in the order determined by the demultiplexing order determination unit 24 so as to output them, and reference numeral 26 denotes a decoding unit for decoding the plurality of subframe-by-subframe power codes and the plurality of subframe-by-subframe shape codes respectively, which are output from the demultiplexing unit 25, so as to reproduce and output a sound signal. - Next, a description will be made as to the operation of the sound encoder and the operation of the sound decoder. The sound encoder performs all processes on a frame-by-frame basis, each frame having a length of 20 ms, for example. When the
encoding unit 21 of the sound encoder accepts a sound signal, theencoding unit 21 encodes the sound signal for each of two subframes (i.e., sections) into which each frame of the sound signal is divided. For each of the two subframes, theencoding unit 21 acquires a power of a signal in each of the two subframes and then encodes the power so as to produce a power code. Theencoding unit 21 then normalizes the sound signal in each of the two subframes with a value obtained by decoding the power code, and encodes the normalized sound signal so as to produce a shape code. Theencoding unit 21 thus performs this encoding processing on each of the two subframes so as to produce and output two power codes, as subframe-by-subframe power codes, and two shape codes, as subframe-by-subframe shape codes. - All or part of each of the two shape codes is a variable length code such as a Huffman code. An envelope code and a plurality of band-by-band codes, which are explained in above-mentioned
embodiment 1, can be used as each of the shape codes. Each of the shape codes is not limited to a combination of an envelope code and a plurality of band-by-band codes, and one of various combinations of a spectrum code, an adaptive sound source code, a driving sound source code, and a gain code widely used in sound coding can be used as each of the shape codes. - When the multiplexing
order determination unit 22 receives the plurality of codes from theencoding unit 21, it classifies the plurality of subframe-by-subframe shape codes as main codes and classifies the plurality of subframe-by-subframe power codes as auxiliary codes. The multiplexingorder determination unit 22 then determines the order in which the plurality of subframe-by-subframe shape codes, which are main codes, are to be multiplexed into a sound code based on the plurality of subframe-by-subframe power codes which are auxiliary codes. The order does not simply indicate the order in which processes are to be done with time, but indicates where the plurality of codes are to be placed in the sound code into which they are to be multiplexed by the multiplexingunit 23. Concretely, the multiplexingorder determination unit 22 provides a frame-independent fixed order for multiplexing of the plurality of subframe-by-subframe power codes which are auxiliary codes, and determines only the order, in which the main codes are to be multiplexed into the sound code, on a frame-by-frame basis. For example, the multiplexingorder determination unit 22 determines the order, in which the main codes are to be multiplexed into the sound code, according to the comparison between the subframe-by-subframe powers acquired by decoding the plurality of subframe-by-subframe power codes which are auxiliary codes. Since the subframe-by-subframe powers are calculated as intermediate variables in theencoding unit 21, theencoding unit 21 can deliver the subframe-by-subframe powers to the multiplexingorder determination unit 22 and it is therefore to omit the decoding of the subframe-by-subframe power codes in the multiplexingorder determination unit 22. - When receiving the plurality of codes from the
encoding unit 21, the multiplexingunit 23 multiplexes both the subframe-by-subframe power codes and the subframe-by-subframe shape codes into a multiplexed code in the order determined by the multiplexingorder determination unit 22, and outputs the multiplexed result as a sound code. - When receiving the sound code from the sound encoder, the
demultiplexing unit 25 of the sound decoder demultiplexes only the auxiliary codes included in the sound code, i.e., the subframe-by-subframe power codes and then outputs them. Thedemultiplexing unit 25 can separate only the auxiliary codes without having to wait for inputting of the order determined on a frame-by-frame basis because the order in which the auxiliary codes are to be multiplexed into the received multiplexed code is fixed in the multiplexingorder determination unit 22 of the corresponding sound encoder. - When receiving the subframe-by-subframe power codes which are auxiliary codes from the
demultiplexing unit 25, the demultiplexingorder determination unit 24 determines the order in which the main codes are to be demultiplexed by thedemultiplexing unit 25 based on the subframe-by-subframe power codes. The method of determining the order has to be made to be the same as that used by the multiplexingorder determination unit 22 of the corresponding sound encoder. When the power for each subframe can be calculated prior to the processing done by the demultiplexingorder determination unit 24 within thedecoding unit 26, it is possible to omit the decoding of the subframe-by-subframe power codes in the demultiplexingorder determination unit 24 by delivering the power for each subframe from thedecoding unit 26 to the demultiplexingorder determination unit 24. - The
demultiplexing unit 25 separates the main codes included in the sound code, i.e., the subframe-by-subframe shape codes from the sound code in the order determined by the demultiplexingorder determination unit 24 and outputs them. When thedecoding unit 26 receives the subframe-by-subframe power codes and the subframe-by-subframe shape codes from thedemultiplexing unit 25, it decodes the subframe-by-subframe power codes so as to calculate the subframe-by-subframe powers and produces normalized sound signals for the two subframes from the subframe-by-subframe shape codes, respectively. Thedecoding unit 26 then denormalizes the sound signals by multiplying the subframe-by-subframe powers by the normalized sound signals for the two subframes, respectively, and outputs the combination of the two denormalized sound signals as a sound signal. -
FIG. 8 is an explanatory drawing for explaining the subframe-by-subframe powers produced in the sound encoder. InFIG. 8 , the horizontal axis indicates the time and it is assumed that the current frame is divided into two subframes: the first half which is referred to as the first subframe and the latter half which is referred to as the second subframe. In the figure, the sound signal for the current frame is shown in the upper part and the subframe-by-subframe powers (i.e., values obtained by decoding the subframe-by-subframe power codes) calculated for the sound signal are shown in the lower part. In the case of the sound signal ofFIG. 8 , the second subframe has a larger power than the first subframe. -
FIGS. 9A and 9B are explanatory drawings for explaining the structure of the sound code output by the sound encoder.FIG. 9A shows an example of the sound code in which the first subframe has a power equal to or greater than that of the second subframe, andFIG. 9B shows another example of the sound code in which the first subframe has a power less than that of the second subframe, as in the case ofFIG. 8 . As shown inFIGS. 9A and 9B , the subframe-by-subframe power codes which are auxiliary codes are fixedly multiplexed into the head of the sound code regardless of the difference between the power of the first subframe and that of the second subframe. The demultiplexingorder determination unit 24 compares the power of the first subframe with that of the second subframe, and gives a higher priority to one of the subframe-by-subframe shape codes, which is associated with the subframe that provides a larger power, so that the higher-priority subframe-by-subframe shape code is multiplexed into the sound code before the other shape code is multiplexed. - In general, each shape code is the one into which a plurality of codes are multiplexed. Since a variable length code is used as part or all of each shape code, the code length of each shape code can be erroneously estimated when a bit error occurs. As a result, the demultiplexing unit may separate other codes, which are placed behind a shape code at which a bit error occurs, erroneously. Therefore, as the demultiplexing unit reaches the tail of the sound code, codes can be decoded erroneously with a higher probability because of the occurrence of bit errors. As shown in
FIGS. 9A and 9B , the multiplexing unit of thisembodiment 2 multiplexes one subframe-by-subframe shape code with a larger power before multiplexing the other subframe-by-subframe shape code, thereby reducing the probability of erroneously decoding the former subframe-by-subframe shape code with a larger power. In general, since the deterioration in the tone quality of the sound signal is large when a subframe-by-subframe shape code with a larger power is erroneously decoded, the multiplexing as shown inFIGS. 9A and 9B makes it possible to reduce the deterioration in the tone quality of the sound signal by reducing the probability of erroneously decoding a subframe-by-subframe shape code with a larger power. - In this
embodiment 2, the number of subframes included in each frame is 2, but is not limited to 2. As an alternative, the number of subframes included in each frame can be 3 or more. Furthermore, in thisembodiment 2, the multiplexing unit of the sound encoder multiplexes the two power codes respectively provided for the two subframes of each frame into a sound code. As an alternative, the multiplexing unit can vector quantize the two subframe-by-subframe powers as a single unit and encode the vector quantized result so as to produce a power code on a frame-by-frame basis. Furthermore, instead of controlling the order in which the first subframe's shape code and the second subframe's shape code are to be multiplexed into the sound code, the multiplexing unit of the sound encoder can multiplex a part of each shape code into the sound code in a fixed order so that it is placed immediately behind the two power codes, and can control the order in which the remainder of the first subframe's shape code and the remainder of the second subframe's shape code are to be multiplexed according to the subframe-by-subframe powers. As an alternative, the multiplexing unit of the sound encoder can divide the shape code of each subframe into a plurality of portions, and can finely control the order in which the plurality of portions are to be multiplexed according to a plurality of powers respectively provided for them. - In addition, in accordance with this
embodiment 2, only the two power codes can be used, as auxiliary codes, to determine the order in which the first subframe's shape code and the second subframe's shape code are to be multiplexed into the sound code. The present embodiment is not limited to the case, and any other code can be used, as an auxiliary code, if the importance of each subframe is determined using the other code. In this variant, the combination of the other code and the two power codes are used as auxiliary codes, or only the other code is used as an auxiliary code. - As can be seen from the above description, in accordance with this
embodiment 2, the sound encoder is so constructed as to multiplex a plurality of codes into a sound code in the order determined by the multiplexingorder determination unit 22, and the sound decoder is so constructed as to demultiplex the sound code into the plurality of codes one by one in the order determined by the demultiplexingorder determination unit 24 and to output them. The present embodiment therefore makes it possible to adaptively multiplex a code that exerts a large influence upon other codes or a part of the code into a position of the sound code where there is a low possibility that the code or the part of the code is erroneously decoded. In other words, the present embodiment makes it possible to implement multiplexing and demultiplexing that reflect the distribution of bit error sensibilities which varies from frame to frame. As a result, the present embodiment offers an advantage of being able to provide a sound encoder and a sound decoder having high bit error immunity. - In a sound encoder according to a variant of either of the first to second embodiments, the multiplexing unit can interchange a plurality of codes multiplexed into a multiplexed code based on the order determined by the multiplexing order determination unit after multiplexing the plurality of codes into the multiplexed code in a fixed order once, instead of multiplexing the plurality of codes into the multiplexed code in the determined order. Even in this case, the same advantages are provided. Similarly, in a sound decoder according to a variant of either of the first to fifth embodiments, the demultiplexing unit can demultiplex an input multiplexed code into a plurality of codes in a fixed order after interchanging the plurality of codes multiplexed into the multiplexed code based on the order determined by the demultiplexing order determination unit once, instead of demultiplexing the multiplexed code into the plurality of codes in the determined order. Even in this case, the same advantages are provided.
- Many widely different embodiments of the present invention may be constructed without departing from the spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific embodiments described in the specification, except as defined in the appended claims.
Claims (2)
1. A sound processing system comprising a sound encoder and a sound decoder
a sound encoder including:
an encoding unit for producing an amplitude envelope as an intermediate value, the amplitude envelope including a plurality of elements, and for encoding a sound signal on a frame-by-frame basis so as to produce a plurality of codes, part or all of which are variable length codes,
the plurality of codes including main codes and an auxiliary code, the auxiliary code being produced based on the amplitude envelope;
a multiplexing order determination unit for analyzing the amplitude envelope produced by said encoding unit to obtain an order of the value corresponding to the elements of the amplitude envelope, so as to determine an order in which the main codes are to be multiplexed; and
a multiplexing unit for multiplexing the main codes in the order determined by said multiplexing order determination unit and multiplexing the auxiliary code in a same fixed order for each frame;
a sound decoder including:
a first demultiplexing unit for receiving a sound code on a frame-by-frame basis and for demultiplexing the sound code into an auxiliary code which is multiplexed for each frame in the same fixed order;
a demultiplexing order determination step for determining an order in which the sound code is to be demultiplexed into main codes, part or all of which are variable length codes, based on an order of the values of the amplitude envelope's elements obtained by an amplitude envelope as an intermediate variable which is produced by the auxiliary code;
a second demultiplexing step for demultiplexing the sound code into the main codes in the order determined by said demultiplexing order determination step and for outputting the main codes; and
a decoding step for decoding the main codes output from said demultiplexing step so as to reproduce a sound signal.
2. A sound processing method comprising a sound encoding method and a sound decoding method
a sound encoding method including:
an encoding step for producing an amplitude envelope as an intermediate value, the amplitude envelope including a plurality of elements, and for encoding a sound signal on a frame-by-frame basis so as to produce a plurality of codes, part or all of which are variable length codes,
the plurality of codes including main codes and an auxiliary code, the auxiliary code being produced based on an amplitude envelope;
a multiplexing order determination step for analyzing the amplitude envelope produced by said encoding unit to obtain an order of the value corresponding to the elements of the amplitude envelope, so as to determine an order in which the main codes are to be multiplexed; and
a multiplexing step for multiplexing the main codes in the order determined by said multiplexing order determination step and multiplexing the auxiliary code in a same fixed order for each frame;
a sound decoding method including:
a first demultiplexing step for receiving a sound code on a frame-by-frame basis, and for demultiplexing the sound code into an auxiliary code which is multiplexed for each frame in the same fixed order;
a demultiplexing order determination step for determining an order in which the sound code is to be demultiplexed into main codes, part or all of which are variable length codes, based on an order of the values of the amplitude envelope's elements obtained by an amplitude envelope as an intermediate variable which is produced by the auxiliary code;
a second demultiplexing step for demultiplexing the sound code into the main codes in the order determined by said demultiplexing order determination step and for outputting the main codes; and
a decoding step for decoding the main codes output from said demultiplexing step so as to reproduce a sound signal.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/907,928 US20080071552A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2001266253A JP3469567B2 (en) | 2001-09-03 | 2001-09-03 | Acoustic encoding device, acoustic decoding device, acoustic encoding method, and acoustic decoding method |
JP2001-266253 | 2001-09-03 | ||
US10/222,902 US7191126B2 (en) | 2001-09-03 | 2002-08-19 | Sound encoder and sound decoder performing multiplexing and demultiplexing on main codes in an order determined by auxiliary codes |
US11/701,461 US20070136049A1 (en) | 2001-09-03 | 2007-02-02 | Sound encoder and sound decoder |
US11/907,928 US20080071552A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/701,461 Division US20070136049A1 (en) | 2001-09-03 | 2007-02-02 | Sound encoder and sound decoder |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080071552A1 true US20080071552A1 (en) | 2008-03-20 |
Family
ID=19092583
Family Applications (11)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/222,902 Expired - Fee Related US7191126B2 (en) | 2001-09-03 | 2002-08-19 | Sound encoder and sound decoder performing multiplexing and demultiplexing on main codes in an order determined by auxiliary codes |
US11/701,461 Abandoned US20070136049A1 (en) | 2001-09-03 | 2007-02-02 | Sound encoder and sound decoder |
US11/907,923 Expired - Lifetime US7756699B2 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound encoding method with multiplexing order determination |
US11/907,928 Abandoned US20080071552A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,924 Abandoned US20080052088A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,927 Abandoned US20080052085A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,917 Abandoned US20080281603A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,926 Abandoned US20080052084A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,921 Abandoned US20080052086A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,922 Expired - Lifetime US7756698B2 (en) | 2001-09-03 | 2007-10-18 | Sound decoder and sound decoding method with demultiplexing order determination |
US12/773,396 Abandoned US20100217608A1 (en) | 2001-09-03 | 2010-05-04 | Sound decoder and sound decoding method with demultiplexing order determination |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/222,902 Expired - Fee Related US7191126B2 (en) | 2001-09-03 | 2002-08-19 | Sound encoder and sound decoder performing multiplexing and demultiplexing on main codes in an order determined by auxiliary codes |
US11/701,461 Abandoned US20070136049A1 (en) | 2001-09-03 | 2007-02-02 | Sound encoder and sound decoder |
US11/907,923 Expired - Lifetime US7756699B2 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound encoding method with multiplexing order determination |
Family Applications After (7)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/907,924 Abandoned US20080052088A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,927 Abandoned US20080052085A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,917 Abandoned US20080281603A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,926 Abandoned US20080052084A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,921 Abandoned US20080052086A1 (en) | 2001-09-03 | 2007-10-18 | Sound encoder and sound decoder |
US11/907,922 Expired - Lifetime US7756698B2 (en) | 2001-09-03 | 2007-10-18 | Sound decoder and sound decoding method with demultiplexing order determination |
US12/773,396 Abandoned US20100217608A1 (en) | 2001-09-03 | 2010-05-04 | Sound decoder and sound decoding method with demultiplexing order determination |
Country Status (2)
Country | Link |
---|---|
US (11) | US7191126B2 (en) |
JP (1) | JP3469567B2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9536534B2 (en) | 2011-04-20 | 2017-01-03 | Panasonic Intellectual Property Corporation Of America | Speech/audio encoding apparatus, speech/audio decoding apparatus, and methods thereof |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3469567B2 (en) * | 2001-09-03 | 2003-11-25 | 三菱電機株式会社 | Acoustic encoding device, acoustic decoding device, acoustic encoding method, and acoustic decoding method |
US8497800B2 (en) * | 2003-09-19 | 2013-07-30 | Trimble Navigation Limited | Method and a system for communicating information to a land surveying rover located in an area without cellular coverage |
JP4548348B2 (en) * | 2006-01-18 | 2010-09-22 | カシオ計算機株式会社 | Speech coding apparatus and speech coding method |
WO2008035949A1 (en) * | 2006-09-22 | 2008-03-27 | Samsung Electronics Co., Ltd. | Method, medium, and system encoding and/or decoding audio signals by using bandwidth extension and stereo coding |
CN101918999B (en) | 2007-11-12 | 2013-11-13 | 尼尔森(美国)有限公司 | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
US8457951B2 (en) | 2008-01-29 | 2013-06-04 | The Nielsen Company (Us), Llc | Methods and apparatus for performing variable black length watermarking of media |
US9160988B2 (en) | 2009-03-09 | 2015-10-13 | The Nielsen Company (Us), Llc | System and method for payload encoding and decoding |
US8700410B2 (en) * | 2009-06-18 | 2014-04-15 | Texas Instruments Incorporated | Method and system for lossless value-location encoding |
JP5997592B2 (en) * | 2012-04-27 | 2016-09-28 | 株式会社Nttドコモ | Speech decoder |
WO2014052431A1 (en) | 2012-09-27 | 2014-04-03 | Dolby Laboratories Licensing Corporation | Method for improving perceptual continuity in a spatial teleconferencing system |
US11196594B2 (en) * | 2019-02-28 | 2021-12-07 | Nokia Solutions And Networks Oy | Probabilistic signal shaping using multiple codebooks |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4821324A (en) * | 1984-12-24 | 1989-04-11 | Nec Corporation | Low bit-rate pattern encoding and decoding capable of reducing an information transmission rate |
US5265167A (en) * | 1989-04-25 | 1993-11-23 | Kabushiki Kaisha Toshiba | Speech coding and decoding apparatus |
US5303058A (en) * | 1990-10-22 | 1994-04-12 | Fujitsu Limited | Data processing apparatus for compressing and reconstructing image data |
US5600754A (en) * | 1992-01-28 | 1997-02-04 | Qualcomm Incorporated | Method and system for the arrangement of vocoder data for the masking of transmission channel induced errors |
US5717394A (en) * | 1993-02-10 | 1998-02-10 | Ricoh Company Ltd. | Method and apparatus for encoding and decoding data |
US5831977A (en) * | 1996-09-04 | 1998-11-03 | Ericsson Inc. | Subtractive CDMA system with simultaneous subtraction in code space and direction-of-arrival space |
US5956674A (en) * | 1995-12-01 | 1999-09-21 | Digital Theater Systems, Inc. | Multi-channel predictive subband audio coder using psychoacoustic adaptive bit allocation in frequency, time and over the multiple channels |
US6078879A (en) * | 1997-07-11 | 2000-06-20 | U.S. Philips Corporation | Transmitter with an improved harmonic speech encoder |
US6131083A (en) * | 1997-12-24 | 2000-10-10 | Kabushiki Kaisha Toshiba | Method of encoding and decoding speech using modified logarithmic transformation with offset of line spectral frequency |
US20030019348A1 (en) * | 2001-07-25 | 2003-01-30 | Hirohisa Tasaki | Sound encoder and sound decoder |
US6952432B2 (en) * | 1996-09-02 | 2005-10-04 | Kabushiki Kaisha Toshiba | Information transmission method and encoding/decoding apparatus and encoding- multiplexing/decoding- demultiplexing apparatus in information transmission system to which information transmission method is applied |
US6975254B1 (en) * | 1998-12-28 | 2005-12-13 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Methods and devices for coding or decoding an audio signal or bit stream |
US6978236B1 (en) * | 1999-10-01 | 2005-12-20 | Coding Technologies Ab | Efficient spectral envelope coding using variable time/frequency resolution and time/frequency switching |
US7136418B2 (en) * | 2001-05-03 | 2006-11-14 | University Of Washington | Scalable and perceptually ranked signal coding and decoding |
US7191126B2 (en) * | 2001-09-03 | 2007-03-13 | Mitsubishi Denki Kabushiki Kaisha | Sound encoder and sound decoder performing multiplexing and demultiplexing on main codes in an order determined by auxiliary codes |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5678898A (en) | 1979-11-30 | 1981-06-29 | Matsushita Electric Ind Co Ltd | Parameterrinformation compacting method |
JPH0754438B2 (en) | 1985-03-20 | 1995-06-07 | 日本電気株式会社 | Voice processor |
JP2523286B2 (en) | 1986-08-01 | 1996-08-07 | 日本電信電話株式会社 | Speech encoding and decoding method |
JPH0833746B2 (en) | 1987-02-17 | 1996-03-29 | シャープ株式会社 | Band division coding device for voice and musical sound |
JP2692104B2 (en) * | 1988-02-12 | 1997-12-17 | 株式会社日立製作所 | Voice multiplexing system |
JP3007120B2 (en) | 1990-07-17 | 2000-02-07 | 宇部興産株式会社 | Monoclonal antibody against reverse transcriptase of human immunodeficiency virus, its production method and its antibody producing strain |
US5253326A (en) * | 1991-11-26 | 1993-10-12 | Codex Corporation | Prioritization method and device for speech frames coded by a linear predictive coder |
US5864650A (en) * | 1992-09-16 | 1999-01-26 | Fujitsu Limited | Speech encoding method and apparatus using tree-structure delta code book |
JPH06259096A (en) | 1993-03-04 | 1994-09-16 | Matsushita Electric Ind Co Ltd | Audio encoding device |
JPH0844393A (en) | 1994-07-28 | 1996-02-16 | Sony Corp | Processing device for audio encoded data |
US5612445A (en) * | 1995-02-15 | 1997-03-18 | Arizona Chemical Co. | Ultraviolet curable epoxidized alkyds |
JPH08251031A (en) | 1995-03-07 | 1996-09-27 | Mitsubishi Electric Corp | Encoder and decoder |
JP3311234B2 (en) * | 1995-04-24 | 2002-08-05 | キヤノン株式会社 | Network system, node device, and transmission control method |
JP3353868B2 (en) | 1995-10-09 | 2002-12-03 | 日本電信電話株式会社 | Audio signal conversion encoding method and decoding method |
US5956341A (en) * | 1996-12-13 | 1999-09-21 | International Business Machines Corporation | Method and system for optimizing data transmission line bandwidth occupation in a multipriority data traffic environment |
JPH10234014A (en) * | 1997-02-20 | 1998-09-02 | Matsushita Electric Ind Co Ltd | Image decoding method, image decoder, image multiplexing method, image multiplexer and recording medium |
DE19743662A1 (en) | 1997-10-02 | 1999-04-08 | Bosch Gmbh Robert | Bit rate scalable audio data stream generation method |
KR100335609B1 (en) * | 1997-11-20 | 2002-10-04 | 삼성전자 주식회사 | Scalable audio encoding/decoding method and apparatus |
US6405338B1 (en) * | 1998-02-11 | 2002-06-11 | Lucent Technologies Inc. | Unequal error protection for perceptual audio coders |
US6230130B1 (en) * | 1998-05-18 | 2001-05-08 | U.S. Philips Corporation | Scalable mixing for speech streaming |
JP3522137B2 (en) | 1998-12-18 | 2004-04-26 | 富士通株式会社 | Variable rate encoding / decoding device |
JP3594829B2 (en) | 1999-02-24 | 2004-12-02 | アルパイン株式会社 | MPEG audio decoding method |
JP3434260B2 (en) | 1999-03-23 | 2003-08-04 | 日本電信電話株式会社 | Audio signal encoding method and decoding method, these devices and program recording medium |
JP3438651B2 (en) * | 1999-05-31 | 2003-08-18 | 日本電気株式会社 | Packet multiplexer |
US7054279B2 (en) * | 2000-04-07 | 2006-05-30 | Broadcom Corporation | Method and apparatus for optimizing signal transformation in a frame-based communications network |
US6760699B1 (en) * | 2000-04-24 | 2004-07-06 | Lucent Technologies Inc. | Soft feature decoding in a distributed automatic speech recognition system for use over wireless channels |
JP4318412B2 (en) * | 2001-08-08 | 2009-08-26 | 富士通株式会社 | Transmission / reception apparatus and transmission / reception method in communication system |
DE10230809B4 (en) * | 2002-07-08 | 2008-09-11 | T-Mobile Deutschland Gmbh | Method for transmitting audio signals according to the method of prioritizing pixel transmission |
-
2001
- 2001-09-03 JP JP2001266253A patent/JP3469567B2/en not_active Expired - Lifetime
-
2002
- 2002-08-19 US US10/222,902 patent/US7191126B2/en not_active Expired - Fee Related
-
2007
- 2007-02-02 US US11/701,461 patent/US20070136049A1/en not_active Abandoned
- 2007-10-18 US US11/907,923 patent/US7756699B2/en not_active Expired - Lifetime
- 2007-10-18 US US11/907,928 patent/US20080071552A1/en not_active Abandoned
- 2007-10-18 US US11/907,924 patent/US20080052088A1/en not_active Abandoned
- 2007-10-18 US US11/907,927 patent/US20080052085A1/en not_active Abandoned
- 2007-10-18 US US11/907,917 patent/US20080281603A1/en not_active Abandoned
- 2007-10-18 US US11/907,926 patent/US20080052084A1/en not_active Abandoned
- 2007-10-18 US US11/907,921 patent/US20080052086A1/en not_active Abandoned
- 2007-10-18 US US11/907,922 patent/US7756698B2/en not_active Expired - Lifetime
-
2010
- 2010-05-04 US US12/773,396 patent/US20100217608A1/en not_active Abandoned
Patent Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4821324A (en) * | 1984-12-24 | 1989-04-11 | Nec Corporation | Low bit-rate pattern encoding and decoding capable of reducing an information transmission rate |
US5265167A (en) * | 1989-04-25 | 1993-11-23 | Kabushiki Kaisha Toshiba | Speech coding and decoding apparatus |
US5303058A (en) * | 1990-10-22 | 1994-04-12 | Fujitsu Limited | Data processing apparatus for compressing and reconstructing image data |
US5600754A (en) * | 1992-01-28 | 1997-02-04 | Qualcomm Incorporated | Method and system for the arrangement of vocoder data for the masking of transmission channel induced errors |
US5717394A (en) * | 1993-02-10 | 1998-02-10 | Ricoh Company Ltd. | Method and apparatus for encoding and decoding data |
US5956674A (en) * | 1995-12-01 | 1999-09-21 | Digital Theater Systems, Inc. | Multi-channel predictive subband audio coder using psychoacoustic adaptive bit allocation in frequency, time and over the multiple channels |
US6487535B1 (en) * | 1995-12-01 | 2002-11-26 | Digital Theater Systems, Inc. | Multi-channel audio encoder |
US6952432B2 (en) * | 1996-09-02 | 2005-10-04 | Kabushiki Kaisha Toshiba | Information transmission method and encoding/decoding apparatus and encoding- multiplexing/decoding- demultiplexing apparatus in information transmission system to which information transmission method is applied |
US5831977A (en) * | 1996-09-04 | 1998-11-03 | Ericsson Inc. | Subtractive CDMA system with simultaneous subtraction in code space and direction-of-arrival space |
US6078879A (en) * | 1997-07-11 | 2000-06-20 | U.S. Philips Corporation | Transmitter with an improved harmonic speech encoder |
US6131083A (en) * | 1997-12-24 | 2000-10-10 | Kabushiki Kaisha Toshiba | Method of encoding and decoding speech using modified logarithmic transformation with offset of line spectral frequency |
US6975254B1 (en) * | 1998-12-28 | 2005-12-13 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Methods and devices for coding or decoding an audio signal or bit stream |
US6978236B1 (en) * | 1999-10-01 | 2005-12-20 | Coding Technologies Ab | Efficient spectral envelope coding using variable time/frequency resolution and time/frequency switching |
US7136418B2 (en) * | 2001-05-03 | 2006-11-14 | University Of Washington | Scalable and perceptually ranked signal coding and decoding |
US20030019348A1 (en) * | 2001-07-25 | 2003-01-30 | Hirohisa Tasaki | Sound encoder and sound decoder |
US7315817B2 (en) * | 2001-07-25 | 2008-01-01 | Mitsubishi Denki Kabushiki Kaisha | Sound encoder and sound decoder |
US7191126B2 (en) * | 2001-09-03 | 2007-03-13 | Mitsubishi Denki Kabushiki Kaisha | Sound encoder and sound decoder performing multiplexing and demultiplexing on main codes in an order determined by auxiliary codes |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9536534B2 (en) | 2011-04-20 | 2017-01-03 | Panasonic Intellectual Property Corporation Of America | Speech/audio encoding apparatus, speech/audio decoding apparatus, and methods thereof |
US10446159B2 (en) | 2011-04-20 | 2019-10-15 | Panasonic Intellectual Property Corporation Of America | Speech/audio encoding apparatus and method thereof |
Also Published As
Publication number | Publication date |
---|---|
US20080052088A1 (en) | 2008-02-28 |
US20080071551A1 (en) | 2008-03-20 |
JP3469567B2 (en) | 2003-11-25 |
US20080052086A1 (en) | 2008-02-28 |
US20030055656A1 (en) | 2003-03-20 |
US20080052084A1 (en) | 2008-02-28 |
JP2003076397A (en) | 2003-03-14 |
US20080052087A1 (en) | 2008-02-28 |
US20100217608A1 (en) | 2010-08-26 |
US7191126B2 (en) | 2007-03-13 |
US20080281603A1 (en) | 2008-11-13 |
US7756698B2 (en) | 2010-07-13 |
US20070136049A1 (en) | 2007-06-14 |
US7756699B2 (en) | 2010-07-13 |
US20080052085A1 (en) | 2008-02-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7756699B2 (en) | Sound encoder and sound encoding method with multiplexing order determination | |
US5778335A (en) | Method and apparatus for efficient multiband celp wideband speech and music coding and decoding | |
KR100304055B1 (en) | Method for signalling a noise substitution during audio signal coding | |
EP1905000B1 (en) | Selectively using multiple entropy models in adaptive coding and decoding | |
KR100871999B1 (en) | Audio coding | |
CN102124655B (en) | Method for encoding a symbol, method for decoding a symbol, method for transmitting a symbol from a transmitter to a receiver, encoder, decoder and system for transmitting a symbol from a transmitter to a receiver | |
US20020049586A1 (en) | Audio encoder, audio decoder, and broadcasting system | |
KR20010021226A (en) | A digital acoustic signal coding apparatus, a method of coding a digital acoustic signal, and a recording medium for recording a program of coding the digital acoustic signal | |
KR20020019483A (en) | Method for improving the coding efficiency of an audio signal | |
US5113448A (en) | Speech coding/decoding system with reduced quantization noise | |
EP1020848A2 (en) | Method for transmitting auxiliary information in a vocoder stream | |
JP2001265397A (en) | Method and device for vocoding input signal | |
US7315817B2 (en) | Sound encoder and sound decoder | |
JPH01261930A (en) | Sound encoding/decoding system | |
Ding | Wideband audio over narrowband low-resolution media | |
JPS6337400A (en) | Voice encoding | |
US6098045A (en) | Sound compression/decompression method and system | |
EP1334485B1 (en) | Speech codec and method for generating a vector codebook and encoding/decoding speech signals | |
JPH0481199B2 (en) |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |