JP2003264466A5

JP2003264466A5 -

Info

Publication number: JP2003264466A5
Application number: JP2002061400A
Authority: JP
Filing date: 2002-03-07
Publication date: 2005-08-25
Anticipated expiration: 2022-03-07

Claims

In a decoding device that decodes encoded data that is encoded data and includes at least characteristic data that represents the characteristics of the data,
Determination means for determining the correctness of the characteristic data and outputting mismatch information representing the determination result;
A decoding device comprising: decoding means for decoding the encoded data based on the mismatch information.

The determination unit determines the correctness of the characteristic data based on a decoding result obtained by decoding the encoded data or information obtained in a process of decoding the encoded data. The decoding device described.

Characteristic data extracting means for extracting the characteristic data from the encoded data;
An actual characteristic extracting means for extracting an actual characteristic that is an actual characteristic of the original data corresponding to the encoded data from the encoded data; and
The decoding apparatus according to claim 1, wherein the determination unit determines the correctness of the characteristic data by comparing the characteristic data with an actual characteristic.

The decoding means includes
Of the decoded data obtained by decoding the encoded data, a class tap used for classifying the focused decoded data of interest into any one of a plurality of classes, Class tap extraction means for extracting from encoded data;
Classifying means for classifying the decoded data of interest based on the class tap and outputting a class code of a corresponding class;
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
A prediction tap extraction means for extracting, from the encoded data, a prediction tap used for a predetermined prediction calculation with the tap coefficient for the target decoded data;
The decoding apparatus according to claim 1, further comprising: a prediction calculation unit that obtains the decoded data of interest by performing a prediction calculation using the prediction tap and the tap coefficient.

The decoding device according to claim 4, wherein the class tap extraction unit extracts a class tap from the encoded data based on the mismatch information.

The decoding apparatus according to claim 4, wherein the class classification unit classifies the target decoded data based on the mismatch information.

The decoding apparatus according to claim 4, wherein the prediction tap extraction unit extracts a prediction tap from the encoded data based on the mismatch information.

The decoding apparatus according to claim 1, wherein the encoded data is obtained by encoding audio data by a CELP (Code Excited Linear Prediction coding) method.

Characteristic data extracting means for extracting an L code representing lag from the encoded data as the characteristic data;
An actual characteristic extraction unit that decodes the encoded data and obtains a pitch period of the decoded audio data obtained as a result as an actual characteristic that is an actual characteristic of the original audio data;
The decoding apparatus according to claim 8, wherein the determination unit determines the correctness of the L code based on a difference between a time represented by the L code and a pitch period as the actual characteristic.

The decoding means includes
CELP decoding means for decoding the encoded data according to a CELP scheme and outputting CELP decoded data;
Of the quality-enhanced data that is focused on among the quality-enhanced data obtained by improving the quality of the CELP decoded data, classify the quality-enhanced data of interest into one of a plurality of classes. Class tap extracting means for extracting the class tap used for the above from the CELP decoded data;
Based on the class tap, classifying the focused high quality data, class classification means for outputting the class code of the corresponding class,
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
A prediction tap extraction unit that extracts a prediction tap used for a predetermined prediction calculation with the tap coefficient from the CELP decoded data, and a prediction calculation using the prediction tap and the tap coefficient with respect to the high quality data of interest. The decoding apparatus according to claim 8, further comprising: a prediction calculation unit that obtains the attention-enhanced quality-enhanced data.

The decoding device according to claim 10, wherein the class tap extraction unit extracts a class tap from the CELP decoded data based on the mismatch information.

The decoding apparatus according to claim 10, wherein the class classification unit classifies the target decoded data based on the mismatch information.

The decoding device according to claim 10, wherein the prediction tap extraction unit extracts a prediction tap from the CELP decoded data based on the mismatch information.

The decoding device according to claim 10, wherein the class tap extraction unit extracts the class tap from the encoded data.

The decoding device according to claim 10, wherein the prediction tap extraction unit extracts the prediction tap also from the encoded data.

The decoding means includes
Residual signal decoding means for decoding the encoded data and outputting a residual signal for driving a speech synthesis filter;
Among the high-quality residual signals, which are residual signals for obtaining high-quality speech synthesis filter outputs, a plurality of high-quality residual signals of interest for the high-quality residual signals of interest. Class tap extracting means for extracting a class tap used for classifying into any one of the classes of the residual signal from the residual signal;
Classifying means for classifying the attention-enhanced residual signal based on the class tap and outputting a class code of a corresponding class;
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
A prediction tap extraction unit that extracts a prediction tap used for a predetermined prediction calculation with the tap coefficient for the attention-enhanced residual signal, from the residual signal;
Prediction calculation means for obtaining the attention-enhanced quality residual signal by performing a prediction calculation using the prediction tap and the tap coefficient;
The decoding apparatus according to claim 8, further comprising: the speech synthesis filter that filters the quality-enhanced residual signal and outputs high-quality decoded speech.

The decoding device according to claim 16, wherein the class tap extraction unit extracts a class tap from the residual signal based on the mismatch information.

The decoding apparatus according to claim 16, wherein the class classification unit classifies the attention-enhanced quality-enhanced residual signal based on the mismatch information.

The decoding apparatus according to claim 16, wherein the prediction tap extraction unit extracts a prediction tap from the residual signal based on the mismatch information.

The decoding apparatus according to claim 16, wherein the class tap extraction unit extracts the class tap from the encoded data.

The decoding apparatus according to claim 16, wherein the prediction tap extraction unit extracts the prediction tap also from the encoded data.

The decoding means includes
Linear prediction coefficient decoding means for decoding the encoded data and outputting linear prediction coefficients that serve as filter coefficients of a speech synthesis filter;
Among the high-quality linear prediction coefficients that are the linear prediction coefficients for obtaining a high-quality speech synthesis filter output, the target high-quality linear prediction coefficients of the high-quality linear prediction coefficients of interest A class tap extracting means for extracting a class tap used for classifying into any of the classes of the linear prediction coefficients;
Classifying means for classifying the focused high-quality linear prediction coefficient based on the class tap and outputting a class code of a corresponding class;
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
A prediction tap extracting unit that extracts a prediction tap used for a predetermined prediction calculation with the tap coefficient from the linear prediction coefficient, and a prediction calculation using the prediction tap and the tap coefficient. By performing the prediction calculation means for obtaining the attention high quality linear prediction coefficient,
The decoding apparatus according to claim 8, further comprising: the speech synthesis filter that performs filtering using the high-quality linear prediction coefficient as a filter coefficient and outputs high-quality decoded speech.

The decoding device according to claim 22, wherein the class tap extraction unit extracts a class tap from the linear prediction coefficient based on the mismatch information.

23. The decoding apparatus according to claim 22, wherein the class classification unit classifies the focused high-quality linear prediction coefficient based on the mismatch information.

The decoding apparatus according to claim 22, wherein the prediction tap extraction unit extracts a prediction tap from the linear prediction coefficient based on the mismatch information.

The decoding apparatus according to claim 22, wherein the class tap extraction unit extracts the class tap from the encoded data.

The decoding apparatus according to claim 22, wherein the prediction tap extraction unit extracts the prediction tap also from the encoded data.

The decoding apparatus according to claim 1, wherein the encoded data is obtained by encoding image data according to an MPEG (Moving Picture Experts Group) method.

Characteristic data extraction means for extracting a DCT (Discrete Cosine Transform) type of a block from the encoded data as the characteristic data;
An actual characteristic extracting means for obtaining a line correlation that is a correlation between lines of decoded image data obtained by decoding the encoded data as an actual characteristic that is an actual characteristic of the original image data;
The decoding device according to claim 28, wherein the determination unit determines the correctness of the DCT type based on the line correlation.

The actual characteristic extracting means includes
MPEG decoding means for decoding the encoded data and outputting the decoded image data;
30. The decoding device according to claim 29, further comprising: a line correlation calculation unit that obtains the line correlation based on the decoded image data.

The actual characteristic extracting means includes
Two-dimensional DCT coefficient extraction means for extracting a two-dimensional DCT coefficient from the encoded data;
30. The decoding apparatus according to claim 29, further comprising: line correlation calculation means for obtaining the line correlation based on the two-dimensional DCT coefficient.

The actual characteristic extracting means includes
Two-dimensional DCT coefficient extraction means for extracting a two-dimensional DCT coefficient from the encoded data;
One-dimensional DCT coefficient calculating means for obtaining a one-dimensional DCT coefficient from the two-dimensional DCT coefficient;
30. The decoding apparatus according to claim 29, further comprising: line correlation calculation means for obtaining the line correlation based on the one-dimensional DCT coefficient.

The decoding means includes
MPEG decoding means for decoding the encoded data according to the MPEG system and outputting MPEG decoded data;
Of the high quality data obtained by improving the quality of the MPEG decoded data, the high quality data of interest is classified into one of a plurality of classes. Class tap extracting means for extracting the class tap used for the above from the MPEG decoded data;
Based on the class tap, classifying the focused high quality data, class classification means for outputting the class code of the corresponding class,
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
Predictive tap extraction means for extracting prediction taps used for predetermined prediction calculation with the tap coefficients from the MPEG decoded data, and prediction calculation using the prediction taps and tap coefficients for the high quality data of interest 29. The decoding apparatus according to claim 28, further comprising: predictive calculation means for obtaining the attention-enhanced quality data.

The decoding device according to claim 33, wherein the class tap extraction unit extracts a class tap from the MPEG decoded data based on the mismatch information.

The decoding device according to claim 33, wherein the class classification means classifies the focused decoded data based on the mismatch information.

The decoding device according to claim 33, wherein the prediction tap extraction unit extracts a prediction tap from the MPEG decoded data based on the mismatch information.

The decoding device according to claim 33, wherein the class tap extraction unit extracts the class tap also from the encoded data.

The decoding apparatus according to claim 33, wherein the prediction tap extraction unit extracts the prediction tap also from the encoded data.

The decoding means includes
Two-dimensional DCT coefficient acquisition means for acquiring a two-dimensional DCT coefficient obtained by two-dimensional DCT-transforming image data from the encoded data;
Of the quality-enhanced data to which attention is paid out of the quality-enhanced data obtained by improving the quality of MPEG-decoded data obtained by MPEG-decoding the encoded data, the noticed quality-enhanced data is selected from any of a plurality of classes. A class tap extracting means for extracting a class tap used for classifying into the class from the two-dimensional DCT coefficient;
Based on the class tap, classifying the focused high quality data, class classification means for outputting the class code of the corresponding class,
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
A prediction tap extracting means for extracting a prediction tap used for a predetermined prediction calculation with the tap coefficient from the two-dimensional DCT coefficient with respect to the attention-enhanced quality data;
The decoding apparatus according to claim 28, further comprising: a prediction calculation unit that calculates the attention-enhanced quality-enhanced data by performing a prediction calculation using the prediction tap and the tap coefficient.

The decoding apparatus according to claim 39, wherein the class tap extraction unit extracts a class tap from the two-dimensional DCT coefficient based on the mismatch information.

The decoding device according to claim 39, wherein the class classification means classifies the attention-enhanced quality-enhanced data based on the mismatch information.

The decoding device according to claim 39, wherein the prediction tap extraction unit extracts a prediction tap from the two-dimensional DCT coefficient based on the mismatch information.

40. The decoding apparatus according to claim 39, wherein the class tap extraction unit extracts the class tap from the encoded data.

The decoding apparatus according to claim 39, wherein the prediction tap extraction unit extracts the prediction tap also from the encoded data.

The decoding means includes
Two-dimensional DCT coefficient acquisition means for acquiring a two-dimensional DCT coefficient obtained by two-dimensional DCT-transforming image data from the encoded data;
Among the high-quality two-dimensional DCT coefficients that are high-quality two-dimensional DCT coefficients for obtaining a high-quality decoded image, the target high-quality two-dimensional DCT coefficient is selected as the target high-quality two-dimensional DCT coefficient of interest. Class tap extraction means for extracting a class tap used for classifying into any one of a plurality of classes from the two-dimensional DCT coefficient;
Class classifying means for classifying the focused high quality two-dimensional DCT coefficient based on the class tap and outputting a class code of a corresponding class;
From a predetermined tap coefficient for each class, tap coefficient acquisition means for acquiring a tap coefficient corresponding to the class code;
A prediction tap extracting means for extracting, from the two-dimensional DCT coefficient, a prediction tap used for a predetermined prediction calculation with the tap coefficient for the attention-enhanced two-dimensional DCT coefficient;
Prediction calculation means for obtaining the attention-enhanced quality two-dimensional DCT coefficient by performing a prediction calculation using the prediction tap and the tap coefficient;
29. The decoding apparatus according to claim 28, further comprising: a two-dimensional inverse DCT transform unit that performs a two-dimensional inverse DCT transform on the high-quality two-dimensional DCT coefficient to obtain a high-quality decoded image.

The decoding device according to claim 45, wherein the class tap extraction unit extracts a class tap from the two-dimensional DCT coefficient based on the mismatch information.

The decoding apparatus according to claim 45, wherein the class classification unit classifies the high-quality two-dimensional DCT coefficient of interest based on the mismatch information.

The decoding apparatus according to claim 45, wherein the prediction tap extraction unit extracts a prediction tap from the two-dimensional DCT coefficient based on the mismatch information.

The decoding device according to claim 45, wherein the class tap extraction unit extracts the class tap also from the encoded data.

The decoding apparatus according to claim 45, wherein the prediction tap extraction unit extracts the prediction tap also from the encoded data.

In a decoding method for decoding encoded data obtained by encoding data, and at least encoded data including characteristic data representing characteristics of the data,
A determination step of determining the correctness of the characteristic data and outputting mismatch information representing the determination result;
And a decoding step of decoding the encoded data based on the mismatch information.

In a program that causes a computer to perform a decoding process that decodes encoded data that is encoded data and includes at least characteristic data that represents the characteristic of the data,
A determination step of determining the correctness of the characteristic data and outputting mismatch information representing the determination result;
And a decoding step of decoding the encoded data based on the mismatch information.

In a recording medium recorded with a program for causing a computer to perform decoding processing for decoding encoded data including encoded data that is at least characteristic data representing the characteristics of the data.
A determination step of determining the correctness of the characteristic data and outputting mismatch information representing the determination result;
A recording medium is recorded, comprising: a decoding step of decoding the encoded data based on the mismatch information.

In a learning device that learns tap coefficients used to decode encoded data that is encoded data and includes at least characteristic data that represents the characteristic of the data,
Teacher data generation means for generating and outputting teacher data serving as a teacher for learning the tap coefficient from learning data;
Student data generation means for generating and outputting student data to be students of learning of the tap coefficient from the learning data;
Encoding means for encoding the learning data and outputting encoded learning data including the characteristic data for the data;
Determination means for determining the correctness of the characteristic data included in the encoded data for learning and outputting mismatch information representing the determination result;
A learning apparatus comprising: learning means for learning the tap coefficient using the teacher data and student data based on the mismatch information.

In a learning method for learning tap coefficients used for decoding encoded data including encoded data including at least characteristic data representing the characteristics of the data, which is encoded data obtained by encoding data,
A teacher data generation step for generating and outputting teacher data to be a teacher for learning the tap coefficient from the learning data;
A student data generation step of generating and outputting student data to be students of learning of the tap coefficient from the learning data;
An encoding step of encoding the learning data and outputting encoded learning data including the characteristic data for the data;
A determination step of determining the correctness of the characteristic data included in the learning encoded data and outputting mismatch information indicating the determination result;
A learning method comprising: a learning step of learning the tap coefficient using the teacher data and student data based on the mismatch information.

In a program for causing a computer to perform learning processing for learning tap coefficients used to decode encoded data including encoded data including at least characteristic data representing encoded data, wherein the encoded data is data encoded.
A teacher data generation step for generating and outputting teacher data to be a teacher for learning the tap coefficient from the learning data;
A student data generation step of generating and outputting student data to be students of learning of the tap coefficient from the learning data;
An encoding step of encoding the learning data and outputting encoded learning data including the characteristic data for the data;
A determination step of determining the correctness of the characteristic data included in the learning encoded data and outputting mismatch information indicating the determination result;
And a learning step for learning the tap coefficient using the teacher data and student data based on the mismatch information.

A program that causes a computer to perform a learning process of learning tap coefficients used to decode at least encoded data including encoded data that is encoded data and includes characteristic data representing the characteristics of the data is recorded. In the recorded recording medium,
A teacher data generation step for generating and outputting teacher data to be a teacher for learning the tap coefficient from the learning data;
A student data generation step of generating and outputting student data to be students of learning of the tap coefficient from the learning data;
An encoding step of encoding the learning data and outputting encoded learning data including the characteristic data for the data;
A determination step of determining the correctness of the characteristic data included in the learning encoded data and outputting mismatch information indicating the determination result;
A recording medium, comprising: a learning step for learning the tap coefficient using the teacher data and student data based on the mismatch information.