JP2001045475A - Video signal hierarchical coder, video signal hierarchical decoder and program recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simplify a motion detector, to decrease redundancy and to attain coding matching the characteristics of a video signal by using a motion vector and outputting a 3rd compression stream resulting from applying high efficiency coding employing motion compensation to a difference signal among 1st, 2nd video signals and a 3rd video signal that is generated from a decoded video signal of the 1st and 2nd video signals and has the same resolution as that of the 1st video signal. SOLUTION: A motion vector converter 118 users a motion vector being the output of a motion detector 102 so as to output a reference image for a difference signal in the unit of macro blocks on the basis of a reproduced difference signal between a coded frame and a reference frame having already been coded and stored in an image memory 117 and decoded. A DCT device 119 applies DCT to each block of a difference signal being an output of a motion compensation device 116 and provides an output. A quantizer 120 quantizes a DCT coefficient and provides an output. A variable length coder 124 outputs a 3rd compression stream by applying variable length coding to a prescribed flag not including an output of the quantizer 120 or a motion vector.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a hierarchical coding scheme such as a spatial scalability profile or an SNR scalability profile, which is a hierarchical coding in the spatial axis direction standardized by MPEG, which is a standardization organization for video signal compression. Video signal hierarchical coding device using
The present invention relates to a decoding device.

[0002]

2. Description of the Related Art A conventional video signal hierarchical coding apparatus is disclosed.
An encoding apparatus of a spatial scalability profile, which is hierarchical encoding in the spatial axis direction standardized by MPEG, is a conventional example.

A conventional video signal hierarchical coding apparatus and a conventional video signal hierarchical decoding apparatus will be described below with reference to FIGS.

First, a video signal hierarchical coding apparatus will be described with reference to FIG. In FIG. 19, 1001 is the first
Resolution converter, 1002 is a motion detector, 1003 is an image memory, 1004 is a motion compensator, 1005 is a DCT device, 1006 is a quantizer, 1007 is an inverse quantizer, 1008 is an IDCT device, and 1009 is a motion compensator. , 1010 is a variable length encoder, 1011 is a second resolution converter, 1012 is a motion detector, 1013 is an image memory, 1014 is a motion compensator, 1015 is a DCT unit, 1016 is a quantizer, and 1017 is an inverse quantum. 1018, an IDCT unit, 1019, a motion compensator, and 1020, a variable length encoder.

[0005] An input video signal is supplied to a first resolution converter 1001.
Thus, the input video signal is converted into a lower resolution video signal.

The motion detector 1002 is a first resolution converter 1001
Is recorded in the image memory 1003, and using the encoded frame and the video signal of the reference frame recorded in the image memory 1003 and the reproduced video signal of the already encoded and decoded reference frame. To detect the motion in units of macroblocks (blocks of 16 pixels × 16 lines in the screen in the luminance signal).

[0007] The motion compensator 1004 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 1002 in macroblock units.

The DCT unit 1005 DCTs the difference signal output from the motion compensator 1004 for each block (block of 8 pixels × 8 lines in the screen) and outputs it. Quantizer 1006 quantizes the DCT coefficient and outputs the result.

An inverse quantizer 1007 inversely quantizes the coefficient quantized by the quantizer 1006 and outputs the result. The IDCT unit 1008 performs an inverse DCT on the output of the inverse quantizer 1007 and outputs the result. Motion compensator 100
9 adds the output of the IDCT unit 1008 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 1004 to generate a reproduced video signal, and stores it in the image memory 1003.

A variable-length encoder 1010 performs variable-length encoding on an output of the quantizer 1006 and a predetermined flag including a motion vector, and outputs the result as a first compressed stream.

The second resolution converter 1011 includes a motion compensator 100
The resolution of the reproduced video signal output from 9 is converted to the same resolution as the input video signal and stored in the image memory 1013.

A motion detector 1012 records an input video signal in an image memory 1013, and stores a coded frame and an image in the image memory 1013.
13 is a video signal of the reference frame recorded in 13, a reproduced video signal of the already encoded and decoded reference frame, and a video signal at the same time in the low-resolution signal output from the second resolution converter 1011. A motion in units of macroblocks is detected using the reference frame.

The motion compensator 1014 outputs a difference signal between the video signal of the encoded frame and the video signal of the reference frame detected by the motion detector 1012 in macroblock units.
The DCT unit 1015 DCTs the difference signal of the output of the motion compensator 1019 for each block and outputs the result. The quantizer 1016 quantizes the DCT coefficient and outputs the result.

The inverse quantizer 1017 inversely quantizes the coefficient quantized by the quantizer 1016 and outputs the result. The IDCT unit 1018 performs an inverse DCT on the output of the inverse quantizer 1017 and outputs the result. Motion compensator 101
9 adds the output of the IDCT unit 1018 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 1014 to generate a reproduced video signal, and stores it in the image memory 1013.

The variable-length encoder 1020 performs variable-length encoding on the output of the quantizer 1016 and a predetermined flag including a motion vector, and outputs the result as a second compressed stream.

Next, a video signal hierarchical decoding apparatus will be described with reference to FIG. In FIG. 20, 1021 is a variable length decoder, 1022 is an inverse quantizer, 1023 is an IDCT unit, 1024 is a motion compensator, 1025 is an image memory, 1026 is a second resolution converter, and 1027 is variable length decoding. , 1028 is an inverse quantizer, 1029
Is an IDCT unit, 1030 is a motion compensator, and 1031 is an image memory.

The variable length decoder 1021 to which the first compressed stream has been input performs predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 1022 inversely quantizes the decoded signal at a predetermined quantization step and outputs a DCT coefficient. The IDCT unit 1023 performs IDCT on the DCT coefficient. Motion compensator 102
In step 4, the output of the IDCT unit 1023 and the video signal of the reference frame specified by the motion vector are added to generate a reproduced video signal and store the reproduced video signal in the image memory 1025.

The second resolution converter 1026 converts the resolution of the reproduced video signal into a predetermined resolution and stores it in the image memory 1031.

The variable length decoder 1027 to which the second compressed stream has been input performs a predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 1028 inversely quantizes the decoded signal at a predetermined quantization step and outputs a DCT coefficient. I
The DCT unit 1029 performs IDCT on the DCT coefficient. The motion compensator 1030
The output of the IDCT unit 1024 and the video signal of the reference frame specified by the motion vector are added to generate a reproduced video signal, which is stored in the image memory 1031.

[0020]

However, in the conventional video signal hierarchical coding apparatus, two motion detectors (1) are used.
002, 1012), the encoding apparatus is complicated, and the first compressed stream and the second compressed stream are used in order to be able to decode the video signal if only the first compressed stream is received. Have a motion vector. For this reason, there are problems that the redundancy of the two compressed streams is high, and it is difficult to perform encoding according to the characteristics of the video signal because only two compressed streams are used.

The present invention has been made in consideration of such problems of the conventional hierarchical coding apparatus and decoding apparatus, and has a simple motion detector, low redundancy, or a code suitable for video signal characteristics. It is an object of the present invention to provide a video signal hierarchical coding device and a video signal hierarchical decoding device which can be converted.

[0022]

According to a first aspect of the present invention, there is provided a video signal hierarchical coding apparatus comprising: a second high efficiency coding means for providing a second video signal having higher image quality; Using the motion vector detected in the first high-efficiency encoding for the second video signal, the first video signal and the first video signal having the same resolution as the first video signal generated from the decoded video signal of the second video signal are used. The present invention is characterized in that it comprises a third high-efficiency encoding means for outputting a third compressed stream in which a difference signal from the third video signal is encoded with high efficiency using motion compensation. A video signal layered coding apparatus according to a second aspect of the present invention is characterized in that, in the same configuration as the video signal layered coding apparatus according to the first invention, the third compressed stream is generated using subband conversion. And the image of the third invention of the present invention. The signal layered coding apparatus is characterized in that a third video signal is added by an addition means to add the coding results of the first high efficiency coding means and the second high efficiency coding means, A video signal hierarchical coding apparatus according to a fourth aspect of the present invention is configured to generate a third compressed stream using subband conversion in the same configuration as the video signal hierarchical coding apparatus according to the third aspect. The video signal hierarchical coding apparatus according to the fifth aspect of the present invention is different from the video signal hierarchical coding apparatus according to the third aspect of the present invention in that the third video signal In the adding means
Wherein the encoding results of the high-efficiency encoding means and the second high-efficiency encoding means are added. The video signal hierarchical encoding apparatus according to the sixth invention of the present invention is characterized in that 4th of
The third compressed stream is generated by using a sub-band transform in a configuration different from that of the video signal hierarchical coding apparatus of the third invention, and in the same configuration as the video signal hierarchical coding apparatus of the third invention. The video signal layered coding apparatus according to the seventh aspect of the present invention is characterized in that it has a coefficient decimation device, and the video signal layered coding according to the eighth aspect of the present invention. The apparatus is characterized in that a coefficient thinning unit is used for the coefficients after subband conversion, and the video signal hierarchical coding apparatus according to the ninth aspect of the present invention is characterized in that it has a coefficient permuter. The first aspect of the present invention.
The video signal hierarchical coding apparatus according to the present invention is characterized in that a coefficient replacement unit is used for the coefficients after subband conversion. A video signal hierarchical decoding apparatus according to any one of claims 1 to 3, wherein the first compressed stream, the second compressed stream, and the third compressed stream are input to the first compressed stream. A third high-efficiency encoding unit that decodes a motion vector from among them, decodes a third compressed stream using the motion vector, and outputs a decoded signal of a differential signal, and a third encoded stream that decodes the first compressed stream. Decoding the difference signal into a second video signal obtained by adding a decoded video signal of the second video signal and a signal obtained by decoding the second compressed stream to a third video signal having the same resolution as the first video signal. Add the signals It is characterized in having a summing means for generating a decoded video signal of the first video signal,
A video signal hierarchical decoding apparatus according to a twelfth aspect of the present invention comprises:
The video signal hierarchical decoding apparatus according to claim 2, 4, or 6, further comprising a sub-band inverse converter for decoding the third compressed stream. The video signal hierarchical decoding apparatus according to a thirteenth aspect of the present invention is the video signal hierarchical decoding apparatus according to claim 7, wherein a coefficient interpolator is used for decoding the third compressed stream. A video signal hierarchical decoding apparatus according to a fourteenth aspect of the present invention is the video signal hierarchical decoding apparatus according to claim 8, wherein the decoding of the third compressed stream is performed. A video signal hierarchical decoding device according to a fifteenth aspect of the present invention is characterized in that the video signal hierarchical decoding device according to the fifteenth aspect of the present invention is provided with a coefficient interpolator. To decode the third compressed stream. The video signal hierarchical decoding apparatus according to the sixteenth aspect of the present invention is characterized in that the apparatus comprises a coefficient separator. The decoding apparatus further comprises a coefficient separator for decoding the third compressed stream.

[0023]

(Embodiment 1) An embodiment of the first invention of the present invention will be described below with reference to FIG. FIG.
In 101, a first resolution converter, 102 is a motion detector, 103 is a motion compensator, 104 is an image memory, 105 is a DCT unit,
106 is a quantizer, 107 is an inverse quantizer, 108 is an IDCT unit, 109 is a motion compensator, 110 is a variable length encoder, 111 is a difference unit, 112
Is a quantizer, 113 is a variable length encoder, 114 is a second resolution converter, 115 is a difference signal generator, 116 is a motion compensator, 117
Is image memory, 118 is motion vector converter, 119 is DCT
Device, 120 is a quantizer, 121 is an inverse quantizer, 122 is an IDCT device, 1
23 is a motion compensator, and 124 is a variable length encoder.

The input video signal is converted by the first resolution converter 101 into a second video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the encoded frame and the video signal of the reference frame recorded in the image memory 104 into the encoded signal. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs the result.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result. The IDCT unit 108 performs an inverse DCT on the output of the inverse quantizer 107 and outputs the result. Motion compensator 109
Generates a playback video signal by adding the output of the IDCT unit 108 and the playback video signal of the reference frame motion-compensated by the motion compensator 103, and stores the playback video signal in the image memory 104.

The variable-length encoder 110 outputs a first compressed stream obtained by variable-length encoding the output of the quantizer 106 and a predetermined flag including a motion vector.

The difference unit 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal. The quantizer 112 quantizes the quantization error signal output from the differentiator 111 and outputs the result. The variable length encoder 113
It outputs a second compressed stream in which the output of the quantizer 112 and a predetermined flag that does not include a motion vector are variable-length coded.

The second resolution converter 114 converts the resolution of the second video signal and outputs the second video signal at the same resolution as the input video signal.

The difference signal generator 115 receives the input video signal and the second
A difference signal from the signal output from the resolution converter 114 is generated and output.

The motion vector converter 118 includes a motion detector 102
The reference image for the difference signal is output in units of macroblocks from the encoded frame and the reproduced difference signal of the reference frame in the image memory 117 which has been encoded and decoded by using the motion vector which is the output of.

The motion compensator 116 outputs the difference signal between the coded frame and the signal from the memory 117 in macroblock units.

The DCT unit 119 performs DCT on the difference signal of the output of the motion compensator 116 for each block and outputs the result. The quantizer 120 is
Quantizes and outputs DCT coefficients.

The inverse quantizer 121 inversely quantizes the coefficient quantized by the quantizer 120 and outputs the result. The IDCT unit 122 performs an inverse DCT on the output of the inverse quantizer 121 and outputs the result.

The motion compensator 123 adds the output of the IDCT unit 122 and the reproduction difference signal of the reference frame motion-compensated by the motion compensator 116 to generate a reproduction difference signal, and stores the signal in the image memory 117.

The variable-length encoder 124 outputs a third compressed stream obtained by variable-length encoding the output of the quantizer 120 and a predetermined flag not including a motion vector.

As an example, when the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into a horizontal Use 3/2 times both vertically.

With such a configuration, the first embodiment of the present invention has the following effects. That is, the motion vector used for encoding the low-resolution video signal is used for encoding the high-resolution difference signal, and the information of the motion vector is not included in the third compressed stream. The video signal hierarchical coding can be performed well, and three compressed streams are generated and the second high efficiency coding means is provided. It is possible to provide the first video signal and the second video signal with less numbers. (Embodiment 2) Hereinafter, an embodiment of the second invention of the present invention will be described with reference to FIG. In FIG. 2, the description of the same numbers as those in FIG. 1 is omitted. 125 is a sub-band converter and 126 is a sub-band inverse converter.

The input video signal is converted by the first resolution converter 101 into a second video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the coded frame and the video signal of the reference frame recorded in the image memory 104 into the coded frame. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the encoded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs the result.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 outputs the output of the inverse quantizer 107 to the inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable length encoder 110 outputs a first compressed stream in which the output of the quantizer 106 and a predetermined flag including a motion vector are variable length encoded.

The difference unit 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantization error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs a second compressed stream obtained by variable-length encoding the output of the quantizer 112 and a predetermined flag not including a motion vector.

The second resolution converter 114 converts the resolution of the second video signal and outputs the second video signal at the same resolution as the input video signal.

The difference signal generator 115 receives the input video signal and the second
A difference signal from the signal output from the resolution converter 114 is generated and output.

The motion vector converter 118 includes a motion detector 102
The reference image for the difference signal is output from the encoded difference between the encoded frame and the already encoded and decoded reference frame in the image memory 117 by using the motion vector which is the output of the reference signal.

The motion compensator 116 outputs a difference signal between the coded frame difference signal and the signal from the memory 117.

The sub-band converter 125 frequency-decomposes the difference signal output from the motion compensator 116 using a predetermined sub-band filter and outputs the result.

The quantizer 120 quantizes the sub-band transform coefficients and outputs the result.

The inverse quantizer 121 inversely quantizes the coefficient quantized by the quantizer 120 and outputs the result.

The inverse subband converter 126 has an inverse quantizer 121
Is output using a predetermined sub-band filter, and a combined signal is output.

The motion compensator 123 includes an inverse subband converter 126
Is added to the reproduction difference signal of the reference frame that has been motion-compensated by the motion compensator 116 to generate a reproduction difference signal, which is stored in the image memory 117. The variable length encoder 124 is a quantizer
A third compressed stream in which the output of 120 and a predetermined flag not including a motion vector are variable-length coded is output.

As an example, when the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into a horizontal Use 3/2 times both vertically.

In the sub-band conversion, the whole screen may be used as a conversion unit, or a fixed conversion unit may be determined for conversion. When the sub-band filter has the characteristics of a wavelet filter, the sub-band transform is a wavelet transform. The number of hierarchies of the subband conversion may be any number, and the ratio of the low-frequency component and the high-frequency component of the subband conversion may be any.

According to the second embodiment, the effect of the device of the first embodiment can be achieved by using a sub-band transform instead of an orthogonal transform for generating the third compressed stream. (Embodiment 3) A third embodiment of the present invention will be described below with reference to FIG. In FIG. 3, the description of the same numbers as those in FIG. 1 is omitted. 127 is the inverse quantizer, 128 is
The IDCT unit 129 is an adder.

The input video signal is converted by the first resolution converter 101 into a video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the encoded frame and the video signal of the reference frame recorded in the image memory 104. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the differential signal output from the motion compensator 103 (a block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs the result.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 converts the output of the inverse quantizer 107 into an inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable length encoder 110 outputs a first compressed stream in which the output of the quantizer 106 and a predetermined flag including a motion vector are variable length encoded.

The difference unit 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantized error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag that does not include a motion vector.

The inverse quantizer 127 outputs the output of the quantizer 112 by performing inverse quantization of the quantization performed by the quantizer 112.

The IDCT unit 128 outputs the output of the inverse quantizer 127 to the inverse DC
T and output.

The adder 129 outputs the IDCT to the output of the motion compensator 109.
And outputs a video signal obtained by adding the outputs of the devices 128.

The second resolution converter 114 converts the resolution of the video signal output from the adder 129 and outputs it at the same resolution as the input video signal.

The difference signal generator 115 receives the input video signal and the second
A difference signal from the signal output from the resolution converter 114 is generated and output.

The motion vector converter 118 includes the motion detector 102
The reference image for the difference signal is output in units of macroblocks from the encoded frame and the reproduced difference signal of the reference frame in the image memory 117 which has been encoded and decoded by using the motion vector which is the output of.

The motion compensator 116 outputs the difference signal between the coded frame and the signal from the memory 117 on a macroblock basis.

The DCT unit 119 performs DCT on the difference signal of the output of the motion compensator 116 for each block and outputs the result.

The quantizer 120 quantizes the DCT coefficient and outputs it.

The inverse quantizer 121 inversely quantizes the coefficient quantized by the quantizer 120 and outputs the result.

The IDCT unit 122 outputs the output of the inverse quantizer 121 to the inverse DC
T and output.

The motion compensator 123 adds the output of the IDCT unit 122 and the reproduction difference signal of the reference frame motion-compensated by the motion compensator 116 to generate a reproduction difference signal, and stores the signal in the image memory 117. The variable length encoder 124 outputs a third compressed stream in which the output of the quantizer 120 and a predetermined flag that does not include a motion vector are variable length encoded.

As an example, when the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into a horizontal Use 3/2 times both vertically.

The device according to the third embodiment is similar to the device according to the first embodiment.
By performing the third compressed stream generation in consideration of the compression distortion of the second video signal, it is possible to provide a high-resolution video signal with less distortion. (Embodiment 4) Hereinafter, a fourth embodiment of the present invention will be described with reference to FIG. In FIG. 4, those having the same numbers as those in FIGS. 1, 2, and 3 will not be described.

The input video signal is converted by the first resolution converter 101 into a video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the coded frame and the video signal of the reference frame recorded in the image memory 104 into the coded frame. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs the result.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 converts the output of the inverse quantizer 107 into an inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable-length encoder 110 outputs a first compressed stream obtained by variable-length encoding the output of the quantizer 106 and a predetermined flag including a motion vector.

The differentiator 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantized error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag that does not include a motion vector.

The inverse quantizer 127 performs an inverse quantization of the quantization performed by the quantizer 112 and outputs the output of the quantizer 112.

The IDCT unit 128 outputs the output of the inverse quantizer 127 to the inverse DC
T and output.

The adder 129 outputs the IDCT to the output of the motion compensator 109.
And outputs a video signal to which the output of the device 128 is added.

The second resolution converter 114 converts the resolution of the video signal output from the adder 129 and outputs the video signal with the same resolution as the input video signal.

The difference signal generator 115 receives the input video signal and the second
A difference signal from the signal output from the resolution converter 114 is generated and output.

The motion vector converter 118 includes the motion detector 102
The reference image for the difference signal is output from the encoded difference between the encoded frame and the already encoded and decoded reference frame in the image memory 117 by using the motion vector which is the output of the reference signal.

The motion compensator 116 outputs a difference signal between the difference signal of the coded frame and the signal from the memory 117.

The sub-band converter 125 frequency-decomposes the difference signal output from the motion compensator 116 using a predetermined sub-band filter and outputs the result.

The quantizer 120 quantizes the sub-band transform coefficient and outputs the result.

The inverse quantizer 121 inversely quantizes the coefficient quantized by the quantizer 120 and outputs the result.

The inverse subband converter 126 includes an inverse quantizer 121
Is output using a predetermined sub-band filter, and a combined signal is output.

The motion compensator 123 includes an inverse subband converter 126
Is added to the reproduction difference signal of the reference frame that has been motion-compensated by the motion compensator 116 to generate a reproduction difference signal, which is stored in the image memory 117. The variable length encoder 124 is a quantizer
A third compressed stream in which the output of 120 and a predetermined flag not including a motion vector are variable-length coded is output.

As an example, when the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into a horizontal Use 3/2 times both vertically.

In the sub-band conversion, the whole screen may be used as a conversion unit, or a fixed conversion unit may be determined for conversion. When the sub-band filter has the characteristics of a wavelet filter, the sub-band transform is a wavelet transform. The number of hierarchies of the sub-band conversion may be any number, and the ratio of the low-frequency component and the high-frequency component of the sub-band conversion may be any.

The device according to the fourth embodiment is similar to the device according to the third embodiment.
The effect of the device of FIG.
This can be performed using a sub-band transform instead of an orthogonal transform. (Fifth Embodiment) A fifth embodiment of the present invention will be described below with reference to FIG. In FIG. 5, FIGS.
The description of the same number as 3 is omitted. 130 is an adder.

The input video signal is converted by the first resolution converter 101 into a video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the coded frame and the video signal of the reference frame recorded in the image memory 104 into the coded frame. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the encoded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs it.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 outputs the output of the inverse quantizer 107 to the inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable length encoder 110 outputs a first compressed stream in which the output of the quantizer 106 and a predetermined flag including a motion vector are variable length encoded.

The differentiator 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantized error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag that does not include a motion vector.

The inverse quantizer 127 performs an inverse quantization of the quantization performed by the quantizer 112 and outputs the output of the quantizer 112.

The adder 130 is composed of the inverse quantizer 107 and the inverse quantizer.
Outputs a signal obtained by adding 127 outputs.

The IDCT unit 128 performs an inverse DCT on the output of the adder 130 and outputs the result.

The adder 129 outputs a video signal obtained by adding the reproduced video signal of the reference frame motion-compensated by the motion compensator 103 and the output of the IDCT unit 128.

The second resolution converter 114 converts the resolution of the video signal output from the adder 129 and outputs the video signal with the same resolution as the input video signal.

The difference signal generator 115 receives the input video signal and the second
A difference signal from the signal output from the resolution converter 114 is generated and output.

[0137] The motion vector converter 118
The reference image for the difference signal is output in units of macroblocks from the encoded frame and the reproduced difference signal of the reference frame in the image memory 117 which has been encoded and decoded by using the motion vector which is the output of.

The motion compensator 116 outputs the difference signal between the coded frame and the signal from the memory 117 on a macroblock basis.

The DCT unit 119 performs DCT on the difference signal of the output of the motion compensator 116 for each block and outputs the result.

The quantizer 120 quantizes the DCT coefficient and outputs it.

The inverse quantizer 121 inversely quantizes the coefficient quantized by the quantizer 120 and outputs the result.

The IDCT unit 122 outputs the output of the inverse quantizer 121 to the inverse DC
T and output.

The motion compensator 123 generates a reproduction difference signal by adding the output of the IDCT unit 122 and the reproduction difference signal of the reference frame motion-compensated by the motion compensator 116, and stores the reproduced difference signal in the image memory 117. The variable length encoder 124 outputs a third compressed stream in which the output of the quantizer 120 and a predetermined flag that does not include a motion vector are variable length encoded.

As an example, if the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into a horizontal Use 3/2 times both vertically.

The device according to the fifth embodiment is similar to the device according to the fourth embodiment.
The effect of the device can be realized by different configurations. (Embodiment 6) A sixth embodiment of the present invention will be described below with reference to FIG.

In FIG. 6, the description of the same reference numerals as those in FIGS. 1, 2, 3, and 5 is omitted.

The input video signal is converted by the first resolution converter 101 into a video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the coded frame and the video signal of the reference frame recorded in the image memory 104 into the coded frame. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal of the output of the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs it.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 outputs the output of the inverse quantizer 107 to the inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable-length encoder 110 outputs a first compressed stream obtained by variable-length encoding the output of the quantizer 106 and a predetermined flag including a motion vector.

The differentiator 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantization error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag that does not include a motion vector.

Inverse quantizer 127 performs an inverse quantization of the quantization performed by quantizer 112 and outputs the output of quantizer 112.

The adder 130 is composed of the inverse quantizer 107 and the inverse quantizer.
Outputs a signal obtained by adding 127 outputs.

The IDCT unit 128 performs an inverse DCT on the output of the adder 130 and outputs the result.

The adder 129 outputs a video signal obtained by adding the reproduced video signal of the reference frame motion-compensated by the motion compensator 103 and the output of the IDCT unit 128.

The second resolution converter 114 converts the resolution of the video signal output from the adder 129 and outputs the video signal with the same resolution as the input video signal.

[0164] The difference signal generator 115 receives the input video signal and the second video signal.
A difference signal from the signal output from the resolution converter 114 is generated and output.

[0165] The motion vector converter 118 is
The reference image for the difference signal is output from the encoded difference between the encoded frame and the already encoded and decoded reference frame in the image memory 117 by using the motion vector which is the output of the reference signal.

The motion compensator 116 outputs a difference signal between the coded frame difference signal and the signal from the memory 117.

The sub-band converter 125 frequency-decomposes the difference signal output from the motion compensator 116 using a predetermined sub-band filter and outputs the result.

The quantizer 120 quantizes the sub-band transform coefficients and outputs the result.

The inverse quantizer 121 inversely quantizes the coefficient quantized by the quantizer 120 and outputs the result.

The inverse sub-band converter 126 includes an inverse quantizer 121
Is output using a predetermined sub-band filter, and a combined signal is output.

The motion compensator 123 includes an inverse subband converter 126
Is added to the reproduction difference signal of the reference frame that has been motion-compensated by the motion compensator 116 to generate a reproduction difference signal, which is stored in the image memory 117. The variable length encoder 124 is a quantizer
A third compressed stream in which the output of 120 and a predetermined flag not including a motion vector are variable-length coded is output.

As an example, when the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into a horizontal Use 3/2 times both vertically.

In the sub-band conversion, the whole screen may be used as a conversion unit, or a fixed conversion unit may be determined for conversion. When the sub-band filter has the characteristics of a wavelet filter, the sub-band transform is a wavelet transform. The number of hierarchies of the sub-band conversion may be any number, and the ratio of the low-frequency component and the high-frequency component of the sub-band conversion may be any.

The device according to the sixth embodiment is similar to the device according to the fifth embodiment.
The effect of the device of FIG.
This can be performed using a sub-band transform instead of an orthogonal transform. (Embodiment 7) An embodiment of the seventh invention of the present invention will be described below with reference to FIG. In FIG. 7, the description of the same numbers as those in FIG. 1 is omitted. 131 is a coefficient thinning unit.

The input video signal is converted by the first resolution converter 101 into a second video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the coded frame and the video signal of the reference frame recorded in the image memory 104 into the coded frame. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (a block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs it.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 converts the output of the inverse quantizer 107 into an inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable-length encoder 110 outputs a first compressed stream obtained by variable-length encoding the output of the quantizer 106 and a predetermined flag including a motion vector.

The differentiator 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantized error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag not including a motion vector.

The second resolution converter 114 converts the resolution of the second video signal, and outputs the second video signal with the same resolution as the input video signal.

[0188] The difference signal generator 115 receives the input video signal and the second video signal.
A difference signal from the signal output from the resolution converter 114 is generated and output.

[0189] The motion vector converter 118 is
The reference image for the difference signal is output in units of macroblocks from the encoded frame and the reproduced difference signal of the reference frame in the image memory 117 which has been encoded and decoded by using the motion vector which is the output of.

The motion compensator 116 outputs the difference signal between the coded frame and the signal from the memory 117 on a macroblock basis.

The DCT unit 119 performs DCT on the difference signal output from the motion compensator 116 for each block and outputs the result.

The quantizer 120 quantizes the DCT coefficient and outputs the result.

The coefficient thinning unit 131 sets all DCT coefficients, which are components included in the resolution of the second video signal, to 0, and outputs the result.

The inverse quantizer 121 inversely quantizes the output of the coefficient thinning unit 131 and outputs the result.

The IDCT unit 122 outputs the output of the inverse quantizer 121 to the inverse DC
T and output.

The motion compensator 123 generates a reproduced difference signal by adding the output of the IDCT unit 122 and the reproduced difference signal of the reference frame motion-compensated by the motion compensator 116, and stores the reproduced difference signal in the image memory 117.

The variable length encoder 124 outputs the output of the quantizer 120 and a third compressed stream in which a predetermined flag not including a motion vector is variable length encoded.

FIG. 17 shows the operation of the coefficient thinning unit 131.
This will be described with reference to FIG. As an example, if the input video signal is 1080p
This is performed by the DCT unit 119 when the second video signal that is a video signal and a low-resolution video signal is a 720p video signal.
Assuming that the DCT block size is 12 pixels horizontally × 12 lines vertically in the screen, the 144 coefficients shown in FIG.
And the 64 shaded coefficients among them become DCT coefficients which are components included in the resolution of the second video signal.
In this case, the coefficient thinning unit 131 sets all shaded coefficients to 0 and outputs them. Or 8 excluding the shaded part
Output only 0 coefficient.

If the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into three horizontal and vertical motion vectors. Use / 2 times.

The input of the inverse quantizer 121 is the quantizer 1
20 outputs may be used.

The device of the seventh embodiment is the same as that of the first embodiment.
And more efficient encoding can be provided by including only the subjectively important high frequency components in the third compressed stream in the third high efficiency encoding means. Embodiment 8 Hereinafter, an eighth embodiment of the present invention will be described with reference to FIG. In FIG. 8, the description of the same numbers as those in FIGS. 1 and 7 is omitted.

The input video signal is converted by the first resolution converter 101 into a second video signal having a lower resolution than the input video signal.

[0203] The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the encoded frame and the video signal of the reference frame recorded in the image memory 104 already. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs the result.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 outputs the output of the inverse quantizer 107 to the inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

[0210] The variable length encoder 110 outputs a first compressed stream in which the output of the quantizer 106 and a predetermined flag including a motion vector are variable length encoded.

[0211] The difference unit 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

[0212] The quantizer 112 quantizes the quantization error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag not including a motion vector.

[0214] The second resolution converter 114 converts the resolution of the second video signal, and outputs it at the same resolution as the input video signal.

[0215] The difference signal generator 115
A difference signal from the signal output from the resolution converter 114 is generated and output.

[0216] The motion vector converter 118
The reference image for the difference signal is output from the encoded difference between the encoded frame and the already encoded and decoded reference frame in the image memory 117 by using the motion vector which is the output of the reference signal.

The motion compensator 116 outputs a difference signal between the coded frame difference signal and the signal from the memory 117.

The sub-band converter 125 frequency-decomposes the difference signal output from the motion compensator 116 using a predetermined sub-band filter and outputs the result.

[0219] The quantizer 120 quantizes the sub-band transform coefficient and outputs the result.

The coefficient thinning unit 131 sets all coefficients which are components included in the resolution of the second video signal to 0 and outputs the result.

The inverse quantizer 121 inversely quantizes the coefficient output from the coefficient thinning unit 131 and outputs the result.

The inverse sub-band converter 126 has an inverse quantizer 121
Is output using a predetermined sub-band filter, and a combined signal is output.

The motion compensator 123 includes an inverse subband converter 126
Is added to the reproduction difference signal of the reference frame that has been motion-compensated by the motion compensator 116 to generate a reproduction difference signal, which is stored in the image memory 117. The variable length encoder 124 is a quantizer
A third compressed stream in which the output of 120 and a predetermined flag not including a motion vector are variable-length coded is output.

FIG. 18 shows the operation of the coefficient thinning unit 131.
This will be described with reference to FIG. As an example, if the input video signal is 1080p
If the second video signal, which is a video signal and a low-resolution video signal, is a 720p video signal, the subband conversion is 2/3 for the low-pass passband in both horizontal and vertical directions, and the remaining 1/3 is for the highpass. The shaded portion shown in FIG. 18 (L
L component) is a coefficient within the resolution of the second video signal. Therefore, the coefficient thinning unit 131 sets all the coefficients to 0 and outputs the result. Alternatively, only the coefficient excluding the shaded portion is output.

If the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into three horizontal and vertical motion vectors. Use / 2 times.

The input of the inverse quantizer 121 is the quantizer 1
20 outputs may be used.

In the sub-band conversion, the whole screen may be used as a conversion unit, or conversion may be performed by determining a fixed conversion unit. When the sub-band filter has the characteristics of a wavelet filter, the sub-band transform is a wavelet transform. The number of hierarchies of the sub-band conversion may be any number, and the ratio of the low-frequency component and the high-frequency component of the sub-band conversion may be any.

The device of the eighth embodiment is the same as that of the seventh embodiment.
Can be performed using the sub-band transform instead of the orthogonal transform for the generation of the third compressed stream. Embodiment 9 Hereinafter, a ninth embodiment of the present invention will be described with reference to FIG. In FIG. 9, the description of the same numbers as those in FIG. 1 is omitted. 132 is a coefficient replacement unit.

The input video signal is converted by the first resolution converter 101 into a second video signal having a lower resolution than the input video signal.

[0230] The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the coded frame and the video signal of the reference frame recorded in the image memory 104 already. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal output from the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

[0233] The quantizer 106 quantizes the DCT coefficient and outputs it.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 outputs the output of the inverse quantizer 107 to the inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable-length encoder 110 outputs a first compressed stream obtained by variable-length encoding the output of the quantizer 106 and a predetermined flag including a motion vector.

The difference unit 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantized error signal output from the differentiator 111 and outputs the result.

The second resolution converter 114 converts the resolution of the second video signal, and outputs the second video signal at the same resolution as the input video signal.

[0241] The difference signal generator 115
A difference signal from the signal output from the resolution converter 114 is generated and output.

[0242] The motion vector converter 118
The reference image for the difference signal is output in units of macroblocks from the encoded frame and the reproduced difference signal of the reference frame in the image memory 117 which has been encoded and decoded by using the motion vector which is the output of.

The motion compensator 116 outputs the difference signal between the coded frame and the signal from the memory 117 in macroblock units.

The DCT unit 119 performs DCT on the difference signal of the output of the motion compensator 116 for each block and outputs the result.

The quantizer 120 quantizes the DCT coefficient and outputs it.

The coefficient replacement unit 132 replaces all DCT coefficients, which are components included in the resolution of the second video signal, with the output of the quantizer 112 and outputs the result.

The inverse quantizer 121 inversely quantizes the output of the coefficient substitution unit 132 and outputs the result.

The IDCT unit 122 outputs the output of the inverse quantizer 121 to the inverse DC
T and output.

The motion compensator 123 generates a reproduced difference signal by adding the output of the IDCT unit 122 and the reproduced difference signal of the reference frame motion-compensated by the motion compensator 116, and stores the signal in the image memory 117. The variable-length encoder 124 outputs a second compressed stream obtained by variable-length encoding the output of the quantizer 120 and a predetermined flag that does not include a motion vector.

The operation of the coefficient replacing unit 132 will be described with reference to FIG. As an example, the input video signal is a 1080p video signal, and the second video signal,
In the case of a 20p video signal, if the block size of the DCT performed by the DCT unit 119 is 12 horizontal pixels × 12 vertical lines in the screen, the 144 coefficients shown in FIG. The shaded 64 coefficients become DCT coefficients which are components included in the resolution of the second video signal. In this case, the coefficient thinning unit 131 replaces all the shaded coefficients with the output of the quantizer 112 and outputs the result.

If the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into three horizontal and vertical motion vectors. Use / 2 times.

The input of the inverse quantizer 121 is the quantizer 1
20 outputs may be used.

The device of the ninth embodiment is the same as that of the seventh embodiment.
The effect of the device can be performed only with two compressed streams. (Embodiment 10) A tenth embodiment of the present invention will be described below with reference to FIG.

In FIG. 10, the description of the same numbers as those in FIGS. 1 and 9 is omitted.

The input video signal is converted by the first resolution converter 101 into a second video signal having a lower resolution than the input video signal.

The motion detector 102 records the video signal output from the resolution converter 101 in the image memory 104, and encodes the encoded frame and the video signal of the reference frame recorded in the image memory 104 into the encoded signal. The motion of each macro block (a block of 16 pixels × 16 lines in a screen in the luminance signal) is detected from the decoded video signal of the reference frame.

[0257] The motion compensator 103 outputs a difference signal between the video signal of the coded frame and the reproduced video signal of the reference frame detected by the motion detector 102 in macroblock units.

The DCT unit 105 blocks the difference signal of the output of the motion compensator 103 (block of 8 pixels × 8 lines in the screen)
DCT is output every time.

The quantizer 106 quantizes the DCT coefficient and outputs it.

The inverse quantizer 107 inversely quantizes the coefficient quantized by the quantizer 106 and outputs the result.

The IDCT unit 108 converts the output of the inverse quantizer 107 into an inverse DC
T and output.

The motion compensator 109 generates a reproduced video signal by adding the output of the IDCT unit 108 and the reproduced video signal of the reference frame motion-compensated by the motion compensator 103, and stores the reproduced video signal in the image memory 104.

The variable-length encoder 110 outputs a first compressed stream obtained by variable-length encoding the output of the quantizer 106 and a predetermined flag including a motion vector.

The difference unit 111 generates a difference signal between the output of the DCT unit 105 and the output of the inverse quantizer 107, that is, a quantization error signal.

The quantizer 112 quantizes the quantized error signal output from the differentiator 111 and outputs the result.

The variable-length encoder 113 outputs the output of the quantizer 112 and a second compressed stream obtained by variable-length encoding a predetermined flag not including a motion vector.

The second resolution converter 114 converts the resolution of the second video signal, and outputs the second video signal with the same resolution as the input video signal.

[0268] The difference signal generator 115 generates the difference between the input video signal and the second video signal.
A difference signal from the signal output from the resolution converter 114 is generated and output.

The motion vector converter 118 includes the motion detector 102
The reference image for the difference signal is output from the encoded difference between the encoded frame and the already encoded and decoded reference frame in the image memory 117 by using the motion vector which is the output of the reference signal.

The motion compensator 116 outputs a difference signal between the coded frame difference signal and the signal from the memory 117.

The sub-band converter 125 frequency-decomposes the difference signal output from the motion compensator 116 using a predetermined sub-band filter and outputs the result.

The quantizer 120 quantizes the sub-band transform coefficient and outputs the result.

The coefficient replacing unit 132 replaces all coefficients, which are components included in the resolution of the second video signal, with the output of the quantizer 112 and outputs the result.

The inverse quantizer 121 inversely quantizes the coefficient output from the coefficient thinning unit 131 and outputs the result.

The inverse subband converter 126 has an inverse quantizer 121
Is output using a predetermined sub-band filter, and a combined signal is output.

The motion compensator 123 includes an inverse subband converter 126
Is added to the reproduction difference signal of the reference frame that has been motion-compensated by the motion compensator 116 to generate a reproduction difference signal, which is stored in the image memory 117. The variable length encoder 124 is a quantizer
A third compressed stream in which the output of 120 and a predetermined flag not including a motion vector are variable-length coded is output.

The operation of the coefficient replacing unit 132 will be described with reference to FIG. As an example, when the input video signal is a 1080p video signal and the second video signal that is a low-resolution video signal is a 720p video signal, the sub-band conversion is performed horizontally and vertically with a low-pass pass band of 2/3, A hatched portion (LL shown in FIG.
Component) is a coefficient within the resolution of the second video signal. Therefore, the coefficient decimator 131 converts all the coefficients into the quantizer 112
Replace with the output of and output.

If the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, the motion vector converter 118 converts the motion vector output from the motion detector 102 into three horizontal and vertical motion vectors. Use / 2 times.

The input of the inverse quantizer 121 is the quantizer 1
20 outputs may be used.

In the sub-band conversion, the whole screen may be used as a conversion unit, or conversion may be performed by determining a fixed conversion unit. When the sub-band filter has the characteristics of a wavelet filter, the sub-band transform is a wavelet transform. The number of hierarchies of the sub-band conversion may be any number, and the ratio of the low-frequency component and the high-frequency component of the sub-band conversion may be any.

[0281] The apparatus of the tenth embodiment differs from the apparatus of the ninth embodiment in the generation of the third compressed stream.
This can be performed using a sub-band transform instead of an orthogonal transform.

Embodiment 11 Hereinafter, an eleventh embodiment of the present invention will be described.
An embodiment of the present invention will be described with reference to FIG.

In FIG. 11, reference numeral 201 denotes a variable length decoder;
02 is an inverse quantizer, 203 is an IDCT unit, 204 is a motion compensator, 205
Is an image memory, 206 is a variable length encoder, 207 is an inverse quantizer, 208 is an IDCT unit, 209 is an adder, 210 is an image memory, 211
Is a second resolution converter, 212 is a variable length decoder, 213 is an inverse quantizer, 214 is an IDCT unit, 215 is a motion vector decoder, 2
16 is a motion compensator, 217 is an image memory, and 218 is an adder.

The variable length decoder 201 to which the first compressed stream has been input performs a predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 202 inversely quantizes the decoded signal output from the variable length decoder 201 at a predetermined quantization step, and outputs a DCT coefficient. The IDCT unit 203 performs IDCT on the DCT coefficient output from the inverse quantizer 202. Motion compensator 20
4 generates a reproduced video signal by adding the output of the IDCT unit 203 and the reproduced video signal of the reference frame specified by the motion vector, and stores the generated reproduced video signal in the image memory 205.

The variable length decoder 206 to which the second compressed stream has been input performs a predetermined decoding and outputs a decoded signal. The inverse quantizer 207 inversely quantizes the decoded signal output from the variable length decoder 206 in a predetermined quantization step and performs DCT.
Output the coefficient. The IDCT unit 208 performs IDCT on the DCT coefficient output from the inverse quantizer 207. The adder 209 stores the reproduced video signal obtained by adding the output of the IDCT unit 208 and the output of the motion compensator 204 in the image memory 210 and outputs it to the outside.

[0286] The second resolution converter 211 has an image memory 210.
And converts the resolution of the reproduced video signal stored in.

The variable length decoder 212 to which the third compressed stream has been input performs predetermined decoding and outputs a decoded signal. The inverse quantizer 213 inversely quantizes the decoded signal output from the variable length decoder 212 in a predetermined quantization step, and performs DCT.
Output the coefficient. The IDCT unit 214 performs IDCT on the DCT coefficient output from the inverse quantizer 213. The motion vector decoder 215
One compressed stream is subjected to variable length decoding to detect only a motion vector, perform a predetermined conversion, and output as a motion vector for a second compressed stream. Motion compensator 216
Generates a playback difference signal by adding the playback difference signal of the reference frame specified by the motion vector output from the IDCT unit 214 and the motion vector decoder 215, and stores the playback difference signal in the image memory 217.

[0288] The adder 218 calculates the difference between the reproduced difference signal and the second signal.
The reproduction video signal output from the resolution converter 211 is added to generate a reproduction video signal of the first video signal.

As an example, if the input video signal is 1080
If the video signal is a p-video signal and the low-resolution video signal is a 720p video signal, the motion vector decoder 215 converts the motion vector in the first compressed stream into 3/2 in both the horizontal and vertical directions.
Use by multiplying.

The apparatus according to the eleventh embodiment has a motion vector decoder and a second high-efficiency decoding means, so that the apparatus according to the first embodiment, the apparatus according to the third embodiment, The compressed stream encoded by the device according to mode 5 can be decoded.

Embodiment 12 Hereinafter, a twelfth embodiment of the present invention will be described.
An embodiment of the present invention will be described with reference to FIG.

In FIG. 12, those having the same numbers as those in FIG. 11 are not described. 219 is an inverse subband transform.

The variable length decoder 201 to which the first compressed stream has been input performs a predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 202 is a variable length decoder 2
The decoded signal which is the output of 01 is inversely quantized in a predetermined quantization step and a DCT coefficient is output. IDCT unit 203 is an inverse quantizer
IDCT the DCT coefficient which is the output of 202. Motion compensator 204
Generates the reproduced video signal by adding the output of the IDCT unit 203 and the reproduced video signal of the reference frame specified by the motion vector, and stores the generated reproduced video signal in the image memory 205.

The variable length decoder 206 to which the second compressed stream has been input performs a predetermined decoding and outputs a decoded signal. The inverse quantizer 207 inversely quantizes the decoded signal output from the variable length decoder 206 at a predetermined quantization step, and outputs a DCT coefficient. IDCT unit 208 is the output of inverse quantizer 207
IDCT the DCT coefficient. The adder 209 causes the image memory 210 to store a reproduced video signal obtained by adding the output of the IDCT unit 208 and the output of the motion compensator 204.

The second resolution converter 211 has an image memory 210
And converts the resolution of the reproduced video signal stored in.

The variable length decoder 212 to which the third compressed stream has been input performs a predetermined decoding and outputs a decoded signal. The inverse quantizer 213 inversely quantizes the decoded signal output from the variable length decoder 212 at a predetermined quantization step and outputs a DCT coefficient. Inverse subband converter 219 is inverse quantizer 2
A signal obtained by converting the output signal of No. 13 using a predetermined sub-band filter and combining the output signal is output. Motion vector decoder 21
Reference numeral 5 denotes variable length decoding of the first compressed stream to detect only a motion vector, performs a predetermined conversion, and outputs the result as a motion vector for the second compressed stream. Motion compensator 21
6 generates a reproduced difference signal by adding the output of the IDCT unit 214 and the reproduced difference signal of the reference frame specified by the motion vector output from the motion vector decoder 215, and stores the generated signal in the image memory 217.

The adder 218 calculates the difference between the reproduced difference signal and the second
The reproduction video signal output from the resolution converter 211 is added to generate a reproduction video signal of the first video signal.

Also, as an example, if the input video signal is 1080
If the video signal is a p-video signal and the low-resolution video signal is a 720p video signal, the motion vector decoder 215 converts the motion vector in the first compressed stream into 3/2 in both the horizontal and vertical directions.
Use by multiplying.

The apparatus according to the twelfth embodiment includes a motion vector decoder, a sub-band inverse transformer, and two high-efficiency decoding means. The decoded compressed stream can be decoded.

Embodiment 13 Hereinafter, a thirteenth embodiment of the present invention will be described.
An embodiment of the present invention will be described with reference to FIG.

In FIG. 13, those having the same numbers as those in FIG. 11 are not described. 220 is a coefficient interpolator.

[0302] The variable length decoder 201 to which the first compressed stream is input performs predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 202 is a variable length decoder 2
The decoded signal which is the output of 01 is inversely quantized in a predetermined quantization step and a DCT coefficient is output. IDCT unit 203 is an inverse quantizer
IDCT the DCT coefficient which is the output of 202. Motion compensator 204
Generates the reproduced video signal by adding the output of the IDCT unit 203 and the reproduced video signal of the reference frame specified by the motion vector, and stores the generated reproduced video signal in the image memory 205.

[0303] The variable length decoder 206 to which the second compressed stream is input performs predetermined decoding and outputs a decoded signal. The inverse quantizer 207 inversely quantizes the decoded signal output from the variable length decoder 206 at a predetermined quantization step, and outputs a DCT coefficient. IDCT unit 208 is the output of inverse quantizer 207
IDCT the DCT coefficient. The adder 209 causes the image memory 210 to store a reproduced video signal obtained by adding the output of the IDCT unit 208 and the output of the motion compensator 204.

[0304] The second resolution converter 211 is provided in the image memory 210.
And converts the resolution of the reproduced video signal stored in.

The variable length decoder 212 to which the third compressed stream has been input performs a predetermined decoding and outputs a decoded signal. The inverse quantizer 213 inversely quantizes the decoded signal output from the variable length decoder 212 at a predetermined quantization step and outputs a DCT coefficient. The coefficient interpolator 220 interpolates the output of the inverse quantizer 213 with the low-frequency component thinned out at the time of encoding by 0 and outputs the result. The IDCT unit 214 is a DCT that is the output of the coefficient interpolator 220.
IDCT the coefficient. The motion vector decoder 215 performs variable length decoding on the first compressed stream, detects only the motion vector, performs a predetermined conversion, and outputs the result as a motion vector for the second compressed stream. The motion compensator 216 is an IDCT unit 2
The playback difference signal is generated by adding the playback difference signal of the reference frame specified by the output of the motion vector decoder 215 and the output of the motion vector decoder 215, and stored in the image memory 217.

[0306] The adder 218 calculates the difference between the reproduced difference signal and the second signal.
The reproduction video signal output from the resolution converter 211 is added to generate a reproduction video signal of the first video signal.

As an example, if the input video signal is 1080
If the video signal is a p-video signal and the low-resolution video signal is a 720p video signal, the motion vector decoder 215 converts the motion vector in the first compressed stream into 3/2 in both the horizontal and vertical directions.
Use by multiplying.

The device of the thirteenth embodiment can decode the compressed stream encoded by the device of the seventh embodiment by including the coefficient interpolator.

(Embodiment 14) Hereinafter, a fourteenth embodiment of the present invention will be described.
An embodiment of the present invention will be described with reference to FIG.

In FIG. 14, the description of the same numbers as in FIGS. 11, 12, and 13 is omitted.

[0311] The variable length decoder 201 to which the first compressed stream is input performs predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 202 is a variable length decoder 2
The decoded signal which is the output of 01 is inversely quantized in a predetermined quantization step and a DCT coefficient is output. IDCT unit 203 is an inverse quantizer
IDCT the DCT coefficient which is the output of 202. Motion compensator 204
Generates the reproduced video signal by adding the output of the IDCT unit 203 and the reproduced video signal of the reference frame specified by the motion vector, and stores the generated reproduced video signal in the image memory 205.

[0312] The variable length decoder 206 to which the second compressed stream has been input performs predetermined decoding and outputs a decoded signal. The inverse quantizer 207 inversely quantizes the decoded signal output from the variable length decoder 206 at a predetermined quantization step, and outputs a DCT coefficient. IDCT unit 208 is the output of inverse quantizer 207
IDCT the DCT coefficient. The adder 209 causes the image memory 210 to store a reproduced video signal obtained by adding the output of the IDCT unit 208 and the output of the motion compensator 204.

[0313] The second resolution converter 211 has an image memory 210.
And converts the resolution of the reproduced video signal stored in.

The variable length decoder 212 to which the third compressed stream has been input performs a predetermined decoding and outputs a decoded signal. The inverse quantizer 213 inversely quantizes the decoded signal output from the variable length decoder 212 at a predetermined quantization step and outputs a DCT coefficient. The coefficient interpolator 220 interpolates the output of the inverse quantizer 213 with the low-frequency components thinned out at the time of encoding by 0, and outputs the result. The inverse subband converter 219 outputs a signal obtained by converting the output signal of the coefficient interpolator 220 using a predetermined subband filter and combining the output signal. The motion vector decoder 215 is the first
Is subjected to variable length decoding to detect only a motion vector, performs a predetermined conversion, and outputs the result as a motion vector for the second compressed stream. The motion compensator 216
The output of the DCT unit 214 and the reproduction difference signal of the reference frame specified by the motion vector output from the motion vector decoder 215 are added to generate a reproduction difference signal, and the image memory 21
Store it in 7.

[0315] The adder 218 calculates the difference between the reproduced difference signal and the second signal.
The reproduction video signal output from the resolution converter 211 is added to generate a reproduction video signal of the first video signal.

Also, as an example, if the input video signal is 1080
If the video signal is a p-video signal and the low-resolution video signal is a 720p video signal, the motion vector decoder 215 converts the motion vector in the first compressed stream into 3/2 in both the horizontal and vertical directions.
Use by multiplying.

The apparatus according to the fourteenth embodiment has a coefficient interpolator and a sub-band inverse transformer, and thus can decode a compressed stream encoded by the apparatus according to the eighth embodiment.

Embodiment 15 Hereinafter, a fifteenth embodiment of the present invention will be described.
An embodiment of the present invention will be described with reference to FIG.

In FIG. 15, those having the same numbers as those in FIG. 11 are not described. 221 is a coefficient separator.

[0320] The variable length decoder 201 to which the first compressed stream is input performs predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 202 is a variable length decoder 2
The decoded signal which is the output of 01 is inversely quantized in a predetermined quantization step and a DCT coefficient is output. IDCT unit 203 is an inverse quantizer
IDCT the DCT coefficient which is the output of 202. Motion compensator 204
Generates the reproduced video signal by adding the output of the IDCT unit 203 and the reproduced video signal of the reference frame specified by the motion vector, and stores the generated reproduced video signal in the image memory 205.

[0321] The variable length decoder 212 to which the second compressed stream is input performs predetermined decoding and outputs a decoded signal. The inverse quantizer 213 inversely quantizes the decoded signal output from the variable length decoder 212 at a predetermined quantization step and outputs a DCT coefficient. The coefficient separator 221 interpolates the output of the inverse quantizer 213 with the low frequency component and the low frequency component with 0, and outputs the high frequency component independently. The IDCT unit 214 performs IDCT on the DCT coefficient of the high frequency component obtained by interpolating the low frequency component output from the coefficient separator 221 with 0. The motion vector decoder 215 is the first
Is subjected to variable length decoding to detect only a motion vector, performs a predetermined conversion, and outputs the result as a motion vector for the second compressed stream. The motion compensator 216
The output of the DCT unit 214 and the reproduction difference signal of the reference frame specified by the motion vector output from the motion vector decoder 215 are added to generate a reproduction difference signal, and the image memory 21
Store it in 7.

The IDCT unit 208 performs IDCT on the low frequency component coefficients output from the coefficient separator 221. The adder 209 is an IDCT unit 208
And the output of the motion compensator 204 is added to the reproduced video signal and stored in the image memory 210.

The second resolution converter 211 has an image memory 210
And converts the resolution of the reproduced video signal stored in.

[0324] The adder 218 calculates the difference between the reproduced difference signal and the second signal.
The reproduction video signal output from the resolution converter 211 is added to generate a reproduction video signal of the first video signal.

Further, as an example, when the input video signal is 1080
If the video signal is a p-video signal and the low-resolution video signal is a 720p video signal, the motion vector decoder 215 converts the motion vector in the first compressed stream into 3/2 in both the horizontal and vertical directions.
Use by multiplying.

The device according to the fifteenth embodiment can decode the compressed stream encoded by the device according to the ninth embodiment by having the coefficient separator.

Embodiment 16 Hereinafter, a sixteenth embodiment of the present invention will be described.
An embodiment of the present invention will be described with reference to FIG.

In FIG. 16, the description of the same numbers as in FIGS. 11, 12, and 15 is omitted.

The variable length decoder 201 to which the first compressed stream has been input performs a predetermined decoding and outputs a motion vector and a decoded signal. The inverse quantizer 202 is a variable length decoder 2
The decoded signal which is the output of 01 is inversely quantized in a predetermined quantization step and a DCT coefficient is output. IDCT unit 203 is an inverse quantizer
IDCT the DCT coefficient which is the output of 202. Motion compensator 204
Generates the reproduced video signal by adding the output of the IDCT unit 203 and the reproduced video signal of the reference frame specified by the motion vector, and stores the generated reproduced video signal in the image memory 205.

[0330] The variable length decoder 212 to which the second compressed stream has been input performs predetermined decoding and outputs a decoded signal. The inverse quantizer 213 inversely quantizes the decoded signal output from the variable length decoder 212 at a predetermined quantization step and outputs a DCT coefficient. The coefficient separator 221 interpolates the output of the inverse quantizer 213 with the low frequency component and the low frequency component with 0, and outputs the high frequency component independently. The subband converter 219 performs inverse subband conversion on the high frequency component obtained by interpolating the low frequency component output from the coefficient separator 221 with 0. The motion vector decoder 215 performs variable length decoding on the first compressed stream, detects only the motion vector, performs a predetermined conversion, and outputs the result as a motion vector for the second compressed stream. The motion compensator 216 adds the output of the sub-band inverse transformer 219 and the playback difference signal of the reference frame specified by the motion vector output from the motion vector decoder 215 to generate a playback difference signal, and To memorize.

The IDCT unit 208 performs IDCT on the low frequency component coefficients output from the coefficient separator 221. The adder 209 is an IDCT unit 208
And the output of the motion compensator 204 is added to the reproduced video signal and stored in the image memory 210.

[0332] The second resolution converter 211 includes an image memory 210.
And converts the resolution of the reproduced video signal stored in.

[0333] The adder 218 calculates the difference between the reproduced difference signal and the second signal.
The reproduction video signal output from the resolution converter 211 is added to generate a reproduction video signal of the first video signal.

Also, as an example, if the input video signal is 1080
If the video signal is a p-video signal and the low-resolution video signal is a 720p video signal, the motion vector decoder 215 converts the motion vector in the first compressed stream into 3/2 in both the horizontal and vertical directions.
Use by multiplying.

Note that the macroblock size is set to 16 pixels × 16 lines in the screen in the luminance signal, and the DCT block size is set to 8 pixels × 8 lines in the screen in the case of other pixel numbers and other line numbers. Good.

In all the hierarchical coding apparatuses of the present embodiment, the coding order in units of frames can be rearranged by having a buffer (or image memory) in the circuit. Further, in all the hierarchical decoding apparatuses of the present embodiment, the output order of the reproduced video signals in frame units can be rearranged to include a buffer (or image memory) in the circuit.

[0337] It is to be noted that, in this embodiment, 1, 3, 5, 7, 11, 1
In 3, when the input video signal is a 1080p video signal and the low-resolution video signal is a 720p video signal, a macro which is a unit of motion detection in the first high-efficiency encoding means and the first high-efficiency decoding means A block is set to 16 pixels × 16 lines in a screen in a luminance signal, a DCT block is set to 8 pixels × 8 lines in a screen, and a unit of motion detection in the third high efficiency coding unit and the third high efficiency decoding unit In the luminance signal, the macro block may be 24 pixels × 24 lines in the screen, and the DCT block may be 12 pixels × 12 lines in the screen.

[0338] It is to be noted that 2, 4, 6, 8, 10, 1
Subband conversion and subband inverse conversion in 2, 14, 16 may be performed by dividing the screen into predetermined units,
After converting the entire screen, the coefficients may be rearranged to form blocks.

The device of the sixteenth embodiment has a coefficient separator and a sub-band inverse transformer, and thus can decode the compressed stream encoded by the device of the tenth embodiment.

Note that each means of the present invention may be realized using a dedicated hardware circuit having such functions, or those functions may be realized as software using a computer.

Further, the program recording medium of the present invention is a program recording medium such as a ROM storing a program for realizing all or a part of the functions of each means in any one of the above-described devices by a computer. is there.

[0342]

The video signal hierarchical coding apparatus according to the first invention of the present invention uses a motion vector used for coding a low-resolution video signal for coding a high-resolution difference signal. 3 does not include motion vector information, so that video signal hierarchical coding can be performed more efficiently than before, and three compressed streams are generated and the second high-efficiency coding is performed. By having the means, the first video signal and the second video signal having less compression distortion can be provided in accordance with the characteristics of the input video signal, and the video signal according to the second invention of the present invention can be provided. The hierarchical coding apparatus can perform the effect of the video signal hierarchical coding apparatus according to the first invention of the present invention with respect to the generation of the third compressed stream by using a subband transform instead of an orthogonal transform,
A video signal layered coding apparatus according to a third aspect of the present invention provides an effect of the video signal layered coding apparatus according to the first aspect of the present invention, and a method for compressing a second compressed video stream by generating a third compressed stream. By taking distortion into account, it is possible to provide a high-resolution video signal with less distortion, and the video signal hierarchical coding apparatus according to the fourth aspect of the present invention provides the video signal hierarchical encoding apparatus according to the third aspect of the present invention. The effect of the signal hierarchical coding apparatus can be performed using subband transform instead of orthogonal transform for the generation of the third compressed stream, and the video signal hierarchical coding apparatus of the fifth invention of the present invention The effects of the video signal hierarchical coding apparatus according to the fourth aspect of the present invention can be realized by different configurations,
A video signal layered coding apparatus according to a sixth aspect of the present invention provides a video signal layered coding apparatus according to the fifth aspect of the present invention, in which the effect of the video signal layered coding apparatus according to the fifth aspect of the present invention is not related to orthogonal transform but to sub-band transform with respect to generation of a third compressed stream. The video signal layered coding apparatus according to the seventh aspect of the present invention is the same as the first aspect of the present invention.
Advantageous effect of the video signal hierarchical coding apparatus of the invention of the present invention, and more efficient coding is provided by including only subjectively important high frequency components in the third compressed stream in the third efficient coding means. The video signal hierarchical coding apparatus according to the eighth aspect of the present invention can perform the orthogonal transform on the generation of the third compressed stream by using the effect of the video signal hierarchical coding apparatus according to the seventh aspect of the present invention. Instead, the video signal hierarchical coding apparatus of the ninth aspect of the present invention can perform the effect of the video signal hierarchical coding apparatus of the seventh aspect of the present invention in two ways. The video signal hierarchical coding apparatus according to the tenth aspect of the present invention can perform the processing using only the compressed stream. With respect to the orthogonal transform, The video signal hierarchical decoding apparatus according to the eleventh aspect of the present invention has a motion vector decoder and a second high-efficiency decoding means. And decoding the compressed stream encoded by the video signal hierarchical coding apparatus of the first invention, the video signal hierarchical coding apparatus of the third invention, and the video signal hierarchical coding apparatus of the fifth invention. The video signal hierarchical decoding apparatus according to the twelfth aspect of the present invention includes a motion vector decoder, a sub-band inverse transformer, and two high-efficiency decoding means. It is possible to decode the compressed stream encoded by the video signal hierarchical coding device of the invention, the video signal hierarchical coding device of the fourth invention, and the video signal hierarchical coding device of the sixth invention. ,
A video signal hierarchical decoding apparatus according to a thirteenth aspect of the present invention comprises:
By having the coefficient interpolator, it is possible to decode the compressed stream encoded by the video signal hierarchical encoding apparatus according to the seventh aspect of the present invention, and to provide the video signal hierarchical aspect according to the fourteenth aspect of the present invention. Since the decoding device has the coefficient interpolator and the sub-band inverse transformer, the decoding device can decode the compressed stream encoded by the video signal hierarchical encoding device according to the eighth aspect of the present invention. A fifteenth aspect of the present invention provides a video signal hierarchical decoding apparatus having a coefficient separator, thereby decoding a compressed stream encoded by the video signal hierarchical encoding apparatus of the ninth aspect of the present invention. It is possible,
A sixteenth aspect of the present invention provides a video signal hierarchical decoding apparatus,
By having a coefficient separator and a subband inverse transformer,
The compressed stream encoded by the video signal hierarchical encoding apparatus according to the tenth aspect of the present invention can be decoded.

[Brief description of the drawings]

FIG. 1 is a block diagram of a video signal hierarchical coding apparatus according to a first invention of the present invention.

FIG. 2 is a block diagram of a video signal hierarchical coding apparatus according to a second invention of the present invention.

FIG. 3 is a block diagram of a video signal hierarchical coding apparatus according to a third invention of the present invention.

FIG. 4 is a block diagram of a video signal hierarchical coding apparatus according to a fourth invention of the present invention.

FIG. 5 is a block diagram of a video signal hierarchical coding apparatus according to a fifth invention of the present invention.

FIG. 6 is a block diagram of a video signal hierarchical coding apparatus according to a sixth invention of the present invention.

FIG. 7 is a block diagram of a video signal hierarchical coding apparatus according to a seventh invention of the present invention.

FIG. 8 is a block diagram of a video signal hierarchical coding apparatus according to an eighth aspect of the present invention.

FIG. 9 is a block diagram of a video signal hierarchical coding apparatus according to a ninth aspect of the present invention.

FIG. 10 is a block diagram of a video signal hierarchical coding apparatus according to a tenth aspect of the present invention.

FIG. 11 is a block diagram of a video signal hierarchical decoding apparatus according to an eleventh aspect of the present invention.

FIG. 12 is a block diagram of a video signal hierarchical decoding apparatus according to a twelfth aspect of the present invention.

FIG. 13 is a block diagram of a video signal hierarchical decoding apparatus according to a thirteenth aspect of the present invention.

FIG. 14 is a block diagram of a video signal hierarchical decoding apparatus according to a fourteenth aspect of the present invention.

FIG. 15 is a block diagram showing a video signal hierarchical decoding apparatus according to a fifteenth aspect of the present invention;

FIG. 16 is a block diagram of a video signal hierarchical decoding apparatus according to a sixteenth aspect of the present invention.

FIG. 17 is a diagram illustrating thinning and replacement of orthogonal transform coefficients according to the present invention.

FIG. 18 is a diagram illustrating thinning and replacement of subband transform coefficients according to the present invention.

FIG. 19 is a block diagram of a conventional video signal hierarchical decoding device.

FIG. 20 is a block diagram of a conventional video signal hierarchical decoding device.

[Explanation of symbols]

101,1001 First resolution converter 102,116,1002,1012 Motion detector 103,109,123,204,216,1004,1009,1014,1019,1024,1030
Motion compensator 104,117,205,210,217,1003,1013,1025,1031 Image memory 105,119,1005,1015 DCT unit 106,112,120,1006,1016 Quantizer 107,121,127,202,207,213,1007,1017,1022,1028 Inverse quantizer 108,122,128,203,208,214,1008,18 1029 IDCT
Unit 110,113,124,212,1010,1020 variable length encoder 111 difference unit 114,211,1011,1026 second resolution converter 115 difference signal generator 118 motion vector converter 125 sub-band converter 126,219 sub-band inverse converter 129,130,209,218 adder 131 Coefficient thinning unit 132 Coefficient replacement unit 201,206,1021,1027 Variable length decoder 215 Motion vector decoder 220 Coefficient interpolator 221 Coefficient separator

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C059 KK01 KK06 LA00 LB05 MA05 MA23 MA24 MA31 MA32 MA41 MA47 MC00 MC11 ME01 NN01 NN21 PP04 SS01 SS20 UA02 UA05 UA12 UA14 UA15

Claims (17)

[Claims] A first resolution conversion unit configured to generate a low-resolution second video signal from a high-resolution first video signal that is an input video signal; First high-efficiency encoding means for outputting a first compressed stream which has been highly-encoded using transform and quantization; and quantization generated at the time of high-efficiency encoding in the first high-efficiency encoding means. A second high-efficiency encoding unit that encodes the error signal at the time using quantization and variable-length encoding to output a second compressed stream; and from the second video signal, the first video A second resolution conversion unit that generates a third video signal having the same resolution as the signal; a difference signal generation unit that generates a difference signal between the first video signal and the third video signal; Using the motion vector detected in the efficiency coding, Video signal hierarchization, comprising: a third high-efficiency encoding unit that outputs a third compressed stream obtained by encoding a signal using motion compensation, orthogonal transform, and quantization. Encoding device. 2. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal that is an input video signal; First high-efficiency encoding means for outputting a first compressed stream which has been highly-encoded using transform and quantization; and quantization generated at the time of high-efficiency encoding in the first high-efficiency encoding means. A second high-efficiency encoding unit that encodes the error signal at the time using quantization and variable-length encoding and outputs a second compressed stream; and the first video signal from the second video signal. Second resolution conversion means for generating a third video signal having the same resolution as the first video signal; difference signal generation means for generating a difference signal between the first video signal and the third video signal; The difference is calculated using the motion vector detected in the efficiency coding. And a third high-efficiency encoding unit that outputs a third compressed stream obtained by encoding the signal using a sub-band transform (including a wavelet transform), which is motion compensation and frequency division, and quantization. A video signal hierarchical coding apparatus. 3. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; A first high-efficiency encoding unit that outputs a first compressed stream that has been highly-encoded using transform and quantization; and wherein the first high-efficiency encoding unit performs quantization at the time of high-efficiency encoding. A second high-efficiency encoding unit that encodes the error signal by using quantization and variable-length encoding to output a second compressed stream; and a decoded video signal in the first high-efficiency encoding unit. Adding means for generating a decoded signal of a second video signal to which a decoded signal is added in the second high-efficiency encoding means; and decoding the first video signal from the decoded signal of the second video signal. A second solution for generating a third video signal having the same resolution as Degree conversion means, difference signal generation means for generating a difference signal between the first video signal and the third video signal, and the difference signal using a motion vector detected in the first high-efficiency encoding. And a third high-efficiency encoding means for outputting a third compressed stream that has been highly-encoded using motion compensation, orthogonal transform, and quantization. . 4. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; A first high-efficiency encoding unit that outputs a first compressed stream that has been highly-encoded using transform and quantization; and wherein the first high-efficiency encoding unit performs quantization at the time of high-efficiency encoding. A second high-efficiency encoding unit that encodes the error signal by using quantization and variable-length encoding to output a second compressed stream; and a decoded video signal in the first high-efficiency encoding unit. Adding means for generating a decoded signal of a second video signal to which the decoded signal is added in the second high-efficiency encoding means; and a first video signal from the decoded signal of the second video signal. Second resolution for generating a third video signal of the same resolution Conversion means; difference signal generation means for generating a difference signal between the first video signal and the third video signal; and converting the difference signal using a motion vector detected in the first high-efficiency coding. A third high-efficiency encoding unit that outputs a third compressed stream that has been highly-encoded using subband transform (including wavelet transform) and quantization, which are compensation and frequency division. Video signal hierarchical coding device. 5. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; A first high-efficiency encoding unit that outputs a first compressed stream that has been highly-encoded using transform and quantization; and wherein the first high-efficiency encoding unit performs quantization at the time of high-efficiency encoding. A second high-efficiency encoding unit that encodes the error signal using quantization and variable-length encoding to output a second compressed stream; and a dequantized signal in the first high-efficiency encoding unit. A decoded signal generating means for generating a decoded signal of the second video signal by adding the inverse quantized signal of the second video signal and performing an inverse orthogonal transform, From the decoded signal, a third video signal having the same resolution as the first video signal Second resolution conversion means for generating a video signal; difference signal generation means for generating a difference signal between the first video signal and the third video signal; motion detected in the first high-efficiency encoding And a third high-efficiency encoding unit that outputs a third compressed stream obtained by performing high-efficiency encoding on the difference signal using motion compensation, orthogonal transform, and quantization using a vector. Video signal hierarchical coding device. 6. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; A first high-efficiency encoding unit that outputs a first compressed stream that has been highly-encoded using transform and quantization; and wherein the first high-efficiency encoding unit performs quantization at the time of high-efficiency encoding. A second high-efficiency encoding unit that encodes the error signal using quantization and variable-length encoding to output a second compressed stream; and a dequantized signal in the first high-efficiency encoding unit. A decoded signal generating means for generating a decoded signal of the second video signal by adding the inverse quantized signal of the second video signal and performing an inverse orthogonal transform, From the decoded signal, a third video signal having the same resolution as the first video signal Second resolution conversion means for generating a video signal; difference signal generation means for generating a difference signal between the first video signal and the third video signal; motion detected in the first high-efficiency encoding A third high-efficiency code for outputting a third compressed stream obtained by encoding the difference signal using a vector and using a sub-band transform (including a wavelet transform), which is motion compensation and frequency division, and quantization; A video signal hierarchical coding apparatus, comprising: 7. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; A first high-efficiency encoding unit that outputs a first compressed stream that has been highly-encoded using transform and quantization; and wherein the first high-efficiency encoding unit performs quantization at the time of high-efficiency encoding. A second high-efficiency encoding unit that encodes the error signal using quantization and variable-length encoding to output a second compressed stream; and from the second video signal, the first video signal Second resolution conversion means for generating a third video signal having the same resolution as the first video signal; difference signal generation means for generating a difference signal between the first video signal and the third video signal; The difference is calculated using the motion vector detected in the efficiency coding. And a third high-efficiency encoding unit that outputs a third compressed stream obtained by encoding the signal with high efficiency using motion compensation, orthogonal transform, and quantization, wherein the third high-efficiency encoding unit includes: , In the signal after orthogonal transformation,
The video signal hierarchical coding apparatus, wherein the third compressed stream is created by thinning out components included in the resolution of the second video signal. 8. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; First high-efficiency encoding means for outputting a first compressed stream which has been highly-encoded using transform and quantization; and quantization generated at the time of high-efficiency encoding in the first high-efficiency encoding means. A second high-efficiency encoding unit that encodes the error signal at the time using quantization and variable-length encoding and outputs a second compressed stream; and the first video signal from the second video signal. Second resolution conversion means for generating a third video signal having the same resolution as the first video signal; difference signal generation means for generating a difference signal between the first video signal and the third video signal; The difference is calculated using the motion vector detected in the efficiency coding. A third high-efficiency encoding unit that outputs a third compressed stream obtained by encoding the signal using sub-band transform (including wavelet transform) that is motion compensation and frequency division and quantization, and Wherein the third high-efficiency encoding means creates a third compressed stream by thinning out components included in the resolution of the second video signal in the signal after subband conversion. Hierarchical coding device. 9. A first resolution conversion means for generating a low-resolution second video signal from a high-resolution first video signal which is an input video signal; A first high-efficiency encoding unit that outputs a first compressed stream that has been highly-encoded using transform and quantization; and wherein the first high-efficiency encoding unit performs quantization at the time of high-efficiency encoding. Quantization means for quantizing the error signal of the first, second resolution conversion means for generating a third video signal having the same resolution as the first video signal from the second video signal, A difference signal generating means for generating a difference signal between a video signal and the third video signal; and using the motion vector detected in the first high-efficiency encoding, the difference signal to perform motion compensation, orthogonal transform, and quantization. The third compression scheme, which is highly efficient encoded using ; And a third high efficiency coding means for outputting stream, the third high-efficiency coding means, in the signal after the orthogonal transformation,
Creating a third compressed stream in which a component included in the resolution of the second video signal is replaced by a quantized signal output from the quantizing means. 10. A first method for generating a low-resolution second video signal from a high-resolution first video signal that is an input video signal.
A first high-efficiency encoding unit that outputs a first compressed stream obtained by performing high-efficiency encoding on the second video signal using motion compensation, orthogonal transformation, and quantization, (1) a quantization means for quantizing an error signal at the time of quantization generated at the time of high-efficiency encoding, and a third video signal having the same resolution as that of the first video signal. Second resolution conversion means for generating a video signal; difference signal generation means for generating a difference signal between the first video signal and the third video signal; motion detected in the first high-efficiency encoding A third high-efficiency code for outputting a third compressed stream obtained by encoding the difference signal using a vector and using a sub-band transform (including a wavelet transform), which is motion compensation and frequency division, and quantization; And means for converting The third high-efficiency encoding means replaces a component included in the resolution of the second video signal in the signal after subband conversion with a quantized signal output from the quantizing means. Creating a stream, a video signal hierarchical coding apparatus. 11. A video signal hierarchical decoding device for a signal output by the video signal hierarchical encoding device according to claim 1, wherein the first compressed stream is: A first high-efficiency decoding unit that outputs a decoded video signal of the second video signal by performing variable-length decoding, inverse quantization, inverse orthogonal transform, and motion compensation; By adding the variable-length-decoded, inverse-quantized, and inverse-orthogonal-transformed signal to the decoded video signal of the second video signal that is the output of the first high-efficiency encoding means. A second high-efficiency decoding unit that outputs a decoded video signal of a second video signal having less compression distortion than an output of the high-efficiency decoding unit; and a second video that is an output of the second high-efficiency decoding unit. From the decoded video signal of the signal, the same as the first video signal A second resolution converting means for generating a third video signal having a resolution, the third compressed stream and the first compressed stream being input, and a variable length decoding of the third compressed stream; A third high-efficiency encoding unit that outputs a decoded signal of a differential signal by performing inverse quantization, inverse orthogonal transform, and performing motion compensation using a motion vector obtained by decoding the first compressed stream; A video signal hierarchical decoding apparatus, comprising: an adding unit that adds the third video signal and the decoded signal of the difference signal to generate a decoded video signal of the first video signal. 12. A video signal hierarchical decoding device for a signal output by the video signal hierarchical encoding device according to claim 2, wherein the first compressed stream is: A first high-efficiency decoding unit that outputs a decoded video signal of the second video signal by performing variable-length decoding, inverse quantization, inverse orthogonal transform, and motion compensation; By adding the variable-length-decoded, inverse-quantized, and inverse-orthogonal-transformed signal to the decoded video signal of the second video signal that is the output of the first high-efficiency encoding means. A second high-efficiency decoding unit that outputs a decoded video signal of the second video signal having less compression distortion than an output of the high-efficiency decoding unit; and a second high-efficiency decoding unit that is an output of the second high-efficiency decoding unit. From the decoded video signal of the video signal, the same as the first video signal Second resolution converting means for generating a third video signal having a resolution, the third compressed stream and the first compressed stream being input, and the third compressed stream being subjected to variable-length decoding, inverse quantization. And a sub-band inverse transform, and performing motion compensation using a motion vector obtained by decoding the first compressed stream, thereby outputting a decoded signal of a difference signal, A video signal hierarchical decoding device, comprising: adding means for adding a third video signal and a decoded signal of the difference signal to generate a decoded video signal of the first video signal. 13. A video signal hierarchical decoding apparatus for a signal output by the video signal hierarchical encoding apparatus according to claim 7, wherein the first compressed stream is subjected to variable length decoding and inverse quantization. A first high-efficiency decoding unit that outputs a decoded video signal of the second video signal by performing inverse orthogonal transform and performing motion compensation, and variable-length decoding and inverse quantization of the second compressed stream. ,
By adding the inverse orthogonally transformed signal to the decoded video signal of the second video signal, which is the output of the first high-efficiency encoding means, the compression distortion is reduced from the output of the first high-efficiency decoding means. A second high-efficiency decoding unit that outputs a decoded video signal of the second video signal having a small amount of the second video signal; A second resolution conversion unit that generates a third video signal having the same resolution as the first video signal; and the third compressed stream and the first compressed stream as inputs, and the third compressed stream is Variable-length decoding, inverse quantization, zero-value interpolation of coefficients decimated at the time of encoding, inverse orthogonal transformation, and motion compensation using a motion vector obtained by decoding the first compressed stream. Output decoded signal of signal A third high-efficiency encoding unit; and an adding unit that adds the third video signal and the decoded signal of the difference signal to generate a decoded video signal of the first video signal. Video signal hierarchical decoding device. 14. A video signal hierarchical decoding apparatus for a signal output by the video signal hierarchical encoding apparatus according to claim 8, wherein the first compressed stream is subjected to variable length decoding and inverse quantization. A first high-efficiency decoding unit that outputs a decoded video signal of the second video signal by performing an inverse orthogonal transform and performing motion compensation, and performs a variable length decoding and an inverse quantum decoding on the second compressed stream. By adding the decoded signal to the decoded video signal of the second video signal, which is the output of the first high-efficiency encoding means, from the output of the first high-efficiency decoding means. A second high-efficiency decoding unit that outputs a decoded video signal of the second video signal with little compression distortion, and a decoded video signal of the second video signal that is an output of the second high-efficiency decoding unit From the third video signal having the same resolution as the first video signal. A second resolution converting means for generating a video signal, the third compressed stream and the first compressed stream being input, and the third compressed stream being subjected to variable-length decoding, inverse quantization and encoding. The third sub-band is inversely transformed after zero-value interpolation of the thinned coefficients, and motion compensation is performed using a motion vector obtained by decoding the first compressed stream, thereby outputting a decoded signal of the differential signal. A video signal layer comprising: efficiency coding means; and addition means for adding the third video signal and the decoded signal of the difference signal to generate a decoded video signal of the first video signal. Decryption device. 15. A video signal hierarchical decoding device for a signal output by the video signal hierarchical encoding device according to claim 9, wherein the first compressed stream is subjected to variable length decoding and inverse quantization. A first high-efficiency decoding unit that outputs a decoded video signal of the second video signal by performing an inverse orthogonal transform and performing motion compensation, and inputs the third compressed stream and the first compressed stream. The third compressed stream is subjected to variable-length decoding and inverse-quantized conversion signal separation into a low-frequency conversion signal and a high-frequency conversion signal in which the low-frequency component is replaced with 0. A second high-efficiency encoding unit that outputs a decoded signal of a differential signal by performing an inverse orthogonal transform on the converted signal of the frequency component and performing motion compensation using a motion vector obtained by decoding the first compressed stream. When, A signal obtained by inverse orthogonally transforming the converted signal, which is a low-frequency component, output from the second high-efficiency encoding means is converted into a decoded video signal of a second video signal, which is output from the first high-efficiency encoding means. And an adding means for outputting a decoded video signal of the second video signal having less compression distortion than the output of the first high-efficiency decoding means, and the second output being the output of the adding means. A second resolution conversion unit for generating a third video signal having the same resolution as the first video signal from a decoded video signal of the video signal; and a third resolution conversion unit for generating the third video signal. A video signal hierarchical decoding apparatus comprising: an adding unit that adds a decoded signal of a differential signal as an output and generates a decoded video signal of the first video signal. 16. A video signal hierarchical decoding apparatus for a signal output by the video signal hierarchical encoding apparatus according to claim 10, wherein the first compressed stream is subjected to variable length decoding and inverse quantization. A first high-efficiency decoding unit that outputs a decoded video signal of the second video signal by performing an inverse orthogonal transform and performing motion compensation, and inputs the third compressed stream and the first compressed stream. The third compressed stream is subjected to variable length decoding and inverse quantization to separate the converted signal into a converted signal as a low frequency component and a converted signal as a high frequency component in which the low frequency component is replaced with 0. A second high-efficiency encoding unit that outputs a decoded signal of a difference signal by sub-band-inverting the converted signal of the component and performing motion compensation using a motion vector obtained by decoding the first compressed stream. A signal obtained by performing an inverse orthogonal transform on the converted signal, which is a low-frequency component output from the second high-efficiency encoding unit, of the second video signal output from the first high-efficiency encoding unit. An adding unit that outputs a decoded video signal of the second video signal having less compression distortion than an output of the first high-efficiency decoding unit by adding the decoded video signal to the decoded video signal; Second resolution conversion means for generating a third video signal having the same resolution as the first video signal from the decoded video signal of the second video signal; and the third video signal and the second high-efficiency decoding Means for adding a decoded signal of the difference signal output from the means to generate a decoded video signal of the first video signal. 17. A program recording medium in which a program for realizing all or a part of the function of each means in a device according to any one of claims 1 to 16 by a computer is stored.