WO1998021896A1 - Digital image coding method and digital image coder, and digital image decoding method and digital image decoder, and data storage medium - Google Patents
Digital image coding method and digital image coder, and digital image decoding method and digital image decoder, and data storage medium Download PDFInfo
- Publication number
- WO1998021896A1 WO1998021896A1 PCT/JP1997/004107 JP9704107W WO9821896A1 WO 1998021896 A1 WO1998021896 A1 WO 1998021896A1 JP 9704107 W JP9704107 W JP 9704107W WO 9821896 A1 WO9821896 A1 WO 9821896A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- image signal
- image
- resolution
- reproduced
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/41—Bandwidth or redundancy reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/649—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding the transform being applied to non rectangular image segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
- H04N19/29—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving scalability at the object level, e.g. video object layer [VOL]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
Definitions
- Digital image coding method and digital image coding apparatus Digital image decoding method and digital image decoding apparatus, and data storage medium
- the present invention relates to a method and an apparatus for encoding a digital image signal, a method and an apparatus for decoding an encoded digital image signal, and a method for encoding and decoding a digital image signal by a computer.
- the present invention relates to a data storage medium storing a program, and more particularly to a spatio-temporal hierarchical encoding process for an image of an object having an arbitrary shape and a spatio-temporal hierarchical decoding process corresponding thereto.
- image signals are separately compressed for each object so that the compression efficiency can be improved and the image signal can be reproduced for each area (hereinafter referred to as image space) corresponding to each object that composes one screen.
- image space corresponding to each object that composes one screen.
- a method of encoding and transmitting has been put to practical use. In this method, on the reproduction side, encoded image signals corresponding to the respective objects are decoded, and the images of the individual objects reproduced by the decoding are combined to form an image corresponding to one screen. Is displayed. By encoding the image signal in object units in this manner,
- a coding method using a transform method for example, a shape-adaptive discrete cosine transform, or a method in which pixel values of pixels constituting an invalid area of an image space (that is, an outer area of an object image) are supplemented by a predetermined method
- a transform method for example, a shape-adaptive discrete cosine transform
- a macroblock consisting of 16 ⁇ 16 pixels is used as a unit area to correspond to a target macroblock to be subjected to encoding processing.
- the prediction signal is an image signal corresponding to a prediction region obtained by motion compensation.
- this is a process of detecting, as a prediction region, a region of 16 ⁇ 16 pixels that gives an image signal having the smallest difference from the image signal of the target macroblock in the screen subjected to the decoding process.
- this prediction region is located at the boundary of the object image in the image space, it will include pixels having insignificant (undefined) sample values (pixel values). Therefore, in such a prediction region, the image signal corresponding to the prediction region is subjected to a compensation process of replacing the insignificant sample value with a significant pseudo sample value, and then subjected to the compensation process.
- the difference between the signal and the image signal of the target MAC block is determined as a prediction error signal (difference signal), and a conversion process for encoding the difference signal is performed.
- the reason why the compensation processing is performed on the prediction area is to suppress the difference signal, in other words, to reduce the code amount when encoding the difference signal.
- an image signal corresponding to each object that is, an image space including the object image is formed.
- a low-resolution object image can be reproduced by decoding a part of the bit string extracted from the transmitted data (encoded bit stream). By decoding the data, a high-resolution object image can be reproduced.
- an image signal (high-resolution image signal) corresponding to a high-resolution image is converted into an image signal (low-resolution image signal) corresponding to a low-resolution image.
- Image signal That is, a high-resolution image signal corresponding to the target block to be encoded is predicted using the corresponding low-resolution image signal to generate a predicted image signal, and the high-resolution image signal of the target block is generated. And a difference signal obtained by subtracting the prediction image signal from the prediction image signal is encoded.
- a shape signal indicating an arbitrary shape of the object is used as an image signal, and a texture signal including a luminance signal and a color difference signal for displaying an object image in gradation color.
- a texture signal including a luminance signal and a color difference signal for displaying an object image in gradation color.
- the low-resolution texture signal corresponding to the macroblock located at the boundary of the object includes insignificant (undefined) sample values (pixel values)
- prediction is performed using the low-resolution texture signal as it is.
- a signal is generated, and the predicted signal is subtracted from a high-resolution texture signal of the target macroblock to be encoded, and a differential pixel value corresponding to a pixel located at the boundary of the object in the differential signal is obtained. Is a large value, and it is not possible to efficiently encode a high-resolution texture signal.
- the image space formed by the image texture signal is A situation arises when the macroblock region of is completely outside the object image. In such a situation, even if a prediction signal of a high-resolution texture signal based on a low-resolution texture signal is used, the difference signal between the high-resolution texture signal and the predicted shape signal cannot be efficiently suppressed.
- the present invention has been made in order to solve the above-described problems, and corresponds to a plurality of hierarchies having different resolutions based on an image signal for forming an image space including an object image having an arbitrary shape.
- an image signal for forming an image space including an object image having an arbitrary shape.
- the image signal of the unit area located at the boundary of the object is encoded. It is an object of the present invention to obtain a digital image encoding method and a digital image encoding device capable of efficiently compressing.
- the present invention provides a method for encoding an image signal for forming an image space including an object image, the image encoding signal obtained by a hierarchical encoding process capable of efficiently compressing the image signal by a corresponding hierarchical decoding process.
- An object of the present invention is to provide a digital image decoding method and a digital image decoding device capable of correctly reproducing.
- the present invention provides a digital recording medium storing a program for realizing, by a computer, the hierarchical encoding process by the digital image encoding method and the hierarchical decoding process by the digital image decoding method. Aim.
- a digital image encoding method comprises a first and a second input having different resolutions for forming an image space composed of a plurality of pixels including an image having an arbitrary shape.
- a digital image encoding method for encoding an image signal wherein the first input image signal is compressed and encoded to generate a first encoded image signal, and the compressed first input image is generated.
- An encoding process of expanding a signal to generate a first reproduced image signal is performed for each unit area that divides the image space, and the first reproduced image signal corresponding to each unit area is encoded. And performing a supplementary process of replacing the insignificant pixel value with a pseudo pixel value obtained by a predetermined method.
- a predicted signal of the second input image signal is generated based on the first reproduced image signal on which the interpolation processing has been performed.
- the difference signal which is the difference between the second input image signal different from the first input image signal and its prediction signal, is suppressed, and the second input image signal corresponding to the unit area located at the boundary of the object Can be compressed while suppressing poor code efficiency.
- a signal generated based on the first reproduced image signal in the target unit area is used as the prediction signal. Since it is used, the encoding process of the second input image signal is delayed by only the time for processing the unit area as compared with the encoding process of the first input image signal. For this reason, the decoding side converts the high-resolution image and the low-resolution image almost in time based on the first and second encoded image signals obtained by encoding the first and second input image signals. It can be reproduced without any shift.
- This invention is a digital image code according to Claim 1.
- the first reproduction image signal corresponding to each unit area is compensated based on a significant pixel value in the first reproduction image signal.
- the difference between the predicted signal of the second input image signal obtained from the second input image signal and the second input image signal can be effectively suppressed.
- a digital image encoding device includes a first image encoding device for encoding a first input image signal for forming an image space including a plurality of pixels including an image having an arbitrary shape. And a second encoding unit that encodes a second input image signal having a different resolution from the first input image signal to form an image space including a plurality of pixels including the image.
- An encoding processing unit wherein the first encoding processing unit compresses and encodes the first input image signal to generate a first encoded image signal, and generates the first encoded image signal.
- a first encoding unit that performs an encoding process of generating a first reproduced image signal by expanding the input image signal of each of the unit regions, the first encoding unit corresponding to each of the unit regions described above.
- the insignificant pixel value of the first reproduced image signal is determined by a predetermined method.
- a compensating unit for performing a compensating process for replacing the pseudo-pixel value with the pseudo pixel value.
- the second encoding unit is configured to perform the compensation based on the first reproduced image signal subjected to the compensating process.
- Prediction signal generating means for predicting a second input image signal corresponding to the region to generate a prediction signal, and compressing and encoding the second input image signal corresponding to each unit region and a difference signal of the prediction signal And generates an encoded difference signal, and expands the compressed difference signal, and adds the prediction signal to the expanded difference signal to generate a second reproduced image signal.
- a second encoding unit that performs the encoding process for each unit area.
- the prediction signal of the second input image signal is generated based on the first reproduced image signal on which the compensation processing has been performed.
- the difference signal which is the difference between the second input image signal different from the first input image signal and the predicted signal, is suppressed, and the unit area located at the boundary of the object
- a signal generated based on the first reproduced image signal in the target unit area is used as the prediction signal. Since it is used, the encoding process of the second input image signal is less time-consuming and delayed than the encoding process of the first input image signal by the time for processing the unit area. For this reason, the decoding side converts the high-resolution image and the low-resolution image almost in time based on the first and second encoded image signals obtained by encoding the first and second input image signals. It can be reproduced without any shift.
- the first reproduced image signal subjected to the compensation processing is converted to the second input image signal.
- Resolution conversion means for converting the resolution to match the resolution of the image signal and outputting a resolution conversion signal, wherein the prediction signal generation means is configured to perform a second input corresponding to each unit area based on the second reproduced image signal.
- Prediction means for predicting an image signal to generate an auxiliary prediction signal; and switch means for switching between the auxiliary prediction signal and the resolution conversion signal based on control information included in the second input image signal.
- the output of the switch means is output as a prediction signal of a second input image signal corresponding to each of the unit areas.
- one of the auxiliary prediction signal obtained from the second input image signal and the resolution conversion signal obtained from the first input image signal is converted into the second input image. Selection is performed based on the control information included in the signal, and the selected signal is output as a prediction signal of the second input image signal corresponding to each unit area. Therefore, the prediction signal is adaptively switched with a simple configuration. Thus, the coding efficiency in the hierarchical coding process can be further improved.
- the first reproduced image signal subjected to the compensation processing is converted into the second input image signal having the resolution equal to the second input signal.
- Resolution conversion means for converting the resolution of the image signal to one SrT and outputting a resolution conversion signal, wherein the prediction signal generation means is provided with a second signal corresponding to each unit area based on the second reproduced image signal. Predict input image signal to generate auxiliary prediction signal
- Replacement form (Rule 26) Generating means; and averaging means for weighting and averaging the auxiliary prediction signal and the resolution conversion signal, and outputting an output of the averaging means to a second input corresponding to each unit area. This is configured to output as a prediction signal of an image signal.
- the auxiliary prediction signal obtained from the second input image signal and the resolution conversion signal obtained from the first input image signal are weighted and averaged. Since the converted signal is output as a predicted signal of the second input image signal corresponding to each unit area, the predicted signal of the second input image signal obtained from the first reproduced image signal and the second input image signal are output. It is possible to finely control the magnitude of the difference value from the signal, and it is possible to improve the coding efficiency in the hierarchical coding process.
- the present invention (Claim 6) is the digital image encoding apparatus according to Claim 5, wherein the compensation means comprises means for rewriting the insignificant pixel value in the first reproduced image signal to the first reproduced image signal.
- the compensation means comprises means for rewriting the insignificant pixel value in the first reproduced image signal to the first reproduced image signal.
- a compensation process is performed to replace a pseudo pixel value obtained based on a significant pixel value in a reproduced image signal.
- the first reproduction image signal corresponding to each unit area is compensated based on a significant pixel value in the first reproduction image signal.
- the difference between the predicted signal of the second input image signal obtained from the second input image signal and the second input image signal can be effectively suppressed.
- the first encoding unit includes a first input image signal corresponding to each of the unit areas.
- An arithmetic unit for calculating a difference between the difference signal and the prediction signal and outputting a difference signal; a compressor for compressing the difference signal; a code a for encoding the compressed difference signal;
- a decompressor for decompressing the difference signal, an adder for adding the output of the decompressor and the predicted signal of the first input image signal to output a first reproduced image signal to the compensation means,
- a frame memory for storing an output of the interpolation means, and a first input image signal corresponding to each of the unit areas, based on the first reproduced image signal which has been subjected to the interpolation and stored in the frame memory.
- a prediction signal generator that generates a prediction signal. It is a thing.
- the image coding apparatus having such a configuration, the first reproduced image subjected to the compensation processing
- the digital image decoding method provides a method for decoding a first and second image signals having different resolutions for forming an image space including a plurality of pixels including an image having an arbitrary shape.
- a digital image decoding method for generating first and second reproduced image signals by decoding first and second encoded image signals obtained by performing an encoding process;
- a decoding process for generating a first reproduced image signal from an encoded image signal is performed for each unit region that partitions the image space, and a first reproduced image signal corresponding to each unit region is processed. Then, a compensation process for replacing the insignificant pixel value with a pseudo pixel value obtained by a predetermined method is performed.
- a second process corresponding to each of the unit areas is performed. Predict the playback image signal and generate the playback prediction signal And decoding the second encoded image signal corresponding to each unit area to reproduce a difference signal between the second image signal and its prediction signal. Is added to generate a second reproduced image signal, and the difference decoding process is performed for each unit area.
- a playback prediction signal of the second playback image signal is generated based on the first playback image signal on which the compensation processing has been performed.
- the second encoded image signal obtained by hierarchically encoding the second image signal based on the first image signal can be correctly hierarchically decoded using the first reproduced image signal.
- the prediction signal is obtained by converting the first reproduced image signal corresponding to the target unit region to the first reproduced image signal. Since the signal generated based on the first encoded image signal is used, the decoding process of the second encoded image signal is performed only for the time required to process the unit area as compared with the decoding process of the first encoded image signal. No delay. Therefore, a high-resolution image and a low-resolution image can be reproduced with almost no time lag based on the first and second coded image signals obtained by the hierarchical coding process of the image signal.
- the present invention (Claim 9) is the digital image decoding method according to Claim 8, wherein the compensation processing for the first reproduced image signal corresponding to each of the unit areas is performed.
- the process of supplementing the first reproduced image signal corresponding to each unit area is performed based on a significant pixel value in the first reproduced image signal.
- a digital image decoding apparatus includes a first image signal for forming an image space including a plurality of pixels including an image having an arbitrary shape; A first decoding processing unit for decoding the first encoded image signal obtained by performing the processing to generate a first reproduced image signal, and an image space including a plurality of pixels including the image.
- a second reproduced image signal is obtained by decoding a second encoded image signal obtained by performing an encoding process on a second image signal having a different resolution from the first image signal to form the second encoded image signal.
- a second decoding unit that generates a first decoded image signal from the first encoded image signal, and a second decoding unit that generates a first reproduced image signal from the first encoded image signal.
- First decoding means for each unit area for partitioning the image space; and And a compensation means for performing compensation processing for replacing the insignificant pixel value with a pseudo pixel value obtained by a predetermined method for the one reproduced image signal.
- Prediction signal generating means for predicting a second reproduced image signal corresponding to each of the unit areas from the first reproduced image signal on which the compensation processing has been performed to generate a reproduced predicted signal; and Decoding the second encoded image signal corresponding to the second image signal to reproduce a difference signal between the second image signal and the prediction signal thereof, and adding the reproduction prediction signal to the difference signal to generate a second signal.
- a second decoding unit that performs the difference decoding process for generating the reproduced image signal for each unit area.
- the reproduction prediction signal of the second reproduction image signal is generated based on the first reproduction image signal subjected to the compensation processing.
- the encoded image signal can be correctly hierarchically decoded using the first reproduced image signal.
- the first reproduced image signal corresponding to the target unit area is used as a prediction signal. Since the signal generated based on the first encoded image signal is used, the decoding process of the second encoded image signal is performed only for the time required to process the unit area as compared with the decoding process of the first encoded image signal. No delay. Therefore, a high-resolution image and a low-resolution image can be reproduced with almost no time lag based on the first and second encoded image signals obtained by the hierarchical encoding process of the image signal.
- the present invention is the digital image decoding apparatus according to Claim 10, wherein the first reproduced image signal having undergone the above-mentioned compensation processing is provided at a resolution of Comprises a resolution conversion means for converting the resolution to match the resolution of the second reproduced image signal and outputting a resolution converted signal, wherein the prediction signal generating means is provided for each unit area based on the second reproduced image signal.
- Prediction means for predicting a second reproduced image signal corresponding to the above and generating an auxiliary prediction signal; and adding the auxiliary prediction signal and the resolution conversion signal to control information included in the second encoded image signal.
- Switch means for switching based on the output of the switch means, and outputting the output of the switch means as a prediction signal of a second reproduced image signal corresponding to each of the unit areas.
- one of the auxiliary prediction signal obtained from the second reproduced image signal and the resolution conversion signal obtained from the first reproduced image signal is converted into the second code. Selection based on the control information included in the image signal, and outputs the selected signal as a reproduction prediction signal of the second reproduction image signal corresponding to each unit area. Can be adaptively switched, and a hierarchical decoding process corresponding to a hierarchical encoding process with higher encoding efficiency can be easily realized.
- the present invention (Claim 12) is the digital image decoding device according to the claim 10, wherein the first reproduced image signal subjected to the compensation processing has a resolution of Resolution converting means for converting the resolution to match the resolution of the second reproduced image signal and outputting a resolution converted signal, wherein the prediction signal generating means corresponds to each unit area based on the second reproduced image signal Predict the second playback image signal to obtain the auxiliary prediction signal.
- averaging means for weighing and averaging the auxiliary prediction signal and the resolution conversion signal, and outputting an output of the averaging means to a second unit corresponding to each unit area.
- This is configured to output as a reproduction prediction signal of a reproduction image signal.
- the auxiliary prediction signal obtained from the second reproduced image signal and the resolution conversion signal obtained from the first reproduced image signal are weighted and averaged.
- the averaged signal is output as a reproduction prediction signal of a second reproduction image signal corresponding to each unit area, a prediction signal of a second image signal obtained from the first image signal and a second image signal And a hierarchical decoding process corresponding to the hierarchical encoding process for finely controlling the magnitude of the difference from the hierarchical encoding process.
- the present invention (Claim 13) is the digital image decoding apparatus according to Claim 12, wherein the compensation means comprises means for rewriting the insignificant pixel value in the first reproduced image signal.
- the compensation means comprises means for rewriting the insignificant pixel value in the first reproduced image signal.
- a compensation process for replacing a pseudo pixel value obtained based on a significant pixel value in the first reproduced image signal is performed.
- the process of supplementing the first reproduced image signal corresponding to each unit area is performed based on a significant pixel value in the first reproduced image signal. Correctly decodes the encoded difference signal obtained by encoding while effectively suppressing the difference between the predicted signal of the second image signal obtained from the first image signal and the second image signal. can do.
- the present invention (claim 14) is the digital image decoding device according to claim 10, wherein the first encoded image signal is converted into a first image signal corresponding to each unit area. And a difference signal that is a difference between the difference signal and the prediction signal as a difference coded signal obtained by compressing and coding the difference signal.
- the first decoding unit decodes the difference coded signal.
- An adder that outputs a reproduced image signal to the compensation means, a frame memory that stores the output of the compensation means, and a first reproduced image signal that has been subjected to the compensation processing and stored in the frame memory. Playback of the first playback image signal corresponding to each unit area And a prediction signal generator ⁇ for generating a raw prediction signal.
- the first reproduced image signal subjected to the compensation process is stored in the frame memory, so that the motion compensation in the decoding process can be performed with higher accuracy.
- the data storage medium according to the present invention (claim 15) is a computer-readable storage medium storing a first and a second image having different resolutions for forming an image space including a plurality of pixels including an image having an arbitrary shape.
- a data storage medium storing a program for performing a process of encoding an input image signal of (2), wherein the program comprises: Performing an encoding process of generating an encoded image signal and expanding the compressed first input image signal to generate a first reproduced image signal for each unit area dividing the image space; The first reproduction image signal corresponding to each of the unit areas is subjected to interpolation processing for replacing the insignificant pixel value with a pseudo pixel value obtained by a predetermined method.
- a compressed differential signal is generated by compressing and encoding a differential signal that is a difference from the differential signal, and the compressed differential signal is decompressed. The predicted signal is added to the decompressed differential signal to obtain a second signal. This stores a program for performing the process of performing the differential compression encoding for generating the reproduced image signal for each unit area.
- the predicted signal of the second input image signal is generated based on the first reproduced image signal on which the compensation processing has been performed.
- the difference signal which is the difference between the second input image signal that is different from the input image signal and the prediction signal, is suppressed, and the second input image signal corresponding to the unit area located at the boundary of the object is
- the data storage medium according to the present invention provides a computer with a first and a second storage medium having different resolutions for reproducing an image space including a plurality of pixels including an image having an arbitrary shape.
- a program for decoding the first and second encoded image signals obtained by performing the encoding process on the first image signal and generating the first and second reproduced image signals.
- Data storage medium, wherein the program includes:
- Replacement form (Rule 26) A process in which a computer performs a decoding process of generating a first reproduced image signal from the first encoded image signal for each unit region that divides the image space; a first reproduction corresponding to each of the unit regions The image signal is subjected to interpolation processing for replacing the insignificant pixel value with a pseudo pixel value obtained by a predetermined method.
- a process of generating a playback prediction signal by predicting a corresponding second playback image signal, and decoding a second coded image signal corresponding to each unit area to obtain a second image signal and its prediction A program that reproduces a difference signal from the signal and performs a difference decoding process of generating a second playback image signal by adding the playback prediction signal to the difference signal for each unit area. It is stored. According to the data storage medium having such a configuration, the reproduction prediction signal of the second reproduced image signal is generated based on the first reproduced image signal on which the compensation processing has been performed.
- a process for suppressing the difference between a second input image signal different from the first input image signal and its prediction signal and correctly decoding an encoded difference signal obtained by encoding can be realized by a computer. . BRIEF DESCRIPTION OF THE FIGURES
- FIG. 1 is a block diagram for explaining an overall configuration of a digital image encoding device according to Embodiment 1 of the present invention.
- FIG. 2 is a block diagram showing a detailed configuration of a texture-coding section constituting the digital image encoding device according to the first embodiment.
- FIG. 3 is a block diagram showing a specific configuration of a preprocessor included in the digital image encoding device according to the first embodiment.
- FIG. 4 (a) shows a specific configuration of the encoder in the texture encoder of the first embodiment
- FIG. 4 (b) shows a specific configuration of the local decoder in the texture encoder.
- FIG. 2 is a block diagram showing a typical configuration.
- FIG. 5 is a schematic diagram for explaining a process of predicting a high-resolution texture signal based on a low-resolution texture signal by the digital image encoding device according to the first embodiment.
- Figure 5) and Figure 5 (b) show a high-resolution image space and a low-resolution image space, respectively.
- FIG. 6 is a schematic diagram for explaining image compensation processing by the digital image encoding device according to the first embodiment.
- FIG. 7 is a diagram illustrating a configuration of a texture-to-converter included in the digital image encoding device according to the first embodiment.
- FIG. 8 is a diagram showing, by a flowchart, a supplementary process and a supplementary process by the digital image encoding device of the first embodiment.
- FIGS. 9 (a) and 9 (b) are schematic diagrams for explaining an image supplementing process performed by the digital image encoding device according to the first embodiment.
- FIG. 10 is a block diagram showing an overall configuration of a digital image decoding device according to Embodiment 2 of the present invention.
- FIG. 11 is a block diagram showing a detailed configuration of a texture decoding unit included in the digital image decoding device according to the second embodiment.
- FIGS. 12 (a), 12 (b), and 12 (c) show a digital image encoding device according to each of the above-described embodiments.
- FIG. 3 is a diagram for explaining a data storage medium storing a program for realizing the above.
- Embodiment 1 Embodiment 1
- FIG. 1 is a block diagram for explaining a digital image encoding device 100 according to Embodiment 1 of the present invention.
- This digital image encoding apparatus 100000 performs a scale encoding of an image signal on a per-object basis.
- the digital image encoding apparatus 1100 is configured to perform the above-described image signal processing on a texture signal for displaying an object in force. Texture for performing scalability encoding processing—encoding section 110 0 0; and shape encoding section 1200 for performing scalability encoding processing on the shape signal that indicates the shape of the object, which constitutes the image signal. have.
- the texture encoding unit 1100 receives the texture signal and receives a texture signal corresponding to a layer having a high resolution (hereinafter, referred to as a high-resolution texture signal).
- a texture pre-processor 1100 c for generating a texture one signal corresponding to a low-resolution layer (hereinafter referred to as a low-resolution texture one signal), and an encoding process for the high-resolution texture one signal.
- a block generator 1 that divides a low-resolution texture signal into blocks corresponding to a unit of encoding processing. 120 b.
- the pre-processor 1 100 c is a single-pass filter (LPF) 2 that performs a filtering process on the texture signal St received at its input terminal 203. 0 1 and a thinning-out device 202 for thinning out the output of the filter 201 by down-sampling.
- LPF single-pass filter
- the high-resolution texture single signal S is directly applied to the first output terminal 2 16 as the texture one signal St. th, and the texture one signal thinned out by the thinning-out device 202 is output to the second output terminal 204 as a low-resolution texture one signal Std.
- the texture encoding unit 110 performs unit processing for classifying a display area of a predetermined object (that is, an image space including an image of an object having an arbitrary shape) with respect to the low-resolution texture signal.
- a code b that outputs a low-resolution texture one difference coded signal (hereinafter referred to as an LT difference coded signal) E td by performing a difference coding process for each region (block);
- a texture transformation 1 1 2 5 that converts the prediction signal used for the difference encoding process of the low-resolution texture one signal Std into a resolution so that the difference encoding process of the high-resolution texture one signal S th can be used;
- the high-resolution texture one signal S th is subjected to differential encoding for each of the unit processing regions (blocks) to obtain a high-resolution texture one differential encoded signal.
- a code I 1 1 0 0 a to output the
- the shape encoding unit 1200 receives the shape signal S k, and receives a shape signal corresponding to a high-resolution hierarchy (hereinafter, referred to as a high-resolution shape signal) S kh and a shape corresponding to a low-resolution hierarchy A signal (hereinafter, referred to as a low-resolution five-shape signal) S kd is provided.
- This shape pre-processor 1200c has the same configuration as the texturing pre-processor 1100c. Further, the shape encoding unit 1200 displays a predetermined object with respect to the low-resolution shape signal S k d.
- a differential encoding process is performed for each unit processing area (block) that divides an area (an image space including an image of an object having an arbitrary shape) and a low-resolution differential encoded signal (hereinafter referred to as an LS differential encoded signal).
- the encoder 1203 outputs the E kd, and the prediction signal used for the difference encoding of the low-resolution shape signal S kd can be used for the difference encoding of the high-resolution shape signal S kh.
- the difference encoding is performed on the high resolution shape signal S kh for each of the unit processing regions (blocks).
- an encoder 1200a that performs processing and outputs a high-resolution shape difference coded signal (hereinafter, referred to as an HS difference coded signal) Ekh.
- each of the above encoders determines a mode of an encoding process performed on each processing unit area (block) based on an input texture-signal or shape signal. It has a configuration having a vessel.
- each encoder 110a and 110b in the texture-to-encoder 110 will be described.
- the low-resolution texture code b ⁇ l 100 b is a first adder that generates a difference signal between the low-resolution texture signal of the target block to be coded and its prediction signal.
- 132 a first information compressor (ENC) 133 for compressing the difference signal output from the adder 132, and a second information compressor 13 for variable-length encoding the output of the information compressor 133.
- It comprises a variable length coder (VLC) 104 and a prediction signal generator 111 b for generating the prediction signal.
- VLC variable length coder
- the first information compressor 13 3 generates a difference signal 304 between a low-resolution texture signal of the target block and its prediction signal.
- a DCT transformer 302 that performs DCT (discrete cosine transform) processing, which is a type of frequency transformation processing, and a quantized signal 300 that quantizes the frequency component 300 of the difference signal obtained by the frequency transformation.
- Quantum 303 that outputs.
- the prediction signal generator 111b expands the output (differential compressed signal) of the first information compressor 133 to reproduce the differential signal by a first information decompressor (DEC) 13 6 and a second adder 1337 for adding the prediction signal and the reproduction difference signal from the information decompressor 1336 to reproduce a low-resolution texture signal.
- DEC first information decompressor
- the first information decompressor 1336 includes an inverse quantizer 3008 for inversely quantizing the compressed difference signal 310, and an inverse quantizer 3008.
- An IDCT unit 309 that performs inverse IDTC processing for converting the frequency-domain data to the spatial-domain data on the compressed differential signal 311 and outputs a decompressed differential signal 312 .
- the prediction signal generation unit 111b receives the output of the adder 137, and converts the insignificant sample value (pixel value) in the reproduced low-resolution texture signal into the low-resolution shape encoder 1 A first compensator 1338 that compensates based on the low-resolution shape signal reproduced in 200b, and a compensated reproduced low-resolution texture signal that is the output of the compensator 1338 And a first frame memory 1339 for storing the data.
- the output of the compensator 1338 is also output to the texture transformation 125.
- the prediction signal generation unit 111b generates a low-resolution texture of the target block based on the output of the first frame memory 139 and the input low-resolution texture signal Std.
- a first motion detector (ME) 1441 which obtains and outputs motion displacement information (motion vector) indicating a prediction area of the same size as the target block, which gives a prediction signal with the smallest error from the signal;
- An address Add1 of the frame memory 1339 is generated based on the motion vector from the motion detector 141, and the reproduced low-resolution texture signal corresponding to the prediction area is generated from the frame memory 1339.
- a first motion compensator (MC) 140 that reads out as a prediction signal and outputs it to the first adder 132.
- the high-resolution texture encoder 110a has substantially the same configuration as the low-resolution texture encoder 110b.
- the high-resolution texture encoder 110a performs the third addition to generate a difference signal between the high-resolution texture signal of the target block to be encoded and the prediction signal.
- Unit 102 a second information compressor (ENC) 103 for compressing a difference signal output from the adder 102, and a variable-length encoding unit for the output of the information compressor 103.
- a second variable length encoder (VLC) 104 that generates the predicted signal, and a predicted signal generator 111a that generates the predicted signal.
- the second information compressor 103 performs frequency conversion on a difference signal between one high-resolution texture signal of the target block and its prediction signal, similarly to the first information compressor 133. It is composed of a DCT transformer 302 that performs DCT (discrete cosine transform) processing, which is a type of processing, and a quantizer 303 that quantizes the frequency component of the difference signal obtained by the frequency transformation. (See Fig. 4 (a)).
- DCT discrete cosine transform
- the prediction signal generation unit 111a expands the output (differential compressed signal) of the second information compressor 103 to reproduce the differential signal by a second information decompressor (DEC) 1010. And a third adder 107 for adding the prediction signal and the reproduction difference signal from the information decompressor 106 to reproduce a high-resolution texture signal.
- DEC second information decompressor
- the prediction signal generation unit 111a receives the output of the adder 107, and converts the insignificant sample value (pixel value) in the reproduced high-resolution texture signal into the high-resolution shape encoder 1 A second compensator 108 for performing compensation based on the high-resolution shape signal reproduced in 200a, and a compensated reproduced high-resolution texture signal which is an output of the compensator 108; And a second frame memory 109 for storing the same. Further, the prediction signal generation unit 111a generates a high-resolution texture signal of the target block based on the output of the second frame memory 109 and the input high-resolution texture signal.
- a second motion detector (ME) 111 for obtaining and outputting motion displacement information (motion vector) indicating a prediction area of the same size as the target block, which gives a prediction signal with the smallest error, and the motion detector
- the address Add2 of the above frame memory 109 is generated based on the motion vector from 111, and the reproduced high-resolution texture signal corresponding to the prediction area is read from the frame memory 109 as a prediction signal.
- the second motion compensator (MC) 110, the output of the second motion compensator (MC) 110 and the output of the texture converter 1 125 are averaged to obtain the third motion compensator (MC) 110.
- An averager (AV E) 1 2 4 that outputs to the adder 102 To have.
- the averaging unit 124 is configured to output the output of the second motion compensator (MC) 110 and the texture converter based on the output of the mode determination unit (not shown).
- the output of 1 125 is weighted at a fixed ratio and averaged.
- the output of the second motion compensator (MC) 110 and the texture conversion based on the output of the mode determiner are replaced with the averager 124 that performs the weighted averaging process.
- One of the outputs of the adders 112 and 25 may be selected, and the selected output may be output to the third adder 102 as a prediction signal of one high-resolution texture signal.
- the low-resolution shape encoder 120b and the high-resolution shape encoder 120a are basically the same in configuration as the low-resolution texture encoder 110b and the high-resolution texture encoder 110a described above. A detailed description will be omitted, and only differences between the configuration of each texture encoder and each configuration encoder will be briefly described. That is, the low-resolution shape encoder 120b does not have the compensator 1338 in the low-resolution texture encoder 110b, and the output of the adder 133 Is different from the above-described low-resolution texture encoder 110 only in that it is configured to directly input the data to the first frame memory 1339.
- the high-resolution shape encoder 120a does not have the compensator 108 in the high-resolution texture encoder 110a, and its adder 100 7 is different from the above high-resolution texture encoder 110a only in that the output of 7 is directly input to the second frame memory 109.
- the texture encoding unit In 1100 scalability encoding processing is performed on texture one signal St, and in shape encoding section 1200, scalability encoding processing is performed on shape signal Sk.
- a high-resolution texture signal Sth and a low-resolution texture signal Std are generated from the texture signal St by the preprocessor 1100c. Is done. Specifically, as shown in FIG. 3 (a), in the pre-processor 110c, the input texture signal (image sequence) St is directly used as a high-resolution texture signal Sth. While being output to the first output terminal 2 16, the texture signal St is filtered out of the high-band component by the mouth-pass filter 201, and further down-sampled by the decimation device 202 to reduce the low-frequency component. It is output to the second output terminal 204 as a solution texture signal Std.
- an image space (image display screen) 205 including (KXL) samples (pixels) and including the image of the object is obtained
- an image space (image display screen) 206 including (K / 2XL / 2) sample lines (pixels) and including the image of the object is obtained.
- K and L are integers.
- the above-described thinning-out unit 202 performs a process of thinning out the filter output every other sample as a down-sampling process.
- the configuration of this thinning-out device is an example, and the texture one signal St may be down-sampled at a ratio other than 1/2.
- the pre-processing unit 1200c pre-processes the shape signal of the object in the same manner as the pre-processing of the texture one signal in the texture one encoding unit 1100.
- the high-resolution texture signal Sth and the low-resolution texture signal Std are divided into one screen (image space) on which an image is displayed by the blocky dangling devices 1120a and 1120b, respectively.
- the image is divided so as to correspond to the block area of the size, and input to the high-resolution texture encoder 1100a and the low-resolution texture encoder 1100b.
- each of the texture signals S th and St d is divided so as to correspond to a rectangular block area composed of (8 ⁇ 8) or (16 ⁇ 16) samples.
- the texture signal may be divided so as to correspond to a block region having an arbitrary shape.
- the shape encoding unit 1200 uses the block units 1220a and 1220b to process the high-resolution shape signal Sth and the low-resolution shape signal Std in the same manner as the above-described block processing for each texture signal. Block processing has been applied. Then, the low-resolution and high-resolution texture signals corresponding to the block to be coded (hereinafter referred to as the target block) are input to the low-resolution coder 1110b and the high-resolution coder 1110a, respectively. Then, each encoder performs a differential encoding process on these signals.
- the low-resolution texture signal Std of the target block is input to the first motion detector 141, and at the same time, the compressed texture signal is expanded and obtained from the first frame memory 139.
- the decompressed texture signal is read out to the first motion detector 141 as a texture-signal of the reference screen.
- the first motion detector 141 detects a predicted block in the reference screen that gives the predicted signal with the smallest error to the low-resolution textural signal of the target block by a method such as block matching. Then, motion displacement information (hereinafter referred to as a motion vector) indicating the position of the prediction area with respect to the target block is output. This motion vector is sent to the first motion compensator 140, where a low-resolution ⁇ ⁇ texture signal corresponding to the prediction block is generated as a prediction signal from the reference texture signal corresponding to the reference screen. . At this time, the motion vector for the target block is supplied to the variable-length encoder 134 and converted into a corresponding variable-length code.
- a motion vector motion displacement information
- the low-resolution texture signal of the target block and the low-resolution texture signal of the prediction block are supplied to the first adder 132, and the first adder 132 generates a difference signal between the two. This difference signal is compressed by the first information compressor 133.
- the compression processing of the difference signal in the first information compressor 133 is performed by frequency conversion in the DCT unit 302 and quantization in the quantizer 303.
- a method such as subband conversion or vector quantization may be used.
- the quantized difference signal (compressed difference signal) is supplied to the variable length encoder 134 and subjected to variable length coding.
- variable-length-encoded compressed difference signal Etd is output to the output terminal 135 together with other side information including the variable-length-encoded motion vector.
- the low-resolution prediction signal generation unit 111b generates a prediction signal based on the compressed difference signal output from the information compressor 135.
- the compressed difference signal when the compressed difference signal is input to the prediction signal generator 111b, the compressed difference signal is subjected to decompression processing by the information decompressor 136, and a decompressed difference signal is output.
- the compressed difference signal is inversely quantized by the inverse quantizer 308, and the inversely quantized compressed difference signal is transmitted to the IDCT unit 309.
- the data in the frequency domain is converted into the data in the spatial domain.
- the decompressed difference signal from the information decompressor 1336 is added to the corresponding low-resolution texture signal of the prediction block by the second adder 1337, and the signal obtained by the addition is the target signal. It is output as a playback low-resolution texture signal corresponding to the block.
- the reproduced low-resolution texture signal is input to a first compensator (PAD) 138, and the complementing process is performed on the reproduced low-resolution texture signal. Then, the reproduced low-resolution texture signal subjected to the compensation processing is stored in the first frame memory 1339 as a reference low-resolution texture signal.
- PAD first compensator
- the above-mentioned compensation processing is processing for replacing insignificant sample values among a plurality of sample values (pixel values) constituting a reproduced low-resolution texture signal corresponding to each block with significant sample values.
- the determination as to whether the sample value is significant or not is made by referring to the reproduced low-resolution shape signal obtained by subjecting the compressed difference signal to decompression processing by the low-resolution shape encoder 120b.
- FIG. 6 is a schematic diagram for explaining the compensation processing by the first compensation device 138.
- each block 501 that divides the image space formed by the reproduced low-resolution texture signal is assumed to be composed of (4 ⁇ 4) samples,
- Each rectangular area in the block 501 indicates one sample (pixel).
- the dotted rectangular regions indicate significant sampling points located inside the object, and the other rectangular regions (regions without the dotted lines) indicate the objects of the object. Insignificant samples located outside.
- sample value of the sample located on the boundary (perimeter) of the object is used to compensate for the sample value of the insignificant sample.
- samples 502, 50 are used to compensate for the sample value of the insignificant sample.
- Replacement paper (Kaikai IJ26) 3, 504, 505 are samples located on the boundary, and by replacing the sample values of these significant samples with the sample values of non-significant samples, the samples of samples located in the outer region of the object Fill in the value. For example, replace the sample value of sample 506 with the sample value of sample 505. For extraneous samples, such as sampnolle 507, which are adjacent to both the significant sample 503 and the significant sample 504, the sample value is interpolated with the average of the sample values of both significant samples. .
- the process of replacing the sample value of the insignificant sample with the sample value of the significant sample adjacent to the significant sample and the sample value is shown as the compensation process, but the compensation process is not significant.
- the sample value of the sample may be replaced with the average value of the sample values of all significant samples on the boundary of the object, or insignificant if there are multiple non-significant sample pairs and adjacent significant sample pairs.
- the first motion detector 141 uses the method such as block matching as described above to input the low-resolution texture signal and the reference reproduction level stored in the frame memory.
- a motion vector is generated based on the resolution texture signal, and the first motion compensator 140 generates a low-resolution texture signal corresponding to the prediction block based on the motion vector. This is output to the first adder 1332 as a prediction signal.
- the difference encoding process for the high-resolution texture signal S th is basically the same as the difference encoding process for the low-resolution texture signal S td, and is a prediction signal corresponding to the target block. Is slightly different from that for the low-resolution texture signal.
- the prediction signal generation unit 111a of the high-resolution texture encoder 110a in addition to the temporal prediction signal obtained by the motion compensation in the second motion compensator 110, Compensated by the first compensator 1 3 8 of the resolution texture encoder 1 110 b
- a processed low-resolution texture signal (spatial prediction signal) is used.
- a low-resolution texture signal for forming the low-resolution image space 206 is a high-resolution texture signal for forming the high-resolution image space 205. Since the signal is obtained by downsampling the signal, the reproduced low-resolution texture signal is used as a spatial prediction signal by the high-resolution texture encoder 110a. It is necessary to interpolate the texture signal by up-sampling or the like.
- the spatial prediction signal is interpolated by up-sampling in the texture converter 111, and the interpolated spatial prediction signal is converted into a prediction signal generator of the high-resolution texture encoder 110a. Supplied to 1 110 a.
- an interpolation value is generated using an even-tap filter, and the interpolation value is used to generate the interpolation value.
- the sample values that make up the prediction signal are interpolated.
- the spatial prediction signal subjected to such upsampling processing is input to the averaging unit 124 together with the temporal prediction signal.
- the averaging unit 124 obtains a high-resolution texture obtained by weighting and averaging the time prediction signal and the space prediction signal based on the mode determination output from the mode determination unit (not shown) described above.
- a prediction signal for one signal is generated, and this prediction signal is supplied to the third and fourth adders 102 and 107 in the yarn feeder 4 ′′ 1.
- three ratios of 1: 0, 0: 1, and 1Z2: 1/2 are used as weighting ratios of the spatial prediction signal and the temporal prediction signal in the averaging unit 124. Is used, but it may be weighted by any other ratio. The weighting ratio may not be adjusted based on the mode determination output, but may be set to a predetermined ratio in advance.
- the spatial prediction signal is output from the first compensator 138, this may be output from the first frame memory 139.
- FIG. 5 is a schematic diagram for explaining a process of generating a prediction signal for a high-resolution textural signal from the reproduced low-resolution textural signal.
- 401a is a high-resolution image containing an arbitrary-shaped object image obtained from a high-resolution texture signal.
- Numeral 4101b denotes a reproduced low-resolution image space obtained from a reproduced low-resolution texture signal and including the object image having the arbitrary shape.
- Each image space is composed of a plurality of blocks (unit processing areas), and the ones marked with dots among the plurality of blocks include a significant sample located inside the object. .
- the blocks that partition the image space 410 a indicate the blocks to be processed on which the encoding process is performed, and the blocks that partition the image space 401 b correspond to the blocks of the image space 401 a.
- the spatial prediction block corresponding to each block to be processed is shown.
- each block to be processed and each spatial prediction block corresponding thereto are located at the same position in each image space.
- the block to be processed 404a and the corresponding spatial prediction block 404b are located at the sixth position from the left end in the horizontal arrangement in the image space 410a and the image space 410b, respectively. It is located in the vertical position, and is located at the fourth position from the top.
- the block to be processed 4003a in the image space 4O la is located on the boundary of the object
- the corresponding spatial prediction block 4003b in the image space 401b is also located on the boundary of the object. positioned.
- the low-resolution texture signal corresponding to the spatial prediction block 400b on the boundary of the object is replaced by the texture converter 1
- the low-resolution texture signal upsampled at 5 is subtracted from the high-resolution texture signal of the block to be processed 403a corresponding to the spatial prediction block.
- the boundary between the object in the spatial prediction block obtained by this and the boundary of the object in the corresponding block to be processed does not match. In most cases. For this reason, as described above, the low-resolution texture signal corresponding to the spatial prediction block is filled in and then upsampled, thereby suppressing an increase in the residual due to a mismatch between the boundaries of both blocks. .
- the spatial prediction block in the image space 401 b may be located completely outside the object .
- the sample value of the sample that constitutes the spatial prediction block 407 b corresponding to the processed block 407 a is not defined, and thus corresponds to the spatial prediction block 407 b. If the low-resolution texture one signal to be processed is used as it is and subtracted from the high-resolution texture one signal corresponding to the block to be processed 407a, the residual of both signals becomes large.
- Embodiment 1 of the present invention for such a spatial prediction block outside the object, its sample value is supplemented by a significant sample value of the spatial block inside the object adjacent to the spatial block outside the object. Like that.
- the sample value is replaced with a significant sample value of the spatial prediction block 402b immediately above.
- the insignificant sample value of the sample is compensated for by the method shown in FIG.
- the sample ⁇ S of the prediction block 407b may be supplemented by the sample value of the sample located on the boundary of the spatial prediction block 402b.
- FIG. 9 (a) and FIG. 9 (b) show examples of such a compensation process.
- Blocks 801, 802, 803, and 804 each consist of 4x4 samples.
- Block 801 and block 803 are boundary blocks, and all sample values are significant due to the interpolation process. Therefore, samples 805 to 812 all have significant sample values.
- Block 802 and block 804 are blocks outside the object.
- samples 805, 806, 807, and 808 are repeatedly and horizontally applied sequentially, and these samples are blocked.
- the average of all candidate sample values in these boundary blocks is replaced with the pseudo sample value to be replaced.
- the maximum value of all candidate sample values can be used as a pseudo sample value to be replaced.
- the spatial prediction block located outside the object is compensated using the sample values of the adjacent boundary blocks, so that even if the spatial prediction block is completely outside the object, Non-significant sample values are replaced by sample values inside the object, so a low-resolution signal corresponding to the spatial prediction block ⁇ ⁇ A signal obtained by up-sampling the texture signal and a high-resolution signal corresponding to the processed block The remnants of the text signal can be suppressed.
- FIG. 8 is a diagram for explaining the operation of the compensator and the texture-converter in consideration of the above-described compensation processing with a flowchart.
- a spatial prediction block and an identification signal LDKD indicating whether the spatial prediction block is outside the object are input to the compensator 1338 (step S1).
- the identification signal LD kd indicating whether or not the prediction block is outside the object is a decompressed shape signal generated by the low-resolution shape encoder 12000 b of the shape encoding unit 12000. (Shape information of the object).
- the compensator 1338 determines whether or not the spatial prediction block is outside the object (step S2). If the spatial prediction block is not located outside the object, the spatial prediction block is output as it is without performing the filling process, and is upsampled by the texture transformation 111 (step S4). On the other hand, if the spatial prediction block is outside the object, the spatial prediction block is subjected to compensation processing using a sample of a significant sample of an adjacent block using a sample (step S 3). The low-resolution texture signal is up-sampled by the texture converter 111 (step S4).
- the preprocessor 201 shown in FIG. 3 (a) is used to hierarchize a texture signal.
- the preprocessor 201 shown in FIG. instead of 1, a preprocessor 207 shown in FIG. 3 (b) may be used.
- the preprocessor 2 07 has an input terminal 2 08, first and second output terminals 2 0 9 and 2 10, and has an input terminal 2 0 8 and a first output terminal 2 0 9 And the connection state between the input terminal 208 and the second output terminal 210 is switched at regular time intervals.
- connection state between the input terminal 208 and the first output terminal 209, and the input terminal 208 and the second output terminal 210 is switched at a predetermined time interval by the switch 207a.
- the input terminal 208 and the second output terminal 210 are connected, and the input texture signal is Output to 2 output terminal.
- the texture signal output from the second output terminal 210 is supplied as a low-resolution texture signal to the first input terminal 131 of FIG.
- the texture signal (image data) between the time t and t + N is output to the first output terminal 209, and the texture signal output from the first output terminal 209 is output.
- the signal is supplied to the second input terminal 101 in FIG. 2 as a high-resolution texture signal.
- N is a force that is an arbitrary integer.
- N 3.
- the converter shown in FIG. 7 uses a motion compensator instead of the interpolator, reads the prediction signal obtained by the motion compensation from the first frame memory 139, and reads the prediction signal ( The predicted signal obtained from the low-resolution texture signal is processed so that the temporal resolution matches the high-resolution texture signal. In this case, though not shown, it is necessary to transmit a motion vector for that purpose to the motion compensator.
- the differential encoding of one texture signal using a prediction signal obtained from another hierarchical layer that is, a hierarchical layer having a different resolution, is used.
- an encoder 110b for differentially encoding the low-resolution texture one signal Std, and a high-resolution texture one signal Sth When the high-resolution texture signal S th is differentially coded by using the prediction signal, the compensator 1 in the above-mentioned coder 110 b has According to 38, a compensation process for replacing a significant sample value of the low-resolution textural signal reproduced by the encoder 110b with a pseudo sample value obtained from the significant sample value is performed.
- the prediction signal for the high-resolution texture one signal S th is generated based on the reproduced low-resolution texture one signal that has been subjected to the above-described compensation processing, the prediction signal is generated based on the reproduced low-resolution texture one signal that has been subjected to the compensation processing.
- High resolution texture signal A prediction signal of S th will be generated.
- the prediction signal is generated based on the reproduced low-resolution texture signal of the target unit area. Therefore, the encoding process of the high-resolution texture one signal S th is delayed only by the time for processing the unit area, as compared with the encoding process of the low-resolution texture one signal Std. Therefore, on the decoding side, based on the LT difference coded signal Etd and the HT difference coded signal Eth obtained by coding the low-resolution texture one signal S td and the high-resolution texture one signal S th, The resolution image and the resolution image can be reproduced with almost no time lag.
- the process of supplementing the reproduced low-resolution texture signal corresponding to each unit area is performed based on a significant pixel value in the reproduced low-resolution texture signal, the high-resolution texture obtained from the low-resolution texture signal is processed. It is possible to effectively suppress the difference between one predicted signal and one high-resolution texture signal.
- the reproduced low-resolution texture signal subjected to the compensation processing is stored in the frame memory 13.
- the encoders 1200a and 1200b constituting the shape encoder 1200 generate low-resolution reproduction shape signals LD kd and high-resolution reproduction shapes.
- the signal LDkh is used as it is for generating the prediction signal, but the low-resolution reproduction shape signal LDkd and the high-resolution reproduction shape signal LDsh that have been subjected to the compensation processing are used for generating the prediction signal. You may.
- FIG. 10 is a block diagram for explaining a digital image decoding apparatus 2000 according to Embodiment 2 of the present invention.
- the digital image encoding apparatus 2000 is a unit for decoding an image encoded signal obtained by performing a scalability encoding process on an image signal by the digital image encoding apparatus 1000 of the first embodiment in object units.
- the texture decoding unit 2100 performs a differential decoding process on the high-resolution texture-one difference encoded signal (HT difference-encoded signal) E th for each block, and performs high-resolution texture decoding.
- the high-resolution texture decoder 2100a for outputting the signal Dth and the high-resolution texture decoding signal Dth corresponding to each block are integrated to obtain a high-resolution texture having a scanning line structure.
- An inverse blocker 2 1 2 0 a that outputs one reproduced signal R th and a low-resolution texture one difference encoded signal (LT difference encoded signal) Etd are subjected to differential decoding processing for each block.
- a low-resolution texture decoder 210b outputting a low-resolution texture decoded signal D td, and a low-resolution texture decoding signal D td corresponding to each block.
- High resolution texture with integrated scanning line structure And a reverse blocker 2 1 2 0 b for outputting R td.
- the texture decoding unit 210 converts the prediction signal used for the differential decoding of the LT differentially coded signal so that it can be used for the differential decoding of the HT differentially coded signal. Te, and a text Suchiya univariate 2 1 2 5 to be outputted to the high-resolution texture one decryption device 2 1 0 0 a.
- the shape decoding unit 2200 performs high-resolution shape decoding by performing difference decoding on the high-resolution shape difference coded signal (HS difference coded signal) Ekh for each block.
- a high-resolution shape decoder 220 2a that outputs a signal Dkh and a high-resolution shape decoding signal Dkh corresponding to each block are integrated to reproduce a high-resolution shape of a scanning line structure.
- An inverse blocker 2222a that outputs a signal Rkh and a low-resolution shape difference coded signal (LS difference coded signal) E kd are subjected to a difference decoding process for each block, so that a low
- the low-resolution texture decoder 220 k outputting the resolution shape decoded signal D kd and the low-resolution texture decoding signal D kd corresponding to each block are integrated and scanned. It has an inverse blocker 2222b that outputs a high-resolution texture one reproduction signal R kd having a linear structure.
- the shape decoding unit 222 converts the prediction signal used for the difference decoding process of the LS difference coded signal so that the prediction signal can be used for the difference decoding process of the HS difference coded signal. And a shape converter 222 for outputting to the high-resolution shape decoder 220a.
- the low-resolution texture one-time decoder 2100b is a data analyzer that analyzes the LT-coded difference signal of the target area (target block) to be decoded and performs variable-length decoding. 22, an information decompressor (DEC) 923 that performs decompression processing on the output of the data analyzer 922 and outputs a decompression differential signal, and the decompression differential signal and the target block.
- An adder 924 for adding a corresponding predicted signal and outputting a low-resolution ⁇ g texture-decoded signal; and a predicted signal generator 21110b for generating a predicted signal corresponding to each block described above. It is composed of
- the first information decompressor 9 23 performs inverse quantization on the output of the data analyzer 9 22 as an inverse quantizer 30. 8 and the inverse quantization
- IDCT Inverse Discrete Cosine Transform
- the prediction signal generation unit 2110b receives the output of the adder 924 and converts the insignificant sample value (pixel value) in the reproduced low-resolution texture signal into the low-resolution shape decoder 1 A first compensator 926 for compensating based on the low-resolution shape signal D kd decoded in 200 b, and a compensated reproduced low-resolution texture that is an output of the compensator 926 And a first frame memory 927 for storing one signal. The output of the compensator 926 is also output to the texture-to-converter 2125. .
- the prediction signal generation unit 2110b generates an output of the first frame memory 927 and a motion vector corresponding to the target block decoded by the data analyzer 9222. Based on the frame memory 927, a prediction area having a reproduced low-resolution textural signal with the smallest error from the reproduced low-resolution textural signal of the target block is detected, and a prediction area corresponding to the predicted area is detected. It has a first motion compensator 928 that reads out the reproduced low-resolution texture signal as a prediction signal and outputs it to the first adder 924.
- the high-resolution texture decoding device 210a has substantially the same configuration as the low-resolution texture decoding device 210b.
- the high-resolution texture one-time decoder 2100a analyzes the HT coded difference signal of the target area (target block) to be subjected to decoding processing and performs variable-length decoding.
- a second adder 904 that adds a prediction signal corresponding to the target block and outputs a high-resolution text-decoded signal, and a prediction signal generation unit that generates a prediction signal corresponding to each of the blocks. 2 110a.
- DEC second information decompressor
- the second information decompressor 903 performs inverse quantization on the output of the data analyzer 902 by performing inverse quantization. 8 and an IDCT transformer 309 for performing an IDCT (Inverse Discrete Cosine Transform) process, which is a type of inverse frequency transform process, on the output of the inverse quantizer 308.
- IDCT Inverse Discrete Cosine Transform
- the prediction signal generation unit 211a receives the output of the second adder 904, and converts the insignificant sample value (pixel value) in the reproduced high-resolution texture signal into the high-resolution shape.
- a second compensator 906 for compensating based on the high-resolution shape signal D kh decoded by the decoder 1200a, and a compensated high level which is an output of the compensator 906.
- a second frame memory 907 for storing the decoded texture signal.
- the prediction signal generation section 211a includes an output of the second frame memory 907 and a motion vector corresponding to the target block decoded by the data analyzer 902. From the frame memory 907, a prediction area which gives the reproduction high-resolution textural signal with the smallest error from the reproduction high-resolution textural signal of the target block is detected and corresponds to the prediction area.
- An averager (AVE) 918 for averaging based on the vector and outputting the result to the second adder 904.
- the low-resolution shape encoder 220 b does not have the compensator 9226 in the low-resolution texture decoder 210 b, and the output of the adder 92 Is directly input to the first frame memory 927, and is different from the above low-resolution texture decoder 210b.
- the high-resolution shape encoder 220 0a does not have the compensator 906 in the high-resolution texture encoder 210a, and its adder 904 This is different from the above-described high-resolution texture decoder 210a only in that the configuration is such that the output of the second frame memory 907 is directly input to the second frame memory 907.
- a multiplexed image coded signal corresponding to a predetermined object input to the present image decoding device 2000 is converted into an HT differential coded signal at a stage preceding the image decoding device 2000.
- Eth, LT differentially coded signal Etd, HS differentially coded signal Ekh, LS differentially coded signal Ekd, and other control signals, and the HT and LT differentially coded signals constitute one or more textures.
- the above-described HS and LS differentially encoded signals are input to the shape decoding unit 2100.
- the texture decoding unit 2100 the scalability decoding process for the two texture-difference encoded signals is performed.
- the shape decoding unit 2200 the scalability decoding process is performed. Is subjected to scalability decoding.
- the LT differentially encoded signal Etd is input to the first data analyzer 9222 via the first input terminal 2101, and the analysis is performed.
- the data analysis is performed by the device 922, and the variable-length-decoded LT encoded difference signal is output to the first information decompressor 923.
- the motion vector of the target block to be subjected to the decoding process is sent to the first motion compensator 928 of the prediction signal generation unit 211b. Is output.
- the first information decompressor 923 performs decompression processing on the variable-length-decoded LT-coded difference signal, and restores the image-texture-difference signal as a low-resolution texture-decompressed difference signal. .
- variable-length-decoded LT encoded difference signal is subjected to inverse quantization by an inverse quantizer 308, and In the discrete cosine transform 309, an inverse frequency transform process for transforming the frequency domain signal into the spatial domain signal is performed.
- the first motion compensator 928 generates an address Add1 for accessing the first frame memory 927 based on the motion vector, and generates the first frame memory 9
- a predicted signal of the reproduced low-resolution ⁇ S texture signal for the target block is read out from the reproduced low-resolution texture one signal stored as a reference image resolution texture signal at 27.
- the read prediction signal and the output of the information decompressor 923 are input to an adder 924, and the adder 924 outputs a low value as an added value of these signals.
- Resolution texture decrypted signal D td is the first output
- the reproduced low-resolution texture signal Dtd is also input to the first compensator 926, and the signal is input to the signal using a significant sample value of the object as described in FIG. Is applied to replace non-significant sample values of.
- the reproduced low-resolution texture signal Dtd thus supplemented is stored in the first frame memory 927.
- the HT encoded difference signal Etd is input to the second data analyzer 9 02 via the second input terminal 2 1 3 1 and the analyzer 9 0
- the data analysis is performed in 2
- the HT encoded difference signal subjected to variable length decoding is output to the second information decompressor 903.
- the motion vector of the target block to be subjected to the decryption processing is calculated by the second motion compensator 908 of the prediction signal generation unit 2110a. Is output to
- the expansion processing is performed on the HT encoded difference signal subjected to the variable length decoding, and the high-resolution texture-difference signal is converted into the high-resolution texture-expanded difference signal. It is restored as a signal.
- variable-length-decoded LT encoded difference signal is subjected to inverse quantization by an inverse quantizer 308, and In the discrete cosine transform 309, an inverse frequency transform process for transforming the frequency domain signal into the spatial domain signal is performed.
- the second motion compensator 908 generates an address Add2 for accessing the second frame memory 907 based on the motion vector, and the second frame memory 907 From the reproduced high-resolution texture signal stored as a reference high-resolution texture signal, a prediction signal for the target block is read as a time prediction signal.
- the texture converter 937 performs the same up-sampling processing as described with reference to FIGS. 7 and 8, and the spatial prediction signal up-sampled in this way is output to the averaging device 918. Is output.
- the averaging unit 918 averages and reproduces the temporal prediction signal from the second motion compensator 908 and the spatial prediction signal based on the mode signal from the data analyzer. High resolution texture single signal prediction signal
- the weighting ratio may be determined in advance on the transmitting and receiving sides, in the present embodiment, the weighting information is transmitted together with the high-resolution texture-compression-coded signal, and the second data analyzer 902 And input to the averaging device 9 18.
- the adder 904 outputs a reproduced high-resolution texture one signal Dth to the second output terminal 905 as an added value of these signals.
- the reproduced high-resolution texture signal Dth is also input to the second compensator 906, and the insignificant sample value of the object is obtained by using the significant sample value of the object as described in FIG. Is replaced.
- the reproduced high-resolution texture-decoded signal Dthh thus compensated is stored in the second frame memory 907.
- the non-significant sample value of the low-resolution texture signal reproduced by the decoder 210 b is obtained from the significant sample value by the compensator 926 in the decoder 210 b.
- a compensation process is performed to replace the pseudo-sample value thus obtained, and the prediction signal is generated based on the reproduced low-resolution texture signal subjected to the compensation process.
- High-resolution text reproduced based on the texture signal A predicted signal of the posture signal Dth is generated. For this reason, hierarchical decoding corresponding to hierarchical encoding processing in which a difference signal that is a difference between a reproduced high-resolution texture signal of a block (unit processing area) to be encoded and its prediction signal is suppressed is suppressed. Processing can be realized.
- the prediction signal is based on the reproduced low-resolution texture image signal corresponding to the target unit region.
- the low-resolution texture signal is used as a starting point.
- the encoded difference signal obtained by encoding while effectively suppressing the difference between the obtained high-resolution texture signal prediction signal and the high-resolution texture signal signal can be correctly decoded.
- the reproduced low-resolution texture signal subjected to the compensation processing is stored in the frame memory 9 2
- the spatial prediction signal has been described as being transmitted from the compensator 926, but this spatial prediction signal is supplied from the first frame memory 927 to the averaging device. You may do so.
- the low-resolution textural compression-encoded signal and the high-resolution textural compression-encoded signal correspond to the same size image space and have time-shifted image information (Fig. 3 (b) )
- a motion compensator is used instead of the interpolator, and the prediction signal obtained by the motion compensation is read from the first frame memory 927. Process to match high resolution texture signal. Although this is not shown, it is necessary to transmit a motion vector for that purpose to the motion compensator.
- Prediction signal compensation processing in order to perform the differential decryption of the texture-coded difference signal of a certain layer using a prediction signal obtained from another layer, that is, a layer having a different resolution, Prediction signal compensation processing must be performed.
- each of the encoders 2200a and 2200b constituting the shape decoding unit 2200 has a low-resolution reproduction shape signal D kd and a high-resolution reproduction shape signal.
- Dkh is used as it is to generate the prediction signal, but the low-resolution reproduction shape signal D
- a signal obtained by subjecting kd and the high-resolution reproduction shape signal Dkh to compensation processing may be used for generating a prediction signal.
- the hierarchical encoding process and the hierarchical decoding process are described as having two hierarchies. However, the hierarchical encoding and decoding processes having three or more hierarchies are described. When predicting an image signal of an upper layer (higher resolution layer) from an image signal of a lower layer (lower resolution layer), the image signal of the lower layer can be similarly compensated. Good.
- an encoding or decoding program for realizing the configuration of the encoding or decoding processing described in each of the above embodiments is recorded on a data storage medium such as a floppy disk.
- the processing described in each of the above embodiments can be easily performed by an independent computer system.
- FIG. 12 is a diagram for explaining the ⁇ in which the encoding or decoding processing of the above embodiment is performed by a computer system using a floppy disk storing the above encoding or decoding program.
- FIG. 12 is a diagram for explaining the ⁇ in which the encoding or decoding processing of the above embodiment is performed by a computer system using a floppy disk storing the above encoding or decoding program.
- Fig. 12 (b) shows the external appearance, cross-sectional structure, and floppy disk of the floppy disk as viewed from the front
- Fig. 12 (a) shows an example of the physical format of the floppy disk that is the main body of the recording medium. Is shown.
- the floppy disk FD is built in the case F.
- On the surface of the disk a plurality of tracks Tr are formed concentrically from the outer circumference toward the inner circumference, and each track has an angle of 16 tracks. It is divided into sectors Se. Therefore, in the floppy disk storing the program, data as the program is recorded in an area allocated on the floppy disk FD.
- FIG. 12 (c) shows a configuration for recording and reproducing the program on a floppy disk FD.
- the above program is recorded on the floppy disk FD
- data as the above program is written from the computer system CS via the floppy disk drive.
- the above-mentioned encoding / decoding device is constructed in a computer system by a program in a floppy disk
- the program is read from the floppy disk by a floppy disk drive and transferred to the computer system.
- the digital image encoding method and the digital image encoding device, the digital image decoding method and the digital image decoding device, and the data storage medium according to the present invention are provided with the encoding device in the compression processing of the image signal.
- Efficiency can be improved, and it is extremely useful for realizing image encoding and image decoding in systems that transmit and store image signals. Suitable for video compression and decompression.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP52238598A JP3144806B2 (ja) | 1996-11-12 | 1997-11-12 | デジタル画像復号化装置 |
KR1019980705338A KR100306337B1 (ko) | 1996-11-12 | 1997-11-12 | 디지털화상부호화방법및디지털화상부호화장치,디지털화상복호화방법및디지털화상복호화장치 |
US09/091,984 US6154570A (en) | 1996-11-12 | 1997-11-12 | Method and apparatus for digital image coding and decoding, and data recording media |
EP97912422A EP0876061A4 (en) | 1996-11-12 | 1997-11-12 | DIGITAL IMAGE ENCODERS AND DECODERS, CORRESPONDING METHODS, AND DATA CARRIERS |
US09/686,942 US6571017B1 (en) | 1996-11-12 | 2000-10-12 | Method and apparatus for digital image coding and decoding, and data recording media |
US10/287,002 US6766061B2 (en) | 1996-11-12 | 2002-11-04 | Method and apparatus for digital image coding and decoding, and data recording media |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP30000696 | 1996-11-12 | ||
JP8/300006 | 1996-11-12 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/091,984 A-371-Of-International US6154570A (en) | 1996-11-12 | 1997-11-12 | Method and apparatus for digital image coding and decoding, and data recording media |
US09/686,942 Continuation US6571017B1 (en) | 1996-11-12 | 2000-10-12 | Method and apparatus for digital image coding and decoding, and data recording media |
Publications (1)
Publication Number | Publication Date |
---|---|
WO1998021896A1 true WO1998021896A1 (en) | 1998-05-22 |
Family
ID=17879600
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP1997/004107 WO1998021896A1 (en) | 1996-11-12 | 1997-11-12 | Digital image coding method and digital image coder, and digital image decoding method and digital image decoder, and data storage medium |
Country Status (7)
Country | Link |
---|---|
US (3) | US6154570A (ja) |
EP (1) | EP0876061A4 (ja) |
JP (1) | JP3144806B2 (ja) |
KR (1) | KR100306337B1 (ja) |
CN (2) | CN1167274C (ja) |
TW (1) | TW358296B (ja) |
WO (1) | WO1998021896A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005507586A (ja) * | 2001-10-26 | 2005-03-17 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 空間的鮮明度拡張技術を用いた空間拡張可能圧縮の機構 |
Families Citing this family (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW358296B (en) * | 1996-11-12 | 1999-05-11 | Matsushita Electric Ind Co Ltd | Digital picture encoding method and digital picture encoding apparatus, digital picture decoding method and digital picture decoding apparatus, and data storage medium |
JP3191922B2 (ja) | 1997-07-10 | 2001-07-23 | 松下電器産業株式会社 | 画像復号化方法 |
EP0972407A2 (en) * | 1998-02-06 | 2000-01-19 | Koninklijke Philips Electronics N.V. | Motion or depth estimation |
US6480538B1 (en) * | 1998-07-08 | 2002-11-12 | Koninklijke Philips Electronics N.V. | Low bandwidth encoding scheme for video transmission |
TW376663B (en) * | 1999-01-21 | 1999-12-11 | Winbond Electronics Corp | Encoding method for source encoder |
CN101106708B (zh) * | 1999-08-09 | 2010-11-03 | 索尼公司 | 发送设备及方法 |
JP4697500B2 (ja) * | 1999-08-09 | 2011-06-08 | ソニー株式会社 | 送信装置および送信方法、受信装置および受信方法、並びに記録媒体 |
US6542545B1 (en) * | 1999-10-01 | 2003-04-01 | Mitsubishi Electric Reseach Laboratories, Inc. | Estimating rate-distortion characteristics of binary shape data |
US6718066B1 (en) * | 2000-08-14 | 2004-04-06 | The Hong Kong University Of Science And Technology | Method and apparatus for coding an image object of arbitrary shape |
FR2813484A1 (fr) * | 2000-08-31 | 2002-03-01 | Koninkl Philips Electronics Nv | Traitement de donnees en une serie temporelle d'etapes |
US6621865B1 (en) * | 2000-09-18 | 2003-09-16 | Powerlayer Microsystems, Inc. | Method and system for encoding and decoding moving and still pictures |
JP3636983B2 (ja) * | 2000-10-23 | 2005-04-06 | 日本放送協会 | 符号化装置 |
US6842177B2 (en) * | 2001-12-14 | 2005-01-11 | University Of Washington | Macroblock padding |
KR100927760B1 (ko) * | 2002-01-11 | 2009-11-20 | 소니 가부시끼 가이샤 | 메모리 셀 회로, 메모리 장치, 움직임 벡터 검출 장치 및움직임 보상 예측 부호화 장치 |
JP3504256B1 (ja) * | 2002-12-10 | 2004-03-08 | 株式会社エヌ・ティ・ティ・ドコモ | 動画像符号化方法、動画像復号方法、動画像符号化装置、及び動画像復号装置 |
KR20050078709A (ko) * | 2004-01-31 | 2005-08-08 | 삼성전자주식회사 | 스케일러블 비디오 코딩방법 및 디코딩방법과 이를 위한장치 |
KR100631777B1 (ko) | 2004-03-31 | 2006-10-12 | 삼성전자주식회사 | 다 계층의 모션 벡터를 효율적으로 압축하는 방법 및 장치 |
JP2005333393A (ja) * | 2004-05-19 | 2005-12-02 | Sharp Corp | 画像圧縮装置,画像出力装置,画像伸張装置,印刷装置,画像処理装置,複写機,画像圧縮方法,画像伸張方法,画像処理プログラムおよび画像処理プログラムを記録した記録媒体 |
DE102005016827A1 (de) * | 2005-04-12 | 2006-10-19 | Siemens Ag | Adaptive Interpolation bei der Bild- oder Videokodierung |
EP1872587B1 (en) * | 2005-04-13 | 2021-05-05 | InterDigital VC Holdings, Inc. | Luma and chroma encoding using separate predictors |
CN101662683B (zh) * | 2005-04-14 | 2012-05-30 | 汤姆森特许公司 | 空间可缩放视频解码方法和空间可缩放视频解码器 |
JP4687216B2 (ja) * | 2005-04-18 | 2011-05-25 | ソニー株式会社 | 画像信号処理装置、カメラシステム、および画像信号処理方法 |
JP2007043651A (ja) | 2005-07-05 | 2007-02-15 | Ntt Docomo Inc | 動画像符号化装置、動画像符号化方法、動画像符号化プログラム、動画像復号装置、動画像復号方法及び動画像復号プログラム |
KR100779173B1 (ko) * | 2005-07-20 | 2007-11-26 | 한국전자통신연구원 | 폴리페이즈 다운 샘플링기반 리던던트 슬라이스 코딩 방법및 그 방법을 이용하는 코덱 |
FR2894424A1 (fr) | 2005-12-05 | 2007-06-08 | Thomson Licensing Sas | Procede de prediction de donnees mouvement et de texture |
JP2007234204A (ja) * | 2006-01-31 | 2007-09-13 | Toshiba Corp | 情報記憶媒体、情報記録方法および情報記録装置 |
JP2007243838A (ja) * | 2006-03-10 | 2007-09-20 | Toshiba Corp | 情報転送装置、情報受信装置およびコンピュータプログラム |
US20070242746A1 (en) * | 2006-04-12 | 2007-10-18 | Takehiro Kishimoto | Video signal processing device |
KR100939917B1 (ko) | 2008-03-07 | 2010-02-03 | 에스케이 텔레콤주식회사 | 움직임 예측을 통한 부호화 시스템 및 움직임 예측을 통한부호화 방법 |
US8295364B2 (en) * | 2009-04-02 | 2012-10-23 | Sony Corporation | System and method of video data encoding with minimum baseband data transmission |
JP5474887B2 (ja) | 2011-08-01 | 2014-04-16 | 株式会社ソニー・コンピュータエンタテインメント | 動画データ生成装置、動画像表示装置、動画データ生成方法、動画像表示方法、および動画像ファイルのデータ構造 |
KR101711161B1 (ko) * | 2012-09-25 | 2017-03-13 | 한국전자통신연구원 | 웹 기반 멀티네트워크 적응형 멀티스크린 서비스 방법 및 그 장치 |
US10237559B2 (en) | 2014-11-20 | 2019-03-19 | Getgo, Inc. | Layer-based video decoding |
US9813721B2 (en) * | 2014-11-20 | 2017-11-07 | Getgo, Inc. | Layer-based video encoding |
CN106296578B (zh) * | 2015-05-29 | 2020-04-28 | 阿里巴巴集团控股有限公司 | 一种图像处理方法及装置 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0389792A (ja) * | 1989-09-01 | 1991-04-15 | Hitachi Ltd | 画像符号化装置 |
JPH03268679A (ja) * | 1990-03-19 | 1991-11-29 | Fujitsu Ltd | 画像補完符号化装置 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
NL9201594A (nl) * | 1992-09-14 | 1994-04-05 | Nederland Ptt | Systeem omvattende ten minste één encoder voor het coderen van een digitaal signaal en ten minste één decoder voor het decoderen van een gecodeerd digitaal signaal, en encoder en decoder voor toepassing in het systeem. |
NL9201640A (nl) * | 1992-09-22 | 1994-04-18 | Nederland Ptt | Systeem omvattende ten minste één encoder voor het coderen van een digitaal signaal en ten minste één decoder voor het decoderen van een digitaal signaal, en encoder en decoder voor toepassing in het systeem volgens de uitvinding. |
JP2979900B2 (ja) * | 1993-05-26 | 1999-11-15 | 日本ビクター株式会社 | 記録媒体 |
US5608458A (en) * | 1994-10-13 | 1997-03-04 | Lucent Technologies Inc. | Method and apparatus for a region-based approach to coding a sequence of video images |
DE69535007T2 (de) * | 1994-12-20 | 2006-12-21 | Matsushita Electric Industrial Co., Ltd., Kadoma | Verfahren und Vorrichtung zur objektbasierten prädiktiven Kodierung und Übertragung von digitalen Bildern und Dekodierungsvorrichtung |
JP3169783B2 (ja) * | 1995-02-15 | 2001-05-28 | 日本電気株式会社 | 動画像の符号化・復号システム |
JP3788823B2 (ja) * | 1995-10-27 | 2006-06-21 | 株式会社東芝 | 動画像符号化装置および動画像復号化装置 |
TW358296B (en) * | 1996-11-12 | 1999-05-11 | Matsushita Electric Ind Co Ltd | Digital picture encoding method and digital picture encoding apparatus, digital picture decoding method and digital picture decoding apparatus, and data storage medium |
-
1997
- 1997-11-11 TW TW086116814A patent/TW358296B/zh active
- 1997-11-12 US US09/091,984 patent/US6154570A/en not_active Expired - Fee Related
- 1997-11-12 EP EP97912422A patent/EP0876061A4/en not_active Withdrawn
- 1997-11-12 CN CNB011217340A patent/CN1167274C/zh not_active Expired - Fee Related
- 1997-11-12 WO PCT/JP1997/004107 patent/WO1998021896A1/ja active IP Right Grant
- 1997-11-12 KR KR1019980705338A patent/KR100306337B1/ko not_active IP Right Cessation
- 1997-11-12 CN CN97192228A patent/CN1112810C/zh not_active Expired - Lifetime
- 1997-11-12 JP JP52238598A patent/JP3144806B2/ja not_active Expired - Fee Related
-
2000
- 2000-10-12 US US09/686,942 patent/US6571017B1/en not_active Expired - Lifetime
-
2002
- 2002-11-04 US US10/287,002 patent/US6766061B2/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0389792A (ja) * | 1989-09-01 | 1991-04-15 | Hitachi Ltd | 画像符号化装置 |
JPH03268679A (ja) * | 1990-03-19 | 1991-11-29 | Fujitsu Ltd | 画像補完符号化装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP0876061A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005507586A (ja) * | 2001-10-26 | 2005-03-17 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 空間的鮮明度拡張技術を用いた空間拡張可能圧縮の機構 |
Also Published As
Publication number | Publication date |
---|---|
KR19990077197A (ko) | 1999-10-25 |
US6766061B2 (en) | 2004-07-20 |
EP0876061A1 (en) | 1998-11-04 |
KR100306337B1 (ko) | 2001-11-02 |
US20030059122A1 (en) | 2003-03-27 |
EP0876061A4 (en) | 2005-11-30 |
TW358296B (en) | 1999-05-11 |
CN1167274C (zh) | 2004-09-15 |
CN1211373A (zh) | 1999-03-17 |
CN1112810C (zh) | 2003-06-25 |
US6154570A (en) | 2000-11-28 |
JP3144806B2 (ja) | 2001-03-12 |
US6571017B1 (en) | 2003-05-27 |
CN1390061A (zh) | 2003-01-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO1998021896A1 (en) | Digital image coding method and digital image coder, and digital image decoding method and digital image decoder, and data storage medium | |
JP3788823B2 (ja) | 動画像符号化装置および動画像復号化装置 | |
KR100781629B1 (ko) | Dct 베이스 기술을 사용하여 압축된 정보를 기억함에 의해 압축 해제에 필요한 메모리를 감축하는 방법 및 이 방법을 구현하기 위한 디코더 | |
US5412428A (en) | Encoding method and decoding method of color signal component of picture signal having plurality resolutions | |
US6233279B1 (en) | Image processing method, image processing apparatus, and data storage media | |
JPH09238366A (ja) | 画像符号化装置及び画像復号化装置及び符号化・復号化システム | |
RU2412556C2 (ru) | Устройство кодирования, способ кодирования, устройство декодирования, способ декодирования и программа | |
JPH09182085A (ja) | 画像符号化装置、画像復号装置、画像符号化方法、画像復号方法、画像伝送方法及び記録媒体 | |
JP2001045475A (ja) | 映像信号階層化符号化装置と映像信号階層化復号化装置及びプログラム記録媒体 | |
JP6484097B2 (ja) | 映像符号化装置、映像復号装置、映像符号化方法、映像復号方法、映像符号化プログラム及び映像復号プログラム | |
JPH08294119A (ja) | 画像符号化/復号化装置 | |
JPH0678294A (ja) | 符号化方法、符号化装置、および復号化装置 | |
JP2000036963A (ja) | 画像符号化装置、画像符号化方法および画像復号化装置 | |
JP4127182B2 (ja) | 動画像時間軸階層符号化方法、符号化装置、復号化方法及び復号化装置並びにコンピュータプログラム | |
JPH10276437A (ja) | 階層的動画像信号符号化/復号化方法及び装置 | |
JP3776735B2 (ja) | 画像予測復号化方法,画像予測復号化装置,画像予測符号化方法,画像予測符号化装置,及びデータ記憶媒体 | |
JPH11346368A (ja) | 画像処理方法,画像処理装置,及びデ―タ記憶媒体 | |
JP2001160971A (ja) | デジタル画像符号化方法及びデジタル画像符号化装置,デジタル画像復号化方法及びデジタル画像復号化装置,並びにデータ記憶媒体 | |
JP3087864B2 (ja) | Hdtv信号用サブバンド符号化方式 | |
JPH05227522A (ja) | 画像符号化装置および画像復号化装置 | |
JP2006042371A (ja) | 画像記録再生装置及び画像再生装置 | |
JPH0638192A (ja) | 画像符号化装置および画像復号化装置 | |
JP3552045B2 (ja) | 画像信号記録媒体の記録方法、画像信号記録装置、および、画像信号再生装置 | |
JP3387820B2 (ja) | 画像予測復号化装置及び画像予測復号化方法 | |
JPH07336681A (ja) | 画像変換装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 97192228.4 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): CN JP KR US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1997912422 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1019980705338 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 09091984 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWP | Wipo information: published in national office |
Ref document number: 1997912422 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 1019980705338 Country of ref document: KR |
|
WWG | Wipo information: grant in national office |
Ref document number: 1019980705338 Country of ref document: KR |