JPH07203372A - Method for arraying video data and its encoding device and decoding device therefor - Google Patents

Abstract

PURPOSE:To select normal reproducing display or specific reproducing display and to display a reproduced picture. CONSTITUTION:A slice layer has macro-block data 53, an extended data start code 51 and extended data 52. When specific reproducing display is not applied to a macro-block, a normal reproducing macro-block code for the macro-block is arrayed in the macro-block data 53. When specific reproducing display is applied to the macro-block, a specific reproducing macro-block code for the specific reproducing display of the macro-block is arrayed as macro-block data 53 e.g. Thereby a picture a part of which is processed by mosaic processing can be displayed by decoding the data 53. A normal reproducing macro-block code for a macro-block to be displayed by the specific reproducing display is arrayed as extended data 52. Thereby a normally reproduced picture can be displayed by substituting the code of the data 52 for the code of the data 53.

Description

Detailed Description of the Invention

[Object of the Invention]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video data arranging method suitable for encoding and decoding of video software requiring special reproduction display, and an encoding apparatus and a decoding apparatus for the method.

[0002]

2. Description of the Related Art In recent years, digital compression of images has been studied. In particular, various standardization proposals have been proposed for high-efficiency coding using DCT (discrete cosine transform). In the DCT, one frame is divided into a plurality of blocks (m pixels x
(n horizontal scanning lines), and the video signal is converted into frequency components in block units to reduce the redundancy in the spatial axis direction. By the way, as a high-efficiency coding method for moving pictures of television signals, CCITT (Inte
rnational Telegraph and Telephone ConsultativeComm
ittee) is MPEG (Moving Picture Experts Group)
The method was proposed. In this method, not only compression by DCT (intra-frame compression) is performed within one frame, but also inter-frame compression for reducing redundancy in the time axis direction by utilizing correlation between frames is adopted. The inter-frame compression is to further reduce the bit rate by utilizing the property that a general moving image is very similar to the preceding and following frames, and obtaining the difference between the preceding and following frames and encoding the difference value. . In particular, motion-compensated interframe predictive coding that reduces the prediction error by predicting the motion of an image and obtaining the interframe difference is effective.

Regarding this motion-compensated interframe predictive coding, for example, "Trend of television digital coding technology"
(Broadcasting technology (1992-5.P.70)) etc. That is, in this encoding, a motion vector is obtained between the image data D (n) of the current frame and the image data D (n-1) of the previous frame. The image data obtained by decoding the encoded data of the previous frame is motion-compensated by the motion vector, and the motion-compensated image data D ′ of the previous frame is obtained.
(N-1) is obtained. The difference between this image data D ′ (n−1) and the image data D (n) of the current frame is calculated, and this difference value (error component due to motion prediction) is encoded and output.

FIG. 14 is an explanatory diagram showing the layer structure of video data in MPEG.

As shown in FIG. 14, the data structure of the MPEG system is hierarchical. The bottom block layer is composed of horizontal 8 pixels × vertical 8 pixels. Since the luminance component and the color difference component have different sampling cycles, the size of one pixel (one block) differs between the luminance component and the color difference component. If the sampling ratio of the luminance component and the color difference component is 4: 1, the luminance 4 block corresponds to each color difference 1 block. For this reason, four blocks Y0 to Y3 each of which has two blocks in the horizontal and vertical directions of the luminance component and two blocks Cr of the color difference signal,
A macroblock layer is formed with Cb.

Predictive coding is performed for each macroblock to form a slice layer composed of one or a plurality of macroblocks, and a picture layer of one frame is formed from N slice layers. For predictive coding of macroblocks,
Use both prediction, backward prediction, forward prediction or intra-picture prediction. Then, a GOP layer is composed of picture layers of several frames. The GOP layer is composed of both prediction frames (B pictures), forward prediction frames (P pictures) and intra-frame prediction frames (I pictures).

FIG. 15 is an explanatory diagram for explaining inter-picture prediction in the GOP layer. The arrow in FIG. 15 indicates the direction of inter-picture prediction. For example, the seventh frame is a P picture that is predictively encoded using the P picture of the fourth frame. The picture interval between an I (or P) picture and a P (or I) picture is defined by the value M.

Further, in the MPEG system, for example, when a predetermined frame is an I picture, all macroblocks are encoded in the picture in the slice layer. In addition, in a frame that is a P picture, each macroblock is encoded in the slice layer using the front or the image. Also, in a B picture, each macroblock is encoded using in-picture, forward, backward, or both.

A video sequence layer is composed of a plurality of GOPs. Each layer has header information necessary for reproduction, and actual data of the video signal is included in the macroblock layer and the block layer. Also, in the video sequence layer, GOP layer, picture layer and slice layer,
At a predetermined position, an extended data area for encoding options and the like and a user data area for storing user's free information are also defined.

FIG. 16 is a block diagram showing an encoding device for a macroblock layer and a block layer, which contains actual data of a video signal.

The input macroblock data is given to the block division circuit 2 or the difference circuit 3 via the switch 1. Now, assuming that the intra-picture coding mode is for creating an I picture, the switch 1 selects the terminal a by the motion compensation ON / OFF signal. The block division circuit 2 is
DCT by dividing macroblock data into blocks of horizontal 8 pixels × vertical 8 pixels Y0 to Y3, Cr, Cb
It is given to the circuit 4.

A signal whose one block is composed of 8 × 8 pixels is input to the DCT circuit 4, and the DCT circuit 4 converts the input signal into frequency components by 8 × 8 two-dimensional DCT processing. This makes it possible to reduce spatial correlation components. That is, the output (transformation coefficient) of the DCT circuit 4 is given to the quantization circuit 5, and the quantization circuit 5 requantizes the transformation coefficient with a predetermined quantization width to reduce the redundancy of the signal of one block. . The quantization width of the quantization circuit 5 is determined by the quantization width determination circuit 7 based on the generated code amount, the assigned set code amount, and the like.

The quantized data from the quantization circuit 5 is the coefficient V
It is given to the LC (variable length coding circuit) 6. The coefficient VLC6 performs variable length coding on the quantized output based on a predetermined variable length code table, for example, a Huffman code table, and outputs a coefficient coded output. As a result, data having a high appearance probability is assigned a short bit, and data having a low appearance probability is assigned a long bit to further reduce the transmission amount.

On the other hand, when P and B pictures are created, if a predetermined macro block is to be predictively coded, the switch 1 selects the terminal b. The macroblock data is given to the difference circuit 3, and the difference circuit 3 predicts the difference for each pixel data between the macroblock of the current frame and the macroblock of the motion-compensated reference frame (hereinafter referred to as the reference macroblock). DCT as an error
Output to circuit 4. In this case, the DCT circuit 4 encodes the difference data.

The reference macroblock is obtained by decoding the quantized output. That is, the output of the quantization circuit 5 is also given to the inverse quantization circuit 8. The inverse quantization circuit 8 inversely quantizes the quantized output, and the inverse DCT circuit 9 performs inverse DCT processing to restore the original video signal. Since the output of the difference circuit 3 is difference information, the output of the inverse DCT circuit 9 is also difference information. The output of the inverse DCT circuit 9 is given to the adder 10. The output of the adder 10 is added through the memory 11 for M images, the reference macroblock cutout circuit 12 and the switch 13 to the adder 10.
The adder 10 adds the difference data to the reference macroblock data from the reference macroblock cutout circuit 12 to reproduce the macroblock data (local decoded data) of the current frame to store a memory for M images. Output to 11.

The M-picture memory 11 delays the local decoded data from the adder 10 for, for example, M frame periods and outputs it to the reference macroblock cutout circuit 12. The reference macroblock cutout circuit 12 is also given a motion vector, corrects the block position of the local decoded data M frames before by the motion vector, and outputs it to the difference circuit 3 as a motion-compensated reference macroblock.
In this way, the motion-compensated data of M frames before is supplied to the difference circuit 3 as a reference macroblock, and the DCT processing is performed on the prediction error from the difference circuit 3.

The processing by the block division circuit 2, the DCT circuit 4, the quantization circuit 5, the coefficient VLC 6, the inverse quantization circuit 8, the inverse DCT circuit 9 and the adder 10 is repeated by the number of blocks in the macroblock. .

For the block for motion compensation, it is also necessary to transmit the motion vector. The motion vector is given to the motion vector VLC14, and the motion vector VLC14
Outputs the motion vector encoded output by encoding the motion vector data according to a predetermined variable length code table. Also,
The address information of the macroblock in which the transform coefficient or motion vector is coded must also be transmitted. Address VL
On the basis of the outputs of the coefficient VLC6 and the motion vector VLC14, C15 determines the difference between the address of the macroblock in which the encoded transform coefficient and the motion vector exist and the address of the immediately preceding encoded macroblock by a predetermined variable length. It encodes according to the code table and outputs the address encoded output.

By the way, when all the coefficients in a predetermined block are "0", encoding is not performed. Based on the output of the coefficient VLC6, the coded block pattern VLC16 codes pattern data indicating a block in which a coefficient other than 0 exists using a predetermined variable length code table and outputs a pattern coded output. Further, it is necessary to transmit the quantization width used by the quantization circuit 5 for decoding. The quantization width VLC17 encodes the quantization width determined by the quantization width determining circuit 7 according to a predetermined variable length code table and outputs a quantization width encoded output.

The encoded output from each VLC 6, 14 to 17 is applied to the macroblock layer construction circuit 18. The macroblock layer configuration circuit 18 rearranges the input data and outputs it as macroblock layer data.

FIG. 17 is a block diagram showing a decoding device for decoding encoded data of the macroblock layer.

In the MPEG encoded output, the header of each layer is extracted by a decoding processing circuit (not shown), and the data of the macroblock layer is input to the data separation circuit 20. The data separation circuit 20 reads the input bit stream in order, separates the coefficient coded output, the address coded output, the pattern coded output, the quantization width coded output, and the motion vector coded output, and outputs each coefficient VLD (variable). Long decoding circuit)
21, address VLD22, coded block pattern VLD
23, the quantization width VLD24 and the motion vector VLD25.

The coded block pattern VLD23 decodes the pattern coded output and outputs the pattern data indicating the coded block in the macroblock to the coefficient VL.
It is output to D21 and the data reconstruction circuit 30. Coefficient VLD21
Is the coefficient encoding output from the data separation circuit 20,
A block having a significant transform coefficient is designated by the pattern data, and this block is variable-length decoded and output to the block division circuit 26. The block division circuit 26 divides the output of the coefficient VLD21 into blocks and supplies them to the inverse quantization circuit 27.

The quantization width VLD 24 decodes the quantization width encoded output from the data separation circuit 20 and outputs the quantization width to the inverse quantization circuit 27. Using this quantization width, the inverse quantization circuit 27 performs inverse quantization to reproduce the data before quantization on the encoding side. Further, the inverse DCT circuit 28 performs inverse DCT processing on the inverse quantized output, so that D on the encoding side
The pixel data before CT processing is restored and output to the switch 29.

The motion vector VLD25 is a data separation circuit.
The motion vector encoded output from 20 is decoded to output the motion vector to the reference block read circuit 33, and
A signal indicating whether the macroblock is intra-picture coded or predictively coded is output to the switch 29. The switch 29 selects the terminal a when it is shown that it is intra-coded by the motion vector VLD 25, and selects the terminal b when it is shown that it is predictively coded.

If the input macroblock is intra-picture coded, the output of the inverse DCT circuit 28 is given to the data reconstruction circuit 30 via the terminal a of the switch 29. The address VLD 22 decodes the address encoded output from the data separation circuit 20, specifies the position of the macroblock, and gives the macroblock address to the data reconstruction circuit 30. The data reconstruction circuit 30 is also supplied with pattern data from the encoded block pattern VLD23. The data reconfiguration circuit 30 reconfigures and outputs the macroblock data based on the macroblock address and the pattern data.

On the other hand, when the input macroblock is predictively coded, the output of the inverse DCT circuit 28 is given to the adder 31 via the terminal b of the switch 29, and the memory for M images is further stored. Give to 32. In this case, the output of the inverse DCT circuit 28 is a difference value with respect to the reference macroblock, and the difference value is delayed by M frames by the memory 32 for M images. The reference block read circuit 33 blocks the output of the memory 32 for M images at a blocking position based on the motion vector, and adds it as a reference macroblock to the adder 31.
Output to. The adder 31 adds the decoded output of the reference frame and the decoded output of the current frame from the inverse DCT circuit 28 to reproduce the video signal of the current frame and output it to the data reconstruction circuit 30.

If the input macroblock is an intra-picture coded macroblock, there is no motion vector coded output, so the motion vector VLD25
Does not work.

By the way, some video software, such as a brutal and violent scene, is inappropriate to be viewed by children and minors. Depending on the country, it may be necessary to cut the reproduction of part or all of the image or display the mosaic for these scenes. Whether or not such a special display is necessary and the degree thereof are different for each country, for example, and the software supplier must perform the image processing corresponding to that country. However, the above-mentioned device simply encodes and decodes the video software, and it is not possible to select whether to display a part of the video software in special display or in normal display.

[0030]

As described above, conventionally, it is not possible to select the special display or the normal display of a part or all of the image. Therefore, the software supplier cannot individually display the image. There was a problem that processing had to be performed.

It is an object of the present invention to provide a video data arrangement method capable of selecting special display or normal display of a part or all of an image, and an encoding device and a decoding device thereof. .

[Constitution of the Invention]

According to a first aspect of the present invention, there is provided a video data arranging method comprising a normal reproduction block code for normal reproduction for a predetermined block of an image and a special reproduction block code for special reproduction for a predetermined block of an image. Of the normal reproduction block code and the special reproduction block code, if the normal reproduction block code and the special reproduction block code exist for a predetermined block of the image. The coding device according to claim 3 of the present invention blocks an image into predetermined blocks, and an extended bitstream region in which block codes that are not arranged in the normal bitstream region are arranged. Blocking means for outputting data, and encoding the block data for normal reproduction A normal reproduction block code for creating a normal reproduction block code, a special encoding means for encoding the block data to create a special reproduction block code for special reproduction, and a normal reproduction block for reproducing the block. Selection means for giving the block data from the blocking means only to the normal coding means and for giving the block data from the blocking means to both the normal coding means and the special coding means when performing special reproduction display And position information coding means for coding position information for specifying the position of the block to be specially reproduced and displayed, and outputs of the normal coding means, special coding means and position information coding means for the position information. And a data reconstructing unit arranged in a predetermined syntax corresponding to the position on the screen according to the present invention. In the decoding device according to claim 7, when the normal reproduction block code for normal reproduction for the predetermined block of the image is arranged and the special reproduction block code for special reproduction is arranged for the predetermined block of the image, The normal reproduction block code extracting means for extracting the normal reproduction block code and the special reproduction block extracting means for extracting the special reproduction block code are the same as the input data in which the normal reproduction block codes for this block are arranged. Reconstructing means for reconstructing data by selecting one of the output of the normal reproduction block code extracting means for the block and the output of the special reproduction block extracting means, and a decoding means for decoding the output of the reconstructing means. It is equipped with and.

[0033]

In the first aspect of the present invention, the normal reproduction block code for normal reproduction for a predetermined block of an image is arranged in the normal bit stream area. The trick play block code for trick play display for a predetermined block is arranged in one of the normal bit stream area and the extended bit stream area. Further, the normal reproduction block code corresponding to the special reproduction block code is arranged in the other one of the normal bit stream area and the extended bit stream area. For example,
When the special reproduction block codes are arranged in the normal bitstream area, by reproducing the normal bitstream area, for example, an image in which a part of the image is mosaic-processed can be displayed. Also in this case, since the normal reproduction block code for the mosaiced block is arranged in the extended bit stream area, a normal image can be displayed by using the block code in this area.

In claim 3 of the present invention, the selecting means is:
When a specific block of an image can be displayed by special reproduction, the block data is given to both the normal coding means and the special coding means. As a result, a normal reproduction block code and a special reproduction block code are created for this block. The position information encoding means encodes position information for making it possible to specify the special reproduction block code and the normal reproduction block code for the same block. The data reconstructing unit arranges the outputs of the normal encoding unit, the special encoding unit, and the position information encoding unit in a predetermined syntax corresponding to the position on the screen based on the position information.

In the seventh aspect of the present invention, the normal reproduction block code extraction means extracts the normal reproduction block code from the input data, and the special reproduction block code extraction means extracts the special reproduction block code. The reconstructing unit selects one of the output of the normal reproduction block code extracting unit and the output of the special reproduction block extracting unit for the same block to reconstruct the data. As a result, it is possible to display the image that is normally reproduced and, for example, to display the image in which a part of the image is mosaic-processed.

[0036]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an explanatory diagram showing an embodiment of a video data arranging method according to the present invention.

In the present embodiment, in consideration of the case where a part or all of a predetermined image of video software needs to be specially reproduced and displayed, an area for arranging data for normal reproduction and display in macroblock units is provided. An area for arranging data for special reproduction display is provided in the slice layer. The syntax of this embodiment is M in FIG.
It is almost the same as PEG. In this embodiment, the syntax of the slice layer is different from that of MPEG.

FIG. 1 shows the syntax of the slice layer in this embodiment. A start code 50 is arranged at the head of the slice layer. The start code 50 is a code indicating the start of data in the slice layer. Next, after arranging the extended data start code 51 and the extended data 52 which are the extended bit stream areas, the macro block data 53 which is the normal bit stream area is arranged, or the macro block without the extended bit stream area is provided. Only data 53 is arranged.

Extended data start code 51 is extended data
If the extension data 52 does not exist, the extension data start code 51 does not exist. The extension data 52 is arranged next to the extension data start code 51. The extension data 52 is divided into, for example, bytes to clarify the end position. When the extended data 52 ends, the macroblock data 53 of the macroblock layer is repeatedly arranged by the number of macroblocks in the slice layer.

In the normal bit stream area, when it is not necessary to perform special reproduction display of a predetermined macroblock, data for normal reproduction display of this macroblock (hereinafter referred to as normal reproduction macroblock code) is used as the macroblock. Arrange as data 53. Further, when it is necessary to perform special reproduction display of a predetermined macroblock, data for performing special reproduction display of this macroblock (hereinafter referred to as special reproduction macroblock code) or normal reproduction macroblock code for this macroblock One of them is arranged as macroblock data 53.

In the extended bit stream area, the special reproduction macroblock code for this macroblock or the normal reproduction macroblock code for this macroblock is extended data only when it is necessary to perform special reproduction display of a predetermined macroblock. Arrange as 52.

When the special reproduction macroblock code of a predetermined macroblock is arranged as the extension data 52, the normal reproduction macroblock code of this macroblock is arranged in the macroblock data 53 and the extension data 52 has the predetermined reproduction macroblock code. When the normal reproduction macroblock code of the macroblock is arranged, the special reproduction macroblock code of this macroblock is arranged in the macroblock data 53.

By arranging the video data in this manner, the extended bit stream area and the normal bit stream area are selected at the time of decoding in accordance with the intended use, and special reproduction in which normal reproduction display and a part of the image are processed is performed. Playback display is possible.

Although the extended bitstream area is provided in the slice layer in FIG. 1, it may be provided in a picture layer, a GOP layer or a video sequence layer other than the slice layer.

FIG. 2 shows an extension data start code 51 and extension data which form the extension bit stream area in FIG.
FIG. 34 is an explanatory diagram showing a specific syntax of 52. In addition,
In FIG. 2, only significant symbols are shown, and data such as byte-related processing is omitted.

In the example of FIG. 2A, the number of bits 141 which is a fixed length code is arranged at the head. 141 bits are extended data
The number of bits is 52. By referring to the number of bits 141, the number of bits to be skipped can be easily determined without decoding the extension data and detecting the end position thereof when the extension data is not read at the time of decoding. After the number of bits 141, the number (n) 142 is arranged. The number (n) 142 indicates the number of macroblocks included in the extension data 52.

Next to the number (n) 142, an address 143 indicating the address of n macroblocks and a VLC 144 which is variable length coded macroblock data are arranged.
Depending on the number (n) 142, address 143 and VLC 144
If the number of bits is fixed by byte conversion processing or the like, skipping n × bits (bytes) makes it possible to easily skip the extension data.

The address 143 is a code indicating the display absolute position of the macroblock data in the extended bitstream area or the relative position of the macroblock in the slice.
The address 143 is composed of a fixed length or variable length code. By referring to this address 143, it becomes possible to decode the macroblock data in the corresponding extended bitstream area instead of the macroblock data 53 in the normal bitstream area during the decoding process.

The address 143 for n macroblocks
After that, n VLCs 144 are arranged, but n pieces of data of a set of address 143 and VLC144 may be arranged.

FIG. 2B shows a data array in which the number of bits 141 of FIG. 2A is omitted. In this case, if you want to skip the data in the extended bitstream area,
The decoding process for the number n shown by the number (n) 142 is required. Alternatively, as in the case of FIG. 2A, the address
When the number of bits of 143 and VLC 144 is fixed by the byte conversion process or the like, the number of bits is skipped by n × bits (bytes).

FIG. 2C shows the data of the set of addresses 143 and VLC144 of FIG.
It is a repeated arrangement.

In FIG. 2D, the number (n) 142 is omitted. The data of the set of address 143 and VLC144 is repeatedly arranged by the number of macroblocks. Note that FIG.
Similar to (a) and (b), the address 143 may be repeatedly arranged for the number of macro blocks, and then the VLC 144 may be repeatedly arranged for the number of macro blocks.

Although the variable length VLC 144 which is the actual data is arranged in FIG. 2, a fixed length code may be arranged.

FIG. 3 is an explanatory diagram showing an embodiment of an encoding apparatus according to the present invention. FIG. 3 shows a slice layer coding apparatus.

The slice header encoding circuit 60 creates the start code 50 indicating the start of the slice layer and encodes the data indicating the address of the slice layer. The switches 61 and 64 are controlled by a control signal (not shown) and are interlocked and switched in units of macroblocks. That is, the switch
61 and 64 select terminal a when creating data for normal reproduction and display of a specified macroblock, and select terminal b when creating data for special reproduction display of a specified macroblock. It is supposed to do.

The normal reproduction macroblock encoding circuit 62 is
The configuration is the same as that of FIG. 16, and the input macroblock data is encoded and output as a normal reproduction macroblock code. The special reproduction macroblock encoding circuit 63 performs the special reproduction encoding process and the normal reproduction encoding process on the macroblock to be subjected to the special reproduction display to generate the special reproduction macroblock code and the normal reproduction macroblock code. Output.

The layer forming circuit 65 outputs the output of the slice header encoding circuit 60 and the normal reproduction macroblock encoding circuit 61.
And the output of the special reproduction macroblock encoding circuit 63, and form the slice layer syntax shown in FIG.

Next, the operation of the embodiment thus configured will be described. In the present embodiment, description will be made assuming that the normal reproduction macroblock code is arranged as the extension data 52 in FIG. 1 and the special reproduction macroblock code is arranged in the macroblock data 53. That is, in this case, the normal bit stream area contains data for special reproduction.

The slice header coding circuit 60 creates a slice layer start code 50. Now, if it is assumed that a particular macro block does not require special reproduction display, both switches 61 and 64 select terminal a. In this case, as in the conventional case, the predetermined macroblock is encoded and the normal reproduction macroblock code is output. The layer configuration circuit 65 arranges the normal reproduction macroblock code as the data of the macroblock data 53.

Here, it is assumed that special reproduction display is required for a predetermined macroblock. In this case, the switches 61 and 64 select the terminal b. Then, the special reproduction macroblock encoding circuit 63 operates to perform the encoding processing for normal reproduction and special reproduction for this macroblock. The special reproduction macroblock code and the normal reproduction macroblock code from the special reproduction macroblock encoding circuit 63 are given to the layer forming circuit 65 via the switch 64.

The layer configuration circuit 65 arranges the start code from the slice header encoding circuit 60 at the head position of the slice layer. The layer configuration circuit 65 sequentially arranges macroblock data that does not require special reproduction display, that is, normal reproduction macroblock codes from the normal reproduction macroblock encoding circuit 61, as macroblock data 53. Then, the layer configuration circuit 65 also arranges the special reproduction macroblock code for the macroblock that needs special reproduction display in the macroblock data 53. That is, as the macro block data 53 which is a normal bit stream area,
The special reproduction macroblock code is arranged at a position corresponding to a predetermined macroblock in the image that needs special reproduction display,
A normal reproduction macroblock code is arranged in the other part. The normal reproduction macroblock code for a predetermined macroblock in an image that needs special reproduction display is arranged in the extension data 52 by the layer configuration circuit 65. In this way, the syntax of the slice layer shown in FIG. 1 is formed.

FIG. 4 is a block diagram showing a concrete structure of the special reproduction macroblock encoding circuit 63 shown in FIG. 4, the same components as those in FIG. 16 are designated by the same reference numerals.

In FIG. 4, the switch 1 is supplied with the macroblock data of the macroblock layer shown in FIG. 14, which macroblock data requires special reproduction display. The switch 1 is connected to the terminal a when the motion compensation ON / OFF signal indicates the intra-picture coding mode.
Is selected, and the terminal b is selected when the motion compensation predictive coding mode is indicated. The terminal b of the switch 1 is connected to the difference circuit 3, and the difference circuit 3 subtracts, for each pixel, the macroblock data of the current frame and the motion-compensated reference macroblock data, which will be described later, and outputs a prediction error. . The prediction error or the macroblock data from the terminal a of the switch 1 is given to the block division circuit 2.

The block division circuit 2 divides the macroblock data into block units of, for example, 8 × 8 pixels and performs DCT.
Output to circuit 4. The DCT circuit 4 is provided with block data, converts the spatial coordinate components into frequency components by DCT processing, and outputs the frequency components to the quantization circuit 5. The quantization width determination circuit 7 determines the quantization width in the quantization circuit 5 based on the used code amount (generated code amount), the set code amount, and the like.
The quantizing circuit 5 quantizes the DCT transform coefficient based on the quantizing width from the quantizing width determining circuit 7 and outputs it to the coefficients VLC 71, 72 and the inverse quantizing circuit 8.

The dequantization circuit 8 dequantizes the quantized output using the quantization width from the quantization width determination circuit 7 and outputs it to the inverse DCT circuit 9 in order to create a reference macroblock. The inverse DCT circuit 9 performs inverse DCT processing on the inverse quantized output and outputs it to the adder 10. The adder 10 adds the data of the reference frame from the switch 13 and the decoded output of the current frame to reproduce the data of the current frame and outputs it to the memory 11 for M images. Note that the switch 13 is off for the macroblock for which motion compensation is not performed, and the adder 10
Does not perform addition processing.

The M image memory 11 outputs the output of the adder 10 (local decoded data) to the reference macroblock cutout circuit 12 as data of a reference frame by delaying it for M frame periods. A motion vector is also given to the reference macroblock cutout circuit 12. The reference macroblock cutout circuit 12 corrects the blocking position of the reference frame using the motion vector, creates a motion-compensated reference macroblock, and outputs it to the difference circuit 3 and a switch.
Output to the adder 10 via 13. The switch 13 is turned on only when motion compensation is performed.

FIG. 5 is an explanatory diagram for explaining the coefficient VLC71.

The DCT circuit 4 performs a DCT process on the block data of 8 × 8 pixels to obtain 8 × 8 DCT transform coefficients in the horizontal and vertical low to high regions. After the DCT transform coefficient is quantized, it is sequentially input to the coefficient VLC71 from the low band in the horizontal and vertical directions to the high band. Coefficient VLC
71 is a part of the horizontal and vertical low frequencies shown in the shaded area in FIG.
Only the quantized output corresponding to the T transform coefficient is variable-length coded according to a predetermined variable-length code table and output as a special reproduction macroblock code. If the DCT transform coefficients of a part of the horizontal and vertical low frequencies shown in the shaded area of FIG. 5 are all 0 and there is no significant coefficient, the coefficient VLC circuit 71 gives a code indicating the end of the block. It is designed to output.

The motion vector VLC 14 encodes motion vector data in a block for motion compensation according to a variable length code table, and outputs a motion vector coded output to the macroblock layer configuration circuit 18. The address VLC15 is based on the output of the coefficient VLC71 and the motion vector VLC14, and for the macroblock in which the coefficient and the motion vector to be coded exist, the difference between the address and the address of the immediately preceding coded macroblock is set to a predetermined variable length code It encodes according to the table and outputs the address encoded output. Based on the output of the coefficient VLC71, the coded block pattern VLC16 encodes pattern data indicating a block in which a coefficient other than 0 exists using a predetermined variable length code table and outputs a pattern coded output. The quantization width VLC17 encodes the quantization width determined by the quantization width determining circuit 7 according to a predetermined variable length code table and outputs a quantization width encoded output.

The encoded output from each VLC 71, 14 to 17 is applied to the macroblock layer configuration circuit 18. The macroblock layer configuration circuit 18 rearranges the input data and outputs it as normal bitstream area data.

On the other hand, the quantized output from the quantizing circuit 5 is also given to the coefficient VLC72, and the coefficient VLC72 shows all significant D values.
The quantized output corresponding to the CT transform coefficient is variable-length coded according to a predetermined variable-length code table, and is output to the slice layer extended data configuration circuit 73 as a normal reproduction macroblock code.
The slice layer extended data configuration circuit 73 creates an address indicating the position of the macroblock and outputs the normal reproduction macroblock code as data of the extended bitstream area.

Next, the operation of the embodiment thus constructed will be described.

Macroblock data for which a part of the image needs to be cut or made into a mosaic pattern is input to the switch 1. In the intra-picture coding mode, the switch 1 selects the terminal a, and the macroblock data is input to the block division circuit 2 via the switch 1. After the macroblock data is divided into blocks by the block division circuit 2, DCT processing is performed by the DCT circuit 4. DCT
The transform coefficient is given to the quantization circuit 5 and quantized, and the coefficient VLC
Output to 71 and 72.

On the other hand, in the predictive coding mode, the quantized output is also given to the inverse quantization circuit 8 and inversely quantized. Further, the inverse DCT circuit 9 performs inverse DCT processing to restore the original data. This data is difference information, and the adder 10 adds the reference macroblock from the switch 13 to reproduce the data of the current frame when performing motion compensation. The locally decoded data from the adder 10 is given to the memory 11 for M images to delay it by M frames, and the reference frame is given to the reference macroblock cutout circuit 12. The reference macroblock cutout circuit 12 corrects the blocking position of the reference frame based on the motion vector to create a reference macroblock, and supplies it to the difference circuit 3.

As a result, the difference circuit 3 obtains the difference between the macroblock of the current frame and the motion-compensated reference macroblock for each pixel and outputs the prediction error. Thus, in this case, the DCT circuit 4 DCT-processes the prediction error. The DCT transform coefficient based on the prediction error is quantized by the quantization circuit 5 and given to the coefficients VLC71 and 72.

The coefficient VLC 72 performs variable length coding on the quantized output corresponding to all DCT transform coefficients using a predetermined variable length code table. The output of the coefficient VLC72 is given to the slice layer extension data forming circuit 73 as a normal reproduction macroblock code.
The slice layer extension data configuration circuit 73 creates data indicating the position of the input normal reproduction macroblock code on the screen, and outputs the normal reproduction macroblock code as the extension data 52 of the extension bitstream area.

The output of the slice layer extended data forming circuit 73 is given to the layer forming circuit 64 of FIG.
Are arranged as extended data 52 of the slice layer. Incidentally, when the decoding device corresponding to the present embodiment described later is not used, the data of the extended data 52 cannot be decoded, and the normal reproduction image, that is, the cut processing or mosaic for a part or all of the image. Unprocessed image cannot be reproduced.

On the other hand, the coefficient VLC 72 performs variable length coding on only the output corresponding to the DCT transform coefficients in the horizontal and vertical low frequencies shown by the diagonal lines in FIG. 5 among the quantized outputs using a predetermined variable length code table. Since the output from the coefficient VLC 72 has the high frequency components of the DCT transform coefficient removed, it is not possible to reproduce a fine portion even when it is decoded, resulting in a mosaic image. The range of the low-frequency component that the coefficient VLC72 performs variable-length coding is changed according to the regulations of each country, for example. The narrower the range of low-frequency components to be variable-length coded, the more blurred the details of the image and the more difficult it is to see. The output of the coefficient VLC71 is given to the macroblock layer forming circuit 18 as a special reproduction macroblock code, and is also given to the address VLC15 and the coded block pattern VLC16.

In the motion vector VLC14, the motion vector data is variable length coded in the block for motion compensation, and the motion vector coded output is output to the macroblock layer configuration circuit 18 and the address VLC15. Address VL
For a macroblock in which a coefficient and a motion vector to be coded exist, C15 performs variable length coding on the difference between the address of the macroblock and the address of the immediately preceding coded macroblock and outputs the address coded output to the macroblock layer configuration circuit 18. Output. The coded block pattern VLC16 is a macroblock layer configuration circuit that variable-length-codes pattern data indicating a block having a significant coefficient and outputs a pattern-coded output.
Output to 18. The quantization width VLC 17 performs variable length coding on the quantization width and outputs the quantization width coded output to the macroblock layer configuration circuit 18.

The macroblock layer configuration circuit 18 is provided for each VLC.
The coded outputs from 71, 14 to 17 are arranged according to the MPEG system, and output as data in the normal bit stream area. The output of the macroblock layer configuration circuit 18 is given to the layer configuration circuit 65, and the layer configuration circuit 65 arranges the special reproduction macroblock code together with the normal reproduction macroblock code for the macroblock that does not need the special reproduction display.

As described above, in this embodiment, a desired portion of an image of normal video software which has not been cut and mosaiced is processed in macroblock units (16 in FIG. 14).
It is determined whether or not the special reproduction display is possible in units of pixels × 16 pixels), and the normal reproduction macroblock code and the special reproduction macroblock code are created for the macroblocks for which the special reproduction display is possible. The normal reproduction macroblock code is arranged in the extended bitstream area in the slice layer, and the special reproduction macroblock code is arranged in the normal bitstream area. In the normal bit stream area, the normal image data and the special reproduction data for the special display portion are arranged, and the cut and mosaiced video can be displayed.

FIG. 6 is a block diagram showing an embodiment of the decoding apparatus according to the present invention.

Slice data is input to the input terminal 81. The slice data has the syntax shown in FIG. 1, and has an extension bit stream including an extension data start code and extension data in addition to a normal bit stream area that can be decoded by a general decoding device compatible with the MPEG system. Has an area.

The slice data is given to the switch 82. The switch 82 is controlled by a control signal (not shown), and when the data of the extended bit stream area is not decoded, the slice data is given to the slice data decoding circuit 84, and when the data is decoded, the switch 84 and the slice header decoding are performed. It is given to the circuit 83. Slice header decoding circuit 83
Decodes data such as a start code indicating the beginning of a slice and an address of the slice. When the extended data start code is not detected following the start code, the slice header decoding circuit 83 controls the switch 84 to give the slice data to the slice data decoding circuit 84, and when the extended data start code is detected. Has
The switch 84 is controlled to output the extended data to the extended data temporary decoding circuit 85, and then the macroblock data is given to the normal data temporary decoding circuit 88.

FIG. 7 is a block diagram showing a specific structure of the extended data temporary decoding circuit shown in FIG.

The extension data from the switch 84 is input to the input terminal 91. This extended data is given to the data read circuit 92. The extended data is composed of a macroblock address and a variable length code which is data, and the data reading circuit 92 reads one bit at a time when the variable length code is input and a predetermined length when a fixed length code is input. The number of bits is read and output to the switch 93. The switch 93 uses the fixed-length code from the data read circuit 92 as an extended data memory.
The variable length code is output to 86 and the variable length code is referred to the variable length code table.
Output to. The variable length code table reference circuit 94 compares the read data with the data stored in the variable length code table 95 to detect the corresponding code. When the corresponding code is not detected, the data read circuit 92 is controlled to read the next 1 bit. The variable-length code table reference circuit 94 detects a code corresponding to the input data, converts the variable-length decoding into a fixed-length code, and outputs the fixed-length code to the extended data memory 86. Thus, the extended data memory
In 86, a fixed-length code of extension data is stored.

When the reading of the extended data is completed, the slice header extraction circuit 83 controls the switch 84 to give the macroblock data to the normal data temporary decoding circuit 88. The normal data temporary decoding circuit 88 has the same configuration as the extended data temporary decoding circuit 85 in FIG. 7, and reads macroblock data and converts it into fixed length data. In this case, the normal data provisional decoding circuit 88 outputs the data to the slice data reconstruction circuit 87 as it is without performing image expansion processing such as inverse quantization.

The slice data reconstruction circuit 87 converts the extension data from the memory 86 into a corresponding normal data temporary decoding circuit.
Replace the macroblock data from 88 and add slice header to reconstruct slice data. As a result, the slice data reconstruction circuit 87 causes the MPE shown in FIG.
Reconstruct the G-type slice layer.

FIG. 8 is a slice data reconstruction circuit in FIG.
FIG. 90 is a block diagram showing a specific configuration of 87. FIG. 9 is an explanatory diagram for explaining the operation.

The slice data reconstruction circuit 87 is shown in FIG.
The reconstruction unit 101 shown in FIG. 8 and the reconstruction unit 102 shown in FIG. The reconstruction unit 101 shown in FIG. 8A is used when variable length coding is performed only within a macroblock, and the reconstruction unit 102 shown in FIG. 8B is used when variable length coding is performed in a macroblock. It is used when it is carried out for a while.

The reconstruction unit 101 is composed of switches 105 and 106. The macroblock data from the normal data temporary decoding circuit 88 is given to the terminal a of the switch 106 via the terminal a of the switch 105. The extended data from the extended data memory 86 is given to the terminal b of the switch 106. The switches 105 and 106 operate in conjunction with each other based on the address. When one selects the terminal a, the other selects the terminal a, and when one selects the terminal b, the other selects the terminal b.

Now, it is assumed that the macroblock data indicated by □ in FIG. 9 is input to the switch 105. The extended data indicated by hatching in FIG. 9 corresponds to the fourth and fifth macroblock data. The switches 105 and 106 select the terminal a at the timing when the first to third macroblock data are input, and the switch 106 outputs the macroblock data. At the timing when the fourth and fifth macroblock data are input, the switches 105 and 106 select the terminal b, discard the macroblock data, and select and output the extended data. In this way, slice data is reconstructed by arranging the data arranged in the extended bitstream area instead of the data arranged in the normal bitstream area.

In the reconstructing section 102 shown in FIG. 8B, the macroblock data and the extension data are given to the decompression circuits 107 and 108, respectively. When the variable-length coding process is performed over a plurality of macroblocks, the variable-length decoding process is not performed in the extended data temporary decoding circuit 85 and the normal data temporary decoding circuit 88, so the decompression circuit 10
Decompression processes 1 and 108 restore the macroblock data and extended data to the original fixed length data. The output of the expansion circuit 107 is given to the terminal a of the switch 110 via the terminal a of the switch 109, and the output of the expansion circuit 108 is given to the terminal b of the switch 110. Switches 109 and 110 are switches 105 and 106
Works in the same way as.

The predetermined macroblock data is replaced by the extension data by the switches 109 and 110. The synthesizing circuit 111 synthesizes the output of the switch 110 and supplies it to the re-encoding circuit 112. The re-encoding circuit 112 performs variable-length encoding on the input data again and outputs it. Thus, instead of the data normally arranged in the bitstream area,
The data arranged in the extended bitstream area is arranged to reconstruct slice data.

The slice data reconstruction circuit 87 includes a reconstruction unit.
A slice header is added to the outputs of 101 and 102 to reconstruct slice data and the slice data is supplied to the slice data decoding circuit 89. The slice data decoding circuit 89 has the same configuration as that shown in FIG. 17, and is designed to decode the input macroblock data and output it.

Next, the operation of the embodiment thus constructed will be described with reference to the flowchart of FIG.

It is assumed that the slice data encoded by the encoder of FIG. 3 is input to the input terminal 81 of FIG.

When the decoding of the slice layer is started, it is determined in step S1 whether or not the extended data is used. When the extended data is not used, the process proceeds to step S8, and the slice data input to the input terminal 81 is given to the slice data decoding circuit 89 via the switch 82 to be decoded. That is, in this case, only the macroblock data 53 of FIG. 1 is decoded. Therefore,
When the special reproduction macroblock code for performing special reproduction display is arranged as the macroblock data 53 by the encoding device of FIG. 3, a part or all of the image is output by the output of the slice data decoding circuit 89. A cut or mosaiced image is displayed.

When reproducing the extended data, the process proceeds from step S1 to step S2, and the slice header extracting circuit 83 decodes the slice header. When the slice header extraction circuit 83 detects that the extended data start code is not included, it controls the switch 84 to output the slice data to the slice data decoding circuit 89 (step S3). In this case, it means that the input slice layer does not include extension data, and that there is no macroblock for special reproduction display in this slice layer. That is, all the macroblock data is an array of normal reproduction macroblock codes for normal reproduction. Therefore, in step S8, the slice data decoding circuit 89 performs the decoding process to display a normal image that has not been cut or mosaiced.

On the other hand, when the extended data start code is included, the slice header extraction circuit 83 controls the switch 84 to give the extended data to the extended data temporary decoding circuit 85. The extended data temporary decoding circuit 85 converts the extended data consisting of the normal reproduction macroblock code and the address into fixed length data in step S4, and stores it in the extended data memory 86 in step S5.

When the reading of the extended data is completed, the slice header extraction circuit 83 controls the switch 84 to give the macroblock data to the normal data temporary decoding circuit 88. The normal data provisional decoding circuit 88, in step S6,
The normal reproduction macroblock data and the special reproduction macroblock code forming the macroblock data 53 are converted into a fixed length code and output to the slice data reconstruction circuit 87.

The slice data reconstruction circuit 87 reads the extended data from the extended data memory 86, replaces it with the data from the normal data temporary decoding circuit 88, and outputs it. That is,
The slice data reconstruction circuit 87 arranges the normal reproduction macroblock code instead of the special reproduction macroblock code. The slice data decoding circuit 89 decodes the output data of the slice data reconstruction circuit 87 in step S8. The special reproduction macroblock code is replaced with a normal reproduction macroblock code to form macroblock data, and the slice data reconstruction circuit 87 displays the original video that has not been cut or mosaiced. You can

As described above, in this embodiment, the normal reproduction macroblock code in the extension data is arranged instead of the special reproduction macroblock code included in the macroblock data in the syntax of the slice layer shown in FIG. And can be converted into syntax compatible with MPEG. When the macroblock data is decoded as it is, part or all of the image can be displayed as a cut or mosaiced image, and when the data in the extended data is replaced and decoded, the The original video that has not been processed or mosaicked can be displayed.

When the normal reproduction macroblock code is arranged as the macroblock data of the macroblock which needs the special reproduction display and the special reproduction macroblock code is arranged in the extension data, the macroblock data is directly decoded. By doing so, it is possible to display a video that has not been cut or mosaic processed, and when replaced with data in the extended data, it is possible to display a video that has been cut or mosaiced.

FIG. 11 is a block diagram showing another embodiment of the present invention. 11, the same components as those in FIG. 4 are designated by the same reference numerals and the description thereof will be omitted. In addition, in FIG.
In the explanation, it is assumed that the special reproduction macroblock code is arranged in the normal bitstream area and the normal reproduction macroblock code is arranged in the extended bitstream area.

In this embodiment, the coefficient VL is used instead of the coefficient VLC71.
Quantization width VLC12 instead of quantum width VLC17 using C6
The difference from the embodiment of FIG. 4 is that 1 is used and the quantization width VLC17 is used instead of the coefficient VLC72. The coefficient VLC6 is a variable-length coded value of the quantized output corresponding to the significant DCT transform coefficient in the entire band using a predetermined variable-length code table.
15 and the encoded block pattern VLC16.

In the present embodiment, the quantization width VLC121
Creates a special reproduction quantization width different from the quantization width used in the quantization circuit 5 and performs variable length coding. The special reproduction quantization width coded output from the quantization width VLC121 is given to the macroblock layer configuration circuit 18. The macroblock layer configuration circuit 18 rearranges the coded outputs of the VLCs 6, 14 to 16 and 121 to configure a macroblock layer.

The quantizing width VLC 17 variable-length-codes the actual quantizing width determined by the quantizing-width determining circuit 7 using a predetermined code table, and outputs it to the slice layer extension data forming circuit 73. The slice layer extension data configuration circuit 73 uses the quantization width VLC.
The output of 17 is arranged as the extension data of the extension bit stream area as the quantization width encoded output for normal reproduction.

In the embodiment constructed as described above,
For a macroblock that requires special reproduction display, the quantization width VLC 121 performs variable length encoding on a quantization width different from the actual quantization width and outputs it as a special reproduction quantization width encoded output. For example, if the quantization width for special playback is set to a value that is sufficiently larger than the quantization width actually used,
When inverse quantization processing is performed on the decoding side using this special reproduction quantization width, horizontal and vertical high-frequency DCT transform coefficients become approximately 0, and mosaic processing is performed as in the embodiment of FIG. An image is obtained. The special reproduction quantized width coded output from the quantized width VLC 121 is arranged by the macroblock layer configuration circuit 18 into macroblock data which is a normal bitstream area.

The quantization width VLC17 outputs the quantization width used for the encoding in the embodiment by variable length encoding. The slice layer extension data configuration circuit 73 arranges the input quantization width coded output in the extension data of the extension bit stream area.

Other actions and effects are similar to those of the embodiment of FIG.

By changing the setting of the quantization width of the quantization width VLC121, the special reproduction process according to the regulations of each country can be performed.

FIG. 12 is a block diagram showing another embodiment of the present invention. In this embodiment, whether or not the special reproduction display is possible can be selected in block units. 12, the same components as those of FIG. 4 are designated by the same reference numerals and the description thereof will be omitted. Note that, in FIG. 12, the special reproduction macroblock code is arranged in the normal bitstream area, and the normal reproduction macroblock code is arranged in the extension bitstream area.

The output of the quantization circuit 5 is given to the coefficient VLC6. The coefficient VLC6 performs variable length coding on the quantized output corresponding to the significant DCT transform coefficients in the entire band using a predetermined code table, and outputs the coded block pattern VLC16. In the present embodiment, the outputs of the coefficient VLC6 and the coding block pattern VLC16 are used as the slice layer extension data configuration circuit 73.
To give to.

The output of the quantization circuit 5 is also output to the coding block pattern VLC131. Special display pattern data indicating a block that enables special reproduction display is also given to the encoded block pattern VLC131. This special display pattern data indicates which of the blocks (6 blocks in the example of FIG. 14) that make up the macro block can be specially reproduced and displayed. The coded block pattern VLC131 uses the pattern data indicating the existence of the block not to be subjected to special reproduction display among the quantized outputs of the block having the significant DCT transform coefficient as the address V.
LC15, macroblock layer configuration circuit 18 and coefficient VLC13
Output to 2.

The coefficient VLC132 performs variable-length coding on only the quantized output of the block indicated by the pattern data from the coded block pattern VLC131 out of the quantized output from the quantization circuit 5, and outputs it to the macroblock layer configuration circuit 18. It is like this.

Next, the operation of the embodiment thus constructed will be described with reference to the explanatory view of FIG.

Now, as shown in FIG. 13, the macro block is composed of four luminance blocks Y and one color difference block C.
It is assumed that the blocks are composed of r and Cb, and that each block is given numbers 1 to 6 shown in FIG. Also, among the blocks, the block numbers including the significant DCT transform coefficients are 1, 2, 3, 5, and 6,
It is assumed that the special display pattern data input to the encoded block pattern VLC131 indicates block numbers 2 and 4.

The macroblock data including the blocks (blocks 2 and 4) to be specially reproduced and displayed is the switch 1
Be entered via. All the quantized outputs from the quantization circuit 5 are variable-length coded by the coefficient VLC6 and given to the slice layer extension data configuration circuit 73. Based on the output of the coefficient VLC6, the coding block pattern VLC16 has a significant D
The pattern data indicating the presence of the block having the CT transform coefficient is output to the slice layer extension data configuration circuit 73. In this case, the pattern data from the encoded block pattern VLC16 becomes "111011" indicating the block numbers 1, 2, 3, 5, and 6. The slice layer extension data configuration circuit 73 arranges the output of the significant coefficient VLC6 as extension data in the extension bit stream area.

On the other hand, the output of the quantizing circuit 5 is also given to the coding block pattern VLC131. The coded block pattern VLC131 is a pattern data "10" indicating the presence of the special reproduction display block, ie, the block numbers 1, 3, 5 and 6 among the blocks having significant DCT transform coefficients.
1011 ″ is output to the coefficient VLC132.

Based on the pattern data from the coded block pattern VLC131, the coefficient VLC132 variable-length-codes only the quantized output for the blocks of block numbers 1, 3, 5, and 6 and outputs it to the macroblock layer configuration circuit 18. . The macroblock layer configuration circuit 18 includes VLCs 14, 15,
The coded outputs of 17, 131 and 132 are rearranged and arranged as macroblock data in the normal bitstream area. As a result, when the normal bit stream area is reproduced and decoded, the reproduction of the block designated by the special display pattern data can be cut.

Other actions and effects are similar to those of the embodiment of FIG.

It is obvious that the decoding apparatus in the embodiment of FIG. 6 can also easily deal with the processing in block units.

[0124]

As described above, according to the present invention, it is possible to select whether to display a part or all of an image in a special display or a normal display.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing an embodiment of a video data arranging method according to the present invention.

FIG. 2 is an explanatory view showing a specific syntax of extension data 52 in FIG.

FIG. 3 is a block diagram showing an embodiment of an encoding device according to the present invention.

FIG. 4 is a block diagram showing a specific configuration of a special reproduction macroblock encoding circuit in FIG.

FIG. 5 is an explanatory diagram for explaining the operation of FIG. 4.

FIG. 6 is a block diagram showing an embodiment of a decoding device according to the present invention.

7 is a block diagram showing a specific configuration of an extended data temporary decoding circuit in FIG.

8 is a block diagram showing a specific configuration of a slice data reconstruction circuit in FIG.

FIG. 9 is an explanatory diagram for explaining the operation of FIG. 8;

10 is a flowchart for explaining the operation of the embodiment of FIG.

FIG. 11 is a block diagram showing another embodiment of the present invention.

FIG. 12 is a block diagram showing another embodiment of the present invention.

13 is an explanatory diagram for explaining the operation of the embodiment of FIG.

FIG. 14 is an explanatory diagram for explaining a layer structure of the MPEG system.

FIG. 15 is an explanatory diagram for explaining the structure of a GOP.

FIG. 16 is a block diagram showing an encoding device compatible with MPEG.

FIG. 17 is a block diagram showing a decoding device compatible with MPEG.

[Explanation of symbols]

51 ... Extended data start code, 52 ... Extended data, 53 ...
Macroblock data

Continuation of the front page (51) Int.Cl. ⁶ Identification number Office reference number FI technical display location H04N 5/76 A 7/24

Claims (7)

[Claims] 1. A normal bitstream area in which a normal reproduction block code for normal reproduction for a predetermined block of an image and a special reproduction block code for special reproduction for a predetermined block of an image can be arranged, and for a predetermined block of the image. When the normal reproduction block code and the special reproduction block code are present, an extension bitstream for arranging the block code not arranged in the normal bitstream area of the normal reproduction block code and the special reproduction block code And a video data arranging method. 2. The extended bitstream area has position information for associating the arranged block code with the normal reproduction block code or the special reproduction block code corresponding to the normal bitstream area. The video data arranging method according to claim 1. 3. Blocking means for blocking an image into predetermined blocks and outputting block data; normal coding means for coding the block data to create a normal playback block code for normal playback; and the block. Special encoding means for encoding data to create a special reproduction block code for special reproduction, and when the block is normally reproduced and displayed, block data from the block forming means is given only to the normal encoding means, When performing special reproduction display, selection means for giving the block data from the blocking means to both the normal encoding means and the special encoding means, and position information for specifying the position of the block for special reproduction display Position information encoding means for encoding the above, the normal encoding means, the special encoding means and the position information encoding means Encoding apparatus characterized by output in correspondence with the position on the screen based on the position information; and a data reconstruction means arranged at a predetermined syntax. 4. The orthogonal encoding means and the special encoding means orthogonally transform block data to output transform coefficients, and quantize the transform coefficients with a predetermined quantization width to output quantized signals. Quantizing means for outputting the special reproduction block code using the quantized output corresponding to some transform coefficients of the transform coefficients from the orthogonal transform means. The encoding device according to claim 3, wherein the encoding device is created. 5. The normal coding means and the special coding means are orthogonal transformation means for orthogonally transforming block data and outputting transform coefficients, and quantizing the transform coefficients with a predetermined quantization width to quantize and output. And a quantizing means for outputting the special reproducing block code, wherein the special encoding means adds a quantization width different from the quantization width in the quantizing means to the special reproduction block code and outputs it. The encoding device according to claim 3. 6. The normal coding means and the special coding means are orthogonal transformation means for orthogonally transforming block data to output transform coefficients, and quantizing the transform coefficients with a predetermined quantization width to quantize output. And a quantizing means for outputting, wherein the special encoding means prohibits encoding a part of the code of the quantized output corresponding to a block that enables special reproduction display. The encoding device according to claim 3. 7. A normal reproduction block code for normal reproduction for a predetermined block of an image is arranged, and when a special reproduction block code for special reproduction is arranged for a predetermined block of an image, a normal reproduction block code for this block is arranged. Input data in which reproduction block codes are also arranged is input, normal reproduction block code extraction means for extracting the normal reproduction block code, special reproduction block extraction means for extracting the special reproduction block code, and normal reproduction for the same block Reconstructing means for selecting one of the output of the block code extracting means and the output of the special reproduction block extracting means for reconstructing data, and a decoding means for decoding the output of the reconstructing means. A decoding device characterized by.