JPH1132337A - Data structure for transmitting picture and encoding method and decoding method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress the influence of an obstacle on the decoding processing of encoded data at the time of error generation in the middle of transmission by arraying first and second bit columns so that the first bit column can be transmitted prior to the second bit column. SOLUTION: A header bit column Dh, binary bit column D2, moving vector bit column Dgtmv, pixel value bit column Dg, and transmissivity bit column Dt are arrayed in a unit bit stream 1 being the repeating unit of transmission at the time of encoding data for displaying a picture corresponding to an object on a display screen by object units, and transmitting the data so that those bit columns can be repeatedly transmitted in this order. Also, this binary bit column D2 is divided into a binary moving vector bit column D2mv and a binary data bit column D2ot. Those bit columns D2mv and D2ot are arrayed so that the binary moving vector bit column D2mv can be transmitted prior to the other binary bit column D2ot.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data structure for image transmission, an encoding method and an encoding device, a decoding method and an decoding device, and a data storage medium. The present invention relates to a bit stream of image display data encoded based on an international standard for image compression.

[0002]

2. Description of the Related Art In recent years, a multimedia era has been entered in which voice, image, and other data are handled in an integrated manner. Has become a feature of multimedia. Generally, multimedia means not only characters but also graphics, sounds, and especially images, etc. are simultaneously associated with each other. To make the above-mentioned conventional information media the target of multimedia, the information must be expressed in digital form. Is an essential condition.

However, when the information amount of each information medium is estimated as a digital information amount, the amount of information per character is 1-2 bytes in the case of a character, while the amount of information per character is 64 kbits per second in the case of a voice. (Telephone quality), and more than 100 Mbits per second (current television reception quality) for moving images, and the above-mentioned information media is not realistic because it is practical to handle the information in digital form. Things are included. For example,
Videophone is an integrated service digital network (ISDN) having a transmission rate of 64 Kbps to 1.5 Mbps.
ices Digital Network), but it is not possible to send the video from a TV camera directly through ISDN.

Therefore, what is required is an information compression technique. For example, in the case of a videophone, ITU-T
(International Telecommunication Union Telecommunication Standardization Sector) The H.261 standard moving image compression technology is used. Further, according to the information compression technology of the MPEG1 standard, it is possible to store image information together with audio information in a normal music CD (compact disc).

Here, MPEG (Moving Picture Exper)
(ts Group) is an international standard for data compression of moving images, and MPEG1 is a standard for compressing moving image data to 1.5 Mbps, that is, TV signal information to about 1/100. Also, since the transmission speed for the MPEG1 standard is mainly limited to about 1.5 Mbps, the MPE standardized to meet the demand for higher image quality
In G2, the moving image data is compressed to 2 to 15 Mbps. At present, the working group (ISO / IEC JTC1 / SC29 / WG11), which has been working on the standardization of MPEG1 and MPEG2, has been working on very low bit rate AV coding (Very-Low Bit).
MPEG4, which enables Rate Audio-Visual Coding) and realizes new functions, is being standardized.

Hereinafter, an information compression method employed in the MPEG4 standard will be described. First, as the information compression method, first, since the value between adjacent pixels is close (high correlation) in a natural image, a method of compressing information using an intra-screen (spatial) correlation is used. There is. In this information compression method, a discrete cosine transform (DCT) is used.
form) is used as an orthogonal transform, and the value obtained by this transform is subjected to quantization processing.

Second, the image information of the previous screen is stored, and the image information of the current screen is represented by a difference value between the image information of the current screen and the image information of the previous screen. In this method, if the displayed image on the current screen does not change from that on the previous screen, it can be reproduced simply by sending the code of no change. If the image is a part of the display image on the previous screen that has been moved, the image can be reproduced only by sending the movement amount of the image of the moved part as a motion vector.

Further, as a third method, there is a method of performing information compression by utilizing the bias of the code appearance probability when performing encoding by the first and second information compression methods. This method is called entropy coding or variable length coding,
Coefficients (DCT coefficients) and motion vector values after the CT transformation have a bias in their appearance probabilities. Therefore, a short code length is assigned to values having a high appearance rate of these values, and values having a low appearance rate are assigned to the values having a low appearance rate. By assigning a long code length, the average information amount is reduced.

In actual compression of an image signal, intra-coding based on spatial correlation and inter-coding based on temporal correlation are selectively used or used together. When inter-picture coding is performed, a motion (motion vector) in an adjacent picture is detected, and the motion is compensated for the motion.

From a completely different viewpoint from the above-mentioned information compression method, a method has been considered in which an image signal is separated for each object on a display screen, and the shape of each separated object is treated as an arbitrary shape. In this method, images can be manipulated and synthesized in units of objects, which leads to efficient transmission of image information. For example, when this method is used in an application where the number of bits is restricted, it is possible to selectively transmit and record important objects by processing images in units of objects. .

Therefore, in MPEG4, VM7.
0 (described in ISO / IEC JTC1 / SC29 / WG11 MPEG97 / N1642) has been created, and this latest evaluation model can encode image signals corresponding to arbitrary shapes, that is, objects. This is the only image coding method known at present. That is, in MPEG4, the above-described first to first processes are performed on the image display data.
In addition to the processing according to the third information compression method, processing for handling image signals in object units is performed.

More specifically, in MPEG4, an image display signal from a computer includes a normal Y signal (luminance signal), a U signal (B-Y color difference signal), and a V signal for performing color display. The configuration is such that a binary shape signal and a transmittance signal are added to the (RY color difference signal). Here, the Y, U, V signals (hereinafter, referred to as pixel value signals).
Is an image signal for normal color display. The transparency signal corresponds to the transparency of the object;
In other words, a coefficient indicating how much an object having an arbitrary shape blocks an image serving as a background is used. Such a transparency signal is used in computer graphics to process an image signal for each object. Therefore, when the object is superimposed on the background, a superimposition ratio (transparency of the image of the object) is required in addition to the pixel value signal (normal image signal) for performing the color display. Further, the binary shape signal corresponds to each pixel in a predetermined area including an arbitrary shape (a certain object) on the display screen, and the pixel is located inside the arbitrary shape or the arbitrary shape. This signal contains binary data indicating whether the signal is located outside the object. In MPEG4, a signal inside the object needs to be transmitted, but a signal outside the object does not need to be transmitted. Because.

For example, when the shape of the object by computer graphics is the shape of a fish shown in FIG. 7E, image information shown in FIG. 7C can be obtained from the pixel value signal. Also, from the transmittance signal, FIG.
7 (b), the fish-shaped body is opaque and the tail is translucent in the image of FIG. 7 (b). Further, from the binary shape signal, image information indicating the contour of the fish shape shown in FIG. 7A can be obtained. FIG. 7D shows a background image which is superimposed on the shape of the fish. When these are superimposed, a composite image as shown in FIG. 7E is obtained. When there are only two values of the transmittance signal, that is, 0% and 100%, since the binary shape signal and the transmittance signal match, the image signal is converted to the binary shape signal and each pixel. It is represented by corresponding Y, U, V signals, that is, pixel value signals.

The image processing according to the MPEG4 standard has the following advantages over the image processing according to the MPEG2 standard. When compositing computer graphics with ordinary natural images (video from a video camera), the computer graphics data clearly shows the movement of objects on the screen,
It is easy to perform motion compensation for each object, but MPE
In G2, since the image signal is processed in units of one screen, not in units of objects, motion compensation cannot be performed in units of objects. , Motion compensation cannot be performed accurately. In contrast, in MPEG4, since image processing is performed on an object basis, motion compensation can be performed accurately and efficiently.

Next, a method of encoding and transmitting image data in accordance with MPEG4 will be described. First, in the first method, as shown in FIG. 8B, a plurality of regions R (see FIG. 8A) corresponding to an object on the display screen and including the object are arranged in a matrix as shown in FIG. Is divided into 12 blocks (here, 12 blocks), DCT processing and motion compensation are performed on the image in each block, and image display data is transmitted. In this method, data outside the object in each block is discarded during decoding. The block is called a macroblock Mb, and has a size of 16 × 16 pixels. The DCT process is performed in units of an area of 8 × 8 pixels obtained by further dividing the macroblock. From the viewpoint of a decoder (decoding device),
Since the decoding process is simpler, it is specified as an essential item in the MPEG4 standard.

The second method is similar to the first method.
A region R corresponding to an object on the display screen and including the object is divided into twelve macroblocks Mb arranged in a matrix, and an image portion of the object in each macroblock is formed into an image shape. D according to
A CT process is performed. In the second method, as the DCT processing, an optimum one is calculated by calculation every time processing is performed on each block, and the calculated DCT processing is performed on the corresponding macro block. The coding efficiency is good and the image quality is improved. However, this second method is optional in MPEG4.

In any of the methods, image compression (encoding) is performed by motion compensation and DCT processing, and transmission of image display data corresponding to one object is performed by encoding data corresponding to a corresponding block. Is repeatedly transmitted for each unit bit stream Bsu as shown in FIG.

Note that the DCT processing is performed on the pixel value signal and the transmittance signal that constitute the image signal, and the binary coding signal that is included in the image signal is subjected to the arithmetic coding processing. As shown in FIG. 9, first, a header bit string Dh corresponding to the header data of each block is sent. The header data includes information as to whether or not there is image information of an object to be sent to the block, and coding processing of a binary shape signal corresponding to each block, which is either intra-screen coding or inter-screen coding. And the information that was taken.

Subsequent to the header bit string Dh, a binary shape bit string D2 obtained by encoding the binary shape signal of each block
Send. The binary shape signal includes binary data corresponding to each pixel in the block and indicating whether each pixel is located inside or outside the image shape of the object.

Following the binary shape bit string D2, a motion vector bit string Dgtmv corresponding to the motion vector for the pixel value signal and the transparency signal is sent. Here, this motion vector is set for each block, and a maximum of 4
One motion vector can be sent.

Further, following the motion vector bit string Dgtmv, a transparency bit string Dt obtained by coding a transmittance signal for each pixel in each block, and a pixel value obtained by coding a pixel value signal for each pixel in each block. The bit string Dg is sequentially sent. Then, the transmission destination decodes these bit strings to generate a binary shape signal, a transmittance signal, and a pixel value signal, and displays an image of the object based on these signals.

[0022]

By the way, the unit bit stream shown in FIG. 9 may be data corresponding to one to four macroblocks as well as data corresponding to one macroblock. That is, each bit string D
When h, D2, Dgtmv, Dt, and Dg are data obtained by encoding data corresponding to one macroblock, or when these bit strings are, for example, one horizontal row in a region R shown in FIG. May be encoded data corresponding to the macroblock (four macroblocks).

However, in any case, if an error occurs during the transmission of one unit bit stream, data subsequent to the error occurrence position in this unit bit stream cannot be decoded at all. For example, if an error occurs during the transmission of the pixel value bit string Dg or the transparency bit example Dt, since the header bit string Dh to the motion vector bit string Dgtmv of the pixel value signal and the transparency signal are transmitted normally. At the transmission destination, the shape of the object can be temporarily displayed based on the header bit string Dh, the binary shape bit string D2, and the motion vector bit string Dgtmv, but the motion vector bit string Dgtmv
If an error occurs during the transmission of the binary bit stream D2 or during transmission of the binary bit stream D2, the image of the object can hardly be displayed on the receiving side, and the macroblock corresponding to the unit bit stream in which the error has occurred. There is a problem that the image inside is lost.

In recent years, a data structure for image transmission corresponding to a transmission line in which a transmission error easily occurs has been proposed. As shown in FIG. 10 (a), this data structure is an image obtained by encoding image display data corresponding to a region (hereinafter also referred to as an object region) R 'corresponding to one object for each macroblock. Encoded data,
Macro block slices (slice areas) S1, S2,
... The structure is arranged for each group. Here, the macroblock slice corresponds to the object area R '.
Is an area composed of four macroblocks arranged in the order of the encoding process in the macroblock slice S1. Specifically, as shown in FIG.
B1 to MB4, and the macroblock slice S2 includes macroblocks MB5 to MB8.

FIG. 10B shows the object area R '.
And a unit bit stream Bsu corresponding to the macroblock slice S1.
1 is shown.

In the bit stream Bsr corresponding to the object area R ', following the synchronizing signal Dsyn corresponding to the object area R, unit bit streams Bsu1, Bsu2 corresponding to each macroblock slice S1, S2,. Are arranged. That is, following the synchronization signal Dsyn, the slice header bit string Dhs corresponding to the header of each macroblock slice
, Dhs2, ... and coded data Ds1, Ds2, ... corresponding to each macroblock slice are sequentially arranged.

In the unit bit stream Bsu1 corresponding to the macroblock slice S1, a slice header bit string Dhs1 corresponding to the macroblock slice S1 and 4 constituting the macroblock slice S1
MB position bit string Dbp, binary shape bit string D2, texture type bit string Dt of one macroblock
y, motion vector bit string Dgtmv, resynchronization signal Drsy
n, a pixel value DC component bit sequence Dgd, and a pixel value AC component bit sequence Dga are arranged in this order.

Here, the MB position bit string Dbp is:
It is a bit string (in the figure, written as MB position) as position information indicating the position of each macroblock from the beginning of the macroblock slice S1, and the binary shape bit string D2
Is coded data corresponding to the binary shape signal of each macroblock (in the figure, described as a binary shape), and the texture type bit string Dty indicates that each macroblock is an inter-block (inter-frame predictive encoding process is performed). Was done)
Or an intra block (in which an intra-screen encoding process has been performed), a bit string as information indicating
Texture Type). The motion vector bit sequence Dgtmv is a bit sequence (described as MV in the figure) as motion vector information of each macroblock, and is obtained by encoding a motion vector obtained from the pixel value signal. Further, the resynchronization signal Drsyn is a signal for detecting a position in the unit bit stream Bsu1. The pixel value bit strings Dgd and Dga are obtained by encoding pixel value signals in each macroblock, respectively. The pixel value DC component bit string Dgd is converted into a pixel value signal corresponding to each macroblock by a spatial domain. Of a plurality of transform coefficients obtained by performing a conversion process of transforming the data of FIG. 2 into frequency domain data (in the figure, referred to as pixel value DC component), and a pixel value AC component bit string Dga Is a variable-length coded version of the AC component of the plurality of transform coefficients (described as a pixel value AC component in the figure).

The unit bit stream Bsu corresponding to the other slice areas S2,... Included in the bit stream Bur corresponding to the object area R '.
Have the same data structure as the unit bit stream Bsu1.

Since the unit bit streams Bsu1, Bsu2,... Having such a data structure include the resynchronization signal Drsyn, the decoding process of the encoded data sent before the resynchronization signal is completed. If a resynchronization signal is detected at the time, it can be detected that data transmission has been performed without error, and even if a transmission error occurs before the resynchronization signal, if the resynchronization signal can be detected, It becomes possible to decode the encoded data from the resynchronization signal to the position where the previous transmission error occurred.

By the way, in the proposed data structure for image transmission corresponding to a transmission path in which a transmission error is likely to occur (see FIG. 10 (a)), the arrangement of the encoded data corresponding to the transparency signal is not described. Nothing is shown. Here, the coded data corresponding to the transmittance signal includes the transmittance DC component bit sequence Dtd and the transmittance AC component bit sequence Dta similarly to the coded data for the pixel value signal, and the transmittance DC component bit sequence Dtd. Is a variable-length coded DC component of a plurality of transform coefficients obtained by performing a transform process for transforming spatial domain data into frequency domain data on a transparency signal corresponding to each macroblock (FIG. In the figure, a transmittance DC component) and a transmittance AC component bit string Dta are obtained by performing variable-length coding on an AC component of the plurality of transform coefficients (described as a transmittance AC component in the figure).

Therefore, as a data structure including a transparency bit string, from the viewpoint that the transparency signal is subjected to the same encoding processing as the pixel value signal, for example, the data structure of the unit bit stream Bsu1 includes a pixel structure. A data structure in which a transmittance DC component bit sequence Dtd is arranged between the value DC component bit sequence Dgd and the resynchronization signal Drsyn, and a transmittance AC component bit sequence Dta is arranged between the pixel value DC component bit sequence Dgd and the pixel value AC component bit sequence Dga. (Figure 1
0 (c)).

However, in the unit bit stream Bsut1 having the data structure shown in FIG. 10C, if a transmission error occurs in the portion of the transparency DC component bit sequence Dtd, the transmission starts from the last end of the pixel value AC component bit sequence Dga. A process of detecting transmission data by following the bit string to the position where the error occurs is performed.
a and the pixel value DC component bit sequence Dgd, there is a transmittance AC component bit sequence Dta.
There is a problem that it takes time to reach the bit string Dgd of the pixel value DC component, which is important data.

The present invention has been made in order to solve the above-described problems. Even if an error occurs during the transmission of encoded data for image display data, the image display quality at the transmission destination deteriorates. , An encoding method and an encoding device capable of generating encoded data of the image transmission data structure, and decoding of the encoded data of the image transmission data structure. Decoding method and decoding device capable of
It is an object of the present invention to obtain a transmission data storage medium storing a program for performing processing by an encoding and decoding method, or storing encoded data having the above-described image transmission data structure.

Further, according to the present invention, even when an error occurs during the transmission of encoded data for image display data, it is possible to avoid as much as possible to interfere with decoding of important encoded data at the transmission destination. In this case, an image transmission data structure capable of performing a decoding process of important encoded data in a short time, and an encoding method capable of generating encoded data of the image transmission data structure. A method and a coding device, a decoding method and a decoding device capable of decoding coded data of the image transmission data structure, and a program for performing processing by the coding and decoding method. Alternatively, it is another object of the present invention to obtain a transmission data storage medium storing encoded data having the image transmission data structure.

[0036]

An image transmission data structure according to the present invention (claim 1) is obtained by encoding image display data corresponding to each object displayed on a display screen for each object. A data structure for transmitting image encoded data to be transmitted, wherein each pixel corresponds to each pixel in a predetermined area including the corresponding object on the display screen, and the pixel is located inside the object or A binary shape bit string obtained by encoding a binary shape signal indicating whether or not it is located outside is included as a part of the image encoded data,
A first bit string obtained by encoding a motion vector information indicating the motion of the object on the display screen, obtained from the binary shape signal, from the value shape bit string, and the motion vector information obtained by encoding the binary shape signal into the motion vector And a second bit sequence obtained by encoding based on information, wherein the first and second bit sequences are arranged such that the first bit sequence is transmitted before the second bit sequence. It is.

According to a second aspect of the present invention, in the image transmission data structure according to the first aspect, the predetermined area including the object on the display screen is divided into a plurality of blocks, and the first bit string is divided into a plurality of blocks. , The motion vector information obtained from the binary shape signal is obtained by encoding the motion vector information corresponding to a predetermined number of adjacent blocks among the plurality of blocks, and the second bit string is The value shape signal is obtained by encoding a value corresponding to a predetermined number of adjacent blocks among the plurality of blocks based on the motion vector information.

According to a third aspect of the present invention, in the image transmission data structure according to the first aspect, in addition to the binary shape bit string, each of the pixels constituting the corresponding object on the display screen is corresponded. A transparency bit string obtained by encoding a transparency signal corresponding to the transparency of the image of the object, and corresponding to each pixel constituting the corresponding object on the display screen,
A pixel value bit string obtained by encoding a pixel value signal for displaying the object as an image, and the pixel value signal and the transparency signal, which are common and are obtained by at least the pixel value signal of the two signals, A motion vector indicating a motion on a display screen, a motion vector bit sequence obtained by encoding, and a header bit sequence obtained by encoding relevant information related to each of the bit sequences, as a part of the image encoded data. Each of the bit strings is arranged so that a binary shape bit string, a motion vector bit string, a pixel value bit string, and a transparency bit string are transmitted in this order following the header bit string transmitted first.

The image transmission data structure according to the present invention (claim 4) is characterized in that encoded image display data obtained by encoding image display data corresponding to each object displayed on the display screen for each object. An image transmission data structure for transmission, which corresponds to each pixel in a predetermined area including the corresponding object on the display screen, and determines whether the pixel is located inside the object or outside the object. A binary shape bit string obtained by encoding the binary shape signal shown in FIG. 2 and a transparency signal corresponding to the transparency of the image of the object corresponding to each pixel constituting the object on the display screen are encoded. And a pixel value bit string obtained by encoding a pixel value signal corresponding to each pixel configuring the corresponding object on the display screen and displaying a color of the object. Including as part of the image coded data,
The bit strings are arranged such that the transparency bit string is transmitted after the binary shape bit string and the pixel value bit string.

According to a fifth aspect of the present invention, in the data structure for image transmission according to the fourth aspect, a predetermined area including the corresponding object on the display screen is divided into a plurality of blocks,
The binary shape bit string is formed by encoding the binary shape signal by an amount corresponding to a predetermined number of adjacent blocks among the plurality of blocks. The pixel value bit string is converted to the pixel value signal by a predetermined number of adjacent predetermined numbers of the plurality of blocks. This is obtained by encoding only the amount corresponding to the block.

According to a sixth aspect of the present invention, in the data structure for image transmission according to the fourth aspect, in addition to each of the bit strings, the pixel value signal and the transparency signal are common to at least the pixel of the two signals. A motion vector indicating the motion of the object on the display screen, obtained from the value signal, includes a motion vector bit sequence obtained by encoding as a part of the image encoded data, and the binary shape bit sequence includes:
A first bit string obtained by encoding motion vector information indicating the motion of the object on the display screen obtained from the binary shape signal, and a binary bit signal obtained by encoding the binary shape signal based on the motion vector information. And a second bit sequence obtained by converting the motion vector bit sequence into the bit sequence after transmitting the first bit sequence.
Thereafter, the second bit string is arranged to be transmitted.

The encoding method according to the present invention (claim 7) encodes image display data corresponding to each object displayed on a display screen for each object and outputs image encoded data. A method, corresponding to each pixel in a predetermined area including the object on the display screen, including binary data indicating whether the pixel is located inside the object or outside the object. A motion detection process for detecting a motion vector indicating a motion of the object on the display screen based on the shape signal;
And generating a second bit string by encoding the binary data forming the binary shape signal based on the motion vector. The bit sequence is arranged so as to be transmitted before the second bit sequence, and is output as a part of the image encoded data.

The encoding method according to the present invention (claim 8) encodes image display data corresponding to an individual object displayed on a display screen for each object and outputs image encoded data. A binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen and indicating whether the pixel is located inside the object or outside the object, And generating a binary shape signal bit string, and encoding a pixel value signal corresponding to each pixel constituting the corresponding object on the display screen for displaying the object in color, thereby forming a pixel value bit string. Generating, and corresponding to each pixel constituting the corresponding object on the display screen, including a process of encoding a transparency signal corresponding to the transparency of the image of the object, to generate a transparency bit string, Each bit above Column, translucent excessive bit string above 2
It is arranged so as to be transmitted after the value shape bit string and the pixel value bit string, and is output as a part of the image encoded data.

An encoding apparatus according to the present invention (claim 9) encodes image display data corresponding to an individual object displayed on a display screen for each object and outputs image encoded data. An apparatus, which corresponds to each pixel in a predetermined area including a corresponding object on the display screen and includes binary data indicating whether the pixel is located inside the object or outside the object. A motion detector that detects a motion vector indicating a motion of the object on the display screen based on the shape signal; a first encoder that encodes the motion vector to generate a first bit string; A second encoding means for encoding the binary data constituting the binary shape signal based on the motion vector to generate a second bit string, wherein the first bit string is a second bit string. From the bit string of It is arranged to be transmitted to, and outputs it as a part of the image coding data.

An encoding apparatus according to the present invention (invention 10) encodes image display data corresponding to an individual object displayed on a display screen for each object and outputs image encoded data. A binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen, the signal indicating whether the pixel is located inside the object or outside the object; A binary shape encoding means for generating a binary shape signal bit string by encoding a pixel value signal for color-displaying the object corresponding to each pixel constituting the object on the display screen; Pixel value encoding means for generating a pixel value bit string, and a transparency signal corresponding to the transparency of an image of the object corresponding to each pixel constituting the object on the display screen, and Generate bit string And a coded transparency means that, by arranging so that each of the above-mentioned bit string translucent excessive bit sequence is transmitted after the above binary shape bit streams and the pixel value bit streams,
It is output as a part of the above-mentioned coded image data.

A decoding method according to the present invention (claim 11) is a decoding method for decoding image encoded data corresponding to each object, which is obtained by the encoding method according to claim 7. A process of decoding a first bit sequence to generate a motion vector obtained from the binary shape signal; and a process of decoding the second bit sequence based on the motion vector to form the binary shape signal. Reproducing the image display data corresponding to each object displayed on the display screen, including a process of generating value data and a process of generating the binary shape signal based on the motion vector and the binary data. Is what you do.

A decoding method according to the present invention (claim 12) is a decoding method for decoding image encoded data corresponding to each object obtained by the encoding method according to claim 8; A process of decoding the binary shape bit sequence to generate the binary shape signal, a process of decoding the pixel value bit sequence to generate the pixel value signal, and a process of decoding the transparency bit sequence to generate And reproducing the image display data corresponding to each object displayed on the display screen based on each of the generated signals.

[0048] A decoding device according to the present invention (claim 13) is a decoding device for decoding image encoded data corresponding to each object obtained by the encoding method according to claim 7; First decoding means for decoding a first bit string to generate a motion vector obtained from the binary shape signal; and decoding the second bit string based on the motion vector to obtain the binary shape signal. A second decoding unit for generating binary data constituting the signal; and a third decoding unit for generating the binary shape signal based on an output of each of the decoding units. The reproduction of the image display data corresponding to the individual objects displayed in.

[0049] A decoding device according to the present invention (claim 14) is a decoding device for decoding image coded data corresponding to each object, which is obtained by the coding method according to claim 8; A binary shape decoding means for decoding the binary shape bit string to generate the binary shape signal, a pixel value decoding means for decoding the pixel value bit string to generate the pixel value signal, and the transparency bit string And a transparency decoding means for generating the transparency signal by decoding the data, and reproducing the image display data corresponding to the individual object displayed on the display screen based on the output of each of the decoding means. Is what you do.

[0050] The data storage medium according to the present invention (claim 15) performs an encoding process of encoding image display data corresponding to each object displayed on a display screen and outputting encoded image data. A data storage medium storing a program to be executed by the computer. Processing for detecting a motion vector indicating a motion of the object on the display screen based on a binary shape signal including binary data indicating whether the object is located outside the object.
A process of encoding the motion vector to generate a first bit sequence, a process of encoding binary data forming the binary shape signal based on the motion vector to generate a second bit sequence, and The bit sequence is arranged so that the first bit sequence is transmitted before the second bit sequence, and a process of outputting as a part of the image encoded data is performed.

The data storage medium according to the present invention (claim 16) performs an encoding process of encoding image display data corresponding to an individual object displayed on a display screen and outputting encoded image data. A data storage medium storing a program to be executed by the computer, wherein the program causes the computer to correspond to each pixel in a predetermined area including the corresponding object on the display screen, and the pixel is located inside the object. Encoding a binary shape signal indicating whether the object is located outside the object or a binary shape signal, and displaying the object in color corresponding to each pixel constituting the object on the display screen. For generating a pixel value bit string by encoding a pixel value signal for transmitting the image of the object corresponding to each pixel constituting the object on the display screen. Encoding the transparency signal corresponding to the above, and arranging each of the bit strings so that the transparency bit string is transmitted after the binary shape bit string and the pixel value bit string; The configuration is such that a process of outputting as a part of the encoded data is performed.

A data storage medium according to the present invention (claim 17) decodes encoded image data corresponding to individual objects displayed on a display screen, obtained by the encoding method according to claim 7. A data storage medium storing a program to be executed by a computer,
The program causes a computer to decode the first bit string to generate a motion vector obtained from the binary shape signal, and to decode the second bit string based on the motion vector, The configuration is such that a process of generating binary data constituting the value shape signal and a process of reproducing the binary shape signal based on the motion vector and the binary data are performed.

According to the data storage medium of the present invention (claim 18), a decoding process for image coded data corresponding to each object displayed on a display screen, which is obtained by the coding method according to claim 8, Is a data storage medium storing a program to be executed by a computer, the program causing the computer to decode the binary shape bit sequence to generate the binary shape signal, and to decode the pixel value bit sequence. And a process for generating the pixel value signal and a process for decoding the transparency bit string to generate the transparency signal.

The data storage medium according to the present invention (claim 19) stores encoded image data obtained by encoding image display data corresponding to each object displayed on the display screen for each object. A data storage medium, wherein the image-encoded data corresponds to each pixel in a predetermined area including a corresponding object on the display screen, and whether the pixel is located inside the object or outside the object. And a motion vector indicating the motion of the object on the display screen obtained from the binary shape signal. A first bit string obtained by encoding information, and a second bit string obtained by encoding the binary shape signal based on the motion vector information.
And the second bit string is arranged so that the first bit string is transmitted before the second bit string.

A data storage medium according to the present invention (claim 20) stores image encoded data obtained by encoding image display data corresponding to each object displayed on a display screen for each object. A data storage medium, wherein the image-encoded data corresponds to each pixel in a predetermined area including a corresponding object on the display screen, and whether the pixel is located inside the object or outside the object. A binary shape bit string obtained by encoding a binary shape signal indicating the following, and a transparency signal corresponding to the transparency of an image of the object corresponding to each pixel constituting the corresponding object on the display screen are encoded. And a pixel value bit string obtained by encoding a pixel value signal corresponding to each pixel constituting the relevant object on the display screen and displaying a color of the object. , The respective bit sequence in which the transparent excessive bit string has a configuration in which sequences to be transmitted after the above binary shape bit streams and the pixel value bit streams.

An image transmission data structure according to the present invention (claim 21) is provided for each block for dividing the predetermined area into image display data corresponding to a predetermined area including an individual object displayed on a display screen. A data structure for image transmission for collectively transmitting image encoded data obtained by performing encoding processing on each slice area composed of a predetermined number of blocks arranged in the order of the encoding processing. A binary shape bit string obtained by encoding a binary shape signal corresponding to each pixel in a predetermined area including the corresponding object, and indicating whether the pixel is located inside the object or outside the object. A transparency bit string obtained by encoding a transparency signal indicating the transparency of the object corresponding to each pixel constituting the corresponding object on the display screen, and a corresponding object on the display screen. A pixel value bit string obtained by encoding a pixel value signal for color-displaying the object corresponding to each pixel to be included, as a part of the image encoded data, and a head position of the pixel value bit string. The pixel value synchronization signal and the transparency synchronization signal indicating the head position of the transparency bit sequence are included as a part of the image encoded data, and the pixel value bit sequence and the transparency bit sequence are respectively followed by the corresponding synchronization signals. They are arranged to be transmitted.

According to a twenty-second aspect of the present invention, in the data structure for image transmission according to the twenty-first aspect, the pixel value synchronization signal and the pixel value bit string are transmitted subsequent to the transparency synchronization signal and the transparency bit string. , These synchronization signals and bit strings are arranged.

According to a twenty-third aspect of the present invention, in the data structure for image transmission according to the twenty-first aspect, the transparency synchronization signal and the transparency bit string are transmitted following the pixel value synchronization signal and the pixel value bit string. , These synchronization signals and bit strings are arranged.

According to the encoding method of the present invention (claim 24), a code for each block dividing the predetermined area is divided into image display data corresponding to a predetermined area including an individual object displayed on a display screen. Encoding processing for generating encoded image data by performing encoding processing, and outputting the encoded image data collectively for each slice area including a predetermined number of blocks arranged in the encoding processing order. A binary shape signal corresponding to each pixel in a predetermined area including the corresponding object and indicating whether the pixel is located inside the object or outside the object is encoded to generate a binary shape signal bit string. A process of generating a pixel value bit string by encoding a pixel value signal corresponding to each pixel configuring the corresponding object on the display screen and displaying a color of the object, The appropriate corresponding to each pixel constituting an object, a transparency signal indicating the transparency of the object image,
Encoding and generating a transparency bit string; and generating a pixel value synchronization signal indicating a head position of the pixel value bit string and a transparency synchronization signal indicating a head position of the transparency bit string. And the transparency bit string,
These bit strings are arranged so as to be transmitted following the corresponding synchronizing signal, and are output as a part of the above-mentioned coded image data.

The encoding apparatus according to the present invention (claim 25) encodes image display data corresponding to a predetermined area including an individual object displayed on a display screen for each block dividing the predetermined area. Encoding apparatus for generating encoded image data by performing encoding processing, and outputting the encoded image data collectively for each slice area including a predetermined number of blocks arranged in the encoding processing order. A binary shape signal corresponding to each pixel in a predetermined area including the corresponding object and indicating whether the pixel is located inside the object or outside the object is encoded to form a binary shape signal bit string. And a pixel value for encoding a pixel value signal for color-displaying the object corresponding to each pixel constituting the object on the display screen to generate a pixel value bit string. Encoding means, corresponding to each pixel constituting the corresponding object on the display screen, a transparency signal indicating the transparency of the object, encoding the transparency encoding means to generate a transparency bit sequence, A synchronizing signal generating means for generating a pixel value synchronizing signal indicating a head position of the pixel value bit string and a transparency synchronizing signal indicating a head position of the transparency bit string, wherein the pixel value bit string and the transparency bit string are They are arranged and output so as to be transmitted following the corresponding synchronization signals.

According to a decoding method of the present invention (claim 26), encoded image data corresponding to a predetermined area including individual objects displayed on a display screen, obtained by the encoding method according to claim 24, is provided. A decoding method for performing a decoding process for each block that divides the predetermined region, wherein the process of decoding the binary shape bit sequence to generate the binary shape signal; Detecting from the encoded image data based on the pixel value synchronization signal corresponding to the above, decoding the detected pixel value bit string to generate the pixel value signal, and transmitting the transparency bit string to the corresponding transmission Detecting from the encoded image data based on the degree synchronization signal and decoding the detected degree of transmission bit sequence to generate the degree of transmission signal, based on each of the generated signals, It is intended to reproduce the image display data corresponding to an individual object displayed on the screen.

A decoding apparatus according to a twenty-seventh aspect of the present invention provides an image encoding apparatus comprising: A decoding device for performing a decoding process for each block dividing the predetermined area, wherein the first decoding means decodes the binary shape bit string to form the binary shape signal; A second decoding means for detecting a value bit sequence from the encoded image data based on a corresponding pixel value synchronization signal, and decoding the detected pixel value bit sequence to form the pixel value signal; A third decoding means for detecting a transparency bit sequence from the image encoded data based on the corresponding transparency synchronization signal, and decoding the detected transparency bit sequence to form the transparency signal; Preparation On the basis of the output of the respective decoding means, and generates an image display data corresponding to an individual object displayed on the display screen.

According to the data storage medium of the present invention (claim 28), the code for each block dividing the predetermined area is divided into image display data corresponding to a predetermined area including an individual object displayed on the display screen. A program for performing, by a computer, a process of generating encoded image data by performing an encoding process and outputting the encoded image data collectively for each slice region including a predetermined number of blocks arranged in the encoding process order Data storage medium, wherein the program causes the computer to correspond to each pixel in a predetermined area including the corresponding object on the display screen, and the pixel is located inside the object or located outside the object. 2 to indicate
Encoding the value shape signal to form a binary shape bit string, encoding the pixel value signal corresponding to each pixel constituting the corresponding object on the display screen, and displaying the object in color. A process of forming a pixel value bit string, corresponding to each pixel constituting a corresponding object on the display screen,
A process of encoding a transparency signal indicating the transparency of the object to form a transparency bit string, and a pixel value synchronization signal indicating a head position of the pixel value bit string and a transparency synchronization signal indicating a head position of the transparency bit string. It is configured to perform a process of generating and a process of arranging and outputting the pixel value bit string and the transparency bit string so that these bit strings are transmitted subsequent to the corresponding synchronization signals.

A data storage medium according to the present invention (claim 29) is obtained by the encoding method according to claim 24.
A data storage medium storing a program for causing a computer to perform a process of decoding image encoded data corresponding to a predetermined region including an individual object displayed on the display screen for each block dividing the predetermined region. A program for causing a computer to decode the binary shape bit sequence to form the binary shape signal; and to encode the pixel value bit sequence based on the corresponding pixel value synchronizing signal into the image encoding. Processing for detecting from the data, decoding the detected pixel value bit sequence to form the pixel value signal, and detecting the transparency bit sequence from the image encoded data based on the corresponding transparency synchronization signal. Then, a process of decoding the detected transparency bit string to form the transparency signal is performed.

According to the data storage medium of the present invention (claim 30), the code for each block dividing the predetermined area is divided into image display data corresponding to a predetermined area including an individual object displayed on the display screen. A data storage medium storing image encoded data obtained by performing the image processing, wherein the image encoded data corresponds to each pixel in a predetermined area including a corresponding object on the display screen, A binary shape bit string obtained by encoding a binary shape signal indicating whether a pixel is located inside the object or outside the object corresponds to each pixel constituting the object on the display screen. A transparency bit string obtained by encoding a transparency signal indicating the transparency of the object, and a pixel value signal for color-displaying the object corresponding to each pixel constituting the object on the display screen. And a pixel value bit string obtained by encoding as a part of the image encoded data, and a pixel value synchronization signal indicating a head position of the pixel value bit string and a transparency synchronization signal indicating a head position of the transparency bit string. A signal is included as a part of the encoded image data, and the pixel value bit string and the transparency bit string are arranged so as to be transmitted following the corresponding synchronization signal.

[0066]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First, the viewpoint and basic principle of the present invention will be described. The present inventor has set that a binary shape signal set for each pixel in a predetermined area including an object on the display screen indicates whether each pixel is located inside the object or outside the object. Can generate a motion vector indicating the motion of the object between the current screen and the previous screen from the binary shape signal, and reproduce the image shape of the object to some extent by the motion vector related to the binary shape signal. Focusing on the fact that the motion vector can be decoded, the present inventors have invented an image transmission data structure capable of decoding the motion vector as little as possible by transmission errors.

The image transmission data structure according to the present invention is as follows.
The binary shape signal is divided into motion vector information obtained from the binary shape signal and binary data constituting the binary shape signal, and a first bit string obtained by encoding the motion vector information is represented by:
These bit strings are arranged so as to be transmitted before the second bit string obtained by encoding the binary data.

The inventor of the present invention has proposed that the encoding of the image display data of an object is performed in units of blocks obtained by dividing a predetermined area including a certain object on the display screen into a plurality of blocks. It has been invented that transmission data for a predetermined number of blocks can be transmitted collectively, and by performing such transmission, the influence of transmission errors on reproduced image quality can be reduced. The image transmission data structure according to the present invention is characterized in that the first bit string is obtained by encoding motion vector information relating to a binary shape signal by an amount corresponding to a predetermined number of blocks, Are obtained by encoding the binary data constituting the binary shape signal by an amount corresponding to a predetermined number of blocks based on the motion vector.

Further, when the present inventor decodes the encoded image display data (image encoded data) and displays the image, in order to maintain the image quality, the present invention corresponds to the transparency of the image of the object. It is noted that the pixel value signal for displaying an object in color is more important than the transmittance signal, and M
In consideration of compatibility with MPEG1 and MPEG2 in PEG4, it has been invented that the transmission order in which the encoded data of the transparency signal is transmitted prior to the encoded data of the pixel value signal is changed. The image transmission data structure according to the present invention is arranged such that the pixel value bit sequence obtained by encoding the pixel value signal and the transparency bit obtained by encoding the transparency signal are transmitted before the pixel value bit sequence is transmitted. They are arranged.

Further, the present inventor has proposed a data structure for transmitting coded image display data (image coded data) for each macroblock slice, which has recently been proposed. Since the resynchronization signal corresponding to the pixel value bit sequence is arranged immediately before the pixel value bit sequence to be executed, even when a transmission error occurs before the resynchronization signal, the resynchronization signal is transmitted from the resynchronization signal to the position where the transmission error occurs. Paying attention to the fact that encoded data can be detected, the present inventors have invented a data structure capable of avoiding hindrance to decoding of important encoded data as much as possible even when a transmission error occurs.

The data structure for image transmission according to the present invention is as follows.
The resynchronization signal corresponding to the transparency bit sequence and the resynchronization signal and the bit sequence that follow the resynchronization signal are transmitted immediately after the pixel value bit sequence or immediately before the resynchronization signal corresponding to the pixel value bit sequence. Is arranged.

Hereinafter, embodiments of the present invention will be described. Embodiment 1 FIG. FIG. 1 is a diagram for explaining a data structure for image transmission according to the first embodiment of the present invention. In the figure, reference numeral 1 denotes a case in which image display data corresponding to an object on a display screen is encoded and transmitted in object units,
This is a unit bit stream that is a transmission repeating unit.

The unit bit stream 1 includes a header bit string Dh, a binary shape bit string D2, a motion vector bit string Dgtmv, a pixel value bit string Dg, and a transparency bit string Dt.
Are arranged such that these bit strings are repeatedly transmitted in this order. Also, the binary shape bit string D2
Are divided into a binary shape motion vector bit sequence D2mv and a binary data bit sequence D2ot.
2mv and D2ot are the binary motion vector bit sequence D
2mv is arranged to be transmitted before the other bit string D2ot of the binary shape.

The binary shape bit string D2 is set for each pixel in a predetermined area including the corresponding object on the display screen, and indicates whether the pixel is located inside the object or outside the object. This is encoded data obtained by encoding a binary shape signal. The binary shape motion vector bit sequence D2mv is encoded data obtained by encoding motion information (motion vector information) related to the binary shape signal, and the binary data bit sequence D2ot is included in the binary shape signal. This is encoded data obtained by encoding binary data based on the motion vector.

The transparency bit string Dt is coded data obtained by coding a transparency signal corresponding to each pixel constituting the object on the display screen and corresponding to the transparency of the image of the object. The pixel value bit string Dg is encoded data obtained by encoding a pixel value signal corresponding to each pixel constituting the object on the display screen for displaying the object in color. Further, the motion vector bit string Dgtmv is obtained by encoding a motion vector indicating the motion of the object on the display screen, which is common to the pixel value signal and the transparency signal, obtained from the pixel value signal. The header bit string Dh is encoded data obtained by encoding relevant information related to each bit string.

Here, the encoding process of the binary shape signal, the inter-screen signal, and the transparency signal is performed for each macro block dividing the object area corresponding to the object, and the unit bit stream 1 is divided into a predetermined number of macro blocks. Each of the corresponding bit strings Dh, D2, Dgtmv, Dg, Dt. The header bit string Dh contains information (intra-inter information) indicating whether the binary shape bit string D2 for each macroblock is obtained by the inter-screen coding processing or the intra-screen coding processing. )It is included.

FIG. 2 is a diagram conceptually showing encoding and decoding processing in the system for handling the data structure for image transmission according to the first embodiment. In the figure, 100 is MPEG4
A transmission system for transmitting an image display signal according to the first embodiment of the present invention, which receives an image display signal from a different image data supply source such as a camera (imaging device) or a computer, and An encoding device 100a that performs an encoding process on a macroblock basis, further multiplexes and transmits the data, and receives transmission data from the encoding device 100a and separates the data into image encoded signals corresponding to respective image data supply sources And a decoding device 100b that performs a decoding process for each macroblock and synthesizes the decoded image data.

The encoding device 100a includes an encoding circuit 110a for encoding display data of a LOGO image A, which is a display object to be displayed on a display screen, created by computer graphic processing, and a computer graphic processing. Encoding circuit 110b for encoding display data of a fish image B, which is a display object to be displayed on the display screen, and display data of a background image C which is a video from a camera (imaging device). And an encoding circuit 110c for encoding. Also,
The encoding device 100a includes encoding circuits 110a to 110a-1.
The multiplexing unit 120 has a multiplexing unit 120 that multiplexes the data encoded in 10c, and outputs the data multiplexed by the multiplexing unit 120.

The decoding device 100b includes a separation processing section 130 for separating transmission data from the coding device 100a into image coded signals corresponding to respective image data supply sources, and a separated image A, image B, It has decoding circuits 140a to 140c for decoding encoded data corresponding to the image C, and a synthesizing unit 150 for synthesizing the decoded data of the images A, B, and C.

FIG. 3 shows each of the encoding circuits 110a-110.
3 shows a specific circuit configuration of c. Each encoding circuit includes an encoding unit 10 for the binary shape signal S2, an encoding unit 20 for the transmittance signal St, and an encoding unit 3 for the pixel value signal Sg.
0. The binary shape signal encoding unit 10 receives a binary shape signal corresponding to the image of each of the objects, and detects a binary shape motion detection circuit 11 for detecting motion information (binary shape motion vector) related to the signal. A binary shape motion compensation circuit 12 for receiving the detection output and performing motion compensation, and a binary shape signal S2 for receiving the binary shape signal S2 and based on the output of the motion compensation circuit 12, Binary data) S2, and a binary shape encoding circuit 14 for performing arithmetic coding processing and outputting the intra / inter information. The encoding unit 10 further includes a variable-length encoding circuit 16 for performing variable-length encoding on the binary shape motion vector, and a variable-length It has a variable length coding circuit 17 for coding and a variable length coding circuit 18 for variable length coding the binary shape signal generated by the coding circuit 14.

In the encoding unit 10, the binary shape signal encoded by the binary shape encoding circuit 14 is decoded and stored in the motion compensation memory 13. The decoded binary shape signal in the memory is output to the binary shape motion detecting circuit 11 and the binary shape motion compensating circuit 12, and is used for the motion detecting process and the motion compensating process. Further, in the encoding unit 10, the switch 15 for controlling the output of the motion vector (binary shape motion vector) related to the binary shape signal from the binary shape motion detection circuit 11 is provided by the switch 15.
And the variable length encoding circuit 16. The switch 15 is controlled to open and close by the binary shape coding circuit 14 based on the intra / inter information so that the switch is turned ON only when the coding process for each macroblock is an inter-screen coding process. I have.

The encoding unit 30 for the pixel value signal Sg receives the pixel value signal Sg corresponding to the image of each object and the decoded output of the encoded binary shape signal.
A pixel value motion detection circuit 31 for detecting motion information on a pixel value signal as a motion vector (pixel value / transparency motion vector) for a pixel value signal and a transparency signal, and a pixel value motion for receiving the detection output and performing motion compensation Compensation circuit 3
2, a pixel value which receives the pixel value signal Sg, performs a DCT transform on the pixel value signal Sg based on the decoded output of the binary shape signal and the output of the motion compensation circuit 32, and further quantizes the pixel value signal Sg. And an encoding circuit 34. further,
The encoding unit 30 further performs variable length encoding on the pixel value / transmittance motion vector in a variable length encoding circuit 36 and the pixel value signal encoded by the encoding circuit 34. It has a variable length coding circuit 35.

In the encoding unit 30, the pixel value signal encoded by the pixel value encoding circuit 34 is decoded and stored in the motion compensation memory 33. The decoded pixel value signal in the pixel 33 is supplied to the pixel value motion detection circuit 31 and the pixel value motion compensation circuit 32.
And is used for motion detection processing and motion compensation processing.

The encoding unit 20 for the transparency signal St includes a transparency motion compensation circuit 22 that receives the output of the pixel value motion detection circuit 31 and performs transparency motion compensation, and a transparency corresponding to the image of each object. Transparency coding which receives the signal St and performs an encoding process of DCT transforming and quantizing the transparency signal St based on the transparency motion compensation output and the decoded output of the encoded binary shape signal. Circuit 24
And a variable length coding circuit 25 for further performing variable length coding on the output of the circuit 24.

In the encoding unit 20, the transparency signal encoded by the transparency encoding circuit 24 is decoded and stored in the motion compensation memory 23. The decoded transparency signal in 23 is output to the above-mentioned transparency motion detection circuit 22, and is used for motion compensation processing.

FIG. 4 shows each of the decoding circuits 140a-140.
3 shows a specific circuit configuration of c. Each decoding circuit includes a decoding unit 50 corresponding to a binary shape signal, a decoding unit 60 corresponding to a transmittance signal, and a decoding unit 70 corresponding to a pixel value signal.

Decoding section 50 corresponding to the binary shape signal
Is encoded data of a binary shape motion vector (binary shape motion vector bit string) D2m from the encoding device 100a.
v, encoded data of header (header bit string) Dh, and encoded data of binary data (binary data bit string) D
Variable-length decoding circuits 55 and 5 which are provided corresponding to 2ot and perform variable-length decoding on each of the encoded data.
6,57. The decoding unit 50 receives the output of the variable length decoding circuit 55, performs a binary shape motion compensation circuit 52, and performs a binary shape motion compensation circuit 52.
Receiving the header data from the decoding circuit 56 and the binary data from the decoding circuit 57,
A binary shape decoding circuit 51 for performing a decoding process for reproducing the value shape signal S2 '. In the encoding unit 50, the binary shape signal S2 'decoded by the binary shape decoding circuit 51 is stored in a motion compensation memory 53. The signal is
It is output to the value shape motion compensation circuit 52 and used for motion compensation processing. Further, the encoding unit 50
Then, the binary shape motion compensation circuit 52 and the variable length coding circuit 5
5, a switch 54 is provided so that the switch 54 is turned on only when the coding process for each macroblock is an inter-screen coding process based on the intra / inter information. Opening / closing control is performed by the shape decoding circuit 51.

The decoding unit 7 corresponding to the pixel value signal Dg
0 is provided corresponding to the coded data (motion vector bit sequence) Dgtmv of the pixel value / transparency motion vector and the coded data (pixel value bit sequence) Dg of the pixel value signal,
Variable-length decoding circuits 75 and 74 for performing variable-length decoding on these encoded data are provided. The decoding unit 70 receives the output of the variable length decoding circuit 75, and performs a pixel value motion compensation circuit 72 that performs motion compensation of the pixel value based on the binary shape signal S2 '. '
And the variable-length decoding circuit 7 based on the
4 has a pixel value decoding circuit 71 for performing a decoding process for inversely quantizing the output of No. 4 and further performing inverse DCT transform to reproduce the pixel value signal Sg ′. The encoding unit 70 has a motion compensation memory 73 for storing the pixel value signal Sg 'from the pixel value decoding circuit 71. The pixel value signal in this memory is And is used for motion compensation processing.

The coded data (transparency bit string) Dt of the transparency signal is decoded by a variable length decoding circuit 64 for performing variable length decoding of the coded data Dt of the transparency signal.
And a transparency motion compensation circuit 62 for receiving the output of the variable length decoding circuit 75 and performing motion compensation on the transparency based on the binary shape signal S2 ', and the binary shape signal S2
And a transparency decoding circuit 61 that performs a decoding process of inversely quantizing the output of the variable length decoding circuit 64 based on the motion compensation output, further performing inverse DCT transform, and reproducing the transparency signal St ′. Have. Also, the encoding unit 60
Has a motion compensation memory 63 for storing the transparency signal St 'from the transparency decoding circuit 61. The transparency signal in this memory is output to the transparency motion compensation circuit 62, It is used for compensation processing.

Next, the operation will be described. For example, as an image display signal, a display signal for images A and B created by computer graphic processing, and an image C obtained by performing a chroma signal on a video signal from a video camera.
Is supplied to the encoding device 100a, the encoding circuit 110 corresponding to the supply source of each image display data
In a to 110c, encoding processing of image display data is performed.

For example, image display data for displaying an image B of a fish which is an object on the display screen includes 2
Value signal S2, a transmittance signal St, and a pixel value signal Sg.
Encoding processing is performed at 0 and 30. Here, the object region R corresponding to the image B is divided into twelve macroblocks Mb, for example, as shown in FIG. 8A, and an encoding process is performed for each macroblock. Here, one macro block Mb has a pixel on the display screen of 16
And 16 horizontal rows in a matrix.

FIG. 5 is a flowchart showing an encoding process of the binary shape signal S2, the transmittance signal St, and the pixel value signal Sg. As shown in FIG. 5, first, image display data is formed. The encoding unit 10 performs an encoding process on the binary shape signal S2.

That is, first, the binary shape motion detection circuit 1
At 1, the binary shape signal S2 included in the image display data of each macroblock and the memory 13
Then, a motion vector related to a binary shape is detected based on a corresponding binary shape signal of the previous screen (hereinafter, referred to as a stored binary shape signal) stored in (step S1). Subsequently, the binary shape motion compensation circuit 12 performs motion compensation of the binary shape signal based on the binary shape motion vector and the stored binary shape signal (step S2). In addition, 2
The value shape encoding circuit 14 performs arithmetic on a binary shape signal (strictly speaking, binary data constituting the binary shape signal) S2 based on the output (motion compensation data) of the binary shape motion compensation circuit. An encoding process is performed (step S3).

In step S4, the processing of steps S1 to S3 for the binary shape signal S2 is performed on a predetermined number (for example, four corresponding to one horizontal row in FIG. 8B) of macroblocks. And if the number of processed macroblocks has not reached the predetermined number,
The following steps S1 to S4
If the number of processed macroblocks has reached the predetermined number, the process of step S5 is performed.

In this step S5, the variable length encoding of the header information constituting the head of the unit bit stream 1 (see FIG. 1) obtained by the encoding process in the binary shape encoding circuit 14 is variable. This is performed by the long encoding circuit 17, whereby encoded data (header bit string) Dh of the header is output. At this time, the coded data Dh of the header is output including the intra / inter information corresponding to each macroblock. In the following step S6,
A predetermined number of variable-length coding processes of the header (here, 4
It is determined whether or not the macroblock has been performed for one of the macroblocks. If the determination result is NO, the encoding process of the header is performed for the subsequent macroblock, and the determination result is YE.
If it is S, the process of step S7 is performed.

In step S 7, the binary shape motion vector detected by the binary shape motion detection circuit 11 is changed in length through the switch 15 by the control based on the intra / inter information from the binary shape encoding circuit 14. Encoding circuit 16
The variable-length coding for the binary shape motion vector is performed by the circuit 16, whereby the encoded data (binary shape motion vector bit sequence) D2mv of the binary shape motion vector is output. In the following step S8, the second
It is determined whether or not the variable-length coding process of the value-shaped motion vector has been performed for a predetermined number (here, four) of macroblocks. If the determination result is NO, the binary-shaped motion The variable length coding of the vector is performed, and if the determination result is YES, the process of step S9 is performed. The data D2mv obtained by performing variable length coding on the binary shape motion vector is arranged next to the coded data Dh of the header in the unit bit stream 1.

In step S9, the variable length coding circuit 18
, A variable length encoding process is performed on the binary data constituting the binary shape signal, and the encoded data (2
(Value data bit string) D2ot is output. In a succeeding step S10, it is determined whether or not the variable-length encoding process of the binary data has been performed for a predetermined number (here, four) of macroblocks. Are subjected to the variable length encoding of the binary data, and if the determination result is YES, the process proceeds to step S
Step 11 is performed. Note that the data D2ot obtained by performing variable length coding on the binary data is the encoded data D2 of the binary shape motion vector in the unit bit stream 1.
It is arranged after mv.

In step S 11, the pixel value motion detection circuit 31 of the encoding unit 30 uses the pixel value signal Sg included in the image display signal of each macroblock and the corresponding pixel value of the previous screen stored in the memory 33. A motion vector (pixel value motion vector) related to the pixel value signal Sg is detected based on the signal (hereinafter, referred to as stored pixel value data) and the stored binary shape signal. And the following step S12
In the above, the variable length encoding of the pixel value motion vector is performed by the variable length encoding circuit 36. Note that this pixel value motion vector is also used as a motion vector related to the transparency signal. Then, in step S13, it is determined whether or not a predetermined number (here, four) of macroblocks have been subjected to the variable length encoding of the pixel value motion vector, and the number of processed macroblocks reaches the predetermined number. If not, the process proceeds to step S1 for the subsequent macroblock.
Steps S1 to S13 are performed, and if the number of processed macroblocks has reached the predetermined number, the processing of step S14 is performed. The encoded data (motion vector bit sequence) Dgtmv of the pixel value / transparency motion vector output from the variable length encoding circuit 36 is encoded data of binary data (binary data) in the unit bit stream 1. (Bit string) D2ot.

In step S14, the pixel value motion compensation circuit 32 outputs a pixel value motion vector, a stored pixel value signal (the pixel value signal of the previous screen stored in the memory 33),
Based on the stored binary shape signal, the motion compensation of the pixel value is performed. In the subsequent step S15, the pixel value encoding circuit 34 performs an encoding process of DCT-transforming and quantizing the pixel value signal Sg based on the motion compensation output and the stored binary shape data, and furthermore, a variable length. Encoding processing 35
, A variable length encoding process is performed on the output of the circuit 34. Thereafter, in step S16, it is determined whether or not the encoding process of the pixel value signal has been performed for a predetermined number (here, four) of macroblocks. If the determination result is NO, the following macroblock is determined. Is performed, and if the result of the determination is YES, the process of step S17 is performed. The encoded data (pixel value bit string) Dg of the pixel value signal output from the variable length encoding circuit 35 is the encoded data D of the pixel value / transparency motion vector in the unit bit stream 1.
It is arranged after gtmv.

Further, in step S17, the transmittance motion compensating circuit 22 of the encoding unit 20 causes the pixel value motion vector from the pixel value detecting circuit 31 and the stored transmittance signal (the previous screen stored in the memory 23). Based on the corresponding transmittance signal) and the stored binary shape data, motion compensation is performed on the transmittance signal. Subsequent step S18
Then, the transparency encoding circuit 24 converts the transparency signal St into D based on the motion compensation output and the stored binary shape signal.
An encoding process of performing CT conversion and quantization is performed, and further, in a variable length encoding process 25, an output of the circuit 24 is subjected to variable length encoding. Thereafter, in step S19, it is determined whether or not the encoding processing of the transmittance signal has been performed for a predetermined number (here, four) of macroblocks.
If it is O, the encoding process of the transparency signal for the subsequent macroblock is performed, and if the determination result is YES, the encoding process for the image display signal of the corresponding object ends. The coded data (transmittance bit string) Dt of the transparency signal output from the variable length coding circuit 25 is arranged next to the coded data Dg of the pixel value signal in the unit bit stream 1.

The same encoding processing as that for the image B is performed on the images A and C by the encoding circuits 110a and 110c, respectively. When bit streams for each of the images A, B, and C are formed, these are multiplexed by the multiplexing processing unit 120, and are transmitted from the encoding device 100a to the decoding device 100.
b.

On the other hand, in the decoding device 100b, upon receiving the coded data of the multiplexed images A, B and C, the separation processing unit 130 separates the coded data into coded data corresponding to each image. Corresponding image decoding circuit 140a, 1
40b and 140c. Note that each decoding circuit performs exactly the same decoding processing.

FIG. 6 shows encoded data of a header (header bit string) Dh and encoded data of a binary shape motion vector (binary shape motion vector bit string) D2mv constituting a bit stream of transmission data from the encoding apparatus 100a. ,
The encoded data of binary data (2
Value data bit sequence) D2ot, pixel value / transparency motion vector encoded data (motion vector bit sequence) Dgtmv, pixel value signal encoded data (pixel value bit sequence) Dg, transparency signal encoded data (transparency bit sequence) It is a flow which shows the process which decodes Dt.

As shown in FIG. 6, first, the variable-length decoding circuit 55 of the decoding unit 50 performs variable-length decoding of the coded data Dh of the header (step T1). In the following step T2, it is determined whether or not a predetermined number (here, four) of macroblocks have been decoded, and if the number of processed macroblocks has not reached the predetermined number, Then, the decoding process of the header is performed on the following macro block, and when the number of processed macro blocks has reached the predetermined number, the process of step T3 is performed.

In step T3, the variable length decoding circuit 55 performs variable length decoding of the encoded data D2mv of the binary shape motion vector. In the following step T4, it is determined whether or not the decoding process has been performed on a predetermined number (here, four) of macroblocks. If the determination result is NO, the decoding process is performed on the subsequent macroblock. If the determination result is YES, the process of step T5 is performed.

In step T5, the decoded binary shape motion vector output from the variable length decoding circuit 55 is transmitted to the binary shape motion compensation circuit 52 via the switch 54 by the control based on the intra / inter information. Supplied,
Here, motion compensation is performed. At this time, the decoded binary shape signal stored in the memory 53 (that is, the decoded binary shape signal of the corresponding macroblock of the previous screen) is used.

Subsequently, in step T6, when the output of the circuit 57 for performing variable length decoding of the coded data D2 other than the motion vector of the binary shape signal is input to the binary shape decoding circuit 51, the circuit 51 Based on the header information output from the variable length decoding circuit 56 and the output from the binary shape motion compensation circuit 52, an encoded binary shape signal (strictly speaking, the binary Arithmetic decoding processing is performed on the value data). At this time, the intra / inter information included in the header information is output to the switch 54. Thus, the binary shape signal S2 'is reproduced. In a succeeding step T7, it is determined whether or not the decoding processing of the binary shape signal has been performed for a predetermined number (here, four) of macroblocks. Is performed, and if the result of the determination is YES, the process of step T8 is performed.

In step T8, the variable length decoding circuit 75 of the decoding unit 70 performs variable length decoding of the coded data (motion vector bit sequence) Dgtmv of the pixel value / transparency motion vector, In the value motion compensating circuit 72, the motion of the pixel value is compensated based on the decoded motion vector, the pixel value signal in the memory 73, and the reproduced binary shape signal S2 '. Subsequently, in step T9, the coded data (pixel value bit string) Dg of the pixel value signal is variable-length decoded by the variable length decoding circuit 74, and further, the binary shape signal S is decoded by the pixel value decoding circuit 71.
Based on 2 ′, a decoding process of dequantizing the decoded pixel value signal and performing inverse DCT transform is performed. As a result, the pixel value signal Sg 'is reproduced. In the following step T10, it is determined whether or not the pixel value motion compensation processing and the pixel value signal decoding processing have been performed for a predetermined number (here, four) of macroblocks. If the determination result is NO, These processes are performed for the subsequent macro blow, and if the determination result is S, the process of step T11 is performed.

In step T11, the transmittance motion compensation circuit 62 of the decoding unit 60 receives the decoded pixel value and transmittance motion vector, and receives the reproduced binary shape signal S2 'and the memory 63. Based on the transmission signal within
A motion compensation of the transmittance is performed. Subsequently, step T12
Then, the encoded data (transparency bit string) of the transparency signal D
t is variable-length decoded by a variable-length decoding circuit 64, and further, the transparency decoding circuit 61 reverses the decoded transparency signal based on the binary shape signal S 2 ′ and the motion compensation output. A decoding process for quantization and inverse DCT is performed. As a result, the transmittance signal St 'is reproduced.

In the following step T13, it is determined whether or not the above-described transparency motion compensation processing and transparency decoding processing have been performed for a predetermined number (here, four) of macroblocks. In some cases, these processes are performed for the subsequent macroblock, and the determination result is YE
If the result is S, the decoding process for the image display signal of the object is ended.

The same decoding processing as that for the image B is performed on the images A and C by the decoding circuits 140a and 140c, respectively. Then, for each of the images A, B, and C, the binary shape signal S
When the 2 ′, the transmittance signal St ′, and the pixel value signal Sg ′ are reproduced, they are synthesized by the synthesis processing unit 150, and the decoded image (see FIG. 2) is displayed.

As described above, in the first embodiment, the binary shape signal is divided into the motion vector information obtained from the binary shape signal and the binary data constituting the binary shape signal, and the motion vector information is obtained by encoding the motion vector information. The encoded data (first bit sequence) D2mv of the obtained binary shape motion vector is converted into encoded data (second bit sequence) D2 obtained by encoding the binary data.
Since these bit strings are arranged on the unit bit stream 1 so as to be transmitted before ot, the motion vector related to the binary shape signal which is an important element for the image shape of the object is affected by transmission errors as much as possible. Decoding can be performed without any problem.

Further, in the first embodiment, the encoded image display data is transmitted at a time for a predetermined number of blocks, so that the influence of the transmission error on the reproduced image quality can be further reduced. Further, in the first embodiment, a pixel value bit sequence Dg obtained by encoding the pixel value signal and a transmittance bit sequence Dt obtained by encoding the transmittance signal are represented by:
Since the pixel value bit string Dg is arranged to be transmitted prior to the transmission bit string Dt, pixel value signals important for maintaining image color display quality are transmitted before transmission signals of lower importance. As a result, deterioration of color display quality due to transmission errors can be reduced.

In the first embodiment, each bit string Dh, D2mv, D2
Although ot, Dgtmv, Dg, and Dt correspond to four macroblocks, each of the bit strings may correspond to a larger number of macroblocks, or may correspond to one macroblock.

Embodiment 2 FIG. 11A is a diagram for explaining a data structure for image transmission according to the second embodiment of the present invention. In the figure, reference numeral 2 denotes a repetition unit of transmission when image display data corresponding to a predetermined area (object area) including an individual object on the display screen is encoded in object units and transmitted in macroblock slices. Is a unit bit stream. Here, the macroblock slice is an area composed of a predetermined number of macroblocks arranged in the order of the encoding processing in the object area.
As shown in (a), the object area R 'is an area composed of four macroblocks arranged in the order of encoding. For example, the macroblock slice S1 includes macroblocks MB1 to MB4, and the macroblock slice S2 includes macroblocks MB5 to MB8.

The unit bit stream 2 includes a slice header bit string Dhs, MB position bit string Dbp, header bit string Dh, binary shape bit string D2, texture type bit string Dty, motion vector bit string Dgtmv, resynchronization signal Dtsyn, transparency bit string Dt, Resynchronization signal Dgs
yn, a pixel value bit string Dg, and these bit strings have an image transmission data structure that is repeatedly transmitted in the above order for each macroblock slice.

Here, the header bit string Dh, the binary shape bit string D2, and the motion vector bit string Dgtmv are:
The header bit string Dh is exactly the same as that in the unit bit stream 1 of the first embodiment, and the header bit string Dh is header information indicating the head position of the binary shape bit string D2. The corresponding binary shape bit string includes information (intra-inter information) indicating which mode of the intra-screen coding mode or the inter-screen coding mode has been subjected to the coding process. The inter information is used for switching between the encoding and decoding processing modes at the time of encoding and decoding processing for the binary shape signal. The binary shape bit string D
2 is divided into a binary shape motion vector bit sequence D2mv obtained from the binary shape signal and a binary data bit sequence D2ot obtained by arithmetically encoding the binary data constituting the binary shape signal.

The transparency bit string Dt is obtained by performing a frequency transformation process (DCT transformation process) and a quantization process on a transparency signal corresponding to a macroblock constituting the macroblock slice. A variable-length coded DC coefficient (transparency DC component bit sequence) Dtd and a variable-length coded AC coefficient (transparency AC component bit sequence) Dt of the plurality of transform coefficients Dt
a, and these bit strings Dtd and Dta are
The transmissivity DC component bit sequence Dtd is arranged to be transmitted before the transmissivity AC component bit sequence Dta.

The pixel value bit string Dg is converted into a pixel value signal corresponding to each macroblock constituting the macroblock slice by a frequency conversion process (DCT conversion process).
And a variable-length coded DC coefficient (pixel value DC component bit sequence) Dgd of a plurality of transform coefficients obtained by performing the quantization process, and a variable-length coded DC coefficient of the plurality of transform coefficients Obtained (pixel value AC component bit string) D
ga, and these bit strings Dgd and Dga have a pixel value DC component bit string Dgd having a pixel value A.
They are arranged so as to be transmitted before the C component bit string Dga.

The resynchronization signal Dtsyn is arranged immediately before the transparency bit string Dt.
By detecting yn, it is possible to recognize that the bit string following this signal is the transparency bit string Dt. Further, the resynchronization signal Dgsyn is arranged immediately before the pixel value bit string Dg. By detecting the resynchronization signal Dgsyn, it is possible to recognize that the bit string following this signal is the pixel value bit string Dg.

Furthermore, the MB position bit string Dbp is:
The texture type bit string Dty indicates that each macroblock constituting one macroblock slice corresponds to position information indicating the position from the beginning of the corresponding macroblock slice. This is a bit string as information indicating whether it is a predictive coding process or an intra block (an intra-screen coding process). These bit sequences Dbp and Dty are shown in FIG. b)
Are the same as those in the conventional unit bit stream Bsu1 shown in FIG.

The slice header bit string Dhs is header information indicating the head position of the unit bit stream 2 corresponding to a macroblock slice.

The encoding and decoding processing in the system for handling image encoded data composed of the unit bit stream 2 having the image transmission data structure according to the second embodiment will be described in the first embodiment with reference to FIG. The encoding device and the decoding device used in this system have basically the same configuration as that described in Embodiment 1 with reference to FIGS. 3 and 4. ing.

Hereinafter, the configurations of the encoding device and the decoding device according to the second embodiment will be described with reference to FIG. 12 and FIG. FIG. 12 is a diagram for describing an encoding device that generates encoded image data composed of a unit bit stream having an image transmission data structure according to the second embodiment, and is a diagram illustrating the configuration of the encoding device. 2 shows a configuration of each encoding circuit corresponding to the images A, B, and C shown in FIG.

Each of the encoding circuits performs an encoding process on the binary shape signal S2 to execute the header bit string Dh, 2.
An encoding unit 10a for generating a value shape motion vector bit sequence D2mv and another bit sequence D2ot of a binary shape; and a transparency DC component bit sequence Dtd and a transparency A as the transparency bit sequence Dt by performing an encoding process on the transparency signal St.
An encoding unit 20a that generates a C component bit sequence Dta, and a texture type bit sequence Dty, a pixel value DC component bit sequence Dgd, and a pixel value to which a motion vector bit sequence Dgtmv is added as necessary by encoding the pixel value signal Sg. Encoding unit 30 that generates AC component bit string Dga
a.

Here, the encoding section 10a has exactly the same configuration as the encoding section 10 shown in FIG. 3 in the first embodiment, and the encoding section 20a has its variable length encoding The circuit 25 differs from the encoding unit 20 of the first embodiment shown in FIG. 3 only in that a transparency DC component bit sequence Dtd and a transparency AC component bit sequence Dta are separately output as a transparency bit sequence Dt. I have.
Further, the encoding unit 30a outputs the pixel value DC component bit sequence Dgd and the pixel value AC component bit sequence Dga separately from the variable length encoding circuit 35 as the pixel value bit sequence Dg, The encoding unit 36 shown in FIG. 3 according to the first embodiment only differs from the encoding circuit 36 in that the texture type bit sequence Dty is output with the motion vector bit sequence Dgtmv added as necessary.
Different from 0.

When the target macroblock to be coded is an inter block, the coding unit 30a outputs the texture type bit sequence Dty with the motion vector bit sequence Dgtmv added thereto. If the target macroblock to be processed is an intra block, the texture type bit string D
ty is output without adding a motion vector bit string Dgtmv to it.

Each of the encoding circuits receives the binary shape signal S2, the transparency signal St, and the pixel value signal Sg, and converts the slice header bit string Dhs, MB position bit string Dbp, and resynchronization signals Dgsyn, Dtsyn. And the bit strings Dh, D2m from the respective encoding units.
v, D2ot, Dty, Dgtmv, Dtd, Dta, Dgd and Dga, the slice header bit strings Dhs,
MB position bit string Dbp and resynchronization signals Dgsyn, Dtsyn
And a bit stream generator 40a for repeatedly outputting a unit bit stream 2 in which these bit strings and resynchronization signals are arranged in the order shown in FIG. 11A for each macroblock slice. .

FIG. 13 is a diagram for explaining a decoding apparatus for decoding image encoded data consisting of a unit bit stream having a data structure for image transmission according to the second embodiment. The image A, shown in FIG.
The configuration of each decoding circuit corresponding to the images B and C is shown.

[0130] Each of the decoding circuits converts the slice header bit string Dhs, MB position bit string Dbp and resynchronization signal included in the unit bit stream from the unit bit stream 2 constituting the image coded data from each of the coding circuits. A bit stream for extracting the header bit string Dh, the binary shape motion vector bit string D2mv, the binary data bit string D2ot, the motion vector bit string Dgtmv, the texture type bit string Dty, the transparency bit string Dt, and the pixel value bit string Dg based on Dgsyn and Dtsyn. Division 4
0b.

Further, each of the decoding circuits includes the header bit string Dh, the binary shape motion vector bit string D2mv, 2
A binary shape signal decoding unit 50 for reproducing the binary shape signal S2 'by decoding the value data bit string D2ot
a and the transmission bit string Dt, and the transmission signal S
A pixel for reproducing a pixel value signal Sg 'by receiving a transparency type signal decoding unit 60a for reproducing t' and a texture type bit sequence Dty to which a motion vector bit sequence Dgtmv is added as necessary together with the pixel value bit sequence Dg. And a value signal decoding unit 70a.

Here, decoding section 50a has exactly the same configuration as coding section 40 shown in FIG. 4 in the first embodiment, and coding section 60a has its variable length decoding The circuit 64 includes a transparency bit sequence Dt, a transparency DC component bit sequence Dtd and a transparency AC component bit sequence Dt.
The difference from the encoding unit 60 of the first embodiment shown in FIG. further,
The encoding unit 70a provides the variable length decoding circuit 74 with:
The pixel value bit string Dg is a pixel value DC component bit string Dgd.
And the pixel value AC component bit string Dga is supplied separately, and the texture type bit string Dty is supplied to the variable length decoding circuit 75 with the motion vector bit string Dgtmv added as necessary. This is different from encoding section 70 of Embodiment 1 shown in FIG.

As described above, in Embodiment 2 of FIG.
The decoding circuit corresponding to each of the images A to C shown in FIG.
(a) Receives image encoded data composed of a unit bit stream 2 having a data structure for image transmission shown in (a), and receives, from the unit bit stream 2, the header bit sequence Dh, the binary shape bit sequence D2, the motion vector bit sequence Dgtmv, and the texture type bit sequence. Dty, the transparency bit string Dt, and the pixel value bit string Dg are separated, and a decoding process is performed in the same manner as the decoding circuit in the first embodiment.

Further, in the decoding circuit of the second embodiment, when a transmission error occurs, based on the resynchronization signals Dtsyn and Dgsyn, a bit string from the resynchronization signal to a transmission error occurrence position before and after the resynchronization signal is generated. Is performed to perform the process of recognizing the encoded data and to perform the process of decoding the encoded data.

Next, the operation will be described. For example, FIG.
When the image display data corresponding to any one of the images A to C shown in FIG.
Encoding processing for the binary shape signal S2, the transmittance signal St, and the pixel value signal Sg included in the image display data is performed in each of the encoding units 10a, 20a, and 30a, and a bit sequence obtained from each signal Is output for each macroblock slice. here,
It is assumed that a macroblock slice is composed of four macroblocks as shown in FIG.

FIG. 14 shows the binary shape signal S2, transmittance signal St, and pixel value signal Sg included in the image display data.
2 shows the flow of the encoding process. First, the bit stream generation unit 40a, based on the binary shape signal S2, the transparency signal St, and the pixel value signal Sg contained in the input image display data, receives the slice header bit sequence Dhs, MB position bit sequence Dbp, The resynchronization signal Dtsyn,
Dgsyn is generated (step S0).

Thereafter, as in the first embodiment, a header bit string Dh is generated by the processing of steps S1 to S6, and a binary shape motion vector bit string D2mv and a binary data bit string D2ot are generated by the processing of steps S7 to S10.
Is generated.

Next, steps S11, S12a, S13
, A texture type bit string Dty and a motion vector Dgtmv are generated. Step S12
In a, if the macroblock to be encoded is to be subjected to the inter-picture prediction encoding,
The texture type bit sequence Dty is output with the motion vector Dgtmv added thereto, and if the macroblock to be encoded is to be subjected to intra-frame encoding, the texture type bit sequence Dty is added to this. Output without adding motion vector Dgtmv.

After that, the pixel value bit sequence Dg is divided into the pixel value DC component bit sequence Dgd and the pixel value AC component bit sequence Dga by the processing of steps S14 to S16, and the transparency is further determined by the processing of steps S17 to S19. The bit sequence Dt is output separately from the transmittance DC component bit sequence Dtd and the transmittance AC component bit sequence Dta.

In the second embodiment, steps S4, S6, S8, S10, and S4 are performed to determine whether the number of processed macroblocks has reached a predetermined number.
13, S16, and S19, the number of macroblocks constituting the macroblock slice (4 in the second embodiment).
) Is performed as a reference.

Finally, the bit stream generator 40a outputs the bit strings Dh, D2mv, D2 from the respective encoders.
ot, Dty, Dgtmv, Dtd, Dta, Dgd and Dga
To the slice header bit string Dhs, MB position bit string Dbp and resynchronization signals Dgsyn and Dtsyn, and these bit strings and resynchronization signal
Are arranged so as to be transmitted in the order shown in (1), and the unit bit stream 2 is output (step S20).

Such an encoding process is performed on the images A to C. When the unit bit streams 2 corresponding to the images A, B, and C are formed, these are multiplexed by the multiplexing processing unit. And transmitted from the encoding device to the decoding device (see FIG. 2).

On the other hand, when the decoding device receives the coded data of the multiplexed image A, image B, and image C, the separation processing section separates the coded data into the coded data corresponding to each image. It is supplied to a picture decoding circuit (see FIG. 2). Note that each decoding circuit performs exactly the same decoding processing.

FIG. 15 is a flowchart showing a process for decoding the bit strings Dh, D2mv, D2ot, Dty, Dgtmv, Dg, and Dt in the unit bit stream constituting the image encoded data from the encoding device.

First, when the unit bit stream 2 is input to the bit stream division unit 40b of the decoding device, the division unit 40b converts the unit header stream from the unit bit stream 2 into slice header bit strings Dhs, Dhs, Based on the MB position bit string Dbp and the re-synchronization signals Dgsyn, Dtsyn, the header bit string D
h, a binary shape motion vector bit sequence D2mv, a binary data bit sequence D2ot, a texture type bit sequence Dty, a motion vector bit sequence Dgtmv, a transparency bit sequence Dt, and a pixel value bit sequence Dg.

Thereafter, as in Embodiment 1, the variable length decoding of the header bit string Dh is performed by the processing of steps T1 and T2, and the binary shape motion vector is further processed by the processing of steps T3 to T7. The variable length decoding of the bit string D2mv and the binary data bit string D2ot is performed.

Further, the decoding process of the pixel value bit string Dg is performed by the processing of steps T8 to T10, and the decoding processing of the transparency bit string Dt is performed by the processing of steps T11 to T13. In the second embodiment, in the above-described step T9, the texture type bit string Dty
And a motion vector Dgtmv, the pixel value bit string D
Pixel value DC component bit string Dgd as g and pixel value A
The decoding process of the C component bit sequence Dga is performed. In step T12, based on the texture type bit sequence Dty and the motion vector Dgtmv, the transmission DC component bit sequence Dtd and the transparency AC component bit sequence Dta as the transparency bit sequence Dt are performed. Decryption processing is performed. Steps T2, T4, T7, T7 for determining whether the number of processed macroblocks has reached a predetermined number.
At 10, T13, the determination process is performed based on the number of blocks constituting the macroblock slice (four in the second embodiment).

The other processes are the same as those in the decoding process of the first embodiment. And each image A, B,
When the binary shape signal S2 ', the transmittance signal St', and the pixel value signal Sg 'are reproduced for C, they are combined by the combining processing unit, and the decoded image is displayed (see FIG. 2). .

In the second embodiment having such a configuration, the resynchronization signal Dtsyn corresponding to the transparency bit string Dt and the subsequent transparency bit string Dt are separated from the resynchronization signal Dgsyn corresponding to the pixel value bit string Dg. The pixel value bit string, which is important data, is arranged to be transmitted as the last bit string constituting the unit bit stream, and an error has occurred during the transmission of the unit bit stream. In this case, it is possible to decode important pixel value bit strings in a short time by sequentially following the tail of the unit bit stream.

Embodiment 3 FIG. 11B is a diagram for explaining a data structure for image transmission according to the third embodiment of the present invention. In the figure, reference numeral 3 denotes a repetition unit of transmission when image display data corresponding to a predetermined area (object area) including an individual object on the display screen is encoded in object units and transmitted in macroblock slices. Is a unit bit stream. Here, the macroblock slice is the same as in the second embodiment, as shown in FIG.
Is an area composed of four macroblocks arranged in the order of encoding in the object area R 'shown in FIG.

The unit bit stream 3 includes a slice header bit string Dhs, MB position bit string Dbp, header bit string Dh, binary shape bit string D2, texture type bit string Dty, motion vector bit string Dgtmv, resynchronization signal Dgsyn, pixel value bit string Dg, Resynchronization signal Dts
yn and the transparency bit sequence Dt are arranged so that these bit sequences are repeatedly transmitted in this order. The unit bit stream 2 of the second embodiment is different from the transparency bit sequence Dt and the resynchronization corresponding thereto. The signal Dtsyn, the pixel value bit string Dg, and the corresponding resynchronization signal Dgs
The only difference is that the sequence order with yn is reversed.

Further, the encoding and decoding processing in the system for handling image encoded data composed of unit bit streams according to the third embodiment is performed in the same manner as that described in the second embodiment. The encoding device and the decoding device used in the system have almost the same configuration as those shown in FIGS.

That is, according to the third embodiment, the bit stream generation unit constituting the encoding device for generating the encoded image data has the slice header bit sequence Dhs, MB
The position bit string Dbp, the header bit string Dh, the binary shape bit string D2, the texture type bit string Dty, the motion vector bit string Dgtmv, the resynchronization signal Dgsyn, the pixel value bit string Dg, the resynchronization signal Dtsyn, and the transparency bit string Dt
This embodiment is different from the second embodiment in that the arrangement is such that the signals are arranged and output so as to be repeatedly transmitted in this order (the order shown in FIG. 11B).

Further, in the third embodiment, the bit stream dividing unit constituting the decoding device for decoding the image coded data converts the bit stream 3 having the image transmission data structure shown in FIG. Receiving the bit stream 3
From the above, based on the slice header bit sequence Dhs, MB position bit sequence Dbp and resynchronization signals Dgsyn, Dtsyn, the header bit sequence Dh, the binary shape bit sequence D2,
The motion vector bit sequence Dgtmv, the pixel value bit sequence Dg, and the transparency bit sequence Dt are separated, and a decoding process similar to that of the decoding device of the second embodiment is performed.

Further, when a transmission error occurs, the decoding circuit constituting the decoding apparatus according to the third embodiment determines, based on the resynchronization signals Dgsyn and Dtsyn, the transmission error before and after the resynchronization signal. The configuration is such that a process of recognizing encoded data as a bit string up to the occurrence position is performed, and a process of decoding the encoded data is performed.

In the third embodiment having such a configuration, the resynchronization signal Dtsyn corresponding to the transparency bit string Dt and the following transparency bit string Dt are arranged to be transmitted after the pixel value bit string Dg. If the decoding side does not need transparency information, the transparency bit string Dt can be easily discarded.

When an error occurs in a part of the pixel value bit string Dg during transmission of the unit bit stream,
With reference to the resynchronization signals Dgsyn and Dtsyn located before and after the important pixel value bit string Dg, the data in the pixel value bit string Dg is traced from the front end and the rear end to the error occurrence position, and most of the data in the pixel value bit string Dg Can be decoded in a short time.

In the second and third embodiments, each bit string Dh, D2mv, D2ot, Dty, Dgtmv located between the MB position bit string Dbp and the resynchronization signal Dtsyn or Dgsyn is used as a unit bit stream. Although the slices are arranged for each slice, that is, arranged for each of the four macroblocks constituting the macroblock slice, the unit bit stream corresponding to the macroblock slice has the MB position bit string Db
p and each bit string Dh, D2mv, D2 corresponding to one macroblock between p and the resynchronization signal Dtsyn or Dgsyn.
ot, Dty, and Dgtmv may be repeatedly arranged for each macroblock.

In each of the above embodiments, the configuration of the encoding device and the decoding device may be realized by either hardware or software. For example, MPEG1
The configurations of the encoding device and the decoding device conforming to the standard are realized by software. Considering the recent increase in the speed of arithmetic processing by a CPU or the like, the M
Encoding devices and decoding devices conforming to the PEG4 standard are also
Most of them can be realized only by software.

However, in this case, when a large amount of data is sent to the receiving side, there may be a situation where decoding cannot be performed due to lack of processing capability of the CPU. For such a problem that the decoding process is temporarily difficult,
In general, it is desirable to transmit the atmosphere as the entire image to be displayed even if the image quality slightly deteriorates, rather than partially missing the image display data completely. A coping data declaration method has been proposed. This means that when a large amount of data is sent to the receiver,
Even if the image quality is slightly reduced, it is possible to decode the coded image data of the corresponding object. By using such a method, the encoding or decoding processing of the MPEG4 standard can be realized by software. It becomes possible.

In MPEG4, encoding and decoding of image display data are performed on an object basis, so that image display data corresponding to an object is
In the case of transmitting the image coded data of the images A, B, and C as in each of the above-described embodiments, if the priority level of the data to be transmitted is set, it is not important because of the balance with the processing capability of the CPU. A method is also conceivable in which transmission is not performed in order from.

Further, an encoding or decoding program for realizing the configuration of the encoding device or the decoding device shown in each of the above embodiments is recorded on a data storage medium such as a floppy disk. The processing described in each embodiment of the present invention can be easily performed by an independent computer system.

FIG. 16 is a diagram for explaining a case where the encoding or decoding processing of each of the above embodiments is performed by a computer system using a floppy disk storing the above encoding or decoding program. is there.

FIG. 16A shows the appearance, cross-sectional structure, and main body of the floppy disk viewed from the front of the floppy disk, and FIG. 16B shows an example of the physical format of the main body of the floppy disk.

The above-mentioned floppy disk FD is composed of the above-mentioned floppy disk main body D and a floppy disk case FC.
A plurality of tracks Tr are formed concentrically from the outer circumference toward the inner circumference on the surface of the floppy disk main body D, and each track Tr has 16 sectors Se in the angular direction. Is divided into Therefore,
In the floppy disk FD storing the program, the floppy disk main body D has data as the program recorded in an area (sector) Se allocated thereon.

FIG. 16C shows a configuration for recording the program on the floppy disk FD and performing image processing using the program stored in the floppy disk FD.

The above program is stored on a floppy disk FD
, The data as the program is written from the computer system Cs to the floppy disk FD via the floppy disk drive FDD.
When the encoding device or the decoding device is constructed in the computer system Cs by the program recorded on the floppy disk FD, the program is read from the floppy disk FD by the floppy disk drive FDD and loaded into the computer system Cs. .

In the above description, the description has been made using a floppy disk as a data recording medium. However, even when an optical disk is used, encoding or decoding by software can be performed in the same manner as in the case of the floppy disk. it can. The recording medium is not limited to the above-mentioned optical disk or floppy disk, but may be an IC card,
Any recording medium such as an OM cassette may be used as long as the program can be recorded. Even when using such a recording medium, encoding or decoding processing by software can be performed in the same manner as when using the above-mentioned floppy disk or the like.

Further, the encoded image data encoded and stored in the data storage medium such as an optical disk has the image transmission data structure of each of the above-described embodiments. In the case where data is decoded and displayed as an image, even when a reading error occurs, it is possible to reduce the quality degradation of the display image due to the error or to decode important pixel value bit strings in a short time. .

[0170]

As described above, according to the image transmission data structure of the present invention (claim 1), each pixel in the predetermined area including the corresponding object on the display screen corresponds to each pixel in the predetermined area. A binary shape bit string obtained by encoding a binary shape signal indicating whether the binary shape signal is located inside or outside the object, and a motion vector information obtained by encoding the motion vector information obtained from the binary shape signal. 1 bit string and a second bit string obtained by encoding the binary shape signal based on the motion vector information are arranged such that the first bit string is transmitted before the second bit string. Since the binary shape bit string is configured, even if an error occurs during the transmission of the encoded image data, it is possible to transmit the motion vector information on the binary shape that is important for displaying the image at the destination. Probability is No longer, thereby it is possible to reduce a quality is degraded in the image display in the transmission destination of transmission errors.

According to the present invention (claim 2), claim 1
In the described image transmission data structure, a predetermined area including the corresponding object on the display screen is divided into a plurality of blocks,
The first bit string is obtained by coding motion vector information obtained from the binary shape signal by an amount corresponding to a predetermined number of adjacent blocks among the plurality of blocks, and Is obtained by encoding the binary shape signal by an amount corresponding to a predetermined number of adjacent blocks among the plurality of blocks based on the motion vector information. When the information of the motion vector is transmitted, a certain but not perfect image display is performed in an area corresponding to the predetermined number of blocks on the display screen. For this reason, it is possible to reduce the occurrence of a problem such as a loss of an image in a region corresponding to a specific block on the display screen due to a transmission error.

According to the present invention (Claim 3), Claim 1
In the data structure for image transmission described above, the binary shape bit string, the transmittance bit string, and the pixel value bit string are obtained from the pixel value signal or the transmittance signal and are common to these signals. A motion vector indicating the motion in the above, including a motion vector bit sequence obtained by encoding, and following the first transmitted header bit sequence obtained by encoding the relevant information related to each of the above bit sequences, a binary Since the shape bit sequence, motion vector bit sequence, pixel value bit sequence, and transparency bit sequence are arranged to be transmitted in this order, even if an error occurs during transmission of the bit sequence subsequent to the pixel value bit sequence, the image is displayed at the transmission destination. Binary shape bit strings and motion vector bit strings that are important to perform can be decoded. For this reason, the image display at the transmission destination can be performed with reduced image quality deterioration due to the transmission error.

According to the data structure for image transmission according to the present invention (claim 4), the pixel corresponding to each pixel in the predetermined area including the object on the display screen is located inside the object or A binary shape bit string obtained by encoding a binary shape signal indicating whether the object is located outside the object, and corresponding to the transparency of the image of the object corresponding to each pixel constituting the object on the display screen. A transmittance bit string obtained by encoding a transmittance signal, and a pixel value bit string corresponding to each pixel constituting the object on the display screen and obtained by encoding a pixel value signal for color-displaying the object. The bit strings are arranged so that the transparency bit strings are transmitted after the binary shape bit strings and the pixel value bit strings, so that the importance is higher than that of a transparency signal for displaying an image. Binary bit string shape signal and the pixel value signal, it is possible to reduce a longer be decoded by a transmission error, the image display on the transmission destination, it is assumed that the image quality deterioration due to transmission errors is reduced.

According to a fifth aspect of the present invention, in the image transmission data structure of the fourth aspect, the predetermined area including the object on the display screen is divided into a plurality of blocks.
The value shape bit sequence, the transparency bit sequence, and the pixel value bit sequence are encoded by encoding the binary shape signal, the transparency signal, and the pixel value signal by an amount corresponding to a predetermined number of adjacent blocks among the plurality of blocks. With this configuration, even if an error occurs during transmission of the transparency bit string, it is possible to decode the binary shape bit string and the pixel value bit string, thereby corresponding to the predetermined number of blocks on the display screen. In the region where the image is displayed, almost complete image display is performed by the binary shape signal and the pixel value signal. For this reason, it is possible to reduce the occurrence of problems such as a missing image in a region corresponding to a specific block on the display screen due to a transmission error and an extremely deteriorated image quality.

According to the present invention (claim 6), claim 3
In the data structure for image transmission described above, the binary shape bit string is obtained by encoding motion vector information indicating the motion of the object on a display screen obtained from the binary shape signal, A bit sequence, and a second bit sequence obtained by encoding the binary shape signal based on the motion vector information. After the transmission of the first bit sequence, the motion vector bit sequence And
After that, since the second bit sequence was arranged to be transmitted,
Even if an error occurs during the transmission of the bit string, there is a probability that a bit string corresponding to a binary shape motion vector, which is particularly important in displaying an image, and a bit vector corresponding to a motion vector common to pixel values and transparency, can be decoded. As a result, image display at the transmission destination can be performed with reduced image quality deterioration due to transmission errors.

According to the present invention (claims 7 and 9), when image display data corresponding to each object displayed on the display screen is encoded for each object, the corresponding object on the display screen is encoded. A motion vector indicating the motion of the object on the display screen using a binary shape signal corresponding to each pixel within the predetermined area including the pixel, the signal being located inside the object or being located outside the object. , The motion vector is coded to form a first bit sequence, and the binary data forming the binary shape signal is coded based on the motion vector to form a second bit sequence, Are arranged such that the first bit string is transmitted before the second bit string. Therefore, even if an error occurs during the transmission of the encoded image data, it is important to perform image display at the transmission destination. Action on value shape Probability of transmitting the information of the vector is high. As a result, it is possible to obtain an encoding method and an encoding device that can reduce degradation of image display quality at a transmission destination due to a transmission error.

According to the present invention (claims 8 and 10), when image display data corresponding to each object displayed on the display screen is encoded for each object, the corresponding object on the display screen is encoded. A binary shape signal corresponding to each pixel in the predetermined area including the pixel and indicating whether the pixel is located inside the object or outside the object is encoded to form a binary shape signal bit string, The pixel value signal for color display of the object corresponding to the above is encoded to form a pixel value bit string, and the transparency signal corresponding to the transparency of the image of the object corresponding to each pixel is encoded. To form a transparency bit string, and each of the bit strings is referred to as the transparency bit string.
Since the bit sequence is arranged so as to be transmitted after the value shape bit sequence and the pixel value bit sequence, the bit sequence of the binary shape signal and the pixel value signal, which are more important than the transmittance signal for performing image display, can be decoded by a transmission error. It is possible to reduce the loss, and thereby obtain an encoding method and an encoding device capable of reducing the image quality degradation due to a transmission error in image display at a transmission destination.

According to the present invention (claims 11 and 13),
When decoding image encoded data corresponding to each object, which is encoded by the encoding method according to claim 7, the first bit string is decoded to form a motion vector obtained from the binary shape signal. Since the second bit string is decoded based on the motion vector to form binary data forming the binary shape signal and generate the binary shape signal, an error occurs during transmission of image data. Even in this case, a decoding method and a decoding apparatus capable of decoding a bit string of a data structure for image transmission having a high probability of being able to transmit motion vector information relating to a binary shape important for displaying an image at a transmission destination are obtained. be able to.

According to the present invention (claims 12 and 14),
When decoding image-encoded data corresponding to each object encoded by the encoding method according to claim 8, the binary shape bit string is decoded to form the binary shape signal, and the pixel value bit string is decoded. To form the pixel value signal, decode the transparency bit string to form the transparency signal, and generate image display data corresponding to each object displayed on the display screen. A bit string of a data structure for image transmission that can reduce the possibility that a bit string of a binary shape signal and a pixel value signal that are more important than a transmittance signal for displaying an image cannot be decoded due to a transmission error. A decoding method and a decoding device capable of decoding can be obtained.

According to the data storage medium of the present invention (claim 15), when encoding image display data corresponding to an object on the display screen, the data in the predetermined area including the object on the display screen is encoded. Using a binary shape signal corresponding to each pixel, indicating whether the pixel is located inside the object or outside the object, detecting a motion vector indicating the movement of the object on the display screen, The motion vector is encoded to form a first bit sequence, and the binary data forming the binary shape signal is encoded based on the motion vector to form a second bit sequence.
Is stored, and a program for causing a computer to perform a process of arranging each of the above-described bit strings so that the first bit string is transmitted before the second bit string is stored. By loading, even if an error occurs during the transmission of the encoded image data, it is important to perform image display at the transmission destination.
It is possible to realize an encoding process for decoding the motion vector information relating to the value shape with a high probability, thereby reducing deterioration of quality in image display at a transmission destination due to a transmission error. .

According to the data storage medium of the present invention (claim 16), when encoding the image display data corresponding to the object on the display screen, the data in the predetermined area including the object on the display screen is encoded. A binary shape signal corresponding to each pixel and indicating whether the pixel is located inside the object or outside the object is encoded to form a binary shape signal bit string,
A pixel value signal for displaying the object in color corresponding to each of the pixels is encoded to form a pixel value bit string, and a transparency signal corresponding to the transparency of the image of the object corresponding to each of the pixels is encoded. A program for causing a computer to perform processing for arranging each bit string to be transmitted after the binary shape bit string and the pixel value bit string is stored. By loading the program into a computer, even when a transmission error occurs, the decoding of the bit string of the binary shape signal and the pixel value signal, which are more important than the transmittance signal, for performing image display, is increased. It is possible to realize coding processing with probability and thereby reduce deterioration of image display quality at a transmission destination due to transmission errors. It can become.

According to the data storage medium of the present invention (claim 17), the processing of decoding the image display data corresponding to each object encoded by the encoding method of claim 7 can be performed by a computer. And storing the program in a computer to decode the first bit sequence to form a motion vector obtained from the binary shape signal, and to convert the second bit sequence based on the motion vector. To form binary data constituting the binary shape signal, and the pixel corresponding to each pixel in a predetermined area including the relevant object on the display screen, the pixel being located inside the relevant object. Since a binary shape signal indicating whether the pixel is a pixel outside the object or a pixel outside the object is generated, by loading the program into a computer, Decoding method capable of decoding a bit string of a data structure for image transmission having a high probability of being able to transmit motion vector information relating to a binary shape important for displaying an image at a destination even if an error occurs during transmission. And a decoding device.

According to the data storage medium of the present invention (claim 18), the processing for decoding the image display data corresponding to each object encoded by the encoding method of claim 8 can be performed by a computer. Storing the program that causes the computer to decode the binary shape bit sequence to form the binary shape signal, decode the pixel value bit sequence to form the pixel value signal, The transmission bit sequence is decoded to form the above-mentioned transmission signal, and a process for generating image display data corresponding to each object displayed on the display screen is performed. Therefore, the program is loaded into a computer. By doing so, the bit string of the binary shape signal and the pixel value signal, which are more important than the transmittance signal for performing image display, are decoded by a transmission error. The bit string data structure for image transmission that can reduce the no longer can be realized decodable decoding method and decoding apparatus.

According to the data storage medium of the present invention (claim 19), the encoded image display data corresponding to each object, which is transmitted in units of individual objects displayed on the display screen, is transmitted. Storing the image display data as a binary value indicating whether the pixel is located inside the object or outside the object, corresponding to each pixel in a predetermined area including the corresponding object on the display screen; A binary shape bit sequence obtained by encoding the shape signal is included. The binary shape bit sequence is obtained by coding motion vector information indicating the motion of the object on the display screen obtained from the binary shape signal. And a second bit string obtained by encoding the binary shape signal based on the motion vector information, and converting the first and second bit strings into a first bit string. The bit string is the second The data storage medium is used in the image display device to display images even if an error occurs during the transmission of image data. Decoding of motion vector information relating to an important binary shape can be performed with a high probability, whereby image reproduction with little deterioration in display quality can be performed.

According to the data storage medium of the present invention (claim 20), the encoded image display data corresponding to each object, which is transmitted in units of individual objects displayed on the display screen, is transmitted. Storing the image display data as a binary value corresponding to each pixel in a predetermined area including the corresponding object on the display screen, indicating whether the pixel is located inside the object or outside the object; A binary shape bit string obtained by encoding the shape signal, and
A transparency bit string obtained by encoding a transparency signal corresponding to the transparency of the image of the object, and corresponding to each of the pixels,
A pixel value bit sequence obtained by encoding a pixel value signal for displaying the object in color,
Since the transparency bit string is arranged so as to be transmitted after the binary shape bit string and the pixel value bit string, an error occurs during transmission of image data in the image display device by using the data storage medium. Even in this case, it is possible to decode the bit sequence of the binary shape signal and the pixel value signal, which are more important than the transmittance signal for performing the image display, with a high probability, thereby deteriorating the display quality. Reproduction of a small number of images can be performed.

According to the image transmission data structure of the present invention (claim 21), the pixel corresponding to each pixel in the predetermined area including the object on the display screen is located inside the object, or A binary shape bit string obtained by encoding a binary shape signal indicating whether the object is located outside the object, and a transmittance indicating the transparency of the object corresponding to each pixel constituting the object on the display screen. A transparency bit string obtained by encoding the signal, and a pixel value bit string obtained by encoding a pixel value signal for displaying the object in color corresponding to each pixel constituting the object on the display screen. Is included as a part of the image encoded data, and a pixel value synchronization signal indicating a head position of the pixel value bit string and a transparency synchronization signal indicating a head position of the transparency bit string are included in the image encoding data. Since the pixel value bit string and the transparency bit string are arranged so as to be transmitted following the corresponding synchronization signal, an error occurs during the transmission of the encoded data for the image display data. Even in this case, it is possible to identify the data of each bit string by following the encoded data from the front end or the rear end of the encoded data to the error occurrence position on the basis of the synchronization signal. As a result, even if a transmission error occurs, it is possible to avoid as much as possible to hinder the decoding process of important encoded data at the transmission destination. Can be done in a short time.

According to the present invention (claim 22), in the image transmission data structure according to claim 21, the pixel value synchronization signal and the pixel value bit string are transmitted following the transparency synchronization signal and the transparency bit string. As described above, since these synchronization signals and bit strings are arranged, a pixel value bit string, which is important data in the unit bit stream, is arranged at the end, and an error occurs during transmission of the unit bit stream. Thus, it becomes possible to trace an important pixel value bit string from the end of the unit bit stream and decode it in a short time.

According to the present invention (claim 23), in the image transmission data structure according to claim 21, the transparency synchronization signal and the transparency bit string are transmitted following the pixel value synchronization signal and the pixel value bit string. As described above, since these synchronization signals and bit strings are arranged, a transparency bit string, which is insignificant data in the unit bit stream, is arranged at the end of the bit stream, and on the decoding side,
When the transparency information is not required, the transparency information can be easily discarded.

When an error occurs in a part of the pixel value bit string during transmission of the unit bit stream, the data in the pixel value bit string is determined based on the resynchronization signals located before and after the important pixel value bit string. Most data of the pixel value bit string can be decoded by following the shortest time from the front end and the rear end to the error occurrence position.

According to the present invention (claims 24 and 25),
When encoding image display data corresponding to an object on the display screen, each pixel corresponding to each pixel in a predetermined area including the corresponding object on the display screen is located inside the object or outside the object. A binary shape signal indicating whether the object is located is encoded to generate a binary shape signal bit string, and a pixel value corresponding to each pixel constituting the corresponding object on the display screen for displaying the object in color The signal is encoded to generate a pixel value bit string, and a transparency signal indicating the transparency of the image of the object corresponding to each pixel constituting the corresponding object on the display screen is encoded to form a transparency bit string. Generate
A pixel value synchronizing signal indicating the head position of the pixel value bit string and a transparency synchronizing signal indicating the head position of the transparency bit string are generated, and the pixel value bit string and the transparency bit string are respectively synchronized with the synchronization signal And output as a part of the encoded image data, so that even if an error occurs during the transmission of the encoded data for the image display data, the encoding is performed based on the synchronization signal. The data of each bit string can be identified by following the encoded data from the front end or the rear end of the encoded data to the error occurrence position. As a result, even if a transmission error occurs, it is possible to avoid as much as possible to hinder the decoding process of important encoded data at the transmission destination. Can be done in a short time.

According to the present invention (claims 26 and 27),
When performing a decoding process on image encoded data corresponding to a predetermined area including an individual object displayed on a display screen, obtained by the encoding method according to claim 24, for each block dividing the predetermined area. , Decoding the binary shape bit sequence to generate the binary shape signal, and converting the pixel value bit sequence into
Based on the corresponding pixel value synchronization signal, the pixel value signal is detected from the image encoded data, and the detected pixel value bit sequence is decoded to generate the pixel value signal. Based on the synchronization signal, detection is performed from the image encoded data, the detected transmission bit sequence is decoded to generate the transmission signal, and based on each of the generated signals, an individual displayed on a display screen is displayed. Since the image display data corresponding to the object is reproduced, even if a transmission error occurs, it is possible to avoid as much as possible to hinder the decoding of important encoded data at the transmission destination. In this case, it is possible to obtain a decoding method and a decoding device capable of decoding a bit stream having a data structure for image transmission, which can perform decoding processing of important encoded data in a short time.

According to the data storage medium of the present invention (claim 28), when encoding image display data corresponding to each object on the display screen, a predetermined area including the corresponding object on the display screen is encoded. Indicating whether the pixel is located inside the object or outside the object, corresponding to each pixel of
Encoding the value shape signal to form a binary shape bit string, encoding the pixel value signal corresponding to each pixel constituting the corresponding object on the display screen, and displaying the object in color. A process of forming a pixel value bit string, corresponding to each pixel constituting a corresponding object on the display screen,
Encoding a transparency signal indicating the transparency of the object to form a transparency bit string, generating a pixel value synchronization signal indicating a head position of the pixel value bit string and a transparency synchronization signal indicating a head position of the transparency bit string; Since a program for causing a computer to perform the process of performing the above process and the process of arranging and outputting the pixel value bit sequence and the transparency bit sequence so that these bit sequences are transmitted following the corresponding synchronization signal is stored, By loading the program into the computer, even if an error occurs during the transmission of the encoded data for the image display data, it is possible to minimize the trouble in decoding the important encoded data at the transmission destination. In this case, important encoded data can be decoded in a short time.

According to the data storage medium of the present invention (claim 29), the image code corresponding to the predetermined area including the individual object displayed on the display screen, obtained by the encoding method of claim 24, Storing a program that causes a computer to perform a process of decoding the coded data for each block that divides the predetermined region, and instructs the computer to decode the binary shape bit sequence and convert the binary shape signal to a computer. Forming, detecting the pixel value bit string from the image encoded data based on the corresponding pixel value synchronization signal, decoding the detected pixel value bit string to form the pixel value signal, and , Detecting the transparency bit string from the image encoded data based on the corresponding transparency synchronization signal, and decoding the detected transparency bit string. Since the processing for forming the transmission signal is performed by a computer, the transmission of the program to the computer enables the transmission destination to decode important encoded data even if a transmission error occurs. A decoding method and a decoding method capable of decoding a bit string of a data structure for image transmission, which can minimize the occurrence of trouble and can perform decoding processing of important encoded data in a short time at this time. Device can be realized.

According to the data storage medium of the present invention (claim 30), each block dividing the predetermined area into image display data corresponding to a predetermined area including an individual object displayed on the display screen. And stores the image encoded data obtained by performing the encoding process on the display screen. The image encoded data corresponds to each pixel in a predetermined area including the corresponding object on the display screen. Or a binary shape signal indicating whether the object is located outside the object, a binary shape bit sequence obtained by encoding the binary shape signal, and a binary shape bit string corresponding to each pixel constituting the relevant object on the display screen. The transparency signal indicating the transparency, the transparency bit string obtained by encoding, corresponding to each pixel constituting the corresponding object on the display screen, a pixel value signal for color display of the object, encoding, Get And a pixel value synchronizing signal indicating a head position of the pixel value bit string and a transparency synchronizing signal indicating a head position of the transparency bit string. Of the pixel value bit string and the transparency bit string are arranged so as to be transmitted following the corresponding synchronization signal, so that the image encoded data having the data structure is used. Thus, even if an error occurs during the transmission of encoded data to the image display data, the decoding device should avoid as much as possible to interfere with decoding of important encoded data at the transmission destination. In this case, important encoded data can be decoded in a short time.

[Brief description of the drawings]

FIG. 1 is a diagram showing a unit bit stream as a transmission repetition unit in an image transmission data structure according to a first embodiment of the present invention.

FIG. 2 is a diagram conceptually showing an encoding process for generating encoded image data having an image transmission data structure according to the first embodiment and a decoding process for decoding the encoded image data.

FIG. 3 is a block diagram illustrating a configuration of an encoding device that performs an encoding process according to the first embodiment.

FIG. 4 is a block diagram illustrating a configuration of a decoding device that performs a decoding process according to the first embodiment.

FIG. 5 is a diagram showing a flow of an encoding process according to the first embodiment.

FIG. 6 is a diagram showing a flow of a decoding process according to the first embodiment.

FIG. 7 is a diagram for explaining an image display signal used for computer graphic processing conforming to MPEG4. FIGS. 7 (a), (b) and (c) show a binary shape signal of an object, The image information corresponding to the transmittance signal and the pixel value signal is shown. FIG. (D) shows a background image, and FIG. (E) shows a composite image of the object and the background image.

FIG. 8 is a diagram for describing a foreground (object) encoding process in MPEG4.

FIG. 9 is a diagram showing a unit bit stream as a repetition unit of transmission in an image transmission data structure of foreground image information in MPEG4.

FIG. 10 is a diagram showing another unit bit stream which is a transmission repeating unit in an image transmission data structure of foreground image information in MPEG4.

FIG. 11 is a diagram for explaining a data structure for image transmission according to the second and third embodiments of the present invention.
(b) is a diagram showing a unit bit stream as a transmission repetition unit in the second and third embodiments.

FIG. 12 is a block diagram illustrating a configuration of an encoding device that generates encoded image data having an image transmission data structure according to the second embodiment.

FIG. 13 is a block diagram for describing a configuration of a decoding device that decodes encoded image data having an image transmission data structure according to the second embodiment.

FIG. 14 is a diagram showing a flow of an encoding process by the encoding device of the second embodiment.

FIG. 15 is a diagram showing a flow of a decoding process by the decoding device of the second embodiment.

FIG. 16 is a diagram for explaining a data recording medium for storing a program for realizing the encoding or decoding device according to the embodiment by a computer system; ) And (b) are diagrams showing the structure of the data recording medium, and FIG. 16 (c) is a conceptual diagram showing the system.

[Explanation of symbols]

1-3 Unit bit stream 10, 10a, 20, 20a, 30, 30a Encoding unit 11 Binary shape motion detection circuit 12, 52 Binary shape motion compensation circuit 13, 23, 33, 53, 63, 73 Memory 14 2 Value shape encoding circuit 15, 54 Switch 22, 62 Transparency motion compensation circuit 24 Transparency encoding circuit 31 Pixel value motion detection circuit 32, 72 Pixel value motion compensation circuit 50, 50a, 60, 60a, 70, 70a Decoding section 61 Transparency encoding circuit 71 Pixel value encoding circuit 100 Image display signal transmission system 100a Encoding device 100b Decoding device 110a to 110c Encoding circuit 120 Multiplex processing unit 130 Separation processing unit 140a to 140c Decoding circuit 150 Synthesis Processing unit Dbp MB position bit string Dh Encoded data of header (header bit string) hs slice header bit string D2mv coded data of binary shape motion vector (first bit example) D2ot coded data of binary data (second bit string) Dgtmv coded data of pixel value / transparency motion vector (motion vector) Bit string) Dg Encoded data of pixel value signal (pixel value bit string) Dt Encoded data of transparency signal (transparency bit string) Dty texture type bit string Dga Pixel value AC component bit string Dta Transparency AC component bit string Dgd Pixel value DC component bit string Dtd Transparency DC component bit string Dgsyn Pixel value synchronization signal Dtsyn Transparency synchronization signal

Claims (30)

[Claims] 1. An image transmission data structure for transmitting image encoded data obtained by encoding image display data corresponding to an individual object displayed on a display screen for each object, wherein: A binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen and indicating whether the pixel is located inside the object or outside the object, obtained by encoding a binary shape signal A shape bit string is included as a part of the image encoded data. The binary shape bit string encodes motion vector information obtained from the binary shape signal and indicating the motion of the object on a display screen. An obtained first bit string, and a second bit string obtained by encoding the binary shape signal based on the motion vector information, wherein the first and second bit strings are Second
A data structure for image transmission, which is arranged so as to be transmitted earlier than the bit string of (1). 2. The image transmission data structure according to claim 1, wherein the predetermined area including the object on the display screen is divided into a plurality of blocks, and the first bit string is the binary shape. The motion vector information obtained from the signal is obtained by encoding the motion vector information by an amount corresponding to a predetermined number of adjacent blocks of the plurality of blocks. A data structure for image transmission, which is obtained by encoding a portion corresponding to a predetermined number of adjacent blocks among the plurality of blocks based on the motion vector information. 3. The image transmission data structure according to claim 1, wherein, in addition to the binary shape bit string, a transparency of an image of the object corresponding to each pixel constituting the object on the display screen. A transparency bit string obtained by encoding the corresponding transmittance signal, and a pixel value signal corresponding to each pixel constituting the corresponding object on the display screen and obtained by encoding a pixel value signal for displaying the object as an image. A pixel value bit string and a motion vector indicating the motion of the object on the display screen, which is common to the pixel value signal and the transmittance signal and is obtained by at least the pixel value signal of the two signals, is obtained by encoding. A motion vector bit sequence and a header bit sequence obtained by encoding relevant information related to each of the bit sequences are included as a part of the image encoded data. A binary bit sequence, a motion vector bit sequence, a pixel value bit sequence, and a transparency bit sequence are arranged to be transmitted in this order following a header bit sequence transmitted to the image transmission data structure. 4. An image transmission data structure for transmitting image encoded data obtained by encoding image display data corresponding to each object displayed on a display screen for each object, wherein: A binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen and indicating whether the pixel is located inside the object or outside the object, obtained by encoding a binary shape signal A shape bit string, and a transparency signal corresponding to the transparency of an image of the object corresponding to each pixel configuring the corresponding object on the display screen,
A transparency bit string obtained by encoding, and a pixel value bit string obtained by encoding a pixel value signal corresponding to each pixel constituting the corresponding object on the display screen for displaying the object in color, A data structure for image transmission, including as a part of the image encoded data, wherein each of the bit strings is arranged such that the transparency bit string is transmitted after a binary shape bit string and a pixel value bit string. 5. The image transmission data structure according to claim 4, wherein the predetermined area including the corresponding object on the display screen is divided into a plurality of blocks, and the binary shape bit string is The shape signal is encoded by an amount corresponding to a predetermined number of adjacent blocks among the plurality of blocks, and the transparency bit string is obtained by encoding the transparency signal into an adjacent one of the plurality of blocks. The pixel value bit string encodes the pixel value signal by an amount corresponding to a predetermined number of adjacent blocks among the plurality of blocks. A data structure for image transmission, comprising: 6. The image transmission data structure according to claim 4, wherein, in addition to said bit strings, said pixel value signal and said transparency signal are common and are obtained from at least a pixel value signal of said two signals. A motion vector indicating a motion of the object on the display screen is encoded, and a motion vector bit sequence obtained by encoding the motion vector bit sequence is included as a part of the image encoded data. The binary shape bit sequence is obtained from the binary shape signal. A first bit sequence obtained by encoding motion vector information indicating the motion of the object on the display screen; and a second bit sequence obtained by encoding the binary shape signal based on the motion vector information. The bit sequences are arranged such that the motion vector bit sequence is transmitted after the transmission of the first bit sequence, and then the second bit sequence is transmitted. Data structure for image transmission, characterized in that the. 7. An encoding method for encoding image display data corresponding to an individual object displayed on a display screen for each object and outputting image encoded data, the image encoding method comprising: On the display screen of the object based on a binary shape signal corresponding to each pixel in the predetermined area including the object and including binary data indicating whether the pixel is located inside the object or outside the object. A motion detection process for detecting a motion vector indicating the motion in the above, a process for encoding the motion vector to generate a first bit string, and a process for converting the binary data constituting the binary shape signal based on the motion vector Encoding to generate a second bit string, arranging the bit strings so that the first bit string is transmitted before the second bit string, and outputting the bit strings as a part of the image encoded data. Encoding method, characterized by. 8. An encoding method for encoding image display data corresponding to an individual object displayed on a display screen for each object and outputting image encoded data, wherein the image display data corresponds to the corresponding object on the display screen. A process of encoding a binary shape signal corresponding to each pixel in a predetermined region including the object and indicating whether the pixel is located inside the object or outside the object, to generate a binary shape signal bit string; A process of encoding a pixel value signal corresponding to each pixel constituting the corresponding object on the display screen for displaying the object in color to generate a pixel value bit string; A transparency signal corresponding to the transparency of the image of the object corresponding to each pixel constituting the object,
A process of generating a transparency bit sequence by encoding, wherein each of the bit sequences is arranged so that the transparency bit sequence is transmitted after the binary shape bit sequence and the pixel value bit sequence, and a part of the image encoded data is An encoding method characterized by outputting as 9. An encoding apparatus for encoding image display data corresponding to an individual object displayed on a display screen for each object and outputting encoded image data, wherein the encoding apparatus outputs a corresponding image on the display screen. On the display screen of the object based on a binary shape signal corresponding to each pixel in the predetermined area including the object and including binary data indicating whether the pixel is located inside the object or outside the object. Motion detecting means for detecting a motion vector indicating the motion in the above, first encoding means for encoding the motion vector to generate a first bit string, and binary data constituting the binary shape signal. Second encoding means for encoding the motion vector based on the motion vector to generate a second bit sequence, and arranging each of the bit sequences so that the first bit sequence is transmitted before the second bit sequence. The above picture Encoding apparatus and outputs as part of the encoded data. 10. An encoding apparatus which encodes image display data corresponding to each object displayed on a display screen for each object and outputs image encoded data, wherein the image display data corresponds to the corresponding object on the display screen. A binary shape signal corresponding to each pixel in a predetermined region including the object and indicating whether the pixel is located inside the object or outside the object, and generating a binary shape signal bit string by encoding the binary shape signal Shape encoding means, and pixel value encoding means for encoding a pixel value signal corresponding to each pixel constituting the object on the display screen for displaying the object in color to generate a pixel value bit string And, corresponding to each pixel constituting the corresponding object on the display screen, the transparency signal corresponding to the transparency of the image of the object,
Transparency encoding means for encoding to generate a transparency bit sequence, wherein each of the bit sequences is arranged so that the transparency bit sequence is transmitted after the binary shape bit sequence and the pixel value bit sequence, and the image encoding is performed. An encoding device characterized by outputting as a part of data. 11. A decoding method for decoding image encoded data corresponding to each object obtained by the encoding method according to claim 7, wherein the first bit string is decoded and the binary A process of generating a motion vector obtained from a shape signal; a process of decoding the second bit string based on the motion vector to generate binary data forming the binary shape signal; Generating the binary shape signal based on the binary data, and reproducing image display data corresponding to each object displayed on the display screen. 12. A decoding method for decoding image encoded data corresponding to each object, obtained by the encoding method according to claim 8, wherein the binary shape bit sequence is decoded to decode the binary shape bit sequence. A process of generating a signal; a process of decoding the pixel value bit sequence to generate the pixel value signal; and a process of decoding the transparency bit sequence to generate the transparency signal. A decoding method comprising: reproducing image display data corresponding to an individual object displayed on a display screen based on a signal. 13. A decoding device for decoding image encoded data corresponding to each object, obtained by the encoding method according to claim 7, wherein the first bit string is decoded, and First decoding means for generating a motion vector obtained from a shape signal; and second decoding means for decoding the second bit string based on the motion vector to generate binary data forming the binary shape signal. And a third decoding means for generating the binary shape signal based on the output of each of the decoding means, wherein an image display corresponding to each object displayed on the display screen is provided. A decoding device for reproducing data for use. 14. A decoding device for decoding image encoded data corresponding to each object, obtained by the encoding method according to claim 8, wherein the binary shape bit string is decoded to decode the binary shape bit string. A binary shape decoding means for generating a signal; a pixel value decoding means for decoding the pixel value bit string to generate the pixel value signal; and a transmission means for decoding the transparency bit string to generate the transparency signal. A decoding device for reproducing image display data corresponding to an individual object displayed on a display screen based on an output of each of the decoding devices. 15. A data storage medium that stores a program for performing, by a computer, an encoding process for encoding image display data corresponding to an individual object displayed on a display screen and outputting image encoded data. The program stores a binary shape corresponding to each pixel in a predetermined area including the corresponding object on the display screen, indicating whether the pixel is located inside the object or outside the object. A process of detecting a motion vector indicating a motion of the object on the display screen based on the signal; a process of encoding the motion vector to generate a first bit string; a binary data constituting the binary shape signal Is generated based on the motion vector to generate a second bit string, and each of the bit strings is set so that the first bit string is ahead of the second bit string. Data storage medium characterized by in sequence to be transmitted is intended to perform a process of outputting as part of said encoded image data. 16. A data storage medium which stores a program for performing a coding process for outputting image encoded data by encoding image display data corresponding to each object displayed on a display screen by a computer. The program is for the computer to provide a binary value corresponding to each pixel in a predetermined area including the corresponding object on the display screen, indicating whether the pixel is located inside the object or outside the object. A process of encoding a shape signal to generate a binary shape bit sequence, a pixel value bit sequence corresponding to each pixel constituting the corresponding object on the display screen and encoding a pixel value signal for displaying the object in color Encoding a transparency signal corresponding to the transparency of the image of the object corresponding to each pixel constituting the corresponding object on the display screen. And a process of arranging the bit strings so that the transparency bit string is transmitted after the binary shape bit string and the pixel value bit string, and outputting the bit string as a part of the image encoded data. A data storage medium characterized by performing the following. 17. Data storing a program for performing, by a computer, decoding processing on image encoded data corresponding to an individual object displayed on a display screen, obtained by the encoding method according to claim 7. A storage medium, wherein the program causes a computer to decode the first bit string and generate a motion vector obtained from the binary shape signal, and to convert the second bit string based on the motion vector Decoding and generating the binary data constituting the binary shape signal; and reproducing the binary shape signal based on the motion vector and the binary data. Characteristic data storage medium. 18. A data storage storing a program for causing a computer to perform a decoding process on image encoded data corresponding to an individual object displayed on a display screen, obtained by the encoding method according to claim 8. A medium, wherein the program causes a computer to decode the binary shape bit sequence to generate the binary shape signal, decode the pixel value bit sequence to generate the pixel value signal, and A data storage medium for performing a process of decoding the transparency bit string to generate the transparency signal. 19. A data storage medium storing image encoded data obtained by encoding image display data corresponding to an individual object displayed on a display screen for each object, wherein the image encoded data is Is obtained by encoding a binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen and indicating whether the pixel is located inside the object or outside the object. A first bit string obtained by encoding motion vector information indicating the motion of the object on the display screen, obtained from the binary shape signal, and A second bit sequence obtained by encoding the binary shape signal based on the motion vector information, wherein the first and second bit sequences are transmitted such that the first bit sequence is transmitted before the second bit sequence. A data recording medium characterized in that the data recording medium is arranged in such a manner. 20. A data storage medium storing image encoded data obtained by encoding image display data corresponding to each object displayed on a display screen for each object, wherein the image encoded data is Is obtained by encoding a binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen and indicating whether the pixel is located inside the object or outside the object. A binary shape bit string, a transparency bit string obtained by encoding a transparency signal corresponding to each pixel constituting the corresponding object on the display screen and corresponding to the transparency of the image of the object, And a pixel value bit sequence obtained by encoding a pixel value signal for color-displaying the object, corresponding to each pixel constituting the corresponding object, and Data storage medium, characterized in that is obtained by sequence to be transmitted serial after the binary shape bit streams and the pixel value bit streams. 21. Image-encoded data obtained by performing an encoding process on image display data corresponding to a predetermined area including an individual object displayed on a display screen for each block dividing the predetermined area. Is a data structure for transmitting images collectively for each slice area consisting of a predetermined number of blocks arranged in the order of encoding processing, and corresponds to each pixel in the predetermined area including the corresponding object on the display screen. A binary shape bit string obtained by encoding a binary shape signal indicating whether the pixel is located inside the object or outside the object, and each pixel constituting the corresponding object on the display screen And a transparency bit string obtained by encoding a transparency signal indicating the transparency of the object, and a color display of the object corresponding to each pixel constituting the corresponding object on the display screen. And a pixel value bit sequence obtained by encoding a pixel value signal for encoding, as a part of the image encoded data, and a pixel value synchronization signal indicating a head position of the pixel value bit sequence and a head position of the transparency bit sequence. The transmission synchronization signal shown
A data structure for image transmission, which is included as a part of the image encoded data, wherein the pixel value bit sequence and the transparency bit sequence are arranged to be transmitted following a corresponding synchronization signal. 22. The image transmission data structure according to claim 21, wherein the pixel value synchronization signal and the pixel value bit sequence are transmitted so as to be transmitted subsequent to the transparency synchronization signal and the transparency bit sequence. A data structure for image transmission characterized by being arranged. 23. The image transmission data structure according to claim 21, wherein the transparency synchronization signal and the transparency bit sequence are transmitted so as to be transmitted subsequent to the pixel value synchronization signal and the pixel value bit sequence. A data structure for image transmission characterized by being arranged. 24. Encoding processing is performed on image display data corresponding to a predetermined area including an individual object displayed on a display screen for each block dividing the predetermined area to generate image encoded data. An encoding method for outputting the encoded image data collectively for each slice area including a predetermined number of blocks arranged in the order of encoding processing, wherein each pixel in a predetermined area including a corresponding object on the display screen is Encoding a binary shape signal indicating whether the pixel is located inside the object or outside the object, and generating a binary shape signal bit string corresponding to the object; A process of encoding a pixel value signal for color-displaying the object corresponding to each pixel constituting the pixel, and generating a pixel value bit string; and a process corresponding to each pixel constituting the corresponding object on the display screen. A process of encoding a transparency signal indicating the transparency of the image of the object to generate a transparency bit sequence; a pixel value synchronization signal indicating a head position of the pixel value bit sequence and a transparency indicating a head position of the transparency bit sequence. Generating a synchronizing signal, and arranging the pixel value bit string and the transparency bit string so that these bit strings are transmitted following the corresponding synchronizing signal, and forming a part of the image encoded data. An encoding method characterized by outputting as 25. Encoding processing is performed on image display data corresponding to a predetermined area including an individual object displayed on a display screen for each block dividing the predetermined area to generate image encoded data. An encoding apparatus that outputs the encoded image data collectively for each slice area including a predetermined number of blocks arranged in the order of encoding processing, wherein each pixel in a predetermined area including a corresponding object on the display screen is A binary shape encoding means for encoding a binary shape signal indicating whether the pixel is located inside the object or outside the object to form a binary shape signal bit string, the display screen corresponding to A pixel value encoding unit that encodes a pixel value signal for color-displaying the object, corresponding to each pixel configuring the corresponding object, and generates a pixel value bit string; Transparency encoding means for encoding a transparency signal indicating the transparency of the object corresponding to each pixel constituting the object to generate a transparency bit sequence; and a pixel value synchronization signal indicating a head position of the pixel value bit sequence. And a synchronizing signal generating means for generating a transmissivity synchronizing signal indicating a head position of the transmissivity bit sequence. The pixel value bit sequence and the transparency bit sequence are transmitted following the synchronizing signal corresponding to each of these bit sequences. An encoding apparatus characterized by arranging and outputting in such a manner. 26. A block obtained by the coding method according to claim 24, wherein the block is divided into image coded data corresponding to a predetermined area including individual objects displayed on a display screen. A decoding method for decoding the binary shape bit string to generate the binary shape signal; and converting the pixel value bit string into the image based on a corresponding pixel value synchronization signal. A process of detecting from the encoded data, decoding the detected pixel value bit sequence to generate the pixel value signal, and transmitting the transparency bit sequence from the image encoded data based on the corresponding transparency synchronization signal. Detecting and decoding the detected transparency bit sequence to generate the transparency signal, and corresponding to each object displayed on the display screen based on the generated signals. Decoding method characterized by reproducing the image data for display that. 27. Decoding for each block dividing the predetermined area into image coded data corresponding to a predetermined area including individual objects displayed on a display screen, obtained by the coding method according to claim 24. A first decoding means for decoding the binary shape bit sequence to form the binary shape signal; and converting the pixel value bit sequence into a corresponding pixel value synchronization signal. Second decoding means for detecting the pixel value bit sequence by detecting the pixel value bit sequence from the image encoded data on the basis of the above, and transmitting the transparency bit sequence to the corresponding transparency synchronization A third decoding means for detecting from the coded image data based on the signal and decoding the detected transparency bit sequence to form the transparency signal, based on an output of each of the decoding means. , Decoding apparatus and generates an image display data corresponding to an individual object displayed on 示画 plane. 28. Encoding processing is performed on image display data corresponding to a predetermined area including an individual object displayed on a display screen for each block dividing the predetermined area to generate image encoded data. A data storage medium storing a program for performing, by a computer, a process of outputting the image encoded data collectively for each slice region including a predetermined number of blocks arranged in the order of encoding process, the program comprising: The computer encodes a binary shape signal corresponding to each pixel in a predetermined area including the corresponding object on the display screen and indicating whether the pixel is located inside the object or outside the object. A process of forming a binary shape bit string, a pixel value signal corresponding to each pixel constituting the corresponding object on the display screen for displaying the object in color, Processing to form a pixel value bit string, corresponding to each pixel constituting the corresponding object on the display screen, a process of encoding a transparency signal indicating the transparency of the object, forming a transparency bit string, A process of generating a pixel value synchronizing signal indicating the head position of the pixel value bit string and a transparency synchronizing signal indicating the head position of the transparency bit string; and these bit strings correspond to the pixel value bit string and the transparency bit string, respectively. A data storage medium for performing a process of arranging and outputting the signals following the synchronization signal to be transmitted. 29. Image-encoded data corresponding to a predetermined area including individual objects displayed on a display screen, obtained by the encoding method according to claim 24, is decoded for each block dividing the predetermined area. A computer-readable storage medium storing a program for causing a computer to perform a process of converting the binary shape bit string into a binary shape signal; Is detected from the coded image data based on the corresponding pixel value synchronization signal, and the process of decoding the detected pixel value bit sequence to form the pixel value signal; and From the image coded data based on the transparency synchronization signal corresponding to, and decodes the detected transparency bit sequence to form the transparency signal Data storage medium, characterized in that to perform that process. 30. Image-encoded data obtained by performing an encoding process on image display data corresponding to a predetermined area including an individual object displayed on a display screen for each block dividing the predetermined area. Wherein the image encoded data corresponds to each pixel in a predetermined area including the corresponding object on the display screen, and the pixel is located inside the object or outside the object. A binary shape bit string obtained by encoding a binary shape signal indicating whether the object is located, and a transparency signal indicating the transparency of the object corresponding to each pixel constituting the object on the display screen, A transparency bit string obtained by encoding, and a pixel value signal corresponding to each pixel constituting the corresponding object on the display screen, a pixel value signal for displaying the object in color, and a pixel value bit string obtained by encoding , Together with the included as part of the coded image data, the transparency synchronizing signal indicating the head position of the pixel value synchronization signal and the transparency bit stream indicating the head position of the pixel value bit streams,
A data storage medium including a part of the image encoded data, wherein the pixel value bit string and the transparency bit string are arranged so as to be transmitted following a corresponding synchronization signal.