JPH11220735A - Image encoding method and image decoding method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reinforce transmission line error resistance while suppressing the deterioration of encoding efficiency in an image encoder. SOLUTION: In this method, a block transmission encoder 1030 for encoding and outputting block transmission information which shows whether or not an object block is a non-object shaped block is provided, only when encoding mode of the object block is inter-screen encoding mode, an output of the block transmission encoder 1030 is added to a shape bit stream as a block transmission signal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image encoding method and an image decoding method, and more particularly, to a method of reducing image quality degradation when a transmission error occurs when transmitting an image signal. And a decoding process corresponding thereto, and an image output data structure of a pixel coded signal obtained by the above coding process. In addition, the present invention is to reduce the number of coding bits without impairing error tolerance when transmitting an image signal using a video packet (data transmission unit) so that image quality deterioration due to transmission error of the image signal is reduced. And a decoding process corresponding thereto. Further, the present invention provides an image encoding device that performs the above-described encoding process, an image decoding device that performs the above-described decoding process, and data that stores an image processing program that implements the above-described encoding and decoding processes by software. It relates to a storage medium.

[0002]

2. Description of the Related Art In recent years, a multimedia era has been entered in which voice, image, and other data are handled in an integrated manner. Has become a feature of multimedia. Generally, multimedia means not only characters, but also graphics, sounds, and especially images, etc., which are simultaneously associated with each other. Is an essential condition. However, when the information amount of each information medium is estimated as a digital information amount, the information amount per character is 1-2 bytes in the case of characters, while 64 Kbits per second in the case of voice (telephone quality). In addition, for a moving image, an information amount of 100 Mbits per second (current television broadcast quality) or more is required, and it is not realistic to handle such enormous information in a digital form in an information medium such as a television. For example, a videophone is 64Kbps
Integrated Services Digital Network (ISDN) with transmission speed of ~ 1.5Mbps
Has already been put into practical use, but it is impossible to send the image of a television camera directly through ISDN. Therefore, information compression technology is required. For example, in the case of a videophone, H.264 standardized internationally by ITU-T (International Telecommunication Union Telecommunication Standardization Sector). 26
A moving image compression technology of one standard is used. MPE
According to the information compression technology of the G1 standard, a normal music CD
(Compact disc) can also contain image information along with audio information.

Here, MPEG (Moving Picture Exper)
ts Group) is an international standard for data compression of moving images.
That is, it is a standard for compressing information of a television signal to about 1/100. In addition, since the data transmission speed for the MPEG1 standard is mainly limited to about 1.5 Mbps, moving picture data is compressed to 2 to 15 Mbps in MPEG2, which is standardized to meet the demand for higher image quality. You. Furthermore, at present, a working group (ISO / IEC JTC1 / SC29 / WG) that has been working on standardization with MPEG1 and MPEG2
As a result, MPEG4, which enables encoding processing and signal operation on an object basis and realizes new functions required in the multimedia age, is being standardized. This MPEG4
At first, we aimed to standardize low-bit-rate encoding methods, but now we are aiming for standardization of more general-purpose encoding methods, including high-bit-rate encoding methods for interlaced images. Processing has been extended.

FIG. 34 is a view for explaining an image signal composed of a shape signal and a pixel value signal. FIG. 34A shows a background image Tb obtained from an image signal, and FIG.
FIG. 34 shows a foreground image Tf obtained from the pixel value signal.
(d) shows the shape Sf of the foreground image obtained from the shape signal. FIG. 34C shows a combined image Gc obtained by combining the background image and the foreground image. As shown in FIG. 34, when synthesizing two images such as the background image Tb and the foreground image Tf, each pixel in the synthesized image Gc is determined according to any pixel value of the foreground image Tf and the background image Tb. You have to decide if you want to make a display.
In other words, for each pixel in the composite image Gc, it must be determined whether or not the background image Tb is located in a portion hidden by the foreground image Tf. To make such a determination, a shape signal representing the shape Sf of the object in the foreground image is required. Here, the shape signal is composed of data (sample value) corresponding to each pixel indicating the shape of the object, and the pixel value signal is data (pixel) corresponding to each pixel for displaying the image of the object in gradation color. Value).

[0005] In MPEG4, encoding processing is standardized so that a decoding apparatus can combine a foreground image and a background image in accordance with a user's instruction. For each image space including the object, a shape signal indicating the shape of the object is transmitted from the image encoding device to the image decoding device together with a pixel value signal for performing gradation display such as color display of the image space. You. By the way, the pixel values of the pixels outside the object in the foreground image space are not used for image synthesis in the image decoding device, and thus need not be transmitted to the image decoding device. That is, from the viewpoint of the encoding efficiency of the image encoding device, if the shape signal is transmitted to the image decoding device, the image encoding device encodes only the pixel values inside the object shape necessary for image synthesis. Is desirable. Therefore, in MPEG4, the shape signal is referred to in the encoding process of the pixel value signal in the image encoding device and the decoding process of the pixel value signal in the image decoding device. Only the pixel values inside the object shape necessary for image synthesis are encoded.

[0006] Further, as for an image processing system using an encoding process conforming to MPEG4, use of a communication line in which a transmission line error is likely to occur as a transmission line is actively considered. In the processing, a mechanism for enhancing error resilience is adopted. A typical example of the mechanism for enhancing error resilience is to introduce a transmission unit of an encoded signal called a video packet.
This video packet is obtained by grouping image signals corresponding to a plurality of continuous macroblocks so as to have a fixed code amount, and forms a macroblock band having an arbitrary length in MPEG1 or MPEG2 encoding processing. This corresponds to the corresponding slice layer. As shown in FIG. 35, an image signal corresponding to a macroblock includes a luminance signal Y corresponding to each of four blocks (sub-blocks) that divide the macroblock, and color difference signals U and V corresponding to the macroblock. It is composed of Note that FIG.
Indicates a relationship between a video packet, which is a transmission unit of an image signal, and a macroblock or a subblock.

In such image processing using video packets, a display screen corresponding to one frame or one field is divided so as to correspond to a video packet composed of a plurality of macroblocks as shown in FIG. This video packet contains all the information necessary to prevent significant image quality degradation if the pixel values of the pixels inside the target video packet to be processed can be decoded correctly. Therefore, in principle, information that affects the syntax and semantics required when decoding the pixel values of the pixels in the video packet is complete in the video packet. On the other hand, for information that does not affect syntax or semantics, a pixel value outside a video packet may be referred to. For example, when acquiring the information of the reference image in the motion compensation processing, even if the information of the reference image is slightly distorted due to the influence of the transmission path error,
This information distortion does not affect the syntax or semantics of the target video packet, and the decoded image decoded from the distorted reference image contains only a small amount of distortion. This does not lead to a significant deterioration in image quality.

Next, an image signal corresponding to a video packet is divided into image signals corresponding to macroblocks as in MPEG1 and MPEG2, as shown in FIG. 35, and this image signal further forms the macroblock. It is divided into a luminance signal Y corresponding to four blocks and color difference signals U and V corresponding to macro blocks. Here, the macro block is a basic unit for switching the encoding process for the image signal between intra-frame encoding and inter-frame encoding or performing motion compensation in the encoding process. This is a basic unit of an encoding process for orthogonally transforming a pixel value corresponding to each pixel in an image signal or a residual pixel value corresponding to each pixel by motion compensation and performing variable length encoding.

[0009] For an image signal including a shape signal indicating the shape of an object in addition to the pixel value signal, an efficient pixel value signal encoding process using the shape signal is performed. That is, in this encoding process, if the target macroblock to be processed is one in which all the pixels inside it are located outside the object area (the area occupied by the object in the image space), Since the pixel value of each pixel in the macroblock does not need to be coded, the coding process for the motion vector and the pixel value of the macroblock is skipped. Similarly, if a block (sub-block) constituting a macroblock has all the pixels inside it located outside the object area, it is not necessary to encode pixel values for the pixels in the block. Therefore, the encoding process of the pixel value for the block is skipped.
This means that whether or not a macroblock and a block have all the pixels located outside the object area has an important meaning in a pixel value encoding process, and therefore, all of the macroblocks and the block. If the determination of whether or not the pixel is located outside the object area is incorrect, it is impossible to analyze the syntax of the encoded bit stream corresponding to the pixel value, which means that the bit stream cannot be decoded at all. .

FIG. 36 shows an image coded signal Eg obtained by coding an image signal including a shape signal together with a pixel value signal.
2 shows a signal format (data structure) of the first embodiment. As shown in the figure, the image coded signal Eg is composed of a header information H at the head, a shape bit stream Bs obtained by coding the shape signal, and a pixel value bit obtained by coding the pixel value signal. And a stream Bg. Here, since the pixel value bit stream Bg is decoded by the image decoding device with reference to the decoded shape signal (decoded shape bit stream), the image encoded signal Eg has the shape signal Are arranged after the shape bit stream Bs obtained by the encoding of Also, the header information H includes the spatial position of the coded image signal, that is, which part of the image on the display screen the image signal corresponds to, and whether the image signal is encoded in the error resilience mode. An identification signal or the like indicating whether or not the information has been converted is described. Note that, depending on the use of the encoding process on the image signal, the case where the image signal corresponding to one macroblock has the data structure shown in FIG.
7 may have the data structure shown in FIG.

FIG. 37 shows a conventional shape bit stream B.
The signal format (data structure) of s is shown in detail. In this shape bit stream Bs, first, a mode encoded signal B obtained by encoding the encoded mode signal
s1 is arranged, and thereafter, a shape-encoded signal Bs2 obtained by encoding the shape signal based on the encoding mode is arranged. Here, the above-mentioned coding mode signal indicates in which coding mode the shape signal corresponding to one macroblock is to be coded, and this coding mode signal is, for example, a target macroblock. Is encoded in the screen.

FIG. 38 is a block diagram of a conventional image coding apparatus. In the figure, 1200a is the shape signal 10
01 and the pixel value signal 1002 as input signals, and the shape signal 1001 and the pixel value signal 1002 corresponding to the target block to be processed on the target screen to be processed
Is an image encoding device that sequentially performs encoding processing on the image data. The image encoding device 1200a includes a mode encoded signal 1100 and a shape signal 1 obtained by encoding the encoded mode signal.
001 obtained by encoding 001
1 and a pixel value bit stream 1103 obtained by encoding the pixel value signal 1002 are multiplexed and output as one multiplexed bit stream.

That is, the image encoding apparatus 1200a
Is a mode determiner 1010 that determines a coding mode based on the shape signal 1001 and outputs a coding mode signal 1010a, and a mode coding that codes the coding mode signal 1010a and outputs a mode coding signal 1100. Device 1011. Also, the image encoding device 1
200a performs intra-coding processing on the shape signal 1001 to output an intra-coded signal 1015a, and performs local decoding processing on the intra-coded signal 1015a to generate an intra-local decoded signal 1015b.
And an inter-screen encoder 1015 for outputting the inter-coding signal 1014a by performing an inter-screen coding process of the shape signal 1001 of the target screen with reference to the shape signal of the previous screen. The signal 1014a is subjected to local decoding processing to obtain an inter-local decoded signal 1014.
14b, which outputs an output signal 14b.

Further, the image encoding device 1200a includes:
A first selector switch 1013 for supplying the shape signal 1001 to one of the encoders 1014 and 1015 based on an output (encoding mode signal) 1010a of the mode determiner 1010, and an encoding mode signal 1010
a second changeover switch 1016 that selects an encoded signal output from one of the encoders 1014 and 1015 based on a and outputs it as a shape encoded signal 1101
And a third switch 1017 for selecting a local decoded signal output from one of the encoders 1014 and 1015 based on the encoding mode signal 1010a and outputting the selected signal as a restored shape signal 1017a. ing.
Further, the image encoding device 1200a outputs the restored shape signal 101 output from the third switch 1017.
7a for storing the restored shape signal 10a.
17a, a block that determines whether the target block is a transparent block (that is, whether all pixels of the target block are located outside the object) and outputs determination result information as block transparent information 1019a It has a transmission determiner 1019 and a pixel value encoder 1020 that performs an encoding process on the pixel value signal 1002 based on the block transmission information 1019a to generate a pixel value bit stream 1103.

Next, the operation will be described. The shape signal 1001 and the pixel value signal 10 are supplied to the image encoding device 1200a.
When 02 is input, the coding mode of the shape signal 1001 is determined by the mode determiner 1010.
An encoding mode signal 1010a indicating the encoding mode determined by the determiner 1010 is output from the switch 101.
3, and is supplied to the mode encoder 1011 at the same time as being supplied to the switch 1016 and the switch 1017. Then, the encoding mode signal 1010a is subjected to encoding processing by the mode encoder 1011 and output as a mode encoded signal 1100.

At this time, the switch 1013 sets the shape signal 10 if the encoding mode is the intra-screen encoding mode.
01 is encoded by the intra-frame encoder 1015, and if the encoding mode is the inter-frame encoding mode, the shape signal 10
Switching control is performed so that 01 is encoded by the inter-screen encoder 14. The above-described intra-screen encoder 1015 performs intra-screen encoding on the shape signal 1001 to generate an intra-coded signal 1015a, and performs intra-local decoding by local decoding of the intra-coded signal 1015a. A shape signal 1015b is generated. At this time, the intra-coded signal 1015a is
16 and the locally decoded shape signal 1015b is output to the switch 1017.

On the other hand, in the inter-picture encoder 1014,
With reference to the decoded shape signal (restored shape signal) 1012 corresponding to the reference screen stored in the memory 1018, an inter-screen coding process is performed on the shape signal 1001 to generate an inter-coded signal 1014a. , A local decoded signal 1014b is generated by local decoding of the inter-coded signal 1014a. The inter-coded signal 1014a is output to the switch 1016, and the locally decoded signal 1014b is output to the switch 1017.
Here, the switches 1016 and 1017 operate when the encoding mode is the intra-screen encoding mode.
015 is selected, and if the coding mode is the inter-screen coding mode, switching control is performed so that the output of the inter-screen encoder 1014 is selected. The output of the switch 1016 is used as the shape encoded signal 1101 in the image encoding device 1.
The restored shape signal 1017a output to the outside of the switch 200a and output from the switch 1017 is stored in the memory 1018. The restored shape signal 1 stored in the memory 1018
017a is referred to as a decoded shape signal when the shape signal corresponding to the subsequent screen is encoded by the inter-screen encoder 1014.

The block transmission determining unit 1019 determines whether or not the target block is a transmission block (a block in which all pixels are located outside the object area) based on the restored shape signal 1017a. The block transmission information 1019a as a result of the determination is supplied to the pixel value encoder 1020. Then, the pixel value encoder 1020 performs an encoding process on the pixel value signal 1002 according to whether the target block is a transparent block, and outputs a pixel value bit stream 1103.
Here, the target block is MPEG1, MP1
Corresponds to a macroblock or a block (subblock) constituting the macroblock in the encoding process conforming to EG2.

FIG. 39 is a block diagram of a conventional image decoding apparatus. The image decoding device 1200b receives, as an input signal, a multiplexed bit stream transmitted from the image encoding device 1200a shown in FIG. That is, the image decoding apparatus 1200b extracts the mode coded signal 1100, the shape coded signal 1101, and the pixel value bit stream 1103 from the multiplexed bit stream, and performs decoding processing on these signals as processing targets. A shape signal 1110 obtained by decoding the shape coded signal 1101 and a pixel value signal 1111 obtained by decoding the pixel value bit stream 1103 are sequentially performed for each target block to be processed in the target screen.
Is output.

The details will be described below.
00b decodes the mode coded signal 1100 and reproduces a coded mode signal (also simply referred to as a coded mode signal).
A mode decoder 1050 that outputs 1050a, an intra-screen decoder 1053 that performs intra-screen decoding on the shape-coded signal 1101 and outputs an intra-decoded signal 1053a, and a previous screen. Reproduction shape signal 1
055a, the shape encoded signal 110 of the target screen
1 and an inter-screen decoder 1052 that performs inter-screen decoding processing on 1 and outputs an inter-decoded signal 1052a.

Further, the image decoding apparatus 1200b includes:
The shape coded signal 1101 is converted to the mode decoder 10
A first changeover switch 1051 for supplying one of the two decoders 1053 and 1052 based on the output (encoding mode signal) 1050a of the F.50, and the two decoders 1053 based on the reproduction encoding mode signal 1050a. , 1
And a second changeover switch 1054 for selecting one of the outputs 1053a and 1052a of the signal 052 and outputting the selected signal as a reproduction shape signal (also simply referred to as a shape signal) 1110.

Further, the image decoding apparatus 1200b
Is a memory 1055 for storing a shape signal 1110 output from the second switch 1054;
10, it is determined whether or not the target block is a transparent block (that is, whether or not all pixels inside the target block are located outside the object area), and the determination result information is referred to as reproduction block transparent information (simply, The block transmission determining unit 1 outputs the block transmission information as 1060a.
060 and a decoding process on the pixel value bit stream 103 based on the block transmission information 1060a to obtain a reproduction pixel value signal (also simply referred to as a pixel value signal) 11.
And a pixel value decoder 1063 that generates the pixel value 11.

Next, the operation will be described. The mode coded signal 1100 extracted from the multiplexed bit stream from the coding side is reproduced by a decoding process in a mode decoder 1050 and output as a coded mode signal 1050a. It is supplied to the switch 1051 and the switch 1054 as a control signal. At this time, if the encoding mode for the shape encoded signal 1101 is the intra-screen encoding mode, the switch 1051 decodes the shape encoded signal 1101 by the intra-screen decoder 1053, and In the case of the inter-frame encoding mode, the shape encoded signal 1101 is used.
Are controlled in accordance with the encoding mode signal 1050a so that is decoded by the inter-picture decoder 1052.

The intra-screen decoder 1053 performs intra-screen decoding on the shape-coded signal 1101,
The intra-decoded signal 1053a is output to the switch 1054. The inter-picture decoder 1052 performs inter-picture decoding on the shape coded signal 1101 with reference to the decoded shape signal 1055a of the reference picture stored in the memory 1055, and performs inter-picture decoding. The decoded signal 1052a is output to the switch 1054. When the encoding mode for the shape encoded signal 1101 is the intra-screen encoding mode, the switch 1054 selects the output 1053a of the intra-screen decoder 1053 and sets the encoding mode to the inter-screen encoding mode. If,
Switching is controlled according to the encoding mode signal 1050a so that the output 1052a of the inter-picture decoder 1052 is selected. The reproduction shape signal 1054a output from the switch 1054 is stored in the memory 1055.
The reproduction shape signal 1055 stored in the memory 1055
a is referred to as a decoded shape signal when the shape-coded signal corresponding to the subsequent screen is decoded by the inter-screen decoder 1052.

In the block transmission decision unit 1060, the shape signal 105 output from the switch 1054 is output.
4a, the target block is a transparent block (a block in which all pixels are located outside the object area)
Is determined, and block transmission information 1060a indicating the determination result is supplied to the pixel value decoder 1063. The pixel value decoder 1063 performs a decoding process on the pixel value bit stream 1103 according to the block transmission information 1060a, that is, whether the target block is a transmission block or not. Is output. The target block corresponds to an MPEG1 or MPEG2 macroblock or a block constituting the macroblock.

As described above, in image processing conforming to MPEG4, an image signal corresponding to a screen D corresponding to one frame or one field is called a plurality of video packets as shown in FIG. The video signal is divided into predetermined signal transmission units, and the image signal corresponding to the video packet is further divided into image signals corresponding to processing units called macroblocks as shown in FIG. 40 (b). The method is not limited to the division method using a macroblock line composed of a plurality of macroblocks arranged in the horizontal scanning direction on the screen as shown in FIG. In an actual encoding process, the image signal corresponding to the macroblock is further divided into image signals corresponding to processing units called individual sub-blocks constituting the macroblock.

For example, as another method of dividing an image signal corresponding to a screen so as to correspond to a video packet, as shown in FIG. Alternatively, there is a method of dividing an image signal of one screen so that a plurality of video packets are included in one macroblock line.

FIG. 41 is a block diagram showing the overall configuration of a conventional image coding apparatus. In the figure, 2200a is
Receiving the image signal 2001 and the refresh signal 2002,
This is an image encoding apparatus that sequentially performs encoding processing on an image signal 2001 corresponding to a target block to be processed in a target screen to be processed. Here, the refresh signal 2002 is a signal for forcibly instructing whether or not to perform the intra-frame encoding process from the outside.
Reference numeral 1 denotes a pixel value signal for displaying an image of an object in gradation color. By the way, M which processes an image signal on an object basis
In an image processing method corresponding to the PEG4 standard, an image signal is required to process a pixel value signal for displaying an object image in gradation color and an image signal for each object.
Although the configuration includes a shape signal indicating the shape of the object, here, for convenience of explanation, the image signal is assumed to represent a pixel value signal, and the encoding process of the pixel value signal is performed for each object. A description of a shape signal referred to at this time and a circuit configuration for performing encoding processing of the shape signal is omitted.

The image encoding device 2200a includes an image signal (pixel value signal) 2001 and the refresh signal 2
002, indicating the type of encoding process on the image signal (that is, performing any one of the intra-coding process, the inter-coding process, and the non-coding process that does not perform the encoding process on the image signal) Mode determiner 20 that determines the coding mode and outputs coding mode signal 2100
10, an encoding mode intra-screen encoder 2013 for performing an intra-screen encoding process on the encoding mode signal 2100, and an encoding mode inter-screen encoder for performing an inter-screen encoding process on the encoding mode signal 2100 2014, a first switch 2011 provided in front of these encoders 2013 and 2014, and both encoders 2013 and 2014
And a second changeover switch 2012 provided at the subsequent stage.

Here, the first changeover switch 2011
Is a coding mode signal 21 which is an output of the mode determiner 2010 based on the refresh signal 2002.
00 is supplied to one of the encoders 2013 and 2014 so as to be supplied to one of the encoders 2013 and 2014. And 201
4 is selected and output as a mode coded signal 2003.

Further, the image encoding device 2200a
A pixel value intra-screen encoder 2016 for performing an intra-screen encoding process on the image signal 2001, a pixel value inter-screen encoder 2017 for performing an inter-screen encoding process on the image signal 2001, these encoders 2016 and A third switch 2015 provided in a stage preceding the 2017;
Changeover switch 2 provided at the subsequent stage of
018.

Here, the third changeover switch 2015
Is an input contact 2015 to which the image signal 2001 is input.
a, an output contact 2015b1 connected to the input of the encoder 2016, an output contact 2015b2 connected to the input of the encoder 2017, and an open output contact 20
15b3, and the coding mode signal 2100
, The input contact 2015a is connected to any of the three output contacts 2015b1 to 2015b3. Further, the fourth changeover switch 2
018 has one output contact 2018b with an input contact 2018a1 connected to the output of the encoder 2016, an input contact 2018a2 connected to the output of the encoder 2017, and an open input contact 2018a3. The output contact 2018b is connected to the three input contacts 20b based on the encoding mode signal 2100.
18a1 to 2018a3.

Next, the operation will be described. When the image signal 2001 and the refresh signal 2002 are input to the present image encoding device 2200a, the encoding mode determination unit 201
In the case of 0, it is determined for each macroblock whether the encoding process is to be performed in any of the encoding modes of the intra-picture coding and the inter-picture coding. At this time, the encoding mode decision unit 20
A refresh signal 2002 for instructing whether to perform forcible intra-frame coding is also input from outside to the coding mode determination unit 2010 by the refresh signal 2002. At the start time or at a fixed cycle, the encoding mode is forcibly determined to be the intra-screen encoding mode. As a result, the effect of the past transmission path error is completely cut off. Specifically, when the intra-screen encoding mode is instructed by the refresh signal 2002, the encoding process corresponds to the MPEG1 or MPEG2 I-frame (intra-frame) encoding process.

The above-mentioned encoding modes include, for example, the following encoding modes A to C. Encoding mode A: A mode in which the image signal corresponding to the target macroblock is intra-coded Encoding mode B: The image signal corresponding to the target macroblock is inter-coded, and a residual signal by motion compensation Coding mode C: a mode in which the image signal corresponding to the target macroblock is inter-coded and the residual signal due to motion compensation is not coded. The target macroblock is When the encoding process is performed for each macroblock, the macroblock to be processed has been subjected to the encoding process of the corresponding image signal.

Further, in the encoding process for each object conforming to the MPEG4, it is necessary to encode information indicating a positional relationship between an object shape and a target macroblock. It is added to encoding modes A to C. Coding mode a: A mode in which an encoding process is performed according to a case where all pixels of the target macroblock are located outside the object. An encoding mode b: A code corresponding to a case where all pixels of the target macroblock are located inside the object. Mode in which the encoding process is performed. Encoding mode c: a mode in which the encoding process is performed according to the case where there are a pixel of the target macroblock located inside the object and a pixel located outside the object. Is switched depending on whether or not the refresh signal 2002 instructs the screen to perform an intra-screen encoding process. That is, the first and second
Switches 2011 and 2012 are switched by the refresh signal 2002 and the refresh signal
02 designates an intra-screen encoding process, the encoding mode intra-screen encoder 2013 executes the encoding mode signal 210.
0 is performed, otherwise, the coding mode signal 210
An encoding process of 0 is performed. At this time, the second changeover switch 2012 outputs an encoding control signal (hereinafter, also referred to as a mode encoding signal) 2003 indicating the encoding mode and obtained by encoding the encoding mode signal. .

The third changeover switch 2015
Is controlled by an encoding mode signal 2100 output from the encoding mode determiner 2010 so that an encoding method for encoding the pixel value of each pixel constituting the image signal 2001 is switched. That is, when each pixel value is to be intra-coded, the image signal 2001 is supplied to the intra-screen encoder 2016. When each pixel value is to be inter-coded, the image signal 2001 is supplied to the inter-screen encoder 2017. Supplied. On the other hand, when the encoding of the pixel value is unnecessary, for example, when the residual signal is not encoded, or when all the pixel values of the target macroblock are outside the object, the encoding process on the pixel value is not performed. .

The fourth changeover switch 2018 is
According to the encoding mode signal 2100, the encoder 2
Input terminal 2018 connected to outputs of 016 and 2017
The output terminal 2018b is controlled to select any one of the a1, 2018a2 and the open terminal 2018a3, and the output of the changeover switch 2018 becomes the encoded image signal 2004 obtained by encoding the image signal. Then, the mode coded signal 2003 and the coded image signal 2004 are transmitted to the image decoding device together with the refresh signal 2002.

FIG. 42A shows an encoding mode signal 2100.
FIG. 10 is a schematic diagram for describing an intra-screen encoding process for. Here, a plurality of macro blocks are arranged in a matrix in one frame screen.
(i, j) indicates the ith macroblock from the left end of the frame screen and the jth macroblock from the upper end of the frame screen.

When the coding mode value F (i, j) is to be encoded using the macroblock M (i, j) as the macroblock to be coded (target macroblock), the neighboring coded macroblock M (i-1, j-1), M (i-1, j), M (i, j-1) coding mode values F (i-1, j-1), F (i-1, j), F (i, j-1), and according to the coding mode values F (i-1, j-1), F (i-1, j), F (i, j-1). The encoding mode value of the encoded macroblock M (i, j)
Determine the encoding method for F (i, j). Note that, for convenience of the following description, the encoding mode value of the encoded macroblock is referred to as an encoded mode value as needed, and the neighboring encoded macroblock and its encoding mode value are referred to as reference macroblocks, respectively. They are called block and reference coding mode values.

Specifically, the reference macro block M (i
-1, j-1), M (i-1, j), M (i, j-1)
j-1), F (i-1, j), and the coding mode value F (i, j) of the macroblock M (i, j) to be encoded is variable according to F (i, j-1). The encoding table for long encoding is switched. In particular, when arithmetically encoding the encoded mode value F (i, j), the prediction probability of the encoding mode value F (i, j) corresponding to the above encoding table is calculated using the reference encoding mode value F (i, j). (i-1, j-1), F (i-1, j), F (i, j-
The calculation from 1) is performed.

FIG. 42 (b) is a schematic diagram for explaining the inter-picture encoding process for the encoding mode signal 2100. Also in this figure, it is assumed that a plurality of macro blocks are arranged in a matrix in one frame screen, the target frame screen to be processed is a frame screen (N), and a macro block on this frame screen (N) Block M (i, j) indicates the ith macroblock from the left end of the frame screen and the jth macroblock from the upper end of the frame screen. The frame screen (N-1) is a frame screen immediately before the frame screen (N), and the macro block BM (i, j) on the previous frame screen (N-1) is The i-th macroblock from the left end of the screen (N-1) and the j-th macroblock from the upper end of the previous frame screen (N-1) are shown.

The above-mentioned frame screen (N) is set as a processing target frame screen, and a macroblock M (i, j) on the screen is set as a processing target macroblock, and its encoding mode value F (i, j) is set.
Is encoded, the coding mode value BF ( i, j), and determines the encoding method of the mode value F (i, j) of the target macroblock M (i, j) according to the value BF (i, j). Specifically, an encoding table for performing variable length encoding of the encoded mode value F (i, j) is switched according to the encoded mode value BF (i, j).

FIG. 43 is a block diagram for describing the conventional encoding mode intra-frame encoder 2013 in detail.
In the figure, reference numeral 2100 denotes an encoding mode value intra-screen encoder 201
3 is an input signal (encoding mode signal). In the encoder 2013, the encoding mode encoder 2110 encodes the input signal 2100 (encoded mode value) with reference to the encoded mode value, and outputs the mode encoded signal 2101. At this time, the encoding mode signal (encoding mode value) 2100 of the target macroblock to be processed
Are stored in the encoding mode memory 2111 and are referred to by the encoding mode encoder 2110 when encoding the encoding mode signal of the subsequent macroblock. If the reference macroblock is a macroblock having no coding mode, for example, a macroblock located outside the screen or outside the object, this macroblock is coded in a predetermined coding mode. Treat as

FIG. 44 is a block diagram for describing the conventional encoding mode inter-picture encoder 2014 in detail.
In the figure, reference numeral 2100 denotes an encoding mode inter-screen encoder 2014
(Encoding mode signal). In this encoder 2014, the encoding mode encoder 2110 refers to the encoded mode value to input signal (encoded mode value) 2
100 and outputs a mode coded signal 2101. At this time, the encoding mode signal 2 of the current macroblock
101 is stored in the encoding mode memory 2111.

When the encoding process is performed on an object basis, the size of the object may change considerably between screens. In this case, the encoding process of the encoding mode signal to be referred to is omitted. This frequently occurs, and the coding efficiency may be degraded. Therefore, when the encoding mode signal is inter-coded, it is necessary to use a predetermined encoding mode value as the reference encoding mode value when encoding of the encoding mode value to be referred to is omitted. Is generated from the coding mode value that is coded according to. Here, the inter-screen coding reference mode generator 2112 performs the above-described processing, and uses the coded mode value read from the coding mode memory 2111 to calculate the coding mode value to be referenced in the subsequent coding. It is configured to generate and output to the encoding mode encoder 2110.

FIG. 45 is a diagram for describing the intra-picture encoding process of the pixel value. Here, for example, in a display area corresponding to a processing unit such as a macro block, a plurality of pixels are arranged in a matrix, and a pixel g (i, j) is an i-th pixel from the left end of the display area. And the j-th pixel from the upper end of FIG.

For example, when a pixel g (i, j) is to be encoded and its pixel value f (i, j) is encoded,
The encoded pixel g (i-2, j-1), ..., located near (i, j)
With reference to the pixel values f (i-2, j-1), ..., f (i, j-1) of g (i, j-1), these pixel values f (i-2, j- 1),..., F (i, j−1), and determine the encoding method of the pixel value f (i, j) of the pixel to be encoded.

Note that the pixel value of the pixel to be coded is referred to as the pixel value to be coded as necessary for convenience of the description, and the coded pixel located in the vicinity of the pixel to be coded and the pixel value thereof are described below. , Are referred to as a reference pixel and a reference pixel value, respectively.

Specifically, reference pixel values f (i−2, j−1),.
An encoding table for performing variable length encoding of the encoded pixel value f (i, j) is switched according to the value of (i, j-1). Especially,
When the pixel value f (i, j) is arithmetically coded, the prediction probability of the pixel value f (i, j) corresponding to the coding table is calculated using the reference pixel value f (i-2, j-1). ), ..., f (i, j-1). In addition, the pixel value inter-screen coding is the same as the intra-pixel value coding except that the pixels of the previous screen which are coded and transmitted at the time before the target screen to be processed can be referred to. The description will be omitted.

FIG. 46 shows a conventional image coding apparatus 2200a.
21 is a block diagram for describing in detail a pixel value intra-screen encoder 2016 in FIG. In the figure, reference numeral 2102 denotes an input signal (pixel value signal) of the intra-pixel value encoder 2016. In this encoder 2016, the pixel value encoder 2113 refers to the encoded pixel value to input signal 210
2 (pixel value signal) and a pixel value encoded signal 210
3 is output. At this time, the pixel value signal 2102 of the current macroblock is stored in the pixel value memory 2114, and is referred to by the pixel value encoder 2113 when encoding the pixel value signal of the subsequent macroblock.

When referring to the pixel value of a pixel that has not been encoded, for example, when the reference pixel is located outside the screen or outside the object, the encoding of the pixel value of that pixel is omitted. If there is, the reference pixel is treated as if a predetermined pixel value has been encoded. Further, the configuration of the pixel value inter-screen encoder 2017 constituting the image encoding device 2200a is the same as that of the pixel value intra-screen encoder 2020.
Since the circuit configuration is the same as that of FIG. 16, the description of the configuration of the pixel value inter-screen encoder 2017 is omitted.

FIG. 47 shows a conventional image decoding apparatus 2200b.
It is a block diagram for explaining. FIG.
1 shows a configuration of an image decoding device that decodes an image encoded signal obtained by the encoding process in the conventional image encoding device 2200a shown in FIG. This image decoding device 2200
b denotes an encoding mode intra-screen decoder 2022 that applies intra-picture decoding to the mode encoded signal 2003 and an encoding mode inter-picture decoder 2023 that applies inter-picture decoding to the mode encoded signal 2003. And these decoders 20
It has a first changeover switch 2020 provided at a stage preceding the decoders 22 and 2023, and a second changeover switch 2021 provided at a stage subsequent to the decoders 2022 and 2023.

Here, the first changeover switch 2020
Is based on a refresh signal 2002 supplied from the outside, and the mode coded signal 2003 is
022 and 2023 are controlled so as to be supplied to one of them.
Numeral 021 is configured to select one of the outputs of the two decoders 2022 and 2023 based on the refresh signal 2002 and to output the selected one as a decoded coding mode signal 2100.

The image decoding device 2200b
A pixel value in-screen decoder 2025 for performing an in-screen decoding process on the coded image signal 2004;
Pixel value inter-screen encoder 20 for performing inter-screen decoding on pixel 4
26, a pixel value skip decoding encoder 2027 that performs inter-screen skip decoding processing on the image encoded signal 2004
And a third changeover switch 2024 provided before the decoders 2025 to 2027 and a fourth changeover switch 2028 provided after the decoders 2025 to 2027. .

Here, the third changeover switch 2024
Is the input contact 20 to which the image encoding signal 2004 is input.
24a, an output contact 2024b1 connected to the input of the decoder 2025, an output contact 2024b2 connected to the input of the decoder 2026, and the decoder 202
7, the output contact 2024b3 is connected to the input of the output contact 2024a based on the decoded encoding mode signal 2100.
024b1 to 2024b3. Also, the fourth switch 2028
Together with an input contact 2028a1 connected to the output of the decoder 2025, an input contact 2028a2 connected to the output of the decoder 2026, and an input contact 2028a3 connected to the output of the decoder 2027 It has three output contacts 2028b, and is configured to connect the output contact 2028b to any one of the three input contacts 2028a1 to 2028a3 based on the encoding mode signal 2100.

Next, the operation will be described. When a refresh signal 2002 is input from the outside, switching control of the first and second switches 2020 and 2021 is performed by the refresh signal 2002. At this time, if refresh signal 2002 indicates intra-screen encoding, encoding mode intra-frame decoder 2022 decodes mode encoded signal 2003 to generate encoded mode signal 2001, and refresh signal 2002 indicates that the refresh signal 2002 When the inner coding is not instructed, the coding mode inter-picture decoder 2023 decodes the mode coding signal 2003 to generate the coding mode signal 2100. Here, the switch 2021
Is an encoded mode signal 2100 decoded.

The third switch 2024 is connected to the encoding mode signal 2100 obtained by the decoding process.
Is controlled so that the decoding method for decoding the image coded signal 2004 is switched. At this time, the third switch 2024 operates when the intra-screen decoding process is performed on the encoded image signal 2004.
Is selected, and the inter-picture decoder 2026 is selected when the inter-picture decoding process is performed on the coded image signal 2004. On the other hand, if the image signal (pixel value) corresponding to the predetermined pixel is not encoded, for example, if the residual signal is not encoded, or if the pixel to be decoded is located outside the current macroblock, , The output of the pixel value skip decoder 2027 that generates a pixel value corresponding to a case where the encoding process of the pixel value is skipped.

The fourth switch 2028 is controlled based on the coding mode signal 2100 so that the output signal of each decoder for decoding the coded image signal is selected. Is the image decoding signal 202
It becomes 9. As described above, it is possible to correctly decode the coded image signal obtained by the coding process in the conventional image coding device 200a of FIG.

FIG. 48 is a block diagram for explaining in detail the conventional encoding mode in-picture decoder 2022.
This encoding mode intra-screen decoder 2022 decodes the mode encoded signal 2003 obtained by the encoding process in the encoding mode intra-screen encoder 2023 shown in FIG.

This encoding mode intra-screen decoder 2022
Then, the coding mode decoder 2210 refers to the decoded coding mode signal 2201 and encodes the mode coded signal 2100 obtained by coding the coding mode signal 2100.
200 (the mode coded signal 2003 shown in FIG. 47) is decoded and a coded mode signal 2201 is output. The coding mode signal 2201 obtained by the above decoding is stored in the decoding mode memory 2211 and is referred to by the coding mode decoder 2210 when decoding the mode coded signal corresponding to the subsequent macroblock. You.

In the process of decoding the mode coded signal, when the coding mode refers to a coding mode in which the coding mode signal is not decoded (for example, when the reference macro block is In such a case, the encoding mode is treated as if a predetermined encoding mode signal has been decoded. As described above, it is possible to correctly decode the mode coded signal obtained by the coding process in coding mode intra-screen coder 2013 shown in FIG.

FIG. 49 shows a conventional image decoding apparatus 2200b.
FIG. 21 is a block diagram for describing an encoding mode inter-screen decoder 2023 in detail. The encoding mode inter-screen decoder 2023 shown in FIG. 49 is for decoding the mode-encoded signal encoded by the encoding mode inter-screen encoder 2014 shown in FIG.

This encoding mode inter-screen decoder 2023
Then, the encoding mode decoder 2210 decodes the mode encoded signal 2200 obtained by encoding the encoded mode signal with reference to the decoded encoding mode signal,
The decoded coding mode signal 2201 is output. At this time, the decoded encoding mode signal 2201 is stored in the decoding mode memory 2211.

The inter-picture decoding reference mode generator 22
In 12, a reference encoding mode signal is generated from the information stored in the decoding mode memory 2211. The reference encoding mode output from the inter-picture decoding reference mode generator 2212 is the inter-picture reference mode generator 21 shown in FIG.
12 is the same as the reference encoding mode signal output from FIG. As described above, it is possible to correctly decode the mode coded signal obtained by the coding process in the coding mode inter-screen coder 2014 shown in FIG.

FIG. 50 shows a conventional pixel value in-picture decoder 20.
FIG. 25 is a block diagram for explaining in detail 25. FIG.
The pixel value intra-picture decoder 2025 shown in FIG. 46 decodes a pixel value encoded signal obtained by encoding an image signal (that is, a pixel value) by the pixel value intra-picture encoder 2016 shown in FIG. . In the intra-pixel value decoder 2025, the pixel value decoder 2213 decodes the pixel value encoded signal 2202 obtained by encoding the pixel value of the target macroblock with reference to the decoded pixel value. , And outputs a decoded pixel value signal 2203. The decoded pixel value signal 2203 is stored in the decoded pixel value memory 2214, and is referred to by the pixel value decoder 2213 when decoding the pixel value encoded signal of the subsequent macro block.

In the above-mentioned decoding process, when a pixel value which has not been decoded is referred to, for example,
If the reference pixel is located outside the screen or outside the object, the reference pixel is treated as if a predetermined pixel value encoded signal has been decoded. As described above, it is possible to correctly decode the image encoded signal encoded by the pixel value intra-screen encoder 2016 shown in FIG. Since the inter-pixel value decoder 2026 can be realized by the same configuration as that of the conventional intra-pixel value decoder 25 shown in FIG. 50, the description is omitted. Also, the pixel value skip decoder 2
Numeral 027 generates a pixel value signal corresponding to a macroblock on which the pixel value has not been encoded on the encoding side, and performs processing such as outputting a pixel value signal of a fixed level.

[0067]

However, such a conventional image coding process has the following problems. That is, in the conventional image encoding processing and image decoding processing described with reference to FIGS. 34 to 39, whether or not a block is a transparent block greatly affects the encoding and decoding of the pixel value signal. Therefore, if a slight mismatch occurs between the image encoding device and the image decoding device with respect to the shape signal due to a transmission path error or the like, the pixel value signal cannot be decoded at all. That is, when the shape signal is inter-coded, an error affects a large number of screens, so that the quality of the image is greatly affected by a transmission path error.
On the other hand, if the encoding process for the shape signal is only intra-frame encoding, the effect of the transmission path error can be prevented from affecting many screens, but the number of bits cannot be reduced by using the inter-screen correlation of the image signal. The coding efficiency is greatly degraded.

In the conventional image encoding and decoding processes described with reference to FIGS. 40 to 50, only the encoding mode, the decoding mode, the encoded pixel value, and the decoded pixel value in the video packet are used. Since no reference is made, when the size of the video packet decreases, the coding efficiency deteriorates. That is,
When referencing the encoding mode signal or the pixel value corresponding to the macroblock outside the video packet, since the predetermined value is referred to uniformly, the predetermined value does not improve the encoding efficiency for all images. In some cases, the coding efficiency may be degraded by referring to the predetermined value.

In the encoding process of the encoding mode signal,
When encoding is performed on a target screen with reference to another locally decoded screen (frame), if a transmission error occurs in the referenced screen, decoding of the target screen encoded with reference to the error is performed. Conversion processing becomes impossible. This is because if a code that affects syntax or semantics cannot be decoded, the subsequent bit stream cannot be interpreted. As a result, the image quality is greatly deteriorated. In addition, if the inter-picture coding is not always used, the robustness against the transmission path error is enhanced. , And the corresponding decoding process, the coding efficiency is significantly reduced.

Further, by switching the type of encoding process and the type of decoding process corresponding to the type of encoding process according to the frequency of occurrence of transmission path errors, ideal encoding and decoding can be performed from the viewpoint of encoding efficiency and error resistance. Although it is possible to implement the method, it is necessary to prepare a configuration for performing independent encoding and decoding processes for low transmission path errors and high transmission path errors, which increases the scale of hardware, There is a disadvantage that the process for decoding is complicated.

The present invention has been made in order to solve the above-mentioned problems, and an image encoding method and an image encoding apparatus capable of strengthening transmission path error resistance while suppressing deterioration of encoding efficiency. , And an image decoding method and an image decoding apparatus corresponding thereto.
SUMMARY OF THE INVENTION It is an object of the present invention to provide an image output data structure that can enhance transmission path error resistance while suppressing degradation of encoding efficiency. An object of the present invention is to provide an encoding process capable of strengthening transmission path error resistance while suppressing deterioration of encoding efficiency, and a data recording medium storing a program for implementing a decoding process corresponding to the encoding process. With the goal. An object of the present invention is to provide an image encoding method and an image encoding device capable of improving encoding efficiency without deteriorating error resilience, and an image decoding method and an image decoding device corresponding thereto. And An object of the present invention is to provide an encoding process capable of improving encoding efficiency without deteriorating error resilience, and a data recording medium storing a program for implementing a decoding process corresponding to the encoding process. And

[0072]

An image encoding method according to the present invention (claim 1) comprises a shape signal indicating a shape of an object on a display screen and a pixel value signal for gradationally displaying the object. An image coding method for coding an image signal for each block that divides the display screen, wherein the shape signal is an intra-screen encoding mode using intra-screen correlation, and an inter-screen encoding using inter-screen correlation. Which coding mode is to be used for coding is determined for each of the above blocks, a coding mode signal indicating the determined coding mode is coded, and a mode coded signal is output. Based on the signal, the target block to be subjected to the encoding process generates block transmission information indicating whether or not the block is located outside the object shape, and the shape signal is generated in the determined encoding mode. Encoded with A shape-encoded signal is output, and the pixel-value signal is encoded with reference to the block transmission information to output a pixel-value-encoded signal. At this time, when the encoding mode is an inter-screen encoding mode , And encodes the block transmission information and outputs it as a block transmission signal.

According to a second aspect of the present invention, in the image encoding method of the first aspect, the mode encoded signal is multiplexed with the shape encoded signal and the pixel value encoded signal, and these are multiplexed into one. It is output as a bit stream.

According to a third aspect of the present invention, in the image encoding method according to the first aspect, the mode encoded signal and the block transmission signal are multiplexed together with the shape encoded signal and the pixel value encoded signal. These are output as one multiplexed bit stream.

According to a fourth aspect of the present invention, in the image encoding method according to the first aspect, a first encoding process is performed on the determined encoding mode signal to obtain a second encoding mode signal obtained by the encoding process. 1 is multiplexed with the block transmission signal, the shape coded signal, and the pixel value coded signal to be transmitted as a multiplexed bit stream, and the determined coding mode signal is subjected to the second coding. It performs processing and sends out the second mode encoded signal obtained by the encoding processing as a different bit stream different from the multiplexed bit stream.

According to a fifth aspect of the present invention, in the image encoding method of the fourth aspect, an intra-screen encoding process is performed as the second encoding process.

According to a sixth aspect of the present invention, in the image encoding method of the first aspect, the mode encoded signal, the shape encoded signal, and the pixel value encoded signal are multiplexed and transmitted as a multiplexed bit stream. In addition, the block transmission signal is transmitted as a different bit stream different from the multiplexed bit stream.

According to a seventh aspect of the present invention, in the image encoding method according to the first aspect, the process of encoding and transmitting the block transmission information is such that the encoding mode is an inter-screen encoding mode, and This is performed only when the mode is a mode that enhances the resistance of the encoded image signal to transmission errors.

According to an eighth aspect of the present invention, in the image encoding method according to the first or seventh aspect, the block is constituted by a plurality of sub-blocks, and the block transmission information is used as an object of encoding processing. This indicates whether or not each sub-block constituting the target block is located outside the object shape.

According to a ninth aspect of the present invention, there is provided an image decoding method for decoding an image coded signal obtained by coding an image signal by the image coding method according to the first aspect. The signal is decoded to generate an encoding mode signal indicating whether the shape signal is encoded in any one of the intra-picture encoding mode and the inter-picture encoding mode. Performing a decoding process corresponding to the encoding mode to generate a shape signal, and when the encoding mode is the intra-screen encoding mode, a target block to be decoded is located outside the object shape. Is generated from the decoded shape signal. On the other hand, when the encoding mode is the inter-screen encoding mode, the block transmission information is decoded. It generates block transmission information, and generates the pixel value signal by decoding the coded pixel value signal with reference to the block transmitted information.

According to a tenth aspect of the present invention, there is provided an image decoding method for decoding an image-encoded signal obtained by encoding according to the image encoding method according to the fourth aspect, wherein a mode code in the multiplexed bit stream is provided. The first
And a second decoding process is performed on the mode-coded signal in the another bit stream. When a transmission error in the multiplexed bit stream is equal to or more than a predetermined reference value, the second decoding process is performed. The coding mode of the shape coded signal is determined based on the coding mode signal obtained by the encoding process, and otherwise, based on the coding mode signal obtained by the first decoding process. Subjecting the shape-encoded signal to decoding processing corresponding to the determined encoding mode to generate a shape signal, and when the encoding mode is the intra-screen encoding mode, is subject to decoding processing. Block transmission information indicating whether or not the target block is located outside the object shape is generated from the shape signal obtained by the decoding, while the coding mode is inter-screen coding. Decoding the block transmission signal to generate the block transmission information, and decoding the pixel value coded signal with reference to the generated block transmission information to generate a pixel value signal. It is.

According to the present invention (claim 11), in the image decoding method according to claim 10, the mode coded signal included in the separate bit stream is obtained by intra-coding a coded mode signal. The second decoding process for the mode-coded signal in the different bit stream is an intra-screen decoding process.

According to a twelfth aspect of the present invention, there is provided an image decoding method for decoding an image signal obtained by encoding an image signal by the image encoding method according to the seventh aspect. The signal is decoded to generate an encoding mode signal indicating whether the shape signal is encoded in any one of the intra-picture encoding mode and the inter-picture encoding mode, and the Performing a decoding process corresponding to the encoding mode to generate a shape signal, and when the encoding mode is an inter-screen encoding mode and a mode for enhancing the transmission error resistance, the decoding process is performed. Block transmission information indicating whether or not the target block to be located is outside the object shape, is generated by decoding the block transmission signal, while the encoding mode is an inter-screen encoding mode. And when the mode is not a mode for enhancing the transmission error resistance, the block transmission information is generated from the decoded shape signal, and the pixel value encoded signal is decoded by referring to the block transmission information. To generate a pixel value signal.

According to a thirteenth aspect of the present invention, in the image decoding method according to the ninth or twelfth aspect, the block is constituted by a plurality of sub-blocks, and the block transmission information is used as an object of decoding processing. This indicates whether or not each sub-block constituting the target block is located outside the object shape.

An image output data structure according to the present invention (claim 14) converts an image signal consisting of a shape signal indicating the shape of an object on a display screen and a pixel value signal for gradationally displaying the object into an image signal. What is claimed is: 1. An image output data structure for outputting an image coded signal obtained by coding each block that divides a display screen, comprising: an intra-screen encoding mode using the intra-screen correlation of the shape signal; A first mode obtained by coding a coding mode signal indicating which coding mode of the inter-screen coding mode using inter-correlation is to be used for coding.
, A second bit sequence obtained by encoding block transmission information indicating whether or not the target block to be encoded is located outside the object shape, and the shape signal in both encoding modes And a fourth bit sequence obtained by encoding the pixel value signal with reference to the shape signal, wherein the first bit sequence is a second bit sequence. These bit strings are arranged such that the bit strings are transmitted earlier, the second bit string is transmitted before the third bit string, and the third bit string is transmitted before the fourth bit string.

According to the present invention (claim 15), in the image output data structure according to claim 14, the second bit string may be used in a case where the encoding mode is a mode for enhancing resistance to transmission errors of the image signal. Then, the above-mentioned block transmission information is obtained by encoding.

According to the present invention (claim 16), in the image output data structure according to claim 14 or 15, the block is composed of a plurality of sub-blocks, and the second bit string is an object of encoding processing. This is obtained by encoding block transmission information indicating whether or not the sub-block is located outside the object shape.

An image coding apparatus according to the present invention (claim 17) converts an image signal consisting of a shape signal indicating the shape of an object on a display screen and a pixel value signal for gradationally displaying the object into the display signal. What is claimed is: 1. An image coding apparatus for coding each block for partitioning a screen, wherein the shape signal is coded by any one of an intra-screen coding mode using intra-screen correlation and an inter-screen coding mode using inter-screen correlation. A mode determining unit that determines whether to perform encoding in a mode for each of the blocks,
A mode encoding unit that encodes an encoding mode signal indicating the determined encoding mode and outputs a mode encoded signal; and a target block to be encoded based on the shape signal is an object shape. Transmission determination means for generating block transmission information indicating whether the block is located outside,
When the encoding mode is an inter-screen encoding mode, a block transmission encoding unit that encodes the block transmission information and outputs a block transmission signal; and encodes the shape signal in a screen and outputs a shape encoded signal. An intra-screen encoding unit that performs inter-frame encoding of the shape signal of the target block and outputs a shape-encoded signal with reference to a shape signal corresponding to the encoded previous screen; Storage means for temporarily storing the shape signal encoded by the intra-screen encoding means and the inter-screen encoding means as an encoded screen shape signal; and encoding the pixel value signal with reference to the block transmission information. Pixel value encoding means for converting the pixel value into a pixel value encoded signal.

According to the present invention (claim 18), in the image coding apparatus according to claim 17, the mode encoding means performs a first encoding process on the encoded mode signal to perform a first mode encoding. A first mode encoder that outputs a coded signal, and a second mode coder that performs a second coding process on the coded mode signal and outputs a second mode coded signal. Multiplexing the first mode coded signal together with the shape coded signal and the pixel value coded signal to output a multiplexed bit stream, and the second mode coded signal is different from the multiplexed bit stream. This is output as a separate bit stream.

According to a nineteenth aspect of the present invention, in the image coding apparatus according to the eighteenth aspect, the second mode encoder performs intra-screen encoding on the encoded mode signal as a second encoding process. It is configured to perform processing.

According to a twentieth aspect of the present invention, in the image encoding apparatus according to the seventeenth aspect, the mode encoding signal
The multiplexed shape coded signal and the coded pixel value signal are output as a multiplexed bit stream, and the block transmission signal is output as a different bit stream different from the multiplexed bit stream.

An image decoding apparatus according to the present invention (claim 21) converts an image signal consisting of a shape signal indicating the shape of an object on a display screen and a pixel value signal for gradationally displaying the object onto the display screen. An image decoding apparatus that decodes an image coded signal obtained by coding in a predetermined coding mode for each block for partitioning, and decodes the mode coded signal from the coding side. Decoding is performed to generate an encoding mode signal indicating whether the shape signal is encoded in one of an intra-screen encoding mode using intra-screen correlation and an inter-screen encoding mode using inter-screen correlation. Mode decoding means, an in-screen decoding means for performing an in-screen decoding process on a shape-encoded signal from the encoding side to generate a shape signal, and a shape signal corresponding to the decoded previous screen. And then An inter-screen decoding means for performing an inter-screen decoding process on the shape-encoded signal to generate a shape signal, and a shape signal obtained by decoding by the intra-screen decoding means and the inter-screen decoding means to obtain a shape of a previous screen. Storage means for temporarily storing as a signal, and when the encoding mode is the intra-screen encoding mode, block transmission information indicating whether or not the target block to be decoded is located outside the object shape. , Generated from the decoded shape signal,
When the encoding mode is the inter-screen encoding mode, a block transmission information generating means for decoding a block transmission signal from the encoding side to generate block transmission information, and the pixel value by referring to the block transmission information Pixel value decoding means for performing a decoding process on the encoded signal to generate a pixel value signal.

According to a twenty-second aspect of the present invention, in the image decoding apparatus according to the twenty-first aspect, the mode decoding means is supplied from the encoding side together with the shape encoded signal and the pixel value encoded signal by a multiplexed bit stream. The first mode encoded signal is decoded, and the shape signal is encoded in any one of an intra-picture encoding mode using intra-picture correlation and an inter-picture encoding mode using inter-picture correlation. And a first mode decoder for generating a first encoding mode signal indicating whether the second mode encoding signal is supplied from the encoding side as a different bit stream different from the multiplexed bit stream. In this case, the shape signal is encoded in any one of an intra-picture encoding mode using intra-picture correlation and an inter-picture encoding mode using inter-picture correlation. Or the second and that a second mode decoder for generating an encoded mode signal indicating,
When the transmission error in the multiplexed bit stream is equal to or greater than a predetermined reference value, the second encoding mode signal is
In other cases, the first coding mode signal is selected and output as a coding mode signal.

According to a twenty-third aspect of the present invention, in the image decoding apparatus according to the twenty-second aspect, the second mode encoded signal supplied from the encoding side as a different bit stream different from the multiplexed bit stream is encoded. On the signal indicating the predetermined encoding mode on the encoding side, and the second mode decoder outputs the signal indicating the predetermined encoding mode to the second mode encoded signal. The configuration is such that an inner decoding process is performed to generate a second encoding mode signal.

A data storage medium according to the present invention (claim 24) is a data storage medium storing an image processing program for performing image processing by software. , 6 as an image encoding program for causing a computer to perform the image signal encoding process by the image encoding method.

The data storage medium according to the present invention (claim 25) is a data storage medium storing an image processing program for performing image processing by software. And an image decoding program for causing a computer to perform a decoding process of an image coded signal by the image decoding method according to any one of the above.

In the image coding method according to the present invention (claim 26), an image signal consisting of a shape signal indicating the shape of an object on a screen and a pixel value signal for displaying the object in gradation is divided into the screen. In the coding process for coding each block to be processed, the pixel value signal corresponding to the processing target screen to be processed is subjected to intra-screen coding mode using intra-screen correlation, between the processing target screen and the previous processing screen. And a second inter-picture coding mode using a correlation between the screen to be processed and the preceding and subsequent processing pictures. An image coding method performed based on a pixel value coding mode indicating whether the pixel value coding mode is an intra-screen coding mode or a first inter-screen coding mode. Coding mode for the signal When the pixel mode is the intra-frame encoding mode and the pixel value encoding mode is the second inter-frame encoding mode, the encoding mode for the shape signal of each block is the intra-frame encoding mode or the first encoding mode. A coding mode of the shape signal is determined so as to be the inter-screen coding mode, a coding mode signal indicating the coding mode of the determined shape signal is coded, and a mode coded signal is output. Is encoded in each block in the determined encoding mode, a shape encoded signal is output, the pixel value signal is encoded in the pixel value encoding mode, and the pixel value encoded signal is This is output together with the value encoding mode information.

[0098] The present invention (claim 27) is an image decoding method for decoding an image coded signal obtained by coding an image signal by the image coding method according to claim 26. And the shape signal is encoded in any one of the intra-picture encoding mode, the first inter-picture encoding mode, and the second inter-picture encoding mode. To generate a shape signal by performing, for each block, a decoding process corresponding to the coding mode indicated by the coding mode signal on the shape-coded signal from the coding side. , A pixel value coded signal from the coding side is decoded based on information from the coding side indicating the pixel value coding mode to generate a pixel value signal.

The image coding apparatus according to the present invention (claim 28) classifies the screen into an image signal consisting of a shape signal indicating the shape of the object on the screen and a pixel value signal for displaying the object in gradation. In the coding process for coding each block to be processed, the pixel value signal corresponding to the processing target screen to be processed is subjected to intra-screen coding mode using intra-screen correlation, between the processing target screen and the previous processing screen. And a second inter-picture coding mode using a correlation between the screen to be processed and the preceding and subsequent processing pictures. An image encoding apparatus that performs a pixel value encoding mode based on a pixel value encoding mode, and receives a shape signal and a signal indicating a pixel value encoding mode, and sets the pixel value encoding mode to an intra-screen encoding mode or a first image encoding mode. In the inter-screen encoding mode When the coding mode is the above intra coding mode for the shape signal of each block,
When the pixel value encoding mode is the second inter-picture encoding mode, the shape signal is such that the encoding mode for the shape signal of each block is the intra-picture encoding mode or the first inter-picture encoding mode. Mode determining means for determining the encoding mode of, the mode encoding means for encoding the encoding mode signal indicating the encoding mode of the determined shape signal and outputting a mode encoded signal, the shape signal,
Shape encoding means for encoding each block with the determined encoding mode and outputting a shape encoded signal,
Pixel value encoding means for encoding the pixel value signal in the pixel value encoding mode and outputting the pixel value encoded signal together with the information on the pixel value encoding mode.

The present invention (claim 29) is an image decoding apparatus for decoding an image coded signal obtained by coding an image signal by the image coding method according to claim 26. And the shape signal is encoded in any one of the intra-picture encoding mode, the first inter-picture encoding mode, and the second inter-picture encoding mode. A mode decoding means for generating a coding mode signal indicating whether or not a shape signal is generated by performing a decoding process corresponding to the coding mode on a shape coded signal from the coding side for each block. Decoding means, and a pixel value decoding means for decoding a pixel value encoded signal from the encoding side based on information from the encoding side indicating the pixel value encoding mode to generate a pixel value signal. It is a thing.

A data storage medium according to the present invention (claim 30) is a data storage medium storing an image processing program for performing image processing by software. This is an encoding processing program for causing a computer to perform the encoding processing of the image signal by the image encoding method.

A data storage medium according to the present invention (claim 31) is a data storage medium storing an image processing program for performing image processing by software. This is a decoding processing program for causing a computer to perform a decoding process of an image coded signal by an image decoding method.

The image encoding method according to the present invention (claim 32) divides an image signal corresponding to a screen so as to correspond to a video packet area which is a predetermined signal processing unit constituting the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is output for each video packet area, wherein the pixel values of the pixels in the target block to be coded are subjected to the coded pixels subjected to the coding process as reference pixels. When the pixel located outside the target video packet area to which the target block belongs is the reference pixel, the pixel value of the reference pixel is set to the target video packet. Replaced with pseudo pixel value generated based on the pixel values of the pixels situated in the packet region, with reference to the pseudo pixel value, and performs a coding process of the pixel value in the target block.

According to the present invention (claim 33), in the image coding method according to claim 32, the pseudo pixel value is
The pixel value of the pixel in the target video packet closest to the reference pixel located outside the target video packet area is used.

In the image encoding method according to the present invention (claim 34), the image signal corresponding to the screen is divided so as to correspond to a video packet area which is a predetermined signal processing unit and constitutes the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is output for each video packet area, and the encoding process for each of the blocks is performed by each block to indicate what kind of encoding process is performed on each block. Is performed by referring to the coding mode set in the above. At this time, the block located outside the target video packet area to which the target block belongs is referred to the coding mode. If the reference block is a reference block, the coding mode of the reference block is replaced with a pseudo coding mode generated based on the coding mode of the block located in the target video packet area, and the pseudo coding mode is referred to. Then, the encoding process of the target block is performed.

According to a thirty-fifth aspect of the present invention, in the image encoding method according to the thirty-fourth aspect, as the pseudo encoding mode, an encoding mode of a block in the target video packet closest to the reference block is used. It is.

According to the image encoding method of the present invention (claim 36), an image signal corresponding to a screen is divided so as to correspond to a video packet area which is a predetermined signal processing unit and constitutes the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is output for each video packet area, wherein a block located around a target block to be coded is used as a reference block, and the coding process for each block is performed in a non-error-resistant mode. In the case where the encoding process is performed in advance, a block in the encoded screen on which the encoding process has been performed is used as the reference block. When the encoding process for the lock is performed in the error resilience mode, only the encoded block that has been subjected to the encoding process in the target video packet area is used as the reference block, and the code of the reference block is used. The coding process of each block is performed by a coding method common to the non-error-resistant mode and the error-resistant mode based on the coding mode.

In the image decoding method according to the present invention (claim 37), the image signal corresponding to the screen is divided so as to correspond to a video packet area which is a predetermined signal processing unit and constitutes the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is an image decoding method for decoding an image coded signal output for each video packet area, wherein a decoding process is performed on pixel values of pixels in a target block to be decoded. When performing a decoding process using the decoded pixel as a reference pixel, if a pixel located outside the target video packet area to which the target block belongs becomes the reference pixel, The pixel value of the target block is replaced with a pseudo pixel value generated based on the pixel value of a pixel located in the target video packet area, and the pixel value in the target block is decoded with reference to the pseudo pixel value. Is what you do.

[0109] The present invention (claim 38) is an image decoding method for decoding an image coded signal coded by the image coding method according to claim 33, wherein the object to be decoded is When performing a decoding process on the pixel values of the pixels in the block using pixels located around the target block as reference pixels, pixels located outside the target video packet area to which the target block belongs are referred to as the reference pixels. When the pixel value of the reference pixel is replaced with the pixel value of the pixel in the target video packet area closest to the reference pixel, the pixel value in the target block with reference to the replaced pixel value The value is decoded.

The present invention (Claim 39) is an image decoding method for decoding an image coded signal coded by the image coding method according to Claim 34, wherein the object to be decoded is When performing a decoding process on a block using a block located around the target block as a reference block, if a block located outside the target video packet area to which the target block belongs becomes the reference block, The coding mode of the reference block is replaced with a pseudo coding mode generated based on the coding mode of a block located in the target video packet area, and decoding of the target block is performed with reference to the pseudo coding mode. It performs a conversion process.

[0111] The present invention (Claim 40) is an image decoding method for decoding an image coded signal coded by the image coding method according to Claim 35, wherein the object to be decoded is When performing a decoding process on a block using a block located around the target block as a reference block, if a block located outside the target video packet area to which the target block belongs is the reference block, The coding mode of the reference block is replaced with the coding mode of the block in the target video packet area closest to the reference block, and the decoding process for the target block is performed with reference to the replaced coding mode. Things.

An image decoding method according to the present invention (claim 41) is an image decoding method for decoding an image coded signal coded by the image coding method according to claim 36, wherein When performing a decoding process on a pixel value of a pixel in a target block to be processed using a block located around the target block as a reference block, the coding process for each block is performed in a non-error-resistant mode. If performed, a block in the decoded screen on which the decoding process has been performed is used as the reference block. If the coding process for each block is performed in the error resilience mode, the reference block In the target video packet area, only the decoded block that has already been subjected to the decoding process is used to encode the reference block. Based on over de and performs decoding processing of each block by common decoding method in a non-error tolerant mode and error tolerant mode.

An image coding apparatus according to the present invention (invention 42) divides an image signal corresponding to a screen so as to correspond to a video packet area constituting a predetermined signal processing unit constituting the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is an image encoding apparatus that outputs, for each video packet area, an encoded pixel subjected to encoding processing as a reference pixel, and encodes a pixel value corresponding to each block by referring to the pixel value. And a storage unit for storing the coded pixel value. If the pixel located outside the target video packet area to which the target block belongs is the reference pixel, the reference image Is replaced with a pseudo pixel value generated based on the pixel value of a pixel located in the target video packet area, and is output.If the pixel located in the target video packet is the reference pixel, A non-video packet pixel value generating means for outputting the encoded pixel value stored in the storage means as the reference pixel to the encoder.

According to the present invention (claim 43), in the image coding apparatus according to claim 42, the out-of-video-packet pixel value generating means includes a reference value located outside the target video packet area as the pseudo-pixel value. The pixel value of the pixel in the target video packet which is closest to the pixel is output.

An image coding apparatus according to the present invention (claim 44) divides an image signal corresponding to a screen so as to correspond to a video packet area which constitutes the screen and is a predetermined signal processing unit. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is an image encoding device that outputs the above-mentioned video packet area for each video packet area, wherein an encoded block subjected to encoding processing is used as a reference block, and an encoding mode value corresponding to each block is referred to with reference to the encoding mode. And a storage means for storing the encoded coding mode value, and a block located outside the target video packet area to which the target block belongs. Is the reference block, the coding mode value of the reference block is replaced with a pseudo coding mode generated based on the coding mode value of the block located in the target video packet area, and the target block is output. If the block located in the video packet is the reference block, the coding mode value stored in the storage means is output to the encoder as the coding mode value of the reference block. And a mode value generating means.

According to the present invention (claim 45), in the image coding apparatus according to claim 44, the video packet outer coding mode value generating means determines the pseudo coding mode as a target closest to the reference block as the pseudo coding mode. This is to output the encoding mode of the block in the video packet to the encoder.

An image coding apparatus according to the present invention (claim 46) divides an image signal corresponding to a screen so as to correspond to a video packet area which is a predetermined signal processing unit and forms the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is an image encoding device that outputs the above-described video packet region by region, wherein an encoded block subjected to encoding processing is set as a reference block, and an encoding mode value corresponding to each block is referred to with reference to the encoding mode. And a storage unit for storing the coded coding mode value, and the coding process for each of the blocks is performed in the error resilience mode. In the case, the reference encoding mode value is generated by referring only to the encoding mode of the block in the target video packet, and when the encoding process for each block is performed in the non-error-resistant mode, And a reference coding mode value generating means for generating and outputting a reference coding mode value by referring to the coding mode of the block in the coded screen together with the coding mode of the block in the block.

An image decoding apparatus according to the present invention (claim 47) divides an image signal corresponding to a screen so as to correspond to a video packet area constituting a predetermined signal processing unit constituting the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. An image decoding apparatus for decoding an image coded signal output for each video packet area, wherein a decoded pixel subjected to decoding processing is set as a reference pixel, and each block is referred to by referring to the pixel value. A decoder that decodes an encoded pixel value corresponding to the target block, a storage unit that stores the decoded pixel value, and a pixel that is located outside the target video packet area to which the target block belongs. When the reference pixel is used, the pixel value of the reference pixel is replaced with a pseudo pixel value generated based on the pixel value of a pixel located in the target video packet area, and the pixel located in the target video packet is In the case where the pixel value is a reference pixel, a pixel value outside the video packet generating means for outputting the pixel value stored in the storage means to the decoder as the reference pixel is provided.

An image decoding apparatus according to the present invention (claim 48) is the image decoding apparatus according to claim 47, wherein said pixel value outside video packet generation means outputs said target video packet area as said pseudo pixel value. The pixel value of the pixel in the target video packet which is closest to the reference pixel located outside the target video packet is output.

An image decoding apparatus according to the present invention (claim 49) divides an image signal corresponding to a screen so as to correspond to a video packet area which is a predetermined signal processing unit constituting the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. Is an image decoding device that decodes an image coded signal output for each video packet region, wherein the coded block subjected to the coding process is used as a reference block, and each of the blocks is referred to by referring to its coding mode. An encoder for encoding an encoding mode value corresponding to the block, a storage unit for storing the decoded encoding mode value, and a target video packet to which the target block belongs If the block located outside the area is the reference block, the coding mode value of the reference block is set to a pseudo coding mode generated based on the coding mode value of the block located in the target video packet area. When the block located in the target video packet is the reference block, the encoding mode value stored in the storage unit is output to the decoder as the encoding mode value of the reference block. A video packet extra coding mode value generating means.

An image decoding apparatus according to the present invention (claim 50) is the image decoding apparatus according to claim 49, wherein said video packet extra coding mode value generating means sets said pseudo coding mode value as said pseudo coding mode value. This is to output the encoding mode value of the block in the target video packet closest to the reference block located outside the target video packet area.

An image decoding apparatus according to the present invention (claim 51) divides an image signal corresponding to a screen so as to correspond to a video packet area which is a predetermined signal processing unit and constitutes the screen. A plurality of pixel values constituting an image signal corresponding to a video packet area are grouped so as to correspond to a block composed of a predetermined number of pixels, and the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are encoded. An image decoding apparatus for decoding an image coded signal output for each video packet area, wherein a decoded block subjected to decoding processing is used as a reference block, and each of the blocks is referred to by referring to its coding mode. A decoder for decoding the encoding mode value corresponding to the block, a storage unit for storing the decoded encoding mode value, and an error in the decoding process for each block. If the decoding process is performed in the non-error-resistant mode, the reference coding mode value is generated with reference to only the coding mode of the block in the target video packet. Reference encoding mode value generating means for generating and outputting a reference encoding mode value with reference to the encoding mode of the block in the decoded screen together with the encoding mode of the block in the target video packet. It is provided.

The data storage medium according to the present invention (Claim 52) is a data storage medium storing an image processing program for performing image processing by software. , 36 as an encoding processing program for causing a computer to perform the encoding processing of the image signal by the image encoding method.

A data storage medium according to the present invention (claim 53) is a data storage medium storing an image processing program for performing image processing by software. , 41 as a decoding processing program for causing a computer to perform the decoding processing of the image coded signal by the image decoding method described in any one of the above.

[0125]

Embodiments of the present invention will be described below. Embodiment 1 FIG. FIG. 1 is a block diagram for explaining an image coding apparatus 1000a according to Embodiment 1 of the present invention. In the figure, the same reference numerals as those in FIG. 38 denote the same parts as those in the conventional image coding apparatus 1200a. An image coding apparatus 1000a according to the first embodiment includes, in addition to the configuration of a conventional image coding apparatus 1200a, block transmission coding for coding output information 1019a of a block transmission determiner 1019 to generate a block transmission signal 1104. Vessel 1
030 and an open / close switch 1031 for switching between a state in which the block transmission signal 1104 is output and a state in which the block transmission signal 1104 is not output based on the output 1010a of the mode determination unit 1010.

FIG. 2A shows the signal format (data structure) of the shape bit stream BSa output from the image coding apparatus 1000a. The difference in signal format between the shape bit stream BSa in the first embodiment and the conventional shape bit stream Bs shown in FIG. 37 is that, in the shape bit stream BSa, the mode coded signal BS1 and the shape coded signal BS2 Is that the block transmission signal BS11 is arranged between the two. here,
Since the block transmission signal BS11 depends on the coding mode of the shape signal, it is arranged after the mode coding signal. Also, if a transmission path error occurs, the shape-encoded signal cannot be correctly decoded. Therefore, if the block transmission information is arranged after the shape-encoded signal, the block transmission information cannot be correctly decoded when the transmission path error occurs. . Therefore, by arranging the block transmission signal between the mode-coded signal and the shape-coded signal, it is possible to decode the pixel value bit stream even if the shape-coded signal cannot be correctly decoded due to a transmission path error. It is possible to prevent large image quality deterioration.

Next, the operation will be described. FIG. 3 is a flowchart showing the flow of an encoding process performed by the image encoding device according to the first embodiment. First, the image coding apparatus 1000a determines the coding mode of the shape signal 1001 corresponding to the target block (step A1),
Mode information (encoding mode signal) 10 as a determination result
10a is encoded and output as a mode encoded signal 1100 (step A2). Next, it is determined whether or not the encoding mode is the intra-screen encoding mode (step A3). If the encoding mode is the intra-screen encoding mode, the intra-screen encoding process is performed on the shape signal to perform the shape encoding. A signal (intra-coded signal) 1015a is output (step A4). On the other hand, if the encoding mode is the inter-picture encoding mode, the inter-picture encoding process is performed on the shape signal to output a shape encoded signal (inter-coded signal) 1014a (step A5).

Next, a signal obtained by locally decoding the shape-encoded signal (hereinafter, referred to as a locally decoded shape signal).
Based on 1017a, block transmission information (identification signal) indicating whether or not the block to be processed is a transmission block (that is, a block located outside the object area).
1019a is generated (step A6), and it is determined whether the coding mode of the target block is the inter-screen coding mode (step A7). At this time, if the encoding mode is the inter-screen encoding mode, block transparency information 1019 indicating whether or not the block is a transparent block.
a is encoded and output as a block transmission signal 1104 (step A9). On the other hand, if the encoding mode is not the inter-screen encoding mode, the block transmission information 1
Block transmitted signal 11 obtained by encoding
04 is not output. Finally, the pixel value signal is encoded with reference to the block transmission information 1019a generated in step A6, and the pixel value bit stream 110
3 is generated (step A10).

Next, the function and effect will be described. In addition,
The description of the same operation as that of the conventional image encoding device 1200a is omitted. When the shape signal 1001 and the pixel value signal 1002 are input to the image encoding device 1000a, the block transmission encoder 1030 determines whether the target block, which is the output of the block transmission determiner 1019, is a non-object block. Is encoded as identification information 1019a indicating the
31.

At this time, the switch 1031 outputs the coding mode signal 101 output from the mode decision unit 1010.
0a, the switch is turned on (conductive state) only when the encoding mode is the inter-screen encoding mode, and the switch 1
From block 031, block transmission signal 1104 is output. As described above, in the first embodiment, the block transmission signal 1104 is generated only when the inter-screen coding processing in which the transmission path error propagates over the coded signals corresponding to a large number of screens is performed. Since the output is performed, it is possible to avoid a large deterioration in the coding efficiency in the conventional image coding apparatus.

Further, when decoding an image-encoded signal, if the target block to be decoded is mistaken as to whether it is a transparent block or not, significant image quality degradation occurs. Then, when the shape signal is inter-coded, in the decoding processing of the pixel value bit stream 1103, information indicating whether or not the target block is a transparent block is obtained by decoding the block transparent signal 1104. In addition, it is possible to avoid the influence of the transmission path error over a large number of screens. When the shape signal is intra-coded, the effect of a transmission path error on one screen does not propagate to the next screen. As a result, in the first embodiment, it is possible to reduce image quality degradation due to transmission path errors without substantially impairing coding efficiency.

In the first embodiment, the unit of the encoding process is simply described as a block. However, in the encoding process of MPEG1 and MPEG2, this block corresponds to a macroblock or a sub-block constituting the macroblock. Needless to say, In the first embodiment, the signal format (data structure) including the block transmission signal is shown as the shape bit stream.
The data structure of the shape bit stream is not limited to this.

For example, FIG. 2B shows a modification of the signal format of the shape bit stream. In the encoding process based on MPEG4, there are two encoding units of a macroblock and a subblock as in MPEG1 and MPEG2. For an image signal including a shape signal indicating the shape of an object, the macroblock unit and the subblock are used. It is determined whether the target block is a transparent block (a block located outside the object area) in units, and the encoding process is performed. Here, if the macroblock is a transparent block, the sub-blocks constituting the macroblock are also transparent blocks. Therefore, as the shape bit stream, similarly to the signal format shown in FIG. 2A, a sub-block transmission signal BS1a indicating whether or not the sub-block is a transmission block is a mode encoding signal BS1 and a shape encoding signal BS2. And the macro block transmission signal B
Shape bit stream BS having a signal format in which S1b is arranged immediately before sub-block transmission signal BS1a
b (see FIG. 2 (b)) becomes effective.

The macroblock transparent signal BS1b is coded and output when the coding mode is the inter-picture coding mode, and the subblock transparent signal BS1a is a macroblock transparent signal BS1b output and the macroblock is outside the object. It is sufficient to encode and output only when it is not a transparent block located.

If the macroblock transmission signal BS1b can output a macroblock transmission signal indicating that all the pixels of the target macroblock are located inside the object, each of the macroblocks constituting the macroblock can be output. Obviously, all the blocks are inside the object, and in that case, the encoding of the sub-block transmission information may be omitted.

Embodiment 2 FIG. 4 is a block diagram for explaining an image decoding apparatus 1000b according to Embodiment 2 of the present invention. This image decoding device 1000b decodes an image coded signal obtained by the coding process in the image coding device 1000a of the first embodiment shown in FIG. 4, the same reference numerals as those in FIG. 39 denote the same components as those in the conventional image decoding device 1200b. Image coding apparatus 100 according to Embodiment 2
0b is a block transmission decoder 1061 that receives the block transmission signal 1104 and decodes it, in addition to the configuration of the conventional image decoding device 1200b, and a mode decoder 10b.
The decoded encoding mode signal 105, which is the output of 50
0a, and a selection switch 1062 for selecting one of the output 1060a of the block transmission determiner 1060 and the output 1061a of the block transmission decoder 1061, and the output 1062a of the selection switch 1062 is
Pixel value decoder 1 as decoded block transmission information
063.

Next, the operation will be described. FIG. 5 is a flowchart showing the flow of a decoding process performed by the image decoding apparatus according to the second embodiment.

First, in the present image decoding apparatus 1000b,
Mode coded signal 1 corresponding to the shape signal of the target block
100 is decoded (step A20), and based on the decoded coding mode signal 1050a, it is determined whether or not the coding mode of the target block is the intra-screen coding (step A21). If the encoding mode is the intra-screen encoding mode, intra-frame decoding processing is performed on the shape-encoded signal 1101, and a shape-decoded signal (intra-decoded signal) 1053a is output (step A22). On the other hand, if the coding mode is the inter-picture coding mode, the inter-picture decoding process is performed on the shape coded signal 1101 to output the shape decoded signal (inter-decoded signal) 1052a (step A23). ).

Further, based on the decoded coding mode signal, it is determined whether or not the coding mode is the inter-picture coding mode (step A25). If the encoding mode is the inter-screen encoding mode, the image encoding device 1
The block transmission information 1061a is generated by decoding the block transmission signal 1104 from the block 000a (Step A27). If the encoding mode is the intra-screen encoding mode, the target block is determined based on the shape decoding signal 1110. A determination as to whether or not the block is a transparent block (a block located outside the object area) is performed in block units, and block determination information 1060a is obtained as a result of the determination (step A24). Finally, a decoding process is performed on the pixel value bit stream (encoded image signal) 1103 with reference to any of the block transmission information 1060a or 1061a, and an image decoded signal 1111 is output (step A28). .

Next, the function and effect will be described. In addition,
The description of the same operation as that of the conventional image decoding apparatus 1200b is omitted. The present image decoding apparatus 1000b
The mode coded signal 1100 and the block transmission signal 11 extracted from the multiplexed bit stream from the coding side
04, the shape coded signal 1101 and the pixel value bit stream 1103 are input, the block transmission decoder 1061 decodes the block transmission signal 1104 to generate block transmission information 1061a, and the block transmission decision unit 1060 From the shape signal 1110, block transmission information 1060a is obtained.

When the encoding mode is the inter-picture encoding mode, the switch 1062 operates the block transparent decoder 10.
61 is selected, and if the encoding mode is the intra-screen encoding mode, the block transmission determiner 1060 is selected.
Of the image value decoder 1063
To supply. As described above, in the image decoding device 1000b according to the second embodiment, when the encoding mode of the target block to be handled in the decoding process is the inter-screen encoding mode,
Block transmitted signal 11 from the image encoding device 1000a
04 is decoded to generate block transmission information. When the coding mode of the target block is the intra-screen coding mode, block transmission information is generated based on the shape decoding signal 1110. Even if inter-coded, correct block transparency information required when decoding the pixel value bit stream can be obtained. For this reason, it is possible to prevent the influence of the transmission path error from propagating across many screens. If the shape signal is intra-coded, the effect of a transmission path error corresponding to a certain screen does not propagate to subsequent screens.

As a result, in the second embodiment, it is possible to correctly decode the image coded signal obtained by the coding process in the image coding apparatus 1000a of the first embodiment shown in FIG. Image quality deterioration due to a road error can be reduced. In the second embodiment, the unit of the encoding process is simply described as a block. However, this block corresponds to a macroblock or a subblock constituting the macroblock in the encoding process of MPEG1 and MPEG2. Needless to say.

Embodiment 3 FIG. 6 is a block diagram for explaining an image coding apparatus according to Embodiment 3 of the present invention. In the figure, the same symbols as those in FIG. 1 are the same as those in the image coding apparatus 1000a according to the first embodiment. The image coding apparatus 1000c according to the third embodiment sets the open / close switch 1031 in the image coding apparatus 1000a according to the first embodiment to the block transmission signal 1104 based on not only the coding mode but also the error resilience mode.
The configuration is such that on / off control of whether or not to output is performed, and the other configuration is completely the same as that of the first embodiment.

That is, the image coding apparatus 1 of the present embodiment
000c, the on / off switch 1031 is supplied as a control signal together with the output (encoding mode signal) 1010a of the mode determiner 1010 and the error tolerance identification signal 100
3 is input. The error resilience mode identification signal 1003 indicates whether it is necessary to enhance error resilience depending on the error rate of the transmission path or the application of the application.

Next, the operation will be described. In the image coding apparatus 1000c having such a configuration, the switch 1031
Is in a conductive state only when the encoding mode is the inter-screen encoding mode and the error resilience mode is strengthened, and the output of the block transmission determining unit 1019 (block transmission information)
An encoded signal obtained by encoding 1019a is output as a block transmission signal 1104.

As a result, the block transmission signal 1104 is added to the shape bit stream only when error tolerance is required. Therefore, when it is not necessary to enhance error tolerance, even if the encoding mode is the inter-frame encoding mode. The block transmission signal 1104 is not output, and the coding efficiency can be further improved as compared with the image coding apparatus 1000a of the first embodiment.

Hereinafter, the encoding process of the image encoding device 1000c will be described in detail with reference to the flowchart of FIG.
However, a description of the same processing as that of the image encoding apparatus according to Embodiment 1 will be omitted. 7, the same reference numerals as those in FIG. 3 indicate the same processes. That is, in the encoding process by the image encoding device 1000c according to the third embodiment, the process of selecting whether or not to encode the block transmission information 1019a output from the block transmission determiner 1019 according to the error resilience mode (step A8) is different from the encoding process by the image encoding device 1000a of the first embodiment in that A8) is added.

In the mode for enhancing the error resilience, the block transmission signal 1104 is added to the shape bit stream, and when an error occurs on the transmission line, the effect of the error on the decoding side extends over many screens. Propagation must be prevented, but if it is not necessary to enhance error resilience, the coding efficiency can be slightly improved by not adding the block transparent signal 1104 to the shape bit stream.

Therefore, in the third embodiment, it is determined whether or not to perform encoding in the error resilience mode (mode for enhancing error resilience) (step A8). The encoding process is performed, and a block transmission signal 1104 is output. On the other hand, if the mode is not the error resilience mode, the block transmission signal 1
104 is not output.

As described above, according to the third embodiment, the advantage of the image coding apparatus 1000a of the first embodiment is utilized.
In addition, when it is not necessary to enhance the error resistance, there is an effect that the coding efficiency can be slightly improved. In the third embodiment, the unit of the encoding process is simply described as a block. However, this block corresponds to a macroblock or a subblock constituting the macroblock in the encoding process of MPEG1 and MPEG2. Needless to say.

Embodiment 4 FIG. 8 is a block diagram for explaining an image decoding device 1000d according to Embodiment 4 of the present invention. The image decoding device 1000d decodes an encoded signal obtained by the encoding process in the image encoding device 1000c according to the third embodiment shown in FIG. 8, the same reference numerals as those in FIG. 4 denote the same components as those in the image decoding device 1000b according to the second embodiment. Image decoding device 1 according to Embodiment 4
000d is the image decoding device 100 according to the second embodiment.
The changeover switch 1062 at 0b is configured to select one of the output 1060a of the block transmission determiner 1060 and the output 1061a of the block transmission decoder 1061 based on not only the encoding mode but also the error resilience mode. The other configuration is exactly the same as that of the second embodiment. That is, in the fourth embodiment, the mode decoder 105 is supplied to the switch 1062 as a control signal.
An error tolerant mode identification signal 1105 is input from the outside together with the output 1050a of 0.

Next, the operation will be described. In the image decoding device 1000d having such a configuration, the switch 10
Reference numeral 62 selects the output 1061a of the block transparent decoder 1061 only when the encoding mode is the inter-screen encoding mode and the error resilience mode is strengthened. As a result, when error resilience is required, the block transparent decoder 1
The output 1061a of the block 061 is selected. Otherwise, the output 1060a of the block transmission determiner 1060 is selected.

Hereinafter, the decoding processing of the image decoding apparatus 1000d will be described in detail with reference to the flowchart of FIG.
However, a description of the same processing as that of the image decoding apparatus according to the second embodiment will be omitted. 9, the same reference numerals as those in FIG. 5 indicate the same processes. That is, in the decoding processing by the image decoding apparatus according to the fourth embodiment, the block transmission signal 1104 is decoded to generate block transmission information or the decoded shape signal 1
The image decoding according to the second embodiment is different from the second embodiment in that a process (step A26) of determining whether the target block is a transparent block and generating block transparent information based on the block 110 is added. This is different from the decryption processing by the device 1000b. In the image decoding process according to the fourth embodiment, block transmission signal 1104 is decoded only when the transmission mode is a mode for enhancing error resilience and the encoding mode is the inter-screen encoding mode. You.

Therefore, if the encoding mode is the inter-picture encoding mode, it is determined whether or not the mode is the error resilience mode (mode for enhancing error resilience) (step A2).
6) If the transmission mode is the error resilience mode, the block transmission information is transmitted to the image encoding device 1 in step A27.
000c, and if the transmission mode is not the error resilience mode, the decoded shape signal 1110 is decoded from the decoded shape signal 1110 in step A24.
It is determined whether or not the target block is a transparent block to generate block transparency information 1060a. As described above, in the fourth embodiment, regardless of whether the transmission mode is the error resilience mode or the error resilience mode, the image encoded signal obtained by the encoding process in the image encoding device of the third embodiment Can be decoded while suppressing image quality deterioration.

Embodiment 5 FIG. FIG. 10 is a block diagram for explaining an image coding apparatus 1500a according to Embodiment 5 of the present invention. An image coding apparatus 1500a according to the fifth embodiment encodes an output 1010a of a mode determination unit 1010 instead of the mode encoder 1011 in the image coding apparatus 1000a according to the first embodiment shown in FIG. , Second mode coded signals 1100a, 1100
b, the first and second mode encoders 1011a,
1011b. Also, the image encoding device 1
500a is a first mode coded signal 1100a and a shape coded signal 1101 as a shape bit stream Bs.
With the pixel value bit stream 1103,
Output as one multiplexed bit stream,
The block transmission signal 1104 and the second mode coded signal 1100b are each output as a bit stream different from the multiplexed bit stream.
Other configurations are the same as those of the image encoding device 1000a according to the first embodiment shown in FIG.

Next, the function and effect will be described. In the fifth embodiment having such a configuration, the block transmission signal 110
Since the fourth and second mode coded signals are output as separate streams from the multiplexed bit stream including the first mode coded signal, the shape coded signal and the pixel value bit stream, a transmission error for the multiplexed bit stream is output. Occurs, the block transmission signal 1104 and the second mode coded signal 1100b are normally transmitted to the decoding side. Therefore, on the decoding side, the encoded mode signal can be reproduced from the second mode encoded signal 1100b, and the information indicating whether or not the target block is a transparent block is obtained by decoding the block transparent signal 1104. Accordingly, it is possible to prevent the influence of the transmission path error from extending over a large number of screens.

Also, the block transmission signal 1104 is output only when an inter-screen encoding process in which a transmission path error propagates over a large number of screens is performed. It is possible to avoid significant deterioration of the coding efficiency. As a result, in the fifth embodiment, as in the first embodiment, it is possible to reduce image quality degradation due to transmission path errors without substantially impairing coding efficiency.

In the fifth embodiment, the first and second
Mode encoders 1011a and 1011b, and the first
Although the output of the mode encoder is included in the multiplexed bit stream and transmitted, and the output 1100b of the second mode encoder is transmitted as a separate bit stream different from the multiplexed bit stream, the first Is configured to adaptively encode the encoding mode signal 1010a by one of the intra-screen encoding process and the inter-screen encoding process, and the second mode encoder 1
011b may be configured to always encode the encoding mode signal 1010a by an intra-screen encoding process. In this case, even if a transmission path error occurs in a bit stream that is different from the multiplexed bit stream and includes the second mode coded signal 1100b, the transmission path error propagates over many screens. However, it is possible to further improve resistance to a transmission path error when transmitting an image signal.

In the fifth embodiment, the open / close switch 1031 in the image encoding device 1500a is set to the block transmission signal 1 based on the encoding mode signal 1010a.
Although the control is performed so as to switch between the conductive state and the cutoff state of the image coding apparatus 104, the image coding apparatus 15 according to the fifth embodiment is controlled.
The open / close switch 1031 in 00a is the same as that in the third embodiment.
Similarly to the above, based on not only the encoding mode but also the error resilience mode, the block transmission signal 1104 may be controlled to be switched between the conductive state and the cutoff state.

Embodiment 6 FIG. FIG. 11 is a block diagram for explaining an image decoding device 1500b according to Embodiment 6 of the present invention. This image decoding device 1500b includes:
This is for decoding the coded image signal obtained by the coding process in the image coding device 1500a according to the fifth embodiment shown in FIG. 5, and the mode in the image decoding device 1000b according to the second embodiment shown in FIG. Instead of decoder 1050, first and second mode decoders 1550a and 1550
b and the outputs 15 of both decoders 1550a, 1550b
And a fourth switch 1063 for selecting one of the switches 51a and 1551b based on an external control signal 1105.

This first mode decoder 1550a
First mode encoded signal 110 included in the multiplexed bit stream sent from image encoding device 1500a
0a is decoded. Further, the second mode decoder 1550b is connected to the image encoding device 15
The second mode coded signal 1100b included in another bit stream different from the multiplexed bit stream output from 00a is decoded. Also,
The fourth switch 1063 is connected to the control signal 11
05, which is information corresponding to the result of transmission error detection for the multiplexed bit stream,
One of the outputs 550a and 1550b is selected and output as a control signal to the first to third changeover switches. Specifically, the changeover switch 1
063, the output 1551b of the second mode decoder 1550b is selected when the transmission error occurrence rate for the multiplexed bit stream exceeds a predetermined reference value, and otherwise, the first mode decoder 1550a is selected. Output 1551
a is selected. Other configurations are shown in FIG.
Is the same as the image encoding device 1000b of the second embodiment shown in FIG.

In the image decoding device 1500b of the sixth embodiment having such a configuration, the first mode encoded signal 1100a included in the multiplexed bit stream transmitted from the image encoding device 1500a of the fifth embodiment is described. And a second mode decoder 1550a for decoding a second mode coded signal 1100b included in another bit stream different from the multiplexed bit stream. Therefore, it is possible to correctly decode the encoded image signal obtained by the encoding process in the image encoding device 1500a according to the fifth embodiment.

The first mode coded signal 1100a
When the rate of occurrence of transmission errors in a multiplexed bit stream including a multiplexed bit stream exceeds a predetermined reference value, the second mode coded signal 1100b transmitted by a different bit stream different from the multiplexed bit stream is decoded to generate a coding mode. The signal 1551b is reproduced, and the encoding mode signal 1
Since the block transmission information 1062a required for decoding the pixel value bit stream 1103 is generated based on either the shape signal 1110 or the block transmission signal 1104 according to the encoding mode indicated by 551b, a transmission error Thus, it is possible to substantially prevent the block transmission information 1062a from being unable to be generated.

Therefore, it is possible to substantially prevent the influence of the transmission path error from propagating across a large number of screens, and it is possible to greatly reduce the image quality deterioration due to the transmission path error.

In the sixth embodiment, the first mode encoder 1011a in the fifth embodiment adaptively converts a coding mode signal into one of an intra-screen coding process and an inter-screen coding process. It is configured to encode,
When the second mode encoder 1011b is configured to always encode the encoding mode signal by the intra-screen encoding process, the first mode decoder 1550a is
The first mode coded signal is adapted to be adaptively decoded by either the intra-screen decoding process or the inter-screen decoding process, and the second mode decoder 1550b outputs the second mode coded signal to the second mode coded signal. The decoding may always be performed by the intra-screen decoding process.

In the sixth embodiment, the third changeover switch 1062 in the image decoding device 1500b is set to the block transmission judging device 10 based on the coding mode signal.
60a output 1060a and block transparent decoder 106
Although one of the outputs 1061a is selected, the third changeover switch 1062 in the image encoding device 1500b according to the sixth embodiment may be set to not only the encoding mode but also the encoding mode as in the fourth embodiment. , The output 106 of the block transmission determiner 1060a based on the error resilience mode.
0a and the output of the block transparent decoder 1061 may be selected.

Embodiment 7 FIG. FIG. 12 is a block diagram for explaining an image coding apparatus 1500c according to Embodiment 7 of the present invention. An image coding apparatus 1500c according to the seventh embodiment is different from the conventional image coding apparatus 12 shown in FIG.
In place of the pixel value encoder 1020 and the mode determiner 1010 in 00a, a signal (hereinafter, referred to as a pixel value encoding mode signal) 1007 indicating a pixel value encoding mode corresponding to each frame is received. The value signal 1002 is encoded to form a pixel value bit stream 15
03 and the pixel value encoding mode signal 1010 as well as the shape signal 1001
07, the coding mode of the shape signal is determined,
A mode determinator 1510 that outputs a coding mode signal 1510c corresponding to each block is provided.

FIG. 13 (a) shows the mode decision unit 1510
3 shows the process of determining the coding mode of the shape signal for each block in FIG. That is, the mode determiner 1510
In, the pixel value encoding mode signal 1007 indicates that the encoding mode of the pixel value signal corresponding to the frame is the I mode (intra-picture encoding mode) or the P mode (inter-picture forward prediction encoding mode). In this case, the coding mode for the shape signals of all the blocks is determined to be the I mode regardless of the coding mode for the shape signal of each block determined from the shape signal. Further, when the pixel value encoding mode signal 1007 indicates that the encoding mode of the pixel value signal corresponding to the frame is the B mode (inter-screen bidirectional predictive encoding mode), each pixel corresponds to each block. The coding mode of the shape signal is set to the I mode or the P mode based on the mode determination result for the shape signal of each block. Other configurations are the same as those in the conventional image encoding device 1200a shown in FIG.

Next, the operation and effect will be briefly described. When the shape signal 1001, the pixel value signal 1002, and the pixel value encoding mode signal 1007 are input to the present image encoding device 1500c, the mode determiner 1510 performs the processing based on the pixel value encoding mode signal 1007 and the shape signal 1001. Then, the coding mode of the shape signal corresponding to each block is determined. For example, as shown in FIG. 13B, the pixel value encoding modes for a plurality of predetermined frames are.
If I, B, B, P, B, B, P, B, B, P,..., The decision unit 1510 sets the coding mode for each block in the frame corresponding to the shape signal. , ..., I, IorP, IorP, I, IorP, Ior
P, I, IorP, IorP, I,... Are determined.

That is, when the encoding mode of the shape signal for a frame is the I or P mode, all the encoding modes of the shape signal corresponding to the blocks constituting the frame are the I mode. On the other hand, when the encoding mode of the shape signal for the frame is the B mode, the encoding mode of the shape signal corresponding to the block constituting the frame is I mode. If, the coding mode of the block is set to the I mode, and if the coding mode of the block determined from the shape signal is P or B, the coding mode of the block is set to the P mode. The output 1510c of the mode determiner 1510 is connected to each of the switches 101.
3, 1016, and 1017, and are encoded by the mode encoder 1011 and output as a mode encoded signal 1100c.

At this time, the shape signal 1001 is subjected to an intra-frame coding process or an inter-screen coding process for each block based on the output of the mode determination unit 1501.
It is output as shape encoded signal 1101. In the pixel value encoder 1503, the pixel value signal 1002 is encoded based on the pixel value signal encoding mode signal 1007 and the block transmission information 1019a, and the pixel value signal encoding mode signal 1007 and the pixel Value signal 1002
Is output as a pixel value bit stream 1503.

The mode coded signal 1100
c, the shape coded signal 1101, and the pixel value bit stream 1503 are multiplexed, and
0c is output as a multiplexed bit stream. Other operations of the image encoding device 1500c according to the seventh embodiment are the same as those of the conventional image decoding device 1200a.

In the image coding apparatus 1500c according to the seventh embodiment having the above-described configuration, when the coding mode corresponding to each frame of the pixel value signal is the I mode or the P mode, the frame signal corresponding to the shape signal is output. When the coding mode of all the blocks is set to the I mode and the coding mode corresponding to each frame of the pixel value signal is the B mode, the coding mode of each block of the corresponding frame of the shape signal is determined as a mode for the shape signal. Since the mode is set to the I mode or the P mode based on the result, the number of blocks to be subjected to the intra-frame encoding processing for the shape signal increases, and the influence of the transmission error is avoided over many frames. be able to.

Embodiment 8 FIG. FIG. 14 is a block diagram illustrating an image decoding device 1500d according to Embodiment 8 of the present invention. This image decoding device 1500d includes:
Image coding apparatus 1500c according to the seventh embodiment shown in FIG.
Is for decoding an image coded signal obtained by the coding processing in the conventional image decoding apparatus 1 shown in FIG.
A pixel value decoder 156 that performs a decoding process on the pixel value bit stream 1503 from the image encoding device 1500c instead of the pixel value decoder 1063 in 200b.
3 is provided. The pixel decoder 1563 is configured to decode the pixel value encoded signal of each frame for each block based on the pixel value encoded mode signal included in the pixel value bit stream 1503. Other configurations are the same as those of the conventional image decoding device 120 shown in FIG.
Same as 0b.

In the image decoding apparatus 1500d according to the eighth embodiment having such a configuration, the image decoding apparatus 1500d based on the pixel value encoding mode signal included in the multiplexed bit stream transmitted from the image encoding apparatus 1500c according to the seventh embodiment. And a pixel value decoder 1563 for decoding the pixel value coded signal of each frame for each block, so that the image coding obtained by the coding process in the image coding apparatus 1500c of the seventh embodiment is performed. The signal can be decoded correctly.

Embodiment 9 FIG. FIG. 15 is a diagram for explaining an image coding apparatus according to Embodiment 9 of the present invention.
The configuration of an encoding mode intra-screen encoder 2013a constituting the image encoding device is shown. This encoding mode intra-screen encoder 2013a includes a video packet extra mode generator 2310 in addition to the configuration of the conventional encoding mode intra-screen encoder 2013 shown in FIG.

The mode generator 231 outside the video packet
0 indicates that the reference macroblock, which is located around the encoded macroblock and whose encoding mode is referred to, is located in the target video packet to be encoded, from the encoding memory 2111. , Read a reference coding mode value and output it as a reference coding mode to the coding mode encoder 2110. If the reference macroblock is located outside the target video packet, the spatial distance between the reference macroblock and the reference macroblock is the smallest. The coding mode of the macroblock in the target video packet, which is close, is output to the coding mode encoder 2110 as the reference coding mode.

The coding mode encoder 2110
Determines the coding method of the coding mode with reference to the output of the mode generator 2310 outside the video packet, and uses the determined coding method to determine the input signal (coding mode signal) 210.
The configuration is such that 0 is encoded and a mode encoded signal 2300 is output. Note that the other configuration of the image encoding device according to the ninth embodiment is the same as that of the conventional image encoding device 22.
Same as 00a.

Next, the flow of processing by the encoder in the encoding mode screen will be briefly described with reference to the flowchart of FIG. First, it is determined whether or not the reference macroblock located around the macroblock to be encoded is located in the target video packet to be processed (step B1). If the reference macroblock is located outside the target video packet, refer to the coding mode of the encoded macroblock located in the target video packet and having the closest spatial distance from the reference macroblock. (Step B2). Next, the encoding method of the encoding mode signal is determined according to the encoding mode to be referred to (step B3), and the encoding mode value (the encoding mode corresponding to the macroblock to be encoded) is determined by the method determined in step B3. The signal value is encoded (step B4).

Next, the function and effect will be described. FIG.
As described with reference to (a), the encoding method of the encoding mode value F (i, j) of the encoded macroblock M (i, j) is based on the encoded macroblock M (i−1, j-1), M (i-1, j), M (i, j-
1) coding mode value F (i-1, j-1), F (i-1, j), F (i, j-1)
, The encoded macroblock M (i-
If all (1, j-1), M (i-1, j), M (i, j-1) are present in the target video packet to be encoded, the conventional method is used. It will be exactly the same.

In the case where a part of the plurality of encoded macroblocks to be referred to is located outside the target video packet, the conventional encoding method uses the encoded block M ( i-1, j-1), M (i-1, j)
The encoding mode values F (i-1, j-1) and F (i-1, j) are replaced with predetermined values.

However, in the encoding process of an image signal, the encoding mode value of the macroblock M (i, j) to be encoded is assumed on the assumption that the image signal has a locally very strong correlation. The encoding method for F (i, j) is defined as macroblocks M (i-1, j-1) and M (i
-1, j), M (i, j-1) coding mode values F (i-1, j-1), F (i-1,
j), F (i, j-1) to increase the coding efficiency, and therefore, the coding mode value F (i-1, j-1),
When the correlation between F (i-1, j) and F (i, j-1) becomes small, the coding efficiency of the macroblock to be coded with respect to the coding mode F (i, j) deteriorates.

Therefore, in the ninth embodiment, FIG.
As shown in FIG. 2, the encoded macroblock M (i
-1, j-1) and M (i-1, j) are located outside the target video packet, the coding mode values of these macroblocks F (i-1, j-1), F (i-1, j-1) As (i-1, j), the coding mode value F (i, j-1) of the macroblock M (i, j-1) located in the target video packet is used. Can be prevented from deteriorating the coding mode value F (i, j) of the macroblock M (i, j) to be encoded even when referring to the coding mode of the macroblock located outside .

Similarly, as shown in FIG. 17 (b), reference macroblocks M (i'-1, j'-1) and M (i ') corresponding to the macroblock M (i', j ') to be coded. , j'-1) are located outside the target video packet, the coding mode values F (i'-1, j'-1) and F (i ', j'-1) of these macroblocks , The coding mode value F (i′-1, j ′) of the macroblock M (i′-1, j ′) located in the target video packet is used. Thereby, these coding modes F (i'-1, j'-1), F (i'-1, j '), F (i', j'-
By increasing the correlation between 1), it is possible to prevent the coding efficiency of the coding target macroblock from being deteriorated in the coding mode. In the above description, only the case where the number of the peripheral macroblocks to be referred to is three has been described. However, the encoding process of the present invention can be similarly realized when the number of the peripheral macroblocks to be referred to is four or more. it can.

Embodiment 10 FIG. FIG. 18 is a diagram for explaining an image encoding apparatus according to Embodiment 10 of the present invention, and shows a configuration of an encoding mode inter-screen encoder 2014a constituting the image encoding apparatus. In the figure, the same reference numerals as those in FIG. 44 indicate the same components as those of the conventional coding mode inter-screen encoder 2014. The coding mode inter-screen encoder 2014a includes an intra-screen coding reference mode generator 2312 in addition to the configuration of the conventional coding mode inter-screen encoder 2014 shown in FIG. It is provided with selection switches 2310 and 2311 provided before and after the coded reference mode generator 2312 and the inter-coding reference mode generator 2112.

Each of the above selection switches 2310 and 2311
Are switched over by an error resilience mode signal 2301 which is externally input and instructs whether or not to perform encoding in the error resilience mode.
Specifically, when the error resilience mode signal 2301 indicates that the mode is the error resilience mode, both switches 2310 and 2311 switch the intra-coded reference mode generator 23.
12; otherwise, it is controlled to be connected to the inter-picture coding reference mode generator 2112. Here, the operation of the inter-picture coding reference mode generator 2112 is the same as the conventional one shown in FIG. Further, the intra-screen coding reference mode generator 2312 is configured to generate a reference coding mode signal based on the coding mode of the coded macroblock located in the target video packet.

The coding mode encoder 2315
Is configured to perform a coding process on an input signal (coding mode signal) based on a coding mode signal output from the reference mode generator selected by the changeover switch 2311 and output a mode coded signal 2302. It has become. The other configuration of the image coding apparatus according to the tenth embodiment is the same as that of the conventional image coding apparatus 2200.

Next, the flow of processing by the coding mode inter-picture encoder will be briefly described with reference to the flowchart in FIG. First, prior to encoding, it is determined whether the encoding mode is an error resilience mode (an encoding mode that reduces the influence of transmission path errors) or a non-error resilience mode (an encoding mode that emphasizes encoding efficiency). Judgment (Step B1
0).

If the coding mode is the error resilience mode, the reference coding mode is generated only from the coding mode of the macroblock located in the target video packet (step B11). On the other hand, when the encoding mode is the non-error tolerant mode, the encoding mode of the macroblock located in the target video packet of the target screen to be processed is referred to, and the coding mode of the encoded screen other than the target screen is referred to. The encoding mode to be referred to is determined with reference to the encoding mode of the macroblock located in the video packet at the position corresponding to the target video packet (step B).
12).

Thereafter, an encoding method is determined based on the input reference encoding mode signal (step B13), and the encoding mode signal of the macroblock to be encoded is encoded by the determined encoding method (step B14). ).

Next, the function and effect will be described. FIG.
As described with reference to (b), in the encoding mode inter-screen encoding process, the encoding mode F (i, j) of the target macroblock M (i, j) is encoded in order to increase the encoding efficiency. The conversion method is
It is determined by referring to the encoding mode BF (i, j) of the macroblock BM (i, j) at the position corresponding to the target macroblock M (i, j) in the other decoded screen. However, such an encoding process is convenient when there is no transmission path error, but in a situation where a transmission path error is likely to occur, if an error occurs on the reference screen, the reference screen is displayed. Since the corresponding image signal cannot be correctly decoded, there is a disadvantage that the influence of the error propagates over a plurality of screens.

Therefore, in the tenth embodiment, in a situation where a transmission path error is likely to occur, the encoding mode BF (i, j) of the macroblock BM (i, j) of another screen is referred to. Instead, the encoding mode of the encoded macroblock located in the target video packet is referred to.
Also, at this time, the macroblock to be referred to has a higher correlation when it is spatially closer to the macroblock to be coded. Therefore, the macroblock to be coded M (i, j) has a neighboring macroblock M (i -1, j) and the encoding mode value F (i, j-1) of the surrounding macroblock M (i, j-1)
Is used in place of the encoding mode BF (i, j) of the macroblock BM (i, j) at the corresponding position of another screen to be referred to.

For example, as shown in FIG. 17 (a), for the macroblock (i, j) to be coded, the surrounding macroblocks M (i-1, j) and M (i, j-1) are targeted. Since it is located in the video packet, instead of the above encoding mode BF (i, j),
The encoding mode value F (i, j-) of the peripheral macroblock M (i, j-1)
As shown in FIG. 17 (b), the macroblock M (i ′, j ′) to be coded is
Since (i ', j'-1) is located outside the target video packet and the surrounding macroblock M (i'-1, j') is located in the target video packet, the coding mode BF (i, j) (Fig. 42 (b)
), The coding mode value (i′-1, j ′) of the peripheral macroblock M (i′-1, j ′) is used.

The basic principle of the tenth embodiment is to switch the position of a reference macroblock to a macroblock depending on the state of a transmission line error, and to select an encoding method according to a referred encoding mode. The procedure for performing the coding and the procedure for coding the coding mode of the macroblock to be coded by the selected coding method are such that no change is required depending on the state of the transmission path error.

Information indicating whether or not the mode for enhancing error resilience (the reference macroblock is included in the target video packet) is encoded as additional information and added to the header of the image coded signal. Therefore, it can be correctly determined at the time of decoding whether or not an image is a coded image coded in a mode for enhancing error resilience. In the first embodiment,
In the case of 0, only the case of referring to one encoding mode has been described, but the case of two or more encoding modes can be similarly realized.

The coding mode inter-screen encoder 2
014a is not limited to the configuration shown in FIG.
For example, in addition to the configuration of FIG.
A mode encoding method selector for selecting an encoding method of the encoding mode from the reference encoding modes selected in the above may be provided. In addition, in the conventional coding mode inter-screen encoder 2014 corresponding to the coding mode inter-screen encoder 2014a having such a configuration, the coding mode encoder 21
Reference numeral 10 (refer to FIG. 44) corresponds to a combination of the mode encoding method selector and the encoding mode encoder 2315.

Embodiment 11 FIG. FIG. 20 is a diagram for explaining an image coding apparatus according to Embodiment 11 of the present invention, and shows the configuration of a pixel value intra-screen encoder 2016a constituting the image coding apparatus. The intra-pixel-value encoder 2016a includes a video-pixel-outside pixel value generator 2320 in addition to the configuration of the conventional intra-pixel-value encoder 2016 shown in FIG. When the pixel that refers to the pixel value is a pixel in the target video packet, the pixel value generator 2320 outside the video packet reads the pixel value to be referenced from the pixel value memory 2114 and encodes the pixel value as a reference pixel value. If the reference pixel is a pixel outside the target video packet, the pixel value of the pixel in the target video packet having a spatial distance close to the reference pixel is set as a reference pixel value. 2
113.

The pixel value encoder 2113 determines the encoding method of the pixel value with reference to the output of the mode generator 2320 outside the video packet, and encodes the input signal (pixel value) by the determined encoding method. Configuration. The other configuration of the image encoding device according to the eleventh embodiment is the same as that of the conventional image encoding device 2200a.

Next, the flow of processing by the above-described intra-pixel-value encoder will be briefly described with reference to the flowchart in FIG. First, it is determined whether or not a pixel referred to for encoding a pixel value of a macroblock to be encoded is present in the target video packet (step B20a). If the pixel to be referenced is located outside the target video packet, the pixel value of the coded pixel in the target video packet having the closest spatial distance from the reference pixel is set as the pixel value to be referenced ( Step B21). Next, an encoding method of the encoded pixel value is determined based on the referenced pixel value (Step B22), and the encoded pixel value is encoded by the method determined in Step B22 (Step B23).

Next, the function and effect will be described. As described with reference to FIG. 45, the pixel value f (i, j) of the pixel g (i, j) to be encoded
, The 10 encoded pixels g (i−2, j−1),..., G (i, j) located around the encoded pixel g (i, j). -1)
, F (i-2, j-1),..., F (i, j-1). 10 located around the pixel to be coded g (i, j)
When all the peripheral pixels g (i-2, j-1),..., G (i, j-1) are present in the target video packet, the method is exactly the same as the conventional method. Also, as shown in FIG. 22, when a part of the coded pixel value to be referred to, which is located around the pixel to be coded, is located outside the video packet, the conventional coding process uses All pixel values of pixels outside the packet are replaced with predetermined values.

However, in the encoding process of an image signal, the pixel value f (i, j) of the pixel g (i, j) to be encoded is originally assumed on the assumption that the image signal has a very strong local correlation. , j), the encoding method for the pixel g (i−2, j−
1), ..., g (i, j-1) is determined from the pixel values f (i-2, j-1), ..., f (i, j-1) Therefore, when the correlation between the pixel values f (i−2, j−1),..., F (i, j−1) decreases, the pixel value f The coding efficiency for (i, j) becomes worse.

Therefore, in the eleventh embodiment, any one of the ten encoded pixels g (i-2, j-1),. When located outside the packet, by generating the reference pixel value corresponding to the pixel outside the video packet from the pixel value of the pixel in the target video packet, the spatial distance from the encoded pixel is the shortest, Even when referring to the pixel value of the pixel located outside the video packet, it is possible to prevent the encoding efficiency of the pixel value f (i, j) of the pixel to be encoded from deteriorating.

Specifically, as shown in FIG. 22 (a), when the coded pixel value is located one pixel away from the boundary of the video packet, the coded pixel g (i-2 , j-1), g (i-
2, j), g (i-2, j + 1) are located outside the target video packet, and the encoded pixels g (i-1, j-2), g (i-1, j-1), g (i-1, j), g (i-1, j +
1), g (i-1, j + 2), g (i, j-2), g (i, j-1) are located in the target video packet. Therefore, the pixel values f (i-2, j-1) of these encoded pixels g (i-2, j-1), g (i-2, j), g (i-2, j + 1)
j-1), f (i-2, j), and f (i-2, j + 1), as shown in FIG. f (i-1, j) and f (i-1, j + 1).

As shown in FIG. 22B, when the coded pixel value is located adjacent to the boundary of the video packet, the coded pixel g (i-2, j-1), g (i-2, j), g (i-2, j + 1), g (i
-1, j-2), g (i-1, j-1), g (i-1, j), g (i-1, j + 1), g (i-1, j + 2)
Are located outside the target video packet and g (i, j-2), g (i, j-1)
Are located in the target video packet. Therefore, the encoded pixels g (i-2, j-1), g (i-2, j), g (i-2, j +
1), g (i-1, j-1), g (i-1, j), g (i-1, j + 1), g (i-1, j + 2) pixel value f (i -2, j-1), f (i-2, j), f (i-2, j + 1), f (i-1, j-1), f (i-1,
j), f (i-1, j + 1) and f (i-1, j + 2) become pixel values f (i, j-1), respectively, as shown in FIG. Encoded pixel g
The (i-1, j-2) image value f (i-1, j-2) is a pixel value f (i, j-2). In this way, the reference pixel values f (i-2, j-1), ..., f (i, j
-1) is for a pixel outside the video packet, the correlation between the reference pixel values f (i-2, j-1), ..., f (i, j-1) is increased, Deterioration of coding efficiency can be prevented.

Embodiment 12 FIG. FIG. 23 is a diagram for explaining an image coding apparatus according to Embodiment 12 of the present invention, and shows the configuration of a pixel value inter-screen encoder 2017a constituting the image coding apparatus. The pixel value inter-screen encoder 2017a replaces the video packet extra pixel value generator 2320 in the pixel value intra-screen encoder 2016a of the eleventh embodiment with a video which performs a different pixel value generation process. It has an out-of-packet pixel value generator 2320a.

This out-of-video-packet pixel value generator 232
When the pixel whose pixel value is referred to is located in the target video packet, 0a reads out the pixel value referred to from the pixel value memory 2114 and outputs it to the pixel value encoder 2113 as a reference pixel value. If the pixel whose value is referred to is located outside the target video packet or has been inter-coded, the pixel value of the pixel in the target video packet that is close in spatial distance to the reference pixel is used as the reference pixel value. It is configured to output to the value encoder 2113.
Other configurations are the same as those of the eleventh embodiment.

Next, the function and effect will be described. With reference to the flowchart in FIG. 24, the flow of processing by pixel value inter-screen coding will be briefly described. First, it is determined whether or not a pixel that refers to a pixel value for encoding a pixel value of a macroblock to be encoded is located in a target video packet and satisfies a condition that inter-frame encoding has not been performed. (Step B20a). If the condition is not satisfied, the pixel value of the coded pixel in the target video packet having the closest spatial distance from the reference pixel is set as the reference pixel value (step B21).

Next, a coding method of the pixel value signal is determined based on the referred pixel value (step B22), and the pixel value signal is coded by the method determined in step B22 (step B23). Thus, in the twelfth embodiment,
The pixel value signal can be correctly encoded by the pixel value inter-screen encoder 2017a.

Embodiment 13 FIG. FIG. 25 is a diagram for explaining an image decoding apparatus according to Embodiment 13 of the present invention, and shows a configuration of an encoding mode in-screen decoder 2022a included in the image decoding apparatus. The encoding mode in-screen decoder 2022a according to the thirteenth embodiment is different from the encoding mode in-frame
Mode encoded signal 2300 encoded by encoding mode intra-screen encoder 2013a according to Embodiment 9 shown in FIG.
Is to be decoded. The encoding mode intra-screen decoder 2022a includes a video packet extra mode generator 2410 in addition to the configuration of the conventional encoding mode intra-screen encoder 2022 shown in FIG.

The mode generator 241 outside the video packet
0 indicates that the coding mode to be referred to is read from the decoding mode memory 2211 when the macroblock referring to the coding mode is located in the target video packet, and the coding mode decoder is used as the reference coding mode. 2210
And if the macroblock referring to the coding mode is located outside the target video packet, the coding mode of the macroblock in the target video packet having the closest spatial distance to the reference macroblock Is output to the encoding mode decoder 2210 as a reference encoding mode.

The encoding mode decoder 2210
Determines the encoding mode decoding method with reference to the output of the video packet outside mode generator 2410, decodes the encoded signal using the determined decoding method, and encodes the encoded mode signal 2
401 is output.

Next, the function and effect will be described. Next, the flow of processing by the above-described encoding mode in-screen decoder will be briefly described with reference to the flowchart in FIG. First, it is determined whether or not a reference macroblock around the macroblock to be decoded, whose coding mode is referred to, is located in the target video packet to be processed (step B30). If the reference macroblock is located outside the target video packet, the encoding mode of the decoded macroblock having the closest spatial distance from the reference macroblock is set as the encoding mode to be referred to (step B31).

Next, a decoding method of the encoding mode is determined according to the referred encoding mode (step B32).
The encoding mode is decoded by the method determined in step B32 (step B33). In this way, the encoded signal encoded by the encoding mode in-screen encoder 2013a shown in FIG. 15 according to the flow shown in FIG. 16 can be correctly decoded.

Embodiment 14 FIG. FIG. 27 is a diagram for explaining an image decoding apparatus according to Embodiment 14 of the present invention, and shows the configuration of an encoding mode inter-screen decoder 2023a constituting the image decoding apparatus. In the figure, the same reference numerals as those in FIG. 49 denote the same parts as in the conventional coding mode inter-screen decoder 2023. An encoding mode inter-screen decoder 2023a according to the fourteenth embodiment decodes a mode encoded signal encoded by the encoding mode inter-screen encoder 2014a shown in FIG.

The coding mode inter-picture decoder 2023
a includes an intra-screen decoding reference mode generator 2423 in addition to the configuration of the conventional encoding mode inter-screen decoder 2023 shown in FIG. Decoding reference mode generator 2212
Selection switches 2421, 232 provided before and after
2 is provided. Switches 2421 and 242
2 is connected to the intra-screen decoding reference mode generator 2423 when the error resilience mode signal 2301 indicates the error resilience mode, and is connected to the inter-screen decoding reference mode generator 2212 otherwise. It is configured to be controlled.

The intra-picture decoding reference mode generator 24
Reference numeral 23 is configured to generate a reference mode from the decoded coding mode of the target video packet. Also, the encoding mode decoder 2420 includes the switch 242
2 (a signal obtained by decoding the encoding mode), the mode encoding signal is decoded, and the encoding mode signal 2 is decoded.
403 is output. The other configuration of the image decoding apparatus according to Embodiment 14 is the same as that of the conventional image decoding apparatus 2200b.

Next, the function and effect will be described. The flow of processing by the encoding mode inter-screen decoder will be briefly described with reference to the flowchart in FIG. First, prior to decoding, it is determined whether the coding mode is an error resilience mode (a coding mode that reduces the influence of transmission path errors) or a non-error resilience mode (a coding mode that emphasizes coding efficiency). A determination is made (step B40). If the encoding mode is the error resilience mode, the reference encoding mode is generated only from the encoding mode of the macroblock in the target video packet (step B41). On the other hand, when the encoding mode is the non-error-resistant mode, the encoding mode of the macroblock in the decoded screen other than the target screen to be processed is also referred to together with the encoding mode of the macroblock in the target video packet. Then, the encoding mode to be referred to is determined (step B42).

Thereafter, a decoding method is determined from the input reference coding mode (step B43), and the coding mode of the target macroblock is decoded by the determined decoding method (step B44). Thus, the first embodiment
4, the encoding mode inter-screen encoder 20 shown in FIG.
At 14a, the encoded signal encoded according to the procedure of the flow of FIG. 19 can be correctly decoded.

The above-mentioned encoding mode inter-screen decoder 2
023a is not limited to the configuration shown in FIG.
For example, in addition to the configuration of FIG.
A mode decoding method selector for selecting a decoding method of an encoded signal from the reference encoding mode selected in the above may be provided. Encoding mode inter-screen decoder 20 having such a configuration
23a, a conventional encoding mode decoder 221
0 (see FIG. 49) is the encoding mode decoder 2 in FIG.
420 and a mode decoding method selector.

Embodiment 15 FIG. FIG. 29 is a diagram for explaining an image decoding apparatus according to Embodiment 15 of the present invention, and shows a configuration of a pixel value in-picture decoder 2025a constituting the image decoding apparatus. The intra-pixel value picture decoder 2025a decodes the coded signal encoded by the intra-pixel value picture encoder 2016 shown in FIG. 20, and performs the conventional intra-picture value decoding shown in FIG. Tableware 2025
In addition to the configuration described above, the pixel value generator 243 outside the video packet
0 is provided. When the pixel whose pixel value is referred to is located in the target video packet, the pixel value generator 2430 outside the video packet
The pixel value to be referred to is read from 14 and output to the pixel value decoder 2213 as a reference pixel value. On the other hand, when the pixel whose pixel value is referred to is located outside the target video packet,
The pixel value decoder 22 uses the pixel value of the pixel in the target video packet which is close in spatial distance to the reference pixel as a reference pixel value.
13 is output.

The pixel value decoder 2213 determines the decoding method of the pixel value with reference to the output of the pixel value generator 2430 outside the video packet, and converts the input signal (pixel value) by the determined decoding method. It is configured to decrypt. The other configuration of the image decoding apparatus according to the fifteenth embodiment is the same as that of the conventional image decoding apparatus 2200b.

Next, the function and effect will be described. The flow of processing by the pixel value in-picture decoder will be briefly described with reference to the flowchart in FIG. First, it is determined whether or not a pixel that refers to a pixel value for decoding a pixel value of a macroblock to be coded is located in the target video packet (step B50). If the referenced pixel is located outside the target video packet, the pixel value of the decoded pixel in the target video packet having the closest spatial distance from the reference pixel is referred to as the pixel value to be referred to. (Step B51).

Next, a decoding method of the encoded signal is determined based on the referenced pixel value (step B52), and the encoded signal is decoded by the method determined in step B52 (step B53). Thus, in the fifteenth embodiment,
In the pixel value intra-screen encoder 2016a shown in FIG.
A coded signal coded according to the flow procedure 1 can be correctly decoded.

Embodiment 16 FIG. FIG. 31 is a diagram for explaining an image decoding apparatus according to Embodiment 16 of the present invention, and shows the configuration of a pixel value inter-picture decoder 2026a constituting the image decoding apparatus. This inter-pixel value picture decoder 2026a decodes the pixel value encoded signal encoded by the inter-pixel value picture encoder 2017a in Embodiment 12 shown in FIG. The decoder 2026a is a unit other than the video packet pixel value generator 24 in the pixel value in-screen decoder 2025a of FIG.
30 is replaced with a video packet outside pixel value generator 2430a having a different function.

This extra-video-pixel value generator 243
If the pixel whose pixel value is referred to is located in the target video packet, 0a reads out the pixel value to be referred from the decoded pixel value memory 2214 and outputs it to the pixel value decoder 2213 as a reference pixel value. If the pixel whose pixel value is referred to is located outside the target video packet or is inter-coded, the pixel value of the pixel in the target video packet whose spatial distance is close to the reference pixel is referred to as the reference pixel value. Is output to the pixel value decoder 2213. Other configurations are the same as those of the fifteenth embodiment.

Next, the function and effect will be described. The flow of processing by the pixel value inter-picture decoder will be briefly described with reference to the flowchart in FIG. First, it is determined whether or not a pixel which refers to a pixel value for decoding a pixel value of a macroblock to be coded satisfies a condition that the pixel is located in the target video packet and is not inter-coded. (Step B50a). If the condition is not satisfied, the pixel value of the decoded pixel in the target video packet having the closest spatial distance from the reference pixel is set as the reference pixel value (step B51).

Next, a decoding method of the encoded signal is determined based on the referenced pixel value (step B52), and the encoded signal is decoded by the method determined in step B52 (step B53). Thus, in the sixteenth embodiment,
Embodiment 1 by means of a pixel value inter-screen decoder 2026a
The pixel value encoded signal encoded by the 2 pixel value inter-screen encoder can be correctly decoded.

It should be noted that an encoding processing program or a decoding processing program for performing the image processing by the image encoding apparatus or the image decoding apparatus shown in each of the above embodiments and the modifications thereof by software is provided by a floppy disk or the like. By recording the data on the data storage medium described above, the processing described in each of the above embodiments can be easily realized by an independent computer system.

FIG. 33 shows that the computer system executes the encoding process or the decoding process of each of the above-described embodiments and its modifications using a floppy disk storing the above-described encoding process program or the decoding process program. It is a figure for explaining a case. FIG. 33 (a)
Fig. 33 (b) shows the appearance, cross-sectional structure, and floppy disk main body viewed from the front of the floppy disk.
Shows an example of the physical format of the floppy disk body. The floppy disk FD is composed of a floppy disk case F
A plurality of tracks Tr are formed concentrically from the outer circumference toward the inner circumference on the surface of the floppy disk main body D, and each track Tr has 16 sectors in the angular direction. It is divided into Se. Therefore, the floppy disk FD storing the above program
In the floppy disk body D, data as the program is recorded in an area (sector) Se allocated thereon. FIG.
FIG. 3 (c) shows a configuration for recording the program on the floppy disk FD and performing image processing by software using the program stored in the floppy disk FD.

The above program is stored on a floppy disk FD
, The data as the program is written from the computer system Cs to the floppy disk FD via the floppy disk drive FDD.
When the image encoding device or the image decoding device is constructed in the computer system Cs by the program recorded on the floppy disk FD, the program is read from the floppy disk FD by the floppy disk drive FDD, and the computer system C
Load to s.

In the above description, the description has been made using the floppy disk as the data storage medium. However, even when the optical disk is used, the encoding process or the decoding process by software can be performed in the same manner as in the case of the floppy disk. it can. Further, the data storage medium is not limited to the above-mentioned optical disk or floppy disk, but may be any type of IC card, ROM cassette, etc., as long as it can record a program. As in the case where a floppy disk or the like is used, encoding or decoding by software can be performed.

Further, the image coded signal stored in the data storage medium such as a floppy disk is transmitted to the first embodiment.
By using the image output data structure of to 8 etc., it is possible to prevent transmission errors from spreading over a large number of screens on the decoding side, and suppress image quality degradation due to transmission errors. .

[0233]

As described above, the present invention (Claims 1, 17,
According to 24), when an image signal including a shape signal indicating a shape of an object on a display screen and a pixel value signal for displaying the object in gradation is encoded for each block that divides the display screen, When the coding mode for the target block is the inter-screen coding mode, a block transmission signal indicating whether or not the target block is a block outside the object shape is coded and output. With respect to the target block on which the inter-screen coding process has been performed, block transmission information indicating whether or not the block is an object-shaped block can be reproduced from the block transmission signal, and a transmission path error occurs. Even when the block transmission information cannot be obtained from the shape-encoded signal, the decoding process of the image-encoded signal can be performed based on the block transmission information, and the transmission error can be reduced. It is possible to reduce the impact of the issue process.

According to the present invention (claim 2), since the mode-coded signal is multiplexed with the shape-coded signal and the pixel-value-coded signal and transmitted, the multiplexed bit stream transmitted after coding the image signal Data structure of MPEG4
Standard.

According to the present invention (claim 3), the mode coded signal and the block transmission signal are multiplexed with the shape coded signal and the pixel value coded signal and transmitted, so that the image signal is coded and transmitted. The multiplexed bit stream includes additional information for increasing the resistance to transmission errors, and the multiplexed bit stream can have a data structure with high resistance to transmission errors.

According to the present invention (claims 4, 18, and 24), the first and second encoding processes are performed on the encoding mode signal to generate first and second mode encoded signals, The first mode coded signal is multiplexed with the shape coded signal and the pixel value coded signal and transmitted as a multiplexed bit stream, and the second mode coded signal is transmitted as a different bit stream different from the multiplexed bit stream. Therefore, the data structure of the multiplexed bit stream that is transmitted after encoding the image signal can be adapted to the MPEG4 standard, and transmission errors in the multiplexed bit stream are prevented as much as possible from hindering the decoding process. can do.

According to the present invention (claims 5 and 19), the second mode coded signal transmitted as a different bit stream different from the multiplexed bit stream is subjected to intra-screen coding processing as a coded mode signal. Since the signal is obtained by performing the transmission, it is possible to avoid the influence of the transmission error in another bit stream over a plurality of frames.

According to the present invention (claims 6, 20, and 24), since the block transparent signal is transmitted as a different bit stream different from the multiplexed bit stream, additional information for strengthening resistance to transmission errors is provided. Since transmission is performed independently of the multiplexed bit stream, resistance to transmission errors in the multiplexed bit stream can be effectively improved.

According to the present invention (claim 7), the process of coding the block transmission information and outputting the block transmission signal is performed in a mode in which the coding mode is the inter-screen coding mode and the mode in which error resilience is enhanced. Since the block transmission is performed only in a certain case, the block transmission signal is output only when strong error tolerance is required. When strong error tolerance is not required, deterioration of the coding efficiency can be prevented.

According to the present invention (claim 8), the block is constituted by a plurality of sub-blocks, and the block transmission information is used to determine whether each sub-block constituting the target block is located outside the object shape. , It is possible to more finely determine whether the target block is a block outside the object shape, and it is possible to improve coding efficiency.

According to the present invention (claims 9, 21, and 25), when decoding the image coded signal, if the coding mode is the intra-screen coding mode, the image is subjected to decoding processing. Block transparency information indicating whether or not the target block is located outside the object shape is generated from the decoded shape signal.On the other hand, when the encoding mode is the inter-screen encoding mode, the block Since the transmission signal is decoded to generate the block transmission information, it is possible to correctly decode an image-encoded signal encoded by an encoding process that enhances transmission error resistance while suppressing deterioration in encoding efficiency. Can be.

According to the present invention (claims 10, 22, 25), in the method of decoding an image coded signal,
A first decoding process is performed on the first mode coded signal in the multiplexed bit stream, and a second decoding process is performed on the second mode coded signal in the other multiplexed bit stream. According to the detection result of the transmission error, the mode decoding signal obtained by one of the above decoding processes is used, so that even if a transmission error occurs in the multiplexed bit stream, the decoding process can be performed normally. it can.

According to the present invention (claims 11, 23, and 25), the second mode coded signal in the separate bit stream, which is generated by intra coding, is subjected to intra picture decoding to perform encoding. Since the mode signal is generated, the mode encoded signal in another bit stream can be correctly decoded.

According to the present invention (claim 12), in the method for decoding an image-encoded signal, whether or not a target block to be decoded is located outside the object shape is indicated. The block transmission information is generated from the decoded shape signal. At this time, when the encoding mode is the inter-screen encoding mode and the mode for enhancing the transmission error resistance is obtained by decoding the image encoded signal. Since the block transmission information is replaced with the block transmission information, it is possible to correctly decode the coded image signal to which the block transmission signal is added, particularly when strong error resistance is required.

According to the present invention (claim 13), the unit of the decoding process is a sub-block constituting the block, and the block transparency information is obtained by converting each block constituting the target block into a block outside the object shape. Since the information indicates whether the target block is a block outside the object shape, the decoding side can also determine whether the target block is a block outside the object shape more finely.

According to the present invention (claim 14), the display screen is divided into a shape signal indicating the shape of the object on the display screen and an image signal consisting of a pixel value signal for displaying the object in gradation. In the image output data structure for outputting the image display data encoded for each block, the shape signal, the first bit string obtained by encoding the encoding mode signal, and encoding the block transmission information Since the configuration includes the obtained second bit sequence and the third bit sequence obtained by encoding the shape signal, whether the target block subjected to the inter-frame encoding process is a block outside the object shape is determined. It is possible to transmit block transmission information indicating whether or not the transmission error is present to the decoding side, and it is possible to suppress the influence of the transmission error between the screens in the decoding process.

According to the present invention (claim 15), in the image output data structure, the second bit string is
When the coding mode is a coding mode for enhancing error resilience, the block transmission information is a bit string obtained by coding, so that the block transmission signal is output only when strong error resilience is required. When strong error tolerance is not required, it is possible to prevent the coding efficiency from deteriorating.

According to the present invention (claim 16), in the image output data structure, in the image output data structure, the second bit string may be a sub-block constituting a block to be encoded. Is a bit string obtained by encoding the block transmission information indicating whether the block is outside the object shape, whether or not the target block is a block outside the object shape, it can be determined more finely, Encoding efficiency can be improved.

According to the present invention (claims 26, 28, and 30), the encoding mode for the shape signal of each block is changed according to the encoding mode corresponding to the pixel value signal of each frame with respect to the transmission error. Since the strong intra-frame encoding mode is used, it is possible to prevent the influence of transmission errors from extending over many frames.

According to the present invention (claims 27, 29, and 31), the pixel value coded signal is decoded according to the coding mode corresponding to the pixel value signal of each frame transmitted from the coding side. Since the shape-encoded signal is decoded according to the encoding mode for the shape signal of each block sent from the encoding side, the encoding side corresponds to the encoding mode corresponding to the pixel value signal of each frame on the encoding side. In addition, it is possible to realize a decoding process corresponding to an encoding process of changing an encoding mode for a shape signal of each block so as to be strong against transmission errors.

According to the present invention (claims 32, 42, and 52), when the reference pixel is located outside the target video packet, the pixel value of the reference pixel is generated from the pixel value of the pixel in the target video packet. Since the pixel value is replaced with the pixel value, the encoding efficiency when the reference pixel is located outside the video packet can be improved without weakening error resilience.

According to the present invention (claims 33 and 43),
Since the pixel value of the pixel in the target video packet closest to the reference pixel outside the target video packet is used as the pseudo pixel value, the correlation of the pixel value between the target pixel and the reference pixel is increased to increase the pixel value. Signal coding efficiency can be improved.

According to the present invention (claims 34, 44, and 52), when the reference block whose coding mode is referred to is located outside the target video packet, the coding mode of the reference block is changed to Since the coding mode is generated based on the coding mode of the block and replaced with the pseudo coding mode, the reference macroblock to which the coding mode is referred is a video packet while maintaining the error resilience in the inter-picture coding processing of the coding mode signal. The coding efficiency with respect to the coding mode signal in the case where it is located outside can be improved.

According to the present invention (claims 35 and 45),
Since the coding mode of the block in the target video packet closest to the reference block outside the target video packet is used as the pseudo coding mode, the correlation of the coding mode between the target macroblock and the reference macroblock is calculated. This can improve the coding efficiency of the coding mode signal.

According to the present invention (claims 36, 46, and 52), in the non-error resilience mode, a reference block around the target block is used as a reference block for referring to the coding mode. As the reference pixels and the reference blocks, those of the coded pixels and the coded blocks in the target video packet are used, so that the pixel value and the coding can be performed without causing a large configuration change and without reducing the error resilience. Deterioration of the coding efficiency for the mode signal can be suppressed.

According to the present invention (claims 37, 47, and 53), when a decoding process for a target pixel is performed with reference to a pixel value of a reference pixel, a pixel outside the target video packet becomes the reference pixel. Replaces the pixel value of the reference pixel with a pseudo pixel value generated based on the pixel value of the pixel in the target video packet, and thus replaces the pixel value of the reference pixel with the pseudo pixel value so as to improve coding efficiency. A decoding process corresponding to the encoding process can be realized.

According to the present invention (claims 38 and 48),
When performing decoding processing on the target pixel with reference to the pixel value of the reference pixel, if a pixel outside the target video packet is the reference pixel, the pixel value of the reference pixel is set to the closest pixel value to the reference pixel. Since the pixel value is replaced with the pixel value of the pixel in the target video packet, the decoding process corresponding to the coding process with high coding efficiency of the pixel value signal in which the correlation of the pixel value between the target pixel and the reference pixel is enhanced is performed. Can be realized.

The invention (claims 39, 49, 50, 5)
According to 3), when the decoding process of the coding mode signal for the target block is performed with reference to the coding mode of the reference block around the target block, if the reference block is located outside the target video packet, Since the coding mode of the reference block is replaced with a pseudo-coding mode generated based on the coding mode of the block in the target video packet, the coding mode signal of the reference block is pseudo-coded to improve coding efficiency. A decoding process corresponding to the encoding process to be replaced with the mode can be realized.

According to the present invention (claim 40), when the decoding process of the coding mode signal for the target block is performed with reference to the coding mode of a reference block around the target block, the reference block If it is located outside, the coding mode of the reference block is replaced with the coding mode of the block in the target video packet closest to the reference block, so that coding between the target block and the reference block is performed. It is possible to realize a decoding process corresponding to an encoding process with high encoding efficiency with respect to the encoding mode signal in which the correlation of the mode signal is enhanced. .

According to the present invention (claims 41 and 51),
When performing a pixel value decoding process on a target block using a block located around the target block as a reference block, in the non-error-resistant mode, using the block in the decoded screen as the reference block, In the error resilience mode, only the decoded block in the target video packet area is used as the reference block, and the decoding process of each block is performed by a decoding method common to the non-error resilience mode and the error resilience mode. In the error resilience mode, a code using a block around the target block as a reference block to be referred to in the coding mode, and in the error resilience mode, a code using a coded block in the target video packet as the reference block. A decoding process corresponding to the decoding process can be realized.

[Brief description of the drawings]

FIG. 1 is a block diagram for describing an image encoding device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a data structure (FIG. (A)) of a shape bit stream output by the image coding apparatus according to the first embodiment and a data structure (FIG. (B)) according to a modified example thereof.

FIG. 3 is a flowchart showing a flow of an encoding process performed by the image encoding device according to the first embodiment;

FIG. 4 is a block diagram for explaining an image decoding device according to a second embodiment of the present invention.

FIG. 5 is a flowchart illustrating a flow of a decoding process performed by the image decoding apparatus according to the second embodiment;

FIG. 6 is a block diagram illustrating an image encoding device according to a third embodiment of the present invention.

FIG. 7 is a flowchart illustrating a flow of an encoding process performed by the image encoding device according to the third embodiment;

FIG. 8 is a block diagram illustrating an image decoding device according to a fourth embodiment of the present invention.

FIG. 9 is a flowchart showing a flow of a decoding process by the image decoding apparatus according to the fourth embodiment.

FIG. 10 is a block diagram for explaining an image encoding device according to a fifth embodiment of the present invention.

FIG. 11 is a block diagram illustrating an image decoding device according to a sixth embodiment of the present invention.

FIG. 12 is a block diagram for describing an image encoding device according to a seventh embodiment of the present invention.

FIG. 13 is a schematic diagram for explaining an operation of the image encoding device according to the seventh embodiment.

FIG. 14 is a block diagram for explaining an image decoding apparatus according to an eighth embodiment of the present invention.

FIG. 15 is a block diagram showing a configuration of an encoding mode intra-screen encoder according to Embodiment 9 of the present invention.

FIG. 16 is a diagram showing, in a flowchart, an encoding mode intra-screen encoding process in the ninth embodiment.

FIGS. 17A and 17B are the same as those in the ninth embodiment shown in FIGS.
FIG. 6 is a diagram for describing the intra-screen encoding processing in the encoding mode in ()).

FIG. 18 is a block diagram illustrating a configuration of an encoding mode inter-screen encoder according to Embodiment 10 of the present invention.

FIG. 19 is a diagram showing, in a flowchart, a coding mode inter-screen coding process in the tenth embodiment.

FIG. 20 is a block diagram showing a configuration of a pixel value inter-screen encoder according to Embodiment 11 of the present invention.

FIG. 21 is a diagram illustrating, in a flowchart, a pixel value intra-screen encoding according to the eleventh embodiment.

FIG. 22 is an explanatory diagram of an intra-screen encoding process of a pixel value according to the eleventh embodiment.

FIG. 23 is a block diagram showing a configuration of a pixel value inter-screen encoder according to Embodiment 12 of the present invention.

FIG. 24 is a diagram showing, in a flowchart, a pixel value inter-picture encoding process in the twelfth embodiment.

FIG. 25 is a block diagram showing a configuration of an encoding mode intra-screen decoder according to Embodiment 13 of the present invention.

FIG. 26 is a diagram illustrating, in a flowchart, a coding-mode in-screen decoding process according to Embodiment 13;

FIG. 27 is a block diagram illustrating a configuration of an encoding mode inter-screen decoder according to Embodiment 14 of the present invention.

FIG. 28 is a diagram illustrating, in a flowchart, a coding mode inter-screen decoding process according to Embodiment 14;

FIG. 29 is a block diagram illustrating a configuration of a pixel value in-picture decoder according to Embodiment 15 of the present invention.

FIG. 30 is a diagram illustrating, in a flowchart, a pixel value intra-screen decoding process according to Embodiment 15;

FIG. 31 is a block diagram illustrating a configuration of a pixel value inter-picture decoder according to Embodiment 16 of the present invention.

FIG. 32 is a diagram illustrating, in a flowchart, a pixel value inter-screen decoding process according to the sixteenth embodiment.

FIG. 33 is an explanatory diagram of a pixel value storage medium for storing a program for realizing the image encoding method or the image decoding method of each of the embodiments by a computer system.

FIG. 34 is a diagram for describing a display image based on an image signal including a shape signal and a pixel value signal.

FIG. 35 is a diagram for describing a coding unit of an image signal corresponding to a display screen.

FIG. 36 is a diagram illustrating a signal format (data structure) of an image encoded signal obtained by encoding an image signal including a shape signal.

FIG. 37 is a diagram showing a signal format (data structure) of a conventional shape signal.

FIG. 38 is a block diagram for explaining a conventional image encoding device.

FIG. 39 is a block diagram for explaining a conventional image decoding device.

FIG. 40 is a diagram for describing a configuration of one screen.

FIG. 41 is a diagram illustrating an overall configuration of a conventional image encoding device.

42 shows a conventional encoding mode intra-screen encoding process (FIG.
(a)) and conventional encoding mode inter-screen encoding processing (Fig.
It is explanatory drawing of (b)).

FIG. 43 is a block diagram showing a configuration of a conventional encoding mode intra-frame encoder.

FIG. 44 is a block diagram illustrating a configuration of a conventional encoding mode inter-screen encoder.

FIG. 45 is an explanatory diagram of a conventional intra-screen encoding process of a pixel value.

FIG. 46 is a block diagram showing a configuration of a conventional pixel value intra-screen encoder.

FIG. 47 is a diagram illustrating an overall configuration of a conventional image decoding device.

FIG. 48 is a block diagram showing a configuration of a conventional encoding mode in-picture decoder.

FIG. 49 is a block diagram showing a configuration of a conventional encoding mode inter-screen decoder.

FIG. 50 is a block diagram showing a configuration of a conventional pixel value in-picture decoder.

[Explanation of symbols]

1000a, 1000c, 1500a, 1500c Image coding device 1000b, 1000d, 1500b, 1500d Image decoding device 1001, 1110 Shape signal 1002, 1111 Pixel value signal 1003, 1105 Error resilience mode signal 1010, 1510 Mode discriminator 1010a Coding mode Signal 1011 Mode encoder 1011a, 1011b First and second mode encoders 1013, 1051 First changeover switch 1014 Inter-screen encoder 1014a Inter-coded signal 1014b Inter-local decoded signal 1015 In-screen encoder 1015a Intra coded signal 1015b Intra locally decoded signal 1016, 1054 Second changeover switch 1017, 1062 Third changeover switch 1018 Memory 1019, 106 Block transmission determiner 1019a, 1060a Block transmission signal 1020, 1520 Pixel value encoder 1030 Block transmission encoder 1031 Open / close switch 1050 Mode decoder 1050a Reproduction encoding mode signal 1550a, 1550b First and second mode decoding Device 1052 inter-screen decoder 1052a inter-decoded signal 1053 intra-screen decoder 1053a intra-decoded signal 1055a reproduction shape signal 1061 block transmission decoder 1063,1563 pixel value decoder 1100 mode encoded signal 1101a, 1101b 1, second mode coded signal 1101 shape coded signal 1017a restored shape signal 1103, 1503 pixel value bit stream 1104 block transmission signal 2001 image signal (pixel value signal) 200 Refresh signal 2100 Encoding mode signal 2110, 2315 Encoding mode encoder 2111 Encoding mode memory 2113 Pixel value encoder 2114 Pixel value memory 2112 Inter-screen encoding reference mode generator 2210, 2420 Encoding mode decoder 2211 Decoding mode memory 2212 Inter-screen decoding reference mode generator 2310, 410 Video packet outside mode generator 2312 In-screen coding reference mode generator 2314, 2424 Mode coding method selector 2320, 2430 Video packet outside pixel value generator 2320a, 2430a Video packet outside / inter-frame coded pixel value generator 2423 In-screen decoding reference mode generator 2424 mode coding method selector Cs Computer system D Floppy disk body FD Floppy disk Disk FDD floppy disk drive FC floppy disk case Se sector Tr track

Claims (53)

[Claims] 1. An image coding method for coding an image signal consisting of a shape signal indicating the shape of an object on a display screen and a pixel value signal for gradationally displaying the object for each block dividing the display screen. A method for coding the shape signal in one of an intra-screen coding mode using intra-screen correlation and an inter-screen coding mode using inter-screen correlation for each of the blocks. The coding mode signal indicating the determined coding mode is coded to output a mode coded signal. Based on the shape signal, the target block to be coded is out of the object shape. Generating block transmission information indicating whether or not the block transmission information is located, and outputting a shape-encoded signal by encoding the shape signal in the determined encoding mode; Reference the pixel value signal to output a pixel value encoded signal. At this time, when the encoding mode is the inter-screen encoding mode, the block transmission information is encoded and output as a block transmission signal. Image encoding method. 2. The image encoding method according to claim 1, wherein the mode encoded signal is multiplexed together with the shape encoded signal and the pixel value encoded signal, and these are output as one multiplexed bit stream. Characteristic image coding method. 3. The image encoding method according to claim 1, wherein the mode encoded signal and the block transparent signal are multiplexed together with the shape encoded signal and the pixel value encoded signal, and these are multiplexed into one multiplexed bit stream. An image encoding method characterized by outputting as an image. 4. The image encoding method according to claim 1, wherein a first encoding process is performed on the determined encoding mode signal, and a first mode encoded signal obtained by the encoding process is obtained. Multiplexing with the block transmission signal, the shape coded signal, and the pixel value coded signal and sending out the multiplexed bit stream, and performing a second coding process on the determined coding mode signal, An image encoding method for transmitting a second mode encoded signal obtained by the encoding process as a bit stream different from the multiplexed bit stream. 5. The image encoding method according to claim 4, wherein an intra-screen encoding process is performed as the second encoding process. 6. The image coding method according to claim 1, wherein the mode coded signal, the shape coded signal, and the pixel value coded signal are multiplexed and transmitted as a multiplexed bit stream, and the block transparent signal is transmitted. And transmitting the multiplexed bit stream as a different bit stream different from the multiplexed bit stream. 7. The image encoding method according to claim 1, wherein the processing of encoding and transmitting the block transmission information is such that the encoding mode is an inter-screen encoding mode, and An image coding method characterized in that the method is performed only in a mode in which resistance to transmission errors is enhanced. 8. The image encoding method according to claim 1, wherein the block is configured by a plurality of sub-blocks, and the block transmission information is configured to form a target block to be subjected to an encoding process. An image coding method characterized by indicating whether or not a sub-block is located outside an object shape. 9. An image decoding method for decoding an image encoded signal obtained by encoding an image signal by the image encoding method according to claim 1, wherein said mode encoded signal is decoded. Generating an encoding mode signal indicating whether the shape signal is encoded in any of the intra-screen encoding mode and the inter-screen encoding mode, and corresponding to the shape encoding signal to the encoding mode When the coding mode is the intra-screen coding mode, it is determined whether the target block to be decoded is located outside the object shape. The generated block transmission information is generated from the decoded shape signal. On the other hand, when the coding mode is the inter-screen coding mode, the block transmission signal is decoded to generate the block transmission information. And decoding the pixel value encoded signal with reference to the block transmission information to generate a pixel value signal. 10. An image decoding method for decoding an image encoded signal obtained by encoding according to the image encoding method according to claim 4, wherein a first mode encoded signal in the multiplexed bit stream is And a second decoding process is performed on the mode-coded signal in the another bit stream. When a transmission error in the multiplexed bit stream is equal to or more than a predetermined reference value, the second decoding process is performed. Based on the encoding mode signal obtained by the encoding process, at other times,
A coding mode of the shape coded signal is determined based on the coding mode signal obtained by the first decoding process, and a decoding process corresponding to the determined coding mode is added to the shape coded signal. To generate a shape signal, and when the coding mode is the intra-screen coding mode, block transmission information indicating whether or not the target block to be decoded is located outside the object shape. Is generated from the shape signal obtained by the decoding.On the other hand, when the encoding mode is the inter-screen encoding mode, the block transmission signal is decoded to generate the block transmission information. An image decoding method, comprising decoding a pixel value encoded signal with reference to block transmission information to generate a pixel value signal. 11. The image decoding method according to claim 10, wherein the mode-encoded signal included in the separate bit stream is obtained by intra-coding an encoded mode signal. Wherein the second decoding process for the mode-encoded signal is an in-screen decoding process. 12. An image decoding method for decoding an image encoded signal obtained by encoding an image signal by the image encoding method according to claim 7, wherein said mode encoded signal is decoded. Generating an encoding mode signal indicating whether the shape signal is encoded in any of the intra-screen encoding mode and the inter-screen encoding mode, and corresponding to the shape encoding signal to the encoding mode When the coding mode is the inter-screen coding mode and the mode for enhancing the transmission error resilience, the target block to be subjected to the decoding process has the object shape. The block transmission information indicating whether the block is located outside is generated by decoding the block transmission signal, while the coding mode is the inter-screen coding mode and the transmission error tolerance is generated. Except when the mode is a mode that enhances the performance, the block transmission information is generated from the decoded shape signal, and the pixel value encoded signal is decoded by referring to the block transmission information to obtain a pixel value signal. An image decoding method characterized by generating. 13. The image decoding method according to claim 9 or 12, wherein the block is configured by a plurality of sub-blocks, and the block transparency information is used to configure a target block to be subjected to a decoding process. An image decoding method characterized by indicating whether or not a sub-block is located outside an object shape. 14. An image code obtained by coding an image signal consisting of a shape signal indicating the shape of an object on a display screen and a pixel value signal for gradationally displaying the object for each block dividing the display screen. An image output data structure for outputting an encoded signal, wherein the shape signal is encoded in any of an intra-picture encoding mode using the intra-picture correlation and an inter-picture encoding mode using the inter-picture correlation. A first bit string obtained by coding a coding mode signal indicating whether coding is performed in the mode, and block transmission information indicating whether the target block to be coded is located outside the object shape And a third bit string obtained by coding the shape signal in one of the two coding modes, and coding the pixel value signal with reference to the shape signal. And a fourth bit string obtained by converting the first bit string into a second bit string before the second bit string.
Characterized in that these bit strings are arranged so that the bit strings are transmitted before the third bit string and the third bit string is transmitted before the fourth bit string. 15. The data structure for image output according to claim 14, wherein the second bit sequence is a mode in which the encoding mode is a mode for enhancing resistance to a transmission error of an image signal.
An image output data structure obtained by encoding the block transmission information. 16. The data structure for image output according to claim 14, wherein said block is composed of a plurality of sub-blocks, and said second bit string is a sub-block to be encoded. An image output data structure, which is obtained by encoding block transmission information indicating whether a block is located outside a shape. 17. An image coding method for coding an image signal consisting of a shape signal indicating the shape of an object on a display screen and a pixel value signal for gradationally displaying the object for each block dividing the display screen. The apparatus, wherein the shape signal is encoded in any one of an intra-screen encoding mode using intra-screen correlation and an inter-screen encoding mode using inter-screen correlation, for each of the blocks. A mode determining means for determining the coding mode, a mode coding means for coding a coding mode signal indicating the determined coding mode and outputting a mode coded signal, and a coding processing target based on the shape signal. Transmission determination means for generating block transmission information indicating whether or not the target block to be located is outside the object shape; and when the encoding mode is the inter-screen encoding mode, Block transmission encoding means for encoding transmission information and outputting a block transmission signal; intra-screen encoding means for encoding the shape signal in a screen and outputting a shape-encoded signal; corresponding to an encoded previous screen With reference to the shape signal to be processed, an inter-screen encoding unit that inter-encodes the shape signal of the target block and outputs a shape-encoded signal, and the intra-frame encoding unit and the inter-screen encoding unit encode the shape signal. A storage unit for temporarily storing a shape signal as a shape signal of an encoded screen; a pixel value encoding unit for encoding the pixel value signal with reference to the block transmission information and outputting a pixel value encoded signal; An image encoding device comprising: 18. The image encoding apparatus according to claim 17, wherein the mode encoding unit performs a first encoding process on the encoded mode signal to perform a first encoding process.
A first mode encoder that outputs a mode-encoded signal of
And a second mode encoder for outputting a mode-encoded signal, and multiplexing the first mode-encoded signal together with a shape-encoded signal and a pixel-value-encoded signal to output a multiplexed bit stream. An image encoding apparatus for outputting the second mode encoded signal as a different bit stream different from the multiplexed bit stream. 19. The image encoding apparatus according to claim 18, wherein the second mode encoder performs an intra-screen encoding process as the second encoding process on the encoded mode signal. An image encoding device characterized by: 20. The image coding apparatus according to claim 17, wherein the mode coded signal, the shape coded signal, and the pixel value coded signal are multiplexed to output a multiplexed bit stream, and the block transmission signal is multiplexed. An image encoding apparatus for outputting a different bit stream different from the multiplexed bit stream. 21. An image signal comprising a shape signal indicating a shape of an object on a display screen and a pixel value signal for gradationally displaying the object in a predetermined coding mode for each block dividing the display screen. An image decoding device that decodes an encoded image signal obtained by encoding for each of the blocks, wherein the mode encoding signal from the encoding side is decoded, and the shape signal uses intra-screen correlation. Mode decoding means for generating an encoding mode signal indicating which encoding mode is used in the intra-coding mode or the inter-coding mode using inter-picture correlation, and a shape from the encoding side An intra-screen decoding means for performing an intra-screen decoding process on the encoded signal to generate a shape signal; and an inter-screen decoding of the shape-encoded signal with reference to the decoded shape signal corresponding to the previous screen. Process Inter-screen decoding means for generating a shape signal; storage means for temporarily storing a shape signal obtained by decoding by the intra-screen decoding means and the inter-screen decoding means as a shape signal of a previous screen; When the encoding mode is the intra-screen encoding mode, block transmission information indicating whether the target block to be decoded is located outside the object shape is generated from the decoded shape signal, When the encoding mode is the inter-screen encoding mode, a block transmission information generating unit that decodes a block transmission signal from the encoding side to generate block transmission information; and the pixel with reference to the block transmission information. An image decoding apparatus comprising: a pixel value decoding unit that performs a decoding process on a value-encoded signal to generate a pixel value signal. 22. The image decoding apparatus according to claim 21, wherein said mode decoding means comprises: a first mode code supplied from a coding side along with a shape coding signal and a pixel value coding signal by a multiplexed bit stream. A first signal indicating whether the shape signal has been encoded in one of an intra-picture encoding mode using intra-picture correlation and an inter-picture encoding mode using inter-picture correlation. A first mode decoder for generating an encoded mode signal, and a second mode encoded signal supplied from the encoding side as a different bit stream different from the multiplexed bit stream, so that the shape signal is displayed on the screen. The second encoding indicating which encoding mode is used in the intra-coding mode using the inner correlation and the inter-coding mode using the inter-correlation. A second mode decoder for generating a mode signal, wherein when the transmission error in the multiplexed bit stream is equal to or greater than a predetermined reference value, the second encoding mode signal
In other cases, the first decoding mode signal is selected and output as a coding mode signal. 23. The image decoding apparatus according to claim 22, wherein the second mode encoded signal supplied from the encoding side as a different bit stream different from the multiplexed bit stream is supplied to the encoding side at the predetermined mode. The signal indicating the encoding mode is obtained by performing an intra-screen encoding process. The second mode decoder performs an intra-screen decoding process on the second mode encoded signal. An image decoding apparatus configured to generate a second encoding mode signal. 24. A data storage medium storing an image processing program for performing image processing by software, wherein the image processing program is an image encoding method according to claim 1, 4, or 6. A data storage medium, which is an image encoding program for causing a computer to perform an image signal encoding process by using a computer. 25. A data storage medium storing an image processing program for performing image processing by software, wherein the image processing program is an image processing method according to any one of claims 9 to 11. A data storage medium, which is an image decoding program for causing a computer to perform a decoding process on an encoded signal. 26. An encoding process for encoding an image signal composed of a shape signal indicating a shape of an object on a screen and a pixel value signal for gradationally displaying the object for each block dividing the screen. An intra-screen encoding mode using an intra-screen correlation of a pixel value signal corresponding to a processing target screen to be processed, a first inter-screen encoding mode using a correlation between the processing target screen and a previous processing screen, And an image performed based on a pixel value encoding mode indicating which encoding mode of the second inter-screen encoding mode uses the correlation between the screen to be processed and the previous and subsequent processing screens In the encoding method, when the pixel value encoding mode is the intra-screen encoding mode or the first inter-screen encoding mode, the encoding mode for the shape signal of each block becomes the intra-screen encoding mode. The above picture When the value encoding mode is the second inter-picture encoding mode, the coding of the shape signal is performed so that the encoding mode for the shape signal of each block is the above-described intra-picture encoding mode or the first inter-picture encoding mode. A coding mode signal that indicates the coding mode of the determined shape signal, and outputs a mode-coded signal. At the same time, each of the shape signals is determined by the determined coding mode. Outputting a shape-encoded signal by encoding for each block, encoding the pixel value signal in the pixel value encoding mode, and outputting the pixel value encoded signal together with information on the pixel value encoding mode. Image encoding method. 27. An image decoding method for decoding an image encoded signal obtained by encoding an image signal by the image encoding method according to claim 26, wherein the mode encoded signal from the encoding side is decoded. And an encoding mode signal indicating which of the encoding modes of the shape signal has been encoded in the intra-screen encoding mode, the first inter-picture encoding mode, and the second inter-picture encoding mode And performs a decoding process corresponding to the encoding mode indicated by the encoding mode signal on each block to the shape-encoded signal from the encoding side to generate a shape signal, and generates a pixel from the encoding side. An image decoding method comprising: decoding a value-encoded signal based on information from an encoding side indicating a pixel-value encoding mode to generate a pixel-value signal. 28. An encoding process for encoding an image signal composed of a shape signal indicating a shape of an object on a screen and a pixel value signal for gradationally displaying the object for each block dividing the screen. An intra-screen encoding mode using an intra-screen correlation of a pixel value signal corresponding to a processing target screen to be processed, a first inter-screen encoding mode using a correlation between the processing target screen and a previous processing screen, And an image performed based on a pixel value encoding mode indicating which encoding mode of the second inter-screen encoding mode uses the correlation between the screen to be processed and the previous and subsequent processing screens An encoding device, receiving a shape signal and a signal indicating a pixel value encoding mode, and when the pixel value encoding mode is the intra-screen encoding mode or the first inter-screen encoding mode, Sign for shape signal Modes becomes said intra coding mode, when the pixel value encoding mode is the encoding mode between the second window, the coding mode is said intra coding mode or the first on the shape signal of each block
Mode determining means for determining a coding mode of the shape signal so as to be the inter-screen coding mode, and coding mode signals indicating the coding mode of the determined shape signal are output as mode coding signals. Mode encoding means; shape encoding means for encoding the shape signal for each block in the determined encoding mode to output a shape encoded signal; and the pixel value signal encoding the pixel value signal. A pixel value encoding unit that encodes the pixel value in a mode and outputs a pixel value encoded signal together with information on the pixel value encoding mode. 29. An image decoding apparatus for decoding an image encoded signal obtained by encoding an image signal by the image encoding method according to claim 26, wherein the mode encoding signal from the encoding side is decoded. And an encoding mode signal indicating which of the encoding modes of the shape signal has been encoded in the intra-screen encoding mode, the first inter-picture encoding mode, and the second inter-picture encoding mode Mode decoding means for generating a shape signal from the encoding side, and performing a decoding process corresponding to the above-described coding mode for each block to generate a shape signal. Pixel value decoding means for decoding a pixel value encoded signal from the encoding side based on information from the encoding side indicating the pixel value encoding mode to generate a pixel value signal. Decryption device. 30. A data storage medium storing an image processing program for performing image processing by software, wherein the image processing program performs an image signal encoding process according to the image encoding method according to claim 26. A data storage medium, which is an encoding processing program to be executed by a computer. 31. A data storage medium storing an image processing program for performing image processing by software, wherein the image processing program decodes an encoded image signal by the image decoding method according to claim 27. A data storage medium, which is a decryption processing program for causing a computer to perform processing. 32. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image coding method for grouping pixel values so as to correspond to a block composed of a predetermined number of pixels, sequentially coding the grouped pixel values for each block, and outputting the coded pixel values for each video packet area When performing an encoding process on a pixel value of a pixel in a target block to be subjected to the encoding process with the encoded pixel subjected to the encoding process as a reference pixel, When a pixel located outside the target video packet area to which the pixel belongs is the reference pixel, the pixel value of the reference pixel is determined based on the pixel value of the pixel located in the target video packet area. There replaced with pseudo pixel value generated, with reference to pseudo pixel value, the image coding method characterized by performing encoding of the pixel values in the target block. 33. The image encoding method according to claim 32, wherein a pixel value of a pixel in the target video packet closest to a reference pixel located outside the target video packet area is used as the pseudo pixel value. An image encoding method characterized by the following. 34. An image signal corresponding to a screen is divided so as to correspond to a video packet area constituting a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image coding method for grouping pixel values so as to correspond to a block composed of a predetermined number of pixels, sequentially coding the grouped pixel values for each block, and outputting the coded pixel values for each video packet area Wherein the encoding process for each block indicates what type of encoding process is performed for each block,
Performing by referring to the encoding mode set for each block. At this time, if the block located outside the target video packet area to which the target block belongs is a reference block that refers to the encoding mode, The coding mode of the reference block is replaced with a pseudo coding mode generated based on the coding mode of a block located in the target video packet area, and the code of the target block is referred to by referring to the pseudo coding mode. An image encoding method characterized by performing an encoding process. 35. The image coding method according to claim 34, wherein a coding mode of a block in the target video packet closest to the reference block is used as the pseudo coding mode. Method. 36. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image coding method for grouping pixel values so as to correspond to a block composed of a predetermined number of pixels, sequentially coding the grouped pixel values for each block, and outputting the coded pixel values for each video packet area When a block located around a target block to be subjected to the encoding process is set as a reference block, and when the encoding process for each of the blocks is performed in the non-error-resistant mode, the reference block is
When using the blocks in the coded screen on which the coding process has already been performed and the coding process for each of the blocks is performed in the error resilience mode, the code in the target video packet area is used as the reference block. The coding process of each block is performed by using a coding method common to the non-error resilience mode and the error resilience mode based on the coding mode of the reference block, using only the coded blocks that have already been subjected to the coding process. An image coding method characterized by the above-mentioned. 37. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image-encoded signal in which pixel values are grouped so as to correspond to a block composed of a predetermined number of pixels, the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are output for each video packet area. An image decoding method for decoding a pixel value of a pixel in a target block to be decoded using a decoded pixel subjected to the decoding process as a reference pixel When the pixel located outside the target video packet area to which the target block belongs is the reference pixel, the pixel value of the reference pixel is set in the target video packet area. Replaced with pseudo pixel value generated based on the pixel values of pixels positioned, with reference to the pseudo pixel value, the image decoding method and performing a decoding process of the pixel values in the target block. 38. An image decoding method for decoding an image encoded signal encoded by the image encoding method according to claim 33, wherein a pixel value of a pixel in a target block to be decoded is set. When performing a decoding process using a pixel located around the target block as a reference pixel, when the pixel located outside the target video packet area to which the target block belongs becomes the reference pixel, The pixel value of the pixel is replaced with the pixel value of the pixel in the target video packet area closest to the reference pixel, and decoding processing of the pixel value in the target block is performed with reference to the replaced pixel value. An image decoding method, characterized in that: 39. An image decoding method for decoding an image-encoded signal encoded by the image encoding method according to claim 34, wherein said object block is a target block to be decoded. When performing a decoding process using a block located around the block as a reference block, if the block located outside the target video packet area to which the target block belongs is the reference block, the coding mode of the reference block is set. Is replaced with a pseudo-coding mode generated based on a coding mode of a block located in the target video packet area, and decoding processing on the target block is performed with reference to the pseudo-coding mode. Image decoding method. 40. An image decoding method for decoding an image-encoded signal encoded by the image encoding method according to claim 35, wherein a target block to be subjected to decoding processing is When performing a decoding process using a block located around the block as a reference block, if a block located outside the target video packet area to which the target block belongs is the reference block,
The coding mode of the reference block is replaced with the coding mode of the block in the target video packet area closest to the reference block, and decoding processing for the target block is performed with reference to the replaced coding mode. Performing an image decoding method. 41. An image decoding method for decoding an image encoded signal encoded by the image encoding method according to claim 36, wherein a pixel value of a pixel in a target block to be decoded is calculated. On the other hand, when performing a decoding process using a block located around the target block as a reference block, when the coding process for each of the blocks is performed in the non-error-resistant mode,
When using the blocks in the decoded screen to which the decoding process has already been performed and the coding process for each block is performed in the error resilience mode, the decoding in the target video packet area as the reference block is performed. Only the decoded blocks that have been subjected to the decoding process are used, and the decoding process of each block is performed by the decoding method common to the non-error-resistant mode and the error-resistant mode based on the coding mode of the reference block. An image decoding method, characterized in that: 42. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image encoding apparatus that groups pixel values into groups corresponding to blocks of a predetermined number of pixels, sequentially encodes the grouped pixel values for each block, and outputs the encoded pixel values for each video packet area An encoder for encoding a pixel value corresponding to each block by referring to the encoded pixel subjected to the encoding process as a reference pixel and referring to the pixel value, and storing the encoded pixel value Storage means, and when a pixel located outside the target video packet area to which the target block belongs is the reference pixel, the pixel value of the reference pixel is stored in the target video packet area. The pixel value is replaced with a pseudo pixel value generated based on the pixel value of the located pixel and output.If the pixel located in the target video packet is the reference pixel, the encoded pixel value stored in the storage unit is An image encoding apparatus, comprising: a video packet extra pixel value generation unit that outputs to the encoder as the reference pixel. 43. The image encoding apparatus according to claim 42, wherein said pixel value outside video packet generation means is configured to generate, as said pseudo pixel value, a target video closest to a reference pixel located outside said target video packet area. An image encoding device for outputting a pixel value of a pixel in a packet. 44. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image encoding apparatus that groups pixel values into groups corresponding to blocks of a predetermined number of pixels, sequentially encodes the grouped pixel values for each block, and outputs the encoded pixel values for each video packet area An encoder that encodes the encoded mode value corresponding to each block by referring to the encoded block subjected to the encoding process as a reference block, and referring to the encoding mode; and an encoded code. Storage means for storing a generalization mode value; and when a block located outside the target video packet area to which the target block belongs is the reference block,
The coding mode value of the reference block is replaced with the pseudo coding mode generated based on the coding mode value of the block located in the target video packet area, and the block is located in the target video packet. A video packet extra coding mode value generating means for outputting the coding mode value stored in the storage means as the coding mode value of the reference block to the encoder when the reference block is used. An image encoding device characterized by the above-mentioned. 45. The image coding apparatus according to claim 44, wherein said extra-video-packet encoding mode value generation means encodes a code of a block in a target video packet closest to said reference block as said pseudo-encoding mode. An image encoding apparatus for outputting an encoding mode to an encoder. 46. An image signal corresponding to a screen is divided so as to correspond to a video packet area constituting a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image encoding apparatus that groups pixel values into groups corresponding to blocks of a predetermined number of pixels, sequentially encodes the grouped pixel values for each block, and outputs the encoded pixel values for each video packet area An encoder that encodes the encoded mode value corresponding to each block by referring to the encoded block subjected to the encoding process as a reference block, and referring to the encoding mode; and an encoded code. Storage means for storing an encoding mode value; and when encoding processing for each of the blocks is performed in the error resilience mode, a code A reference encoding mode value is generated with reference to only the encoding mode, and when the encoding process for each of the blocks is performed in the non-error tolerant mode, the encoding is performed together with the encoding mode of the block in the target video packet. An image coding apparatus, comprising: a reference coding mode value generation unit that generates and outputs a reference coding mode value with reference to a coding mode of a block in a converted screen. 47. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image-encoded signal in which pixel values are grouped so as to correspond to a block composed of a predetermined number of pixels, the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are output for each video packet area. An image decoding apparatus for decoding a decoded pixel as a reference pixel, and decoding an encoded pixel value corresponding to each block with reference to the pixel value. A storage unit for storing the decoded pixel value; and a pixel located outside the target video packet area to which the target block belongs is the reference pixel. The elementary value is replaced with a pseudo pixel value generated based on the pixel value of a pixel located in the target video packet area. If the pixel located in the target video packet is the reference pixel, the pixel value is stored in the storage unit. Pixel value
An image decoding apparatus, comprising: a video packet extra pixel value generation unit that outputs to the decoder as the reference pixel. 48. The video decoding apparatus according to claim 47, wherein the pixel value outside the video packet generation unit is configured to generate, as the pseudo pixel value, a target video closest to a reference pixel located outside the target video packet area. An image decoding apparatus for outputting a pixel value of a pixel in a packet. 49. An image signal corresponding to a screen is divided so as to correspond to a video packet area serving as a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image-encoded signal in which pixel values are grouped so as to correspond to a block composed of a predetermined number of pixels, the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are output for each video packet area. An image decoding device that decodes an encoded block, wherein an encoded block subjected to encoding processing is used as a reference block, and an encoding mode value corresponding to each block is encoded with reference to the encoding mode. A storage unit for storing the decoded encoding mode value; and a block located outside the target video packet area to which the target block belongs. If the
The coding mode value of the reference block is replaced with a pseudo coding mode generated based on the coding mode value of the block located in the target video packet area, and the block located in the target video packet is referred to as the reference block. If not, the coding mode value stored in the storage means is set as the coding mode value of the reference block, and the video packet extra coding mode value generating means for outputting to the decoder is provided. Image decoding device. 50. The image decoding apparatus according to claim 49, wherein said video packet extra coding mode value generation means determines the pseudo coding mode value from a reference block located outside the target video packet area. An image decoding apparatus for outputting an encoding mode value of a block in a close video packet of a target video packet. 51. An image signal corresponding to a screen is divided so as to correspond to a video packet area constituting a predetermined signal processing unit constituting the screen, and a plurality of image signals forming an image signal corresponding to the video packet area are divided. An image-encoded signal in which pixel values are grouped so as to correspond to a block composed of a predetermined number of pixels, the grouped pixel values are sequentially encoded for each block, and the encoded pixel values are output for each video packet area. An image decoding apparatus for decoding a decoded block, wherein a decoded block subjected to decoding processing is used as a reference block, and a decoding mode value corresponding to each block is decoded with reference to the coding mode. And a storage means for storing the decoded coding mode value. When the decoding process for each of the blocks is performed in the error resilience mode, A reference encoding mode value is generated with reference to only the encoding mode of the block in the packet, and when the decoding process for each block is performed in the non-error-resistant mode, the code of the block in the target video packet is encoded. Decoding reference value generating means for generating and outputting a reference coding mode value with reference to the coding mode of the block in the decoded screen together with the coding mode . 52. A data storage medium storing an image processing program for performing image processing by software, wherein the image processing program is an image encoding method according to any one of claims 32, 34, and 36. A data storage medium, which is an encoding processing program for causing a computer to perform an encoding process on an image signal by the computer. 53. A data storage medium storing an image processing program for performing image processing by software, wherein the image processing program is an image decoding method according to any one of claims 37, 39, and 41. A data storage medium, which is a decoding processing program for causing a computer to perform decoding processing of an image coded signal according to (1).