JP3866628B2 - Moving picture coding method, moving picture decoding method, picture coding apparatus, picture decoding apparatus, moving picture coding program, moving picture decoding program, and recording medium for these programs - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a technique related to moving picture coding using an inter-frame predictive coding scheme, and in particular, does not give each frame time information for outputting it, but present decoded frame when outputting a decoded picture. Video coding that makes it easy to edit when replacing frames and to simplify the device configuration of the image output part of the image decoding device by providing an output timing number indicating the timing based on The present invention relates to a method, a moving image decoding method, an image encoding device, an image decoding device, a moving image encoding program, a moving image decoding program, and a recording medium for those programs.
[0002]
[Prior art]
MPEG-1, MPEG-2 and H.264. 261, H.M. In international standard video encoding such as H.263, the output time of each frame is encoded. Such time information is called TR (Temporal Reference), and is fixed-length encoded for each frame. A reference time interval is set in advance in the system, and the time from the beginning of the sequence is indicated by the product of the time interval and TR. The image encoding device (encoder) encodes each frame by setting time information of the input image to TR, and the image decoding device (decoder) outputs the decoded image of each frame at the time specified by TR.
[0003]
On the other hand, in general, moving picture coding uses inter-frame predictive coding in order to achieve high coding efficiency using temporal correlation. The frame encoding mode can be predicted from an I frame that is encoded without using correlation between frames, a P frame that is predicted from one previously encoded frame, and two previously encoded frames. There are B frames. In particular, the video encoding method H.264. In 263, decoded images for a plurality of frames can be stored in the reference image memory, and the reference image can be selected and predicted from the memory.
[0004]
In the B frame, a method of predicting from a past frame is referred to as forward interframe prediction, and a method of predicting from a future frame is referred to as backward interframe prediction. The display time of the reference frame in the backward inter-frame prediction may be in the future than the current frame. In this case, after displaying the current frame, a reference frame for backward interframe prediction is output.
[0005]
When prediction is performed from two frames in the B frame (in the case of bi-directional inter-frame prediction), image information from two frames is interpolated to generate image information for one frame to generate a predicted image.
[0006]
FIG. 19A1 shows an example of the prediction relationship of moving images when the reference frame display time in the backward inter-frame prediction is in the future. When the encoding modes from the first frame F1 to the seventh frame F7 are encoded in the order of IBBPBBP, since there is a prediction relationship shown in FIG. 19A1, when encoding is actually performed, FIG. As shown in (A2), frames are encoded in the order of F1, F4, F2, F3, F7, F5, and F6. In this case, the order of TR to be encoded is a value corresponding to F1->F4->F2->F3->F7->F5-> F6, similar to the encoded frame.
[0007]
FIG. 19B1 shows an example of the prediction relationship of moving images when the reference frame display time in the backward inter-frame prediction is in the past. Unlike the case of FIG. 19A1, even when the encoding modes from the first frame F1 to the seventh frame F7 are encoded in the order of IBBPBBP, there is a prediction relationship shown in FIG. 19B1. As shown in FIG. 19B2, the frames are encoded in the order of F1, F4, F2, F3, F5, F6, and F7.
[0008]
As a method for indicating the output time of each frame, in addition to a method of encoding time information from the beginning of a sequence (hereinafter referred to as method a), as in MPEG-1 and 2 TR, for example, A method is conceivable.
(Method b) The difference time information from the frame encoded immediately before is encoded.
(Method c) A reference frame is set, time information from the sequence head position is encoded in the reference frame, and time information from the reference frame is encoded in each frame.
(Method d) A reference frame is set, time information from the sequence start position is encoded in the reference frame, and difference time information from the frame encoded immediately before is encoded in each frame.
[0009]
Among these methods, in the method b and the method d, when the display time of the reference frame in the backward inter-frame prediction is the future in the B frame, the difference time information of the past frame with respect to the frame encoded immediately before In this case, for example, a negative value is used as the difference time information. For example, in the encoded data in which the encoding mode from the first frame F1 to the seventh frame F7 is IBBIBBI, encoding is performed in the order of F1, F4, F2, F3, F7, F5, and F6. The time information is, for example, 0, 3, -2, 1, 4, -2, 1 in the order of encoded data.
[0010]
[Problems to be solved by the invention]
However, the method for indicating the output time of each frame has the following problems when the encoded data is replaced in units of a plurality of frames.
(1) In the above method a, it is necessary to change the time information of all the frames to be processed, and the work becomes complicated.
(2) In the above method b, for example, in the encoded data encoded in the order of IBBIBBI, the time information is given as 0, 3, -2, 1, 4, -2, 1 in the encoded data order In the case of the same I frame, the time information is 0, 3 or 4 depending on the position in the sequence. Therefore, as in the case of method a, it is necessary to change the time information of several frames to be processed, and the work becomes complicated.
(3) In method c or method d, it is necessary to change the time information of the reference frame, and the work becomes complicated.
[0011]
As described above, in any of the methods, it is necessary to change time information when replacing encoded data in units of a plurality of frames.
[0012]
SUMMARY OF THE INVENTION An object of the present invention is to solve the above problems and to provide a new moving picture encoding / decoding system that eliminates the need to change time information when replacing encoded data in units of a plurality of frames.
[0013]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the present invention is characterized in that each frame has information (this is referred to as an output timing number) indicating timing based on the current decoded frame when outputting the decoded image.
[0014]
That is, the present invention relates to a moving image coding method for coding image information using an inter-frame predictive coding method, in which image information to be coded is input and coded in units of frames, and the input frame is coded. An output timing number indicating how many frames later the current decoded frame is output on the decoding side is encoded on the decoding side. Data obtained by encoding the output timing number and data obtained by encoding image information of the input frame are output as encoded data.
[0015]
As a method of indicating whether or not to immediately output the current decoded frame on the decoding side, a method of encoding a decoded image output flag for distinguishing it and adding it to the encoded data, or a specific value in which the value of the output timing number is determined in advance A method of encoding as a value (for example, 0) can be used.
[0016]
Also, in the image encoding device, when the encoded data is decoded and output by the image decoding device, from the start of input of the encoded data to be decoded until the output of the decoded image obtained by decoding the encoded data is started The information indicating the number of frames in which the output of the decoded image is delayed in all the frames in the sequence (this is referred to as the number of output delay frames) is encoded and added before the series of encoded data for output. .
[0017]
The image decoding apparatus decodes the encoded data of the number of output delay frames, and controls the output of the decoded image according to the number of output delay frames and the output timing number for each frame.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
First, an outline of the present invention will be described according to a specific example. 1 and 2 are diagrams for explaining the operation of the output timing number according to the present invention.
[0019]
In the prior art, as a method of indicating the output time of each frame, a method of giving each frame time information from the beginning of the sequence, a method of giving differential time information from the previous frame, and setting a reference frame, Set the frame to have time information from the start position of the sequence, and set each frame to have time information from the reference frame, or set the reference frame and set the reference frame to the time information from the start position of the sequence. And each frame has a time difference information from the previous frame. Therefore, in these methods, there is a problem that when the encoded data is replaced in units of a plurality of frames, the time information needs to be changed and the work is complicated.
[0020]
In the present invention, each frame has an output timing number (this value is hereinafter referred to as OutputTimNum) indicating timing based on the current decoded frame when outputting a decoded image, instead of time information as in the prior art. Make it. Also, the number of output delay frames indicating the number of frames for delaying the output of the decoded image as a whole sequence (hereinafter, this value is expressed as DelayNum) is encoded. According to this method, it is not necessary to change the output timing number and the number of output delay frames in the encoded data when the encoded data is replaced in units of a plurality of frames.
[0021]
For example, assume that the encoded data of the sequence is (I3) (P4) (B1) (B2) (I6) (B5) as shown in FIG. However, I, P, and B indicate encoding modes, respectively, and the numbers after the encoding modes indicate the output order. (B1) and (B2) refer to (I3) and (P4), and (B5) refers to (I6).
[0022]
In the example shown in FIG. 1, it is assumed that the number of output delay frames is two. This means that there is a delay of 2 frames from the input of the first decoding target image (I3) to the output of the first decoded image (B1).
[0023]
The image decoding apparatus outputs one frame every time one frame is decoded. A memory for a plurality of frames is provided as the output image memory, and the storage position of the decoded image is determined by the output timing number. Here, to make the explanation easier to understand, when one frame of an image is output, the data in the memory is shifted to the next adjacent memory (in fact, the data is not shifted in the memory, It looks like the data has shifted by updating the index). When the value of the output timing number is 0, it is output immediately after decoding.
[0024]
(I3) Since the output timing number of the frame is 4, the decoded image is stored in the memory whose index value is 4 in the output image memory. The index value is decremented by −1 in units of processing time of each frame, and the (I3) frame is output after being delayed by a time corresponding to 4 frames from the input. Since the (P4) frame output timing number is also 4, the (P4) frame is output after the elapse of 4 frames from the input of the frame. The (B1) frame is output immediately because the output timing number is 0, and the (B2) frame is also output immediately. After the output of (B2) frame, the decoded image of (I4) frame is output, and subsequently, the decoded image of (P4) frame is output. After the (P4) frame is output, the (B5) frame and (I6) frame are output in this order.
[0025]
The order of encoding the image information in which the order of the frames to be output is (B1) (B2) (I3) (P4) (B5) (I6) is (I3) (P4) (B1) (B2) (I6) (B5) will be described in the case where editing is performed so as to output in the order of (B5) (I6) (B1) (B2) (I3) (P4) by replacing this in units of a plurality of frames. .
[0026]
In this case, the order of frames to be encoded is (I6) (B5) (I3) (P4) (B1) (B2). At this time, the output timing number added to each frame is 3, 1, 4, 4, 0, 0, and it is not necessary to change the output timing number even if the output order is changed in units of a plurality of frames. FIG. 1B shows an example of the decoding order, the storage position of the output image memory, and the output image order at this time.
[0027]
As is clear from the example shown in FIG. 1B, the decoded images are output in a desired order without changing the output timing number. The replacement of the units of a plurality of frames may not be at any position, but the process of changing the output timing number can be omitted by limiting the frame positions that can be replaced as necessary.
[0028]
Similarly, the example shown in FIG. 2 will be described. For example, assume that the encoded data of the sequence is (I1) (P2) (I4) (B3) as shown in FIG. However, (B3) refers to (I4). Also assume that the number of output delay frames is one.
[0029]
The frames (I1), (P2), (I4), and (B3) have output timing numbers 1, 1, 2, and 0, respectively. Is output, and the decoded image is output in the order of (I1) (P2) (B3) (I4).
[0030]
It is assumed that editing is performed so that these are output in the order of (B3), (I4), (I1), and (P2) by replacing them in units of multiple frames. As shown in FIG. 2B, the encoding frame order is (I4), (B3), (I1), and (P2). In this case as well, the decoded images are in the desired order according to the respective output timing numbers. Will be output.
[0031]
As described above, in this method, the frame is always buffered by the maximum number of output delay frames in the output image memory at the place where the data is replaced, so that the decoded image is not overwritten.
[0032]
Bit streams with the same number of output delay frames can be combined. Also, when bit streams having different numbers of output delay frames are combined, as will be described later, they can be combined by adjusting the output timing number for each sequence according to the difference in the number of output delay frames.
[0033]
The relationship between the decoded image, the contents of the output image memory, and the output image will be described according to still another specific example. 3 and 4 are diagrams for explaining an example of use of the output image memory in the image decoding apparatus.
[0034]
The image decoding apparatus (decoder) includes an output image memory managed by an index, and the index indicates the number of frames from the current frame until the image is output from the memory in the output image memory. When the output image memory is composed of a plurality of memories, the index is also information for distinguishing each memory, and is expressed by a different number for each memory in the output image memory.
[0035]
The image decoding apparatus stores the decoded image at the position of the output image memory indicated by the index corresponding to the output timing number, and updates the index each time the encoded data for one frame is decoded. One frame of the stored decoded image or the decoded image of the current frame is output.
[0036]
For example, an operation example when the encoded data is (I1) (B2) (B3) (I4) (B5) (B6) (I7) is shown. The number after the picture type indicates the output order. The display time of the reference frame in the backward inter-frame prediction of the B frame is assumed to be in the future, and in the encoded data, the order is (I1) (I4) (B2) (B3) (I7) (B5) (B6). Are lined up. However, (B5) and (B6) refer to only (I7).
[0037]
In this case, the relationship between the decoded image and the output timing number, the contents of the output image memory, and the output image is as shown in FIG. In this figure, when the output timing number is 0, the decoded image of the current frame is output immediately. When the output timing number is other than 0, the image decoding apparatus outputs the image stored in the memory having the index value of 1 from the output image memory, and then corresponds the decoded image to the output timing number in the output image memory. Accumulate at the position specified by the index. Regardless of the value of the output timing number, the image decoding apparatus updates the index value of the output image memory when the image is output even if the value is 0. In updating the index value, if the original index value is other than 1, the value is subtracted by 1, and if it is 1, the maximum value is set.
[0038]
Here, in FIG. 3A, a memory for three frames is prepared as an output image memory, and a positive integer index starting from 1 is sequentially assigned to each memory. Such a configuration is also possible, but in this case, the output image memory needs to include a memory having the number of consecutive B frames and a capacity of one frame, which increases the necessary memory capacity. .
[0039]
Therefore, as shown in FIG. 3B, the output image memory is provided with memories for the number of output delay frames, which is the number of frames in which the output of the decoded image is delayed in all frames in the sequence, and each memory has an individual index. Is allocated. However, in each memory, when the decoded image is not stored in the memory, the index is set to 0, and when the index is 0, the index value is not updated. If the newly decoded image has an output timing number other than 0, it is stored in the memory location where the index is 0.
[0040]
Here, the number of output delay frames is the number of frames of the B frame in which the display time of the reference frame in the backward inter-frame prediction is in the future, and is the number of frames that can be designated from the outside during image coding.
[0041]
In this way, output image memories need only be prepared for the number of output delay frames, and the memory capacity can be reduced as compared with the memory configuration as shown in FIG. Here, the number of output delay frames is set to the same value in the sequence.
[0042]
As apparent from the example shown in FIG. 3A or 3B, according to this method, the image decoding apparatus can output one frame image each time one frame is decoded. Further, according to this method, when the encoded data is replaced in units of a plurality of frames, it is not necessary to change the output timing number in the encoded data, and therefore, it is not necessary to change the encoded data.
[0043]
For example, the output order of the encoded data (I1) (B2) (B3) (I4) (B5) (B6) (I7) is changed to (B5) (B6) (I7) (I1) (B2) (B3). When switching to (I4), it is as follows.
[0044]
In the encoded data, the data arranged in the order of (I1) (I4) (B2) (B3) (I7) (B5) (B6) are (I7) (B5) (B6) (I1) (I4) ( B2) The order is (B3). In this case, the relationship between the decoded image and the output timing number, the contents of the output image memory and the output image in each frame is as shown in FIG. 4 (A) or (B), and the output timing number need not be changed. Even if the frames are exchanged in this way, the image decoding apparatus can output one frame image each time one frame is decoded without changing the output timing number. Further, since the output image memory always stores the maximum number of output delay frames at the place of replacement, the decoded image is not overwritten in the output image memory.
[0045]
As described above, according to the present invention, even if the frames in the encoded data are replaced, it is not necessary to change the encoded data.
[0046]
The image decoding apparatus can output one frame image each time one frame is decoded. That is, the image decoding apparatus can execute decoding and output of one frame at the same frequency. In the conventional method of specifying the output time using TR, if there is a B frame in the encoded data, the image decoding apparatus does not output a frame for decoding one frame, or collects a plurality of frames. There is a problem that the configuration of the image output portion of the image decoding apparatus becomes complicated. However, in the present invention, it is sufficient for the image decoding apparatus to output one frame at the same frequency as the decoding of one frame, and the apparatus configuration of the output part can be realized easily.
[0047]
In the present invention, if the number of output delay frames of the encoded data is the same, the maximum value of the index of the decoded image in the output image memory becomes the same, and the encoded data can be combined. Therefore, in order to determine whether or not the encoded data can be combined, it is preferable to include the number of output delay frames in the encoded data. For example, it is preferable to include it in the sequence header.
[0048]
There are the following methods for combining encoded data having different numbers of output delay frames. For this purpose, the number of output delay frames of the encoded data to be combined should be the same. Therefore, the maximum number (MaxDelayNum) of the plurality of output delay frames is obtained, and the difference output delay frame number (DeltaDelayNum) is obtained from the output delay frame number (DelayNum) in each encoded data according to the following equation.
[0049]
DeltaDelayNum = MaxDelayNum -DelayNum
A value obtained by adding the number of differential output delay frames (DeltaDelayNum) to the output timing number (OutputTimNum) of each frame in the encoded data is again set as an output timing number. As described above, all the encoded data to be combined becomes encoded data having MaxDelayNum as the number of output delay frames, and can be combined. In this case, it is necessary to include the number of differential output delay frames (DeltaDelayNum) in the encoded data. For example, when combining in units of MPEG-2 GOP, it is preferable to include the number of differential output delay frames in the GOP header.
[0050]
Next, examples of the image encoding device and the image decoding device according to the embodiment of the present invention will be described.
[0051]
[Configuration Example 1 of Image Encoding Device]
FIG. 5 shows an apparatus outline of a first configuration example of the image encoding apparatus. The image coding apparatus 10 includes an image input unit 101 that captures image information in units of one frame, an input frame number counting unit 102 that increments a counter of the number of frames of the captured image, and I, P, and B frames of the captured image. The encoding mode designating unit 103 that designates an encoding mode indicating from which to encode from the outside, and the captured frame is immediately determined according to whether the encoding mode designated by the encoding mode designating unit 103 is a B frame or not. An encoding determination unit 104 that determines whether or not to encode, an encoded frame number counting unit 105 that increments a counter of the number of frames when the captured frame is encoded immediately, and a sequence on the decoding side A delay indicator that designates the number of output delay frames indicating the number of frames for which the output of the decoded image is delayed in all frames Unit 106, the number of frames counted by input frame number counting unit 102, the number of frames counted by encoded frame number counting unit 105, and the number of output delay frames designated by delay designating unit 106, An output timing number calculation unit 107 that calculates an output timing number indicating at which timing the decoded image stored in the output image memory on the decoding side is output, and an encoding determination unit 104 immediately encodes the captured frame. A decoded image output determining unit 108 that determines whether or not to output a decoded image immediately on the decoding side, and an output timing number encoding unit that encodes the output timing number in a variable length or fixed length 109 and a decoded image output flag for designating whether or not the decoded image is to be output immediately on the decoding side. A decoded image output flag encoding unit 110 that performs fixed-length encoding, an inter-frame prediction encoding unit 111 that encodes a captured frame using inter-frame prediction encoding, and a code obtained from the inter-frame prediction encoding unit 111 A decoding unit 112 for decoding the encoded data, a reference image memory 113 for storing the decoded image, an input image delay memory 114 for storing the captured frame when the captured frame is not immediately encoded, and an input image delay memory When there is a frame accumulated in 114, a delayed image coding determination unit 115 that determines whether or not the frame is encoded by the inter-frame prediction encoding unit 111 is provided.
[0052]
SW1 to SW3 in the figure are switch units for switching input or output to each unit. When the switch unit SW1 determines that the frame determined by the image input unit 101 is to be encoded immediately by the encoding determination unit 104, the switch unit SW1 guides the input frame to the switch unit SW2 and determines that the frame is not encoded immediately The input frame is guided to the input image delay memory 114. The switch unit SW2 performs inter-frame prediction on the frame stored in the input image delay memory 114 according to the determination result of whether or not the delay image encoding determination unit 115 encodes the frame stored in the input image delay memory 114. Switching between guiding to the encoding unit 111 or guiding the input frame from the switch unit SW1 to the inter-frame prediction encoding unit 111 is performed.
[0053]
Further, the switch unit SW3 performs encoding by the output timing number encoding unit 109 or a decoded image output flag encoding unit according to the result of determining whether or not the decoded image output determination unit 108 outputs the decoded image immediately. The encoding by 110 is controlled.
[0054]
FIG. 6 shows an operation flow of the image encoding device 10. First, in step S100, the number of output delay frames (DelayNum) is designated from the outside. In step S101, it is checked whether or not there is an image to be encoded by the image encoding device 10, and if it exists, the process proceeds to step S102, and if not, the processing of the image encoding device 10 itself ends.
[0055]
In step S102, the image input unit 101 captures one frame of the input image. In step S103, the frame number counter (hereinafter, this value is indicated by InputFrameNum) of the frame taken in by the input frame number counting unit 102 is incremented by one. In step S104, the encoding mode designating unit 103 designates the encoding mode of the frame captured by the image input unit 101 from the outside. In step S105, when the frame encoding mode is B frame, the encoding determination unit 104 determines to delay the encoding of the captured frame, and immediately encodes the captured frame for other frames. Then decide. If it is determined to encode with a delay, the process proceeds to step S106. If it is determined to encode immediately, the process proceeds to step S107.
[0056]
In step S106, the image information of the frame determined to delay the encoding is stored in the input image delay memory 114. Thereafter, the process returns to step S102, and the next frame is similarly processed.
[0057]
In step S107, the encoded frame number counting unit 105 increments the frame number counter (hereinafter, this value is indicated by EncodeFrameNum) of the frame determined to be encoded immediately. In step S109, the decoded image output determining unit 108 determines whether to output the decoded image immediately after decoding on the decoding side. Here, in step S105, when the encoding determination unit 104 determines not to immediately encode the captured frame, it is determined to output the decoded image immediately after decoding, and it is determined to immediately encode the captured frame. In such a case, it is determined that the decoded image is not output immediately after decoding. If it is determined to output the decoded image immediately after decoding, the process proceeds to step S110. If it is determined to output the decoded image immediately after decoding, the process proceeds to step S111.
[0058]
In step S110, when the decoding side determines to output the decoded image immediately after decoding, the decoded image output flag encoding unit 110 sets the decoded image output flag to the value “1” and encodes it. Thereafter, the process proceeds to step S114.
[0059]
In step S111, when the decoding side determines not to output the decoded image immediately after decoding, the decoded image output flag encoding unit 110 sets the decoded image output flag to the value “0” and encodes it. In step S112, the output timing number calculation unit 107 calculates the output timing number (OutputTimNum) from the output delay frame number (DelayNum), the input frame number counter value (InputFrameNum), and the encoded frame number counter value (EncodeFrameNum) according to the following equation. Calculate
[0060]
OutputTimNum = DelayNum + InputFrameNum-EncodeFrameNum
In step S113, when the decoding side determines not to output the decoded image immediately after decoding, the output timing number encoding unit 109 encodes the output timing number.
[0061]
In step S114, the frame to be encoded is divided into blocks, and it is determined whether all the blocks have been encoded. If there is a block that has not been encoded yet, the process proceeds to step S115, where the inter-frame predictive encoding unit 111 encodes the block and outputs encoded data of the encoding result. In step S116, the decoding unit 112 decodes the encoded data obtained by the inter-frame prediction encoding unit 111. In step S117, the decoded image is stored in the reference image memory 113.
[0062]
If it is determined in step S114 that all have been encoded, the process proceeds to step S118. In step S118, the delayed image encoding determination unit 115 checks whether the input image is stored in the input image delay memory 114, and If accumulated, the process returns to step S107 with the input image of that frame as an encoding target. If no input image is accumulated, the process returns to step S101.
[0063]
As a method for determining whether or not all blocks have been encoded in step S114, for example, the following method can be used.
(1) The total number of blocks in a frame is measured in advance, and when the number of encoded blocks matches the total number of blocks, it is determined that all blocks have been encoded.
(2) An EOB image having a unique bit pattern is placed in advance at the end of the image data captured by the image input unit 101, and when an EOB image is detected, it is determined that all blocks have been encoded.
[0064]
In the above example, the output timing number calculation unit 107 calculates the output timing number in step S112. However, this step may be executed immediately before step S109 or immediately before step S111.
[0065]
[Configuration Example 2 of Image Encoding Device]
FIG. 7 shows a device outline of a second configuration example of the image encoding device. In the first configuration example described above, a decoded image output flag is encoded by the decoded image output flag encoding unit 110 in addition to the output timing number, but a decoded image is output using a specific value of the output timing number. It is also possible to specify whether or not to do so. For example, if the value of the output timing number is 0, the decoded image is output. If the value is other than that, the decoded image is not output, and the decoded image is designated by the output timing number in the output image memory. Specifies accumulation at the index position.
[0066]
The configuration of the image encoding device 11 in this case is as shown in FIG. The operation flow is as shown in FIG. In the image encoding device 11 of the second configuration example, elements indicated by the same reference numerals as those of the image encoding device 10 of the first configuration example have the same functions, and thus detailed descriptions of the individual elements are omitted.
[0067]
The operation flow shown in FIG. 8 is different from the operation flow described in FIG. 6 in that steps S109 to S113 shown in FIG. 6 are steps S208 to S213 in FIG. Only the parts different from the above example will be described below.
[0068]
In step S208 of FIG. 8, the output timing number calculation unit 107 first outputs an output delay frame number (DelayNum), an input frame number counter value (InputFrameNum), and an encoded frame number counter value (EncodeFrameNum) according to the following equation. Calculate the timing number (OutputTimNum).
[0069]
OutputTimNum = DelayNum + InputFrameNum-EncodeFrameNum
At this time, if the encoding determination unit 104 determines not to immediately encode the captured frame, the output timing number (OutputTimNum) value is determined instead of calculating and determining the output timing number according to the previous equation. Set to “0”.
[0070]
In step S213, the output timing number determined in step S208 is encoded, and the encoding result is output.
[0071]
[Configuration Example 3 of Image Encoding Device]
FIG. 9 shows a device outline of a third configuration example of the image encoding device. The image encoding device 12 shown in FIG. 9 has a configuration in which a delay encoding unit 116 is further added to the image encoding device 10 of the first configuration example described above.
[0072]
The delay encoding unit 116 performs variable length or fixed length encoding on the number of output delay frames specified by the delay specifying unit 106, and includes the encoded result of the number of output delay frames in the encoded data. The operation flow of the image encoding device 12 is the same as the operation flow of the image encoding device 10 described in FIG. Also, when the number of differential output delay frames is included in the encoded data, the image encoding device 12 is configured and the operation flow is the same.
[0073]
[Configuration Example 4 of Image Encoding Device]
FIG. 10 shows an apparatus outline of a fourth configuration example of the image encoding apparatus. The image encoding device 13 shown in FIG. 10 has a configuration in which a delay encoding unit 116 is further added to the image encoding device 11 of the second configuration example described above.
[0074]
The delay encoding unit 116 performs variable length or fixed length encoding on the number of output delay frames specified by the delay specifying unit 106, and includes the encoded result of the number of output delay frames in the encoded data. The operation flow of the image encoding device 13 is the same as the operation flow of the image encoding device 11 described in FIG. Also, when the number of differential output delay frames is included in the encoded data, the image encoding device 13 is configured and the operation flow is the same.
[0075]
Next, an image decoding apparatus that decodes encoded data encoded with the configuration described above will be described.
[0076]
[Configuration Example 1 of Image Decoding Device]
First, an image decoding apparatus that decodes encoded data output from the image encoding apparatus 10 of the first configuration example shown in FIG. 5 will be described. FIG. 11 shows a device outline of a first configuration example of the image decoding device.
[0077]
The image decoding apparatus 20 includes a decoding unit 201 that decodes encoded data, a reference image memory 202 that accumulates decoded images, and a decoded image output that decodes a decoded image output flag that indicates whether or not to output the decoded image immediately after decoding. When the flag decoding unit 203 and the decoded image output flag indicate that the decoded image is not output immediately after decoding, the output timing number decoding unit 204 that decodes the output timing number and the index position indicated by the output timing number are decoded. An output image memory 205 that stores images and an output image memory index update unit 206 that updates the index of the output image memory 205 every time one frame is decoded are provided.
[0078]
Depending on the decoded image output flag decoded by the decoded image output flag decoding unit 203, the image information decoded by the decoding unit 201 is switched immediately or the image information decoded by the decoding unit 201 is stored in the output image memory 205. A switch unit SW4 is provided.
[0079]
In the index update in the output image memory index update unit 206, when the index value is other than “0”, the value is decreased by 1, and when the index value is “0”, the value is set to the maximum value. I do.
[0080]
FIG. 12 shows an operation flow of the image decoding apparatus 20. In step S301, it is checked whether or not there is encoded data to be decoded by the image decoding apparatus 20. If it exists, the process proceeds to step S302, and if not, the process proceeds to step S314.
[0081]
In step S302, it is determined whether all the blocks in the frame have been decoded. If there is a block that has not been decoded, the process proceeds to step S303, and the decoding unit 210 decodes the encoded data. Subsequently, in step S304, the decoded image is stored in the reference image memory 202, and then the process returns to step S302.
[0082]
If it is determined in step S302 that all blocks in the frame have been decoded, the process proceeds to step S305, and the decoded image output flag decoding unit 203 decodes the decoded image output flag. In step S307, it is determined whether or not the decoded image output flag is “0”. If the decoded image output flag is “0”, it is determined that the decoded image is not output, and if “1”, the decoded image is output.
[0083]
When the decoded image output flag is “0”, the process proceeds to step S308. In step S308, the output timing number decoding unit 204 decodes the output timing number. In step S309, the output image memory 205 outputs a decoded image in the memory whose index value is 1. In step S310, the output image memory index update unit 206 updates the index of the output image memory 205. In step S311, the decoded image is stored at the index position designated by the output timing number in the output image memory 205. Thereafter, the process returns to step S301.
[0084]
If it is determined in step S307 that the decoded image output flag is “1”, the process proceeds to step S312, and in step S312, the decoding unit 201 outputs the decoded image. In step S313, the output image memory index update unit 206 updates the index of the output image memory 205. Thereafter, the process returns to step S301. If it is determined in step S301 that there is no encoded data to be decoded, all the images in the output image memory 205 are output in step S314.
[0085]
[Configuration Example 2 of Image Decoding Device]
FIG. 13 shows an outline of a second configuration example of the image decoding apparatus. The image decoding device 21 decodes the encoded data encoded by the image encoding device 11 shown in FIG.
[0086]
In the image decoding device 20 of the first configuration example described above, the decoded image output flag is decoded in addition to the output timing number, but whether or not to output the decoded image using a specific value of the output timing number is designated. It is also possible. For example, if the value of the output timing number is “0”, the decoded image is output. Otherwise, the decoded image is not output, and the decoded image is specified by the output timing number in the output image memory. Specifies to accumulate at the specified index position. The configuration of the image decoding apparatus in this case is as shown in FIG. The operation flow is as shown in FIG.
[0087]
In the image decoding device 21 of the second configuration example, the difference from the image decoding device 20 of the first configuration example is that the decoded image output determination unit 209 is used instead of the decoded image output flag decoding unit 203 in the first configuration example. Is that there is. The decoded image output determination unit 209 determines whether or not to immediately output the decoded image decoded by the decoding unit 201, based on the value of the output timing number decoded by the output timing number decoding unit 208. When the value of the output timing number is “0”, it is determined that the decoded image is output immediately. When the value is other than “0”, the decoded image is not output immediately, and the value of the output timing number is determined. The decoded image is stored at the index position of the output image memory 205 indicated by. Other parts of the image decoding device 21 are the same as those in the first configuration example described above.
[0088]
The operation flow shown in FIG. 14 is different from the operation flow described in FIG. 12 in that the output timing number is decoded in step S406 instead of decoding the decoded image output flag in step S305 in FIG. In step S407, it is determined whether to output a decoded image.
[0089]
[Configuration Example 3 of Image Decoding Device]
FIG. 15 shows an outline of a third configuration example of the image decoding apparatus. The image decoding device 22 shown in FIG. 15 has a configuration in which a delay decoding unit 207 is further added to the image decoding device 20 of the first configuration example described above. The image decoding device 22 decodes the encoded data encoded by the image encoding device 12 shown in FIG.
[0090]
The encoded data input by the image decoding device 22 includes information on the number of encoded output delay frames, and the delay decoding unit 207 sets the number of encoded output delay frames to a variable length or a fixed value. Decode long.
[0091]
The operation flow of the image decoding device 22 is shown in FIG. Basically, the operation flow is the same as the operation flow of the image decoding apparatus 20 of the first configuration example shown in FIG. 12, but at the start of decoding of the encoded data of the sequence, in step S500, the delay decoding unit 207 outputs the output delay. A process for decoding the number of frames has been added.
[0092]
Also, when the differential output delay frame number (DeltaDelayNum) is included in the encoded data, the configuration of the image decoding apparatus is as shown in FIG. 15, and the delay decoding unit 207 performs decoding of the output delay frame number. Similarly, variable length or fixed length decoding is performed on the number of differential output delay frames.
[0093]
If the number of output delay frames is included in the encoded data, the output delay frame number and the differential output delay frame number are decoded in step S500 of FIG. 16, and in step S508, the output timing number decoding unit After 204 decodes the output timing number, a value obtained by adding the number of differential output delay frames (DeltaDelayNum) to the decoded output timing number is set as an actually used output timing number (DelayNum).
[0094]
[Configuration Example 4 of Image Decoding Device]
FIG. 17 shows a device outline of a fourth configuration example of the image decoding device. The image decoding device 23 shown in FIG. 17 has a configuration in which a delay decoding unit 207 is further added to the image decoding device 21 of the second configuration example described above. The image decoding device 23 decodes the encoded data encoded by the image encoding device 13 shown in FIG.
[0095]
The encoded data input by the image decoding device 23 includes information on the number of encoded output delay frames, and the delay decoding unit 207 sets the number of encoded output delay frames to a variable length or a fixed value. Decode long.
[0096]
The operation flow of this image decoding device 23 is shown in FIG. Basically, it is the same as the operation flow of the image decoding device 21 of the second configuration example shown in FIG. 14, but at the start of decoding of the encoded data of the sequence, the delay decoding unit 207 outputs the output delay in step S600. A process for decoding the number of frames has been added.
[0097]
Also, when the differential output delay frame number (DeltaDelayNum) is included in the encoded data, the configuration of the image decoding apparatus is as shown in FIG. 17, and the delay decoding unit 207 performs decoding of the output delay frame number. Similarly, variable length or fixed length decoding is performed on the number of differential output delay frames.
[0098]
If the number of output delay frames is included in the encoded data, decoding of the number of output delay frames and decoding of the number of differential output delay frames are performed in step S600 of FIG. 18, and an output timing number decoding unit in step S606. After 204 decodes the output timing number, a value obtained by adding the number of differential output delay frames (DeltaDelayNum) to the decoded output timing number is set as an actually used output timing number (DelayNum).
[0099]
The processing performed by the image encoding device and the image decoding device described above can be realized not only by a hardware circuit but also by a computer and a software program, and the program is stored in a portable medium memory that can be read by a computer. The data can be stored in a suitable recording medium such as a semiconductor memory or a hard disk and read out from the recording medium to be executed by a computer.
[0100]
【The invention's effect】
According to the present invention, when the frames are exchanged in units of a plurality of frames in the encoded data, the trouble of changing the time information can be saved.
[0101]
The image decoding apparatus can output one frame image each time one frame is decoded. That is, the device configuration of the image output portion of the image decoding device can be simplified.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining the operation of an output timing number according to the present invention.
FIG. 2 is a diagram for explaining the operation of an output timing number according to the present invention.
FIG. 3 is a diagram for describing an example of use of an output image memory in an image decoding device.
FIG. 4 is a diagram illustrating an example of using an output image memory in an image decoding device.
FIG. 5 is a diagram illustrating an apparatus outline of a first configuration example of an image encoding apparatus.
FIG. 6 is a diagram illustrating an operation flow of the image coding apparatus according to the first configuration example.
FIG. 7 is a diagram illustrating an apparatus outline of a second configuration example of an image encoding apparatus.
FIG. 8 is a diagram illustrating an operation flow of the image coding apparatus according to the second configuration example.
FIG. 9 is a diagram illustrating an apparatus outline of a third configuration example of the image encoding apparatus.
FIG. 10 is a diagram illustrating an apparatus outline of a fourth configuration example of an image encoding apparatus.
FIG. 11 is a diagram illustrating an apparatus outline of a first configuration example of an image decoding apparatus.
FIG. 12 is a diagram illustrating an operation flow of the image decoding apparatus according to the first configuration example.
FIG. 13 is a diagram illustrating an apparatus outline of a second configuration example of an image decoding apparatus.
FIG. 14 is a diagram illustrating an operation flow of the image decoding apparatus according to the second configuration example.
FIG. 15 is a diagram illustrating an apparatus outline of a third configuration example of an image decoding apparatus.
FIG. 16 is a diagram illustrating an operation flow of the image decoding apparatus according to the third configuration example.
FIG. 17 is a diagram illustrating an apparatus outline of a fourth configuration example of an image decoding apparatus.
FIG. 18 is a diagram illustrating an operation flow of the image decoding device according to the fourth configuration example.
[Fig. 19] Fig. 19 is a diagram for describing an example of a prediction relationship of a general interframe predictive coding scheme.
[Explanation of symbols]
10 Image encoding device
101 Image input unit
102 Input frame count section
103 Coding mode designation part
104 Coding determination unit
105 Encoding frame count section
106 Delay specification part
107 Output timing number calculator
108 Decoded image output determination unit
109 Output timing number encoding unit
110 Decoded Image Output Flag Encoding Unit
111 Interframe prediction encoding unit
112 Decoding unit
113 Reference image memory
114 Input image delay memory
115 Delayed image coding determination unit
116 Delay encoding unit
20 Image decoding device
201 Decoding unit
202 Reference image memory
203 Decoded image output flag decoding unit
204 Output timing number decoding unit
205 Output image memory
206 Output image memory index update unit
207 Delay decoding unit
208 Output timing number decoding unit
209 Decoded image output determination unit
SW1 to SW4 switch

Claims (22)

In a moving image coding method for coding image information using an inter-frame predictive coding method,
A process of inputting image information to be encoded in units of frames;
A process of encoding an output timing number indicating the number of frames to be output from the time when a frame obtained by encoding the input frame is input on the decoding side;
A process of encoding image information of the input frame using an inter-frame predictive encoding method;
A moving picture coding method comprising: a step of outputting data obtained by coding the output timing number and data obtained by coding image information of the input frame as coded data. And a process of encoding a decoded image output flag indicating whether or not to immediately output the current decoded frame on the decoding side,
2. The moving picture coding method according to claim 1, wherein the moving picture coding method is output together with the coded data. 2. The process of encoding the output timing number, wherein the value of the output timing number is encoded as a predetermined specific value when the current decoded frame is to be output immediately on the decoding side. The moving image encoding method described. In a moving image coding method for coding image information using an inter-frame predictive coding method,
A process of inputting image information to be encoded in units of frames;
The process of counting the number of input frames,
Determining the picture coding mode; and
Determining whether to encode the input frame with a delay;
A process of storing the input frame in the input image delay memory when the input frame is delayed and encoded;
The process of counting the number of encoded frames;
A process of determining whether to output a decoded image immediately after decoding on the decoding side;
A process of encoding and outputting a decoded image output flag indicating whether or not to output a decoded image immediately after decoding on the decoding side;
When the decoding side decides not to output the decoded image immediately after decoding, the count value of the number of input frames is added to the number of output delay frames indicating the number of frames in which the output of the decoded image is delayed in all frames in the sequence. Further, a process of calculating a value obtained by subtracting the count value of the number of encoded frames as an output timing number;
Encoding and outputting the output timing number;
The process of encoding and outputting the input frame using inter-frame predictive encoding until all the intra-frame image information is encoded,
A process of decoding encoded data of an input frame and storing the decoded image in a reference image memory for reference by encoding by an inter-frame predictive encoding method;
A moving image coding method comprising: a step of repeating processing subsequent to a step of counting the number of encoded frames for image information stored in the input image storage memory. In a moving image coding method for coding image information using an inter-frame predictive coding method,
A process of inputting image information to be encoded in units of frames;
The process of counting the number of input frames,
Determining the picture coding mode; and
Determining whether to encode the input frame with a delay;
A process of storing the input frame in the input image delay memory when the input frame is delayed and encoded;
The process of counting the number of encoded frames;
A process of determining whether to output a decoded image immediately after decoding on the decoding side;
When the decoding side does not output the decoded image immediately after decoding, the count value of the number of input frames is added to the number of output delay frames indicating the number of frames in which the output of the decoded image is delayed in all frames in the sequence, and When the value obtained by subtracting the count value of the number of encoded frames is calculated as an output timing number and the decoded image is output immediately after decoding, the output timing number is not output immediately after decoding. The process of setting a specific value that can be distinguished from the output timing number of
Encoding and outputting the output timing number;
The process of encoding and outputting the input frame using inter-frame predictive encoding until all the intra-frame image information is encoded,
A process of decoding encoded data of an input frame and storing the decoded image in a reference image memory for reference by encoding by an inter-frame predictive encoding method;
A moving image coding method comprising: a step of repeating processing subsequent to a step of counting the number of encoded frames for image information stored in the input image storage memory. Encoding the number of output delay frames indicating the number of frames in which the output of the decoded image is delayed in all the frames in the sequence;
6. The moving picture coding method according to claim 1, wherein the moving picture coding method is added before the series of coded data and outputted. In a video decoding method for decoding image information encoded using an inter-frame predictive encoding method,
Encoded data with an output timing number indicating that the encoded image information to be decoded is input in units of frames and the number of frames after the input frame is input and the decoded image of the input frame is output The process of entering
Decoding the encoded image information of the input frame;
Decoding the encoded data of the output timing number;
And a step of determining a timing for outputting the decoded image information in accordance with the decoded output timing number and outputting the decoded image information. And a process of inputting encoded data of a decoded image output flag indicating whether or not to immediately output the current decoded frame;
A process of decoding the encoded data of the decoded image output flag,
8. The moving image according to claim 7, wherein in the process of outputting the decoded image information, the decoded frame is output immediately when the decoded image output flag indicates that the current decoded frame is output immediately. Image decoding method. 8. The moving picture decoding method according to claim 7, wherein in the process of outputting the decoded image information, the decoded frame is immediately output when the decoded output timing number is a predetermined specific value. . In a video decoding method for decoding image information encoded using an inter-frame predictive encoding method,
Encoded data with an output timing number indicating that the encoded image information to be decoded is input in units of frames and the number of frames after the input frame is input and the decoded image of the input frame is output A process of inputting encoded data of a decoded image output flag indicating whether or not to output the decoded image immediately after decoding;
Inter-frame predictive decoding of the encoded image information of the input frame;
Storing the decoded image in a reference image memory for reference in inter-frame prediction decoding;
Decoding the encoded data of the decoded image output flag;
Decoding the encoded data of the output timing number;
When the decoded image output flag indicates that the decoded image is not output immediately after decoding, the decoded image is output from the output image memory that stores the decoded image based on the output timing number in advance, and the output image memory Updating the index indicating the output order of the decoded images, and storing the decoded image of the current frame in the position of the output image memory indicated by the index corresponding to the output timing number;
A step of outputting a decoded image of the current frame and updating an index indicating an output order of the decoded image in the output image memory when the decoded image output flag indicates that the decoded image is output immediately after decoding. A video decoding method characterized by the above. In a video decoding method for decoding image information encoded using an inter-frame predictive encoding method,
Encoded data with an output timing number indicating that the encoded image information to be decoded is input in units of frames and the number of frames after the input frame is input and the decoded image of the input frame is output The process of entering
Inter-frame predictive decoding of the encoded image information of the input frame;
Storing the decoded image in a reference image memory for reference in inter-frame prediction decoding;
Decoding the encoded data of the output timing number;
Determining whether to output a decoded image immediately after decoding according to whether the decoded output timing number is a specific value;
When the decoded image is not output immediately after decoding, the decoded image is output from the output image memory that stores the decoded image in advance based on the output timing number, and an index indicating the output order of the decoded image in the output image memory is provided. Updating and storing the decoded image of the current frame in the position of the output image memory indicated by the index corresponding to the output timing number;
A method of decoding a moving image, comprising: outputting a decoded image of a current frame and updating an index indicating an output order of the decoded image in the output image memory when the decoded image is output immediately after decoding. Furthermore, a process of inputting encoded data having an output delay frame number indicating the number of frames in which the output of the decoded image is delayed in all frames in the sequence;
A process of decoding encoded data of the number of input output delay frames,
The moving picture decoding method according to any one of claims 7 to 11, wherein the output of the decoded picture is delayed for all the frames in the sequence in accordance with the number of decoded output delay frames. In an image encoding apparatus that encodes image information using an inter-frame predictive encoding method,
Means for inputting image information to be encoded in units of frames;
Means for counting the number of input frames;
Means for specifying a picture coding mode;
Means for determining whether to encode the input frame with a delay;
An input image delay memory for storing image information to be encoded with delay;
Means for storing the input frame in the input image delay memory when encoding the input frame with a delay;
Means for counting the number of encoded frames;
Means for determining whether or not to output the decoded image immediately after decoding on the decoding side;
Means for encoding and outputting a decoded image output flag indicating whether or not to output the decoded image immediately after decoding on the decoding side;
When the decoding side decides not to output the decoded image immediately after decoding, the count value of the number of input frames is added to the number of output delay frames indicating the number of frames in which the output of the decoded image is delayed in all frames in the sequence. And means for calculating a value obtained by subtracting the count value of the number of encoded frames as an output timing number;
Means for encoding and outputting the output timing number;
Means for encoding and outputting image information of an input frame or image information stored in the input image delay memory using an inter-frame predictive encoding method;
A reference image memory for storing a decoded image for reference in encoding by the inter-frame predictive encoding method;
Means for decoding the encoded data of the input frame;
An image encoding apparatus comprising: means for storing a decoded image in the reference image memory. In an image encoding apparatus that encodes image information using an inter-frame predictive encoding method,
Means for inputting image information to be encoded in units of frames;
Means for counting the number of input frames;
Means for determining a picture coding mode;
Means for determining whether to encode the input frame with a delay;
An input image delay memory for storing image information to be encoded with delay;
Means for storing the input frame in the input image delay memory when encoding the input frame with a delay;
Means for counting the number of encoded frames;
When the decoding side does not output the decoded image immediately after decoding, the count value of the number of input frames is added to the number of output delay frames indicating the number of frames in which the output of the decoded image is delayed in all frames in the sequence, and When the value obtained by subtracting the count value of the number of encoded frames is calculated as an output timing number and the decoded image is output immediately after decoding, the output timing number is not output immediately after decoding. Means to set a specific value that can be distinguished from the output timing number of
Means for encoding and outputting the output timing number;
Means for encoding and outputting image information of an input frame or image information stored in the input image delay memory using an inter-frame predictive encoding method;
A reference image memory for storing a decoded image for reference in encoding by the inter-frame predictive encoding method;
Means for decoding the encoded data of the input frame;
An image encoding apparatus comprising: means for storing a decoded image in the reference image memory. 14. A means for encoding an output delay frame number indicating the number of frames in which the output of a decoded image is delayed in all the frames in the sequence, and adding and outputting it before the series of encoded data. Or the image coding apparatus of Claim 14. In an image decoding apparatus for decoding image information encoded using an inter-frame predictive encoding method,
Means for inputting encoded image information to be decoded in units of frames and performing predictive decoding between frames;
A reference image memory for storing a decoded image for referring to the decoded image by inter-frame prediction decoding;
Decoding means for inputting and decoding encoded data of a decoded image output flag indicating whether or not to output a decoded image immediately after decoding;
Means for inputting and decoding encoded data of an output timing number indicating how many frames later from the time when the frame of the encoded image information is input, and outputting the decoded image of the frame;
An output image memory for storing the decoded image with a delayed output;
Means for updating an index indicating an output order of decoded images in the output image memory every time a decoded image of each frame is output;
When the decoded image output flag indicates that the decoded image is output immediately after decoding, the decoded image decoded by the decoding unit is output, and the decoded image output flag indicates that the decoded image is not output immediately after decoding In addition, the decoded image stored in the output image memory is read out from the output image memory according to the index and output, and the current decoded frame is displayed at the position of the output image memory indicated by the index associated with the output timing number. An image decoding apparatus that accumulates decoded images. In an image decoding apparatus for decoding image information encoded using an inter-frame predictive encoding method,
Decoding means for inputting encoded image information to be decoded in units of frames and performing interframe predictive decoding;
Means for inputting encoded data of an output timing number indicating how many frames later from the time when the frame of the encoded image information is input, and outputting the decoded image of the frame;
Means for inter-frame predictive decoding of the encoded image information of the input frame;
Means for storing the decoded image in a reference image memory for referring to the inter-frame prediction decoding;
An output image memory for storing the decoded image with a delayed output;
Means for decoding the encoded data of the output timing number;
Means for determining whether or not to output the decoded image immediately after decoding depending on whether or not the decoded output timing number is a specific value;
When the decoded image is output immediately after decoding, the decoded image decoded by the decoding means is output. When the decoded image is not output immediately after decoding, the decoded image is output from the output image memory, and the current frame is output. Means for storing a decoded image at a position of the output image memory indicated by an index associated with the output timing number;
An image decoding apparatus comprising: means for updating an index indicating an output order of decoded images in the output image memory each time a decoded image of each frame is output. Means for inputting encoded data of the number of output delay frames indicating the number of frames in which the output of the decoded image is delayed in all frames in the sequence;
Means for decoding encoded data of the number of input output delay frames,
18. The image decoding apparatus according to claim 16, wherein output of the decoded image is delayed for all frames in the sequence in accordance with the number of output delay frames decoded. A moving picture coding program for causing a computer to execute the moving picture coding method according to any one of claims 1 to 6. A moving picture decoding program for causing a computer to execute the moving picture decoding method according to any one of claims 7 to 12. A recording medium for a moving picture coding program, in which a program for causing a computer to execute the moving picture coding method according to any one of claims 1 to 6 is recorded. A recording medium for a moving picture decoding program, wherein a program for causing a computer to execute the moving picture decoding method according to any one of claims 7 to 12 is recorded.

Images