JP2007043264A - Digital moving image decoder and decoding method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress jerkiness caused by time reversal between fields. <P>SOLUTION: A field divider 300 divides a reproduction frame image signal outputted from an image decoder 100 into an odd field signal and an even field signal. A buffer 10 stores the odd field signal and a buffer 20 stores the even field signal. An interpolation signal generator 500 generates an interline interpolation signal by using the even field signal. A moving amount calculator 400 calculates the moving amount between fields from an odd field output signal and an even field output signal. An output controller 600 determines whether output of an interpolation signal is required or not from movement information and controls the output signal. A switch 200 outputs any one of the odd field signal, the even field signal and the interpolation signal. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to decoding of a digital moving image, and more particularly to a digital moving image decoding apparatus and a digital moving image decoding method for outputting a decoded image signal to an interlace television such as NTSC.

  Conventionally, in order to decode an image signal encoded by a high-efficiency encoded image signal and output it to an interlace television such as NTSC, the configuration shown in FIG. It does not matter).

  That is, an image decoder (hereinafter referred to as a decoder) 101 reads an encoded image signal from a storage medium such as a DVD or decodes an encoded image signal supplied via a transmission path, and reproduces a reproduced frame image signal. Is output at a predetermined timing. In order to output the playback frame image signal to an NTSC television 900 of an interlace system such as NTSC, the field divider 301 divides the playback frame image signal into two field signals of an odd field and an even field and outputs the odd field buffer 11. And must be stored in the even field buffer 21.

  A field is a screen configured by skipping one line from one frame, and an odd-numbered line extracted from a frame is called an odd field, and an even-numbered line extracted is called an even field. One playback frame image signal is divided into two field signals, an odd field signal and an even field signal, and is alternately output from the odd field buffer 11 and the even field buffer 21 to the digital-analog conversion circuit 800 by the switch 201 at a predetermined timing. Then, it is converted into an NTSC signal by the digital-analog conversion circuit 800 and output to the NTSC television 900.

  Here, in the case of decoding an encoded image signal supplied via a transmission line, there is an image encoder (hereinafter referred to as an encoder) on the opposite side. If the transmission code amount needs to be reduced due to the bandwidth of the network, or if the encoding process is not in time, a crash may occur (the encoded image signal for one frame may be lost). Then, the decoder 101 cannot receive the encoded image signal of the frame subject to the corruption, decodes the encoded image signal of the frame subject to the corruption, and outputs the playback frame image signal at the timing to be reproduced. The frame image signal is lost.

  In general, the decoder 101 that decodes an encoded image signal activates a compensation process corresponding to the occurrence of a fall by the encoder. The simplest compensation process is to output the reproduced frame image signal output at the previous time again at the display timing of the corrupted frame. For example, repair such as interpolation of a defective image from adjacent pictures is performed to make an error portion of the image inconspicuous (see Patent Document 1).

  In general, a decoder that decodes an encoded image signal has a correction function for image degradation. The decoder may fail to decode the encoded image signal when reading from a storage medium such as a DVD fails or when the code data supplied via the transmission path contains an error. A playback frame image that has failed in decoding is visually degraded. In addition, moving picture compression methods such as MPEG (Moving Picture Experts Group) have a feature that predictive coding is used to achieve a high compression rate.

  This is a technique for increasing the compression rate by using frames that are close in time as predicted frames at other times. At this time, when a decoding abnormality occurs in decoding of an image signal of a certain frame, the frame deteriorates, and another frame may be decoded by referring to the deteriorated frame. In this case, the frame decoded with reference to the deteriorated frame also deteriorates, and the deterioration propagates.

  On the other hand, as a method of suppressing the propagation of deterioration, generally used is a method of outputting a decoded image that has already been decoded instead of an image that cannot be decoded when decoding cannot be performed normally due to a decoding abnormality. (For example, see Patent Document 2 and Patent Document 3).

JP 6-98313 A (page 4) Japanese Patent Laid-Open No. 6-98313 (2nd page, FIG. 1) Japanese Patent Laid-Open No. 10-23431 (2nd page, FIG. 1)

  By the way, as described above, when a coded image signal is supplied via a transmission line, when a crash occurs in the encoder, or when a decoding abnormality occurs in order to suppress propagation of image degradation, When a decoding abnormality occurs in a decoder having a function of outputting a decoded image that has already been decoded instead of an image that cannot be decoded when decoding cannot be performed, the output of two reproduced frame image signals from the decoder continues to be the same. It may become. FIG. 8 or FIG. 9 shows the output of the reproduced frame image signal from the decoder and the output to the digital-analog converter circuit in this case. FIG. 8 shows a case where the above-described crash occurs, and FIG. 9 shows a case where the above-described decoding abnormality occurs. FIG. 8 and FIG. 9 are not different as diagrams.

  Hereinafter, with reference to FIG. 7 and FIG. 8, a high-efficiency encoded image signal according to the prior art will be described with reference to FIGS. The operation of decoding the image signal encoded by the above and outputting it to an interlace television such as NTSC will be described. The same applies to the case where the decoding abnormality shown in FIG. 9 occurs.

  In the example shown in FIG. 8, a square indicated by F (n) represents a playback frame image from the decoder 101, and n represents a sequential number of the playback frame image along time. That is, in the example shown in FIG. 8, the decoder 101 performs field division on a reproduction frame image signal decoded in the order of F (0), F (1), F (2), and F (3) at a predetermined timing. Output to the unit 301. A playback frame image signal F (0) to be output at time T (0) is supplied from the decoder 101, and the field divider 301 converts F (0) into an odd field signal F (0) -odd and an even field signal F ( 0) -even, and F (0) -odd is output to the odd field buffer 11 and F (0) -even is output to the even field buffer 21. The switch 201 outputs F (0) -odd at a predetermined timing and outputs F (0) -even at the next predetermined timing.

  Subsequently, a playback frame image signal F (1) to be output at time T (1) is supplied from the decoder 101, and F (1) -odd is output at a predetermined timing in the same operation as described above. F (1) -even is output at the timing.

Here, when decoding the frame F (2) to be output at the next time T (2), if the encoded image signal of F (2) has not been received due to a fall by the encoder, the decoder In 101, F (1) stored in the decoder 101 is output as compensation processing. When this compensation processing is activated, the field signal output to the digital-analog conversion circuit 800 is F (1) -odd, F (1) -even at time T (1), and F (1 at time T (2). ) -odd, F (1) -even. That is, a time reversal occurs between F (1) -even at time T (1) and F (1) -odd at time T (2). When the amount of movement of the subject between the fields is large, jerkiness that makes the movement of the subject awkward occurs due to the reversal of this time.
The present invention has been made in view of the above points. When a playback frame image signal from an image decoder is output to an interlace television such as NTSC, the output of the playback frame image signal from the image decoder is performed. An object is to suppress jerkiness caused by time reversal between fields that occurs when two consecutive playback frame image signals are generated.

  In order to solve this problem, a digital video decoding apparatus according to the present invention decodes a high-efficiency encoded image signal and reproduces the image signal, and outputs from the image decoder. A field divider (300 in FIG. 1) that divides the reproduced frame image signal into an odd field signal and an even field signal, and an odd field buffer (in FIG. 1) that stores the odd field signal output from the field divider 10), an even field buffer (20 in FIG. 1) for storing an even field signal output from the field divider, and an interpolation signal for generating an interline interpolation signal using the even field signal output from the field divider The generator (500 in FIG. 1), the odd field output signal output from the odd field buffer, and the output from the even field buffer. The motion amount calculator (400 in FIG. 1) for calculating the motion amount between fields from the even field output signal, and the interpolation generated by the interpolation signal generator from the motion information output from the motion amount calculator An output controller (600 in FIG. 1) that determines whether signal output is necessary and controls the output signal, and an odd field signal stored in an odd field buffer and an even field buffer in accordance with an instruction from the output controller The switch (200 in FIG. 1) outputs any one of the even field signal and the interpolation signal generated by the interpolation signal generator.

  A digital video decoding method according to the present invention is a digital video decoding method using the above-described digital video decoding device, and is generated by dividing a reproduction frame image signal supplied from a decoder by a field divider. Odd field signal and even field signal stored in odd field buffer and even field buffer respectively, and when encoded image signal cannot be received due to occurrence of corruption by encoder, or normal due to decoding abnormality in decoder When the decoding process cannot be performed, a procedure for operating a compensation process for outputting a playback frame image signal that has already been decoded instead of a playback frame image signal that cannot be decoded, and an odd field output signal and an even field output from the odd field buffer Even field output from buffer The even field signal at the timing of the odd field output of the reproduced image frame signal to be reproduced repeatedly when the calculated motion amount between the fields is larger than a predetermined value. And a field signal for outputting an odd field of a reproduced image frame signal to be reproduced repeatedly when the calculated motion amount between fields is smaller than a predetermined value. And a procedure for selecting.

  As described above, according to the present invention, when a coded image signal is supplied via a transmission line, a decoding frame is already decoded instead of a non-decoded reproduction frame image when a crash occurs in the encoder. When the playback frame image output from the image decoder having the function of outputting the decoded frame image is output to an interlaced television such as NTSC, two playback frame images from the image decoder are output in succession. By controlling the field signal to be output when it becomes a frame image, and outputting the interpolation signal generated from the even field signal at the output timing of the odd field signal when the amount of motion between the fields is large, It is possible to realize a digital video decoding apparatus that suppresses the occurrence of jerkiness due to time reversal between fields.

  The explanation of the operation in the case where decoding cannot be normally performed due to the occurrence of decoding abnormality in the decoder, which is another factor that causes two reproduced frame image outputs from the image decoder to be the same reproduced frame image in succession. Although only 4 has been described, it is obvious that the present invention operates in the same manner as the description of the operation described in this paper and brings about the same effect.

  The digital video decoding apparatus of the present invention includes an odd field buffer and an even field buffer for storing an odd field signal and an even field signal generated by dividing a reproduction frame image signal supplied from a decoder by a field divider, respectively. If the encoded image signal cannot be received due to the occurrence of a corruption by the encoder, or if the decoding cannot be performed normally due to the occurrence of a decoding abnormality in the decoder, it is already decoded instead of the unrecognizable playback frame image signal. When the compensation processing for outputting the reproduced frame image signal is activated, the motion amount between the fields is calculated from the odd field output signal output from the odd field buffer and the even field output signal output from the even field buffer. The amount of movement between If the value is larger than a certain value, an interline interpolation signal generated from the even field signal is output at the odd field output timing of the reproduced image frame signal to be reproduced repeatedly, and the calculated motion amount between the fields is a predetermined value. In the case where it is smaller, there is provided means for selecting a field signal to be output so as to output an odd field of the reproduced image frame signal to be reproduced in duplicate.

  A decoded frame image signal that has already been decoded instead of a reconstructed frame image signal that cannot be decoded when the encoded image signal cannot be received due to occurrence of a corruption by the encoder, or when decoding cannot be performed normally due to a decoding abnormality. When outputting a playback frame image signal from an image decoder having a function of outputting to an interlace system television such as NTSC, two playback frame image signals from the decoder are continuously output to the same playback frame image signal. It is possible to suppress the occurrence of jerkiness due to the time reversal between fields that occurs when

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing Embodiment 1 of the digital video decoding apparatus of the present invention. The digital video decoding apparatus shown in FIG. 1 includes an image decoder 100, an odd field buffer 10, an even field buffer 20, a switch 200, a field divider 300, a motion amount calculator 400, and output control. It consists of a container 600.

  If the image decoder 100 cannot receive the encoded image signal due to the occurrence of a corruption by the encoder, or cannot decode normally due to the occurrence of a decoding abnormality, the image decoder 100 has already replaced the unrecognizable playback frame image signal. When the compensation process for outputting the decoded decoded frame image signal is activated, a means for notifying that is provided.

  Further, the image decoder 100 decodes the encoded image signal and outputs the playback frame image signal to the field divider 300 at a predetermined timing. The field divider 300 divides the supplied reproduction frame image signal into two field signals, an odd field signal and an even field signal, and converts the odd field signal to the odd field buffer 10 and the even field signal to the even field buffer 20 and Output to the interpolation signal generator 500.

  The interpolation signal generator 500 generates an interpolation signal obtained by converting the even field signal supplied from the field divider 300 for output to the odd field.

  The motion amount calculator 400 receives the odd field signal from the odd field buffer 10 and the even field signal from the even field buffer 20, and calculates the motion amount between fields. When the calculated amount of motion is equal to or greater than a predetermined threshold, a control signal is transmitted to the output controller 600.

  In accordance with an instruction from the output controller 600, the switch 200 receives the odd field signal stored in the odd field buffer 10, the even field signal stored in the even field buffer 20, and the interpolation stored in the interpolation signal generator 500. Output one of the signals.

  The output controller 600 outputs the odd field signal stored in the odd field buffer 10 to the switch 200, the even field signal stored in the even field buffer 20, and the interpolation signal stored in the interpolation signal generator 500. Which signal is output is instructed at a predetermined timing.

  Here, the amount of motion between fields will be mentioned. In general video encoding methods such as H.261, MPEG-1, and MPEG-2, an image of one field is divided into blocks called macroblocks of a predetermined unit (for example, 16 lines × 16 pixels) The amount of movement is obtained every time. As shown in FIG. 2, the motion amount of each block is represented by the distance between the macroblock coordinates in the current field and the coordinates of the macroblock having the smallest difference information between the past fields.

  In this way, all the motion amounts of each block for one field are obtained, and the sum of their absolute values is used as the motion amount between fields, and the value is compared with a threshold value. Judgment of non-operation.

  Next, an example of the operation of the digital video decoding apparatus of the present invention will be described with reference to FIGS. 1 and 3, taking as an example the case where an encoded image signal cannot be received due to occurrence of a fall by the encoder.

  In FIG. 3, a square indicated by F (n) represents a playback frame image from the image decoder (hereinafter referred to as a decoder) 100, and n represents a serial number of the playback frame image along time. That is, in the example shown in FIG. 3, the decoder 100 is a field of the reproduced frame image signal decoded in the order of F (0), F (1), F (2), F (3). Output to the divider 300.

  First, when the playback frame image signal F (0) is output from the decoder 100, the field divider 300 converts the supplied playback frame image signal F (0) into an odd field signal F (0) -odd and an even field. The signal is divided into signals F (0) -even, F (0) -odd is output to the odd field buffer 10, and F (0) -even is output to the even field buffer 20 and the interpolation signal generator 500.

  The odd field buffer 10 and the even field buffer 20 hold the supplied field signals, respectively, and the interpolation signal generator 500 generates an interpolation signal F (0) -even ′ from F (0) -even. Here, the interpolation signal F (0) -even 'is a field signal obtained by converting the even field signal F (0) -even, which is originally intended for output to the even field, to be output to the odd field.

  The output controller 600 issues an output instruction to the switch 200 at a predetermined timing. Here, since the control signal from the motion amount calculator is not received, the switch 200 is instructed to output F (0) -odd at a predetermined timing, and F (0) -even at the next predetermined timing. Is output.

  Next, the image decoder 100 outputs the playback frame image signal F (1) to the field divider 300, and thereafter, F (1) -odd, F ( 1) -even is output.

  Next, at the output timing of F (2) from the image decoder 100, the encoded image signal F (2) cannot be received due to the occurrence of a fall by the encoder, so the compensation processing by the image decoder 100 has been activated. And The image decoder 100 transmits a compensation processing operation notification to the motion amount calculator 400, and outputs the playback frame image signal F (1) at the previous time to the field divider 300 again. Similarly to the above, the field divider 300 divides the supplied reproduction frame image signal F (1) into an odd field signal F (1) -odd and an even field signal F (1) -even, and F (1)- The odd number is output to the odd field buffer 10, and F (1) -even is output to the even field buffer 20 and the interpolation signal generator 500, respectively. The interpolation signal generator 500 generates an interpolation signal F (1) -even ′ from F (1) -even.

  Next, the motion amount calculator 400 reads the odd field signal F (1) -odd in the odd field buffer 10 and the even field signal F (1) -even in the even field buffer 20, and outputs the two field signals. Calculate the amount of movement. Here, if the calculated motion amount is equal to or greater than a predetermined threshold value, the motion amount calculator 400 transmits a control signal to the output controller 600.

  The output controller 600 instructs the switch 200 to output the interpolation signal F (1) -even 'generated by the interpolation signal generator 500 at a predetermined timing, and at the next predetermined timing, F (1) -even Direct output. Since the interpolated signal F (1) -even 'is a field signal converted from F (1) -even to output to the odd field, the time between F (1) -even' and F (1) -even There is no reversal, and there is no jerkiness that makes the subject's movement jerky.

  FIG. 4 shows an operation when the motion amount calculated by the motion amount calculator 400 is smaller than a predetermined threshold value. In this case, since the motion amount calculator 400 does not transmit a control signal to the output controller 600, the output controller 600 outputs F (1) -odd to the switch 200 at a predetermined timing as usual. And instruct the output of F (1) -even at the next predetermined timing.

  Next, FIG. 5 shows the operation of the digital video decoding apparatus of the present invention when decoding is abnormal. This is an operation in the case where decoding cannot be performed normally due to the occurrence of a decoding abnormality in the decoder, which is another factor that causes two reproduced frame image outputs from the decoder to be the same reproduced frame image. FIG. 5 showing this operation is not different from the diagram in FIG. 3 showing the operation in the case of a crash. In FIG. 5, “normal reception” in FIG. “Reception impossible” may be read as “decoding abnormality occurred”.

  FIG. 6 is a block diagram showing Embodiment 2 of the digital video decoding apparatus of the present invention. The decoder 110 according to the second embodiment is different from the decoder 100 according to the first embodiment shown in FIG. 1 in the case where the encoded image signal cannot be received due to the occurrence of a fall by the encoder, or the occurrence of a decoding abnormality. Therefore, when decoding cannot be normally performed, there is no means for notifying the compensation processing operation when the compensation processing for outputting the decoded image that has been decoded instead of the image that cannot be decoded is activated.

  Instead, this digital video decoding apparatus includes a compensation processing detection unit 700, and can detect the compensation processing operation in the decoder 100 without the compensation processing operation notification from the decoder 100. That is, the frame buffer 30 for storing the playback frame image signal from the decoder 100, the frame buffer 40 for storing the playback frame image signal of one time past from the decoder 100, and the playback frame image stored in the frame buffer 30 A frame comparator having means for transmitting a compensation processing operation notification to the motion amount calculator 400 when the signal and the reproduced frame image signal stored in the frame buffer 40 at the previous time match and match, The same function as the compensation processing operation notification from the image decoder 100 in 1 is realized. The functions of the other components are the same as in FIG.

1 is a block diagram showing a first embodiment of a digital video decoding apparatus according to the present invention. The figure for demonstrating the amount of motion between the fields of a frame image signal The figure for demonstrating the 1st operation | movement of the digital moving image decoding apparatus of this invention at the time of the fall generation | occurrence | production in an encoder. The figure for demonstrating the 2nd operation | movement of the digital moving image decoding apparatus of this invention at the time of the fall generation | occurrence | production in an encoder. The figure for demonstrating operation | movement of the digital moving image decoding apparatus of this invention at the time of decoding abnormality FIG. 9 is a block diagram showing a second embodiment of the digital video decoding apparatus of the present invention. Block diagram showing a conventional digital video decoding device The figure for demonstrating operation | movement of the conventional digital moving image decoding apparatus at the time of the fall generation | occurrence | production in an encoder. The figure for demonstrating operation | movement of the conventional digital moving image decoding apparatus at the time of decoding abnormality

Explanation of symbols

10 Odd field buffer
20 Even field buffer
30 frame buffer
40 delay frame buffer
50 frame comparator
100 image decoder
110 Image decoder
200 switches
300 field divider
400 Motion calculator
500 interpolation signal generator
600 output controller
700 Compensation processing detector

Claims (2)

An image decoder for decoding the high-efficiency encoded image signal and reproducing the image signal;
A field divider for dividing a reproduced frame image signal output from the image decoder into an odd field signal and an even field signal;
An odd field buffer for storing an odd field signal output from the field divider;
An even field buffer for storing an even field signal output from the field divider;
An interpolation signal generator for generating an interline interpolation signal using an even field signal output from the field divider;
A motion amount calculator for calculating a motion amount between fields from an odd field output signal output from the odd field buffer and an even field output signal output from the even field buffer;
An output controller that determines whether or not the output of the interpolation signal generated by the interpolation signal generator is necessary from the motion information output from the motion amount calculator, and controls the output signal;
One of an odd field signal stored in the odd field buffer, an even field signal stored in the even field buffer, and an interpolation signal generated by the interpolation signal generator according to an instruction from the output controller. A digital moving picture decoding apparatus comprising a switch for outputting. A digital video decoding method using the digital video decoding device according to claim 1,
A procedure for storing an odd field signal and an even field signal generated by dividing a reproduction frame image signal supplied from a decoder by a field divider, respectively, into an odd field buffer and an even field buffer;
When the encoded image signal cannot be received due to the occurrence of a crash by the encoder, or when the decoding cannot be normally performed due to the occurrence of a decoding abnormality in the decoder, it has already been decoded instead of the undecoded playback frame image signal. A procedure for operating a compensation process for outputting a playback frame image signal;
A procedure for calculating a motion amount between fields from an odd field output signal output from the odd field buffer and an even field output signal output from the even field buffer;
When the calculated amount of motion between fields is greater than a predetermined value, a procedure for outputting an interline interpolation signal generated from an even field signal at an odd field output timing of a reproduced image frame signal to be reproduced repeatedly;
And a procedure for selecting a field signal to be output so as to output an odd field of a reproduced image frame signal to be reproduced in a duplicated manner when the calculated motion amount between fields is smaller than a predetermined value. Video decoding method.

Images