Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
  • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
  • H04N19/198—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/117—Filters, e.g. for pre-processing or post-processing
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/146—Data rate or code amount at the encoder output
  • H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/146—Data rate or code amount at the encoder output
  • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
  • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Definitions

• the invention relates to signal processing such as, for example, coding a sequence of pictures in accordance with a standard defined by the Moving Pictures Experts Group (MPEG).
• MPEG Moving Pictures Experts Group
• the document JP-A-09 ,009,260 describes a dynamic image encoding device. What follows is a literal citation of the English abstract.
• the low frequency components are passed through by a two-dimensional block unit in a variable low-pass spatial filter, a high frequency encoding processing is performed in a compressor 13, they are tentatively stored in a FIFO memory and a compressed data storage amount in the FIFO memory is monitored by a FIFO monitoring device.
• FIFO storage information which is the monitoring data and block activity information for each block unit from the compressor are inputted to a band controller and a cut-off frequency for each block is set and instructed to the variable low-pass spatial filter from the band controller.
• Processing of a signal may cause distortion.
• coding a sequence of pictures is a form of signal processing which may cause distortion.
• the spatial low-pass filter which filters picture data before it is coded, appears to be adjusted as a function of the amount of coded data contained in the FIFO output buffer. Consequently, it does not initially prevent that a relatively large amount of coded data is produced. If a relatively large amount of coded data is indeed produced, the picture data yet to be coded will be distorted to a relatively large extent. This is because this picture data either has to be filtered to a relatively large extent, or has to be coded with a relatively low precision, or both, in order to prevent that a limit in terms of amount of coded data obtained is exceeded. Thus, the picture data yet to be coded will have a relatively poor quality, either because the resolution is low or because there are so ,,e block effects, or both.
• an examining circuit examines a signal to be processed by means of a signal processor so as to obtain a distortion indication.
• the distortion indication indicates to which extent distortion would be introduced if the signal as such were processed by the signal processor.
• An adjustable filter filters the signal in dependence on the distortion indication so as to obtain a filtered signal.
• the signal processor processes the filtered signal.
• the adjustable filter is adjusted in a pro-active manner, whereas in the background art, the spatial low-pass filter is adjusted in a retro-active manner. Accordingly, in the invention, there is not any substantial delay in making a compromise between distortion caused by processing and distortion caused by filtering, whereas in the background art, there is inherently some delay in making such a compromise. Thus, the invention allows a better compromise between the two aforementioned types of distortion. As a result, the invention allows a better quality.
• the invention may be applied for coding a sequence of pictures.
• the examining circuit examines a picture to be coded or a portion thereof. By doing so, it can indicate that if the picture as such were coded, a relatively large amount of coded data would be obtained. As explained hereinbefore, this potentially causes distortion of one or more pictures subsequently to be coded. Since the invention allows the picture to be filtered in dependence on this indication, it can be prevented that the coding of the picture actually produces a large amount of coded data. Accordingly, this contributes to the quality of the one or more subsequent pictures. Thus, in effect, the invention allows a quality trade, off between the picture examined and the one or more subsequent pictures. Accordingly, the invention allows a satisfactory and homogeneous picture quality.
• Fig. 1 is a conceptual diagram illustrating basic features of the invention as claimed in claim 1.
• Fig. 2 is a block diagram illustrating an example of a video encoder
• Fig. 3 is a block diagram illustrating a video-coding arrangement in accordance with the invention
• Fig. 4 is a graph illustrating a first filter control-characteristic for the video coding arrangement illustrated in Fig. 3.
• Fig. 5 is a graph illustrating a second filter control-characteristic for the video coding arrangement illustrated in Fig. 3.
• a signal processing arrangement comprises an examining circuit EXAM, a pre-processor FLL, and a signal processor PRC.
• the examining circuit EXAM examines a signal S to be processed so as to obtain a distortion indication IND.
• the distortion indication LND indicates to which extent distortion DIST would be introduced if the signal S were processed PRC[S] by means of the processor PRC.
• the pre-processor FIL pre-processes the signal S in dependence on the distortion indication END so as to obtain a pre-processed signal SF.
• the signal processor PRC processes the pre-processed signal SF.
• the features illustrated in Fig. 1 may be applied, for example, for coding a sequence of pictures.
• the signal S is a data stream representing the sequence of pictures to be coded.
• the signal processor PRC is a video encoder which may distort one or more pictures to a relatively large extent. This will be explained in greater detail hereinafter.
• Fig. 2 illustrates an example of a video encoder.
• the video encoder provides an MPEG data stream OUT having a certain bit rate R in response to a picture data stream IN representing a sequence of pictures.
• the picture data stream IN may be obtained, for example, by converting an analog video signal to a digital video signal.
• the video encoder comprises the following functional blocks: an input buffer LBUF, a subtractor SUB, a memory MEM, a motion estimator and compensator MEC, a discrete cosine transformer DCT, an inverse discrete cosine transformer IDCT, a quantizer Q, an inverse quantizer IQ, an adder ADD, a variable-length encoder VLC, an output buffer OBUF, and a controller CON.
• the video encoder illustrated in Fig. 2 codes most pictures in the following manner.
• the input buffer LBUF temporarily stores a picture to be coded.
• the picture to be coded is, in effect, subdivided into macroblocks of 16-by-16 pixels.
• the memory MEM contains a decoded version of a previously coded picture which will hereinafter be referred to as the previous picture.
• the motion estimator and compensator MEC searches a similar macroblock of 16-by-16 pixels in the previous picture.
• the motion estimator and compensator MEC supplies the similar macroblock which it has found to the subtractor SUB.
• the subtractor SUB provides a differential macroblock by subtracting, from the macroblock to be coded, the similar macroblock provided by the motion estimator and compensator MEC.
• the discrete cosine transformer DCT transforms the differential macroblock into a block of frequency coefficients.
• the quantizer Q divides each frequency coefficient by a value which is proportional to a quantization parameter QP and rounds off the result of this division to the nearest integer. Accordingly, the quantizer Q provides a block of quantized frequency coefficients.
• the inverse quantizer IQ and the inverse discrete cosine transformer ICDT provide a decoded version of the differential macroblock on the basis of the block of quantized frequency coefficients.
• the adder ADD adds the similar macroblock in the previous picture, which the motion estimator and compensator MEC has found, to the decoded version of the differential macroblock. Accordingly, the adder ADD provides a decoded version of the macroblock being coded, which decoded version is stored in the memory MEM.
• the memory MEM will thus comprise a decoded version of the picture currently being coded once all macroblocks comprised in this picture have been coded. Consequently, in this manner it is achieved that when a picture is coded, a decoded version of the preceding picture is contained in the memory MEM.
• the variable-length encoder VLC transforms the block of quantized frequency coefficients into a series of variable-length codes.
• the block of quantized frequency coefficients will generally comprise a number of frequency coefficients having the value of zero, the number being higher as the quantization parameter QP has a higher value.
• the series of variable-length codes comprises relatively few bits if the quantization parameter QP has a high value, and vice versa.
• the variable-length codes are temporarily stored in the output buffer OBUF.
• the output buffer OBUF outputs variable-length codes belonging to macroblocks which have already been coded, at the bit rate R.
• the controller CON controls the quantization parameter QP on the basis of the following criterion.
• the amount of coded data contained in the output buffer OBUF should be between a minimum and a maximum level. This implies that, if the output buffer OBUF is relatively full, the quantization parameter QP will generally have a relatively high value. If the output buffer OBUF is relatively empty, the quantization parameter QP will generally have a relatively low value.
• the controller CON calculates a target amount of coded data for a picture to be coded, or a portion thereof.
• the target amount of coded data depends on the output buffer fullness F. That is, if the output buffer OBUF is relatively full, the target will be relatively low, and vice versa.
• the controller CON calculates a value for the quantization parameter QP on the basis of the target amount of coded data and recent coding experiences. These recent coding experiences include an amount data comprised in a recently coded portion of the picture, and the value of the quantization parameter QP which was applied in the coding of that portion. Let it be assumed that the recently coded portion of the picture comprises a relatively large amount of coded data. The controller CON deduces from this that the quantization parameter QP should have a value which is somewhat lower than the recent value, so as to prevent that the target amount of coded data is exceeded.
• the video encoder illustrated in Fig. 2 may distort a picture to a relatively large extent if the picture, or a portion thereof, is coded with the quantization parameter QP having a relatively high value. If the quantization parameter QP has a relatively high value, the number of different values which a quantized frequency coefficient may have, is relatively low. Moreover, in practice, many frequency coefficients will be rounded off to zero value. As a result, at a decoding end, the picture will be distorted to a relatively large extent. For example, objects, or portions thereof, which comprise relatively many details will be represented by means of relatively large, uniform blocks. This phenomenon is hereinafter referred to as block effects.
• Block effects may occur, for example, when there is a scene change in the sequence of pictures.
• the first picture of a new scene will differ from the last picture of the preceding scene to a relatively large extent. Consequently, if the first picture of the new scene is coded, many blocks of frequency coefficients will comprise many frequency coefficients having a substantial value. If these blocks were quantized with the quantization parameter QP having a nominal value, a relatively large amount of coded data would be obtained. In order to prevent this, the controller CON will give the quantization parameter QP a high value. As explained hereinbefore, this might cause block effects.
• Fig. 3 illustrates an example of a video-encoding arrangement in accordance with the invention.
• the video-encoding arrangement recaptures the features illustrated in Fig. 1. It provides an MPEG data stream MDS in response to a picture data stream PDS representing a sequence of pictures.
• the video-encoding arrangement comprises a pseudo video-encoder PENC, a filter controller FCON, a delay circuit DEL, an adjustable filter FLL and a video encoder ENC.
• the video encoder ENC and the pseudo video-encoder PENC are similar to the video encoder illustrated in Fig. 2 and discussed hereinbefore.
• the controller CON comprised in the pseudo video-encoder does not control the quantization parameter QP in the same manner as described hereinbefore with reference to Fig. 2. This will be explained in greater detail hereinafter.
• the video-encoding arrangement illustrated in Fig. 3 basically operates in the following manner.
• the pseudo- video-encoder PENC codes a picture so as to derive a complexity indication CI indicating, as it were, how difficult it is to code the picture.
• the filter controller FCON controls the adjustable filter FLL in dependence on the complexity indication CI.
• the delay circuit DEL compensates for the time which the pseudo video-encoder PENC spends to code the picture as well as the time which the filter controller FCON spends to control the adjustable filter FEL.
• the adjustable filter FLL filters the picture to be coded with a cut-off frequency FC determined by the complexity indication CI.
• the video encoder ENC codes the filtered picture.
• the pseudo video-encoder PENC may provide the complexity indication CI.
• the pseudo video-encoder may code the picture with the quantization parameter QP having a certain fixed value. If the amount of coded data is relatively large, it can be said that the picture is difficult to code, and vice versa. Thus, the amount of coded data obtained by coding the picture may constitute the complexity indication CI.
• the pseudo video-encoder PENC may also encode the picture with the quantization parameter QP being controlled on the basis of a target amount of coded data established in the encoder ENC. If the quantization parameter QP is given a relatively high value, so as to meet the target, it can be said that the picture is difficult to code, and vice versa.
• the quantization parameter QP may constitute the complexity indication CI. It is also possible to use the product of the quantization parameter QP and the amount of coded data obtained as a complexity indication. In that case, it does not matter how the pseudo video- encoder PENC establishes a value for the quantization parameter QP.
• the complexity indication CI is, in effect, a distortion indication. If the complexity indication CI has a high value, which means that the picture is difficult to code, the following may occur.
• the video encoder ENC may give the quantization parameter QP a relatively high value, so as to prevent that a relatively large amount of coded data is produced. In that case, block effects may occur in the picture at a decoding end, as explained hereinbefore.
• the video encoder ENC may also give the quantization parameter QP a value which is sufficiently low to prevent such block effects. However, in that case, a relatively large amount of coded data will be produced, which will affect the quality of one or more subsequent pictures as explained hereinbefore.
• the complexity indication CI has a high value, either the picture itself will be distorted, or one or more subsequent pictures, or both, if the encoder ENC were to code the picture as such.
• Fig. 4 illustrates a filter control characteristic which may be applied by the filter controller FCON.
• Fig. 4 is a graph having a horizontal axis representing the complexity indication CI and a vertical axis representing the cut-off frequency FC of the adjustable filter FLL.
• the graph illustrates that, if the complexity indication CI is below a threshold value Cth, the cut-off frequency has a relatively high value which does not substantially vary as a function of the complexity indication CI. Accordingly, if a picture is relatively easy to code, it will be filtered to a relatively small extent only and, consequently, details of the picture will substantially be preserved. However, if the complexity indication CI is above the threshold value, the cut-off frequency decreases as the complexity indication CI increases in value.
• a picture is relatively difficult to code, it will be filtered to an extent which depends on how difficult the picture is to code. That is, if a picture is relatively difficult to code, details of the picture will be removed to an extent which depends on how difficult the picture is to code.
• This allows the video encoder ENC to code the thus filtered picture with the quantization parameter QP having a value which is sufficiently low to prevent block effects in the picture itself, while the amount of coded data obtained is sufficiently low to allow a satisfactory quality of subsequent pictures.
• Fig. 5 illustrates another filter control characteristic which may be optionally applied in combination with the control characteristic illustrated in Fig. 4.
• Fig. 5 is a graph having a horizontal axis representing a picture number and a vertical axis representing the cutoff frequency FC.
• the picture number N represents the picture for which the complexity indication CI has been established as described hereinbefore. It is assumed that the complexity indication CI of this picture has a relatively high value, which means that the picture is difficult to code.
• the spatial filter FTL has a relatively low cut-off frequency FClow when the picture number N is filtered.
• Fig. 5 illustrates that, as a consequence, subsequent pictures having numbers N+l, N+2, N+3, are also filtered with the cut-off frequency which gradually increases as the picture number increases.
• the filter control characteristic illustrated in Fig. 5 is advantageous, for example, when a scene change occurs.
• the picture number N is the first picture of a new scene. Since the first picture of the new scene is filtered with the relatively low cut-off frequency FClow, relatively many details will be removed. That is, at a decoding end, the first picture of the new scene will have a relatively low resolution. Since the cut-off frequency FC gradually increases with the picture number in the new scene, the resolution will gradually become better with each subsequent picture. This evolution in resolution matches properties of human vision. Human beings tend to first pay attention to the basic shape and color of new objects and only later pay attention to the details of the new objects. Thus, in the case of a scene change, the filter control characteristic illustrated in Fig.
• control characteristic illustrated in Fig. 5 contributes to a satisfactory overall quality.
• the drawings are very diagrammatic, each representing only one possible embodiment of the invention. Thus, although a drawing shows different functional elements as different blocks, this by no means excludes that some functional elements, or all functional elements, may be implemented as a single physical unit.
• the video-coding arrangement illustrated in Fig. 3 uses a pseudo video-encoder PENC to provide a distortion indication in the form of the complexity indication CI
• other circuits may be used to provide a distortion indication.
• a circuit may be used, which establishes a sum of absolute differences between the pixels of a picture to be coded and corresponding pixels of a previous picture. If the sum of absolute differences is high, the picture is difficult to code and, consequently, the picture itself may be distorted or one or more subsequent pictures, or both. Thus, the sum of absolute differences is a distortion indication.
• the adjustable filter FLL filters pictures and is controlled on a picture-by-picture basis, it may also filter portions of pictures and be adjusted on a picture portion-by-portion basis.
• the adjustable filter FLL shown in Fig. 5 the following is also noted.
• the adjustable filter FIL may be a spatial filter or a horizontal filter. That is, it may be a two-dimensional filter or a one- dimensional filter.
• the adjustable filter FLL may be implemented, for example, as a mean filter, a gauss filter or a median filter
• the adjustable filter FLL may also be implemented as a wavelet domain filter.
• the wavelet domain filter can be based on a de-blocking algorithm for JPEG compressed images.
• the filter carries out edge detection and smoothing so as to preserve detected edges in the wavelet domain.
• the edge detection may be based on a threshold which is determined in the pseudo video-encoder PENC shown in Fig. 3. Accordingly, the threshold is adapted to the complexity of the current picture to be encoded.
• the wavelet domain filter counters block effects by filtering only those areas of a picture in which these effects may occur.
• a wavelet domain filter will reduce the resolution of a picture to a lesser extent than a low-pass filter.
• a JPEG algorithm can further be useful to counter block effects. Such an algorithm provides a satisfactory de-blocking performance and is relatively simple.
• filter is not limited to signal processing characterized by a certain frequency response.
• filter should be broadly construed so as to include various types of pre-processing which will diminish the distortion that would otherwise be introduced by a processor.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computing Systems (AREA)
• Theoretical Computer Science (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)

Priority Applications (1)

Applications Claiming Priority (4)

Publications (1)

Family

ID=8235573

Family Applications (1)

Country Status (5)

Families Citing this family (2)

Family Cites Families (3)

• 1999
  • 1999-11-16 CN CNB998044229A patent/CN1178519C/zh not_active Expired - Fee Related
  • 1999-11-16 JP JP2000586107A patent/JP2002532028A/ja active Pending
  • 1999-11-16 WO PCT/EP1999/008937 patent/WO2000033582A1/en not_active Application Discontinuation
  • 1999-11-16 EP EP99973212A patent/EP1057345A1/de not_active Withdrawn
  • 1999-11-16 KR KR1020007008210A patent/KR20010034437A/ko active IP Right Grant

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events