US7373010B2 - Method and device for post-processing digital images - Google Patents

Method and device for post-processing digital images Download PDF

Info

Publication number
US7373010B2
US7373010B2 US10/474,112 US47411203A US7373010B2 US 7373010 B2 US7373010 B2 US 7373010B2 US 47411203 A US47411203 A US 47411203A US 7373010 B2 US7373010 B2 US 7373010B2
Authority
US
United States
Prior art keywords
coefficients
frequency
corrected
transformed
frequency coefficients
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US10/474,112
Other versions
US20040105592A1 (en
Inventor
Estelle Lesellier
Jorge E. Caviedes
Carolina Miro Sorolla
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Assigned to KONINKLIJKE PHILIPS ELECTRONICS N.V. reassignment KONINKLIJKE PHILIPS ELECTRONICS N.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CAVIEDES, JORGE E., LESELLIER, ESTELLE, MIRO SOROLLA, CAROLINA
Publication of US20040105592A1 publication Critical patent/US20040105592A1/en
Application granted granted Critical
Publication of US7373010B2 publication Critical patent/US7373010B2/en
Adjusted expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/10—Image enhancement or restoration using non-spatial domain filtering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G06T2207/20052—Discrete cosine transform [DCT]

Definitions

  • the invention relates to a method and a device for post-processing digital images comprising pixels.
  • the invention also relates to a computer program product for performing such a post-processing method.
  • the invention notably finds its application in the correction of digital images that have previously been encoded and subsequently decoded in accordance with a block-based encoding technique, for example, the MPEG standard, so as to attenuate visual artifacts caused by the block-based encoding technique.
  • a block-based encoding technique for example, the MPEG standard
  • the method of post-processing data in accordance with the prior art, described in FIG. 1 comprises the steps of:
  • This method of post-processing decoded video data necessarily comprises a low-pass filtering step for filtering the high-frequency components.
  • This method allows extraction, in the spatial domain, of the low-frequency data on which a first DCT transform and an adjustment are applied in order to deliver adjusted low-frequency coefficients.
  • the high-frequency coefficients are extracted ( 15 ) by way of a second DCT transform of the decoded video data.
  • one part of the data-processing method is realized in the spatial domain, which renders the method both complex to be carried out and costly in terms of computing.
  • a low-frequency coefficient comprised in the transformed filtered data is adjusted within the interval [Xq ⁇ q/2,Xq+q/2], where Xq is the value of said quantized low-frequency coefficient and q is the value of the quantization step, so that such a method necessitates access to the encoding parameters, which is not always possible.
  • the method of post-processing digital images according to the invention is characterized in that it comprises the steps of:
  • Said method is particularly adapted if the frequency transformation step uses the same type of frequency transformation as that used in the technique of block-encoding during a previous encoding of video data, for example, a DCT transform in the case of data that have previously been encoded and subsequently decoded in accordance with the MPEG standard. It also allows better control of the correction of blocking artifacts.
  • the post-processing method is more effective, particularly when a first half of the set of transformed coefficients constitutes the original low-frequency coefficients and a second half of said set constitutes the original high-frequency coefficients.
  • the combination step can linearly combine corrected transformed high-frequency coefficients and original high-frequency coefficients so as to deliver the set of combined transformed coefficients.
  • FIG. 1 illustrates the method of post-processing data in accordance with the prior art
  • FIG. 2 is a diagram showing the principal steps of the method of post-processing data according to the invention.
  • FIG. 3 illustrates a method of correcting blocking artifacts
  • FIG. 4 is a diagram showing an embodiment of the method of post-processing data according to the invention, comprising such a step of correcting blocking artifacts.
  • the present invention relates to a method of post-processing digital images that have previously been encoded and subsequently decoded in accordance with a block-based encoding technique and therefore comprise blocking artifacts.
  • the method of post-processing video data according to the invention is intended to determine:
  • FIG. 2 shows diagrammatically the principal steps of the method of post-processing decoded video data according to the invention. This method comprises the steps of:
  • the set of pixels may be alternatively constituted by either an entire or a partial encoding block.
  • the frequency transformation step preferably uses a transformation of the DCT type which is particularly adapted to the MPEG standard.
  • a segment of pixels is transformed in the transformation step into a segment of DCT coefficients.
  • a first half of the segment of DCT coefficients i.e. the first 4 DCT coefficients constituting the original low-frequency coefficients (Ybfo)
  • a second half of the segment of DCT coefficients i.e. the last 4 DCT coefficients constituting the original high-frequency coefficients (Yhfo)
  • Ybfo the first 4 DCT coefficients constituting the original low-frequency coefficients
  • Yhfo the last 4 DCT coefficients constituting the original high-frequency coefficients
  • the extraction step ( 22 ) also comprises a truncation sub-step during which the first 4 DCT coefficients are completed by 4 zero coefficients so as to deliver a segment of truncated DCT coefficients.
  • This truncation sub-step is in a way similar to a low-pass filtering operation.
  • the segments of truncated coefficients are then corrected so as to deliver a segment of corrected DCT coefficients comprising 4 corrected low-frequency DCT coefficients (Ybfc) and 4 corrected high-frequency DCT coefficients (Yhfc).
  • the 4 original high-frequency coefficients and the segment of corrected DCT coefficients are combined so as to deliver a segment of combined DCT coefficients (Yadd).
  • the segment of combined DCT coefficients corresponds to the concatenation of the 4 corrected low-frequency DCT coefficients (Ybfc) and the 4 original high-frequency coefficients (Yhfo).
  • the segment of combined DCT coefficients is finally transformed in the spatial domain via an IDCT transform, which delivers a segment of processed pixels (yout) for display on a screen.
  • the method of post-processing data also comprises at least a horizontal processing of an image, associated with at least a vertical processing of said image.
  • the blocking artifacts may be present at the borders of an encoding block, that is, in the four segments delimiting the block vertically or horizontally. If the image is processed horizontally, vertical blocking artifacts will be corrected; conversely, horizontal blocking artifacts will be corrected if the image is processed vertically.
  • the method of post-processing data is successively applied to each of the two fields constituting a frame if the image is composed of two fields. It is preferably applied to luminance data in the digital image.
  • the correction step which is carried out is based on the numerous blocking artifact correction methods that are known to those skilled in the art, and preferably those methods that do not use decoding parameters, which parameters are not always accessible.
  • the data correction method is referred to as DFD method (DCT Frequency Deblocking).
  • DFD method DCT Frequency Deblocking
  • Such a data correction method comprises the following steps, shown in FIG. 3 , namely:
  • T is a threshold different from zero.
  • a more precise predicted maximum frequency (kpred) is computed from the introduction of the threshold T, which allows a more effective correction of the blocking artifacts.
  • the value of the threshold T is a function of the size of the segments u and v. Indeed, a part solely consisting of pixels of the segments u and v may be processed, for example, the pixels of either the even or the odd rows.
  • the correction step COR ( 37 ) preferably comprises a sub-step of detecting natural contours from the values of the pixels of the initial segments u and v and the transformed segments U and V. This sub-step allows distinction of the natural contours of the blocking artifacts. A natural contour is detected if two conditions are met:
  • FIG. 4 is a diagram showing an embodiment of the method of post-processing data according to the invention, including the DFD method of correcting blocking artifacts as described with reference to FIG. 3 .
  • Such a method of post-processing video data comprises the steps of:
  • the post-processing method described with reference to FIG. 4 has the advantage that it does not degrade the quality of the images that do not originally comprise any blocking artifacts. Indeed, in the presence of such images, the original low-frequency coefficients are not subjected to any modification because the DFD correction method used and the combined high-frequency DCT coefficients remain identical to the original high-frequency coefficients. In the prior-art technique, the use of a low-pass filter in the spatial domain may, on the other hand, lead to a degradation of the quality of an image that does not originally comprise any blocking artifact.
  • the invention may be realized in the form of software embedded on one or several circuits performing the method of post-processing data described hereinbefore, or in the form of items of hard ware.
  • a device for post-processing digital images, corresponding to said method, is represented again by the functional blocks of FIG. 2 . It comprises:
  • Such a post-processing device can be inserted between a video decoder and a television receiver in order to post-process decoded digital images and to display the post-processed digital images on the television receiver.
  • a device can be built independently. It can also be part of the video decoder or of the television receiver.
  • FIGS. 2 to 4 are very diagrammatic. Therefore, although a Figure shows different functions in the form of separate blocks, it does not exclude the fact that a single piece of software performs several functions. This neither excludes the fact that a function can be performed by a set of software. It is possible to implement these functions by means of a suitably programmed video decoder circuit, a set top box, or a television receiver.
  • a set of instructions comprised in a programming memory may cause the circuit to perform the different operations described hereinbefore with reference to FIGS. 2 and 4 .
  • the set of instructions may also be loaded into the programming memory by reading a record carrier such as, for example, a disc comprising the set of instructions. Reading may alternatively be effected through a communication network such as, for example, the Internet. In this case, a service provider will put the set of instructions at the disposal of those interested.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)

Abstract

A method of post-processing digital images frequency transforming a set of the pixels to a set of transformed coefficients; extracting original low-frequency coefficients and original high-frequency coefficients from the set of transformed coefficients; correcting the original low-frequency coefficients and the original high-frequency coefficients for delivering a set of corrected transformed coefficients including corrected low-frequency coefficients and corrected high-frequency coefficients; and combining the set of corrected transformed coefficients and the original high-frequency coefficients for delivering a set of combined transformed coefficients. The set of combined transformed coefficients are inverse frequency transformed for delivering a processed set of pixels that are ready for display on a screen.

Description

FIELD OF THE INVENTION
The invention relates to a method and a device for post-processing digital images comprising pixels.
The invention also relates to a computer program product for performing such a post-processing method.
The invention notably finds its application in the correction of digital images that have previously been encoded and subsequently decoded in accordance with a block-based encoding technique, for example, the MPEG standard, so as to attenuate visual artifacts caused by the block-based encoding technique.
BACKGROUND OF THE INVENTION
International patent application WO 97/29594 describes a method and a device for post-processing decoded video data so as to minimize the blocking artifacts in an image without affecting the contrast.
To this end, the method of post-processing data in accordance with the prior art, described in FIG. 1, comprises the steps of:
    • LPF filtering (11) decoded video data (x), suitable for delivering filtered data (xf),
    • DCT transform (12,13) of the filtered data and the decoded video data, suitable for delivering transformed filtered data (Xf) and transformed decoded data (X),
    • adjusting ADJ (14) the low-frequency coefficients comprised in the transformed filtered data, suitable for delivering adjusted low-frequency coefficients (Xbf),
    • combining (16) the high-frequency coefficients (Xhf) comprised in the transformed decoded data and the adjusted low-frequency coefficients, suitable for delivering combined transformed data (Xc), and
    • IDCT transform (17) of the combined transformed data, suitable for delivering processed data (xc) that are ready for display on a screen.
This method of post-processing decoded video data necessarily comprises a low-pass filtering step for filtering the high-frequency components. This method allows extraction, in the spatial domain, of the low-frequency data on which a first DCT transform and an adjustment are applied in order to deliver adjusted low-frequency coefficients. The high-frequency coefficients are extracted (15) by way of a second DCT transform of the decoded video data. Thus, one part of the data-processing method is realized in the spatial domain, which renders the method both complex to be carried out and costly in terms of computing.
Moreover, a low-frequency coefficient comprised in the transformed filtered data is adjusted within the interval [Xq−q/2,Xq+q/2], where Xq is the value of said quantized low-frequency coefficient and q is the value of the quantization step, so that such a method necessitates access to the encoding parameters, which is not always possible.
OBJECT AND SUMMARY OF THE INVENTION
It is an object of the present invention to provide a method of post-processing decoded video data, which can be performed in a simple and economical manner.
To this end, the method of post-processing digital images according to the invention is characterized in that it comprises the steps of:
    • frequency transformation, suitable for delivering a set of transformed coefficients from a set of pixels,
    • extraction of original low-frequency coefficients and original high-frequency coefficients comprised in the set of transformed coefficients,
    • correction, suitable for delivering a set of corrected transformed coefficients from the original low-frequency coefficients, and
    • combination, suitable for delivering a set of combined transformed coefficients from the original high-frequency coefficients and from the set of corrected transformed coefficients.
In such a post-processing method, data are processed, and particularly the original high and low-frequency coefficients are separated, in the frequency domain. The post-processing method can therefore be carried out in a simpler manner because the original low-frequency coefficients are solely extracted and corrected via the transformed coefficients. Consequently, neither the step of low-pass filtering in the spatial domain, nor a double frequency transformation of the filtered data and the decoded video data is necessary.
Said method is particularly adapted if the frequency transformation step uses the same type of frequency transformation as that used in the technique of block-encoding during a previous encoding of video data, for example, a DCT transform in the case of data that have previously been encoded and subsequently decoded in accordance with the MPEG standard. It also allows better control of the correction of blocking artifacts.
In addition, the post-processing method is more effective, particularly when a first half of the set of transformed coefficients constitutes the original low-frequency coefficients and a second half of said set constitutes the original high-frequency coefficients.
It is also a very flexible method as regards the restitution of the high frequencies in the image, wherein the combination step can linearly combine corrected transformed high-frequency coefficients and original high-frequency coefficients so as to deliver the set of combined transformed coefficients.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects of the invention are apparent from and will be elucidated, by way of non-limitative example, with reference to the embodiments described hereinafter.
In the drawings:
FIG. 1 illustrates the method of post-processing data in accordance with the prior art,
FIG. 2 is a diagram showing the principal steps of the method of post-processing data according to the invention,
FIG. 3 illustrates a method of correcting blocking artifacts, and
FIG. 4 is a diagram showing an embodiment of the method of post-processing data according to the invention, comprising such a step of correcting blocking artifacts.
 DESCRIPTION OF PREFERRED EMBODIMENTS
The present invention relates to a method of post-processing digital images that have previously been encoded and subsequently decoded in accordance with a block-based encoding technique and therefore comprise blocking artifacts. As will be described hereinafter, the method of post-processing video data according to the invention is intended to determine:
    • the original high-frequency coefficients that must be preserved within a block of transformed coefficients so as to maintain the details of the image, such as contours, as well as
    • the original low-frequency coefficients that must be corrected so as to effectively suppress the blocking artifacts.
FIG. 2 shows diagrammatically the principal steps of the method of post-processing decoded video data according to the invention. This method comprises the steps of:
    • frequency transformation TF (21), suitable for delivering a set of transformed coefficients (Y) from a set of pixels (y),
    • extraction SEP (22) of original low-frequency coefficients (Ybfo) and original high-frequency coefficients (Yhfo) comprised in the set of transformed coefficients,
    • correction COR (23), suitable for delivering a set of corrected transformed coefficients (Yc) from the original low-frequency coefficients,
    • combination (24), suitable for delivering a set of combined transformed coefficients (Yadd) from the original high-frequency coefficients and from the set of corrected transformed coefficients, and
    • inverse frequency transformation ITF (25) of the set of combined transformed coefficients, suitable for delivering a processed set of pixels (yout) that are ready for display on a screen.
The set of pixels is preferably a segment of N pixels, with N=8 in the case of the MPEG standard for which the encoding blocks generally comprise 8 rows of 8 pixels. The set of pixels may be alternatively constituted by either an entire or a partial encoding block. The frequency transformation step preferably uses a transformation of the DCT type which is particularly adapted to the MPEG standard.
In the preferred embodiment, a segment of pixels is transformed in the transformation step into a segment of DCT coefficients. Subsequently, a first half of the segment of DCT coefficients, i.e. the first 4 DCT coefficients constituting the original low-frequency coefficients (Ybfo), and a second half of the segment of DCT coefficients, i.e. the last 4 DCT coefficients constituting the original high-frequency coefficients (Yhfo), are extracted in the extraction step. Such a separation into two parts of the segment of DCT coefficients allows a better correction of blocking artifacts. It may also be easily adjusted optimally as compared with the prior-art technique, which necessitates the optimal adjustment of a low-pass filter from an infinite number of available filters.
The extraction step (22) also comprises a truncation sub-step during which the first 4 DCT coefficients are completed by 4 zero coefficients so as to deliver a segment of truncated DCT coefficients. This truncation sub-step is in a way similar to a low-pass filtering operation. In the correction step (23), the segments of truncated coefficients are then corrected so as to deliver a segment of corrected DCT coefficients comprising 4 corrected low-frequency DCT coefficients (Ybfc) and 4 corrected high-frequency DCT coefficients (Yhfc). In the combination step (24), the 4 original high-frequency coefficients and the segment of corrected DCT coefficients are combined so as to deliver a segment of combined DCT coefficients (Yadd).
In a particularly advantageous embodiment, the segment of combined DCT coefficients corresponds to the concatenation of the 4 corrected low-frequency DCT coefficients (Ybfc) and the 4 original high-frequency coefficients (Yhfo). In the preferred embodiment, the segment of combined DCT coefficients corresponds to the concatenation of the 4 corrected low-frequency DCT coefficients (Ybfc) and the 4 combined high-frequency DCT coefficients, resulting in a linear combination of the 4 corrected high-frequency DCT coefficients (Yhfc) and the 4 original high-frequency coefficients (Yhfo), namely:
Yhfadd=a.Yhfc+(1−b).Yhfo
where a and b are real values between 0 and 1, with, for example, a=1/2 and b=a/4 if Yhfc differs from 0 and b=1/2 if Yhfc is equal to 0. Such a combination gives more weight to the original high-frequency coefficients, if high frequencies appear in the corrected DCT coefficients, and introduces an attenuation in the opposite case.
The segment of combined DCT coefficients is finally transformed in the spatial domain via an IDCT transform, which delivers a segment of processed pixels (yout) for display on a screen.
The method of post-processing data also comprises at least a horizontal processing of an image, associated with at least a vertical processing of said image. Indeed, the blocking artifacts may be present at the borders of an encoding block, that is, in the four segments delimiting the block vertically or horizontally. If the image is processed horizontally, vertical blocking artifacts will be corrected; conversely, horizontal blocking artifacts will be corrected if the image is processed vertically. The method of post-processing data is successively applied to each of the two fields constituting a frame if the image is composed of two fields. It is preferably applied to luminance data in the digital image.
The correction step which is carried out is based on the numerous blocking artifact correction methods that are known to those skilled in the art, and preferably those methods that do not use decoding parameters, which parameters are not always accessible.
In the preferred embodiment, the data correction method is referred to as DFD method (DCT Frequency Deblocking). Such a data correction method comprises the following steps, shown in FIG. 3, namely:
    • a step of computing a first discrete cosine transform DCT1 (31) of a first segment (u) of N pixels, with N=8 in the example used, resulting in a first transformed segment U,
    • a step of computing a first discrete cosine transform DCT1 (32) of a second segment (v) of N pixels, which second segment is adjacent to the first, resulting in a second transformed segment V,
    • a step of determining (33) a predicted maximum frequency (kpred) as a function of the maximum frequencies ku and kv of U and V, as follows:
      kpred=2.max(ku,kv)+2
with ku=max(k∈{0, . . . ,N−1}/U(k)≠0),
    • kv=max(k∈{0, . . . ,N−1}/V(k)≠0), and
    • max is the function giving the maximum of k among a set of determined values,
    • a step of processing (35) a concatenated segment (w) comprising 2N pixels, i.e. 16 pixels in our case, and corresponding to the concatenation (34) of the first (u) and the second (v) segment, this processing step comprising the following sub-steps of:
      • computing a second discrete cosine transform DCT2 (36) of the concatenated segment (w), resulting in a transformed concatenated segment W,
      • correction (37) by setting those transformed data W(k) to zero that have an odd frequency k which is higher than the predicted maximum frequency (kpred), delivering a corrected transformed concatenated segment Wc,
    • computing an inverse discrete cosine transform IDCT2 (38) of the corrected transformed segment Wc, delivering a corrected concatenated segment (cw).
In a preferred embodiment of the invention, filtering thresholds are introduced in accordance with the following principle:
kumax=max(k∈{0, . . . ,N−1}/abs(U(k))>T)
kvmax=max(k∈{0, . . . ,N−1}/abs(V(k))>T)
where T is a threshold different from zero.
In the determination step (33), a more precise predicted maximum frequency (kpred) is computed from the introduction of the threshold T, which allows a more effective correction of the blocking artifacts. The value of the threshold T is a function of the size of the segments u and v. Indeed, a part solely consisting of pixels of the segments u and v may be processed, for example, the pixels of either the even or the odd rows.
The correction step COR (37) preferably comprises a sub-step of detecting natural contours from the values of the pixels of the initial segments u and v and the transformed segments U and V. This sub-step allows distinction of the natural contours of the blocking artifacts. A natural contour is detected if two conditions are met:
    • the average values of the pixels of the segments u and v on both sides of a border between blocks differ by a considerable value which is higher than a predetermined threshold M,
    • the segments u and v have a low spatial activity, which becomes manifest by the fact that the values ku and kv are small and less than a predetermined value k0.
FIG. 4 is a diagram showing an embodiment of the method of post-processing data according to the invention, including the DFD method of correcting blocking artifacts as described with reference to FIG. 3. Such a method of post-processing video data comprises the steps of:
    • DCT transform (41), suitable for delivering a first segment of DCT coefficients (U) from a first set of pixels (u),
    • DCT transform (42), suitable for delivering a second segment of DCT coefficients (V) from a second set of pixels (v) adjacent to the first segment of pixels,
    • extracting (43) first original low-frequency coefficients (Ubfo) and first original high-frequency coefficients (Uhfo) comprised in the first segment of DCT coefficients (U), suitable for delivering a first segment of truncated DCT coefficients (Ut) comprising the first original low-frequency coefficients,
    • extracting (44) second original low-frequency coefficients (Vbfo) and second original high-frequency coefficients (Vhfo) comprised in the second segment of DCT coefficients (V), suitable for delivering a second segment of truncated DCT coefficients (Vt) comprising the second original low-frequency coefficients,
    • correction (23), suitable for delivering a first and a second segment of corrected DCT coefficients (Uc,Vc, respectively) from the first and second original low-frequency coefficients (Ubfo,Vbfo, respectively), comprising the sub-steps of:
      • IDCT transform (231) of the first segment of truncated DCT coefficients (Ut), intended to deliver a first segment of a preprocessed pixel (ut),
      • IDCT transform (232) of the second segment of truncated DCT coefficients (Vt), intended to deliver a second segment of a preprocessed pixel (vt),
      • DFD correction (230) of the segments of preprocessed pixels in accordance with the principle described with reference to FIG. 3, suitable for delivering segments of corrected pixels (uc,vc),
      • DCT transform (233) of the first segment of corrected pixels (uc), suitable for delivering a first segment of corrected DCT coefficients (Uc),
      • DCT transform (234) of the second segment of corrected pixels (vc), suitable for delivering a second segment of corrected DCT coefficients (Vc),
    • combination (45), suitable for delivering a first segment of combined DCT coefficients (Uadd) from the first original high-frequency coefficients (Uhfo) and the first segment of corrected DCT coefficients (Uc),
    • combination (46), suitable for delivering a second segment of combined DCT coefficients (Vadd) from the second original high-frequency coefficients (Vhfo) and the second segment of corrected DCT coefficients (Vc),
    • IDCT transform (47) of the first segment of combined DCT coefficients (Uadd), suitable for delivering a first segment of processed pixels (uout) for display on a screen, and
    • IDCT transform (48) of the second segment of combined DCT coefficients (Vadd), suitable for delivering a second segment of processed pixels (vout), adjacent to the first segment of processed pixels (uout), for display on a screen.
The post-processing method described with reference to FIG. 4 has the advantage that it does not degrade the quality of the images that do not originally comprise any blocking artifacts. Indeed, in the presence of such images, the original low-frequency coefficients are not subjected to any modification because the DFD correction method used and the combined high-frequency DCT coefficients remain identical to the original high-frequency coefficients. In the prior-art technique, the use of a low-pass filter in the spatial domain may, on the other hand, lead to a degradation of the quality of an image that does not originally comprise any blocking artifact.
The invention may be realized in the form of software embedded on one or several circuits performing the method of post-processing data described hereinbefore, or in the form of items of hard ware. A device for post-processing digital images, corresponding to said method, is represented again by the functional blocks of FIG. 2. It comprises:
    • frequency transformation means TF (21), suitable for delivering a set of decoded transformed coefficients (Y) from a set of pixels (y),
    • means SEP (22) for extracting original low-frequency coefficients (Ybfo) and original high-frequency coefficients (Yhfo) comprised in the set of transformed coefficients,
    • correction means COR (23), suitable for delivering a set of corrected transformed coefficients (Yc) from the original low-frequency coefficients, and
    • combination means (24), suitable for delivering a set of combined transformed coefficients (Yadd) from the original high-frequency coefficients and from the set of corrected transformed coefficients, and
    • means ITF (25) for inverse frequency transformation of the set of combined transformed coefficients, suitable for delivering a set of processed pixels (yout) that are ready for display on a screen.
Such a post-processing device can be inserted between a video decoder and a television receiver in order to post-process decoded digital images and to display the post-processed digital images on the television receiver. Such a device can be built independently. It can also be part of the video decoder or of the television receiver.
There are numerous ways of implementing the previously described functions by means of software. In this respect, FIGS. 2 to 4 are very diagrammatic. Therefore, although a Figure shows different functions in the form of separate blocks, it does not exclude the fact that a single piece of software performs several functions. This neither excludes the fact that a function can be performed by a set of software. It is possible to implement these functions by means of a suitably programmed video decoder circuit, a set top box, or a television receiver. A set of instructions comprised in a programming memory may cause the circuit to perform the different operations described hereinbefore with reference to FIGS. 2 and 4. The set of instructions may also be loaded into the programming memory by reading a record carrier such as, for example, a disc comprising the set of instructions. Reading may alternatively be effected through a communication network such as, for example, the Internet. In this case, a service provider will put the set of instructions at the disposal of those interested.
Any reference sign placed between parentheses in this text shall not be construed as limiting the claim. Use of the verb “comprise” and its conjugations does not exclude the presence of elements or steps other than those stated in the claims. Use of the article “a” or “an” preceding an element or a step does not exclude the presence of a plurality of such elements or steps.

Claims (11)

1. A method of post-processing digital images comprising pixels, the method comprising the acts of:
frequency transforming a set of the pixels to a set of transformed coefficients,
extracting original low-frequency coefficients and original high-frequency coefficients from the set of transformed coefficients,
correcting the original low-frequency coefficients for delivering a set of corrected transformed coefficients including corrected low-frequency coefficients, and
combining the set of corrected transformed coefficients and the original high-frequency coefficients for delivering a set of combined transformed coefficients by giving more weight to the original high-frequency coefficients if high frequencies appear in the set of corrected transformed coefficients, and introducing an attenuation to the original high-frequency coefficients if the high frequencies do not appear in the set of corrected transformed coefficients.
2. The method of claim 1, wherein the extracting act is suitable for extracting a first half of the set of transformed coefficients as being the original low-frequency coefficients and a second half of the set of transformed coefficients as being the original high-frequency coefficients.
3. The method of claim 1, wherein the combining act is suitable for linearly combining corrected high-frequency coefficients included in the set of corrected transformed coefficients and the original high-frequency coefficients so as to deliver the set of combined transformed coefficients.
4. A device for post-processing digital images comprising pixels, the device comprising:
frequency transformation means for transforming a set of the pixels to a set of transformed coefficients,
means for extracting original low-frequency coefficients and original high-frequency coefficients from the set of transformed coefficients,
correction means for correcting the original low-frequency coefficients for delivering a set of corrected transformed coefficients including corrected low-frequency coefficients, and
combination means for combining the set of corrected transformed coefficients and the original high-frequency coefficients to deliver a set of combined transformed coefficients by giving more weight to the original high-frequency coefficients if high frequencies appear in the set of corrected transformed coefficients, and introducing an attenuation to the original high-frequency coefficients if the high frequencies do not appear in the set of corrected transformed coefficients.
5. A video decoder adapted to deliver decoded digital images and comprising a post-processing device as claimed as in claim 4, suitable for post-processing the decoded digital images in order to deliver post-processed digital pictures.
6. A television receiver adapted to receive digital images and comprising a post-processing device as claimed as in claim 4, suitable for post-processing the digital picture in order to display post-processed digital pictures on a screen of the television receiver.
7. A computer readable storage medium embodying a computer program product for a video decoder comprising a set of instructions which, when loaded into the video decoder, causes the video decoder to:
transform a set of pixels to a set of transformed coefficients;
extract original low-frequency coefficients and original high-frequency coefficients from the set of transformed coefficients;
correct the original low-frequency coefficients for delivering a set of corrected transformed coefficients including corrected low-frequency coefficients; and
combine the set of corrected transformed coefficients and the original high-frequency coefficients for delivering a set of combined transformed coefficients by giving more weight to the original high-frequency coefficients if high frequencies appear in the set of corrected transformed coefficients, and by introducing an attenuation to the original high-frequency coefficients if the high frequencies do not appear in the set of corrected transformed coefficients.
8. The device of claim 4, wherein the means for extracting extract a first half of the set of transformed coefficients as being the original low-frequency coefficients and a second half of the set of transformed coefficients as being the original high-frequency coefficients.
9. The device of claim 4, wherein the combination means linearly combine corrected high-frequency coefficients included in the set of corrected transformed coefficients and the original high-frequency coefficients so as to deliver the set of combined transformed coefficients.
10. The computer readable storage medium of claim 7, wherein the set of instructions which, when loaded into the video decoder, causes the video decoder to extract a first half of the set of transformed coefficients as being the original low-frequency coefficients and a second half of the set of transformed coefficients as being the original high-frequency coefficients.
11. The computer readable storage medium of claim 7, wherein the set of instructions which, when loaded into the video decoder, causes the video decoder to linearly combine corrected high-frequency coefficients included in the set of corrected transformed coefficients and the original high-frequency coefficients so as to deliver the set of combined transformed coefficients.
US10/474,112 2001-04-10 2002-04-08 Method and device for post-processing digital images Expired - Fee Related US7373010B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR0104862A FR2823338A1 (en) 2001-04-10 2001-04-10 Digital MPEG post processing having frequency transformation step providing transformed coefficient assembly with original base/high frequency coefficients extracted/correction step carried out/combined transformed coefficients produced.
FR0104862 2001-04-10
PCT/IB2002/001250 WO2002084593A2 (en) 2001-04-10 2002-04-08 Method and device for post-processing digital images

Publications (2)

Publication Number Publication Date
US20040105592A1 US20040105592A1 (en) 2004-06-03
US7373010B2 true US7373010B2 (en) 2008-05-13

Family

ID=8862153

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/474,112 Expired - Fee Related US7373010B2 (en) 2001-04-10 2002-04-08 Method and device for post-processing digital images

Country Status (6)

Country Link
US (1) US7373010B2 (en)
EP (1) EP1380010A2 (en)
KR (1) KR100871998B1 (en)
CN (1) CN1268132C (en)
FR (1) FR2823338A1 (en)
WO (1) WO2002084593A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050100239A1 (en) * 2003-10-15 2005-05-12 Ntt Docomo, Inc Image signal processing method, image signal processing apparatus, and image signal processing program
US20100135589A1 (en) * 2008-03-12 2010-06-03 Megachips Corporation Image processor

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150090515A (en) * 2014-01-29 2015-08-06 삼성전자주식회사 Method and apparatus for image quality enhancement using phase modulation of high frequency element
US10702115B2 (en) * 2015-09-28 2020-07-07 Pogo International Limited Surface treating machine with automatic drive

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5109451A (en) * 1988-04-28 1992-04-28 Sharp Kabushiki Kaisha Orthogonal transform coding system for image data
WO1997029594A1 (en) 1996-02-08 1997-08-14 Sony Electronics, Inc. Method and apparatus for the reduction of blocking effects in images
US5737450A (en) * 1995-05-15 1998-04-07 Polaroid Corporation Method and apparatus for fast two-dimensional cosine transform filtering
US5737019A (en) * 1996-01-29 1998-04-07 Matsushita Electric Corporation Of America Method and apparatus for changing resolution by direct DCT mapping
US5774599A (en) * 1995-03-14 1998-06-30 Eastman Kodak Company Method for precompensation of digital images for enhanced presentation on digital displays with limited capabilities
US5870505A (en) * 1996-03-14 1999-02-09 Polaroid Corporation Method and apparatus for pixel level luminance adjustment
US5920654A (en) * 1991-08-23 1999-07-06 Mitsubishi Denki Kabushiki Kaisha Image processing system that includes discrimination of an interpolation direction

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2305829B (en) * 1994-09-20 1997-10-22 Ricoh Kk A coder
US6141446A (en) 1994-09-21 2000-10-31 Ricoh Company, Ltd. Compression and decompression system with reversible wavelets and lossy reconstruction
KR0165497B1 (en) * 1995-01-20 1999-03-20 김광호 Post processing apparatus and method for removing blocking artifact

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5109451A (en) * 1988-04-28 1992-04-28 Sharp Kabushiki Kaisha Orthogonal transform coding system for image data
US5920654A (en) * 1991-08-23 1999-07-06 Mitsubishi Denki Kabushiki Kaisha Image processing system that includes discrimination of an interpolation direction
US5774599A (en) * 1995-03-14 1998-06-30 Eastman Kodak Company Method for precompensation of digital images for enhanced presentation on digital displays with limited capabilities
US5737450A (en) * 1995-05-15 1998-04-07 Polaroid Corporation Method and apparatus for fast two-dimensional cosine transform filtering
US5737019A (en) * 1996-01-29 1998-04-07 Matsushita Electric Corporation Of America Method and apparatus for changing resolution by direct DCT mapping
WO1997029594A1 (en) 1996-02-08 1997-08-14 Sony Electronics, Inc. Method and apparatus for the reduction of blocking effects in images
US5881180A (en) * 1996-02-08 1999-03-09 Sony Corporation Method and apparatus for the reduction of blocking effects in images
US5870505A (en) * 1996-03-14 1999-02-09 Polaroid Corporation Method and apparatus for pixel level luminance adjustment

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050100239A1 (en) * 2003-10-15 2005-05-12 Ntt Docomo, Inc Image signal processing method, image signal processing apparatus, and image signal processing program
US20100135589A1 (en) * 2008-03-12 2010-06-03 Megachips Corporation Image processor
US8204342B2 (en) * 2008-03-12 2012-06-19 Megachips Corporation Image processor

Also Published As

Publication number Publication date
WO2002084593A2 (en) 2002-10-24
FR2823338A1 (en) 2002-10-11
EP1380010A2 (en) 2004-01-14
KR20030014699A (en) 2003-02-19
CN1478252A (en) 2004-02-25
WO2002084593A3 (en) 2003-10-02
CN1268132C (en) 2006-08-02
KR100871998B1 (en) 2008-12-05
US20040105592A1 (en) 2004-06-03

Similar Documents

Publication Publication Date Title
US7620261B2 (en) Edge adaptive filtering system for reducing artifacts and method
EP1698164B1 (en) Directional video filters for locally adaptive spatial noise reduction
US5819035A (en) Post-filter for removing ringing artifacts of DCT coding
US7778480B2 (en) Block filtering system for reducing artifacts and method
EP0781053B1 (en) Method and apparatus for post-processing images
JP3308921B2 (en) Video data loop filtering method and apparatus
US6370192B1 (en) Methods and apparatus for decoding different portions of a video image at different resolutions
US7373013B2 (en) Directional video filters for locally adaptive spatial noise reduction
EP0680219B1 (en) Improved post-processing method for use in an image signal decoding system
JP2001522172A (en) Video data post-processing method and apparatus for reducing quantization effect and recording medium recording the same
WO2007041326A2 (en) System and method of spatio-temporal edge-preserved filtering techniques to reduce ringing and mosquito noise of digital pictures
WO1997040627A1 (en) Method and apparatus for blocking effect reduction in images by post-processing in the spatial domain
US20090080517A1 (en) Method and Related Device for Reducing Blocking Artifacts in Video Streams
EP0714210B1 (en) Method of reducing mosquito noise generated during decoding process of image data and device for decoding image data using the same
WO1997034422A1 (en) Method and apparatus for blocking effect reduction in images
EP1439711A2 (en) Method for blocking artifact reduction
EP1135749B1 (en) Device and method for filtering
WO2002096117A1 (en) Deblocking block-based video data
US7373010B2 (en) Method and device for post-processing digital images
EP1169868B1 (en) Method of reducing blocking artifacts
EP1570678B1 (en) Method of measuring blocking artefacts
US20030072377A1 (en) Method of detecting blocking artifacts
JP3233999B2 (en) Image signal decoding device
EP1520429A2 (en) Method of detecting blocking artefacts
KR100217148B1 (en) Method of reducing mosquito noise generated during decoding process of image data and device for decoding image data using the same

Legal Events

Date Code Title Description
AS Assignment

Owner name: KONINKLIJKE PHILIPS ELECTRONICS N.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LESELLIER, ESTELLE;CAVIEDES, JORGE E.;MIRO SOROLLA, CAROLINA;REEL/FRAME:014985/0821

Effective date: 20021105

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20120513