WO2008075261A1 - Automatic noise reduction improvement in video sequences - Google Patents
Automatic noise reduction improvement in video sequences Download PDFInfo
- Publication number
- WO2008075261A1 WO2008075261A1 PCT/IB2007/055056 IB2007055056W WO2008075261A1 WO 2008075261 A1 WO2008075261 A1 WO 2008075261A1 IB 2007055056 W IB2007055056 W IB 2007055056W WO 2008075261 A1 WO2008075261 A1 WO 2008075261A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- noise reduction
- frames
- frame
- noise
- mpeg
- Prior art date
Links
- 230000009467 reduction Effects 0.000 title claims abstract description 104
- 230000006872 improvement Effects 0.000 title description 2
- 238000000034 method Methods 0.000 claims description 35
- 230000002123 temporal effect Effects 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 8
- 238000005259 measurement Methods 0.000 claims description 8
- 230000007423 decrease Effects 0.000 claims description 3
- 238000004422 calculation algorithm Methods 0.000 description 21
- 230000006835 compression Effects 0.000 description 8
- 238000007906 compression Methods 0.000 description 8
- 230000003044 adaptive effect Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000005086 pumping Methods 0.000 description 5
- 238000001914 filtration Methods 0.000 description 4
- 230000001965 increasing effect Effects 0.000 description 3
- 238000013139 quantization Methods 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 108091026890 Coding region Proteins 0.000 description 1
- 101000946275 Homo sapiens Protein CLEC16A Proteins 0.000 description 1
- 102100034718 Protein CLEC16A Human genes 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000021615 conjugation Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000796 flavoring agent Substances 0.000 description 1
- 235000019634 flavors Nutrition 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
-
- G06T5/70—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20182—Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
Definitions
- This invention relates generally to video signal processing and more particularly to improved methods of and systems for noise reduction in a video signal.
- the invention also relates to a device comprising a system for noise reduction in a video signal.
- the signal is comprised of intracoded and intercoded frames, for instance I-frames, P-frames and B-frames.
- the I-frames are intra-coded.
- the P- and B-frames are referred to as intercoded frames.
- Intra-code frames can be reconstructed without any reference to other frames; intercoded frames are reconstructed using data of other frames (forward or backward prediction).
- Image signals are commonly encoded digitally for transmission and then decoded for display.
- the Motion Pictures Experts Group is an ISO group that sets standards (MPEG standards) for compressing and storing video, audio and animation in digital form.
- MPEG-I is a standard audio and video coding format for low density storage media such as CD-ROMs video CDs and so forth.
- MPEG-2 is a standard coding format for broadcast video.
- the compression method involves I-frames or intra frames.
- a frame refers to a complete TV picture. It can be made up of multiple fields, such as a field of odd numbered lines and a field of even-numbered lines.
- An I-frame is an intra-coded video frame that is independent of other video frames in MPEG standard.
- I-frames are repeated at a regular interval to refresh the coding sequence. Between any two I-frames are P-frames (Predictive frames) and B-frames (Bi-directional predictive frames). The P-and B-frames only contain information or changes between the I-frames. An I-frame and its P-and B- frames are called a GOP (Group of Pictures).
- the video sequence is composed of groups of pictures (GOP 's) that follow one after the other.
- the invention is not restricted to MPEG, and could be used in other standards using intracoded and intercoded frames, such as DivX and Xvid.
- Video compression methods are lossy compression methods.
- the display can develop undeliverable characteristics. For example, when a portion of an image has saturated colors, that portion of the image can experience significant enhancement of noise when conventional filters are applied to peak the image. This can be particularly true of blue sections of an image, to which the eye is most sensitive.
- noise typically involve some type of noise component.
- the noise can be present in the actual video signal.
- Noise can also be introduced by processing circuitry, such as at the encoder, decoder, transmitter, analog-digital converter (ADC), digital-analog converter (DAC) and so forth.
- ADC analog-digital converter
- DAC digital-analog converter
- Noise reduction methods applied at the decoding end are known to reduce noise in the displayed video image.
- Such noise reduction algorithms typically comprise spatial or local recursive noise reduction algorithms.
- Conventional algorithms apply an average noise reduction (filter) strength in the noise reduction algorithms.
- a method and apparatus for noise reduction of a sequence of video frames is provided.
- the method in accordance with the invention is a method for noise reduction in a video signal comprising groups of intra and intercoded frames wherein to the frames of the video sequence a noise reduction is applied wherein the noise reduction has a noise reduction strength and the noise reduction strength has a modulation in time with a period substantially equal to the period between intra coded frames, wherein a maximum in the modulation substantially coincides with a intra coded frame.
- the system in accordance with the invention is a system for noise reduction in a video signal comprising groups of intra and intercoded frames wherein the system comprises a noise reductor to apply to the frames of the video sequence a noise reduction wherein the noise reductor is arranged such that the noise reduction has a noise reduction strength and the noise reduction strength has a modulation in time with a period substantially equal to the period between intra coded frames, wherein a maximum in the modulation substantially coincides with a intra coded frame.
- the invention is based on the following insight: When a scene is compressed with algorithms like for instance MPEG compression the signal to noise ratio starts modulating with the I-frames (I-frame pumping), as the P-, and B-frames are implicitly filtered stronger during reconstruction in the decoder.
- I-frame pumping I-frame pumping
- I-frames compared to intercoded frames such as P-/B-frames.
- Intracoded I-frames will contain more noise and quantization artifacts then the intercoded P- and B-frames because the latter two frame-types, being intercoded frame types, have been interpolated hence filtered stronger during reconstruction in the decoder.
- I-frame intracoded frames
- P-/B-frames intracoded frames
- I-frames will contain more noise and quantization artifacts then the P- and B-frames because the latter two frame-types have been interpolated hence filtered stronger during reconstruction in the decoder.
- the noise is peaked at the I-frame.
- I-frame pumping i.e. the noise is pumped at the I-frames.
- an average (temporal or spatial) noise reduction factor is used in a noise reduction algorithm, averaging the noise reduction of a sequences of frames, thus comprising intracoded as well as intercoded frame, the required noise reduction strength is underestimated for intracoded frames and for the intracoded frames too much noise passes the noise filter formed by the noise reduction algorithm.
- the invention is not restricted to a particular type of noise reduction, but it is in particular advantageous when use is made of recursive noise reduction and loop systems for recursive noise reduction.
- Noise reduction algorithm include within the framework of the invention algorithms to prevent noise from occurring. Coring, a method to prevent sharpening/enhancing noise is an example of such noise preventing algorithms. Likewise “noise reduction' as a method step includes method steps aimed at preventing noise from arising, such methods including coring.
- the invention accordingly comprises the several steps and the relation of one or more of such steps with respect to each of the others, and any method, system, device and computer program adapted to effect or resulting from such steps, all as exemplified in the following detailed description and drawings and the scope of the invention will be indicated in the claims.
- Figs. Ia and Ib show a number of frames in MPEG display order and MPEG transfer order respectively.
- Fig. 2 shows an unfiltered MPEG artifact meter output plotted along a temporal axis.
- Fig. 3 illustrates a modulated noise reduction strength
- Fig. 4 shows unfiltered (or weakly filtered) Mu and filtered Mf MPEG artifact meter data.
- Fig. 5 shows unfiltered (or weakly filtered) Mu and filtered MfMPEG meter data and the confidence factor C.
- Fig. 6 schematically shows temporal recursive noise reduction.
- Fig. 7 schematically shows spatial recursive noise reduction.
- FIG. 8 schematically shows a device in accordance with the invention
- Figs. Ia and Ib illustrate sequences of MPEG frames.
- Fig. Ia illustrates the MPEG display order.
- the I-frames are infra coded frames, i.e. they can be reconstructed without any reference to other frames.
- the P-frames are forward predicted from the last I- frame or P-frame, so it is impossible to reconstruct them without the data of another frame (I or P).
- the B frames are forward en backward predicted from the last/next I-frame or P-frame.
- P-frames and B-frames are referred to as inter coded frames.
- the frame for backward prediction follows the predicted frame.
- Fig. Ib illustrates an MPEG coded sequence.
- the frames appear in such an order (I P B B B P B B B I P B B B P B B B I etc.) that the referred to frames precede the referring frames.
- the only task of the decoder is to reorder the reconstructed frames.
- MPEG DO stands for MPEG Display Order
- MPEG TO stands for MPEG Transfer Order.
- Ti denotes the period of a GOP (group of pictures). The intraframes are in time separated by T 1 . Ti is below also called the GOP interval.
- Video signals typically involve some type of noise component.
- the noise can be present in the actual video signal.
- Noise can also be introduced by processing circuitry, such as at the encoder, decoder, transmitter, analog-digital converter (ADC), digital-analog converter (DAC) and so forth.
- ADC analog-digital converter
- DAC digital-analog converter
- the inventor has realized that when a scene is compressed with algorithms like MPEG compression the signal to noise ratio starts modulating with the intracoded I- frames (in this application the word I-frame pumping is used to describe this effect), because the intercoded P-, and B-frames are implicitly filtered stronger during reconstruction in the decoder.
- I-frames intracoded frames
- P -/B-frames intercoded frames
- MPEG artifact meters exist that with some filtering produce a value representative for the average amount of MPEG compression artifacts.
- the MPEG meter is evaluated temporally unfiltered, then in the temporal domain a clear peaked pattern can be seen with its peaks coinciding with the I-frames. This effect is shown in Fig. 2 where M u is the unfiltered MPEG meter output is plotted along a temporal axis. Analysis of this 'beat' allows predicting when an I-frame will occur because MPEG streams are mostly coded with a fixed GOP interval T 1 .
- noise reduction includes method to prevent noise such as coring, a method to prevent sharpening/enhancing noise. Such methods are performed by or via algorithms. In such algorithms the coring strength is a parameter of the algorithm In coring methods in accordance with the invention a modulated coring strength is applied to I- frames stronger than to P and B-frames.
- the position of the I-frames can be found by measuring the cadence in the artifacts.
- Advanced high end market digital set-top boxes include image processing algorithms that provide for the location of the I-frames. The location of the I-frames is then known and need not be found separately.
- Fig. 3 illustrates that in the invention the intracoded I-frames are filtered stronger then the other frames.
- the image is valid for all types of noise reduction.
- NR stands for the noise reduction strength.
- the dotted line in Fig. 3 shows a steady reduction strength NR.
- the continuous line shows the modulated reduction strength with its peaks coinciding with the I-frames of the decoded MPEG stream.
- the average of the continuous line over one GOP-period can be equal to the level of the conventional steady reduction (dotted line) so the integral amount of reduction is still the same while the visual effect is better.
- the modulation D on NR is in the time domain, with a period T 1; equal to the I-frame period (GOP).
- Noise reduction is modulated such that an I-frame is filtered stronger then the P-, and B-frames. On the noise filtered output this will give more weight to the relatively cleaner P- and B-frames compared to the I-frames.
- the modulation depth is the ratio between the higher noise reduction levels at the I-frame over the lower noise reduction levels at the P- and B-frames.
- the average amount of noise reduction is kept the same, such that a modulation does not change the noise reduction on average.
- the average of noise reduction on the I-frame and the P- and B-frames must be equal such that
- ⁇ NR a NR ⁇ + ⁇ NR m
- NRu un-modulated noise reduction
- NR m modulated noise reduction
- I stands for the intracoded frames
- B+P for the intercoded frames.
- the amount of extra noise reduction on the I-frames is in preferred embodiments compensated by applying less noise reduction on the P- and B-frames to keep the average over the GOP at the same level.
- the relation can be formulated as follows:
- NR m ' NR u + NR u - (D -I)IA
- NR m P B NR 11 - NR 11 (D - 1) /(A - (GOP - 1))
- A as the accuracy ⁇ D and NR U as the unmodulated noise reduction and GOP is the number of frames in a GOP.
- P and B frames are treated equally.
- the modulation depth D can be calculated from several statistics. An important parameter may be the confidence factor C. If not confident about the I-frame beat (C -> O) then D should be 1 or very close to 1, e.g. no modulation to very little modulation. The influence of C can be controlled too.
- a dark scene can be evaluated in many smart ways with help of stochastic distributions and their deviations, relevance related to the size of dark surfaces, ignoring of sub-black levels etc. or in a simple way as the average luminance value of the image. Given here is that we know how dark the image is, expressed as Y. With this determined the modulation depth D can be slightly increased too when Y decreases.
- ⁇ is the amount of influence of C
- ⁇ > 1 is the inverse amount of influence of Y
- NR U there needs to be a sufficient amount of NR U to work with. Most digital signals have hardly to any analogue noise at all. So any conventional automatic analogue noise reduction algorithm would have set the amount of NR U to a low level because of low analogue noise levels.
- the NR U mentioned here preferably is a function of the conventional evaluated noise reduction level and a new evaluation of the noise reduction level based on MPEG measurement.
- NR u f(NR a ,NR d )
- NRa being the noise reduction level based on analogue noise measurement
- NRj being the un-modulated noise reduction level based on the filtered MPEG measurement M f .
- a conventional MPEG artifact meter or any meter capable of measuring artifacts or noise in a frame is a conventional MPEG artifact meter or any meter capable of measuring artifacts or noise in a frame.
- Embedded processor able to perform video frame synchronized calculations.
- An MPEG artifact meter produces a temporally unfiltered (or weakly filtered) and normalized measurement M u.
- An MPEG artifact meter produces a temporally filtered and normalized measurement M f.
- the unfiltered (or weakly filtered) M u and filtered MPEG meter data Mf looks like Fig. 4.
- Ti is the repetition period (GOP) of the I-frame. The occurrences of I-frames coincide with the peak in the unfiltered measurement M u .
- the modulation depth of the modulation has to be provided. This modulation depth can be provided in several manners. A simple one is a standard modulation depth related to the average value. The modulation depth is then not determined separately but follows from the average value. This can be a standard percentage modulation of the average value or a more complex, for instance non- linear function of the average value. The modulation depth may also be made dependent on the darkness of the shot.
- the modulation depth is, at least for a range of average image intensities a decreasing function for increasing average image intensity.
- the modulation depth D increases for relatively dark scenes where errors are more clearly visible.
- the dependence on image intensity may be such that above a certain intensity level no modulation or a very simple type of modulation is used, not dependent on image intensity, whereas below a threshold image intensity a dependence of the modulation depth on intensity is used, which becomes more complex as the intensity goes down.
- Additional values for determining the modulation depth may be provided as follows.
- a confidence counter C can be increased (Fig. 5).
- a confidence counter can be decreased.
- J is a constant to be added when the event coincides with an I-frame peak in the MPEG meter.
- Fig. Mf shows the diagram of temporal recursive noise reduction.
- the local adaptive mixer compares the image to the previous image and calculates filter strength for each pixel. The result is stored in a frame memory so this result can be used for filtering the next image.
- the trick of the trade is to adjust the local adaptive mixer such that a proper balance is made in the recursion factor such that the filtering is strong enough to reduce noise and MPEG artifacts, but does not introduce too much (motion) artifacts.
- the noisier I-frame may break through the dynamic threshold of the temporal recursive noise reduction processor.
- the result is that the I-frame's extra noise ends up in the recursive path. This will result in just propagating the noise of the I-frame into the following B-frames.
- the effect of temporal recursive noise reduction is then less effective or even counter effective if not implemented and programmed exactly as a stable closed loop system.
- the data stream is analyzed in e.g. an MPEG artifact meter (MPEG AM) which provides for a measure of Mf, the cadence, i.e.
- MPEG AM MPEG artifact meter
- the MPEG AM is an artifact meter that has an output for indicating the position of an intraframe (I-frame).
- the data coming from the artifact meter are used to control the local adaptive filter in the recursive noise reduction loop RNRL (or more generally any device and method in which the noise reduction is made to run in sync with the GOP frames with a maximum on the intraframes) which is schematically indicated in the dotted rectangle.
- This loop RNRL forms a noise reductor to reduce the noise in the GOP frames.
- Fig. 7 shows the diagram of spatial noise reduction.
- Spatial noise reduction is like temporal noise reduction based on a local adaptive filter too. But in stead of comparing a pixel with a pixel from a previous (recursive) frame a pixel is compared to other pixels in its direct neighborhood. This is done in a spatial correlation local adaptive filter SCLAF The trick of the trade is to adjust the local adaptive filter such that the filtering is strong enough to reduce noise and MPEG, but does not wash out too many details in the image.
- the embodiment provides for an MPEG Fig. Mf and a confidence factor C.
- Conventional methods only have a filtered MPEG Fig. to set temporally averaged filter strength to the noise reduction functions. It is remarked that motion can be used to determine a dynamic ratio between temporal noise reduction for still images, and spatial noise reduction for moving images.
- Advanced high end market digital set-top boxes include comparable image processing algorithms as a television.
- this invention is applied in such a device then the cadence does not need to be 'looked for'. The location of the I-frames is given. So the confidence factor C is maximal and does not need to be determined.
- the invention is also embodied in any device using the method or system in accordance with the invention, such devices including, without being restricted to television receivers, advanced digital content players and receivers/decoders.
- the invention can also be used in or for software/GPU video render applications and algorithms on any computer platform. All of these devices received data streams comprising intra and inter- frames. The problem of a cadence in the artifacts occurs. For all such devices the invention is useful.
- Fig. 8 schematically show a device.
- the device has a receiver for receiving a signal (signal in) having intra and intercoded frames.
- the device comprises a system (which could be in hardware or in software or in a combination of hard and software) for applying a noise reduction (wherein "noise-reduction” may be noise-prevention) that is in cadence with the intraframes and has maximum at the intraframes.
- the noise reduced output signal is sent or internally transferred to a display part for displaying the images on a display D.
- a noise reduction is applied to a video signal comprising groups (GOP) of intra (I-frame) and intercoded frames (P-frame, B-frame) .
- the strength of the noise reduction strength has a modulation in time with a period substantially equal to the period (Ti) between intra coded frames.
- the noise reduction strength has a maximum substantially coinciding with the position of intra coded frames.
- the invention is also embodied in any computer program comprising program code means for performing a method in accordance with the invention when said program is run on a computer as well as in any computer program product comprising program code means stored on a computer readable medium for performing a method in accordance with the invention.
- Computer program products can for instance include a graphic processor for a game-console.
- redactor and reduction loop calculator etc. should be broadly understood to comprise e.g. any piece of hard- ware (such as a redactor or reduction loop, etc.), any circuit or sub-circuit designed for performing or aiding in a reduction or in a loop etc. as described as well as any piece of soft-ware (computer program or sub program or set of computer programs, or program code(s)) designed or programmed to perform an action in accordance with the invention as well as any combination of pieces of hardware and software acting as such, without being restricted to the below given exemplary embodiments.
- more than more than one element may be combined into one piece of hardware or software.
- One piece of software or hard ware may also perform more than one function.
Abstract
To a video signal comprising groups (GOP) of intra (I-frame) and intercoded frames (P-frame, B-frame) a noise reduction is applied. The strength of the noise reduction strength has a modulation in time with a period substantially equal to the period (Tl) between intra coded frames. The noise reduction strength has a maximum substantially co inciding with the position of intra coded frames.
Description
Automatic noise reduction improvement in video sequences
BACKGROUND OF THE INVENTION
This invention relates generally to video signal processing and more particularly to improved methods of and systems for noise reduction in a video signal.
The invention also relates to a device comprising a system for noise reduction in a video signal.
In video signal processing the signal is comprised of intracoded and intercoded frames, for instance I-frames, P-frames and B-frames. The I-frames are intra-coded. The P- and B-frames are referred to as intercoded frames. Intra-code frames can be reconstructed without any reference to other frames; intercoded frames are reconstructed using data of other frames (forward or backward prediction).
Image signals are commonly encoded digitally for transmission and then decoded for display. For example, the Motion Pictures Experts Group is an ISO group that sets standards (MPEG standards) for compressing and storing video, audio and animation in digital form. MPEG-I is a standard audio and video coding format for low density storage media such as CD-ROMs video CDs and so forth. MPEG-2 is a standard coding format for broadcast video. In MPEG, the compression method involves I-frames or intra frames. A frame refers to a complete TV picture. It can be made up of multiple fields, such as a field of odd numbered lines and a field of even-numbered lines. An I-frame is an intra-coded video frame that is independent of other video frames in MPEG standard. I-frames are repeated at a regular interval to refresh the coding sequence. Between any two I-frames are P-frames (Predictive frames) and B-frames (Bi-directional predictive frames). The P-and B-frames only contain information or changes between the I-frames. An I-frame and its P-and B- frames are called a GOP (Group of Pictures). The video sequence is composed of groups of pictures (GOP 's) that follow one after the other. The invention is not restricted to MPEG, and could be used in other standards using intracoded and intercoded frames, such as DivX and Xvid.
Many compression methods, such as MPEG compression methods, are lossy compression methods. When images are coded, decoded, and subjected to digital post processing, the display can develop undeliverable characteristics. For example, when a
portion of an image has saturated colors, that portion of the image can experience significant enhancement of noise when conventional filters are applied to peak the image. This can be particularly true of blue sections of an image, to which the eye is most sensitive.
Thus video signals typically involve some type of noise component. The noise can be present in the actual video signal. Noise can also be introduced by processing circuitry, such as at the encoder, decoder, transmitter, analog-digital converter (ADC), digital-analog converter (DAC) and so forth.
Noise reduction methods applied at the decoding end are known to reduce noise in the displayed video image. Such noise reduction algorithms typically comprise spatial or local recursive noise reduction algorithms. Conventional algorithms apply an average noise reduction (filter) strength in the noise reduction algorithms.
Although the conventional noise reduction methods for video sequences do provide a considerably reduction in noise, there remains a desire to improve the noise reduction.
Accordingly, it is desirable to provide improved methods and systems for noise reduction of video sequences.
SUMMARY OF THE INVENTION
Generally speaking, in accordance with the invention, a method and apparatus for noise reduction of a sequence of video frames is provided.
The method in accordance with the invention is a method for noise reduction in a video signal comprising groups of intra and intercoded frames wherein to the frames of the video sequence a noise reduction is applied wherein the noise reduction has a noise reduction strength and the noise reduction strength has a modulation in time with a period substantially equal to the period between intra coded frames, wherein a maximum in the modulation substantially coincides with a intra coded frame.
The system in accordance with the invention is a system for noise reduction in a video signal comprising groups of intra and intercoded frames wherein the system comprises a noise reductor to apply to the frames of the video sequence a noise reduction wherein the noise reductor is arranged such that the noise reduction has a noise reduction strength and the noise reduction strength has a modulation in time with a period substantially equal to the period between intra coded frames, wherein a maximum in the modulation substantially coincides with a intra coded frame.
The invention is based on the following insight:
When a scene is compressed with algorithms like for instance MPEG compression the signal to noise ratio starts modulating with the I-frames (I-frame pumping), as the P-, and B-frames are implicitly filtered stronger during reconstruction in the decoder.
If an image has been encoded and decoded than the noise may be worse on frames that were transmitted as intracoded frames, I-frames compared to intercoded frames such as P-/B-frames. Intracoded I-frames will contain more noise and quantization artifacts then the intercoded P- and B-frames because the latter two frame-types, being intercoded frame types, have been interpolated hence filtered stronger during reconstruction in the decoder.
If an image has been encoded and decoded than the noise may be worse on frames that were transmitted as intracoded frames, I-frame, compared to intracoded frames such as P-/B-frames. I-frames will contain more noise and quantization artifacts then the P- and B-frames because the latter two frame-types have been interpolated hence filtered stronger during reconstruction in the decoder. The noise is peaked at the I-frame. Herein below this effect will also be called I-frame pumping, i.e. the noise is pumped at the I-frames.
If an average (temporal or spatial) noise reduction factor is used in a noise reduction algorithm, averaging the noise reduction of a sequences of frames, thus comprising intracoded as well as intercoded frame, the required noise reduction strength is underestimated for intracoded frames and for the intracoded frames too much noise passes the noise filter formed by the noise reduction algorithm.
The invention is not restricted to a particular type of noise reduction, but it is in particular advantageous when use is made of recursive noise reduction and loop systems for recursive noise reduction.
When a signal with significant I-frame pumping is processed with a temporal recursive noise reduction algorithm then the noisier than average I-frame may break through the dynamic threshold of the temporal recursive noise reduction processor. The result is that the I-frame' s extra noise ends up in the recursive path of the loop system. This will result in just propagating the noise of the I-frame into the following B-frames. The effect of temporal recursive noise reduction is less effective or even counter effective if not implemented and programmed as a stable closed loop system.
"Noise reduction" algorithm include within the framework of the invention algorithms to prevent noise from occurring. Coring, a method to prevent sharpening/enhancing noise is an example of such noise preventing algorithms. Likewise
"noise reduction' as a method step includes method steps aimed at preventing noise from arising, such methods including coring.
The invention accordingly comprises the several steps and the relation of one or more of such steps with respect to each of the others, and any method, system, device and computer program adapted to effect or resulting from such steps, all as exemplified in the following detailed description and drawings and the scope of the invention will be indicated in the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
For a fuller understanding of the invention, reference is had to the following description, taken in connection with the accompanying drawings, in which:
Figs. Ia and Ib show a number of frames in MPEG display order and MPEG transfer order respectively.
Fig. 2 shows an unfiltered MPEG artifact meter output plotted along a temporal axis.
Fig. 3 illustrates a modulated noise reduction strength.
Fig. 4 shows unfiltered (or weakly filtered) Mu and filtered Mf MPEG artifact meter data.
Fig. 5 shows unfiltered (or weakly filtered) Mu and filtered MfMPEG meter data and the confidence factor C.
Fig. 6 schematically shows temporal recursive noise reduction.
Fig. 7 schematically shows spatial recursive noise reduction.
Fig. 8 schematically shows a device in accordance with the invention
The Figs, are not drawn to scale. Generally, identical components are denoted by the same reference numerals in the Figs.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Figs. Ia and Ib illustrate sequences of MPEG frames. Fig. Ia illustrates the MPEG display order. The I-frames are infra coded frames, i.e. they can be reconstructed without any reference to other frames. The P-frames are forward predicted from the last I- frame or P-frame, so it is impossible to reconstruct them without the data of another frame (I or P). The B frames are forward en backward predicted from the last/next I-frame or P-frame. P-frames and B-frames are referred to as inter coded frames. The frame for backward prediction follows the predicted frame. That would require, if the frames would be coded
according to the MPEG display order, to suspend the decoding the B-frames till the next P- or B-frame appears. Fig. Ib illustrates an MPEG coded sequence. In the data stream the frames appear in such an order (I P B B B P B B B I P B B B P B B B I etc.) that the referred to frames precede the referring frames. The only task of the decoder is to reorder the reconstructed frames. MPEG DO stands for MPEG Display Order, MPEG TO stands for MPEG Transfer Order. Ti denotes the period of a GOP (group of pictures). The intraframes are in time separated by T1. Ti is below also called the GOP interval.
It is remarked that everywhere in this document where the term MPEG is used also all other derivations of the MPEG compression are meant. (Examples: DivX, XVid, ASP etc.)
Video signals typically involve some type of noise component. The noise can be present in the actual video signal. Noise can also be introduced by processing circuitry, such as at the encoder, decoder, transmitter, analog-digital converter (ADC), digital-analog converter (DAC) and so forth.
The inventor has realized that when a scene is compressed with algorithms like MPEG compression the signal to noise ratio starts modulating with the intracoded I- frames (in this application the word I-frame pumping is used to describe this effect), because the intercoded P-, and B-frames are implicitly filtered stronger during reconstruction in the decoder.
If an image has been encoded and decoded than the noise may be worse on frames that were transmitted as intracoded frames (I-frames) compared to intercoded frames (P -/B-frames). Intracoded I-frames will contain more noise and quantization artifacts then the intercoded P- and B-frames because the latter two frame-types have been interpolated hence filtered stronger during reconstruction in the decoder.
MPEG artifact meters exist that with some filtering produce a value representative for the average amount of MPEG compression artifacts. However if the MPEG meter is evaluated temporally unfiltered, then in the temporal domain a clear peaked pattern can be seen with its peaks coinciding with the I-frames. This effect is shown in Fig. 2 where Mu is the unfiltered MPEG meter output is plotted along a temporal axis. Analysis of this 'beat' allows predicting when an I-frame will occur because MPEG streams are mostly coded with a fixed GOP interval T1.
For an I-frame the noise reduction (both temporal recursive and spatial) should be set stronger then on the P- and B-frames. This is the core of the invention. Within the framework of the invention "noise reduction" includes method to prevent noise such as
coring, a method to prevent sharpening/enhancing noise. Such methods are performed by or via algorithms. In such algorithms the coring strength is a parameter of the algorithm In coring methods in accordance with the invention a modulated coring strength is applied to I- frames stronger than to P and B-frames.
The position of the I-frames can be found by measuring the cadence in the artifacts. Advanced high end market digital set-top boxes include image processing algorithms that provide for the location of the I-frames. The location of the I-frames is then known and need not be found separately.
Fig. 3 illustrates that in the invention the intracoded I-frames are filtered stronger then the other frames. The image is valid for all types of noise reduction. NR stands for the noise reduction strength. The dotted line in Fig. 3 shows a steady reduction strength NR. The continuous line shows the modulated reduction strength with its peaks coinciding with the I-frames of the decoded MPEG stream. The average of the continuous line over one GOP-period can be equal to the level of the conventional steady reduction (dotted line) so the integral amount of reduction is still the same while the visual effect is better. The modulation D on NR is in the time domain, with a period T1; equal to the I-frame period (GOP). Noise reduction is modulated such that an I-frame is filtered stronger then the P-, and B-frames. On the noise filtered output this will give more weight to the relatively cleaner P- and B-frames compared to the I-frames.
The modulation depth is the ratio between the higher noise reduction levels at the I-frame over the lower noise reduction levels at the P- and B-frames. The average amount of noise reduction is kept the same, such that a modulation does not change the noise reduction on average. To keep the average amount of noise reduction the same for all modulation depths, the average of noise reduction on the I-frame and the P- and B-frames must be equal such that
∑NRa = NRΪ + ∑NRm
GOP B+P
with NRu = un-modulated noise reduction and NRm = modulated noise reduction, I stands for the intracoded frames and B+P for the intercoded frames.
In other words, the amount of extra noise reduction on the I-frames is in preferred embodiments compensated by applying less noise reduction on the P- and B-frames to keep the average over the GOP at the same level.
In an example the relation can be formulated as follows:
NRm' = NRu + NRu - (D -I)IA
And
NRm P B = NR11 - NR11 (D - 1) /(A - (GOP - 1))
With D as modulation depth > 1 , A as the accuracy < D and NRU as the unmodulated noise reduction and GOP is the number of frames in a GOP. In this example the P and B frames are treated equally.
The modulation depth D can be calculated from several statistics. An important parameter may be the confidence factor C. If not confident about the I-frame beat (C -> O) then D should be 1 or very close to 1, e.g. no modulation to very little modulation. The influence of C can be controlled too.
Another parameter could take into account the relevance of this whole algorithm at dark scenes. A dark scene can be evaluated in many smart ways with help of stochastic distributions and their deviations, relevance related to the size of dark surfaces, ignoring of sub-black levels etc. or in a simple way as the average luminance value of the image. Given here is that we know how dark the image is, expressed as Y. With this determined the modulation depth D can be slightly increased too when Y decreases.
At last there are the application flavors F, and Fmax giving the application a means of control over the modulation.
In an embodiment the modulation depth D look as follows:
D = l + MIN(^ 7-^β ,F, MAX ,
α is the amount of influence of C, β > 1 is the inverse amount of influence of Y , and
Y > 1 by limitation, with β rather chosen as a power function then as linear multiplier.
This provides a substantially linear relation to the gamma of the video signal.
It is remarked that it is needed to have in the above exemplary formulas an NRu level of > 0 to start with. In the formulas for NRm above, if NRU = 0 then the whole modulation makes no sense. The resulting NRm will be 0 if NRU = 0.
In this example there needs to be a sufficient amount of NRU to work with. Most digital signals have hardly to any analogue noise at all. So any conventional automatic analogue noise reduction algorithm would have set the amount of NRU to a low level because of low analogue noise levels. The NRU mentioned here preferably is a function of the conventional evaluated noise reduction level and a new evaluation of the noise reduction level based on MPEG measurement.
NRu = f(NRa,NRd)
NRa being the noise reduction level based on analogue noise measurement and NRj being the un-modulated noise reduction level based on the filtered MPEG measurement Mf.
An embodiment of the invention is illustrated in Fig. 4 to 7.
Building elements of this embodiment are:
A conventional MPEG artifact meter or any meter capable of measuring artifacts or noise in a frame.
Temporal and/or Spatial noise reduction.
(optional) Sharpening functions with coring and anti-peaking mechanisms.
Embedded processor able to perform video frame synchronized calculations.
Given the following:
An MPEG artifact meter produces a temporally unfiltered (or weakly filtered) and normalized measurement Mu.
An MPEG artifact meter produces a temporally filtered and normalized measurement Mf.
On video signals that were once MPEG compressed the unfiltered (or weakly filtered) Mu and filtered MPEG meter data Mf looks like Fig. 4. Ti is the repetition period (GOP) of the I-frame. The occurrences of I-frames coincide with the peak in the unfiltered measurement Mu.
With a simple recurring comparison function it can be detected that the unfiltered Mu data is periodically (with the I-frame or GOP period) larger ten the average. So the 'beat' of the I-frame can be detected and the location of the next I-frame can be predicted.
The modulation depth of the modulation has to be provided. This modulation depth can be provided in several manners. A simple one is a standard modulation depth related to the average value. The modulation depth is then not determined separately but follows from the average value. This can be a standard percentage modulation of the average value or a more complex, for instance non- linear function of the average value. The modulation depth may also be made dependent on the darkness of the shot. Preferably the modulation depth is, at least for a range of average image intensities a decreasing function for increasing average image intensity. The modulation depth D increases for relatively dark scenes where errors are more clearly visible. The dependence on image intensity may be such that above a certain intensity level no modulation or a very simple type of modulation is used, not dependent on image intensity, whereas below a threshold image intensity a dependence of the modulation depth on intensity is used, which becomes more complex as the intensity goes down. Some exemplary methods for determining D are given above.
Additional values for determining the modulation depth may be provided as follows.
For each time that the unfiltered MPEG artifact meter Mu is clearly bigger then the filtered MPEG artifact meter Mf exactly (within error margins) on a repetitive interval a confidence counter C can be increased (Fig. 5). For each time that the unfiltered MPEG artifact meter Mu is clearly bigger then the filtered MPEG artifact meter Mf but not on a repetitive interval, a confidence counter can be decreased. Such that a confidence C is calculated on every occurrence of an I-frame for instance by the following formula:
λ * M11 (t) ≥ Mf (t)\AND[λ *Mu (t -Tj) ≥ Mf (t - T1 )J}→ C(t - 1) + J
C(O = else → C(t -I) -I
Here λ is a factor to determine 'how clearly bigger' Mu should be then Mf on the I-frames.
Here J is a constant to be added when the event coincides with an I-frame peak in the MPEG meter.
Now that we have an MPEG Fig. Mf and a confidence factor C for the cadence we can start to control the temporal- and spatial noise reduction. The confidence factor C if low, reduces the modulation depth, if the confidence factor C is high, the modulation depth D increases.
Fig. 6 shows the diagram of temporal recursive noise reduction. The local adaptive mixer compares the image to the previous image and calculates filter strength for each pixel. The result is stored in a frame memory so this result can be used for filtering the next image. The trick of the trade is to adjust the local adaptive mixer such that a proper balance is made in the recursion factor such that the filtering is strong enough to reduce noise and MPEG artifacts, but does not introduce too much (motion) artifacts. When a signal with significant I-frame pumping is processed with a temporal recursive noise reduction algorithm then the noisier I-frame may break through the dynamic threshold of the temporal recursive noise reduction processor. The result is that the I-frame's extra noise ends up in the recursive path. This will result in just propagating the noise of the I-frame into the following B-frames. The effect of temporal recursive noise reduction is then less effective or even counter effective if not implemented and programmed exactly as a stable closed loop system. In the embodiments of the invention the data stream is analyzed in e.g. an MPEG artifact meter (MPEG AM) which provides for a measure of Mf, the cadence, i.e. where the I-frames occur, and optionally the confidence factor C. The MPEG AM is an artifact meter that has an output for indicating the position of an intraframe (I-frame). The data coming from the artifact meter are used to control the local adaptive filter in the recursive noise reduction loop RNRL (or more generally any device and method in which the noise reduction is made to run in sync with the GOP frames with a maximum on the intraframes) which is schematically indicated in the dotted rectangle. This loop RNRL forms a noise reductor to reduce the noise in the GOP frames.
Fig. 7 shows the diagram of spatial noise reduction. Spatial noise reduction is like temporal noise reduction based on a local adaptive filter too. But in stead of comparing a pixel with a pixel from a previous (recursive) frame a pixel is compared to other pixels in its direct neighborhood. This is done in a spatial correlation local adaptive filter SCLAF The trick of the trade is to adjust the local adaptive filter such that the filtering is strong enough to reduce noise and MPEG, but does not wash out too many details in the image.
Both temporal and spatial noise reduction have means of global (= per total image) strength control. The global strength control sets a filter strength tendency to the local adaptive filters in both cases.
As mentioned before the embodiment provides for an MPEG Fig. Mf and a confidence factor C. Conventional methods only have a filtered MPEG Fig. to set temporally averaged filter strength to the noise reduction functions.
It is remarked that motion can be used to determine a dynamic ratio between temporal noise reduction for still images, and spatial noise reduction for moving images.
Studies of MPEG meters in temporal domain show a clearly distinctive response of the meter output of moving and still images. After an I-frame peak the down slope of the meter values in time decreases clearly faster on moving images then on still images. If there is a lot of motion, the MPEG artifacts decay faster in time after an I-frame (due to more interpolations on sub-block shifted image data). So the down slope is steeper. This allows for a very elementary motion detector just indicating the amount of motion.
Advanced high end market digital set-top boxes include comparable image processing algorithms as a television. When this invention is applied in such a device then the cadence does not need to be 'looked for'. The location of the I-frames is given. So the confidence factor C is maximal and does not need to be determined.
The invention is also embodied in any device using the method or system in accordance with the invention, such devices including, without being restricted to television receivers, advanced digital content players and receivers/decoders. The invention can also be used in or for software/GPU video render applications and algorithms on any computer platform. All of these devices received data streams comprising intra and inter- frames. The problem of a cadence in the artifacts occurs. For all such devices the invention is useful.
Fig. 8 schematically show a device. The device has a receiver for receiving a signal (signal in) having intra and intercoded frames. The device comprises a system (which could be in hardware or in software or in a combination of hard and software) for applying a noise reduction (wherein "noise-reduction" may be noise-prevention) that is in cadence with the intraframes and has maximum at the intraframes. The noise reduced output signal is sent or internally transferred to a display part for displaying the images on a display D.
In short the invention can be described by:
To a video signal comprising groups (GOP) of intra (I-frame) and intercoded frames (P-frame, B-frame) a noise reduction is applied. The strength of the noise reduction strength has a modulation in time with a period substantially equal to the period (Ti) between intra coded frames. The noise reduction strength has a maximum substantially coinciding with the position of intra coded frames.
The invention is also embodied in any computer program comprising program code means for performing a method in accordance with the invention when said program is run on a computer as well as in any computer program product comprising program code means stored on a computer readable medium for performing a method in accordance with
the invention. Computer program products can for instance include a graphic processor for a game-console.
It is remarked that, within the concept of the invention redactor and reduction loop calculator etc. should be broadly understood to comprise e.g. any piece of hard- ware (such as a redactor or reduction loop, etc.), any circuit or sub-circuit designed for performing or aiding in a reduction or in a loop etc. as described as well as any piece of soft-ware (computer program or sub program or set of computer programs, or program code(s)) designed or programmed to perform an action in accordance with the invention as well as any combination of pieces of hardware and software acting as such, without being restricted to the below given exemplary embodiments. In embodiments more than more than one element may be combined into one piece of hardware or software. One piece of software or hard ware may also perform more than one function.
It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. The invention resides in each and every novel characteristic feature and each and every combination of characteristic features. Reference numerals in the claims do not limit their protective scope. Use of the verb "to comprise" and its conjugations does not exclude the presence of elements other than those stated in the claims. Use of the article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
The present invention has been described in terms of specific embodiments, which are illustrative of the invention and not to be construed as limiting. The invention may be implemented in a method and a device, in hardware, firmware or software, or in a combination of them. Other embodiments are within the scope of the following claims.
Claims
1. A method for noise reduction in a video signal comprising groups (GOP) of intra (I-frame) and intercoded frames (P-frame, B-frame) wherein to the frames of the video sequence a noise reduction is applied wherein the noise reduction has a noise reduction strength (NR) and the noise reduction strength has a modulation in time with a period substantially equal to the period (Ti) between intra coded frames, wherein a maximum in the modulation substantially coincides with an intra coded frame.
2. Method as claimed in claim 1 wherein the modulation depth (D) is a function of the average intensity of the image.
3. Method as claimed in claim 2 wherein the modulation depth (D) increases, at least for a range of average image intensities, as the image intensity decreases.
4. Method as claimed in any of the preceding claims wherein a confidence factor (C) is calculated which confidence factor C influences the modulation depth (D).
5. Method as claimed in any of the preceding claims, wherein the noise is reduced by a temporal recursive noise reduction.
6. Method as claimed in any of the preceding claims wherein the noise is reduced by a recursive spatial noise reduction.
7. Method as claimed in any of the preceding claims wherein an artifact measurement (MPEG AM) is performed and from the artifact measurement the position of an intracoded frame is determined.
8. Computer program comprising program code means for performing a method as claimed in any one of claims 1 to 7 when said program is run on a computer.
9. Computer program product comprising program code means stored on a computer readable medium for performing a method as claimed in any one of claims 1 to 7 when said program is run on a computer.
10. System for noise reduction in a video signal comprising groups (GOP) of intra (I-frame) and intercoded frames (P-frame, B-frame) wherein the system comprises a noise reductor (SCLAF, RNRL) to apply to the frames of the video sequence a noise reduction wherein the noise reductor (SCLAF, RNRL) is arranged such that the noise reduction has a noise reduction strength (NR) and the noise reduction strength has a modulation (D) in time with a period substantially equal to the period between intra coded frames (I-frames), wherein a maximum in the modulation substantially coincides with a intra coded frame.
11. System as claimed in claim 10, wherein the system comprises a temporal recursive noise reduction loop (RNRL)
12. System as claimed in claim 10, wherein the system comprises a spatial recursive noise reduction loop (SCLAF).
13. System as claimed in any of the claims 10 to 12 wherein the system comprises an artifact meter (MPEG AM) and the artifact meter has an output for indicating the position of an intracoded frame (I-frame).
14. Device comprising a system as claimed in any of the claims 10 to 13.
15. Device as claimed in claim 14 wherein the device is a television receiver, receiver/decoder or content player.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP06126363.8 | 2006-12-18 | ||
EP06126363 | 2006-12-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008075261A1 true WO2008075261A1 (en) | 2008-06-26 |
Family
ID=39387286
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2007/055056 WO2008075261A1 (en) | 2006-12-18 | 2007-12-12 | Automatic noise reduction improvement in video sequences |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2008075261A1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150085943A1 (en) * | 2012-04-11 | 2015-03-26 | Sharp Kabushiki Kaisha | Video processing device, video processing method, television receiver, program, and recording medium |
US10382780B2 (en) | 2017-03-24 | 2019-08-13 | Axis Ab | Method, a video encoder, and a video camera for encoding a video stream |
US10531001B2 (en) | 2017-03-24 | 2020-01-07 | Axis Ab | Controller, video camera, and method for controlling a video camera |
US10757435B2 (en) | 2016-01-22 | 2020-08-25 | Hewlett-Packard Development Company, L.P. | Video frame drift correction |
CN113542746A (en) * | 2021-07-13 | 2021-10-22 | Oppo广东移动通信有限公司 | Video encoding method and apparatus, computer readable medium, and electronic device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4500911A (en) * | 1981-05-25 | 1985-02-19 | Nippon Hoso Kyokai | Noise reduction apparatus |
EP0779742A2 (en) * | 1995-12-12 | 1997-06-18 | RCA Thomson Licensing Corporation | Noise estimation and reduction apparatus for video signal processing |
US6115071A (en) * | 1993-10-13 | 2000-09-05 | Thomson Licensing S.A. | Video signal compression apparatus using noise reduction |
GB2420040A (en) * | 2004-11-05 | 2006-05-10 | Hitachi Ltd | Image correction using additional information input with image signal |
US20060171467A1 (en) * | 2005-01-28 | 2006-08-03 | Brian Schoner | Method and system for block noise reduction |
-
2007
- 2007-12-12 WO PCT/IB2007/055056 patent/WO2008075261A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4500911A (en) * | 1981-05-25 | 1985-02-19 | Nippon Hoso Kyokai | Noise reduction apparatus |
US6115071A (en) * | 1993-10-13 | 2000-09-05 | Thomson Licensing S.A. | Video signal compression apparatus using noise reduction |
EP0779742A2 (en) * | 1995-12-12 | 1997-06-18 | RCA Thomson Licensing Corporation | Noise estimation and reduction apparatus for video signal processing |
GB2420040A (en) * | 2004-11-05 | 2006-05-10 | Hitachi Ltd | Image correction using additional information input with image signal |
US20060171467A1 (en) * | 2005-01-28 | 2006-08-03 | Brian Schoner | Method and system for block noise reduction |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150085943A1 (en) * | 2012-04-11 | 2015-03-26 | Sharp Kabushiki Kaisha | Video processing device, video processing method, television receiver, program, and recording medium |
US10757435B2 (en) | 2016-01-22 | 2020-08-25 | Hewlett-Packard Development Company, L.P. | Video frame drift correction |
US10382780B2 (en) | 2017-03-24 | 2019-08-13 | Axis Ab | Method, a video encoder, and a video camera for encoding a video stream |
US10531001B2 (en) | 2017-03-24 | 2020-01-07 | Axis Ab | Controller, video camera, and method for controlling a video camera |
CN113542746A (en) * | 2021-07-13 | 2021-10-22 | Oppo广东移动通信有限公司 | Video encoding method and apparatus, computer readable medium, and electronic device |
CN113542746B (en) * | 2021-07-13 | 2024-04-12 | Oppo广东移动通信有限公司 | Video encoding method and device, computer readable medium and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR100971601B1 (en) | Adaptive gop structure in video streaming | |
US8345750B2 (en) | Scene change detection | |
JP4444840B2 (en) | Measuring video quality | |
JP3957915B2 (en) | Fade detection device and information encoding device | |
CN111200734B (en) | Video coding method and device | |
EP2553935B1 (en) | Video quality measurement | |
US6862372B2 (en) | System for and method of sharpness enhancement using coding information and local spatial features | |
TWI477154B (en) | Method and a digital video encoder system for encoding digital video data | |
US6873657B2 (en) | Method of and system for improving temporal consistency in sharpness enhancement for a video signal | |
WO2008075261A1 (en) | Automatic noise reduction improvement in video sequences | |
JP2005525014A (en) | Sharpness enhancement system and method for encoded digital video | |
CN105872556B (en) | Video encoding method and apparatus | |
US20150249829A1 (en) | Method, Apparatus and Computer Program Product for Video Compression | |
KR20040106416A (en) | Method of processing digital images for low-rate applications | |
US8654844B1 (en) | Intra frame beating effect reduction | |
JP2009535881A (en) | Method and apparatus for encoding / transcoding and decoding | |
WO2008016600A2 (en) | Video encoding | |
US9307235B2 (en) | Video encoding system with adaptive hierarchical B-frames and method for use therewith | |
WO2005086491A1 (en) | System and method for global indication of mpeg impairments in compressed digital video | |
JP4081103B2 (en) | Video encoding device | |
US20090245386A1 (en) | Method and apparatus for encoding a flash picture occurring in a video sequence, and for decoding corresponding data for a flash picture | |
KR100714071B1 (en) | Method for encoding/decoding video sequence based on ???? using adaptively-adjusted GOP structure | |
US20120133836A1 (en) | Frame level quantization estimation | |
EP3547684B1 (en) | Method, device and system for encoding a sequence of frames in a video stream | |
US9542611B1 (en) | Logo detection for macroblock-based video processing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07849454 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007849454 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 07849454 Country of ref document: EP Kind code of ref document: A1 |