WO2000010326A2

WO2000010326A2 - Two-dimensional adjustable flicker filter

Info

Publication number: WO2000010326A2
Application number: PCT/US1999/017820
Authority: WO
Inventors: Kenneth A. Boehlke
Original assignee: Focus Enhancements, Inc.
Priority date: 1998-08-12
Filing date: 1999-08-06
Publication date: 2000-02-24
Also published as: WO2000010326A3; WO2000010326A9

Abstract

The invention is a flicker filter for use with video signals. The flicker filter of the invention has at least two user-adjustable inputs adapted to balance image quality versus flicker in the second video image. A first user-adjustable input is adapted to govern an amount of flicker suppression. A second user-adjustable input is adapted to govern an amount of blur, or sharpness. The two inputs are independently adjustable such that a user may dynamically adjust the two-dimensional system characteristics. This ability allows the circuit to be tuned to adjust pixel intensities where an amount of pixel intensity adjustment increases with decreassing boundary angle, inter alia.

Description

Title: TWO-DIMENSIONAL ADJUSTABLE FLICKER FILTER

Background of the Invention

The present invention relates generally to an apparatus and method for flicker filtering. More particularly, the invention relates to an apparatus and method for significantly reducing flicker in a video display by employing a two-dimensional flicker filter.

A video image, such as that found on a television for example, is formed by a succession of frames projected onto a phosphorescent screen, such as that found in a cathode-ray tube ("CRT"). Multiple horizontal lines of pixels with many pixels per line, in turn, form each frame.

To draw each frame, an electron beam in a CRT scans horizontally along each horizontal line. As it projects each pixel of a horizontal line in turn, the beam supplies energy to the phosphors which phosphoress, thus illuminating the pixel. The amount of energy supplied by the electron beam sets the initial intensity of the pixel, but the intensity pixel progressively degrades between scans as its phosphors give up energy in the form of light. Each pixel therefore acts like a small light that flickers at the frequency at which the pixel is scanned.

However, if the frequency at which a pixel is scanned is high enough, at least 45 Hz, a viewer will not perceive pixel flicker. This is due to the fact that past this threshold, humans can not cognitively process- the optical changes fast enough in order to perceive the flicker. Typical television systems typically, however, do not update pixels fast enough. For example an National Television Standards Committee ("NTSC") has established television and video standards in the United States (in Europe and the rest of the world, the dominant television standards are PAL and SECAM) which defines television standard as a composite video signal with a refresh rate of 60 half-frames (interlaced) per second. A television operating on the NTSC standard then updates each pixel 30 times per second, or 30 Hz. Thus, a viewer can readily perceive pixel flicker in an NTSC format display. Phase Alternating Line ("PAL"), the dominant television standard in Europe has a similar problem.

The NTSC and PAL formats use interlacing to help mask pixel flicker. Each frame is divided into two interlaced fields. One field includes all even numbered pixel rows while the other field includes all odd numbered pixel rows. hen displaying a frame, all the rows of one field are scanned and then all the rows of the other field are scanned. Thus, two vertically adjacent pixels will flicker almost 180 degrees out of sync. Since the two pixels are adjacent, they will usually have the same or nearly the same intensity, particularly when the image does not have sharp horizontal edges. In an NTSC system, the two pixels will look like a single pixel flashing at 60 Hz instead of two pixels flashing at 30 Hz each. Since 60 Hz is above the 45 Hz threshold level for flicker perception, the viewer will not perceive that the two pixels flicker. Thus, vertically adjacent pixels tend to compensate for each other's flicker.

However, an image with sharp contrasts at its edges, such as a bright rectangle displayed on a dark background for example, can be problematic. The upper or lower edge of the rectangle acts as a sharply defined horizontal boundary between areas of high and low intensity. For example, a row of pixels immediately below the horizontal lower edge of the rectangle flickers with high intensity while the row of pixels immediately above the lower rectangle edge flickers with little or no intensity. Thus, the flicker of the low intensity row of pixels will not adequately compensate for flicker of its high intensity neighboring row, and a viewer will perceive flicker in the high intensity row.

One way to reduce flicker along a horizontal intensity boundary is to filter the signal controlling the beam so as to reduce the abruptness with which image intensity changes in the vertical direction. A prior art "one-dimensional" flicker filter sets the intensity of each pixel to a weighted average of itself and its nearest two vertical neighbors. The intensity of each pixel therefore increases when a vertical neighbor is brighter and decreases when a vertical neighbor is dimmer. This reduces flicker because it ensures that vertically adjacent neighbors will flash with more nearly the same intensity. Such filtering blurs sharp horizontal intensity boundaries making an image appear fuzzy, but most viewers are willing to give up sharpness at horizontal intensity boundaries in order to reduce annoying flicker. However, such a flicker filter is not selective and thus, adjusts pixel intensities everywhere in the image, not just in areas of the image where flicker is a problem. This has the effect of reducing image shaφness thereby reducing image quality.

Accordingly, it is an object of this invention to provide a flicker filter that reduces flicker in an image.

It is another object of this invention to provide a flicker filter that maximizes image quality in two dimensions.

It is still another object of the invention to provide a flicker filter that allows a user to selectively adjust input values to compensate for variable boundary conditions.

These and other objects of the invention will be obvious and will appear hereinafter. Summary

The aforementioned and other objects are achieved by the invention which provides a flicker filter for reducing flicker in a video signal. Often, such a filter is located within a television or a video scan converter.

The flicker filter of the invention has at least two user-adjustable inputs adapted to balance image quality versus flicker in the second video image. A first user-adjustable input is adapted to govern an amount of flicker suppression. A second user-adjustable input is adapted to govern an amount of blur, or sharpness.

The two inputs are independently adjustable such that a user may dynamically adjust the two-dimensional system characteristics. This ability allows the circuit to be tune to adjust pixel intensities where an amount of pixel intensity adjustment increases with decreasing boundary angle, inter alia.

In further aspects, the invention provides methods in accord with the apparatus described above. The aforementioned and other aspects of the invention are evident in the drawings and in the description that follows.

Brief Description of the Drawings

The foregoing and other objects of this invention, the various features thereof, as well as the invention itself, may be more fully understood from the following description, when read together with the accompanying drawings in which:

Figure 1 shows a block diagram illustrating a flicker filter system in accordance with the invention;

Figure 2 shows an intensity matrix of a signal input into the flicker filter system of Figure 1;

Figures 3, 4, and 5 show illustrate 3x5 weighting function matrices;

Figure 6 shows a suitable matrix for the chroma path flicker filter;

Figure 7 illustrates a weighting the intensity path flicker filter;

Figure 8 illustrates a weighting provided by the filter;

Figure 9 illustrates a weighting provided by the filter when SHP is 0 and 0 < FLK < 1;

Figure 10 illustrates a weighting provided by the filter when FLK is 1 and SHP is 1;

Figure 11 illustrates a weighting provided by the filter when FLK is 1 and SHP is 1/2;

Figure 12 illustrates a map of pixel intensities near the horizontal intensity boundary;

Figure 13 shows a resulting frame image if a conventional 1 -dimensional flicker filter weighting is applied;

Figure 14 shows a resulting frame image if a 2-dimensional weighting is applied to Figure 10; Figure 15 illustrates intensities of pixels near the vertical intensity boundary;

Figure 16 shows a resulting frame image if a 1 -dimensional weighting distribution of Figure 10 is applied to Figure 15;

Figure 17 illustrates a resulting frame image if a 2-dimensional weighting distribution of Figure 10 is applied to the image of Figure 15.

Figure 18 illustrates intensities of pixels near the boundary;

Figure 19 illustrates a resulting image when the filter applies the 1 -dimensional weighting distribution of Figure 8 to the image of Figure 18;

Figure 20 shows a resulting frame image if a 2-dimensional weighting distribution of Figure 10 is applied to the image of Figure 18;

Figure 21 is a more detailed block diagram of the intensity path flicker filter of Figure 1;

Figure 22 illustrates a weighting and summing circuit which weights and sums the 15 outputs of the shift registers of Figure 21.

Detailed Description

While the present invention retains utility within a wide variety of video devices and may be embodied in several different forms, it is advantageously employed in connection in televisions or in connection with the conversion of a digital video signal to a television video signal, for example. In the case of conversion, the conversion is generally performed by a device commonly known as a scan converter and a flicker filter is then disposed therein. Though these are the forms of the preferred embodiments and will be described as such, these embodiments should be considered illustrative and not restrictive.

Many of the above-described problems in displaying video signals can be significantly reduced and image quality can be improved if the flicker filter strongly adjusts intensity of only pixels for which the perception of flicker is a problem. Flicker is most clearly perceived only along a sharp image intensity boundary and, therefore, the farther a pixel is from an intensity boundary, the less likely a viewer is to perceive it as flickering. Also, there becomes less need to adjust its intensity and the intensity of its vertical neighbors in order to limit perceived flicker. Moreover, the closer an image intensity boundary comes to vertical, the less likely a viewer is to perceive flicker in a pixel near that boundary. Generally while most viewers will perceive flicker along a sharp intensity boundary that is less than 20 degrees from horizontal, few viewers can perceive flicker along a boundary that is more than 35 degrees from horizontal. Thus, when a pixel is near an intensity boundary that is more than 20-35 degrees from horizontal, there is little need to adjust its intensity and the intensity of its neighbors in order to limit perceived flicker.

The flicker filter therefore should strongly adjust pixel intensities when they are near a sharp intensity boundary that- is near horizontal but should only weakly adjust pixel intensities along boundaries that are closer to vertical. The amount of pixel intensity adjustment therefore should increase with decreasing boundary angle.

In the preferred embodiment of the invention, a two-dimensional flicker filter is used that is user adjustable. These adjustments may be factory adjustments that are optimized for a specific device, a television for example, or may be controlled by an end user through a user interface. In the latter case, the user interface can be knobs or other mechanical interface. An example of a device that may allow such adjustability would be a scan converter where the scan converter is not necessarily optimized for a specific output device.

Figure 1 is a block diagram illustrating a flicker filter system in accordance with the invention. The filter system has two filter paths, one for the luma (intensity) signal YΓ_N and one for the chroma (color) signals (R-Y)_IN and (B-Y)_IN. In the luma path, an analog-to-digital ("A/D") converter digitizes the luma signal Y_IN at the pixel clock rate to produce a data sequence Y representing intensities of successive pixels along successive rows. A flicker filter then filters Y to produce another data sequence Y'. A digital-to-analog ("D/A") converter converts Y' into an output analog luma signal Y_OUT for controlling pixel intensity. An image controlled by Y_OUT will have less flicker than an image controlled by Y_IN.

The two chroma signals (R-Y)_IN and (B-Y)_]N are at half the frequency of the intensity signal Y-_N and are horizontally interlaced with one another so that they control alternate pixels along each row. In the chroma path, a commutating switch alternately applies each chroma signal to an A/D converter. After a flicker filter filters the output of the A/D converter, another commutating switch separates the flicker filter outputs into (R-Y)' and (B-Y)' color signal sequences. A pair of D/A converters then convert them into (R-Y)ouτ and (B-Y)ouτ signals. The flicker filter in the intensity signal path adjusts the intensity of each pixel in the Y_OUT signal so that it is a weighted average of itself and, in the preferred embodiment, fifteen of its neighboring pixels. One skilled in the art will recognize that the actual number of pixels which is used to create the weighted average is implementation specific.

Y'(N,M) = A*GT(N,M) + B*GT(N,M)*FLK + C*GT(N,M)*FLK*SHP[1]

In the above equation, Y'(N, M) is the intensity data value of filter output sequence Y' for the N^th pixel of row M. The value GT(N, M) is the transpose of an intensity matrix G(N, M) illustrated in Figure 2. Referring to Figure 2, the variable Y(N, M) is intensity data value conveyed in input sequence Y for the N^th pixel of row M. Thus, G(N, M) is a matrix of fifteen input sequence Y intensity data values, including the intensity at position (N, M), the intensities of its four horizontally nearest neighbor pixels along row M, and the intensities of five pixels nearest neighbor pixels along rows M-l and M+l. Matrices A, B and C are 3x5 weighting functions illustrated in Figures 3, 4 and 5, respectively. A flicker coefficient FLK and a shaφness coefficient SHP are scalar quantities provided as user input ranging between 0 and 1.

The flicker filter coefficient, FLK, governs whether the flicker filter is off or on. Any setting in between 0 and 1 governs an acceptable amount of flicker where closer to 1 creates greater flicker suppression. The shaφness coefficient, SHP, is a settable coefficient which governs an amount of blur which is acceptable. As SHP is adjusted towards 1, shaφness of text and diagonal lines are returned toward their non-flicker suppressed clarity.

The flicker filter in the chroma path is similar to the flicker filter in the luma path except for a difference in matrix C. A suitable C matrix for the chroma path flicker filter is illustrated in Figure 6. The difference arises because the two chroma signals are horizontally interlaced. There are 0's in the N-l and N+l columns in Figure 6 because pixels of alternate columns are controlled by different chroma signals. Although color flicker is normally not noticeable, the chroma signals are flicker filtered in generally the same manner as the intensity signal to maintain the spatial correlation between intensity and color.

To illustrate operation of the filter in the intensity signal path, let us first assume that flicker coefficient FLK = 0. Figure 7 illustrates the weighting the intensity path flicker filter gives to each of a 5 x 3 block of pixels when computing the adjusted intensity of the pixel at center position (N, M). Since the pixel at (N, M) has a weight of 1 and all other pixels have weight 0, equation [1] reduces to

Y'(N,M) = Y(N,M).

Since input and output intensities are the same, the flicker filter does not provide any adjustment to pixel intensity when FLK*=0.

Now assume that FLK = 1 and SHP = 0. Figure 8 illustrates the weighting provided by the filter. In such case equation [1] reduces to

Y'(N,M) = [1/4]Y(N,M+1) + [1/2]Y(N,M) + [1/4]Y(N,M-1)

Here the intensity of the pixel at position (N, M) is adjusted so that it is a weighted average of itself and its two vertically adjacent neighbors. The pixel at (N, M) is given twice the weight of its neighbors. This is the same weighting that is provided by a typical prior art one-dimensional flicker filter.

Suppose we now set SHP = 0 and 0 < FLK < 1. Figure 9 illustrates the weighting provided by the filter. Equation [1] reduces to the following:

Y'(N,M) = [FLK/4]Y(N,M+1) + [1-FLK/2]Y(N,M) + [FLK 4]Y(N,M-1) We see that the flicker coefficient FLK determines how weighting is distributed between the pixel at (N,M) and its two vertical neighbors. As FLK increases from 0 to 1 we decrease the contribution of the pixel at N,M and increase the contributions of its vertically neighboring pixels. Thus, by increasing FLK we increase the amount flicker suppression by decreasing differences in intensity between vertically adjacent pixels.

Let us now set FLK = 1 and SHP = 1. Figure 10 illustrates the weight given to each neighboring pixel when computing Y'(N, M). If we compare Figures 8 and 10, we note that when SHP increases from 0 to 1, the filter gives weight to pixels that are horizontally displaced from column N. Note also by inspection of Figure 10 that the intensity of the pixel at (N, M) is increased in proportion to the intensity of each of the 10 pixels of the neighboring rows M+l and M-l with the contribution being largest for the pixels of column N. Note however that the weights given to neighboring pixels along row M itself are negative — the intensity of the pixel at (N, M) is reduced in inverse relation to the intensity of its horizontally neighboring pixels. Flashing is more apparent when all pixels along a row are bright. Thus, when SHP is high, the filter reduces the appearance of flashing by dimming a pixel when its horizontal neighbors are bright.

Figure 11 illustrates the weighting the filter provides when FLK = 1 and

SHP = 1/2. Comparing Figures 10 and 11, we see that by decreasing SHP from 1 to 1/2 we increase the weighting given to pixels along column N and decrease the weighting of pixels horizontally displaced from column N. By comparing Figures 7-11 we see that the flicker coefficient FLK controls the overall amount of adjustment that is made to the intensity of the pixel at position (N, M), and particularly affects the vertical distribution of weighting factors. The greater the value of FLK, the greater the weight that is given to pixels on rows M+l and M-l. The shaφness coefficient SHP controls the horizontal distribution of weighting factors. The greater the value of SHP, the greater the weight that is given to pixels in columns N+l, N+2, N-l and N-2.

Assume intensity values Y range between 0 and 1. Suppose, for example, that the upper half of an image frame represented by the Y signal is very dark (intensity = 0) and that the lower half of the image frame is very light (intensity = 1). Then a map of pixel intensities near the horizontal intensity boundary would appear as in Figure 12. Without flicker filtering (i.e., with a weighting as illustrated in Figure 7), the uppermost row of pixels of intensity 1 would appear to flicker.

If we apply conventional 1-dimensional flicker filter weighting as illustrated in Figure 8, the resulting frame image would appear as in Figure 13. Note that the intensity of the row of pixels above the boundary is increased from 0 to 1/4 while the intensity of the row of pixels below the boundary is decreased from 1 to 3/4. Since the two rows flicker out of sync, apparent flickering is reduced, although shaφness at the boundary is lost.

If we now apply the 2-dimensional weighting of Figure 10, where FLK = 1 and SHP = 1, the image would appear as in Figure 14. Note that Figures 13 and 14 are similar. Where the intensity boundary is horizontal, increasing the shaφness factor SHP has no effect on pixel intensities.

Suppose now that the image is dark on the left and bright on the right. Figure 15 illustrates intensities of pixels near the vertical intensity boundary. If we apply the 1-dimensional weighting distribution of Figure 8 to the image, the result appears as in Figure 16. Note that there is no difference between Figures 15 and 16. The 1-dimensional weighting distribution of Figure 8 (FLK = 1, SHP = 0) has no affect on pixels near a vertical intensity boundary. This is desirable because no adjustment is needed. Figure 17 illustrates the result if we apply the 2-dimensional weighting distribution of Figure 10 (FLK = 1, SHP = 1) to the image of Figure 15. Note here too, no adjustment to pixel intensity is made because it isn't needed.

Let us now suppose that an image has a 45 degree diagonal boundary between areas of high and low intensity. Figure 18 illustrates intensities of pixels near the boundary. Figure 19 illustrates a resulting image when the filter applies the 1-dimensional weighting distribution of Figure 8 to the image of

Figure 18. Figure 18 illustrates that pixels above the boundary are reduced in intensity by 1/4 while pixels below the boundary are increased in intensity by 1/4. Since most observers do not perceive flicking along a shaφ intensity boundary that is more than 20-35 degrees from horizontal, most observers would not perceive flickering in the image of Figure 18. Thus, the modification of pixel intensities seen in Figure 19 resulting from the weighting distribution of Figure 8 is unnecessary. In effect, the weighting distribution of Figure 8 substantially reduces pixel shaφness along the 45 degrees intensity boundary without providing a noticeable improvement in flicker.

Suppose now we apply the 2-dimensional weighting distribution of Figure 10 to the image of Figure 18. The result is shown in Figure 20. Note that in comparing Figure 20 to Figure 19, we see that the image of Figure 20 does not make as great an adjustment to pixel intensities along the intensity boundary, and tends to shift the adjustment horizontally away from the boundary. The image of Figure 20 will have a shaφer boundary. As SHP is increased, the filter tends to limit the amount of intensity adjustment carried out near an intensity boundary, particularly when the angle of the intensity boundary becomes more vertical, where flicker is less noticeable.

A user selectively calibrates the flicker filter by initially setting shaφness coefficient SHP to 0 and then increasing the flicker coefficient FLK only as high as needed to reduce apparent flicker to an acceptable level. In doing so the user gives up some shaφness everywhere in the image. However, the user can regain much of that shaφness everywhere except near substantially horizontal intensity boundaries by thereafter increasing the shaφness coefficient SHP. This tends to reduce the amount of intensity averaging carried out at steeper boundary angles where it is not needed. The higher the SHP value the more nearly horizontal a boundary must be before the filter begins to provide substantial intensity adjustment. However, if SHP is set too high, the user will begin to notice unacceptable flicker along intensity boundaries that are nearly horizontal. Thus, the user sets SHP to the highest level that will not result in unacceptable flicker.

Figure 21 is a more detailed block diagram of the intensity path flicker filter of Figure 1. The Y sequence is progressively delayed by two delay circuits. Each delay circuit delays each pixel data value of the Y sequence by an amount of time between updates of vertically adjacent pixel rows. The Y value and the outputs of the two delay circuits are applied to inputs of three serial-in/parallel-out shift registers. In the preferred embodiment, each shift register holds five successive intensity data values. A weighting and summing circuit, illustrated in detail in Figure 22, weights and sums the fifteen outputs of the shift registers in accordance with equation [1] to produce the Y' data sequence. The chroma path flicker filter is similar to the intensity path flicker filter except that it implements the C weighting matrix of Figure 6.

The invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments • are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

Claims

ClaimsThe embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:

1. A scan converter having a processor for converting a first video signal representing a first video image into a second video signal representing a second video image, the scan converter comprising a flicker filter having at least two user-adjustable inputs adapted to balance image quality versus flicker in the second video image.

2. The scan converter in accordance with claim 1 wherein the at least two user selectable inputs comprise a first user selectable input adapted to govern an amount of flicker suppression and a second user selectable input adapted to govern shaφness.

3. The scan converter in accordance with claim 2 wherein the first user selectable input is user adjustable to adjust flicker compensation.

4. The scan converter in accordance with claim 1 wherein the second user selectable input is user adjustable to adjust shaφness.

5. The scan converter in accordance with claim 1 wherein the at least two user selectable inputs comprise a first variable adapted to govern an amount of flicker suppression and a second variable adapted to govern governs an amount of blur.

6. A two-dimensional flicker filter for removing a flicker component of an input video signal comprising: flicker means for adjusting flicker compensation; and shaφness means for adjusting shaφness control.

7. The scan converter in accordance with claim 6 wherein the flicker means and the shaφness means are variable.

8. The scan converter in accordance with claim 6 wherein the flicker filter provide both luma and chroma filtering.

9. The scan converter in accordance with claim 6 wherein the flicker filter utilizes a 5x3 flicker ^"filter.

10. The scan converter in accordance with claim 6 wherein the flicker filter is convertible into a one-dimensional flicker filter with adjustable flicker compensation by setting the shaφness means to zero.

11. A two-dimensional flicker filter for removing a flicker component of an input video signal comprising a filter adapted to adjust pixel intensities where an amount of pixel intensity adjustment increases with decreasing boundary angle.